Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
This report summarizes scanner evidence for stanfordnlp/stanza, a Python project with 7,895 GitHub stars. SynthScan examined 121,035 lines of code across 646 source files, recording 2484 pattern matches distributed across 21 syntactic categories. The legacy adjusted pattern signal is 29.3 (Elevated pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 1451 finding(s).
Are imports declared and package/API names verified? 601 finding(s).
Are wrappers, guards, and repeated structures necessary? 1404 finding(s).
Which changes need focused human review? 2484 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 2484 distinct pattern matches across 21 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 47 | // ── Layout constants ─────────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 55 | // ── Tree layout helpers ──────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 125 | // ── Drawing ──────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 207 | // ── Public API (identical to original) ──────────────────────────── | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 87 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 89 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 174 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 176 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 220 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 222 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 301 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 303 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 26 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 29 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 341 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 343 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 81 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 83 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 101 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 103 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 121 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 123 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 228 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 230 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 257 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 259 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 294 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 296 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 361 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 363 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/resources/test_list_installed.py | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/resources/test_list_installed.py | 34 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 115 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 117 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 159 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 161 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 345 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 352 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 18 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 20 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 44 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 79 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 81 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 38 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 74 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 76 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 116 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 118 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/lemma_classifier/test_contextual_preds.py | 143 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/lemma_classifier/test_contextual_preds.py | 145 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 60 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 62 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 92 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 94 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/utils/test_confusion.py | 21 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/utils/test_confusion.py | 23 | # --------------------------------------------------------------------------- | COMMENT |
| 284 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/tokenize_processor.py | 119 | def _apply_speaker_to_sentences(result_doc, segments, original_text): | CODE |
| LOW | stanza/pipeline/tokenize_processor.py | 256 | def process_pre_tokenized_text(self, input_src): | CODE |
| LOW | stanza/pipeline/tokenize_processor.py | 326 | def _process_speaker_tagged_text(self, original_text): | CODE |
| LOW | stanza/pipeline/core.py | 90 | def build_default_config_option(model_specs): | CODE |
| LOW | stanza/pipeline/core.py | 163 | def normalize_download_method(download_method): | CODE |
| LOW | stanza/pipeline/processor.py | 286 | def register_processor_variant(name, variant): | CODE |
| LOW | stanza/pipeline/demo/stanza-brat.js | 211 | function ConstituencyParseProcessor() { | CODE |
| LOW | stanza/resources/prepare_resources.py | 183 | def get_lemma_pretrain_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 213 | def get_tokenizer_charlm_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 216 | def get_tokenizer_dependencies(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 223 | def get_depparse_charlm_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 226 | def get_depparse_dependencies(lang, package): | CODE |
| LOW | stanza/resources/prepare_resources.py | 260 | def get_sentiment_dependencies(lang, package): | CODE |
| LOW | stanza/resources/prepare_resources.py | 363 | def get_default_depparse_package(lang, ud_package, known_resources): | CODE |
| LOW | stanza/resources/prepare_resources.py | 510 | def get_default_optional_processors(resources, lang): | CODE |
| LOW | stanza/resources/prepare_resources.py | 520 | def update_processor_add_transformer(resources, lang, current_processors, processor, transformer): | CODE |
| LOW | stanza/resources/installation.py | 182 | def installed_corenlp_version(dir): | CODE |
| LOW | stanza/resources/common.py | 468 | def process_pipeline_parameters(lang, model_dir, package, processors): | CODE |
| LOW | stanza/tests/__init__.py | 127 | def compare_ignoring_whitespace(predicted, expected): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 79 | def test_register_nonprocessor(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 96 | def test_register_processor_variant(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 117 | def test_register_processor_variant_with_override(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 123 | def test_register_nonprocessor_variant(): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 337 | def test_tokenize_ssplit_robustness(basic_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 350 | def test_pretokenized_multidoc(pretokenized_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 391 | def test_postprocessor_typeerror(): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 406 | def test_zh_tokenizer_skip_newline(zh_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 412 | def test_zh_tokenizer_skip_newline_offsets(zh_pipeline): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 327 | def test_sentence_indices_multidoc(self, processed_multidoc): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 332 | def test_dependency_parse_multidoc(self, processed_multidoc): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 338 | def processed_multidoc_variant(self): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 344 | def test_dependency_parse_multidoc_variant(self, processed_multidoc_variant): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 66 | def test_download_missing_ner_model(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 91 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 117 | def test_download_missing_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 140 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 164 | def test_download_resources_overwrites(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 177 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 202 | def test_reuse_resources_overwrites(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 226 | def test_download_not_repeated(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 273 | def check_download_method_updates(download_method): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 294 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 318 | def test_download_fixed_reuse_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 324 | def test_download_fixed_download_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 371 | def test_empty_unknown_language(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 378 | def test_unknown_language_tokenizer(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 397 | def test_unknown_language_mwt(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_pipeline_multi_doc.py | 10 | def test_process_many_strings(): | CODE |
| LOW | stanza/tests/pipeline/test_pipeline_multi_doc.py | 33 | def test_process_many_documents(): | CODE |
| LOW | stanza/tests/pipeline/test_requirements.py | 27 | def test_missing_requirements(): | CODE |
| LOW | stanza/tests/pipeline/test_coref_speaker.py | 16 | def test_pipeline_passes_speakers_to_coref_model(): | CODE |
| LOW | stanza/tests/pipeline/test_lemmatizer.py | 124 | def test_latin_caseless_lemmatizer(): | STRING |
| LOW | stanza/tests/pipeline/test_lemmatizer.py | 139 | def test_contextual_lemmatizer(): | STRING |
| LOW | stanza/tests/pipeline/test_depparse.py | 77 | def test_depparse_with_pretagged_doc(): | STRING |
| LOW | stanza/tests/pipeline/test_depparse.py | 88 | def test_raises_requirements_exception_if_pretagged_not_passed(): | STRING |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 91 | def test_parse_no_tags_returns_single_unlabeled_segment(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 95 | def test_parse_single_tag_at_start(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 110 | def test_parse_unlabeled_prefix(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 117 | def test_parse_multi_char_label(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 125 | def test_parse_curly_brace_delimiter(): | CODE |
| 883 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | demo/pipeline_demo.py | 7 | CODE | |
| LOW | stanza/__init__.py | 1 | CODE | |
| LOW | stanza/__init__.py | 1 | CODE | |
| LOW | stanza/__init__.py | 2 | CODE | |
| LOW | stanza/__init__.py | 3 | CODE | |
| LOW | stanza/__init__.py | 4 | CODE | |
| LOW | stanza/__init__.py | 5 | CODE | |
| LOW | stanza/__init__.py | 5 | CODE | |
| LOW | stanza/__init__.py | 6 | CODE | |
| LOW | stanza/__init__.py | 6 | CODE | |
| LOW | stanza/__init__.py | 7 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 6 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 15 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 17 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 21 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 22 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 23 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 24 | CODE | |
| LOW | stanza/pipeline/langid_processor.py | 7 | CODE | |
| LOW | stanza/pipeline/langid_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/constituency_processor.py | 7 | CODE | |
| LOW | stanza/pipeline/constituency_processor.py | 10 | CODE | |
| LOW | stanza/pipeline/pos_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/depparse_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/depparse_processor.py | 16 | CODE | |
| LOW | stanza/pipeline/sentiment_processor.py | 19 | CODE | |
| LOW | stanza/pipeline/coref_processor.py | 9 | CODE | |
| LOW | stanza/pipeline/coref_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/core.py | 9 | CODE | |
| LOW | stanza/pipeline/core.py | 10 | CODE | |
| LOW | stanza/pipeline/core.py | 12 | CODE | |
| LOW | stanza/pipeline/core.py | 15 | CODE | |
| LOW | stanza/pipeline/core.py | 20 | CODE | |
| LOW | stanza/pipeline/core.py | 22 | CODE | |
| LOW | stanza/pipeline/core.py | 23 | CODE | |
| LOW | stanza/pipeline/core.py | 24 | CODE | |
| LOW | stanza/pipeline/core.py | 25 | CODE | |
| LOW | stanza/pipeline/core.py | 26 | CODE | |
| LOW | stanza/pipeline/core.py | 27 | CODE | |
| LOW | stanza/pipeline/core.py | 28 | CODE | |
| LOW | stanza/pipeline/core.py | 29 | CODE | |
| LOW | stanza/pipeline/core.py | 30 | CODE | |
| LOW | stanza/pipeline/core.py | 31 | CODE | |
| LOW | stanza/pipeline/core.py | 32 | CODE | |
| LOW | stanza/pipeline/multilingual.py | 13 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 11 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 15 | CODE | |
| LOW | stanza/pipeline/lemma_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 5 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 11 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 7 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 18 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 19 | CODE | |
| LOW | stanza/pipeline/external/pythainlp.py | 16 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 24 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/tests/pipeline/test_pipeline_mwt_expander.py | 8 | CODE | |
| 518 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/tokenize_processor.py | 94 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 119 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 378 | CODE | |
| LOW | stanza/pipeline/core.py | 115 | CODE | |
| LOW | stanza/pipeline/core.py | 178 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 37 | CODE | |
| LOW | stanza/pipeline/lemma_processor.py | 69 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 28 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 279 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 385 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 610 | CODE | |
| LOW | stanza/resources/common.py | 147 | CODE | |
| LOW | stanza/resources/common.py | 243 | CODE | |
| LOW | stanza/resources/common.py | 267 | CODE | |
| LOW | stanza/resources/common.py | 468 | CODE | |
| LOW | stanza/resources/list_installed.py | 57 | CODE | |
| LOW | stanza/tests/utils/test_conll_offsets.py | 88 | CODE | |
| LOW | stanza/tests/constituency/test_trainer.py | 610 | CODE | |
| LOW | stanza/tests/constituency/test_trainer.py | 647 | CODE | |
| LOW | stanza/tests/tokenization/test_tokenizer_training.py | 47 | CODE | |
| LOW | …/tests/tokenization/test_tokenize_data_augmentation.py | 1043 | CODE | |
| LOW | stanza/tests/pos/test_data.py | 102 | CODE | |
| LOW | stanza/tests/pos/test_data.py | 498 | CODE | |
| LOW | stanza/tests/classifiers/test_classifier.py | 267 | CODE | |
| LOW | stanza/server/java_protobuf_requests.py | 206 | CODE | |
| LOW | stanza/server/java_protobuf_requests.py | 290 | CODE | |
| LOW | stanza/server/ssurgeon.py | 54 | CODE | |
| LOW | stanza/server/ssurgeon.py | 129 | CODE | |
| LOW | stanza/server/ssurgeon.py | 250 | CODE | |
| LOW | stanza/server/client.py | 129 | CODE | |
| LOW | stanza/server/client.py | 257 | CODE | |
| LOW | stanza/server/ud_enhancer.py | 9 | CODE | |
| LOW | stanza/server/main.py | 33 | CODE | |
| LOW | stanza/server/semgrex.py | 156 | CODE | |
| LOW | stanza/utils/conll.py | 131 | CODE | |
| LOW | stanza/utils/conll.py | 173 | CODE | |
| LOW | stanza/utils/conll.py | 225 | CODE | |
| LOW | stanza/utils/conll.py | 247 | CODE | |
| LOW | stanza/utils/conll.py | 268 | CODE | |
| LOW | stanza/utils/conll.py | 389 | CODE | |
| LOW | …anza/utils/visualization/conll_deprel_visualization.py | 10 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 21 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 97 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 249 | CODE | |
| LOW | stanza/utils/visualization/dependency_visualization.py | 12 | CODE | |
| LOW | stanza/utils/visualization/ner_visualization.py | 14 | CODE | |
| LOW | stanza/utils/visualization/semgrex_app.py | 107 | CODE | |
| LOW | stanza/utils/visualization/semgrex_app.py | 255 | CODE | |
| LOW | stanza/utils/ner/flair_ner_tag_dataset.py | 14 | CODE | |
| LOW | stanza/utils/ner/spacy_ner_tag_dataset.py | 55 | CODE | |
| LOW | stanza/utils/training/separate_ner_pretrain.py | 37 | CODE | |
| LOW | stanza/utils/training/common.py | 81 | CODE | |
| LOW | stanza/utils/training/common.py | 309 | CODE | |
| LOW | stanza/utils/training/common.py | 344 | CODE | |
| LOW | stanza/utils/training/common.py | 40 | CODE | |
| LOW | stanza/utils/training/run_pos.py | 46 | CODE | |
| LOW | stanza/utils/training/run_lemma.py | 107 | CODE | |
| LOW | stanza/utils/datasets/prepare_mwt_treebank.py | 34 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_data.py | 60 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_treebank.py | 183 | CODE | |
| 249 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | stanza/pipeline/external/sudachipy.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/pythainlp.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/jieba.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/spacy.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/tests/server/test_ssurgeon.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/server/ssurgeon.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/utils/visualization/constants.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/tests/server/test_server_start.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/server/test_server_request.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/server/test_server_misc.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/tokenization/test_tokenize_utils.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/depparse/test_parser.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/lemma/test_data.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | …/tests/tokenization/test_tokenize_data_augmentation.py | 0 | a leading ¿ plus a different mark (¡) elsewhere in the sentence must also be blocked, not just a repeat of the same lead | STRING |
| HIGH | stanza/tests/depparse/test_depparse_data.py | 0 | a leading ¿ plus a different mark (¡) elsewhere in the sentence must also be blocked, not just a repeat of the same lead | STRING |
| HIGH | stanza/tests/pos/test_data.py | 0 | a leading ¿ plus a different mark (¡) elsewhere in the sentence must also be blocked, not just a repeat of the same lead | STRING |
| HIGH | stanza/tests/depparse/test_parser.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/depparse/parser_training.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/depparse/test_depparse_data.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/tests/common/test_utils.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/tests/pos/test_data.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/server/ssurgeon.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/tsurgeon.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/ud_enhancer.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/parser_eval.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/semgrex.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/utils/datasets/prepare_pos_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/utils/datasets/prepare_lemma_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/utils/datasets/prepare_mwt_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/models/ner/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/mwt/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/depparse/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/pos/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/lemma/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/constituency/in_order_compound_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/constituency/top_down_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/depparse/transition/dynamic_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/coref/pairwise_encoder.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| HIGH | stanza/models/coref/word_encoder.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| HIGH | stanza/models/coref/span_predictor.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/__init__.py | 21 | COMMENT | |
| LOW | stanza/pipeline/demo/stanza-brat.js | 481 | // | COMMENT |
| LOW | stanza/resources/default_packages.py | 501 | default transformers to use for various languages | COMMENT |
| LOW | stanza/resources/default_packages.py | 521 | # no transformer 90.19 91.26 | COMMENT |
| LOW | stanza/resources/default_packages.py | 541 | # alexanderfalk/danbert-small-cased 0.8236 0.8286 | COMMENT |
| LOW | stanza/resources/default_packages.py | 561 | # model dev text | COMMENT |
| LOW | stanza/resources/default_packages.py | 581 | # german/electra 89.98 88.66 | COMMENT |
| LOW | stanza/resources/default_packages.py | 601 | COMMENT | |
| LOW | stanza/resources/default_packages.py | 621 | # electra-small: 92.17 90.02 88.25 87.66 88.25 | COMMENT |
| LOW | stanza/resources/default_packages.py | 641 | # TODO need to test, possibly compare with others | COMMENT |
| LOW | stanza/resources/default_packages.py | 661 | COMMENT | |
| LOW | stanza/resources/default_packages.py | 681 | # benjamin/roberta-base-wechsel-french | COMMENT |
| LOW | stanza/resources/default_packages.py | 701 | # Microbert MXP 0.8916 0.7742 | COMMENT |
| LOW | stanza/resources/default_packages.py | 721 | # 97.09 97.09 92.36 91.28 | COMMENT |
| LOW | stanza/resources/default_packages.py | 741 | # bertic 96.86 96.65 91.32 91.77 | COMMENT |
| LOW | stanza/resources/default_packages.py | 761 | # indobenchmark/indobert-base-p2 90.09 | COMMENT |
| LOW | stanza/resources/default_packages.py | 781 | # dbmdz/bert-base-italian-cased 0.8079 | COMMENT |
| LOW | stanza/resources/default_packages.py | 801 | # but they require different tokenizers instead of being | COMMENT |
| LOW | stanza/resources/default_packages.py | 821 | # or | COMMENT |
| LOW | stanza/resources/default_packages.py | 841 | # GroNLP/bert-base-dutch-cased 94.30 93.26 | COMMENT |
| LOW | stanza/resources/default_packages.py | 861 | # adalbertojunior/distilbert-portuguese-cased: 0.9300 | COMMENT |
| LOW | stanza/resources/default_packages.py | 881 | # EMBEDDIA/sloberta 94.07 94.88 | COMMENT |
| LOW | stanza/resources/default_packages.py | 901 | # classla/bcms-bertic 92.81 93.45 | COMMENT |
| LOW | stanza/resources/default_packages.py | 921 | # Tamil options: quite a few, need to run a bunch of experiments | COMMENT |
| LOW | stanza/resources/default_packages.py | 941 | # this is clearly better than no transformer on a couple datasets: | COMMENT |
| LOW | stanza/resources/default_packages.py | 961 | "vi": "vinai/phobert-large", | COMMENT |
| LOW | stanza/tests/constituency/test_top_down_oracle.py | 81 | # and then the rest: | COMMENT |
| LOW | …/tests/tokenization/test_tokenize_data_augmentation.py | 81 | 'use_dictionary': False, | COMMENT |
| LOW | …/tests/tokenization/test_tokenize_data_augmentation.py | 961 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | stanza/tests/tokenization/test_tokenization_lst20.py | 81 | COMMENT | |
| LOW | stanza/tests/tokenization/test_tokenization_lst20.py | 101 | # รายงาน 6 | COMMENT |
| LOW | stanza/tests/depparse/test_depparse_data.py | 121 | # separate Dataset class (mirroring stanza.models.pos.data.Dataset), which | COMMENT |
| LOW | stanza/tests/depparse/test_depparse_data.py | 621 | train_batch[1] | COMMENT |
| LOW | stanza/tests/depparse/test_depparse_data.py | 921 | train_batch = _build_train_loader(NOPUNCT_ELIGIBLE_SAMPLE, extra_args={'augment_nopunct': 0.5}) | COMMENT |
| LOW | stanza/tests/pos/test_data.py | 401 | # drop_initial_punct | COMMENT |
| LOW | stanza/utils/datasets/indic/mixed_indic_dataset.py | 561 | # language at all. As soon as the target has any data of its own, dev and | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_icepahc.py | 21 | (NP (D-D þessu-þessi))) | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_icepahc.py | 41 | # (P í) | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_it_vit.py | 501 | # but the corresponding ' is skipped in the con version of VIT, | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_it_vit.py | 521 | # and before you ask, there are also clitics which are | COMMENT |
| LOW | stanza/utils/datasets/coref/convert_hebrew_iahlt.py | 101 | # expanded_end = min(len(text), mention_end + 10) | COMMENT |
| LOW | stanza/utils/constituency/condense_output_layers.py | 341 | # | COMMENT |
| LOW | stanza/utils/constituency/condense_output_layers.py | 361 | # middle_output_sizes = self.args.get('output_layer_sizes', [self.hidden_size] * middle_layers) | COMMENT |
| LOW | stanza/utils/charlm/make_lm_data.py | 361 | fout.writelines(buffers[bucket_idx]) | COMMENT |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 101 | # so it's in a predictable, already-known location, but it's a separate | COMMENT |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 121 | # Stanza lookup. | COMMENT |
| LOW | stanza/models/classifier.py | 121 | # For the most part, these values are for the constituency parser. | COMMENT |
| LOW | stanza/models/classifier.py | 241 | # dev set macro f1 scores on 3 class problems | COMMENT |
| LOW | stanza/models/parser.py | 61 | # Unfortunately, the same general improvement occurs when using | COMMENT |
| LOW | stanza/models/parser.py | 161 | # on several different datasets (using a transformer as the input embedding) | COMMENT |
| LOW | stanza/models/parser.py | 181 | # were a clear improvement over AdaDelta+Adam | COMMENT |
| LOW | stanza/models/constituency_parser.py | 201 | parser.add_argument('--charlm_backward_file', type=str, default=None, help="Exact path to use for backward charlm") | COMMENT |
| LOW | stanza/models/constituency_parser.py | 221 | # 5 layers 0.892064 (299) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 241 | # 150 with no finetuning | COMMENT |
| LOW | stanza/models/constituency_parser.py | 261 | # observation that at the 150 iteration mark, 0.09 was winning: | COMMENT |
| LOW | stanza/models/constituency_parser.py | 281 | # 1: 0.900594 (226) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 301 | # 0.004: 0.899566 (290) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 381 | # | COMMENT |
| LOW | stanza/models/constituency_parser.py | 401 | parser.add_argument('--deactivated_oracle_levels', type=str, default=None, help='Temporarily turn off a default orac | COMMENT |
| LOW | stanza/models/constituency_parser.py | 441 | # baseline is an 80.6 model that occurs when trained using adadelta, lr 1.0 | COMMENT |
| 74 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 11 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 12 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 22 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 23 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 30 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 31 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 39 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 40 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 49 | stack = stack.push(i) | CODE |
| HIGH | stanza/models/constituency/transformer_tree_stack.py | 189 | new_stacks.append(stack.push(value=Node(node_value, new_key_stack, new_value_stack, output))) | CODE |
| HIGH | stanza/models/constituency/base_model.py | 503 | return [stack.push(constituent) for stack, constituent in zip(constituent_stacks, constituents)] | CODE |
| HIGH | stanza/models/constituency/base_model.py | 509 | return [stack.push(transition) for stack, transition in zip(transition_stacks, transitions)] | CODE |
| HIGH | stanza/models/constituency/lstm_tree_stack.py | 94 | new_stacks = [stack.push(Node(transition, hx[:, i, :], cx[:, i, :], last_layer[i])) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | stanza/resources/list_installed.py | 44 | except OSError: | CODE |
| HIGH | stanza/tests/server/test_server_start.py | 209 | except AnnotationException as ae: | CODE |
| HIGH | stanza/tests/common/test_utils.py | 157 | except ValueError: | CODE |
| HIGH | stanza/tests/common/test_utils.py | 176 | except ValueError: | CODE |
| HIGH | stanza/server/ssurgeon.py | 254 | except AttributeError: | CODE |
| HIGH | stanza/server/client.py | 201 | except ShouldRetryException: | CODE |
| HIGH | stanza/server/client.py | 214 | except ShouldRetryException: | CODE |
| HIGH | stanza/server/client.py | 178 | except subprocess.TimeoutExpired: | CODE |
| HIGH | stanza/utils/get_tqdm.py | 24 | except ImportError: | CODE |
| HIGH | stanza/utils/training/common.py | 243 | except UnknownLanguageError: | CODE |
| HIGH | stanza/utils/datasets/tokenization/convert_th_best.py | 30 | except ImportError: | CODE |
| HIGH | …ils/datasets/tokenization/process_thai_tokenization.py | 6 | except ImportError: | CODE |
| HIGH | stanza/utils/charlm/make_lm_data.py | 210 | except (subprocess.CalledProcessError, FileNotFoundError, ValueError, IndexError): | CODE |
| HIGH | stanza/utils/charlm/community_oscar_dedup.py | 422 | except OSError: | CODE |
| HIGH | stanza/models/depparse/trainer.py | 14 | except ImportError: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/resources/default_packages.py | 907 | # Certainly it looks like the original bert-base is best, but we | COMMENT |
| LOW | stanza/tests/__init__.py | 107 | # just return if path doesn't exist | COMMENT |
| LOW | stanza/utils/conll.py | 416 | else: # no comments defined a new doc_id, so just add it to the current document | CODE |
| LOW | stanza/utils/datasets/dataset_retagging.py | 67 | # TODO: just create a Pipeline for the retagging instead? | COMMENT |
| MEDIUM | stanza/utils/datasets/slovenian/sloleks_lemmas.py | 63 | # We want unique forms only (some paradigm slots share surface forms) | COMMENT |
| MEDIUM | stanza/models/constituency_parser.py | 625 | # When using word_dropout and predict_dropout in conjunction with relu, one particular experiment produced the follo | COMMENT |
| LOW | stanza/models/lemma_classifier/train_lstm_model.py | 57 | # TODO: just pass around the args instead | COMMENT |
| LOW | stanza/models/constituency/in_order_compound_oracle.py | 78 | # no fix is possible, so we just return here | COMMENT |
| MEDIUM | stanza/models/constituency/lstm_model.py | 169 | # Essentially C Linears stacked on top of each other, | COMMENT |
| MEDIUM | stanza/models/tokenization/data.py | 518 | # colon -- "Fax:", "Cell:", "Job Group:", "Notice Regarding:". Essentially | COMMENT |
| LOW | stanza/models/common/pretrain.py | 273 | # if we can't find it anywhere, just return the first location searched... | COMMENT |
| LOW | stanza/models/common/bert_embedding.py | 506 | # after all, we just set the first one to be 0 | COMMENT |
| MEDIUM | stanza/models/pos/vocab.py | 38 | # when using the __len__ / __getitem__ paradigm, | COMMENT |
| LOW | stanza/models/coref/pairwise_encoder.py | 78 | # if speaker is not found in the doc, simply return "speaker#1" for all the speakers | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/core.py | 178 | CODE | |
| LOW | stanza/pipeline/multilingual.py | 40 | CODE | |
| LOW | stanza/resources/common.py | 648 | CODE | |
| LOW | stanza/tests/pos/test_xpos_vocab_factory.py | 56 | CODE | |
| LOW | stanza/server/client.py | 257 | CODE | |
| LOW | stanza/models/charlm.py | 40 | CODE | |
| LOW | stanza/models/ner/trainer.py | 65 | CODE | |
| LOW | stanza/models/mwt/data.py | 121 | CODE | |
| LOW | stanza/models/mwt/data.py | 156 | CODE | |
| LOW | stanza/models/lemma_classifier/transformer_model.py | 88 | CODE | |
| LOW | stanza/models/lemma_classifier/lstm_model.py | 214 | CODE | |
| LOW | stanza/models/constituency/transformer_tree_stack.py | 103 | CODE | |
| LOW | stanza/models/constituency/label_attention.py | 625 | CODE | |
| LOW | stanza/models/constituency/parser_training.py | 299 | CODE | |
| LOW | stanza/models/constituency/positional_encoding.py | 89 | CODE | |
| LOW | stanza/models/constituency/partitioned_transformer.py | 227 | CODE | |
| LOW | stanza/models/tokenization/trainer.py | 17 | CODE | |
| LOW | stanza/models/common/warmup_plateau_scheduler.py | 119 | CODE | |
| LOW | stanza/models/common/biaffine.py | 28 | CODE | |
| LOW | stanza/models/common/utils.py | 271 | CODE | |
| LOW | stanza/models/common/utils.py | 322 | CODE | |
| LOW | stanza/models/common/bert_embedding.py | 288 | CODE | |
| LOW | stanza/models/common/dropout.py | 71 | CODE | |
| LOW | stanza/models/common/hlstm.py | 60 | CODE | |
| LOW | stanza/models/pos/data.py | 393 | CODE | |
| LOW | stanza/models/lemma/data.py | 210 | CODE | |
| LOW | stanza/models/classifiers/cnn_classifier.py | 508 | CODE | |
| LOW | stanza/models/classifiers/constituency_classifier.py | 72 | CODE | |
| LOW | stanza/models/coref/anaphoricity_scorer.py | 122 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/resources/installation.py | 74 | except Exception as e: | CODE |
| LOW | stanza/resources/installation.py | 146 | except Exception as e: | CODE |
| LOW | stanza/resources/installation.py | 164 | except Exception as e: | CODE |
| LOW | stanza/resources/installation.py | 249 | except Exception as e: | CODE |
| LOW | stanza/resources/installation.py | 292 | except Exception as e: | CODE |
| LOW | stanza/tests/server/test_server_start.py | 211 | except Exception as e: | CODE |
| LOW | stanza/tests/common/test_foundation_cache.py | 178 | except Exception as e: | CODE |
| MEDIUM | stanza/tests/common/test_foundation_cache.py | 174 | def load(): | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 175 | except Exception as e: | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 215 | except Exception as e: | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 236 | except Exception as e: | CODE |
| LOW | stanza/server/ssurgeon.py | 79 | except Exception as e: | CODE |
| LOW | stanza/server/ssurgeon.py | 209 | except Exception as e: | CODE |
| LOW | stanza/server/parser_eval.py | 40 | except Exception as e: | CODE |
| LOW | stanza/utils/training/run_ner.py | 111 | except Exception as e: | CODE |
| MEDIUM | stanza/utils/datasets/ner/convert_amt.py | 204 | print("Error: no documents found in the input file!") | CODE |
| LOW | stanza/utils/datasets/constituency/convert_ctb.py | 191 | except Exception as e: | CODE |
| LOW | …nza/utils/datasets/depparse/assemble_silver_dataset.py | 53 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 315 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 338 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_dedup.py | 348 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_dedup.py | 376 | except Exception as e: | CODE |
| LOW⚡ | …nza/utils/charlm/community_oscar_inspect_similarity.py | 176 | except Exception: | CODE |
| LOW | stanza/models/pos/trainer.py | 155 | except Exception as e: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/server/client.py | 33 | # Check if str is CoreNLP supported language | COMMENT |
| LOW | stanza/server/client.py | 194 | # Check if the service is active and alive | COMMENT |
| LOW | stanza/utils/default_paths.py | 26 | # Set directories to store external word vector data | COMMENT |
| LOW | scripts/config.sh | 5 | # Set UDBASE to the location of UD data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 16 | # Set NERBASE to the location of NER data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 25 | # Set CONSTITUENCY_BASE to the location of NER data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 34 | # Set directories to store processed training/evaluation files | COMMENT |
| LOW | scripts/config.sh | 50 | # Set directories to store external word vector data | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1070 | $('#text').attr('placeholder', 'على سبيل المثال، قفز الثعلب البني السريع فوق الكلب الكسول.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1072 | $('#text').attr('placeholder', 'e.g., The quick brown fox jumped over the lazy dog.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1074 | $('#text').attr('placeholder', '例如，快速的棕色狐狸跳过了懒惰的狗。'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1076 | $('#text').attr('placeholder', '例如，快速的棕色狐狸跳過了懶惰的狗。'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1078 | $('#text').attr('placeholder', 'Par exemple, le renard brun rapide a sauté sur le chien paresseux.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1080 | $('#text').attr('placeholder', 'Z. B. sprang der schnelle braune Fuchs über den faulen Hund.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1082 | $('#text').attr('placeholder', 'Por ejemplo, el rápido zorro marrón saltó sobre el perro perezoso.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1084 | $('#text').attr('placeholder', 'میرا نام علی ہے'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1086 | $('#text').attr('placeholder', 'Unknown language for placeholder query: ' + $('#language').val()); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/pipeline/external/spacy.py | 37 | # Create a Tokenizer with the default settings for English | COMMENT |
| MEDIUM | stanza/utils/datasets/constituency/vtb_split.py | 76 | # Create a random shuffle list of the file names in the original directory | COMMENT |
| MEDIUM | stanza/models/common/build_short_name_to_treebank.py | 39 | fout.write("# This module is autogenerated by build_short_name_to_treebank.py\n") | CODE |
| MEDIUM | stanza/models/common/short_name_to_treebank.py | 1 | # This module is autogenerated by build_short_name_to_treebank.py | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | stanza/utils/training/separate_ner_pretrain.py | 193 | trainer.model.delta_emb.weight.data.copy_(delta_vectors) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 74 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 80 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 59 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 65 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 74 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 80 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 59 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 65 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | setup.py | 74 | # simple. Or you can use find_packages(). | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/server/client.py | 779 | __all__ = ["CoreNLPClient", "AnnotationException", "TimeoutException", "to_text"] | CODE |
| LOW | stanza/utils/lemma/convert_lemma_dict.py | 32 | logger = logging.getLogger(__name__) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/utils/datasets/sentiment/process_es_tass2020.py | 157 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/models/constituency/transition_sequence.py | 84 | def helper(tree): | CODE |