Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages
This report presents the forensic synthetic code analysis of stanfordnlp/stanza, a Python project with 7,858 GitHub stars. SynthScan v2.0 examined 114,226 lines of code across 631 source files, recording 2231 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 27.8 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 2231 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 47 | // ── Layout constants ─────────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 55 | // ── Tree layout helpers ──────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 125 | // ── Drawing ──────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | stanza/pipeline/demo/stanza-parseviewer.js | 207 | // ── Public API (identical to original) ──────────────────────────── | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 87 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 89 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 174 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 176 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 220 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 222 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 301 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 303 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 26 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 29 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 341 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/pipeline/test_tokenize_speaker.py | 343 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 81 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 83 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 101 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 103 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 121 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 123 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 228 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 230 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 257 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 259 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 294 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 296 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 361 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/resources/test_list_installed.py | 363 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/resources/test_list_installed.py | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/resources/test_list_installed.py | 34 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 115 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 117 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 159 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 161 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 345 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/mwt/test_mwt_training.py | 352 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 18 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 20 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 44 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 79 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …a/tests/lemma_classifier/test_lemma_classifier_base.py | 81 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 38 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 74 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 76 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 116 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM | stanza/tests/lemma_classifier/test_contextual_preds.py | 118 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/lemma_classifier/test_contextual_preds.py | 143 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/lemma_classifier/test_contextual_preds.py | 145 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 60 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 62 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 92 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | stanza/tests/utils/test_confusion.py | 94 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/utils/test_confusion.py | 21 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | stanza/tests/utils/test_confusion.py | 23 | # --------------------------------------------------------------------------- | COMMENT |
| 242 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/tokenize_processor.py | 119 | def _apply_speaker_to_sentences(result_doc, segments, original_text): | CODE |
| LOW | stanza/pipeline/tokenize_processor.py | 256 | def process_pre_tokenized_text(self, input_src): | CODE |
| LOW | stanza/pipeline/tokenize_processor.py | 326 | def _process_speaker_tagged_text(self, original_text): | CODE |
| LOW | stanza/pipeline/core.py | 90 | def build_default_config_option(model_specs): | CODE |
| LOW | stanza/pipeline/core.py | 163 | def normalize_download_method(download_method): | CODE |
| LOW | stanza/pipeline/processor.py | 286 | def register_processor_variant(name, variant): | CODE |
| LOW | stanza/pipeline/demo/stanza-brat.js | 211 | function ConstituencyParseProcessor() { | CODE |
| LOW | stanza/resources/prepare_resources.py | 181 | def get_lemma_pretrain_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 211 | def get_tokenizer_charlm_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 214 | def get_tokenizer_dependencies(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 221 | def get_depparse_charlm_package(lang, package): | CODE |
| LOW⚡ | stanza/resources/prepare_resources.py | 224 | def get_depparse_dependencies(lang, package): | CODE |
| LOW | stanza/resources/prepare_resources.py | 258 | def get_sentiment_dependencies(lang, package): | CODE |
| LOW | stanza/resources/prepare_resources.py | 361 | def get_default_depparse_package(lang, ud_package, known_resources): | CODE |
| LOW | stanza/resources/prepare_resources.py | 508 | def get_default_optional_processors(resources, lang): | CODE |
| LOW | stanza/resources/prepare_resources.py | 518 | def update_processor_add_transformer(resources, lang, current_processors, processor, transformer): | CODE |
| LOW | stanza/resources/common.py | 468 | def process_pipeline_parameters(lang, model_dir, package, processors): | CODE |
| LOW | stanza/tests/__init__.py | 109 | def compare_ignoring_whitespace(predicted, expected): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 79 | def test_register_nonprocessor(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 96 | def test_register_processor_variant(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 117 | def test_register_processor_variant_with_override(): | CODE |
| LOW | stanza/tests/pipeline/test_decorators.py | 123 | def test_register_nonprocessor_variant(): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 337 | def test_tokenize_ssplit_robustness(basic_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 350 | def test_pretokenized_multidoc(pretokenized_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 391 | def test_postprocessor_typeerror(): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 406 | def test_zh_tokenizer_skip_newline(zh_pipeline): | CODE |
| LOW | stanza/tests/pipeline/test_tokenizer.py | 412 | def test_zh_tokenizer_skip_newline_offsets(zh_pipeline): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 327 | def test_sentence_indices_multidoc(self, processed_multidoc): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 332 | def test_dependency_parse_multidoc(self, processed_multidoc): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 338 | def processed_multidoc_variant(self): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_english_pipeline.py | 344 | def test_dependency_parse_multidoc_variant(self, processed_multidoc_variant): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 66 | def test_download_missing_ner_model(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 91 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 117 | def test_download_missing_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 140 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 164 | def test_download_resources_overwrites(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 177 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 202 | def test_reuse_resources_overwrites(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 226 | def test_download_not_repeated(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 273 | def check_download_method_updates(download_method): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 294 | def fake_request_file_with_restore(url, path, *args, **kwargs): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 318 | def test_download_fixed_reuse_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 324 | def test_download_fixed_download_resources(): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 371 | def test_empty_unknown_language(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 378 | def test_unknown_language_tokenizer(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_core.py | 397 | def test_unknown_language_mwt(unknown_language_name): | CODE |
| LOW | stanza/tests/pipeline/test_pipeline_multi_doc.py | 10 | def test_process_many_strings(): | CODE |
| LOW | stanza/tests/pipeline/test_pipeline_multi_doc.py | 33 | def test_process_many_documents(): | CODE |
| LOW | stanza/tests/pipeline/test_requirements.py | 27 | def test_missing_requirements(): | CODE |
| LOW | stanza/tests/pipeline/test_lemmatizer.py | 124 | def test_latin_caseless_lemmatizer(): | STRING |
| LOW | stanza/tests/pipeline/test_lemmatizer.py | 139 | def test_contextual_lemmatizer(): | STRING |
| LOW | stanza/tests/pipeline/test_depparse.py | 77 | def test_depparse_with_pretagged_doc(): | STRING |
| LOW | stanza/tests/pipeline/test_depparse.py | 88 | def test_raises_requirements_exception_if_pretagged_not_passed(): | STRING |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 91 | def test_parse_no_tags_returns_single_unlabeled_segment(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 95 | def test_parse_single_tag_at_start(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 110 | def test_parse_unlabeled_prefix(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 117 | def test_parse_multi_char_label(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 125 | def test_parse_curly_brace_delimiter(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 133 | def test_parse_same_opener_closer_raises(): | CODE |
| LOW⚡ | stanza/tests/pipeline/test_tokenize_speaker.py | 137 | def test_parse_consecutive_tags_empty_middle(): | CODE |
| 719 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | demo/pipeline_demo.py | 7 | CODE | |
| LOW | stanza/__init__.py | 1 | CODE | |
| LOW | stanza/__init__.py | 1 | CODE | |
| LOW | stanza/__init__.py | 2 | CODE | |
| LOW | stanza/__init__.py | 3 | CODE | |
| LOW | stanza/__init__.py | 4 | CODE | |
| LOW | stanza/__init__.py | 5 | CODE | |
| LOW | stanza/__init__.py | 5 | CODE | |
| LOW | stanza/__init__.py | 6 | CODE | |
| LOW | stanza/__init__.py | 6 | CODE | |
| LOW | stanza/__init__.py | 7 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 6 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 15 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 17 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 21 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 22 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 23 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 24 | CODE | |
| LOW | stanza/pipeline/langid_processor.py | 7 | CODE | |
| LOW | stanza/pipeline/langid_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/constituency_processor.py | 7 | CODE | |
| LOW | stanza/pipeline/constituency_processor.py | 10 | CODE | |
| LOW | stanza/pipeline/pos_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/depparse_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/depparse_processor.py | 16 | CODE | |
| LOW | stanza/pipeline/sentiment_processor.py | 19 | CODE | |
| LOW | stanza/pipeline/coref_processor.py | 9 | CODE | |
| LOW | stanza/pipeline/coref_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/core.py | 9 | CODE | |
| LOW | stanza/pipeline/core.py | 10 | CODE | |
| LOW | stanza/pipeline/core.py | 12 | CODE | |
| LOW | stanza/pipeline/core.py | 15 | CODE | |
| LOW | stanza/pipeline/core.py | 20 | CODE | |
| LOW | stanza/pipeline/core.py | 22 | CODE | |
| LOW | stanza/pipeline/core.py | 23 | CODE | |
| LOW | stanza/pipeline/core.py | 24 | CODE | |
| LOW | stanza/pipeline/core.py | 25 | CODE | |
| LOW | stanza/pipeline/core.py | 26 | CODE | |
| LOW | stanza/pipeline/core.py | 27 | CODE | |
| LOW | stanza/pipeline/core.py | 28 | CODE | |
| LOW | stanza/pipeline/core.py | 29 | CODE | |
| LOW | stanza/pipeline/core.py | 30 | CODE | |
| LOW | stanza/pipeline/core.py | 31 | CODE | |
| LOW | stanza/pipeline/core.py | 32 | CODE | |
| LOW | stanza/pipeline/multilingual.py | 13 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 11 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 15 | CODE | |
| LOW | stanza/pipeline/lemma_processor.py | 12 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 5 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 11 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 7 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 18 | CODE | |
| LOW | stanza/pipeline/external/sudachipy.py | 19 | CODE | |
| LOW | stanza/pipeline/external/pythainlp.py | 16 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 24 | CODE | |
| LOW | stanza/resources/installation.py | 7 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| LOW | stanza/resources/common.py | 25 | CODE | |
| 514 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/tokenize_processor.py | 94 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 119 | CODE | |
| LOW | stanza/pipeline/tokenize_processor.py | 378 | CODE | |
| LOW | stanza/pipeline/core.py | 115 | CODE | |
| LOW | stanza/pipeline/core.py | 178 | CODE | |
| LOW | stanza/pipeline/ner_processor.py | 37 | CODE | |
| LOW | stanza/pipeline/lemma_processor.py | 69 | CODE | |
| LOW | stanza/pipeline/mwt_processor.py | 28 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 277 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 383 | CODE | |
| LOW | stanza/resources/prepare_resources.py | 608 | CODE | |
| LOW | stanza/resources/common.py | 147 | CODE | |
| LOW | stanza/resources/common.py | 243 | CODE | |
| LOW | stanza/resources/common.py | 267 | CODE | |
| LOW | stanza/resources/common.py | 468 | CODE | |
| LOW | stanza/resources/list_installed.py | 57 | CODE | |
| LOW | stanza/tests/constituency/test_trainer.py | 610 | CODE | |
| LOW | stanza/tests/constituency/test_trainer.py | 647 | CODE | |
| LOW | stanza/tests/tokenization/test_tokenizer_training.py | 46 | CODE | |
| LOW | …/tests/tokenization/test_tokenize_data_augmentation.py | 739 | CODE | |
| LOW | stanza/tests/pos/test_data.py | 101 | CODE | |
| LOW | stanza/tests/classifiers/test_classifier.py | 267 | CODE | |
| LOW | stanza/server/java_protobuf_requests.py | 206 | CODE | |
| LOW | stanza/server/java_protobuf_requests.py | 284 | CODE | |
| LOW | stanza/server/ssurgeon.py | 54 | CODE | |
| LOW | stanza/server/ssurgeon.py | 129 | CODE | |
| LOW | stanza/server/ssurgeon.py | 250 | CODE | |
| LOW | stanza/server/client.py | 129 | CODE | |
| LOW | stanza/server/client.py | 257 | CODE | |
| LOW | stanza/server/ud_enhancer.py | 9 | CODE | |
| LOW | stanza/server/main.py | 33 | CODE | |
| LOW | stanza/server/semgrex.py | 53 | CODE | |
| LOW | stanza/server/semgrex.py | 104 | CODE | |
| LOW | stanza/utils/conll.py | 19 | CODE | |
| LOW | stanza/utils/conll.py | 59 | CODE | |
| LOW | stanza/utils/conll.py | 105 | CODE | |
| LOW | stanza/utils/conll.py | 127 | CODE | |
| LOW | stanza/utils/conll.py | 153 | CODE | |
| LOW | …anza/utils/visualization/conll_deprel_visualization.py | 10 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 21 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 97 | CODE | |
| LOW | stanza/utils/visualization/semgrex_visualizer.py | 245 | CODE | |
| LOW | stanza/utils/visualization/dependency_visualization.py | 12 | CODE | |
| LOW | stanza/utils/visualization/ner_visualization.py | 14 | CODE | |
| LOW | stanza/utils/visualization/semgrex_app.py | 107 | CODE | |
| LOW | stanza/utils/visualization/semgrex_app.py | 255 | CODE | |
| LOW | stanza/utils/ner/flair_ner_tag_dataset.py | 14 | CODE | |
| LOW | stanza/utils/ner/spacy_ner_tag_dataset.py | 55 | CODE | |
| LOW | stanza/utils/training/separate_ner_pretrain.py | 37 | CODE | |
| LOW | stanza/utils/training/common.py | 81 | CODE | |
| LOW | stanza/utils/training/common.py | 309 | CODE | |
| LOW | stanza/utils/training/common.py | 344 | CODE | |
| LOW | stanza/utils/training/common.py | 40 | CODE | |
| LOW | stanza/utils/training/run_pos.py | 40 | CODE | |
| LOW | stanza/utils/training/run_lemma.py | 107 | CODE | |
| LOW | stanza/utils/datasets/prepare_mwt_treebank.py | 34 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_data.py | 60 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_treebank.py | 152 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_treebank.py | 178 | CODE | |
| LOW | stanza/utils/datasets/prepare_tokenizer_treebank.py | 223 | CODE | |
| 239 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | stanza/pipeline/external/sudachipy.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/pythainlp.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/jieba.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/pipeline/external/spacy.py | 0 | tokenize a document with the spacy tokenizer and wrap the results into a doc object. | STRING |
| HIGH | stanza/tests/server/test_ssurgeon.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/server/ssurgeon.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/utils/visualization/constants.py | 0 | # sent_id = 271 # text = hers is easy to clean. # previous = what did the dealer like about alex's car? # comment = extr | STRING |
| HIGH | stanza/tests/server/test_server_start.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/server/test_server_request.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/server/test_server_misc.py | 0 | sentence #1 (6 tokens): joe smith lives in california. tokens: [text=joe characteroffsetbegin=0 characteroffsetend=3 par | STRING |
| HIGH | stanza/tests/tokenization/test_tokenize_utils.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/depparse/test_parser.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/lemma/test_data.py | 0 | # sent_id = weblog-juancole.com_juancole_20051126063000_eng_20051126_063000-0003 # text = dpa: iraqi authorities announc | STRING |
| HIGH | stanza/tests/depparse/test_parser.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | 1 from from adp in _ 3 case 3:case _ 2 the the det dt definite=def|prontype=art 3 det 3:det _ 3 ap ap propn nnp number=s | STRING |
| HIGH | stanza/tests/depparse/parser_training.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/pos/test_tagger.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/lemma/test_lemma_trainer.py | 0 | run the training for a few iterations, load & return the model | STRING |
| HIGH | stanza/tests/depparse/test_depparse_data.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/tests/common/test_utils.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/tests/pos/test_data.py | 0 | test a punctuation simplification that should make it so unexpected question/exclamation marks types are processed into | STRING |
| HIGH | stanza/server/ssurgeon.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/tsurgeon.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/ud_enhancer.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/parser_eval.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/server/semgrex.py | 0 | semgrex context window this is a context window which keeps a process open. should allow for multiple requests without l | STRING |
| HIGH | stanza/utils/datasets/prepare_pos_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/utils/datasets/prepare_lemma_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/utils/datasets/prepare_mwt_treebank.py | 0 | a script to prepare all mwt datasets. for example, do python -m stanza.utils.datasets.prepare_mwt_treebank treebank such | STRING |
| HIGH | stanza/models/ner/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/mwt/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/depparse/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/pos/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/lemma/trainer.py | 0 | a trainer class to handle training and testing of models. | STRING |
| HIGH | stanza/models/constituency/in_order_compound_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/constituency/top_down_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/depparse/transition/dynamic_oracle.py | 0 | enumerate values as normal, but also keep a pointer to a function which repairs that kind of error | STRING |
| HIGH | stanza/models/coref/pairwise_encoder.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| HIGH | stanza/models/coref/word_encoder.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| HIGH | stanza/models/coref/span_predictor.py | 0 | a workaround to get current device (which is assumed to be the device of the first parameter of one of the submodules) | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/__init__.py | 21 | COMMENT | |
| LOW | stanza/pipeline/demo/stanza-brat.js | 481 | // | COMMENT |
| LOW | stanza/resources/default_packages.py | 461 | """ | COMMENT |
| LOW | stanza/resources/default_packages.py | 481 | # bg_btb LAS dev test | COMMENT |
| LOW | stanza/resources/default_packages.py | 501 | # no bert 0.8245 0.8230 | COMMENT |
| LOW | stanza/resources/default_packages.py | 521 | # NER scores | COMMENT |
| LOW | stanza/resources/default_packages.py | 541 | # dbmdz/bert 89.67 88.54 | COMMENT |
| LOW | stanza/resources/default_packages.py | 561 | "el": "nlpaueb/bert-base-greek-uncased-v1", | COMMENT |
| LOW | stanza/resources/default_packages.py | 581 | # roberta-large: 93.47 91.56 90.13 89.71 90.13 | COMMENT |
| LOW | stanza/resources/default_packages.py | 601 | COMMENT | |
| LOW | stanza/resources/default_packages.py | 621 | "fa": 'HooshvareLab/bert-base-parsbert-uncased', | COMMENT |
| LOW | stanza/resources/default_packages.py | 641 | # 98.70 100.00 98.69 98.24 | COMMENT |
| LOW | stanza/resources/default_packages.py | 661 | # Microbert MX 0.8910 0.7755 | COMMENT |
| LOW | stanza/resources/default_packages.py | 681 | # UPOS XPOS UFeats AllTags | COMMENT |
| LOW | stanza/resources/default_packages.py | 701 | # crosloeng 96.64 96.48 91.31 91.51 | COMMENT |
| LOW | stanza/resources/default_packages.py | 721 | # flax-community/indonesian-roberta-base 90.14 xxx | COMMENT |
| LOW | stanza/resources/default_packages.py | 741 | # in-order constituency parser on the VIT dev set: | COMMENT |
| LOW | stanza/resources/default_packages.py | 761 | # there are others that would also work, | COMMENT |
| LOW | stanza/resources/default_packages.py | 781 | # l3cube-pune/marathi-bert-v2 | COMMENT |
| LOW | stanza/resources/default_packages.py | 801 | # DTAI-KULeuven/robbert-2023-dutch-large 94.57 93.80 | COMMENT |
| LOW | stanza/resources/default_packages.py | 821 | # xlm-roberta-large: 0.9254 | COMMENT |
| LOW | stanza/resources/default_packages.py | 841 | # no transformer 90.37 90.70 | COMMENT |
| LOW | stanza/resources/default_packages.py | 861 | # jerteh/Jerteh-355 90.89 91.98 | COMMENT |
| LOW | stanza/resources/default_packages.py | 881 | COMMENT | |
| LOW | stanza/resources/default_packages.py | 901 | # https://huggingface.co/airesearch/wangchanberta-base-att-spm-uncased | COMMENT |
| LOW | stanza/resources/default_packages.py | 921 | # does not help the scores | COMMENT |
| LOW | stanza/tests/constituency/test_top_down_oracle.py | 81 | # and then the rest: | COMMENT |
| LOW | …/tests/tokenization/test_tokenize_data_augmentation.py | 661 | # Every test above calls an augmentation method directly on a `sentence` | COMMENT |
| LOW | stanza/tests/tokenization/test_tokenization_lst20.py | 81 | COMMENT | |
| LOW | stanza/tests/tokenization/test_tokenization_lst20.py | 101 | # รายงาน 6 | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_icepahc.py | 21 | (NP (D-D þessu-þessi))) | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_icepahc.py | 41 | # (P í) | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_it_vit.py | 501 | # but the corresponding ' is skipped in the con version of VIT, | COMMENT |
| LOW | stanza/utils/datasets/constituency/convert_it_vit.py | 521 | # and before you ask, there are also clitics which are | COMMENT |
| LOW | stanza/utils/datasets/coref/convert_hebrew_iahlt.py | 101 | # expanded_end = min(len(text), mention_end + 10) | COMMENT |
| LOW | stanza/utils/constituency/condense_output_layers.py | 341 | # | COMMENT |
| LOW | stanza/utils/constituency/condense_output_layers.py | 361 | # middle_output_sizes = self.args.get('output_layer_sizes', [self.hidden_size] * middle_layers) | COMMENT |
| LOW | stanza/utils/charlm/make_lm_data.py | 361 | buffers[bucket_idx] = [] | COMMENT |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 101 | # so it's in a predictable, already-known location, but it's a separate | COMMENT |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 121 | # Stanza lookup. | COMMENT |
| LOW | stanza/models/classifier.py | 121 | # For the most part, these values are for the constituency parser. | COMMENT |
| LOW | stanza/models/classifier.py | 241 | # dev set macro f1 scores on 3 class problems | COMMENT |
| LOW | stanza/models/parser.py | 61 | # multiple UD datasets | COMMENT |
| LOW | stanza/models/parser.py | 161 | # Later experiments found the current defaults helped the results | COMMENT |
| LOW | stanza/models/parser.py | 181 | # In addition to these experiments, we ran multiple alternate optimizer combinations, none of which | COMMENT |
| LOW | stanza/models/constituency_parser.py | 201 | parser.add_argument('--charlm_backward_file', type=str, default=None, help="Exact path to use for backward charlm") | COMMENT |
| LOW | stanza/models/constituency_parser.py | 221 | # 5 layers 0.892064 (299) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 241 | # 150 with no finetuning | COMMENT |
| LOW | stanza/models/constituency_parser.py | 261 | # observation that at the 150 iteration mark, 0.09 was winning: | COMMENT |
| LOW | stanza/models/constituency_parser.py | 281 | # 1: 0.900594 (226) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 301 | # 0.004: 0.899566 (290) | COMMENT |
| LOW | stanza/models/constituency_parser.py | 381 | # | COMMENT |
| LOW | stanza/models/constituency_parser.py | 401 | parser.add_argument('--deactivated_oracle_levels', type=str, default=None, help='Temporarily turn off a default orac | COMMENT |
| LOW | stanza/models/constituency_parser.py | 441 | # baseline is an 80.6 model that occurs when trained using adadelta, lr 1.0 | COMMENT |
| LOW | stanza/models/constituency_parser.py | 461 | # 0.00002: 80.15 | COMMENT |
| LOW | stanza/models/constituency_parser.py | 481 | # Hardshrink: 0.3 | COMMENT |
| LOW | stanza/models/constituency_parser.py | 501 | # 0.0001 0.818566 | COMMENT |
| LOW | stanza/models/constituency_parser.py | 521 | # 0.00005 0.819871 | COMMENT |
| LOW | stanza/models/constituency_parser.py | 561 | COMMENT | |
| LOW | stanza/models/constituency_parser.py | 581 | # 0.05 : 0.929669 | COMMENT |
| 63 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 11 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 12 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 22 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 23 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 30 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 31 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 39 | stack = stack.push(3) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 40 | stack = stack.push(1) | CODE |
| HIGH⚡ | stanza/tests/constituency/test_tree_stack.py | 49 | stack = stack.push(i) | CODE |
| HIGH | stanza/models/constituency/transformer_tree_stack.py | 189 | new_stacks.append(stack.push(value=Node(node_value, new_key_stack, new_value_stack, output))) | CODE |
| HIGH | stanza/models/constituency/base_model.py | 503 | return [stack.push(constituent) for stack, constituent in zip(constituent_stacks, constituents)] | CODE |
| HIGH | stanza/models/constituency/base_model.py | 509 | return [stack.push(transition) for stack, transition in zip(transition_stacks, transitions)] | CODE |
| HIGH | stanza/models/constituency/lstm_tree_stack.py | 94 | new_stacks = [stack.push(Node(transition, hx[:, i, :], cx[:, i, :], last_layer[i])) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/resources/default_packages.py | 868 | # Certainly it looks like the original bert-base is best, but we | COMMENT |
| LOW | stanza/tests/__init__.py | 89 | # just return if path doesn't exist | COMMENT |
| LOW | stanza/utils/conll.py | 180 | else: # no comments defined a new doc_id, so just add it to the current document | CODE |
| LOW | stanza/utils/datasets/dataset_retagging.py | 67 | # TODO: just create a Pipeline for the retagging instead? | COMMENT |
| MEDIUM | stanza/utils/datasets/slovenian/sloleks_lemmas.py | 63 | # We want unique forms only (some paradigm slots share surface forms) | COMMENT |
| MEDIUM | stanza/models/constituency_parser.py | 625 | # When using word_dropout and predict_dropout in conjunction with relu, one particular experiment produced the follo | COMMENT |
| LOW | stanza/models/lemma_classifier/train_lstm_model.py | 57 | # TODO: just pass around the args instead | COMMENT |
| LOW | stanza/models/constituency/in_order_compound_oracle.py | 78 | # no fix is possible, so we just return here | COMMENT |
| MEDIUM | stanza/models/constituency/lstm_model.py | 169 | # Essentially C Linears stacked on top of each other, | COMMENT |
| MEDIUM | stanza/models/tokenization/data.py | 468 | # colon -- "Fax:", "Cell:", "Job Group:", "Notice Regarding:". Essentially | COMMENT |
| LOW | stanza/models/common/pretrain.py | 273 | # if we can't find it anywhere, just return the first location searched... | COMMENT |
| LOW | stanza/models/common/bert_embedding.py | 504 | # after all, we just set the first one to be 0 | COMMENT |
| MEDIUM | stanza/models/pos/vocab.py | 38 | # when using the __len__ / __getitem__ paradigm, | COMMENT |
| LOW | stanza/models/coref/pairwise_encoder.py | 78 | # if speaker is not found in the doc, simply return "speaker#1" for all the speakers | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/pipeline/core.py | 178 | CODE | |
| LOW | stanza/pipeline/multilingual.py | 40 | CODE | |
| LOW | stanza/resources/common.py | 648 | CODE | |
| LOW | stanza/tests/pos/test_xpos_vocab_factory.py | 56 | CODE | |
| LOW | stanza/server/client.py | 257 | CODE | |
| LOW | stanza/models/charlm.py | 40 | CODE | |
| LOW | stanza/models/ner/trainer.py | 65 | CODE | |
| LOW | stanza/models/mwt/data.py | 121 | CODE | |
| LOW | stanza/models/mwt/data.py | 156 | CODE | |
| LOW | stanza/models/lemma_classifier/transformer_model.py | 88 | CODE | |
| LOW | stanza/models/lemma_classifier/lstm_model.py | 214 | CODE | |
| LOW | stanza/models/constituency/transformer_tree_stack.py | 103 | CODE | |
| LOW | stanza/models/constituency/label_attention.py | 625 | CODE | |
| LOW | stanza/models/constituency/parser_training.py | 299 | CODE | |
| LOW | stanza/models/constituency/positional_encoding.py | 89 | CODE | |
| LOW | stanza/models/constituency/partitioned_transformer.py | 227 | CODE | |
| LOW | stanza/models/common/warmup_plateau_scheduler.py | 119 | CODE | |
| LOW | stanza/models/common/biaffine.py | 28 | CODE | |
| LOW | stanza/models/common/utils.py | 271 | CODE | |
| LOW | stanza/models/common/utils.py | 322 | CODE | |
| LOW | stanza/models/common/bert_embedding.py | 286 | CODE | |
| LOW | stanza/models/common/dropout.py | 71 | CODE | |
| LOW | stanza/models/common/hlstm.py | 60 | CODE | |
| LOW | stanza/models/pos/data.py | 284 | CODE | |
| LOW | stanza/models/lemma/data.py | 210 | CODE | |
| LOW | stanza/models/classifiers/cnn_classifier.py | 508 | CODE | |
| LOW | stanza/models/classifiers/constituency_classifier.py | 72 | CODE | |
| LOW | stanza/models/coref/anaphoricity_scorer.py | 122 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/resources/installation.py | 80 | except Exception as e: | CODE |
| LOW | stanza/resources/installation.py | 117 | except Exception as e: | CODE |
| LOW | stanza/tests/server/test_server_start.py | 211 | except Exception as e: | CODE |
| LOW | stanza/tests/common/test_foundation_cache.py | 178 | except Exception as e: | CODE |
| MEDIUM | stanza/tests/common/test_foundation_cache.py | 174 | def load(): | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 175 | except Exception as e: | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 215 | except Exception as e: | CODE |
| LOW | stanza/tests/morphseg/test_stanza_integration.py | 236 | except Exception as e: | CODE |
| LOW | stanza/server/ssurgeon.py | 79 | except Exception as e: | CODE |
| LOW | stanza/server/ssurgeon.py | 209 | except Exception as e: | CODE |
| LOW | stanza/server/parser_eval.py | 40 | except Exception as e: | CODE |
| LOW | stanza/utils/training/run_ner.py | 111 | except Exception as e: | CODE |
| MEDIUM | stanza/utils/datasets/ner/convert_amt.py | 204 | print("Error: no documents found in the input file!") | CODE |
| LOW | stanza/utils/datasets/constituency/convert_ctb.py | 191 | except Exception as e: | CODE |
| LOW | …nza/utils/datasets/depparse/assemble_silver_dataset.py | 53 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 315 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_inventory.py | 338 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_dedup.py | 348 | except Exception as e: | CODE |
| LOW | stanza/utils/charlm/community_oscar_dedup.py | 376 | except Exception as e: | CODE |
| LOW⚡ | …nza/utils/charlm/community_oscar_inspect_similarity.py | 176 | except Exception: | CODE |
| LOW | stanza/models/pos/trainer.py | 130 | except Exception as e: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/server/client.py | 33 | # Check if str is CoreNLP supported language | COMMENT |
| LOW | stanza/server/client.py | 194 | # Check if the service is active and alive | COMMENT |
| LOW | stanza/utils/default_paths.py | 26 | # Set directories to store external word vector data | COMMENT |
| LOW | scripts/config.sh | 5 | # Set UDBASE to the location of UD data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 16 | # Set NERBASE to the location of NER data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 25 | # Set CONSTITUENCY_BASE to the location of NER data folder | COMMENT |
| LOW⚡ | scripts/config.sh | 34 | # Set directories to store processed training/evaluation files | COMMENT |
| LOW | scripts/config.sh | 50 | # Set directories to store external word vector data | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1070 | $('#text').attr('placeholder', 'على سبيل المثال، قفز الثعلب البني السريع فوق الكلب الكسول.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1072 | $('#text').attr('placeholder', 'e.g., The quick brown fox jumped over the lazy dog.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1074 | $('#text').attr('placeholder', '例如,快速的棕色狐狸跳过了懒惰的狗。'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1076 | $('#text').attr('placeholder', '例如,快速的棕色狐狸跳過了懶惰的狗。'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1078 | $('#text').attr('placeholder', 'Par exemple, le renard brun rapide a sauté sur le chien paresseux.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1080 | $('#text').attr('placeholder', 'Z. B. sprang der schnelle braune Fuchs über den faulen Hund.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1082 | $('#text').attr('placeholder', 'Por ejemplo, el rápido zorro marrón saltó sobre el perro perezoso.'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1084 | $('#text').attr('placeholder', 'میرا نام علی ہے'); | CODE |
| LOW⚡ | stanza/pipeline/demo/stanza-brat.js | 1086 | $('#text').attr('placeholder', 'Unknown language for placeholder query: ' + $('#language').val()); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/pipeline/external/spacy.py | 37 | # Create a Tokenizer with the default settings for English | COMMENT |
| MEDIUM | stanza/utils/datasets/constituency/vtb_split.py | 76 | # Create a random shuffle list of the file names in the original directory | COMMENT |
| MEDIUM | stanza/models/common/build_short_name_to_treebank.py | 39 | fout.write("# This module is autogenerated by build_short_name_to_treebank.py\n") | CODE |
| MEDIUM | stanza/models/common/short_name_to_treebank.py | 1 | # This module is autogenerated by build_short_name_to_treebank.py | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | stanza/utils/training/separate_ner_pretrain.py | 193 | trainer.model.delta_emb.weight.data.copy_(delta_vectors) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 74 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 80 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 59 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 65 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 74 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | …a/tests/depparse/test_parser_gradient_checkpointing.py | 80 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 59 | # Step 1: load with gradient checkpointing | COMMENT |
| LOW⚡ | stanza/tests/common/test_peft_gradient_checkpointing.py | 65 | # Step 2: wrap with PEFT — model should still have checkpointing on | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | setup.py | 74 | # simple. Or you can use find_packages(). | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/server/client.py | 779 | __all__ = ["CoreNLPClient", "AnnotationException", "TimeoutException", "to_text"] | CODE |
| LOW | stanza/utils/lemma/convert_lemma_dict.py | 29 | logger = logging.getLogger(__name__) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | stanza/utils/datasets/sentiment/process_es_tass2020.py | 157 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | stanza/models/constituency/transition_sequence.py | 84 | def helper(tree): | CODE |