explosion/spaCy

Pattern Findings

1542 matches across 13 categories. Click a row to expand file-level details.

Hyper-Verbose Identifiers1150 hits · 1252 pts

Severity	File	Line	Snippet
LOW	website/setup/jinja_to_js.py	696	def _process_filter_capitalize(self, node, **kwargs):
LOW	website/setup/jinja_to_js.py	977	def _process_test_divisibleby(self, node, **kwargs):
LOW	website/meta/universe.json	5499	"def create_presque_normalizer(nlp, name='presque_normalizer'):",
LOW	extra/DEVELOPER_DOCS/Code Conventions.md	492	def test_doc_creation_with_pos():
LOW	extra/DEVELOPER_DOCS/Code Conventions.md	526	def test_en_tokenizer_splits_em_dash_infix(en_tokenizer):
LOW	extra/DEVELOPER_DOCS/Code Conventions.md	555	def test_phrase_matcher_validation(en_vocab):
LOW	spacy/util.py	1387	def make_first_longest_spans_filter():
LOW	spacy/language.py	2163	def _resolve_component_status(
LOW	spacy/scorer.py	262	def score_token_attr_per_feat(
LOW	spacy/pipeline/spancat.py	144	def build_ngram_range_suggester(min_size: int, max_size: int) -> Suggester:
LOW	spacy/pipeline/spancat.py	152	def build_preset_spans_suggester(spans_key: str) -> Suggester:
LOW	spacy/pipeline/spancat.py	558	def _make_span_group_multilabel(
LOW	spacy/pipeline/spancat.py	599	def _make_span_group_singlelabel(
LOW	spacy/pipeline/attributeruler.py	47	def make_attribute_ruler_scorer():
LOW	spacy/pipeline/span_ruler.py	36	def prioritize_new_ents_filter(
LOW	spacy/pipeline/span_ruler.py	62	def make_prioritize_new_ents_filter():
LOW	spacy/pipeline/span_ruler.py	66	def prioritize_existing_ents_filter(
LOW	spacy/pipeline/span_ruler.py	92	def make_preserve_existing_ents_filter():
LOW	spacy/pipeline/span_ruler.py	96	def overlapping_labeled_spans_score(
LOW	spacy/pipeline/span_ruler.py	111	def make_overlapping_labeled_spans_scorer(spans_key: str = DEFAULT_SPANS_KEY):
LOW	spacy/pipeline/factories.py	727	def make_edit_tree_lemmatizer(
LOW	spacy/pipeline/entity_linker.py	47	def make_entity_linker_scorer():
LOW	spacy/pipeline/entity_linker.py	237	def batch_has_learnable_example(self, examples):
LOW	spacy/pipeline/textcat_multilabel.py	82	def make_textcat_multilabel_scorer():
LOW	spacy/pipeline/span_finder.py	217	def _get_aligned_truth_scores(self, examples, ops) -> Tuple[Floats2d, Floats2d]:
LOW	spacy/training/batchers.py	22	def configure_minibatch_by_padded_size(
LOW	spacy/training/batchers.py	56	def configure_minibatch_by_words(
LOW	spacy/training/augment.py	13	def create_combined_augmenter(
LOW	spacy/training/augment.py	85	def create_orth_variants_augmenter(
LOW	spacy/training/augment.py	102	def create_lower_casing_augmenter(
LOW	spacy/training/augment.py	337	def construct_modified_raw_text(token_dict):
LOW	spacy/training/iob_utils.py	63	def _doc_to_biluo_tags_with_partial(doc: Doc) -> List[str]:
LOW	spacy/training/callbacks.py	10	def create_copy_from_base_model(
LOW	spacy/training/loop.py	290	def create_evaluation_callback(
LOW	spacy/training/loop.py	356	def create_before_to_disk_callback(
LOW	spacy/training/corpus.py	199	def make_examples_gold_preproc(
LOW	spacy/tests/test_displacy.py	120	def test_displacy_parse_spans(en_vocab):
LOW	spacy/tests/test_displacy.py	149	def test_displacy_parse_spans_with_kb_id_options(en_vocab):
LOW	spacy/tests/test_displacy.py	184	def test_displacy_parse_spans_different_spans_key(en_vocab):
LOW	spacy/tests/test_displacy.py	206	def test_displacy_parse_empty_spans_key(en_vocab):
LOW	spacy/tests/test_displacy.py	236	def test_displacy_parse_ents_with_kb_id_options(en_vocab):
LOW	spacy/tests/test_displacy.py	294	def test_displacy_invalid_arcs():
LOW	spacy/tests/test_displacy.py	313	def test_displacy_raises_for_wrong_type(en_vocab):
LOW	spacy/tests/test_displacy.py	337	def test_displacy_render_wrapper(en_vocab):
LOW	spacy/tests/test_displacy.py	353	def test_displacy_render_manual_dep():
LOW	spacy/tests/test_displacy.py	375	def test_displacy_render_manual_ent():
LOW	spacy/tests/test_displacy.py	396	def test_displacy_render_manual_span():
LOW	spacy/tests/test_displacy.py	425	def test_displacy_options_case():
LOW	spacy/tests/test_displacy.py	440	def test_displacy_manual_sorted_entities():
LOW	spacy/tests/test_displacy.py	474	def test_displacy_span_stacking():
LOW	spacy/tests/test_misc.py	79	def test_util_ensure_path_succeeds(text):
LOW	spacy/tests/test_misc.py	93	def test_util_get_package_path(package):
LOW	spacy/tests/test_misc.py	176	def test_load_model_blank_shortcut():
LOW	spacy/tests/test_misc.py	207	def test_is_compatible_version(version, constraint, compatible):
LOW	spacy/tests/test_misc.py	225	def test_is_unconstrained_version(constraint, expected):
LOW	spacy/tests/test_misc.py	284	def test_dot_to_dict_overrides(dot_notation, expected):
LOW	spacy/tests/test_misc.py	351	def test_util_minibatch_oversize(doc_sizes, expected_batches):
LOW	spacy/tests/util.py	42	def apply_transition_sequence(parser, doc, sequence):
LOW	spacy/tests/test_factory_imports.py	65	def test_factory_import_compatibility(factory_name, original_module, compat_module):
LOW	spacy/tests/README.md	111	def test_doc_token_api_strings(en_vocab):
1090 more matches not shown…

Unused Imports183 hits · 174 pts

Severity	File	Line
LOW	spacy/compat.py	42
LOW	spacy/compat.py	28
LOW	spacy/compat.py	28
LOW	spacy/compat.py	28
LOW	spacy/compat.py	30
LOW	spacy/compat.py	30
LOW	spacy/compat.py	30
LOW	spacy/compat.py	36
LOW	spacy/compat.py	38
LOW	spacy/util.py	68
LOW	spacy/util.py	68
LOW	spacy/util.py	68
LOW	spacy/util.py	77
LOW	spacy/util.py	77
LOW	spacy/util.py	78
LOW	spacy/util.py	78
LOW	spacy/util.py	79
LOW	spacy/util.py	402
LOW	spacy/util.py	1156
LOW	spacy/__init__.py	11
LOW	spacy/__init__.py	11
LOW	spacy/__init__.py	11
LOW	spacy/__init__.py	13
LOW	spacy/__init__.py	17
LOW	spacy/__init__.py	18
LOW	spacy/__init__.py	20
LOW	spacy/__init__.py	22
LOW	spacy/__init__.py	22
LOW	spacy/__init__.py	33
LOW	spacy/__init__.py	33
LOW	spacy/schemas.py	41
LOW	spacy/schemas.py	42
LOW	spacy/schemas.py	43
LOW	spacy/pipe_analysis.py	11
LOW	spacy/ty.py	17
LOW	spacy/ty.py	18
LOW	spacy/scorer.py	24
LOW	spacy/pipeline/__init__.py	1
LOW	spacy/pipeline/__init__.py	2
LOW	spacy/pipeline/__init__.py	3
LOW	spacy/pipeline/__init__.py	4
LOW	spacy/pipeline/__init__.py	5
LOW	spacy/pipeline/__init__.py	6
LOW	spacy/pipeline/__init__.py	6
LOW	spacy/pipeline/__init__.py	6
LOW	spacy/pipeline/__init__.py	7
LOW	spacy/pipeline/__init__.py	8
LOW	spacy/pipeline/__init__.py	9
LOW	spacy/pipeline/__init__.py	10
LOW	spacy/pipeline/__init__.py	11
LOW	spacy/pipeline/__init__.py	12
LOW	spacy/pipeline/__init__.py	13
LOW	spacy/pipeline/__init__.py	14
LOW	spacy/pipeline/__init__.py	15
LOW	spacy/pipeline/__init__.py	16
LOW	spacy/pipeline/__init__.py	17
LOW	spacy/pipeline/__init__.py	18
LOW	spacy/pipeline/__init__.py	19
LOW	spacy/pipeline/__init__.py	20
LOW	spacy/pipeline/legacy/__init__.py	1
123 more matches not shown…

Deep Nesting116 hits · 116 pts

Severity	File	Line
LOW	website/setup/jinja_to_js.py	458
LOW	website/setup/jinja_to_js.py	491
LOW	website/setup/jinja_to_js.py	651
LOW	website/setup/jinja_to_js.py	675
LOW	website/setup/jinja_to_js.py	886
LOW	website/setup/jinja_to_js.py	1022
LOW	website/setup/jinja_to_js.py	1112
LOW	spacy/util.py	675
LOW	spacy/util.py	940
LOW	spacy/util.py	1810
LOW	spacy/language.py	838
LOW	spacy/language.py	1636
LOW	spacy/language.py	1763
LOW	spacy/language.py	1996
LOW	spacy/pipe_analysis.py	17
LOW	spacy/pipe_analysis.py	81
LOW	spacy/scorer.py	760
LOW	spacy/scorer.py	211
LOW	spacy/scorer.py	262
LOW	spacy/scorer.py	346
LOW	spacy/scorer.py	447
LOW	spacy/scorer.py	583
LOW	spacy/scorer.py	652
LOW	spacy/displacy/render.py	153
LOW	spacy/pipeline/functions.py	82
LOW	spacy/pipeline/functions.py	138
LOW	spacy/pipeline/tok2vec.py	278
LOW	spacy/pipeline/lemmatizer.py	172
LOW	spacy/pipeline/edit_tree_lemmatizer.py	156
LOW	spacy/pipeline/edit_tree_lemmatizer.py	176
LOW	spacy/pipeline/edit_tree_lemmatizer.py	197
LOW	spacy/pipeline/entityruler.py	246
LOW	spacy/pipeline/spancat.py	449
LOW	spacy/pipeline/spancat.py	558
LOW	spacy/pipeline/attributeruler.py	190
LOW	spacy/pipeline/span_ruler.py	322
LOW	spacy/pipeline/entity_linker.py	338
LOW	spacy/pipeline/entity_linker.py	460
LOW	spacy/pipeline/span_finder.py	135
LOW	spacy/pipeline/span_finder.py	217
LOW	spacy/pipeline/textcat.py	262
LOW	spacy/pipeline/legacy/entity_linker.py	139
LOW	spacy/pipeline/legacy/entity_linker.py	225
LOW	spacy/pipeline/legacy/entity_linker.py	311
LOW	spacy/training/pretrain.py	26
LOW	spacy/training/initialize.py	35
LOW	spacy/training/initialize.py	210
LOW	spacy/training/batchers.py	134
LOW	spacy/training/augment.py	164
LOW	spacy/training/augment.py	219
LOW	spacy/training/iob_utils.py	71
LOW	spacy/training/iob_utils.py	194
LOW	spacy/training/loop.py	35
LOW	spacy/training/loop.py	153
LOW	spacy/training/loop.py	373
LOW	spacy/training/corpus.py	84
LOW	spacy/training/corpus.py	184
LOW	spacy/training/corpus.py	212
LOW	spacy/training/corpus.py	261
LOW	spacy/training/corpus.py	311
56 more matches not shown…

Cross-File Repetition19 hits · 95 pts

Severity	File	Snippet
HIGH	spacy/displacy/render.py	render complete markup. parsed (list): dependency parses to render. page (bool): render parses wrapped as full html page
HIGH	spacy/displacy/render.py	render complete markup. parsed (list): dependency parses to render. page (bool): render parses wrapped as full html page
HIGH	spacy/displacy/render.py	render complete markup. parsed (list): dependency parses to render. page (bool): render parses wrapped as full html page
HIGH	spacy/lang/sv/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/ja/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/el/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/ca/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/nb/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/de/syntax_iterators.py	detect base noun phrases from a dependency parse. works on doc and span.
HIGH	spacy/lang/ms/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/it/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/pt/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/fi/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/id/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/fr/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/es/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/en/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/fa/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.
HIGH	spacy/lang/tr/syntax_iterators.py	detect base noun phrases from a dependency parse. works on both doc and span.

Self-Referential Comments18 hits · 52 pts

Severity	File	Line	Snippet
MEDIUM	website/meta/universe.json	100	"# Define the language for the sentence as well as for the spaCy and benepar models",
MEDIUM	website/meta/universe.json	104	"# Create the pipeline (note, the required models will be downloaded and installed automatically)",
MEDIUM	website/meta/universe.json	108	"# Create the tree from where we are going to extract the desired noun phrases",
MEDIUM	website/meta/universe.json	1387	"# Create a new chat bot named Charlie",
MEDIUM	website/meta/universe.json	3606	"# Create a new DocBin",
MEDIUM	spacy/language.py	220	# Create the default tokenizer from the default config
MEDIUM	spacy/displacy/render.py	326	# Create a random ID prefix to make sure parses don't receive the
MEDIUM	spacy/pipeline/legacy/entity_linker.py	1	# This file is present to provide a prior version of the EntityLinker component
MEDIUM	spacy/tests/test_displacy.py	457	# Create a doc containing an annotated word and an unannotated HTML tag
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	151	# Create the Entity Linker component and add it to the pipeline
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	746	# Create the Entity Linker component and add it to the pipeline
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	852	# Create the NER and EL components and add them to the pipeline
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	933	# Create the Entity Linker component with the KB from file, and check the final vocab
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	1156	# Create a ruler to mark entities
MEDIUM	spacy/tests/pipeline/test_entity_linker.py	1282	# Create the Entity Linker component and add it to the pipeline
MEDIUM	spacy/cli/debug_data.py	149	# Create the gold corpus to be able to better analyze data
MEDIUM	spacy/cli/debug_data.py	903	# Creating a data structure that holds the start and
MEDIUM	spacy/lang/lex_attrs.py	185	# This function is partially applied so lang code can be passed in

Cross-Language Confusion (JS/TS)4 hits · 28 pts

Severity	File	Line	Snippet
HIGH	website/pages/index.tsx	52	print("Noun phrases:", [chunk.text for chunk in doc.noun_chunks])
HIGH	website/pages/index.tsx	53	print("Verbs:", [token.lemma_ for token in doc if token.pos_ == "VERB"])
HIGH	website/pages/index.tsx	57	print(entity.text, entity.label_)
HIGH	website/src/widgets/quickstart-models.js	105	print([

Excessive Try-Catch Wrapping21 hits · 22 pts

Severity	File	Line	Snippet
LOW	setup.py	136	except Exception:
LOW	setup.py	144	except Exception:
LOW	spacy/util.py	890	except Exception:
LOW	spacy/util.py	1777	except Exception as e:
LOW	spacy/language.py	1057	except Exception as e:
LOW	spacy/language.py	2417	except Exception:
LOW	spacy/pipeline/lemmatizer.py	113	except Exception as e:
LOW	spacy/pipeline/entityruler.py	125	except Exception as e:
LOW	spacy/pipeline/attributeruler.py	134	except Exception as e:
LOW	spacy/pipeline/span_ruler.py	224	except Exception as e:
LOW	spacy/training/loop.py	126	except Exception as e:
LOW	spacy/training/loop.py	385	except Exception as e:
LOW	spacy/tests/test_models.py	163	except Exception:
LOW	spacy/tests/test_models.py	173	except Exception:
LOW	spacy/tests/serialize/test_resource_warning.py	117	except Exception as e:
LOW	spacy/tests/serialize/test_resource_warning.py	131	except Exception as e:
LOW	spacy/tests/serialize/test_resource_warning.py	137	except Exception as e:
LOW	spacy/cli/_util.py	195	except Exception as e:
LOW	spacy/cli/info.py	159	except Exception:
LOW	spacy/cli/info.py	197	except Exception:
LOW	spacy/cli/debug_model.py	146	except Exception:

Cross-Language Confusion3 hits · 15 pts

Severity	File	Line	Snippet
HIGH	spacy/tests/parser/test_state.py	28	state.push()
HIGH	spacy/tests/parser/test_state.py	32	state.push()
HIGH	spacy/tests/parser/test_state.py	45	state.push()

AI Slop Vocabulary9 hits · 14 pts

Severity	File	Line	Snippet
MEDIUM	website/meta/universe.json	9	"description": "**[Temporal Expressions Normalization spaCy (TeNs)](https://github.com/iliedorobat/timespan-
MEDIUM	website/meta/universe.json	5396	"# floret n-gram embeddings robust to typos",
LOW	spacy/schemas.py	102	# binding=True. Here we just use an empty model that allows everything.
LOW	spacy/scorer.py	724	# None is indistinct, so we can't just add it to the set
LOW	spacy/training/loggers.py	120	# If we don't have a new checkpoint, just return.
LOW	spacy/tests/test_factory_registrations.py	59	# For Cython functions, just use a placeholder
LOW	spacy/lang/ja/__init__.py	77	# if there's no lemma info (it's an unk) just use the surface
LOW	spacy/lang/ht/lemmatizer.py	39	# fallback rule: just return lowercased form
LOW	spacy/ml/_precomputable_affine.py	44	# However, we avoid building that array for efficiency -- and just pass

Fake / Example Data9 hits · 13 pts

Severity	File	Line	Snippet
LOW	website/meta/universe.json	744	"# [{'end': 8, 'start': 0, 'text': 'John Doe', 'type': 'PERSON'}, {'end': 25, 'start': 13, 'text': 'Go D
LOW	spacy/tests/tokenizer/test_whitespace.py	4	@pytest.mark.parametrize("text", ["lorem ipsum"])
LOW	spacy/tests/tokenizer/test_whitespace.py	17	@pytest.mark.parametrize("text", ["lorem ipsum "])
LOW	spacy/tests/tokenizer/test_tokenizer.py	317	text = "Lorem ipsum: 1984."
LOW	spacy/tests/tokenizer/test_tokenizer.py	350	text = """Lorem ipsum dolor sit amet, consectetur adipiscing elit
LOW	spacy/tests/tokenizer/test_tokenizer.py	350	text = """Lorem ipsum dolor sit amet, consectetur adipiscing elit
LOW	spacy/tests/tokenizer/test_tokenizer.py	374	text1 = "Lorem dolor sit amet, consectetur adipiscing elit."
LOW	spacy/tests/tokenizer/test_tokenizer.py	375	text2 = "Lorem ipsum dolor sit amet, consectetur adipiscing elit."
LOW	spacy/tests/tokenizer/test_tokenizer.py	375	text2 = "Lorem ipsum dolor sit amet, consectetur adipiscing elit."

Redundant / Tautological Comments6 hits · 7 pts

Severity	File	Line	Snippet
LOW	spacy/util.py	418	# Check if language is registered / entry point is available
LOW	spacy/language.py	2065	# Check if the path actually exists in the config
LOW	spacy/lang/it/syntax_iterators.py	57	elif right_child.dep in np_modifs: # Check if we can expand to right
LOW	spacy/lang/pt/syntax_iterators.py	56	elif right_child.dep in np_modifs: # Check if we can expand to right
LOW	spacy/lang/fr/syntax_iterators.py	58	elif right_child.dep in np_modifs: # Check if we can expand to right
LOW	spacy/lang/es/syntax_iterators.py	47	elif right_child.dep in np_modifs: # Check if we can expand to right

Over-Commented Block3 hits · 3 pts

Severity	File	Line	Snippet
LOW	spacy/default_config.cfg	41	# Whether to train on sequences with 'gold standard' sentence boundaries
LOW	spacy/lang/nl/stop_words.py	1	# The original stop words list (added in f46ffe3) was taken from
LOW	spacy/ml/_precomputable_affine.py	21	W = model.get_param("W")

Slop Phrases1 hit · 2 pts

Severity	File	Line	Snippet
MEDIUM	website/meta/universe.json	1768	"# For instance you can add the BertTone model for classification of sentiment polarity to the pipeline:

Score History

Severity Breakdown

Pattern Findings