smicallef/spiderfoot

26.6

Adjusted Score

26.6

Raw Score

100%

Time Factor

2026-04-13

Last Push

20.5K

Stars

Python

Language

98.6K

Lines of Code

764

Files

1.5K

Pattern Hits

2026-08-13

Scan Date

0.05

HC Hit Rate

What These Metrics Mean

Adjusted Score: Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score: The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor: The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits: Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate: High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files: Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 41MEDIUM 495LOW 939

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1475 distinct pattern matches across 12 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators478 hits · 1431 pts

Severity	File	Line	Snippet	Context
MEDIUM	sf.py	3	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sf.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sflib.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sflib.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sfwebui.py	2	# -----------------------------------------------------------------	COMMENT
MEDIUM	sfwebui.py	11	# -----------------------------------------------------------------	COMMENT
MEDIUM	sfcli.py	3	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sfcli.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	sfscan.py	2	# -----------------------------------------------------------------	COMMENT
MEDIUM	sfscan.py	11	# -----------------------------------------------------------------	COMMENT
MEDIUM	spiderfoot/db.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	spiderfoot/db.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_opennic.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_opennic.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_commoncrawl.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_commoncrawl.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_citadel.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_citadel.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_dnsraw.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_dnsraw.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_cinsscore.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_cinsscore.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_myspace.py	1	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_myspace.py	10	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_tool_onesixtyone.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_tool_onesixtyone.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_junkfiles.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_junkfiles.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_cloudflaredns.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_cloudflaredns.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_surbl.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_surbl.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_urlscan.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_urlscan.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_archiveorg.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_archiveorg.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_bitcoinwhoswho.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_bitcoinwhoswho.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_greynoise_community.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_greynoise_community.py	13	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_fullhunt.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_fullhunt.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_apple_itunes.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_apple_itunes.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_bitcoinabuse.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_bitcoinabuse.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_isc.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_isc.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_accounts.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_accounts.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_openphish.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_openphish.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_tool_retirejs.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_tool_retirejs.py	11	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_spyonweb.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_spyonweb.py	12	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_hackertarget.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_hackertarget.py	13	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_securitytrails.py	2	# -------------------------------------------------------------------------------	COMMENT
MEDIUM	modules/sfp_securitytrails.py	11	# -------------------------------------------------------------------------------	COMMENT
418 more matches not shown…

Excessive Try-Catch Wrapping327 hits · 333 pts

Severity	File	Line	Snippet	Context
LOW	sf.py	165	except Exception as e:	CODE
LOW	sf.py	177	except Exception as e:	CODE
LOW	sf.py	194	except Exception as e:	CODE
LOW	sflib.py	165	except Exception as e:	CODE
LOW	sflib.py	1238	except Exception:	CODE
LOW	sflib.py	1287	except Exception as e:	CODE
LOW	sflib.py	1331	except Exception as e:	CODE
LOW	sflib.py	1372	except Exception as e:	CODE
LOW	sflib.py	1397	except Exception as e:	CODE
LOW	sflib.py	1429	except Exception as e:	CODE
LOW	sflib.py	1526	except Exception:	CODE
LOW	sflib.py	1531	except Exception:	CODE
LOW	sfwebui.py	265	except Exception:	CODE
LOW	sfwebui.py	346	except Exception:	CODE
LOW	sfwebui.py	386	except Exception:	CODE
LOW	sfwebui.py	391	except Exception:	CODE
LOW	sfwebui.py	843	except Exception as e:	CODE
LOW	sfwebui.py	897	except Exception as e:	CODE
LOW	sfwebui.py	1125	except Exception as e:	CODE
LOW	sfwebui.py	1149	except Exception as e:	CODE
LOW	sfwebui.py	1191	except Exception as e:	CODE
LOW	sfwebui.py	1206	except Exception:	CODE
LOW	sfwebui.py	1232	except Exception:	CODE
LOW	sfwebui.py	1371	except Exception as e:	CODE
LOW	sfwebui.py	1491	except Exception as e:	CODE
LOW	sfwebui.py	1553	except Exception as e:	CODE
LOW	sfwebui.py	1579	except Exception:	CODE
LOW	sfwebui.py	1605	except Exception:	CODE
LOW	sfwebui.py	1704	except Exception:	CODE
LOW	sfwebui.py	1709	except Exception:	CODE
LOW	sfwebui.py	1737	except Exception:	CODE
LOW	sfwebui.py	1768	except Exception:	CODE
LOW	sfwebui.py	1807	except Exception:	CODE
LOW	sfwebui.py	1831	except Exception:	CODE
LOW	sfwebui.py	1852	except Exception:	CODE
LOW	sfwebui.py	1876	except Exception:	CODE
LOW	sfcli.py	416	except Exception as e:	CODE
MEDIUM	sfcli.py	417	self.edprint(f"Error parsing command: {e}")	CODE
MEDIUM	sfcli.py	550	self.edprint(f"Error running your query: {j[1]}")	CODE
LOW	sfcli.py	850	except Exception as e:	CODE
MEDIUM	sfcli.py	1223	self.edprint("Error fetching SpiderFoot server-side config.")	CODE
MEDIUM	sfcli.py	1314	self.edprint(f"Error setting SpiderFoot server-side config: {j[1]}")	CODE
LOW	sfscan.py	296	except Exception:	CODE
LOW⚡	sfscan.py	313	except Exception:	CODE
LOW⚡	sfscan.py	322	except Exception as e:	CODE
LOW⚡	sfscan.py	330	except Exception as e:	CODE
LOW⚡	sfscan.py	339	except Exception as e:	CODE
LOW⚡	sfscan.py	346	except Exception as e:	CODE
LOW⚡	sfscan.py	354	except Exception as e:	CODE
LOW⚡	sfscan.py	534	except Exception:	CODE
LOW⚡	sfscan.py	544	except Exception:	CODE
LOW⚡	sfscan.py	553	except Exception:	CODE
LOW	spiderfoot/db.py	319	except Exception as e:	CODE
LOW	spiderfoot/db.py	345	except Exception:	CODE
LOW	spiderfoot/db.py	359	except Exception as e:	CODE
LOW	spiderfoot/db.py	390	except Exception:	CODE
LOW	spiderfoot/threadpool.py	257	except Exception: # noqa: B902	CODE
LOW	spiderfoot/plugin.py	389	except Exception as e:	CODE
LOW	spiderfoot/plugin.py	524	except Exception as e:	CODE
MEDIUM	spiderfoot/plugin.py	498	def threadWorker(self) -> None:	CODE
267 more matches not shown…

Over-Commented Block239 hits · 238 pts

Severity	File	Line	Snippet	Context
LOW	sf.py	1	#!/usr/bin/env python3	COMMENT
LOW	sflib.py	1	# -- coding: utf-8 --	COMMENT
LOW	sfwebui.py	1	# -- coding: utf-8 --	COMMENT
LOW	docker-compose.yml	1	version: "3"	COMMENT
LOW	sfcli.py	1	#!/usr/bin/env python3	COMMENT
LOW	sfscan.py	1	# -- coding: utf-8 --	COMMENT
LOW	spiderfoot/db.py	1	# -- coding: utf-8 --	COMMENT
LOW	spiderfoot/plugin.py	101	# Current event being processed	COMMENT
LOW	spiderfoot/plugin.py	341		COMMENT
LOW	spiderfoot/static/js/spiderfoot.js	1	//-------------------------------------------------------------------------------	COMMENT
LOW	docs/conf.py	1	# Configuration file for the Sphinx documentation builder.	COMMENT
LOW	docs/conf.py	41	# for a list of supported languages.	COMMENT
LOW	modules/sfp_opennic.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_commoncrawl.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_citadel.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_dnsraw.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_cinsscore.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_tool_onesixtyone.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_junkfiles.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_cloudflaredns.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_surbl.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_urlscan.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_archiveorg.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_bitcoinwhoswho.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_greynoise_community.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_fullhunt.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_apple_itunes.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_bitcoinabuse.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_isc.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_accounts.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_openphish.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_tool_retirejs.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_spyonweb.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_hackertarget.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_securitytrails.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_dnsneighbor.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_threatcrowd.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_bingsearch.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_dnsbrute.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_sociallinks.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_robtex.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_hosting.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_trumail.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_openstreetmap.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_company.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_dnszonexfer.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_cleantalk.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_uceprotect.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_textmagic.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_emailrep.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_tool_testsslsh.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_cleanbrowsing.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_coinblocker.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_zoneh.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_whatcms.py	1	# -------------------------------------------------------------------------------	COMMENT
LOW	modules/sfp_c99.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_pulsedive.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_abstractapi.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_alienvaultiprep.py	1	# -- coding: utf-8 --	COMMENT
LOW	modules/sfp_crt.py	1	# -- coding: utf-8 --	COMMENT
179 more matches not shown…

Docstring Block Structure38 hits · 190 pts

Severity	File	Line	Snippet	Context
HIGH	sflib.py	307	Convert a Python dictionary to something storable in the database. Args: opts (dict): Dictionary of	STRING
HIGH	sflib.py	371	Take strings, etc. from the database or UI and convert them to a dictionary for Python to process. Args	STRING
HIGH	sfwebui.py	194	Convert data to HTML entities; except quotes and ampersands. Args: inputList (list): list of string	STRING
HIGH	sfwebui.py	796	Rerun a scan. Args: id (str): scan ID Returns: None Raises:	STRING
HIGH	sfwebui.py	1089	Save settings, also used to completely reset them to default. Args: allopts: TBD token	STRING
HIGH	sfwebui.py	1376	Initiate a scan. Args: scanname (str): scan name scantarget (str): scan target	STRING
HIGH	spiderfoot/db.py	449	Search database. Args: criteria (dict): search criteria such as: - scan_id (search	STRING
HIGH	spiderfoot/db.py	550	Logs a batch of events to the database. Args: batch (list): tuples containing: instanceId, classifi	STRING
HIGH	spiderfoot/db.py	720	Return info about a scan instance (name, target, created, started, ended, status) Args: instanceId	STRING
HIGH	spiderfoot/db.py	749	Obtain a summary of the results, filtered by event type, module or entity. Args: instanceId (str):	STRING
HIGH	spiderfoot/db.py	803	Obtain a summary of the correlations, filtered by rule or risk Args: instanceId (str): scan instanc	STRING
HIGH	spiderfoot/db.py	848	Obtain a list of the correlations from a scan Args: instanceId (str): scan instance ID Ret	STRING
HIGH	spiderfoot/db.py	889	Obtain the data for a scan and event type. Args: instanceId (str): scan instance ID eve	STRING
HIGH	spiderfoot/db.py	978	Obtain a unique list of elements. Args: instanceId (str): scan instance ID eventType (s	STRING
HIGH	spiderfoot/db.py	1020	Get scan logs. Args: instanceId (str): scan instance ID limit (int): limit number of re	STRING
HIGH	spiderfoot/db.py	1066	Get scan errors. Args: instanceId (str): scan instance ID limit (int): limit number of	STRING
HIGH	spiderfoot/db.py	1103	Delete a scan instance. Args: instanceId (str): scan instance ID Returns: bool	STRING
HIGH	spiderfoot/db.py	1138	Set the false positive flag for a result. Args: instanceId (str): scan instance ID resu	STRING
HIGH	spiderfoot/db.py	1177	Store the default configuration in the database. Args: optMap (dict): config options Retur	STRING
HIGH	spiderfoot/db.py	1306	Retrieve configuration data for a scan component. Args: instanceId (str): scan instance ID	STRING
HIGH	spiderfoot/db.py	1470	History of data from the scan. Args: instanceId (str): scan instance ID Returns:	STRING
HIGH	spiderfoot/db.py	1499	Get the source IDs, types and data for a set of IDs. Args: instanceId (str): scan instance ID	STRING
HIGH	spiderfoot/db.py	1550	Get the child IDs, types and data for a set of IDs. Args: instanceId (str): scan instance ID	STRING
HIGH	spiderfoot/db.py	1599	Get the full set of upstream IDs which are parents to the supplied set of IDs. Args: instanceId (st	STRING
HIGH	spiderfoot/db.py	1670	Get the full set of downstream IDs which are children of the supplied set of IDs. Args: instanceId	STRING
HIGH	spiderfoot/db.py	1728	Create a correlation result in the database. Args: instanceId (str): scan instance ID r	STRING
HIGH	spiderfoot/correlation.py	134	Build up the criteria to be used to query the database. Args: matchrule (dict): dict representing a	STRING
HIGH	spiderfoot/correlation.py	843	Work through all the components of the rule to produce a final set of data elements for building into correlatio	STRING
HIGH	spiderfoot/correlation.py	898	Build the correlation title with field substitution. Args: rule (dict): correlation rule	STRING
HIGH	spiderfoot/helpers.py	122	Load modules from modules directory. Args: path (str): file system path for modules directory	STRING
HIGH	spiderfoot/helpers.py	176	Load correlation rules from correlations directory. Args: path (str): file system path for correlat	STRING
HIGH	spiderfoot/helpers.py	345	Return dictionary words from several language dictionaries. Args: wordlists (list[str]): list of wo	STRING
HIGH	spiderfoot/helpers.py	373	Return list of human names from wordlist file. Args: wordlists (list[str]): list of wordlist file n	STRING
HIGH	spiderfoot/helpers.py	401	Return list of usernames from wordlist file. Args: wordlists (list[str]): list of wordlist file nam	STRING
HIGH	spiderfoot/helpers.py	560	Return a format-agnostic collection of tuples to use as the basis for building graphs in various formats.	STRING
HIGH	spiderfoot/helpers.py	637	Converts a dictionary of k -> array to a nested tree that can be digested by d3 for visualizations. Arg	STRING
HIGH	spiderfoot/helpers.py	775	Find all URLs within the supplied content. This function does not fetch any URLs. A dictionary will be	STRING
HIGH	spiderfoot/helpers.py	1144	Given a certificate as a DER-encoded blob of bytes, returns a PEM-encoded string version of the same certificate.	STRING

Hyper-Verbose Identifiers173 hits · 182 pts

Severity	File	Line	Snippet	Context
LOW	sfwebui.py	491	def scaneventresultexportmulti(self: 'SpiderFootWebUi', ids: str, filetype: str = "csv", dialect: str = "excel") ->	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	217	def test_scan_viz_multi_should_return_a_string(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	227	def test_scanopts_should_return_dict(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	235	def test_rerunscan_invalid_scan_id_should_return_error(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	378	def test_eventtypes_should_return_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	385	def test_modules_should_return_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	392	def test_correlationrules_should_return_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	399	def test_ping_should_return_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	545	def test_scanlist_should_return_a_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	555	def test_scanstatus_should_return_a_list(self):	CODE
LOW⚡	test/unit/test_spiderfootwebui.py	565	def test_scansummary_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	24	def test_init_no_web_config_should_raise(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	76	def test_clean_user_input_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	83	def test_clean_user_input_invalid_input_should_raise(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	94	def test_clean_user_input_should_clean_user_input(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	109	def test_search_base_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	123	def test_scan_correlations_export(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	134	def test_scan_event_result_export_should_return_bytes(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	147	def test_scan_event_result_export_multi(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	160	def test_scan_search_result_export(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	172	def test_scan_export_logs_invalid_scan_id_should_return_string(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	184	def test_scan_export_logs_should_return_bytes(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	195	def test_scan_export_json_multi(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	206	def test_scan_viz_should_return_a_string(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	300	def test_optsexport_should_return_a_string(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	307	def test_optsraw_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	325	def test_scandelete_invalid_scanid_should_return_an_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	336	def test_savesettings_invalid_csrf_token_should_return_an_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	351	def test_savesettingsraw_invalid_csrf_token_should_return_an_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	363	def test_reset_settings_should_return_true(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	410	def test_query_should_perform_sql_query(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	424	def test_query_invalid_query_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	441	def test_start_scan_should_start_a_scan(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	452	def test_start_scan_invalid_scanname_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	464	def test_start_scan_invalid_scantarget_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	476	def test_start_scan_unrecognized_scantarget_type_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	486	def test_start_scan_invalid_modules_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	498	def test_start_scan_invalid_typelist_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	510	def test_stopscan_invalid_scanid_should_return_an_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	521	def test_scanlog_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	533	def test_scanerrors_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	577	def test_scaneventresults_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	589	def test_scaneventresultsunique_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	601	def test_search_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	613	def test_scan_history_missing_scanid_should_return_error(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	627	def test_scan_history_should_return_a_list(self):	CODE
LOW	test/unit/test_spiderfootwebui.py	637	def test_scan_element_type_discovery_should_return_a_dict(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	139	def test_config_serialize_invalid_opts_should_raise(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	145	def test_config_serialize_should_return_a_dict(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	151	def test_config_unserialize_invalid_opts_should_raise(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	157	def test_config_unserialize_invalid_reference_point_should_raise(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	163	def test_config_unserialize_should_return_a_dict(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	169	def test_cache_get_invalid_label_should_return_none(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	175	def test_cache_get_invalid_timeout_should_return_none(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	313	def test_host_domain_invalid_tldlist_should_return_none(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	319	def test_is_domain_valid_domain_should_return_true(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	327	def test_is_domain_invalid_domain_should_return_false(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	346	def test_is_domain_invalid_tldlist_should_return_false(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	353	def test_is_domain_invalid_tld_should_return_false(self):	CODE
LOW⚡	test/unit/test_spiderfoot.py	361	def test_valid_host_invalid_tldlist_should_return_false(self):	CODE
113 more matches not shown…

Deep Nesting187 hits · 182 pts

Severity	File	Line	Context
LOW	sf.py	235	CODE
LOW	sflib.py	254	CODE
LOW	sflib.py	306	CODE
LOW	sflib.py	370	CODE
LOW	sflib.py	534	CODE
LOW	sflib.py	562	CODE
LOW	sflib.py	801	CODE
LOW	sflib.py	976	CODE
LOW	sflib.py	1191	CODE
LOW	sflib.py	1459	CODE
LOW	sfwebui.py	1035	CODE
LOW	sfwebui.py	1088	CODE
LOW	sfwebui.py	1375	CODE
LOW	sfcli.py	228	CODE
LOW	sfcli.py	449	CODE
LOW	sfcli.py	854	CODE
LOW	sfcli.py	1176	CODE
LOW	sfscan.py	52	CODE
LOW	sfscan.py	260	CODE
LOW	sfscan.py	438	CODE
LOW	sfscan.py	517	CODE
LOW	spiderfoot/db.py	286	CODE
LOW	spiderfoot/db.py	549	CODE
LOW	spiderfoot/db.py	1220	CODE
LOW	spiderfoot/db.py	1305	CODE
LOW	spiderfoot/db.py	1598	CODE
LOW	spiderfoot/threadpool.py	72	CODE
LOW	spiderfoot/threadpool.py	240	CODE
LOW	spiderfoot/plugin.py	312	CODE
LOW	spiderfoot/plugin.py	498	CODE
LOW	spiderfoot/target.py	157	CODE
LOW	spiderfoot/correlation.py	133	CODE
LOW	spiderfoot/correlation.py	410	CODE
LOW	spiderfoot/correlation.py	608	CODE
LOW	spiderfoot/correlation.py	744	CODE
LOW	spiderfoot/correlation.py	793	CODE
LOW	spiderfoot/correlation.py	985	CODE
LOW	spiderfoot/correlation.py	617	CODE
LOW	spiderfoot/helpers.py	344	CODE
LOW	spiderfoot/helpers.py	372	CODE
LOW	spiderfoot/helpers.py	400	CODE
LOW	spiderfoot/helpers.py	559	CODE
LOW	spiderfoot/helpers.py	774	CODE
LOW	modules/sfp_opennic.py	129	CODE
LOW	modules/sfp_commoncrawl.py	134	CODE
LOW	modules/sfp_dnsraw.py	68	CODE
LOW	modules/sfp_cinsscore.py	84	CODE
LOW	modules/sfp_cinsscore.py	125	CODE
LOW	modules/sfp_junkfiles.py	86	CODE
LOW	modules/sfp_surbl.py	128	CODE
LOW	modules/sfp_fullhunt.py	139	CODE
LOW	modules/sfp_accounts.py	289	CODE
LOW	modules/sfp_openphish.py	151	CODE
LOW	modules/sfp_tool_retirejs.py	73	CODE
LOW	modules/sfp_spyonweb.py	192	CODE
LOW	modules/sfp_hackertarget.py	222	CODE
LOW	modules/sfp_securitytrails.py	96	CODE
LOW	modules/sfp_securitytrails.py	149	CODE
LOW	modules/sfp_dnsneighbor.py	66	CODE
LOW	modules/sfp_dnsneighbor.py	144	CODE
127 more matches not shown…

Self-Referential Comments8 hits · 24 pts

Severity	File	Line	Snippet	Context
MEDIUM	sfscan.py	114	# Create a unique ID for this scan in the back-end DB.	COMMENT
MEDIUM	sfscan.py	374	# Create a pseudo module for the root event to originate from	COMMENT
MEDIUM	spiderfoot/logger.py	55	# Create a new database handle when the first log batch is processed	COMMENT
MEDIUM	modules/sfp_hackertarget.py	337	# Create an IP Address event stemming from the netblock as the	COMMENT
MEDIUM	modules/sfp_tool_testsslsh.py	155	# Create a temporary output file	COMMENT
MEDIUM	modules/sfp_builtwith.py	249	# Create the name/co-host	COMMENT
MEDIUM	modules/sfp_bingsharedip.py	161	# Create an IP Address event stemming from the netblock as the	COMMENT
MEDIUM	correlations/template.yaml	34	# Define the collections to perform here. Refer to the README.md	COMMENT

Redundant / Tautological Comments12 hits · 18 pts

Severity	File	Line	Snippet	Context
LOW	spiderfoot/plugin.py	382	# Check if we've been asked to stop in the meantime, so that	COMMENT
LOW	spiderfoot/correlation.py	1068	# Check if any of the options aren't valid	COMMENT
LOW	modules/sfp_accounts.py	313	# Check if a state cache exists first, to not have to do this all the time	COMMENT
LOW	modules/sfp_slideshare.py	103	# Check if the profile is valid and extract name	COMMENT
LOW	modules/sfp_hunter.py	139	# Check if we have more results on further pages	COMMENT
LOW	modules/sfp_onioncity.py	147	# Check if we've been asked to stop	COMMENT
LOW	modules/sfp_torch.py	102	# Check if we've been asked to stop	COMMENT
LOW	modules/sfp_template.py	273	# Check if the module has already analysed this event data.	COMMENT
LOW	modules/sfp_tool_dnstwist.py	105	# Check if the TLD has wildcards before testing	COMMENT
LOW	modules/sfp_similar.py	118	# Check if the TLD has wildcards before testing	COMMENT
LOW	modules/sfp_skymem.py	141	# Check if we're on the last page of results	COMMENT
LOW	modules/sfp_onionsearchengine.py	97	# Check if we've been asked to stop	COMMENT

Cross-File Repetition3 hits · 15 pts

Severity	File	Snippet	Context
HIGH	modules/sfp_sorbs.py	query dronebl dns for an ipv4 address. args: qaddr (str): ipv4 address. returns: list: dronebl dns entries	STRING
HIGH	modules/sfp_spamcop.py	query dronebl dns for an ipv4 address. args: qaddr (str): ipv4 address. returns: list: dronebl dns entries	STRING
HIGH	modules/sfp_dronebl.py	query dronebl dns for an ipv4 address. args: qaddr (str): ipv4 address. returns: list: dronebl dns entries	STRING

Unused Imports8 hits · 8 pts

Severity	File	Line	Context
LOW	spiderfoot/__init__.py	1	CODE
LOW	spiderfoot/__init__.py	2	CODE
LOW	spiderfoot/__init__.py	3	CODE
LOW	spiderfoot/__init__.py	4	CODE
LOW	spiderfoot/__init__.py	5	CODE
LOW	spiderfoot/__init__.py	6	CODE
LOW	spiderfoot/__init__.py	7	CODE
LOW	spiderfoot/__init__.py	8	CODE

Modern Structural Boilerplate1 hit · 1 pts

Severity	File	Line	Snippet	Context
LOW	spiderfoot/plugin.py	151	def _updateSocket(self, socksProxy: str) -> None:	CODE

AI Structural Patterns1 hit · 0 pts

Severity	File	Line	Snippet	Context
LOW	sflib.py	1191		CODE

Analysis Overview

What These Metrics Mean

Score History

Severity Breakdown

Directory Score Breakdown

Pattern Findings