AI Slop Code Risk Monitor

codelucas/newspaper

SlopCodeMonitor badge for codelucas/newspaper Adjusted legacy signal; badge bands: 25 / 50 / 75 (different from dashboard bands).

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

0.6 Low pattern signal View on GitHub

Open-Source Code Quality, Security and Technical Debt Review

This report summarizes scanner evidence for codelucas/newspaper, a Python project with 15,181 GitHub stars. SynthScan examined 297,753 lines of code across 399 source files, recording 127 pattern matches distributed across 14 syntactic categories. The legacy adjusted pattern signal is 0.6 (Low pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

0.6
Adjusted Signal
0.6
Raw Pattern Score
100%
Time Factor
2026-10-26
Last Push
15.2K
Stars
Python
Language
297.8K
Lines of Code
399
Files
127
Pattern Hits
2026-10-31
Scan Date
0.01
HC Hit Rate

Risk Review · Payload v1

Use each vector to guide manual verification of the underlying findings.

Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.

Cognitive Ownership Risk 2.0/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 90 finding(s).

Hallucinated Dependency & Supply Chain Risk 0.7/100 · LOW

Are imports declared and package/API names verified? 25 finding(s).

Agent Over-Engineering Ratio 1.1/100 · LOW

Are wrappers, guards, and repeated structures necessary? 46 finding(s).

PR Review Velocity Impact 3.4/100 · LOW

Which changes need focused human review? 127 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 2HIGH 2MEDIUM 24LOW 99

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 127 distinct pattern matches across 14 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

AI Slop Vocabulary19 hits · 44 pts
SeverityFileLineSnippetContext
MEDIUM⚡tests/data/html/thedailybeast.com2.html1<!DOCTYPE html><!--[if lt IE 7]> <html class="ie ie6 lte9 lte8 lte7" lang="en"> <![endif]--><!--[if IE 7]> <html class="CODE
MEDIUM⚡tests/data/html/thedailybeast.com2.html1<!DOCTYPE html><!--[if lt IE 7]> <html class="ie ie6 lte9 lte8 lte7" lang="en"> <![endif]--><!--[if IE 7]> <html class="CODE
MEDIUM⚡tests/data/html/thedailybeast.com2.html1<!DOCTYPE html><!--[if lt IE 7]> <html class="ie ie6 lte9 lte8 lte7" lang="en"> <![endif]--><!--[if IE 7]> <html class="CODE
MEDIUMtests/data/html/lifebuzz.com1.html306 <img alt="30 World Festivals That You&#39;ll Definitely Want To Add To Your Bucket List. " src="http:CODE
MEDIUMtests/data/html/lifebuzz.com1.html307</a> <h3><a href="/fun-festivals/">30 World Festivals That You&#39;ll Definitely Want To Add To Your BuckCODE
MEDIUMtests/data/html/bostonherald.com1.html587 <div class="field-item even" property="content:encoded"><p><body.content></body.content></p><p><person>Annie LCODE
MEDIUMtests/data/html/slate.com1.html1493<p>These contemporary <a href="http://en.wikipedia.org/wiki/Appian_Way">Appian Ways</a> are the vital back end of the InCODE
MEDIUMtests/data/html/slate.com1.html1649<p>That&rsquo;s in part because the state-owned and private telecom companies that have built and run the global networkCODE
MEDIUMtests/data/html/slate.com1.html1649<p>That&rsquo;s in part because the state-owned and private telecom companies that have built and run the global networkCODE
MEDIUMtests/data/html/slate.com1.html2048<p>And in the cold rock deep underground, engineers are toiling to fix a pretty big flaw in the system. The&nbsp;<em>NewCODE
MEDIUMtests/data/html/glamour.com2.html11<meta name="description" content="A ton of brides are going for the pretty pretty princess vibe on their wedding day, soCODE
MEDIUMtests/data/html/glamour.com2.html23<meta property="og:description" content="A ton of brides are going for the pretty pretty princess vibe on their wedding CODE
MEDIUMtests/data/html/glamour.com2.html71 meta: {"contributor":"Kim Fusaro","description":"A ton of brides are going for the pretty pretty princess vibe oCODE
MEDIUMtests/data/html/glamour.com2.html731 <p>A ton of brides are going for the <a href="http://smile.amazon.com/Pretty-Princess-DrCODE
MEDIUMtests/data/html/lifebuzz.com2.html306 <img alt="30 World Festivals That You&#39;ll Definitely Want To Add To Your Bucket List. " src="http:CODE
MEDIUMtests/data/html/lifebuzz.com2.html307</a> <h3><a href="/fun-festivals/">30 World Festivals That You&#39;ll Definitely Want To Add To Your BuckCODE
MEDIUM⚡tests/data/html/thedailybeast.com1.html3<p>The report was the fruit of an investigation into 341 American congregations guided by Mother Superior Marie Clare MiCODE
MEDIUM⚡tests/data/html/thedailybeast.com1.html3<p>The report was the fruit of an investigation into 341 American congregations guided by Mother Superior Marie Clare MiCODE
MEDIUM⚡tests/data/html/thedailybeast.com1.html3<p>The report was the fruit of an investigation into 341 American congregations guided by Mother Superior Marie Clare MiCODE
Hyper-Verbose Identifiers34 hits · 36 pts
SeverityFileLineSnippetContext
LOW⚡tests/unit_tests.py382 def test_get_canonical_link_rel_canonical(self):CODE
LOW⚡tests/unit_tests.py387 def test_get_canonical_link_rel_canonical_absolute_url(self):CODE
LOW⚡tests/unit_tests.py393 def test_get_canonical_link_og_url_absolute_url(self):CODE
LOW⚡tests/unit_tests.py399 def test_get_canonical_link_hostname_og_url_absolute_url(self):CODE
LOW⚡tests/unit_tests.py405 def test_get_top_image_from_meta(self):CODE
LOW⚡tests/unit_tests.py639 def test_article_default_params(self):CODE
LOW⚡tests/unit_tests.py648 def test_article_custom_params(self):CODE
LOW⚡tests/unit_tests.py657 def test_source_default_params(self):CODE
LOW⚡tests/unit_tests.py665 def test_source_custom_params(self):CODE
LOWtests/unit_tests.py186 def test_meta_refresh_redirect(self):CODE
LOWtests/unit_tests.py199 def test_meta_refresh_no_url_redirect(self):CODE
LOWtests/unit_tests.py248 def test_meta_type_extraction(self):CODE
LOWtests/unit_tests.py332 def test_download_file_success(self):CODE
LOWtests/unit_tests.py341 def test_download_file_failure(self):CODE
LOWtests/unit_tests.py369 def test_get_title_split_escaped(self):CODE
LOWtests/unit_tests.py450 def test_source_url_input_none(self):CODE
LOWtests/unit_tests.py676 def test_chinese_fulltext_extract(self):CODE
LOWtests/unit_tests.py687 def test_arabic_fulltext_extract(self):CODE
LOWtests/unit_tests.py700 def test_spanish_fulltext_extract(self):CODE
LOWtests/unit_tests.py712 def test_japanese_fulltext_extract(self):CODE
LOWtests/unit_tests.py734 def test_thai_fulltext_extract(self):CODE
LOWtests/unit_tests.py754 def test_article_pdf_ignoring(self):CODE
LOWtests/unit_tests.py765 def test_article_pdf_fetching(self):CODE
LOWtests/data/html/nypost.com1.html182</script><script type="text/javascript">function janrainCaptureWidgetOnLoad() {CODE
LOWtests/data/html/youbeauty.com2.html1547 function highlightUserAlreadyExistMessage() {CODE
LOWtests/data/html/youbeauty.com1.html1637 function highlightUserAlreadyExistMessage() {CODE
LOWtests/data/html/nypost.com2.html182</script><script type="text/javascript">function janrainCaptureWidgetOnLoad() {CODE
LOWnewspaper/outputformatters.py101 def remove_negativescores_nodes(self):CODE
LOWnewspaper/outputformatters.py141 def remove_trailing_media_div(self):CODE
LOWnewspaper/extractors.py1022 def is_table_and_no_para_exist(self, e):CODE
LOWnewspaper/extractors.py1034 def is_nodescore_threshold_met(self, node, e):CODE
LOWnewspaper/utils.py354def print_available_languages():CODE
LOWnewspaper/article.py552 def throw_if_not_downloaded_verbose(self):CODE
LOWnewspaper/article.py562 def throw_if_not_parsed_verbose(self):CODE
Hallucination Indicators2 hits · 20 pts
SeverityFileLineSnippetContext
CRITICALtests/data/html/nypost.com1.html414 fyre.conv.BackplaneAuthDelegate.prototype.logout.call(this, delegate);CODE
CRITICALtests/data/html/nypost.com2.html413 fyre.conv.BackplaneAuthDelegate.prototype.logout.call(this, delegate);CODE
Over-Commented Block17 hits · 17 pts
SeverityFileLineSnippetContext
LOWtests/data/html/bhg.com2.html141 .socialToolbar li div.gig-button-container { padding: 0; }COMMENT
LOWtests/data/html/bhg.com2.html161 COMMENT
LOWtests/data/html/reuters.com1.html801Reuters.utils.addLoadEvent(function() { Reuters.utils.replaceContent('searchModule', '/assets/searchIntercept?blob='+higCOMMENT
LOWnewspaper/resources/text/stopwords-fr.txt1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWdocs/conf.py1# -*- coding: utf-8 -*-COMMENT
LOWdocs/conf.py21# If extensions (or modules to document with autodoc) are in another directory,COMMENT
LOWdocs/conf.py41# The suffix of source filenames.COMMENT
LOWdocs/conf.py61release = '0.0.2'COMMENT
LOWdocs/conf.py81# If true, '()' will be appended to :func: etc. cross-reference text.COMMENT
LOWdocs/conf.py101COMMENT
LOWdocs/conf.py121# A shorter title for the navigation bar. Default is the same as html_title.COMMENT
LOWdocs/conf.py141#html_extra_path = []COMMENT
LOWdocs/conf.py161COMMENT
LOWdocs/conf.py181# contain a <link> tag referring to it. The value of this option must be theCOMMENT
LOWdocs/conf.py201# Additional stuff for the LaTeX preamble.COMMENT
LOWdocs/conf.py221# If true, show page references after internal links.COMMENT
LOWdocs/conf.py261# If false, no module index is generated.COMMENT
Unused Imports16 hits · 16 pts
SeverityFileLineSnippetContext
LOWtests/benchmarks.py11CODE
LOWtests/benchmarks.py14CODE
LOWtests/benchmarks.py15CODE
LOWtests/benchmarks.py16CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py10CODE
LOWnewspaper/__init__.py12CODE
LOWnewspaper/__init__.py12CODE
LOWnewspaper/__init__.py14CODE
LOWnewspaper/__init__.py15CODE
LOWnewspaper/settings.py15CODE
Deep Nesting13 hits · 12 pts
SeverityFileLineSnippetContext
LOWtests/unit_tests.py549CODE
LOWnewspaper/configuration.py106CODE
LOWnewspaper/extractors.py237CODE
LOWnewspaper/extractors.py492CODE
LOWnewspaper/extractors.py629CODE
LOWnewspaper/extractors.py773CODE
LOWnewspaper/extractors.py885CODE
LOWnewspaper/parsers.py193CODE
LOWnewspaper/nlp.py180CODE
LOWnewspaper/images.py86CODE
LOWnewspaper/images.py228CODE
LOWnewspaper/cleaners.py221CODE
LOWnewspaper/urls.py102CODE
Empty Error Handlers2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHnewspaper/settings.py55except FileExistsError:CODE
HIGHnewspaper/article.py422except OSError:CODE
Decorative Section Separators3 hits · 9 pts
SeverityFileLineSnippetContext
MEDIUMnewspaper/resources/text/stopwords-fr.txt16#-----------------------------------------------------------------------COMMENT
MEDIUMnewspaper/resources/text/stopwords-sv.txt1#-----------------------------------------------------------------------COMMENT
MEDIUMnewspaper/resources/text/stopwords-sv.txt3#-----------------------------------------------------------------------COMMENT
Fake / Example Data7 hits · 8 pts
SeverityFileLineSnippetContext
LOWtests/data/html/upworthy.com2.html765 <img src="#" id="placeholder" alt="Image Detail">CODE
LOWtests/data/html/youbeauty.com2.html381 $("#newsletter_subscription_email").attr("placeholder", "Please enter a valid email address")CODE
LOWtests/data/html/upworthy.com1.html749 <img src="#" id="placeholder" alt="Image Detail">CODE
LOWtests/data/html/youbeauty.com1.html381 $("#newsletter_subscription_email").attr("placeholder", "Please enter a valid email address")CODE
LOW⚡tests/data/html/nola.com1.html1221jQuery('#SearchKeyword').val(jQuery(this).attr('placeholder')).addClass('grayTxt').focus(function(){CODE
LOW⚡tests/data/html/nola.com1.html1224 if(jQuery(this).val()==='')jQuery(this).addClass('grayTxt').val(jQuery(this).attr('placeholder'));CODE
LOW⚡tests/data/html/nola.com1.html1226jQuery('#SearchKeyword').val(jQuery('#SearchKeyword').attr('placeholder'));CODE
Excessive Try-Catch Wrapping7 hits · 8 pts
SeverityFileLineSnippetContext
LOWtests/unit_tests.py99 except Exception:CODE
LOWnewspaper/parsers.py70 except Exception:CODE
LOWnewspaper/api.py66 except Exception as e:CODE
LOWnewspaper/images.py127 except Exception as e:CODE
LOWnewspaper/mthreading.py47 except Exception:CODE
LOWnewspaper/article.py442 except Exception as e:CODE
MEDIUMnewspaper/article.py165def _parse_scheme_file(self, path):CODE
Slop Phrases3 hits · 3 pts
SeverityFileLineSnippetContext
LOWtests/data/html/teenvogue.com2.html2738<p>Ahead, we've rounded up our top 10 break-out style star picks for 2014. Click through to see who we chose, and don't CODE
LOWtests/data/html/teenvogue.com2.html3628<p>Ahead, we've rounded up our top 10 break-out style star picks for 2014. Click through to see who we chose, and don't CODE
LOWtests/data/html/teenvogue.com2.html5384 introData.body = {"xml-fragment":{"text":"<p>Every year, we love looking back and picking ouCODE
Redundant / Tautological Comments2 hits · 3 pts
SeverityFileLineSnippetContext
LOWnewspaper/configuration.py44 # Set this to false if you don't care about getting imagesCOMMENT
LOWnewspaper/configuration.py76 # Set this to False if you want to recompute the categoriesCOMMENT
Self-Referential Comments1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMdocs/conf.py6# This file is execfile()d with the current directory set to itsCOMMENT
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOWnewspaper/article.py417 # TODO: implement in entiretyCOMMENT