AI Slop Code Risk Monitor

NirDiamant/GenAI_Agents

SlopCodeMonitor badge for NirDiamant/GenAI_Agents Adjusted legacy signal; badge bands: 25 / 50 / 75 (different from dashboard bands).

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

1.3 Low pattern signal View on GitHub

Open-Source Code Quality, Security and Technical Debt Review

This report summarizes scanner evidence for NirDiamant/GenAI_Agents, a Jupyter Notebook project with 24,747 GitHub stars. SynthScan examined 71,260 lines of code across 63 source files, recording 66 pattern matches distributed across 6 syntactic categories. The legacy adjusted pattern signal is 1.3 (Low pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

1.3
Adjusted Signal
1.3
Raw Pattern Score
100%
Time Factor
2026-10-31
Last Push
24.7K
Stars
Jupyter Notebook
Language
71.3K
Lines of Code
63
Files
66
Pattern Hits
2026-10-31
Scan Date
0.00
HC Hit Rate

Risk Review · Payload v1

Use each vector to guide manual verification of the underlying findings.

Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.

Cognitive Ownership Risk 6.0/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 64 finding(s).

Hallucinated Dependency & Supply Chain Risk 0.0/100 · LOW

Are imports declared and package/API names verified? 0 finding(s).

Agent Over-Engineering Ratio 2.8/100 · LOW

Are wrappers, guards, and repeated structures necessary? 39 finding(s).

PR Review Velocity Impact 7.8/100 · LOW

Which changes need focused human review? 66 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 0MEDIUM 25LOW 41

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 66 distinct pattern matches across 6 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

AI Slop Vocabulary24 hits · 46 pts
SeverityFileLineSnippetContext
MEDIUMall_agents_tutorials/data/kv_store_text_chunks.json160 "content": "Artist: Eugene Delacroix\nArtwork Name: Liberty Leading the People\nArtwork Genre: history painting,symbCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json183 "return": "(\"entity\"<|>\"England\"<|>\"geo\"<|>\"England is the geographical location from which the emigrants in CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json187 "return": "(\"entity\"<|>\"Napoleon Bonaparte\"<|>\"person\"<|>\"Napoleon Bonaparte was the French military leader wCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json319 "return": "(\"entity\"<|>\"Théodore Géricault\"<|>\"person\"<|>\"Théodore Géricault was a French Romantic painter anCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json451 "return": "(\"entity\"<|>\"Pierre-Auguste Renoir\"<|>\"person\"<|>\"Pierre-Auguste Renoir was a French artist known CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json463 "return": "(\"entity\"<|>\"Cotton Exchange\"<|>\"organization\"<|>\"The Cotton Exchange was a significant business eCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json491 "return": "(\"entity\"<|>\"Pierre-Auguste Renoir\"<|>\"person\"<|>\"Pierre-Auguste Renoir was a French artist known CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json551 "return": "(\"entity\"<|>\"Pierre-Auguste Renoir\"<|>\"person\"<|>\"Pierre-Auguste Renoir was a French artist known CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json555 "return": "(\"entity\"<|>\"Woman with a Pearl Necklace in a Loge\"<|>\"event\"<|>\"Woman with a Pearl Necklace in a CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json635 "return": "(\"entity\"<|>\"Painting\"<|>\"event\"<|>\"Painting refers to the act of applying pigment to a surface, wCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json687 "return": "(\"entity\"<|>\"Thomas Eakins\"<|>\"person\"<|>\"Thomas Eakins is an American artist known for his contriCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json839 "return": "(\"entity\"<|>\"Oil on Canvas\"<|>\"technology\"<|>\"Oil on Canvas is the medium used for the painting 'JCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json851 "return": "(\"entity\"<|>\"oil on canvas\"<|>\"technology\"<|>\"Oil on canvas refers to the technique used by AbbottCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json899 "return": "(\"entity\"<|>\"The Sick Child (Norwegian: Det syke barn)\"<|>\"event\"<|>\"The Sick Child is a series ofCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json907 "return": "(\"entity\"<|>\"The Scream Team\"<|>\"organization\"<|>\"The Scream Team consists of individuals involvedCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json935 "return": "(\"entity\"<|>\"The Fate of the Animals\"<|>\"event\"<|>\"The Fate of the Animals is a painting created iCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json943 "return": "(\"entity\"<|>\"Francesco Hayez\"<|>\"person\"<|>\"Francesco Hayez is an Italian artist known for his hisCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json967 "return": "(\"entity\"<|>\"Alessandro Sanquirico\"<|>\"person\"<|>\"Alessandro Sanquirico was an artist whose set deCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json979 "return": "Sure, I will extract additional entities that may have been overlooked in the previous extraction.\n\n(\"CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json979 "return": "Sure, I will extract additional entities that may have been overlooked in the previous extraction.\n\n(\"CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json995 "return": "(\"entity\"<|>\"Francisco Goya\"<|>\"person\"<|>\"Francisco Goya was a renowned Spanish artist known for CODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json1015 "return": "(\"entity\"<|>\"Charles IV\"<|>\"person\"<|>\"Charles IV was the King of Spain from 1788 to 1808, depicteCODE
MEDIUM…agents_tutorials/data/kv_store_llm_response_cache.json1143 "return": "(\"entity\"<|>\"The Junta of the Royal Company of the Philippines\"<|>\"event\"<|>\"The Junta of the RoyaCODE
MEDIUMall_agents_tutorials/data/kv_store_full_docs.json81 "content": "Artist: Eugene Delacroix\nArtwork Name: Liberty Leading the People\nArtwork Genre: history painting,symbCODE
Hyper-Verbose Identifiers37 hits · 38 pts
SeverityFileLineSnippetContext
LOWtests/test_hitl_approval_agent.py49 def test_low_risk_action_executes_without_an_approval_request(self):CODE
LOWtests/test_hitl_approval_agent.py58 def test_high_risk_action_pauses_before_any_side_effect(self):CODE
LOW⚡tests/test_hitl_approval_agent.py70 def test_small_mutating_refund_also_pauses_before_side_effect(self):CODE
LOW⚡tests/test_hitl_approval_agent.py80 def test_planned_refund_cannot_call_tool_dispatcher_directly(self):CODE
LOW⚡tests/test_hitl_approval_agent.py88 def test_approve_resumes_and_executes_the_original_action(self):CODE
LOWtests/test_hitl_approval_agent.py102 def test_reject_finishes_without_executing_the_action(self):CODE
LOWtests/test_hitl_approval_agent.py119 def test_modify_revalidates_and_executes_reviewer_arguments(self):CODE
LOWtests/test_hitl_approval_agent.py144 def test_invalid_modified_arguments_are_blocked(self):CODE
LOWtests/test_hitl_approval_agent.py161 def test_unexpected_tool_arguments_are_rejected(self):CODE
LOWtests/test_hitl_approval_agent.py174 def test_unexpected_modified_arguments_are_blocked(self):CODE
LOWtests/test_hitl_approval_agent.py195 def test_boolean_and_non_finite_refund_amounts_are_rejected(self):CODE
LOWtests/test_hitl_approval_agent.py226 def test_graph_interrupts_before_refund_execution(self):CODE
LOWtests/test_hitl_approval_agent.py236 def test_graph_resumes_approve_reject_and_modify_decisions(self):CODE
LOWtests/test_trace_based_agent_evaluation.py28 def test_perfect_trace_receives_full_credit(self):CODE
LOWtests/test_trace_based_agent_evaluation.py50 def test_wrong_arguments_and_ungrounded_answer_lose_independent_credit(self):CODE
LOWtests/test_trace_based_agent_evaluation.py72 def test_errors_fail_every_execution_check(self):CODE
LOWtests/test_trace_based_agent_evaluation.py89 def test_empty_error_string_still_means_execution_failed(self):CODE
LOWtests/test_trace_based_agent_evaluation.py105 def test_agent_exception_becomes_failed_trace_and_suite_continues(self):CODE
LOWtests/test_trace_based_agent_evaluation.py119 def test_empty_suite_is_rejected_with_clear_error(self):CODE
LOWtests/test_trace_based_agent_evaluation.py123 def test_contradictory_claim_does_not_receive_evidence_credit(self):CODE
LOWtests/test_trace_based_agent_evaluation.py139 def test_extra_tool_call_fails_the_complete_sequence_contract(self):CODE
LOWtests/test_trace_based_agent_evaluation.py158 def test_latency_budget_is_inclusive_and_rejects_over_budget(self):CODE
LOWtests/test_trace_based_agent_evaluation.py190 def test_suite_gate_reports_metric_regressions(self):CODE
LOWtests/test_trace_based_agent_evaluation.py206 def test_improved_agent_passes_the_declared_gate(self):CODE
LOWtests/test_validate_notebook.py69 def test_accepts_template_compliant_notebook(self):CODE
LOWtests/test_validate_notebook.py77 def test_reports_outputs_and_execution_counts(self):CODE
LOWtests/test_validate_notebook.py89 def test_reports_code_cell_without_preceding_markdown_description(self):CODE
LOWtests/test_validate_notebook.py101 def test_reports_code_cell_after_empty_markdown(self):CODE
LOWtests/test_validate_notebook.py114 def test_reports_code_cell_after_prose_without_a_title(self):CODE
LOWtests/test_validate_notebook.py127 def test_reports_missing_template_section(self):CODE
LOWtests/test_validate_notebook.py142 def test_near_match_does_not_satisfy_required_section(self):CODE
LOWtests/test_validate_notebook.py156 def test_reports_missing_local_markdown_image(self):CODE
LOWtests/test_validate_notebook.py170 def test_reports_missing_local_html_image(self):CODE
LOWtests/test_validate_notebook.py184 def test_protocol_relative_image_is_treated_as_remote(self):CODE
LOWtests/test_validate_notebook.py196 def test_malformed_image_target_reports_finding_and_continues(self):CODE
LOWtests/test_validate_notebook.py212 def test_local_image_cannot_escape_repository_root(self):CODE
LOWtests/test_validate_notebook.py263 def test_cli_checks_every_requested_notebook(self):CODE
Excessive Try-Catch Wrapping2 hits · 2 pts
SeverityFileLineSnippetContext
LOWall_agents_tutorials/scripts/mcp_server.py58 except Exception as e:CODE
LOW.github/workflows/notebook-smoke.yml41 except Exception as exc:CODE
Self-Referential Comments1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_validate_notebook.py41 markdown("## Implementation\n\n### Define the policy"),CODE
Redundant / Tautological Comments1 hit · 2 pts
SeverityFileLineSnippetContext
LOWall_agents_tutorials/scripts/mcp_server.py48 # Check if we got data for the requested cryptoCOMMENT
Over-Commented Block1 hit · 1 pts
SeverityFileLineSnippetContext
LOWrequirements.txt1# Shared dependencies for the GenAI_Agents notebooks.COMMENT