AI Slop Code RIsk Monitor

pathwaycom/llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

29.8 Elevated pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for pathwaycom/llm-app, a Jupyter Notebook project with 58,812 GitHub stars. SynthScan examined 6,017 lines of code across 66 source files, recording 79 pattern matches distributed across 7 syntactic categories. The legacy adjusted pattern signal is 29.8 (Elevated pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

29.8
Adjusted Signal
29.8
Raw Pattern Score
100%
Time Factor
2026-07-05
Last Push
58.8K
Stars
Jupyter Notebook
Language
6.0K
Lines of Code
66
Files
79
Pattern Hits
2026-10-12
Scan Date
0.00
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 76.2/100 · CRITICAL

Can maintainers explain intent, assumptions, and trade-offs? 72 finding(s).

Hallucinated Dependency & Supply Chain Risk 1.6/100 · LOW

Are imports declared and package/API names verified? 2 finding(s).

Agent Over-Engineering Ratio 8.7/100 · LOW

Are wrappers, guards, and repeated structures necessary? 12 finding(s).

PR Review Velocity Impact 74.6/100 · HIGH

Which changes need focused human review? 79 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 0MEDIUM 43LOW 36

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 79 distinct pattern matches across 7 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Modern AI Meta-Vocabulary43 hits · 144 pts
SeverityFileLineSnippetContext
MEDIUMtemplates/slides_ai_search/app.yaml1# This YAML configuration file is used to set up and configure the Slides Search RAG template.COMMENT
MEDIUMtemplates/slides_ai_search/app.yaml8# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUMtemplates/slides_ai_search/README.md219#### With the Pathway Live Data Framework RAG ClientCOMMENT
MEDIUMtemplates/document_store_mcp_server/app.yaml1# This YAML configuration file is used to set up and configure the Document indexing RAG template.COMMENT
MEDIUMtemplates/document_store_mcp_server/app.yaml7# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUMtemplates/document_store_mcp_server/app.yaml65# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUM⚡templates/video_rag_twelvelabs/app.yaml1# This YAML configuration file sets up the TwelveLabs video RAG template.COMMENT
MEDIUM⚡templates/video_rag_twelvelabs/app.yaml3# embedding that text with the TwelveLabs Marengo model, and serving a RAGCOMMENT
MEDIUM⚡templates/video_rag_twelvelabs/app.yaml9# $sources defines the data sources read and indexed in the RAG.COMMENT
MEDIUMtemplates/video_rag_twelvelabs/app.yaml79# The RAG question-answering component served over HTTP.COMMENT
MEDIUMtemplates/video_rag_twelvelabs/README.md12# Video RAG with Pathway Live Data Framework and TwelveLabsCOMMENT
MEDIUMtemplates/document_indexing/app.yaml1# This YAML configuration file is used to set up and configure the Document indexing RAG template.COMMENT
MEDIUMtemplates/document_indexing/app.yaml7# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUMtemplates/document_indexing/app.yaml65# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUMtemplates/private_rag/app.yaml1# This YAML configuration file is used to set up and configure the Private RAG template.COMMENT
MEDIUMtemplates/private_rag/app.yaml8# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUMtemplates/private_rag/app.yaml87# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUMtemplates/private_rag/app.yaml94# Configures the question-answering component using the RAG approach.COMMENT
MEDIUMtemplates/private_rag/README.md12# Fully private RAG with Pathway Live Data FrameworkCOMMENT
MEDIUMtemplates/multimodal_rag/app.yaml1# This YAML configuration file is used to set up and configure the Multimodal RAG template.COMMENT
MEDIUMtemplates/multimodal_rag/app.yaml8# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUMtemplates/multimodal_rag/app.yaml91# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUMtemplates/multimodal_rag/app.yaml98# Configures the question-answering component using the RAG approach.COMMENT
MEDIUMtemplates/multimodal_rag/README.md12# Multimodal RAG with Pathway Live Data Framework: Process your Financial Reports and Tables with GPT-4oCOMMENT
MEDIUMtemplates/drive_alert/README.md1# Pathway Live Data Framework + LLM + Slack notification: RAG App with real-time alerting when answers change in documenCOMMENT
MEDIUMtemplates/adaptive_rag/app.yaml1# This YAML configuration file is used to set up and configure the Adaptive RAG template.COMMENT
MEDIUMtemplates/adaptive_rag/app.yaml8# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUM⚡templates/adaptive_rag/app.yaml79# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUM⚡templates/adaptive_rag/app.yaml86# Configures the question-answering component using the RAG approach.COMMENT
MEDIUM⚡templates/adaptive_rag/app.yaml87# The component builds a RAG over an index.COMMENT
MEDIUM⚡templates/adaptive_rag/app.yaml88# You can interact with obtained RAG using a REST API.COMMENT
MEDIUMtemplates/adaptive_rag/README.md13# End to end Adaptive RAG with Pathway Live Data FrameworkCOMMENT
MEDIUMtemplates/question_answering_rag/app.yaml1# This YAML configuration file is used to set up and configure the Question Answering RAG template.COMMENT
MEDIUMtemplates/question_answering_rag/app.yaml8# $sources defines the data sources used to read the data which will be indexed in the RAG.COMMENT
MEDIUM⚡templates/question_answering_rag/app.yaml80# Manages the storage and retrieval of documents for the RAG template.COMMENT
MEDIUM⚡templates/question_answering_rag/app.yaml87# Configures the question-answering component using the RAG approach.COMMENT
MEDIUM⚡templates/question_answering_rag/app.yaml88# The component builds a RAG over an index.COMMENT
MEDIUM⚡templates/question_answering_rag/app.yaml89# You can interact with obtained RAG using a REST API.COMMENT
MEDIUMtemplates/question_answering_rag/README.md12# Pathway Live Data Framework RAG app with always up-to-date knowledgeCOMMENT
MEDIUMtemplates/question_answering_rag/README.md41This example spawns a lightweight webserver using Pathway’s [`QASummaryRestServer`](https://pathway.com/developers/api-dCODE
MEDIUMtemplates/question_answering_rag/README.md48### LLM and RAG capabilitiesCOMMENT
MEDIUMtemplates/question_answering_rag/README.md94### RAGCOMMENT
MEDIUMtemplates/question_answering_rag/README.md329#### Asking questions to LLM (With and without RAG)COMMENT
Over-Commented Block22 hits · 22 pts
SeverityFileLineSnippetContext
LOWtemplates/slides_ai_search/app.yaml21 # url: $SHAREPOINT_URLCOMMENT
LOWtemplates/slides_ai_search/app.yaml101 description: "Language of the slide. For example 'fr', 'en'"COMMENT
LOWtemplates/slides_ai_search/app.yaml121# Defaults to false, uncomment the following line if you want to set it to trueCOMMENT
LOWtemplates/document_store_mcp_server/app.yaml1# This YAML configuration file is used to set up and configure the Document indexing RAG template.COMMENT
LOWtemplates/document_store_mcp_server/app.yaml21 # tenant: $SHAREPOINT_TENANTCOMMENT
LOWtemplates/document_store_mcp_server/app.yaml81# By default, caching is enabled for UDFs with cache_strategy set.COMMENT
LOWtemplates/video_rag_twelvelabs/app.yaml1# This YAML configuration file sets up the TwelveLabs video RAG template.COMMENT
LOWtemplates/video_rag_twelvelabs/app.yaml21 # - !pw.io.gdrive.readCOMMENT
LOWtemplates/video_rag_twelvelabs/app.yaml81 llm: $llmCOMMENT
LOWtemplates/document_indexing/app.yaml1# This YAML configuration file is used to set up and configure the Document indexing RAG template.COMMENT
LOWtemplates/document_indexing/app.yaml21 # tenant: $SHAREPOINT_TENANTCOMMENT
LOWtemplates/document_indexing/app.yaml81# By default, when enabled, Cache is stored in .Cache directory.COMMENT
LOWtemplates/private_rag/app.yaml21 # url: $SHAREPOINT_URLCOMMENT
LOWtemplates/private_rag/app.yaml101 strict_prompt: trueCOMMENT
LOWtemplates/multimodal_rag/app.yaml21 # url: $SHAREPOINT_URLCOMMENT
LOWtemplates/multimodal_rag/app.yaml101 indexer: $document_storeCOMMENT
LOWtemplates/multimodal_rag/app.yaml121# path: ".Cache"COMMENT
LOWtemplates/adaptive_rag/app.yaml21 # url: $SHAREPOINT_URLCOMMENT
LOWtemplates/adaptive_rag/app.yaml101COMMENT
LOWtemplates/question_answering_rag/app.yaml21 # url: $SHAREPOINT_URLCOMMENT
LOWtemplates/question_answering_rag/app.yaml81$document_store: !pw.xpacks.llm.document_store.DocumentStoreCOMMENT
LOWtemplates/question_answering_rag/app.yaml101COMMENT
Hyper-Verbose Identifiers4 hits · 3 pts
SeverityFileLineSnippetContext
LOWtemplates/slides_ai_search/ui/ui.py91def parse_slide_id_components(slide_id: str) -> tuple[str, int, int]:CODE
LOWtemplates/drive_alert/app.py73def build_prompt_check_for_alert_request_and_extract_query(query: str) -> str:CODE
LOWtemplates/drive_alert/app.py94def build_prompt_compare_answers(new: str, old: str) -> str:STRING
LOWtemplates/drive_alert/app.py111def construct_notification_message(query: str, response: str) -> str:STRING
Excessive Try-Catch Wrapping3 hits · 3 pts
SeverityFileLineSnippetContext
LOW…/slides_ai_search/pathway_slides_ai_search/__init__.py104 except Exception as e:CODE
LOW…/slides_ai_search/pathway_slides_ai_search/__init__.py117 except Exception as e:CODE
LOWtemplates/unstructured_to_sql_on_the_fly/ui/server.py75 except Exception as e:CODE
AI Structural Patterns3 hits · 3 pts
SeverityFileLineSnippetContext
LOWtemplates/unstructured_to_sql_on_the_fly/app.py208CODE
LOWtemplates/unstructured_to_sql_on_the_fly/app.py273CODE
LOWtemplates/drive_alert/app.py128CODE
Modern Structural Boilerplate2 hits · 2 pts
SeverityFileLineSnippetContext
LOWtemplates/unstructured_to_sql_on_the_fly/__init__.py3__all__ = ["run"]CODE
LOWtemplates/drive_alert/__init__.py3__all__ = ["run"]CODE
Unused Imports2 hits · 2 pts
SeverityFileLineSnippetContext
LOWtemplates/unstructured_to_sql_on_the_fly/__init__.py1CODE
LOWtemplates/drive_alert/__init__.py1CODE