AI Slop Code RIsk Monitor

ai-boost/awesome-harness-engineering

Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.

89.5 High pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for ai-boost/awesome-harness-engineering, a Python project with 4,786 GitHub stars. SynthScan examined 1,296 lines of code across 9 source files, recording 61 pattern matches distributed across 2 syntactic categories. The legacy adjusted pattern signal is 89.5 (High pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

89.5
Adjusted Signal
89.5
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
4.8K
Stars
Python
Language
1.3K
Lines of Code
9
Files
61
Pattern Hits
2026-10-12
Scan Date
0.00
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 98.7/100 · CRITICAL

Can maintainers explain intent, assumptions, and trade-offs? 59 finding(s).

Hallucinated Dependency & Supply Chain Risk 0.0/100 · LOW

Are imports declared and package/API names verified? 0 finding(s).

Agent Over-Engineering Ratio 10.9/100 · LOW

Are wrappers, guards, and repeated structures necessary? 2 finding(s).

PR Review Velocity Impact 99.9/100 · CRITICAL

Which changes need focused human review? 61 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 0MEDIUM 60LOW 1

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 61 distinct pattern matches across 2 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Modern AI Meta-Vocabulary59 hits · 113 pts
SeverityFileLineSnippetContext
MEDIUM⚡README.md82- [2026 Agentic Coding Trends Report](https://resources.anthropic.com/hubfs/2026%20Agentic%20Coding%20Trends%20Report.pdCODE
MEDIUM⚡README.md83- [How We Build Azure SRE Agent with Agentic Workflows](https://techcommunity.microsoft.com/blog/appsonazureblog/how-we-CODE
MEDIUM⚡README.md92- [What makes a harness a harness: necessary and sufficient conditions for an agent harness](https://arxiv.org/abs/2606.CODE
MEDIUM⚡README.md112- [Hooks – Codex](https://developers.openai.com/codex/hooks) — OpenAI's lifecycle-hook framework for Codex: inject deterCODE
MEDIUM⚡README.md116- [Loop Engineering](https://github.com/cobusgreyling/loop-engineering) — Practical design system for agent loops with sCODE
MEDIUM⚡README.md126- [statewright](https://github.com/statewright/statewright) — State machine guardrails that constrain which tools an ageCODE
MEDIUM⚡README.md225- [Google Developers: Closing the Knowledge Gap with Agent Skills](https://developers.googleblog.com/closing-the-knowledCODE
MEDIUM⚡README.md231- [agentic-stack](https://github.com/codejunkie99/agentic-stack) — Portable `.agent/` folder that externalizes memory, sCODE
MEDIUM⚡README.md236- [Antigravity Awesome Skills](https://github.com/sickn33/antigravity-awesome-skills) — Installable library of 1,400+ agCODE
MEDIUM⚡README.md237- [agentgateway](https://github.com/agentgateway/agentgateway) — Open-source agentic proxy that unifies LLM gateway, MCPCODE
MEDIUM⚡README.md252- [Two Different Types of Agent Authorization](https://blog.langchain.com/two-different-types-of-agent-authorization/) —CODE
MEDIUM⚡README.md257- [AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security](https://arxiv.org/abs/2601.18491) — ThreCODE
MEDIUM⚡README.md261- [When "Do Not" Is Not Deny: Security Rules in CLAUDE.md vs Built-In Controls](https://arxiv.org/abs/2608.23550) — AnalCODE
MEDIUM⚡README.md301- [LiteLLM](https://github.com/BerriAI/litellm) — Unified proxy and SDK that routes to 100+ LLM providers behind a singlCODE
MEDIUM⚡README.md303- [OpenAI Agents SDK](https://github.com/openai/openai-agents-python) — Lightweight multi-agent framework built around hCODE
MEDIUM⚡README.md307- [strands-agents/harness-sdk](https://github.com/strands-agents/harness-sdk) — AWS's open-source, model-driven agent SDCODE
MEDIUM⚡README.md354- [The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems](https://arxiv.org/CODE
MEDIUM⚡README.md364- [Opik](https://github.com/comet-ml/opik) — Comet's open-source AI observability and evaluation platform: deep tracing CODE
MEDIUM⚡README.md374- [Distributed Tracing for Agentic Workflows with OpenTelemetry](https://developers.redhat.com/articles/2026/04/06/distrCODE
MEDIUM⚡README.md376- [Future AGI](https://github.com/future-agi/future-agi) — Open-source, self-hostable platform unifying tracing, evals, CODE
MEDIUM⚡README.md426- [Building Governed AI Agents](https://developers.openai.com/cookbook/examples/partners/agentic_governance_guide/agentiCODE
MEDIUM⚡README.md435- [Engineering Trustworthy Multi-Agent Systems](https://www.ieeesmc.org/cai-2026/tutorial-3-engineering-trustworthy-multCODE
MEDIUM⚡README.md436- [agents-best-practices](https://github.com/DenisSergeevitch/agents-best-practices) — Provider-neutral Agent Skill for CODE
MEDIUM⚡README.md446- [neosigmaai/auto-harness](https://github.com/neosigmaai/auto-harness) — April 2026 open-source self-improving agentic CODE
MEDIUM⚡README.md447- [agentic-harness-engineering](https://github.com/china-qijizhifeng/agentic-harness-engineering) — Observability-drivenCODE
MEDIUM⚡README.md447- [agentic-harness-engineering](https://github.com/china-qijizhifeng/agentic-harness-engineering) — Observability-drivenCODE
MEDIUM⚡README.md478- [browser-harness](https://github.com/browser-use/browser-harness) — Self-healing browser harness that connects an LLM CODE
MEDIUM⚡README.md483- [Live-SWE-agent: Autonomous Software Agent with Self-Evolving Harness](https://arxiv.org/html/2511.13646v3) — ProductiCODE
MEDIUM⚡README.md487- [Building NVIDIA Nemotron 3 Agents for Reasoning, Multimodal RAG, Voice, and Safety](https://developer.nvidia.com/blogCODE
MEDIUM⚡README.md489- [GitHub Agentic Workflows](https://github.blog/changelog/2026-02-13-github-agentic-workflows-are-now-in-technical-prevCODE
MEDIUM⚡README.md544- [NeMo Guardrails](https://github.com/NVIDIA-NeMo/Guardrails) — NVIDIA's programmable guardrails toolkit: define input,CODE
MEDIUM⚡README.md548- [Practical Security Guidance for Sandboxing Agentic Workflows](https://developer.nvidia.com/blog/practical-security-guCODE
MEDIUM⚡README.md549- [Under the Hood: Security Architecture of GitHub Agentic Workflows](https://github.blog/ai-and-ml/generative-ai/under-CODE
MEDIUM⚡README.md553- [deepsec](https://github.com/vercel-labs/deepsec) — Vercel Labs' security harness that treats vulnerability scanning aCODE
MEDIUM⚡README.md554- [Visa Vulnerability Agentic Harness](https://github.com/visa/visa-vulnerability-agentic-harness) — Visa's June 2026 opCODE
MEDIUM⚡README.md571- [The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey](https://arxiv.org/abs/2603.11088) — The firstCODE
MEDIUM⚡README.md573- [RAMPART](https://github.com/microsoft/RAMPART) — Pytest-native safety and security testing framework for agentic AI tCODE
MEDIUM⚡README.md574- [aiming-lab/AutoHarness](https://github.com/aiming-lab/AutoHarness) — Open-source Python governance harness that wrapsCODE
MEDIUM⚡README.md582- [Claw-Eval](https://github.com/claw-eval/claw-eval) — 300 human-verified tasks across 9 categories evaluating LLM-as-aCODE
MEDIUM⚡README.md587- [Quantifying Infrastructure Noise in Agentic Coding Evals](https://www.anthropic.com/engineering/infrastructure-noise)CODE
MEDIUM⚡README.md592- [Towards a Science of AI Agent Reliability](https://arxiv.org/abs/2602.16666) — Proposes twelve concrete reliability mCODE
MEDIUM⚡README.md598- [Live-SWE-agent: First Live Software Agent with Self-Evolving Scaffold](https://arxiv.org/html/2511.13646v3) — DemonstCODE
MEDIUM⚡README.md623- [kvcache-ai/AgentENV](https://github.com/kvcache-ai/AgentENV) — Distributed platform for running agent environments atCODE
MEDIUM⚡README.md624- [5 Production Scaling Challenges for Agentic AI in 2026](https://machinelearningmastery.com/5-production-scaling-challCODE
MEDIUM⚡README.md627- [KernelEvolve: How Meta's Ranking Engineer Agent Optimizes AI Infrastructure](https://engineering.fb.com/2026/04/02/deCODE
MEDIUM⚡README.md629- [Agentic Development: What It Means for Engineering Infrastructure in 2026](https://www.bunnyshell.com/guides/agentic-CODE
MEDIUM⚡README.md630- [FinOps for Agents: Loop Limits, Tool-Call Caps, and the New Unit Economics of Agentic SaaS](https://www.infoworld.comCODE
MEDIUM⚡README.md633- [Minions: Stripe's one-shot, end-to-end coding agents—Part 2](https://stripe.dev/blog/minions-stripes-one-shot-end-to-CODE
MEDIUMREADME.md43 - [⚙️ Task Runners & Orchestration](#task-runners--orchestration)CODE
MEDIUMREADME.md191- [AutoHarness: Improving LLM Agents by Automatically Synthesizing a Code Harness](https://arxiv.org/abs/2603.03329) — GCODE
MEDIUMREADME.md208- [Announcing the Agentic Resource Discovery specification](https://developers.googleblog.com/announcing-the-agentic-resCODE
MEDIUMREADME.md279- [Building an Agentic Memory System for GitHub Copilot](https://github.blog/ai-and-ml/github-copilot/building-an-agentiCODE
MEDIUMREADME.md320- [Shopify Roast](https://github.com/Shopify/roast) — Shopify's open-source Ruby DSL for structured AI workflows that inCODE
MEDIUMREADME.md323- [Orchestrating Ambient Agents with Temporal](https://temporal.io/blog/orchestrating-ambient-agents-with-temporal) — TeCODE
MEDIUMREADME.md340- [Scion](https://github.com/GoogleCloudPlatform/scion) — Google's experimental "hypervisor for agents" (April 2026, ApaCODE
MEDIUMREADME.md408- [Humans and Agents in Software Engineering Loops](https://martinfowler.com/articles/exploring-gen-ai/humans-and-agentsCODE
MEDIUMREADME.md514- [DeepCode](https://github.com/HKUDS/DeepCode) — HKUDS's open agentic coding harness (September 2026) built around goalCODE
MEDIUMREADME.md654- [ICLR 2026 MemAgents Workshop](https://sites.google.com/view/memagent-iclr26/) — Interdisciplinary workshop (April 27,CODE
MEDIUMREADME.md655- [Awesome Code as Agent Harness Papers](https://github.com/YennNing/Awesome-Code-as-Agent-Harness-Papers) — Curated comCODE
Excessive Try-Catch Wrapping2 hits · 3 pts
SeverityFileLineSnippetContext
LOWverify_urls.py137 except Exception as e:CODE
MEDIUMverify_urls.py214 print(f"Error: {args.file} not found")CODE