AI Slop Code Risk Monitor

CodebuffAI/codebuff

SlopCodeMonitor badge for CodebuffAI/codebuff Adjusted legacy signal; badge bands: 25 / 50 / 75 (different from dashboard bands).

The free coding agent

2.8 Low pattern signal View on GitHub

Open-Source Code Quality, Security and Technical Debt Review

This report summarizes scanner evidence for CodebuffAI/codebuff, a TypeScript project with 13,894 GitHub stars. SynthScan examined 464,440 lines of code across 2235 source files, recording 1180 pattern matches distributed across 19 syntactic categories. The legacy adjusted pattern signal is 2.8 (Low pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

2.8
Adjusted Signal
2.8
Raw Pattern Score
100%
Time Factor
2026-10-31
Last Push
13.9K
Stars
TypeScript
Language
464.4K
Lines of Code
2.2K
Files
1.2K
Pattern Hits
2026-10-31
Scan Date
0.01
HC Hit Rate

Risk Review · Payload v1

Use each vector to guide manual verification of the underlying findings.

Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.

Cognitive Ownership Risk 12.4/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 1157 finding(s).

Hallucinated Dependency & Supply Chain Risk 0.7/100 · LOW

Are imports declared and package/API names verified? 17 finding(s).

Agent Over-Engineering Ratio 9.3/100 · LOW

Are wrappers, guards, and repeated structures necessary? 908 finding(s).

PR Review Velocity Impact 13.0/100 · LOW

Which changes need focused human review? 1180 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 2HIGH 10MEDIUM 24LOW 1144

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 1180 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers902 hits · 897 pts
SeverityFileLineSnippetContext
LOWevals/buffbench/eval-plane.json380 "diff": "Index: apps/api/plane/app/serializers/page.py\n======================================================CODE
LOWevals/buffbench/eval-plane.json405 "diff": "Index: apps/api/plane/utils/content_validator.py\n===================================================CODE
LOWevals/buffbench/eval-plane.json656 "diff": "Index: apps/api/plane/app/views/page/base.py\n=======================================================CODE
LOWevals/buffbench/eval-plane.json666 "diff": "Index: apps/api/plane/tests/unit/bg_tasks/test_copy_s3_objects.py\n==================================CODE
LOWevals/buffbench/eval-plane.json701 "diff": "Index: packages/editor/src/core/helpers/find-suggestion-match.ts\n===================================CODE
LOWevals/buffbench/eval-plane.json778 "diff": "Index: packages/editor/src/core/extensions/table/table/table-view.tsx\n==============================CODE
LOWevals/buffbench/eval-plane.json1359 "diff": "Index: apps/api/plane/tests/unit/utils/test_url.py\n=================================================CODE
LOW⚡evals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
LOWevals/buffbench/eval-manifold.json214 "diff": "Index: common/src/api/market-types.ts\n==============================================================CODE
LOWevals/buffbench/eval-manifold.json224 "diff": "Index: common/src/tier.ts\n===================================================================\n--- cCODE
LOWevals/buffbench/eval-manifold.json384 "spec": "Implement probability-based user metric updates for contracts without recent betting activity and optimizCODE
LOWevals/buffbench/eval-manifold.json431 "diff": "Index: backend/shared/src/update-contract-metrics-core.ts\n==========================================CODE
LOWevals/buffbench/eval-manifold.json748 "diff": "Index: .cursor/rules/general-knowledge.mdc\n=========================================================CODE
LOWevals/buffbench/eval-manifold.json1027 "diff": "Index: backend/shared/src/update-user-metrics-with-bets.ts\n=========================================CODE
LOWevals/buffbench/eval-manifold.json1425 "spec": "Implement profit restoration on unresolve by reverting each user's contract metric profit to the previousCODE
LOWevals/buffbench/setup-test-repo.ts41async function executeGitCommandWithRetry(CODE
LOWevals/buffbench/gen-evals.ts33async function extractFileDiffsFromCommit(CODE
LOW…ts/reviewer/multi-prompt/code-reviewer-multi-prompt.ts11export function createCodeReviewerMultiPrompt(): Omit<CODE
LOWagents/e2e/context-pruning-threshold.e2e.test.ts279function verifyToolCallPairIntegrity(messages: Message[]) {CODE
LOWagents/e2e/base2-free-summary-format.e2e.test.ts115function createSummarizedConversation(): Message {CODE
LOWagents/e2e/base2-free-summary-format.e2e.test.ts177function createComplexMidTurnPrunedConversation(): Message[] {CODE
LOWagents/base2/base-deep.ts104function buildDeepInstructionsPrompt(noAskUser: boolean, noLearning: boolean): string {CODE
LOWagents/base2/base2.ts471function buildImplementationInstructionsPrompt({CODE
LOWagents/base2/base2.ts524function buildPlanOnlyInstructionsPrompt({}: {}) {CODE
LOWcli/release-core/launcher.js269 function shouldExitAlternateScreen(code, signal) {CODE
LOWcli/release-core/launcher.js347 function stderrReportsMissingCpuFeature(code, signal, stderrTail) {CODE
LOWcli/release-core/launcher.js732 function getBaselineFallbackTargetKey() {CODE
LOWcli/release-core/launcher.js738 function isTargetAllowedForThisMachine(target) {CODE
LOWcli/release-core/launcher.js1408 function getRequiredWrapperVersion(currentVersion) {CODE
LOWcli/release-core/launcher.js1758 async function adoptOrphanedStagedUpdates() {CODE
LOWcli/release-core/launcher.js1943 function printBaselineOverrideHint() {CODE
LOWcli/scripts/build-binary.ts296function openTuiNativePackageFolder(target: OpenTuiNativeTarget): string {CODE
LOWcli/scripts/build-binary.ts301function prepareOpenTuiNativeBundle(targetInfo: TargetInfo) {CODE
LOWcli/scripts/build-binary.ts369function getInstalledOpenTuiPackage(CODE
LOWcli/scripts/prebuild-agents.ts92function generateBundledAgentsFile(agents: Record<string, AgentDefinition>): string {CODE
LOWcli/scripts/prebuild-agents.ts116export function getBundledAgentsAsLocalInfo(): LocalAgentInfo[] {CODE
LOWcli/scripts/open-tui-native-bundle.ts42export function ensureOpenTuiNativeBundle({CODE
LOWcli/scripts/open-tui-native-bundle.ts97function recoverInterruptedReplacement(CODE
LOWcli/scripts/open-tui-native-bundle.ts293function getOpenTuiNativePackageName(targetInfo: OpenTuiNativeTarget): string {CODE
LOWcli/src/smoke/terminal-command-broker.ts134function createConsoleReaderScript(CODE
LOWcli/src/smoke/terminal-command-broker.ts160export async function runPackagedTerminalBrokerSmoke({CODE
LOWcli/src/ads/served-display-ads.ts119export async function announcedDisplayPlacements(): Promise<readonly string[]> {CODE
LOWcli/src/ads/served-display-ads.ts240export function setServedDisplayAdBillingForTests(CODE
LOWcli/src/ads/served-display-ads.ts247export function recordServedDisplayImpression(sponsor: CliServedSponsor): void {CODE
LOWcli/src/ads/served-display-ads.ts285export function useServedDisplayImpression(CODE
LOWcli/src/ads/partner-ads.ts164async function announcedPartnerPlacements(): Promise<readonly string[]> {CODE
LOWcli/src/ads/display-ads-telemetry.ts37export function setCliDisplayAdTrackerForTests(next?: Track): void {CODE
LOWcli/src/ads/display-ads-telemetry.ts67export function useCliDisplayAdImpression(CODE
LOWcli/src/ads/ad-client-context.ts1176export function collectCliAdClientContext(): AdClientContext | undefined {CODE
LOWcli/src/ads/click-return.ts108export function noteUserTurnForAdClickReturn(): void {CODE
LOW⚡cli/src/ads/ad-signals.ts114export function setAdTranscriptScrolledUp(scrolledUp: boolean): void {CODE
LOW⚡cli/src/ads/ad-signals.ts118export function getAdTranscriptScrolledUp(): boolean | null {CODE
LOW⚡cli/src/ads/ad-signals.ts126export function registerAdTranscriptViewport(CODE
LOWcli/src/ads/ad-signals.ts201export function ensureAdTerminalFocusWatch(): void {CODE
LOWcli/src/ads/use-ad-engagement.ts158export function setAdEngagementRegistryForTests(CODE
LOWcli/src/agents/bundled-agents.generated.d.ts12export declare function getBundledAgentsAsLocalInfo(): LocalAgentInfo[]CODE
LOWcli/src/utils/sponsored-brief.ts19export function takePendingSponsoredBrief(): string | null {CODE
LOWcli/src/utils/survey-events.ts37export function createCliSurveyEventSender(CODE
LOWcli/src/utils/survey-events.ts82export function setCliSurveyEventSinkForTests(next: SurveyEventSink | null) {CODE
LOWcli/src/utils/active-run.ts38export function applyActiveRunQueuePolicy(CODE
842 more matches not shown…
Over-Commented Block165 hits · 143 pts
SeverityFileLineSnippetContext
LOWagents/__tests__/base3-fast.test.ts121 expect(guidance).toContain('really, really helpful')COMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts461 // TOKEN_COUNT_FUDGE_FACTOR > maxContextLength`, so both could hold only ifCOMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts501 //COMMENT
LOWagents/researcher/researcher-web.ts41 // the model is never asked for anything, so it ends the step after thinkingCOMMENT
LOWcli/bunfig.toml1[test]COMMENT
LOWcli/release-core/launcher.js621 // Everything else assumes AVX2 — true of every x64 CPU since ~2013.COMMENT
LOWcli/release-core/launcher.js2161 // otherwise sticks for good.COMMENT
LOWcli/scripts/smoke-binary.ts41COMMENT
LOWcli/scripts/smoke-binary.ts101// Windows GitHub Actions runners intermittently hang the binary's startupCOMMENT
LOWcli/src/index.tsx501 process.on('uncaughtException', earlyFatalHandler)COMMENT
LOWcli/src/chat.tsx461 },COMMENT
LOWcli/src/pre-init/tree-sitter-wasm.ts1// Find tree-sitter.wasm so the SDK's tree-sitter parser singleton can loadCOMMENT
LOWcli/src/pre-init/tree-sitter-wasm.ts21COMMENT
LOWcli/src/utils/run-state-storage.ts401COMMENT
LOWcli/src/utils/exit-cleanly.ts61 if (exitPromise) return exitPromiseCOMMENT
LOWcli/src/utils/theme-system.ts681 // index.tsx skips detectTerminalTheme() when platform === 'win32' — soCOMMENT
LOWcli/src/utils/keyboard-actions.ts221 // Escape is claimed here and NOWHERE ELSE, and only while the panel isCOMMENT
LOWcli/src/utils/sdk-event-handlers.ts521// These handlers only project SDK events onto the chat UI, but they run INSIDECOMMENT
LOWcli/src/utils/renderer-cleanup.ts221 const handleExitRequest = () => {COMMENT
LOWcli/src/utils/freebuff-session-relaunch.ts61 } catch {COMMENT
LOWcli/src/utils/__tests__/settings.test.ts121 // preference is the longest-lived way to hold a dead id: it survives everyCOMMENT
LOWcli/src/components/freebuff-referral-banner.tsx481 // and that is the visible shape of the reward moving. The reward there is noCOMMENT
LOWcli/src/components/freebuff-model-selector.tsx281 * answered by an Enter meant for something else. */COMMENT
LOWcli/src/components/freebuff-model-selector.tsx301 // drift from what is actually charged.COMMENT
LOWcli/src/components/freebuff-model-selector.tsx501 // price findable instead — it is the first thing on the row's secondCOMMENT
LOWcli/src/components/freebuff-model-selector.tsx821 // selection IS the recommended model — a returning user whose preference is aCOMMENT
LOWcli/src/components/freebuff-model-selector.tsx921 }),COMMENT
LOWcli/src/components/freebuff-model-selector.tsx1041 )COMMENT
LOWcli/src/components/freebuff-model-selector.tsx1061 // while collapsed, so leaving them out would let the card jump width theCOMMENT
LOWcli/src/components/freebuff-model-selector.tsx1081 // whichever is actually drawn, silently, because wrapMode is 'none'.COMMENT
LOW…/components/__tests__/freebuff-model-selector.test.tsx321 // 48 rows since 2026-09-23: Solar Mini 4 and Space Bunny Alpha made theCOMMENT
LOW…/components/__tests__/freebuff-model-selector.test.tsx461 //COMMENT
LOW…/components/__tests__/freebuff-model-selector.test.tsx781 // is ordinary slack from the widest row in the set.COMMENT
LOWcli/src/__tests__/terminal-watchdog.test.ts21afterAll(() => {COMMENT
LOWcli/src/hooks/use-freebuff-session.ts561 afterCatalog(() => {COMMENT
LOWcli/src/hooks/use-freebuff-session.ts781 // response after a user pick, whatever that response turns out to be.COMMENT
LOWcli/src/hooks/use-freebuff-session.ts881 // Server says the requested model isn't available right now. FlipCOMMENT
LOWcli/src/hooks/use-send-message.ts721 // The sponsor's grant paid for a sponsored turn; it is not theCOMMENT
LOWcli/src/hooks/use-send-message.ts1001COMMENT
LOWcli/src/hooks/use-send-message.ts1101 // the last snapshot it reached (which carries its run id once theCOMMENT
LOWcli/src/hooks/helpers/send-message.ts601 case 'session_model_mismatch':COMMENT
LOWcommon/src/ads/sponsored-capabilities.ts321 code: 'traversal',COMMENT
LOWcommon/src/ads/sponsored-local-execution.ts521 env.USERPROFILE = paths.homeCOMMENT
LOWcommon/src/ads/sponsored-proposal-target.ts61 // Strip the scheme and credentials, then the host, leaving the path. TheCOMMENT
LOWcommon/src/tools/params/tool/set-output.ts1import z from 'zod/v4'COMMENT
LOWcommon/src/types/ad-client-context.ts1import { z } from 'zod/v4'COMMENT
LOWcommon/src/types/dynamic-agent-template.ts261 "outputSchema requires outputMode to be explicitly set to 'structured_output'.",COMMENT
LOWcommon/src/types/dynamic-agent-template.ts281 // },COMMENT
LOWcommon/src/util/freebuff-picker-sections.ts81 // UnlimitedCOMMENT
LOWcommon/src/util/model-utils.ts1// Compatibility export for callers that imported the old utility path. TheCOMMENT
LOWcommon/src/util/error.ts441 'ConnectionClosed',COMMENT
LOWcommon/src/constants/free-agents.ts541 'base2-free-muse-spark',COMMENT
LOWcommon/src/constants/free-agents.ts841 'base2-free': new Set([COMMENT
LOWcommon/src/constants/free-agents.ts861 // routing are untouched.COMMENT
LOWcommon/src/constants/free-agents.ts881 // root's prompt and history, so its allowlist entry is what lets the fan-outCOMMENT
LOWcommon/src/constants/free-agents.ts981 'base2-free-llama-4-maverick': new Set([FREEBUFF_LLAMA_4_MAVERICK_MODEL_ID]),COMMENT
LOWcommon/src/constants/free-agents.ts1001 // allowed both `google/` models would be a door onto Pro from an ordinaryCOMMENT
LOWcommon/src/constants/free-agents.ts1121 FREEBUFF_GEMINI_38_FLASH_MODEL_ID,COMMENT
LOWcommon/src/constants/freebuff-models.ts1501 */COMMENT
LOWcommon/src/constants/freebuff-models.ts1521 //COMMENT
105 more matches not shown…
Verbosity Indicators26 hits · 51 pts
SeverityFileLineSnippetContext
LOW⚡agents/__tests__/base-chat.test.ts113 // Step 1: prune, then STEP.COMMENT
LOW⚡agents/__tests__/base-chat.test.ts116 // Step 2: prunes again — a multi-step turn (subagent spawns) must not skipCOMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts533 // Step 1: CALIBRATION RUN — measure true token count with 200k limit (no pruning)COMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts585 // Step 2: TEST RUN — continue the calibration run with a 100k limitCOMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts317 // Step 1: Set "fresh" dataCOMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts321 // Step 2: Invalidate to simulate staleness (sets dataUpdatedAt to 0)COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts921 // Step 1: Simulate first fetch failure setting retry count to 1COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts925 // Step 2: OLD CODE would call clearRetryState here, which resets count to 0:COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts931 // Step 3: When the retry fires after 1s, it reads count as 0COMMENT
LOW⚡sdk/scripts/verify.ts183 // Step 1: Clean and BuildCOMMENT
LOW⚡sdk/scripts/verify.ts188 // Step 2: TypeScript CheckCOMMENT
LOW⚡sdk/scripts/verify.ts191 // Step 3: Smoke TestCOMMENT
LOW⚡sdk/scripts/verify.ts194 // Step 4: Compatibility TestsCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts452 // Step 1: Read files and capture initial stateCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts460 // Step 2: Search for patterns based on file contentCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts468 // Step 3: Create a plan based on findingsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts479 // Step 4: Add subgoal for trackingCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts492 // Step 5: Write analysis fileCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts504 // Step 6: Update subgoal statusCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts516 // Step 7: Set final output with comprehensive dataCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts530 // Step 8: Transition to STEP_ALL to continue processingCOMMENT
LOW⚡…ckages/agent-runtime/src/__tests__/n-parameter.test.ts310 // Step 1: Request multiple generationsCOMMENT
LOW⚡…ckages/agent-runtime/src/__tests__/n-parameter.test.ts314 // Step 2: Use the responsesCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts650 // Step 1: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts661 // Step 2: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts672 // Step 3: Should have received tool result with unified diff for new fileCOMMENT
Structural Annotation Overuse26 hits · 51 pts
SeverityFileLineSnippetContext
LOW⚡agents/__tests__/base-chat.test.ts113 // Step 1: prune, then STEP.COMMENT
LOW⚡agents/__tests__/base-chat.test.ts116 // Step 2: prunes again — a multi-step turn (subagent spawns) must not skipCOMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts533 // Step 1: CALIBRATION RUN — measure true token count with 200k limit (no pruning)COMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts585 // Step 2: TEST RUN — continue the calibration run with a 100k limitCOMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts317 // Step 1: Set "fresh" dataCOMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts321 // Step 2: Invalidate to simulate staleness (sets dataUpdatedAt to 0)COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts921 // Step 1: Simulate first fetch failure setting retry count to 1COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts925 // Step 2: OLD CODE would call clearRetryState here, which resets count to 0:COMMENT
LOW⚡cli/src/hooks/__tests__/use-activity-query.test.ts931 // Step 3: When the retry fires after 1s, it reads count as 0COMMENT
LOW⚡sdk/scripts/verify.ts183 // Step 1: Clean and BuildCOMMENT
LOW⚡sdk/scripts/verify.ts188 // Step 2: TypeScript CheckCOMMENT
LOW⚡sdk/scripts/verify.ts191 // Step 3: Smoke TestCOMMENT
LOW⚡sdk/scripts/verify.ts194 // Step 4: Compatibility TestsCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts452 // Step 1: Read files and capture initial stateCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts460 // Step 2: Search for patterns based on file contentCOMMENT
LOW⚡…nt-runtime/src/__tests__/run-programmatic-step.test.ts468 // Step 3: Create a plan based on findingsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts479 // Step 4: Add subgoal for trackingCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts492 // Step 5: Write analysis fileCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts504 // Step 6: Update subgoal statusCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts516 // Step 7: Set final output with comprehensive dataCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts530 // Step 8: Transition to STEP_ALL to continue processingCOMMENT
LOW⚡…ckages/agent-runtime/src/__tests__/n-parameter.test.ts310 // Step 1: Request multiple generationsCOMMENT
LOW⚡…ckages/agent-runtime/src/__tests__/n-parameter.test.ts314 // Step 2: Use the responsesCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts650 // Step 1: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts661 // Step 2: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts672 // Step 3: Should have received tool result with unified diff for new fileCOMMENT
Cross-Language Confusion (JS/TS)6 hits · 35 pts
SeverityFileLineSnippetContext
HIGHcli/src/state/profile-survey-store.ts250 print(sponsoredCompletionLine(response.rewardedFreebucks))CODE
HIGHcli/src/state/profile-survey-store.ts276 print(CODE
HIGHcli/src/state/profile-survey-store.ts311 print(CODE
HIGHcommon/src/ads/agentic-ad-lab-batch.ts200print(json.dumps({CODE
HIGH⚡sdk/test/tree-sitter-queries/test-query-files.js40 return FalseCODE
HIGH⚡sdk/test/tree-sitter-queries/test-query-files.js42 return TrueCODE
Modern AI Meta-Vocabulary10 hits · 27 pts
SeverityFileLineSnippetContext
MEDIUMcli/src/utils/env.ts96 // `bun run dev:agentic-ads cli` only: force one LOCAL campaign on the offerCOMMENT
MEDIUMcli/src/utils/env.ts98 // campaign (`common/src/ads/local-agentic-test.ts`).COMMENT
MEDIUMcli/src/hooks/use-send-message.ts958 // `docs/ads/agentic/step-checks.md`): a driven run's steps areCOMMENT
MEDIUMcommon/src/ads/agentic-ad-lab-desktop.ts25 return `freebuff://agentic-lab?${new URLSearchParams(parsed)}`CODE
MEDIUMcommon/src/ads/agentic-bench-v2-snapshots.json265 "packages/promptetheus/pyproject.toml": "[build-system]\nrequires = [\"hatchling\"]\nbuild-backend = \"hatchling.buiCODE
MEDIUMcommon/src/ads/agentic-bench-v2-snapshots.json410 "evals/quality_eval/requirements.txt": "# Required\nlangchain-openai>=0.1.0\npython-dotenv>=1.0.0\n\n# Optional: halCODE
MEDIUMcommon/src/ads/sponsored-offer-plan.ts145 // card, the grader and the agentic-runs page count.COMMENT
MEDIUMcommon/src/constants/agentic-ad-events.ts114 // The client-and-server funnel (agentic ads revamp, 2026-10-23, COD-935).COMMENT
MEDIUMsdk/src/__tests__/sponsored-sandbox.test.ts1464 // The agentic:e2e shape: its shim dir lives under the temp dir, which theCOMMENT
MEDIUMsdk/src/__tests__/sponsored-sandbox.test.ts1749 // agentic:e2e's shape: a shim dir under the temp dir, symlinking theCOMMENT
Hallucination Indicators2 hits · 20 pts
SeverityFileLineSnippetContext
CRITICALevals/buffbench/eval-plane.json390 "diff": "Index: apps/api/plane/app/serializers/workspace.py\n=================================================CODE
CRITICALcli/src/utils/sdk-event-handlers.ts142 state.streaming.streamRefs.state.rootStreamBuffer.includes('</PLAN>')CODE
Self-Referential Comments6 hits · 16 pts
SeverityFileLineSnippetContext
MEDIUMevals/buffbench/eval-plane.json727 "diff": "Index: apps/api/plane/app/views/project/base.py\n====================================================CODE
MEDIUMevals/buffbench/eval-plane.json1359 "diff": "Index: apps/api/plane/tests/unit/utils/test_url.py\n=================================================CODE
MEDIUM⚡evals/buffbench/eval-plane.json1670 "diff": "Index: apiserver/plane/tests/conftest.py\n===========================================================CODE
MEDIUM⚡evals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
MEDIUMagents/base2/base2.ts556## Creating a specCOMMENT
MEDIUMcli/scripts/test-sdk-file-hooks.sh47# Create a temporary SDK file to trigger the hooksCOMMENT
Decorative Section Separators4 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMevals/logger.ts19 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMevals/logger.ts21 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMcli/src/utils/logger.ts86 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMcli/src/utils/logger.ts88 // ──────────────────────────────────────────────────────────────COMMENT
Redundant / Tautological Comments8 hits · 12 pts
SeverityFileLineSnippetContext
LOW⚡evals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
LOWagents/tmux-cli.ts196# Check if session is aliveCOMMENT
LOWscripts/tmux/tmux-start.sh106 # Check if next arg is a path (not another flag or missing)COMMENT
LOWscripts/tmux/tmux-start.sh188# Check if tmux is availableCOMMENT
LOWscripts/tmux/tmux-start.sh262# Output resultCOMMENT
LOWscripts/tmux/tmux-stop.sh129# Check if session name was providedCOMMENT
LOWscripts/tmux/tmux-send.sh240# Check if text was providedCOMMENT
LOWscripts/tmux/tmux-cli.sh110 # Check if output looks like JSONCOMMENT
AI Slop Vocabulary4 hits · 11 pts
SeverityFileLineSnippetContext
MEDIUM⚡evals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
MEDIUMcommon/src/ads/agentic-bench-v2-snapshots.json7 ".coderabbit.yaml": "# yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json\n\n# CodeRabbCODE
MEDIUMsdk/src/tools/code-search.ts98 // Use JSON output for robust parsing and early stoppingCOMMENT
MEDIUMscripts/tmux/tmux-viewer/components/theme.ts48 // This is a simple heuristic - a more robust solution would use OSC detectionCOMMENT
Synthetic Comment Markers2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHevals/buffbench/eval-manifold.json1665 "diff": "Index: web/components/ai-forecast.tsx\n==============================================================CODE
HIGHevals/buffbench/pick-commits.ts83- Auto-generated code (generated files, build outputs)CODE
Fake / Example Data8 hits · 8 pts
SeverityFileLineSnippetContext
LOWagents/browser-use/run-browser-use.ts49 'Navigate to https://httpbin.org/forms/post and fill out the form with: customer name "Test User", telephone "555-CODE
LOWagents/e2e/file-explorer.e2e.test.ts41 return { id, name: 'John Doe' }CODE
LOWcli/src/__tests__/integration/api-integration.test.ts75 JSON.stringify({ id: 'user', email: 'user@example.com' }),CODE
LOW…/hooks/__tests__/use-suggestion-engine-mention.test.ts58 const result = parseAtInLine('user@example.com')CODE
LOWsdk/src/__tests__/database.test.ts110 return new Response(JSON.stringify({ email: 'user@example.com' }), {CODE
LOWsdk/src/__tests__/database.test.ts133 expect(second).toEqual({ email: 'user@example.com' })CODE
LOWsdk/src/__tests__/database.test.ts140 expect(third).toEqual({ id: 'user-123', email: 'user@example.com' })CODE
LOWsdk/src/__tests__/code-search.test.ts1113 expect(value.stdout).not.toContain('placeholder')CODE
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHcli/src/hooks/__tests__/use-directory-browser.test.ts109 // In this implementation, ~user is not specially handledCOMMENT
Magic Placeholder Names1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHevals/buffbench/README.md430CODEBUFF_API_KEY=your-api-keyCODE
Overly Generic Function Names4 hits · 4 pts
SeverityFileLineSnippetContext
LOW⚡sdk/test/tree-sitter-queries/test-query-files.js47def process_data(items: List[str]) -> List[str]:CODE
LOWsdk/e2e/examples/sdk-refactor.example.ts11function processData(data) {CODE
LOWsdk/src/__tests__/code-search.test.ts185 createRgJsonContext('code.ts', 5, 'function processData() {'),CODE
LOWsdk/src/__tests__/code-search.test.ts200 expect(value.stdout).toContain('function processData() {')CODE
Slop Phrases2 hits · 2 pts
SeverityFileLineSnippetContext
LOWagents/file-explorer/file-lister-max.ts12- List out the full paths of 20 files that are relevant to the prompt, separated by newlines. Each file path is relativeCODE
LOWagents/file-explorer/file-lister.ts41- List out the full paths of 12 files that are relevant to the prompt, separated by newlines. Each file path is relativeCODE
Excessive Try-Catch Wrapping2 hits · 2 pts
SeverityFileLineSnippetContext
LOWcommon/src/ads/agentic-ad-lab-batch.ts171 except Exception:CODE
LOWcommon/src/ads/agentic-ad-lab-batch.ts197except Exception:CODE
TODO Padding1 hit · 1 pts
SeverityFileLineSnippetContext
LOWsdk/src/__tests__/code-search.test.ts186 createRgJsonMatch('code.ts', 6, ' // TODO: implement this'),CODE