Repository Analysis

CodebuffAI/codebuff

Generate code from the terminal!

2.3 Likely human-written View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of CodebuffAI/codebuff, a TypeScript project with 7,555 GitHub stars. SynthScan v2.0 examined 225,656 lines of code across 1191 source files, recording 381 pattern matches distributed across 17 syntactic categories. The overall adjusted score of 2.3 places this repository in the Likely human-written band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

2.3
Adjusted Score
2.3
Raw Score
100%
Time Factor
2026-07-14
Last Push
7.6K
Stars
TypeScript
Language
225.7K
Lines of Code
1.2K
Files
381
Pattern Hits
2026-07-14
Scan Date
0.01
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 2HIGH 8MEDIUM 14LOW 357

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 381 distinct pattern matches across 17 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers235 hits · 234 pts
SeverityFileLineSnippetContext
LOWevals/buffbench/eval-plane.json380 "diff": "Index: apps/api/plane/app/serializers/page.py\n======================================================CODE
LOWevals/buffbench/eval-plane.json405 "diff": "Index: apps/api/plane/utils/content_validator.py\n===================================================CODE
LOWevals/buffbench/eval-plane.json656 "diff": "Index: apps/api/plane/app/views/page/base.py\n=======================================================CODE
LOWevals/buffbench/eval-plane.json666 "diff": "Index: apps/api/plane/tests/unit/bg_tasks/test_copy_s3_objects.py\n==================================CODE
LOWevals/buffbench/eval-plane.json701 "diff": "Index: packages/editor/src/core/helpers/find-suggestion-match.ts\n===================================CODE
LOWevals/buffbench/eval-plane.json778 "diff": "Index: packages/editor/src/core/extensions/table/table/table-view.tsx\n==============================CODE
LOWevals/buffbench/eval-plane.json1359 "diff": "Index: apps/api/plane/tests/unit/utils/test_url.py\n=================================================CODE
LOWevals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
LOWevals/buffbench/eval-manifold.json214 "diff": "Index: common/src/api/market-types.ts\n==============================================================CODE
LOWevals/buffbench/eval-manifold.json224 "diff": "Index: common/src/tier.ts\n===================================================================\n--- cCODE
LOWevals/buffbench/eval-manifold.json384 "spec": "Implement probability-based user metric updates for contracts without recent betting activity and optimizCODE
LOWevals/buffbench/eval-manifold.json431 "diff": "Index: backend/shared/src/update-contract-metrics-core.ts\n==========================================CODE
LOWevals/buffbench/eval-manifold.json748 "diff": "Index: .cursor/rules/general-knowledge.mdc\n=========================================================CODE
LOWevals/buffbench/eval-manifold.json1027 "diff": "Index: backend/shared/src/update-user-metrics-with-bets.ts\n=========================================CODE
LOWevals/buffbench/eval-manifold.json1425 "spec": "Implement profit restoration on unresolve by reverting each user's contract metric profit to the previousCODE
LOWevals/buffbench/setup-test-repo.ts41async function executeGitCommandWithRetry(CODE
LOWevals/buffbench/gen-evals.ts33async function extractFileDiffsFromCommit(CODE
LOW…ts/reviewer/multi-prompt/code-reviewer-multi-prompt.ts11export function createCodeReviewerMultiPrompt(): Omit<CODE
LOWagents/e2e/context-pruning-threshold.e2e.test.ts279function verifyToolCallPairIntegrity(messages: Message[]) {CODE
LOWagents/e2e/base2-free-summary-format.e2e.test.ts115function createSummarizedConversation(): Message {CODE
LOWagents/e2e/base2-free-summary-format.e2e.test.ts177function createComplexMidTurnPrunedConversation(): Message[] {CODE
LOWagents/base2/base-deep.ts104function buildDeepInstructionsPrompt(noAskUser: boolean, noLearning: boolean): string {CODE
LOWagents/base2/base2.ts432function buildImplementationInstructionsPrompt({CODE
LOWagents/base2/base2.ts491function buildImplementationStepPrompt({CODE
LOWagents/base2/base2.ts528function buildPlanOnlyInstructionsPrompt({}: {}) {CODE
LOWcli/release-core/launcher.js85 function shouldExitAlternateScreen(code, signal) {CODE
LOWcli/release-core/launcher.js369 function getBaselineFallbackTargetKey() {CODE
LOWcli/release-core/launcher.js375 function isTargetAllowedForThisMachine(target) {CODE
LOWcli/release-core/launcher.js1028 function printBaselineOverrideHint() {CODE
LOWcli/scripts/build-binary.ts293async function ensureOpenTuiNativeBundle(targetInfo: TargetInfo) {CODE
LOWcli/scripts/prebuild-agents.ts92function generateBundledAgentsFile(agents: Record<string, AgentDefinition>): string {CODE
LOWcli/scripts/prebuild-agents.ts116export function getBundledAgentsAsLocalInfo(): LocalAgentInfo[] {CODE
LOWcli/src/agents/bundled-agents.generated.d.ts12export declare function getBundledAgentsAsLocalInfo(): LocalAgentInfo[]CODE
LOWcli/src/utils/freebuff-model-navigation.ts27export function freebuffModelNavigationDirectionForKey(key: {CODE
LOWcli/src/utils/freebuff-premium-reset.ts6export function getFreebuffPremiumResetAt(params: {CODE
LOWcli/src/utils/freebuff-premium-reset.ts34export function formatFreebuffPremiumResetCountdown(CODE
LOWcli/src/utils/bash-messages.ts7export function createRunTerminalToolResult(params: {CODE
LOWcli/src/utils/bash-messages.ts77export function formatBashContextForPrompt(CODE
LOWcli/src/utils/run-state-storage.ts55export function clearLiveChatStateProvider(ownerId: string): void {CODE
LOWcli/src/utils/run-state-storage.ts122export function getAllToggleIdsFromMessages(messages: ChatMessage[]): string[] {CODE
LOWcli/src/utils/run-state-storage.ts139export function setChatDirOverrideForTesting(dir: string | undefined): void {CODE
LOWcli/src/utils/keypad-keys.ts31export function getKeypadPrintableSequence(key: KeypadKey): string | null {CODE
LOWcli/src/utils/word-wrap-utils.ts37export function calculateNewCursorPosition(params: {CODE
LOWcli/src/utils/clipboard.ts13export function registerClipboardRenderer(renderer: Record<string, unknown>): void {CODE
LOWcli/src/utils/clipboard.ts17export function unregisterClipboardRenderer(): void {CODE
LOWcli/src/utils/clipboard.ts33export function subscribeClipboardMessages(CODE
LOWcli/src/utils/terminal-watchdog.ts65export function getTerminalWatchdogDiagnostics() {CODE
LOWcli/src/utils/theme-system.ts784function detectWindowsPowerShellTheme(): ThemeName | null {CODE
LOWcli/src/utils/terminal-images.ts17export function detectTerminalImageSupport(CODE
LOWcli/src/utils/terminal-images.ts120function generateKittyImageSequence(CODE
LOWcli/src/utils/terminal-images.ts216export function getImageSupportDescription(): string {CODE
LOWcli/src/utils/pending-attachments.ts186export async function validateAndAddImage(CODE
LOWcli/src/utils/pending-attachments.ts352export function capturePendingAttachments(): PendingAttachment[] {CODE
LOWcli/src/utils/keyboard-actions.ts119export function resolveChatKeyboardAction(CODE
LOWcli/src/utils/keyboard-actions.ts359export function createDefaultChatKeyboardState(): ChatKeyboardState {CODE
LOWcli/src/utils/usage-banner-state.ts68export function generateLoadingBannerText(sessionCreditsUsed: number): string {CODE
LOWcli/src/utils/renderer-cleanup.ts86export function installProcessCleanupHandlers(cliRenderer: CliRenderer): void {CODE
LOWcli/src/utils/chatgpt-oauth.ts244export async function exchangeChatGptCodeForTokens(CODE
LOWcli/src/utils/clipboard-image.ts318export function getFileOrFolderPathFromText(text: string, cwd: string): { path: string; isDirectory: boolean } | null {CODE
LOWcli/src/utils/clipboard-image.ts406function readClipboardFilePathMacOS(): string | null {CODE
175 more matches not shown…
Verbosity Indicators28 hits · 54 pts
SeverityFileLineSnippetContext
LOWagents/e2e/context-pruning-threshold.e2e.test.ts500 // Step 1: CALIBRATION RUN — measure true token count with 200k limit (no pruning)COMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts552 // Step 2: TEST RUN — same content with 100k limitCOMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts317 // Step 1: Set "fresh" dataCOMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts321 // Step 2: Invalidate to simulate staleness (sets dataUpdatedAt to 0)COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts921 // Step 1: Simulate first fetch failure setting retry count to 1COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts925 // Step 2: OLD CODE would call clearRetryState here, which resets count to 0:COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts931 // Step 3: When the retry fires after 1s, it reads count as 0COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts30 // Step 1: Run git diff and git log to analyze changes.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts49 // Step 2: Put words in AI's mouth so it will read files next.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts60 // Step 3: Let AI generate a step to decide which files to read.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts63 // Step 4: Put words in AI's mouth to analyze the changes and create a commit.COMMENT
LOWsdk/scripts/verify.ts175 // Step 1: Clean and BuildCOMMENT
LOWsdk/scripts/verify.ts180 // Step 2: TypeScript CheckCOMMENT
LOWsdk/scripts/verify.ts183 // Step 3: Smoke TestCOMMENT
LOWsdk/scripts/verify.ts186 // Step 4: Compatibility TestsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts383 // Step 1: Read files and capture initial stateCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts391 // Step 2: Search for patterns based on file contentCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts399 // Step 3: Create a plan based on findingsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts410 // Step 4: Add subgoal for trackingCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts423 // Step 5: Write analysis fileCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts435 // Step 6: Update subgoal statusCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts447 // Step 7: Set final output with comprehensive dataCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts461 // Step 8: Transition to STEP_ALL to continue processingCOMMENT
LOW…ckages/agent-runtime/src/__tests__/n-parameter.test.ts308 // Step 1: Request multiple generationsCOMMENT
LOW…ckages/agent-runtime/src/__tests__/n-parameter.test.ts312 // Step 2: Use the responsesCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts650 // Step 1: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts661 // Step 2: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts672 // Step 3: Should have received tool result with unified diff for new fileCOMMENT
Structural Annotation Overuse28 hits · 54 pts
SeverityFileLineSnippetContext
LOWagents/e2e/context-pruning-threshold.e2e.test.ts500 // Step 1: CALIBRATION RUN — measure true token count with 200k limit (no pruning)COMMENT
LOWagents/e2e/context-pruning-threshold.e2e.test.ts552 // Step 2: TEST RUN — same content with 100k limitCOMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts317 // Step 1: Set "fresh" dataCOMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts321 // Step 2: Invalidate to simulate staleness (sets dataUpdatedAt to 0)COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts921 // Step 1: Simulate first fetch failure setting retry count to 1COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts925 // Step 2: OLD CODE would call clearRetryState here, which resets count to 0:COMMENT
LOWcli/src/hooks/__tests__/use-activity-query.test.ts931 // Step 3: When the retry fires after 1s, it reads count as 0COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts30 // Step 1: Run git diff and git log to analyze changes.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts49 // Step 2: Put words in AI's mouth so it will read files next.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts60 // Step 3: Let AI generate a step to decide which files to read.COMMENT
LOW…l-agents-dir/examples/02-intermediate-git-committer.ts63 // Step 4: Put words in AI's mouth to analyze the changes and create a commit.COMMENT
LOWsdk/scripts/verify.ts175 // Step 1: Clean and BuildCOMMENT
LOWsdk/scripts/verify.ts180 // Step 2: TypeScript CheckCOMMENT
LOWsdk/scripts/verify.ts183 // Step 3: Smoke TestCOMMENT
LOWsdk/scripts/verify.ts186 // Step 4: Compatibility TestsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts383 // Step 1: Read files and capture initial stateCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts391 // Step 2: Search for patterns based on file contentCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts399 // Step 3: Create a plan based on findingsCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts410 // Step 4: Add subgoal for trackingCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts423 // Step 5: Write analysis fileCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts435 // Step 6: Update subgoal statusCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts447 // Step 7: Set final output with comprehensive dataCOMMENT
LOW…nt-runtime/src/__tests__/run-programmatic-step.test.ts461 // Step 8: Transition to STEP_ALL to continue processingCOMMENT
LOW…ckages/agent-runtime/src/__tests__/n-parameter.test.ts308 // Step 1: Request multiple generationsCOMMENT
LOW…ckages/agent-runtime/src/__tests__/n-parameter.test.ts312 // Step 2: Use the responsesCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts650 // Step 1: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts661 // Step 2: Should have received tool result with unified diffCOMMENT
LOW…ages/agent-runtime/src/__tests__/propose-tools.test.ts672 // Step 3: Should have received tool result with unified diff for new fileCOMMENT
Over-Commented Block40 hits · 40 pts
SeverityFileLineSnippetContext
LOWagents/e2e/context-pruning-threshold.e2e.test.ts481 // the token counting API is over-reporting (30% buffer or fallback bug).COMMENT
LOWcli/scripts/smoke-binary.ts61COMMENT
LOWcli/scripts/smoke-binary.ts81] as constCOMMENT
LOWcli/src/app.tsx301 const { session, error: sessionError } = useFreebuffSession()COMMENT
LOWcli/src/pre-init/tree-sitter-wasm.ts1// Find tree-sitter.wasm so the SDK's tree-sitter parser singleton can loadCOMMENT
LOWcli/src/pre-init/tree-sitter-wasm.ts21COMMENT
LOWcli/src/utils/run-state-storage.ts241COMMENT
LOWcli/src/components/freebuff-landing-screen.tsx321 // height we show the compact wordmark so more models fit without scrolling.COMMENT
LOWcli/src/components/freebuff-model-selector.tsx61// "Premium"/"Unlimited" chip. The PREMIUM header carries the shared quotaCOMMENT
LOWcli/src/hooks/use-freebuff-session.ts541 // `setSelectedModel` doesn't persist, so the user's saved preferenceCOMMENT
LOWcli/src/hooks/use-send-message.ts481 runState: latestRunStateSnapshot,COMMENT
LOWcommon/src/tools/params/tool/set-output.ts1import z from 'zod/v4'COMMENT
LOWcommon/src/types/dynamic-agent-template.ts241 // if (COMMENT
LOWcommon/src/types/dynamic-agent-template.ts261 // data.outputMode !== 'structured_output'COMMENT
LOWcommon/src/util/messages.ts101 AuxiliaryMessageDataCOMMENT
LOWcommon/src/constants/analytics-events.ts1/**COMMENT
LOWcommon/src/constants/analytics-events.ts201 // (both low-volume per-referral transitions). The "why is this still pending"COMMENT
LOWcommon/src/constants/analytics-events.ts241COMMENT
LOWcommon/src/testing/index.ts81// used together with other testing utilities.COMMENT
LOWscripts/tmux/tmux-capture.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/tmux/tmux-capture.sh21# -e, --end LINE End capture at this line (default: -)COMMENT
LOWscripts/tmux/tmux-capture.sh41#COMMENT
LOWscripts/tmux/tmux-start.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/tmux/tmux-start.sh21# --wait SECONDS Seconds to wait for app to initialize (default: 4)COMMENT
LOWscripts/tmux/tmux-start.sh41# # Output: tui-test-1234567890COMMENT
LOWscripts/tmux/tmux-stop.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/tmux/tmux-stop.sh21#COMMENT
LOWscripts/tmux/tmux-send.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/tmux/tmux-send.sh21# ARGUMENTS:COMMENT
LOWscripts/tmux/tmux-send.sh41# Max wait time is 120 seconds to prevent infinite loops.COMMENT
LOWscripts/tmux/tmux-send.sh61# # Paste clipboard content and submit immediatelyCOMMENT
LOWscripts/tmux/tmux-send.sh261COMMENT
LOWscripts/tmux/tmux-cli.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/tmux/tmux-cli.sh21# list List all active tmux sessionsCOMMENT
LOWscripts/tmux/tmux-cli.sh41#COMMENT
LOWscripts/tmux/tmux-cli.sh61# # Get help for a specific commandCOMMENT
LOWpackages/agent-runtime/src/run-programmatic-step.ts501 input: toolCallToExecute.input,COMMENT
LOWpackages/agent-runtime/src/tools/stream-parser.ts341 }COMMENT
LOW…/agent-runtime/src/tools/handlers/tool/spawn-agents.ts241 parentAgentState.creditsUsed += subAgentCreditsCOMMENT
LOW…gent-runtime/src/system-prompt/search-system-prompt.ts81 // systemPromptTokens: countTokensJson(systemPrompt),COMMENT
Hallucination Indicators2 hits · 20 pts
SeverityFileLineSnippetContext
CRITICALevals/buffbench/eval-plane.json390 "diff": "Index: apps/api/plane/app/serializers/workspace.py\n=================================================CODE
CRITICALcli/src/utils/sdk-event-handlers.ts134 state.streaming.streamRefs.state.rootStreamBuffer.includes('</PLAN>')CODE
Self-Referential Comments6 hits · 16 pts
SeverityFileLineSnippetContext
MEDIUMevals/buffbench/eval-plane.json727 "diff": "Index: apps/api/plane/app/views/project/base.py\n====================================================CODE
MEDIUMevals/buffbench/eval-plane.json1359 "diff": "Index: apps/api/plane/tests/unit/utils/test_url.py\n=================================================CODE
MEDIUMevals/buffbench/eval-plane.json1670 "diff": "Index: apiserver/plane/tests/conftest.py\n===========================================================CODE
MEDIUMevals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
MEDIUMagents/base2/base2.ts549## Creating a specCOMMENT
MEDIUMcli/scripts/test-sdk-file-hooks.sh47# Create a temporary SDK file to trigger the hooksCOMMENT
Magic Placeholder Names3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHREADME.md185 apiKey: 'your-api-key',CODE
HIGHREADME.zh-CN.md120 apiKey: 'your-api-key',CODE
HIGHevals/buffbench/README.md416CODEBUFF_API_KEY=your-api-keyCODE
Cross-Language Confusion (JS/TS)2 hits · 15 pts
SeverityFileLineSnippetContext
HIGHsdk/test/tree-sitter-queries/test-query-files.js40 return FalseCODE
HIGHsdk/test/tree-sitter-queries/test-query-files.js42 return TrueCODE
Decorative Section Separators4 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMevals/logger.ts19 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMevals/logger.ts21 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMcli/src/utils/logger.ts84 // ──────────────────────────────────────────────────────────────COMMENT
MEDIUMcli/src/utils/logger.ts86 // ──────────────────────────────────────────────────────────────COMMENT
AI Slop Vocabulary4 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMevals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
MEDIUMsdk/src/tools/code-search.ts64 // Use JSON output for robust parsing and early stoppingCOMMENT
MEDIUMscripts/tmux/tmux-viewer/components/theme.ts48 // This is a simple heuristic - a more robust solution would use OSC detectionCOMMENT
MEDIUM…nt-runtime/src/find-files/custom-file-picker-config.ts21// Add a more robust check to ensure the array is suitable for z.enumCOMMENT
Redundant / Tautological Comments8 hits · 12 pts
SeverityFileLineSnippetContext
LOWevals/buffbench/eval-plane.json1675 "diff": "Index: apiserver/plane/tests/contract/app/test_project_app.py\n======================================CODE
LOWagents/tmux-cli.ts188# Check if session is aliveCOMMENT
LOWscripts/tmux/tmux-start.sh106 # Check if next arg is a path (not another flag or missing)COMMENT
LOWscripts/tmux/tmux-start.sh188# Check if tmux is availableCOMMENT
LOWscripts/tmux/tmux-start.sh262# Output resultCOMMENT
LOWscripts/tmux/tmux-stop.sh129# Check if session name was providedCOMMENT
LOWscripts/tmux/tmux-send.sh240# Check if text was providedCOMMENT
LOWscripts/tmux/tmux-cli.sh110 # Check if output looks like JSONCOMMENT
Synthetic Comment Markers2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHevals/buffbench/eval-manifold.json1665 "diff": "Index: web/components/ai-forecast.tsx\n==============================================================CODE
HIGHevals/buffbench/pick-commits.ts83- Auto-generated code (generated files, build outputs)CODE
Fake / Example Data8 hits · 8 pts
SeverityFileLineSnippetContext
LOWagents/browser-use/browser-use.test.ts44 'Navigate to https://httpbin.org/forms/post and fill out the form with: customer name "Test User", telephone "555-CODE
LOWagents/e2e/file-explorer.e2e.test.ts42 return { id, name: 'John Doe' }CODE
LOWagents/e2e/file-explorer.e2e.test.ts269 return { id, name: 'John Doe' }CODE
LOWcli/src/__tests__/integration/api-integration.test.ts75 JSON.stringify({ id: 'user', email: 'user@example.com' }),CODE
LOW…/hooks/__tests__/use-suggestion-engine-mention.test.ts58 const result = parseAtInLine('user@example.com')CODE
LOWsdk/src/__tests__/database.test.ts65 return new Response(JSON.stringify({ email: 'user@example.com' }), {CODE
LOWsdk/src/__tests__/database.test.ts88 expect(second).toEqual({ email: 'user@example.com' })CODE
LOWsdk/src/__tests__/database.test.ts95 expect(third).toEqual({ id: 'user-123', email: 'user@example.com' })CODE
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHcli/src/hooks/__tests__/use-directory-browser.test.ts109 // In this implementation, ~user is not specially handledCOMMENT
Slop Phrases5 hits · 6 pts
SeverityFileLineSnippetContext
LOWagents/types/tools.ts424 /** List of todos with their completion status. Add ALL of the applicable tasks to the list, so you don't forget to doCOMMENT
LOWagents/file-explorer/file-lister-max.ts12- List out the full paths of 20 files that are relevant to the prompt, separated by newlines. Each file path is relativeCODE
LOWagents/file-explorer/file-lister.ts37- List out the full paths of 12 files that are relevant to the prompt, separated by newlines. Each file path is relativeCODE
LOWcommon/src/tools/params/tool/write-todos.ts22 "List of todos with their completion status. Add ALL of the applicable tasks to the list, so you don't forget toCODE
LOWcommon/src/templates/initial-agents-dir/types/tools.ts424 /** List of todos with their completion status. Add ALL of the applicable tasks to the list, so you don't forget to doCOMMENT
Overly Generic Function Names4 hits · 4 pts
SeverityFileLineSnippetContext
LOWsdk/test/tree-sitter-queries/test-query-files.js47def process_data(items: List[str]) -> List[str]:CODE
LOWsdk/e2e/examples/sdk-refactor.example.ts11function processData(data) {CODE
LOWsdk/src/__tests__/code-search.test.ts145 createRgJsonContext('code.ts', 5, 'function processData() {'),CODE
LOWsdk/src/__tests__/code-search.test.ts160 expect(value.stdout).toContain('function processData() {')CODE
TODO Padding1 hit · 1 pts
SeverityFileLineSnippetContext
LOWsdk/src/__tests__/code-search.test.ts146 createRgJsonMatch('code.ts', 6, ' // TODO: implement this'),CODE