Comet: agent skill harness for turning ideas into evaluated workflows
This report summarizes scanner evidence for rpamis/comet, a JavaScript project with 3,260 GitHub stars. SynthScan examined 1,250,474 lines of code across 3023 source files, recording 3592 pattern matches distributed across 23 syntactic categories. The legacy adjusted pattern signal is 3.2 (Low pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.
Can maintainers explain intent, assumptions, and trade-offs? 3137 finding(s).
Are imports declared and package/API names verified? 266 finding(s).
Are wrappers, guards, and repeated structures necessary? 3157 finding(s).
Which changes need focused human review? 3592 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 3592 distinct pattern matches across 23 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | domains/skill/platform-inspect.ts | 58 | export async function getPlatformRuleDestinations( | CODE |
| LOW | domains/skill/platform-inspect.ts | 82 | export async function getLegacyPlatformRuleDestinations( | CODE |
| LOW | domains/skill/platform-inspect.ts | 204 | function collectZcodeGroupedCommands(config: Record<string, unknown>): unknown[] { | CODE |
| LOW | domains/skill/platform-inspect.ts | 292 | function collectCopilotCommandFields(config: Record<string, unknown>): unknown[] { | CODE |
| LOW | domains/skill/platform-inspect.ts | 327 | function containsDuplicateManagedHook( | CODE |
| LOW | domains/skill/platform-inspect.ts | 335 | function containsExtraManagedCommandCopies( | CODE |
| LOW | domains/skill/platform-inspect.ts | 363 | function containsLegacyManagedCommand(commands: unknown[]): boolean { | CODE |
| LOW | domains/skill/platform-inspect.ts | 496 | export async function inspectCometHooksForPlatform( | CODE |
| LOW | domains/skill/languages.ts | 29 | function detectSkillDescriptionLanguage(content: string): SkillLanguageId | null { | CODE |
| LOW | domains/skill/languages.ts | 54 | function formatSupportedArtifactLanguages(): string { | CODE |
| LOW | domains/skill/languages.ts | 69 | function artifactLanguageToSkillLanguage( | CODE |
| LOW | domains/skill/find.ts | 264 | async function discoveredPreferenceEntries( | CODE |
| LOW | domains/skill/uninstall.ts | 96 | function setManagedWorkingTreeEntry( | CODE |
| LOW | domains/skill/uninstall.ts | 211 | async function readWorkingObjectIdentity( | CODE |
| LOW | domains/skill/uninstall.ts | 222 | async function captureAncestorIdentities( | CODE |
| LOW | domains/skill/uninstall.ts | 306 | async function inspectManagedWorkingTree( | CODE |
| LOW | domains/skill/uninstall.ts | 361 | async function validateManagedWorkingTree( | CODE |
| LOW | domains/skill/uninstall.ts | 406 | async function assertWorkingTreeAbsentOrRealDirectory( | CODE |
| LOW | domains/skill/uninstall.ts | 467 | async function assertQuarantineAncestorIdentities( | CODE |
| LOW | domains/skill/uninstall.ts | 611 | async function removeManagedProjectConfig( | CODE |
| LOW | domains/skill/uninstall.ts | 641 | function retainedWorkingDirectoryContent(error: unknown, cometDir: string): string | null { | CODE |
| LOW | domains/skill/uninstall.ts | 649 | async function removeManagedSkillsFromDirs( | CODE |
| LOW | domains/skill/uninstall.ts | 722 | export async function removeLegacyCometSkillsForPlatform( | CODE |
| LOW | domains/skill/uninstall.ts | 735 | async function removeCometSkillsForPlatform( | CODE |
| LOW | domains/skill/uninstall.ts | 823 | async function removeCometRulesForPlatform( | CODE |
| LOW | domains/skill/uninstall.ts | 881 | async function removeOpenSpecSkillsForPlatform( | CODE |
| LOW | domains/skill/uninstall.ts | 931 | async function readLockedSuperpowersSkillNames(projectPath: string): Promise<string[]> { | CODE |
| LOW | domains/skill/uninstall.ts | 946 | async function removeSuperpowersSkillDirs( | CODE |
| LOW | domains/skill/uninstall.ts | 983 | async function removeSuperpowersSkillsForPlatforms( | CODE |
| LOW | domains/skill/uninstall.ts | 1106 | async function removeCometHooksForPlatform( | CODE |
| LOW | domains/skill/uninstall.ts | 1310 | function removeManagedGroupedHooks( | CODE |
| LOW | domains/skill/hook-lifecycle.ts | 9 | export async function reconcileCometHooksForPlatform( | CODE |
| LOW | domains/skill/hook-lifecycle.ts | 50 | export async function reconcileProjectCometHooksForPlatform( | CODE |
| LOW | domains/skill/platform-install.ts | 229 | export function isManagedSkillPathForSelection( | CODE |
| LOW | domains/skill/platform-install.ts | 257 | export async function detectInstalledWorkflowSelection( | CODE |
| LOW | domains/skill/platform-install.ts | 274 | function getManagedSkillPathsForSelection( | CODE |
| LOW | domains/skill/platform-install.ts | 283 | function getUserFacingSkillPathsForSelection( | CODE |
| LOW | domains/skill/platform-install.ts | 296 | function getManagedSkillReplacementPaths( | CODE |
| LOW | domains/skill/platform-install.ts | 316 | function getManagedSkillTopLevelEntries( | CODE |
| LOW | domains/skill/platform-install.ts | 330 | function getManagedEntriesForTopLevel( | CODE |
| LOW | domains/skill/platform-install.ts | 346 | async function collectDirectoryEntryPaths(root: string, current = root): Promise<string[]> { | CODE |
| LOW | domains/skill/platform-install.ts | 363 | async function assertDirectoryContainsOnlyManagedEntries( | CODE |
| LOW | domains/skill/platform-install.ts | 462 | async function assertBundledAssetsComplete(assetsDir: string = getAssetsDir()): Promise<void> { | CODE |
| LOW | domains/skill/platform-install.ts | 553 | async function removeRetiredCometOwnedSkillPaths( | CODE |
| LOW | domains/skill/platform-install.ts | 637 | async function prepareManagedSkillCopyTarget( | CODE |
| LOW | domains/skill/platform-install.ts | 678 | async function prepareNativeSkillInstallTarget( | CODE |
| LOW | domains/skill/platform-install.ts | 883 | async function copyCometSkillsForPlatform( | CODE |
| LOW | domains/skill/platform-install.ts | 1179 | function selectRulePathsForLanguage(rulePaths: string[], languageId: SkillLanguageId): string[] { | CODE |
| LOW | domains/skill/platform-install.ts | 1212 | async function copyCometRulesForPlatform( | CODE |
| LOW | domains/skill/platform-install.ts | 1382 | async function installCometHooksForPlatform( | CODE |
| LOW | domains/skill/platform-install.ts | 1706 | function removeManagedCopilotHookEntries( | CODE |
| LOW | domains/skill/platform-install.ts | 1773 | async function removeManagedHooksFromJsonFile( | CODE |
| LOW | domains/skill/platform-install.ts | 1832 | async function removeManagedWindsurfHooksFromJsonFile( | CODE |
| LOW | domains/skill/platform-install.ts | 1887 | function resolveInstalledHookMatcher( | CODE |
| LOW | domains/skill/platform-install.ts | 2448 | function parseProjectConfigOverrides(content: string): Record<string, string> { | CODE |
| LOW | domains/skill/dsh-adapter.ts | 148 | function renderDshInstructionBlock(content: string): string { | CODE |
| LOW | domains/skill/project-instructions.ts | 75 | function normalizeInstructionTarget(target: string): string { | CODE |
| LOW | domains/skill/project-instructions.ts | 80 | export function renderCometAmbientResumeContent(languageId: SkillLanguageId): string { | CODE |
| LOW | domains/skill/project-instructions.ts | 126 | export async function installCometProjectInstructions( | CODE |
| LOW | domains/skill/project-instructions.ts | 169 | export async function syncCometProjectInstructions( | CODE |
| 2905 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | eval/langsmith/tests/tasks/test_tasks.py | 30 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | eval/langsmith/tests/tasks/test_tasks.py | 34 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | eval/langsmith/tests/tasks/test_tasks.py | 85 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/langsmith/tests/tasks/test_tasks.py | 87 | # ============================================================================= | COMMENT |
| MEDIUM | eval/langsmith/tests/tasks/test_tasks.py | 271 | # ============================================================================= | COMMENT |
| MEDIUM | eval/langsmith/tests/tasks/test_tasks.py | 273 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tasks/index.yaml | 101 | # ── Default / canonical full-workflow task ────────────────────────────── | COMMENT |
| MEDIUM | eval/local/tasks/index.yaml | 158 | # ── Expanded workflow pressure tasks inspired by skills-benchmarks ────── | COMMENT |
| MEDIUM⚡ | eval/local/tests/conftest.py | 1715 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/conftest.py | 1717 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/conftest.py | 1823 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/conftest.py | 1825 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 273 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 275 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 895 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 1068 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 1070 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 1316 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 1318 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 2388 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/conftest.py | 2390 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/tasks/test_tasks.py | 123 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/tasks/test_tasks.py | 125 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/tasks/test_tasks.py | 471 | # ============================================================================= | COMMENT |
| MEDIUM | eval/local/tests/tasks/test_tasks.py | 473 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/local/tests/scaffold/test_profiles.py | 707 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | eval/local/tests/scaffold/test_profiles.py | 709 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | eval/local/tests/scaffold/test_profiles.py | 889 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | eval/local/tests/scaffold/test_profiles.py | 891 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 18 | # ── Extract target file path ────────────────────────────────────── | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 53 | # ── Resolve to project-relative path ───────────────────────────── | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 88 | # ── Helpers to read .comet.yaml fields ─────────────────────────── | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 105 | # ── Determine the governing Comet change + phase ───────────────── | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 177 | # ── Whitelist: phase-aware allowed paths ───────────────────────── | COMMENT |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 275 | # ── Phase-based enforcement ────────────────────────────────────── | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 91 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 93 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 369 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 371 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 422 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 424 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 631 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 633 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 900 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/python/logging.py | 902 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 19 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 21 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 76 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 78 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 101 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 103 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 160 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 162 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 192 | # ============================================================================= | COMMENT |
| MEDIUM | eval/scaffold/shell/setup.sh | 194 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 7 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 9 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 17 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 19 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 37 | # ============================================================================= | COMMENT |
| 17 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | eval/langfuse/tests/conftest.py | 3 | CODE | |
| LOW | eval/langfuse/tests/test_adapter.py | 1 | CODE | |
| LOW | eval/langfuse/tests/tasks/test_tasks.py | 3 | CODE | |
| LOW | …met-native-workflow/validation/test_native_workflow.py | 3 | CODE | |
| LOW | …sks/comet-noise-distractor/environment/test_invoice.py | 1 | CODE | |
| LOW | …al/tasks/comet-noise-distractor/environment/invoice.py | 1 | CODE | |
| LOW | …ly/validation/test_native_wave_f_dashboard_readonly.py | 3 | CODE | |
| LOW | …sks/comet-human-approval-flow/environment/approvals.py | 1 | CODE | |
| LOW | …omet-human-approval-flow/environment/test_approvals.py | 1 | CODE | |
| LOW | …counter-refactor-archive/environment/text_processor.py | 8 | CODE | |
| LOW | …er-refactor-archive/environment/test_text_processor.py | 3 | CODE | |
| LOW | …afety/validation/test_native_wave_e_parallel_safety.py | 3 | CODE | |
| LOW | …met-persistence-threading/environment/session_store.py | 1 | CODE | |
| LOW | …ersistence-threading/environment/test_session_store.py | 1 | CODE | |
| LOW | …et-dependency-confusion/environment/settings_loader.py | 1 | CODE | |
| LOW | …endency-confusion/environment/test_settings_service.py | 1 | CODE | |
| LOW | …al/tasks/comet-dependency-confusion/environment/app.py | 1 | CODE | |
| LOW | …l/local/tasks/comet-api-cache-ttl/environment/cache.py | 8 | CODE | |
| LOW | …l/local/tasks/comet-api-cache-ttl/environment/cache.py | 10 | CODE | |
| LOW | …al/tasks/comet-api-cache-ttl/environment/test_cache.py | 9 | CODE | |
| LOW | …s/comet-api-cache-ttl/validation/test_api_cache_ttl.py | 6 | CODE | |
| LOW | …esume/validation/test_native_wave_b_decision_resume.py | 8 | CODE | |
| LOW | …ve-sdk-recovery/validation/test_native_sdk_recovery.py | 3 | CODE | |
| LOW | eval/local/tasks/comet-fix-median/environment/stats.py | 7 | CODE | |
| LOW | …l/tasks/comet-fix-median/validation/test_fix_median.py | 7 | CODE | |
| LOW | …l/tasks/comet-fix-median/validation/test_fix_median.py | 10 | CODE | |
| LOW | …asks/comet-cross-file-refactor/environment/counting.py | 1 | CODE | |
| LOW | …cal/tasks/comet-cross-file-refactor/environment/cli.py | 1 | CODE | |
| LOW | …/comet-cross-file-refactor/environment/test_textkit.py | 1 | CODE | |
| LOW | …al/local/tasks/comet-perf-dedupe/environment/dedupe.py | 7 | CODE | |
| LOW | …cal/tasks/comet-perf-dedupe/environment/test_dedupe.py | 5 | CODE | |
| LOW | …tasks/comet-robust-config/environment/config_loader.py | 8 | CODE | |
| LOW | …ervability-env-template/environment/test_env_writer.py | 1 | CODE | |
| LOW | …t-observability-env-template/environment/env_writer.py | 1 | CODE | |
| LOW | …alidation/test_native_wave_c_verification_integrity.py | 3 | CODE | |
| LOW | …ks/comet-layered-streaming-fix/environment/chat_app.py | 1 | CODE | |
| LOW | …met-layered-streaming-fix/environment/test_chat_app.py | 1 | CODE | |
| LOW | …-stop/validation/test_native_wave_d_stagnation_stop.py | 3 | CODE | |
| LOW | …s/comet-refactor-counter/environment/text_processor.py | 8 | CODE | |
| LOW | …et-refactor-counter/environment/test_text_processor.py | 3 | CODE | |
| LOW | eval/local/tests/conftest.py | 32 | CODE | |
| LOW | eval/local/tests/tasks/test_validation_scripts.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_native_sdk_recovery.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_aligned_comparison.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_task_resolution.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_langsmith_conftest.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_execution.py | 3 | CODE | |
| LOW | …l/local/tests/scaffold/test_native_wave_evaluations.py | 7 | CODE | |
| LOW | eval/local/tests/scaffold/test_regression_check.py | 3 | CODE | |
| LOW | eval/local/tests/scaffold/test_langfuse_trajectory.py | 3 | CODE | |
| LOW | eval/local/scripts/regression_check.py | 13 | CODE | |
| LOW | eval/local/scripts/render_readme_benchmark_figures.py | 3 | CODE | |
| LOW | eval/local/scripts/rescore_rubric.py | 9 | CODE | |
| LOW | eval/local/scripts/compare_baselines.py | 15 | CODE | |
| LOW | eval/local/scripts/generate_report_style_demo_charts.py | 9 | CODE | |
| LOW | eval/scaffold/__init__.py | 6 | CODE | |
| LOW | eval/scaffold/__init__.py | 6 | CODE | |
| LOW | eval/scaffold/__init__.py | 6 | CODE | |
| LOW | eval/scaffold/__init__.py | 6 | CODE | |
| LOW | eval/scaffold/__init__.py | 6 | CODE | |
| 170 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …-full-recovery/validation/test_classic_sdk_recovery.py | 180 | "readClassicSdkDeliveryCheckpoint(checkpoint,x.run)!==null));", | CODE |
| HIGH | …c-sdk-recovery/validation/test_classic_sdk_recovery.py | 180 | "readClassicSdkDeliveryCheckpoint(checkpoint,x.run)!==null));", | CODE |
| HIGH | …-lifecycle/validation/test_classic_layout_lifecycle.py | 337 | "process.stdout.write(JSON.stringify(portableRunCheckpointProjectionMatches(checkpoint,run) || readClassicSdkDe | CODE |
| HIGH | eval/local/tests/scaffold/test_utils.py | 775 | 'kill "$(cat "$2/child.pid")" 2>/dev/null || true ;;\n' | CODE |
| HIGH | eval/local/tests/scaffold/test_utils.py | 1006 | "$3" "$2" 'Test prompt' --agent claude-code --max-turns 1 || exit $? | CODE |
| HIGH | eval/local/tests/scaffold/test_utils.py | 1324 | 'kill "$1" 2>/dev/null || true', | CODE |
| HIGH⚡ | eval/local/tests/scaffold/test_profiles.py | 49 | ['D=$(mktemp -d); exec {D}>/dev/null; rm -rf "$D"'], | CODE |
| HIGH⚡ | eval/local/tests/scaffold/test_profiles.py | 50 | ['D=$(mktemp -d); command exec {D}>/dev/null; rm -rf "$D"'], | CODE |
| HIGH | eval/local/tests/scaffold/test_profiles.py | 186 | '{"runId":"r1","contextHash":null,"artifactsHash":"abc","createdAt":"2026-07-01"}', | CODE |
| HIGH | eval/local/tests/scaffold/test_sdk_task_validators.py | 462 | let run=await runtime.start({{runId:'fixture',workflow:{{id:'fixture',version:'1'}},input:null}}); | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 419 | if (typeof score === 'number') return score >= 0 && score <= 1 ? score : (score > 1 ? score / 100 : 0); | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 425 | if (result && typeof result === 'object') {{ | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 430 | return null; | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 445 | if (score === null) {{ | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 449 | const minS = expected.min_score || 0; | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 450 | const maxS = expected.max_score || 1; | CODE |
| HIGH⚡ | eval/scaffold/python/validation/evaluator.py | 451 | return {{ name, passed: score >= minS && score <= maxS, score }}; | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | eval/langsmith/tests/tasks/test_tasks.py | 147 | except Exception: # pragma: no cover - defensive | CODE |
| HIGH | …unter-refactor-archive/validation/test_archive_task.py | 29 | except ValueError: | CODE |
| HIGH | eval/local/tests/conftest.py | 1819 | except Exception: | CODE |
| HIGH | eval/local/tests/scaffold/test_custom_agents.py | 140 | except OSError: | CODE |
| HIGH | eval/local/scripts/rescore_rubric.py | 30 | except ValueError: | CODE |
| HIGH | eval/scaffold/python/logging.py | 105 | except json.JSONDecodeError: | CODE |
| HIGH | eval/scaffold/python/generic_llm_judge.py | 36 | except Exception: | CODE |
| HIGH | eval/scaffold/python/utils.py | 573 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | eval/scaffold/python/utils.py | 608 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | eval/scaffold/python/llm_judge.py | 32 | except Exception: | CODE |
| HIGH | eval/scaffold/python/progress.py | 114 | except (OSError, ValueError, TypeError, KeyError): | CODE |
| HIGH | eval/scaffold/python/progress.py | 121 | except OSError: | CODE |
| HIGH | eval/scaffold/python/progress.py | 164 | except (OSError, ValueError, AttributeError): | CODE |
| HIGH | eval/scaffold/python/progress.py | 241 | except (OSError, ValueError): | CODE |
| HIGH | eval/scaffold/python/progress.py | 237 | except (ValueError, TypeError, OSError): | CODE |
| HIGH | eval/scaffold/python/validation/rubric.py | 331 | except Exception: | CODE |
| HIGH | eval/scaffold/python/validation/rubric.py | 341 | except Exception: | CODE |
| HIGH | eval/scaffold/python/validation/rubric.py | 842 | except Exception: | CODE |
| HIGH | eval/scaffold/python/validation/comet_workflow.py | 216 | except OSError: | CODE |
| HIGH | eval/scaffold/python/validation/evaluator.py | 492 | except json.JSONDecodeError: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | CONTRIBUTING.md | 258 | app/ # CLI entry and command orchestration. Composes domain/platform capabilities only; holds no domain | CODE |
| MEDIUM | CONTRIBUTING.md | 270 | ├── engine/ # Generic execution engine (loop / state / guardrails / evals) | CODE |
| MEDIUM | CONTRIBUTING-zh.md | 221 | ├── engine/ # 通用执行引擎(loop / state / guardrails / evals) | CODE |
| MEDIUM | …799f800bcf1eb6f3614ae319f134df59a21d35f27c1f57e24.json | 4 | "content": "# Acceptance evidence\n\n<!-- comet-native:acceptance-evidence:start -->\n[\n {\n \"acceptance_id\": \ | CODE |
| MEDIUM | …066e43b31f19959b0f06eea888fa2cfe350a2054b4bdcb3b6.json | 4 | "content": "# Acceptance evidence\n\n<!-- comet-native:acceptance-evidence:start -->\n[\n {\n \"acceptance_id\": \ | CODE |
| MEDIUM | eval/README.md | 664 | # 仅运行 scaffold 单元测试(快速,不需要 Docker) | COMMENT |
| MEDIUM | …ill-test-20261013/evidence/independent-conclusion.json | 65 | "output": "# Factual Report: /workspace\n\n## 1. `/workspace/pipeline.py` (verbatim, 19 lines)\n\n```python\nTHREA | CODE |
| MEDIUM | …/grill-test-20261013/evidence/continuation/events.json | 894 | "output": "id: to-tickets\nroot: /workspace/.comet/applications/grill-test/versions/5c95c6a0669eb7c85719f99338e7af | CODE |
| MEDIUM | …/grill-test-20261013/evidence/continuation/events.json | 962 | "output": "# Factual Report: /workspace\n\n## 1. `/workspace/pipeline.py` (verbatim, 19 lines)\n\n```python\nTHREA | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 3 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7/subagents/agent-af446fc962c6040c8.jsonl": "{\"parentUuid\":null,\"isSidechain\": | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 5 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7/subagents/agent-a58a041666158b1b6.jsonl": "{\"parentUuid\":null,\"isSidechain\": | CODE |
| MEDIUM | eval/local/tests/scaffold/test_utils.py | 869 | assert "bash //opt/scaffold-shell/run-agent-runtime.sh" in docker_sh | CODE |
| MEDIUM | eval/local/tests/scaffold/test_utils.py | 578 | assert 'bash //opt/scaffold-shell/run-claude-loop.sh "$prompt"' in docker_sh | STRING |
| MEDIUM⚡ | eval/scaffold/python/utils.py | 546 | # The repository package initializer imports host-only orchestration | COMMENT |
| MEDIUM⚡ | eval/scaffold/python/utils.py | 555 | # can import it without loading the host-side scaffold package initializer. | COMMENT |
| MEDIUM⚡ | eval/scaffold/python/utils.py | 563 | # scaffold and comet_checks remain importable inside the benchmark container. | COMMENT |
| MEDIUM | eval/scaffold/python/validation/comet_workflow.py | 183 | # Filter out the validator itself and scaffold copies. | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 2 | # Common shell utilities for test orchestration | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 3 | # Source this file: source "$(dirname "$0")/../../scaffold/shell/common.sh" | COMMENT |
| MEDIUM⚡ | eval/scaffold/shell/common.sh | 50 | # Get the absolute path to the scaffold directory | COMMENT |
| MEDIUM | eval/scaffold/shell/agent-runtime-config.sh | 4 | # Eval scaffold, while the generated config roots below are mounted as tmpfs | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 2 | # Docker utilities for test orchestration | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 217 | # Don't hash the entire directory — test scripts and scaffold files are | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 1005 | # Mounts the scaffold shell dir so run-claude-loop.sh is available inside. | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 1051 | # Mount the scaffold shell scripts read-only so the loop driver is available | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 1052 | # at /opt/scaffold-shell/ inside the container. | COMMENT |
| MEDIUM | eval/scaffold/shell/docker.sh | 536 | RUNTIME_CONFIG_MOUNT_ARGS=("-v" "$shell_host://opt/scaffold-shell:ro" "-v" "$python_host://opt/python:ro") | CODE |
| MEDIUM | eval/scaffold/shell/docker.sh | 914 | AGENT_COMMAND=(bash //opt/scaffold-shell/run-agent-runtime.sh "$agent" "$model" --prompt-stdin --) | CODE |
| MEDIUM | eval/scaffold/shell/docker.sh | 916 | AGENT_COMMAND=(bash //opt/scaffold-shell/run-agent-runtime.sh "$agent" "$model" "$prompt" --) | CODE |
| MEDIUM | eval/scaffold/shell/docker.sh | 1065 | bash //opt/scaffold-shell/run-claude-loop.sh "$prompt" \ | CODE |
| MEDIUM | eval/scaffold/shell/docker.sh | 1136 | bash //opt/scaffold-shell/run-claude-loop.sh "$prompt" \ | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | eval/langfuse/tests/conftest.py | 131 | except Exception as exc: | CODE |
| LOW | eval/langfuse/tests/tasks/test_tasks.py | 60 | except Exception: | CODE |
| LOW | eval/langsmith/tests/tasks/test_tasks.py | 60 | except Exception: # pragma: no cover - import guard | CODE |
| LOW | eval/langsmith/tests/tasks/test_tasks.py | 68 | except Exception: # pragma: no cover - fallback if private helper moves | CODE |
| LOW⚡ | eval/langsmith/tests/tasks/test_tasks.py | 94 | except Exception as exc: # pragma: no cover - defensive | CODE |
| LOW | eval/langsmith/tests/tasks/test_tasks.py | 147 | except Exception: # pragma: no cover - defensive | CODE |
| LOW | eval/langsmith/tests/tasks/test_tasks.py | 158 | except Exception: # pragma: no cover - defensive | CODE |
| LOW | eval/langsmith/tests/tasks/test_tasks.py | 208 | except Exception: | CODE |
| LOW | …met-native-workflow/validation/test_native_workflow.py | 186 | except Exception as error: | CODE |
| MEDIUM | …met-native-workflow/validation/test_native_workflow.py | 165 | def check_feature(): | CODE |
| LOW | …s/comet-full-workflow/validation/test_full_workflow.py | 166 | except Exception as e: | CODE |
| MEDIUM | …s/comet-full-workflow/validation/test_full_workflow.py | 36 | def current_treatment(): | CODE |
| LOW | …ition/validation/test_native_interrupted_transition.py | 50 | except Exception as error: | CODE |
| LOW | …afety/validation/test_native_wave_e_parallel_safety.py | 146 | except Exception as error: | CODE |
| LOW | …afety/validation/test_native_wave_e_parallel_safety.py | 162 | except Exception as error: | CODE |
| LOW | …ository-fact/validation/test_native_repository_fact.py | 47 | except Exception as error: | CODE |
| LOW | …esume/validation/test_native_wave_b_decision_resume.py | 155 | except Exception as error: | CODE |
| LOW | …-clarification/validation/test_native_clarification.py | 72 | except Exception as error: | CODE |
| MEDIUM | …-clarification/validation/test_native_clarification.py | 53 | def check_behavior(): | CODE |
| LOW | …on-depth/validation/test_native_clarification_depth.py | 510 | except Exception as error: | CODE |
| LOW | …-lifecycle/validation/test_classic_layout_lifecycle.py | 694 | except Exception as e: | CODE |
| MEDIUM | …-lifecycle/validation/test_classic_layout_lifecycle.py | 46 | def current_treatment(): | CODE |
| LOW | …on-modes/validation/test_native_clarification_modes.py | 114 | except Exception as error: | CODE |
| LOW | …-stop/validation/test_native_wave_d_stagnation_stop.py | 135 | except Exception as error: | CODE |
| LOW | …-stop/validation/test_native_wave_d_stagnation_stop.py | 235 | except Exception as error: | CODE |
| LOW⚡ | eval/local/tests/conftest.py | 1711 | except Exception as e: | CODE |
| LOW⚡ | eval/local/tests/conftest.py | 1819 | except Exception: | CODE |
| LOW | eval/local/tests/conftest.py | 510 | except Exception as exc: | CODE |
| LOW | eval/local/tests/conftest.py | 526 | except Exception as exc: | CODE |
| LOW | eval/local/tests/conftest.py | 1267 | except Exception as e: | CODE |
| LOW | eval/local/tests/conftest.py | 2639 | except Exception as e: | CODE |
| MEDIUM | eval/local/tests/scaffold/test_classic_sdk_recovery.py | 403 | ' print("Error: cannot read input file", file=sys.stderr)\n' | STRING |
| MEDIUM | eval/scaffold/python/langfuse_adapter.py | 433 | def main(): | CODE |
| MEDIUM | eval/scaffold/python/langfuse_adapter.py | 1019 | def flush(self) -> None: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 139 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 295 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 436 | except Exception: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 573 | except Exception as exc: # pragma: no cover - optional dependency | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 591 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 785 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 875 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 907 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 933 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 1016 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/langfuse_adapter.py | 1022 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/generic_llm_judge.py | 36 | except Exception: | CODE |
| LOW | eval/scaffold/python/utils.py | 310 | except Exception as e: | CODE |
| LOW | eval/scaffold/python/utils.py | 439 | except Exception as error: | CODE |
| LOW | eval/scaffold/python/utils.py | 482 | except Exception as cleanup_exception: # pragma: no cover - defensive cleanup | CODE |
| LOW | eval/scaffold/python/utils.py | 519 | except Exception as cleanup_exception: # pragma: no cover - defensive cleanup | CODE |
| LOW | eval/scaffold/python/utils.py | 703 | except Exception as e: | CODE |
| LOW | eval/scaffold/python/utils.py | 717 | except Exception as e: | CODE |
| LOW | eval/scaffold/python/utils.py | 740 | except Exception as e: | CODE |
| LOW | eval/scaffold/python/utils.py | 753 | except Exception as e: | CODE |
| MEDIUM | eval/scaffold/python/utils.py | 280 | def check_docker_available(): | CODE |
| MEDIUM | eval/scaffold/python/utils.py | 689 | def check_claude_available(): | CODE |
| LOW | eval/scaffold/python/llm_judge.py | 32 | except Exception: | CODE |
| LOW | eval/scaffold/python/llm_judge.py | 46 | except Exception: | CODE |
| LOW | eval/scaffold/python/auto_tasks.py | 699 | except Exception as exc: | CODE |
| LOW | eval/scaffold/python/validation/rubric.py | 331 | except Exception: | CODE |
| 27 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | app/commands/personal-memory.ts | 49 | print(status, options); | CODE |
| HIGH | app/commands/personal-memory.ts | 218 | print(output, options); | CODE |
| HIGH | app/commands/personal-memory.ts | 265 | print(context, options); | CODE |
| HIGH⚡ | app/commands/personal-memory.ts | 303 | print(result, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 69 | print(result, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 127 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 145 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 168 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 221 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 240 | print(output, options); | CODE |
| HIGH⚡ | app/commands/project-knowledge.ts | 255 | print(output, options); | CODE |
| HIGH⚡ | app/commands/project-knowledge.ts | 272 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 295 | print(output, options); | CODE |
| HIGH | app/commands/project-knowledge.ts | 477 | print(result, options); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …s/comet-full-workflow/validation/test_full_workflow.py | 91 | CODE | |
| LOW | …afety/validation/test_native_wave_e_parallel_safety.py | 50 | CODE | |
| LOW | eval/local/tests/conftest.py | 137 | CODE | |
| LOW | eval/local/tests/conftest.py | 195 | CODE | |
| LOW | eval/local/tests/conftest.py | 2477 | CODE | |
| LOW | eval/local/tests/conftest.py | 2511 | CODE | |
| LOW | eval/local/tests/conftest.py | 2545 | CODE | |
| LOW | eval/local/tests/conftest.py | 1117 | CODE | |
| LOW | eval/local/tests/tasks/test_tasks.py | 150 | CODE | |
| LOW | eval/local/tests/scaffold/test_application_eval.py | 379 | CODE | |
| LOW | …cal/tests/scaffold/test_workspace_artifacts_windows.py | 100 | CODE | |
| LOW | eval/local/tests/scaffold/test_regression_check.py | 485 | CODE | |
| LOW | eval/local/tests/scaffold/test_regression_check.py | 552 | CODE | |
| LOW | eval/local/tests/scaffold/test_regression_check.py | 586 | CODE | |
| LOW | eval/local/tests/scaffold/test_regression_check.py | 486 | CODE | |
| LOW | eval/local/tests/scaffold/test_sdk_task_validators.py | 240 | CODE | |
| LOW | eval/local/scripts/render_readme_benchmark_figures.py | 118 | CODE | |
| LOW | eval/local/scripts/compare_baselines.py | 184 | CODE | |
| LOW | eval/local/scripts/compare_baselines.py | 559 | CODE | |
| LOW | eval/scaffold/python/judge_config.py | 206 | CODE | |
| LOW | eval/scaffold/python/logging.py | 110 | CODE | |
| LOW | eval/scaffold/python/logging.py | 140 | CODE | |
| LOW | eval/scaffold/python/logging.py | 186 | CODE | |
| LOW | eval/scaffold/python/logging.py | 716 | CODE | |
| LOW | eval/scaffold/python/stream_capture.py | 19 | CODE | |
| LOW | eval/scaffold/python/execution.py | 408 | CODE | |
| LOW | eval/scaffold/python/inline_tasks.py | 49 | CODE | |
| LOW | eval/scaffold/python/inline_tasks.py | 52 | CODE | |
| LOW | eval/scaffold/python/langfuse_adapter.py | 174 | CODE | |
| LOW | eval/scaffold/python/langfuse_adapter.py | 326 | CODE | |
| LOW | eval/scaffold/python/langfuse_adapter.py | 936 | CODE | |
| LOW | eval/scaffold/python/report_outputs.py | 618 | CODE | |
| LOW | eval/scaffold/python/report_outputs.py | 860 | CODE | |
| LOW | eval/scaffold/python/agents.py | 48 | CODE | |
| LOW | eval/scaffold/python/workspace_artifacts_windows.py | 186 | CODE | |
| LOW | eval/scaffold/python/utils.py | 216 | CODE | |
| LOW | eval/scaffold/python/generated_task_cache.py | 111 | CODE | |
| LOW | eval/scaffold/python/generated_task_cache.py | 159 | CODE | |
| LOW | eval/scaffold/python/generated_task_cache.py | 163 | CODE | |
| LOW | eval/scaffold/python/treatments.py | 97 | CODE | |
| LOW | eval/scaffold/python/application_eval.py | 98 | CODE | |
| LOW | eval/scaffold/python/llm_judge.py | 50 | CODE | |
| LOW | eval/scaffold/python/auto_tasks.py | 301 | CODE | |
| LOW | eval/scaffold/python/auto_tasks.py | 574 | CODE | |
| LOW | eval/scaffold/python/auto_tasks.py | 607 | CODE | |
| LOW | eval/scaffold/python/skill_parser.py | 335 | CODE | |
| LOW | eval/scaffold/python/progress.py | 61 | CODE | |
| LOW | eval/scaffold/python/progress.py | 132 | CODE | |
| LOW | eval/scaffold/python/progress.py | 198 | CODE | |
| LOW | eval/scaffold/python/progress.py | 212 | CODE | |
| LOW | eval/scaffold/python/aligned_comparison.py | 804 | CODE | |
| LOW | eval/scaffold/python/aligned_comparison.py | 1102 | CODE | |
| LOW | eval/scaffold/python/tool_telemetry.py | 62 | CODE | |
| LOW | eval/scaffold/python/tool_telemetry.py | 115 | CODE | |
| LOW | eval/scaffold/python/release_gate.py | 90 | CODE | |
| LOW | eval/scaffold/python/validation/rubric.py | 212 | CODE | |
| LOW | eval/scaffold/python/validation/rubric.py | 489 | CODE | |
| LOW | eval/scaffold/python/validation/rubric.py | 671 | CODE | |
| LOW | eval/scaffold/python/validation/tracing.py | 25 | CODE | |
| LOW | eval/scaffold/python/validation/tracing.py | 89 | CODE | |
| 8 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | package-lock.json | 6939 | "resolved": "https://registry.npmmirror.com/robust-predicates/-/robust-predicates-3.0.3.tgz", | CODE |
| MEDIUM | …ives/grill-test-20261013/evidence/native/report-3.json | 603 | "prompt": "[COMET NATIVE BETA17 TREATMENT]\nInvoke /comet-native as the only Skill. Do not invoke /comet or any othe | CODE |
| MEDIUM | …ives/grill-test-20261013/evidence/native/report-2.json | 642 | "prompt": "[COMET NATIVE BETA17 TREATMENT]\nInvoke /comet-native as the only Skill. Do not invoke /comet or any othe | CODE |
| MEDIUM | …ives/grill-test-20261013/evidence/native/report-1.json | 656 | "prompt": "[COMET NATIVE BETA17 TREATMENT]\nInvoke /comet-native as the only Skill. Do not invoke /comet or any othe | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| MEDIUM⚡ | …t-20261013/evidence/continuation/session-evidence.json | 3 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7/subagents/agent-af446fc962c6040c8.jsonl": "{\"parentUuid\":null,\"isSidechain\": | CODE |
| MEDIUM | …s/comet-robust-config/validation/test_robust_config.py | 1 | """Validation for the comet-robust-config task. | STRING |
| MEDIUM | eval/local/tests/scaffold/test_native_sdk_recovery.py | 493 | # This metadata only unit-tests the harness boundary predicate. No model was called. | STRING |
| MEDIUM⚡ | eval/local/tests/scaffold/test_tasks.py | 245 | assert prompt.startswith("## Eval harness requirement") | STRING |
| MEDIUM | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 7 | # Usage (called by harness, not directly): | COMMENT |
| MEDIUM⚡ | …ency/superpowers/brainstorming/scripts/start-server.sh | 153 | # Resolve the harness PID (grandparent of this script). | COMMENT |
| MEDIUM⚡ | …ency/superpowers/brainstorming/scripts/start-server.sh | 154 | # $PPID is the ephemeral shell the harness spawned to run us — it dies | COMMENT |
| MEDIUM⚡ | …ency/superpowers/brainstorming/scripts/start-server.sh | 155 | # when this script exits. The harness itself is $PPID's parent. | COMMENT |
| MEDIUM | eval/scaffold/python/tasks.py | 32 | ## Eval harness requirement | COMMENT |
| MEDIUM⚡ | eval/scaffold/python/validation/evaluator.py | 411 | # Create test harness script | COMMENT |
| MEDIUM | eval/scaffold/shell/run-claude-loop.sh | 116 | # Copy each received JSONL line to the harness and the current turn's buffer. | COMMENT |
| MEDIUM | eval/scaffold/shell/run-claude-loop.sh | 278 | # Preserve the harness stream outside command substitution without reopening | COMMENT |
| MEDIUM | eval/scaffold/shell/run-claude-loop.sh | 343 | # The read-only harness records actual SDK state before starting a new session. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | domains/skill/platform-install.ts | 799 | // Step 1: Copy skills to central store | COMMENT |
| LOW | domains/skill/platform-install.ts | 828 | // Step 2: Create symlinks from platform dir to central store | COMMENT |
| LOW⚡ | domains/dashboard/web/src/demo-messages.en.json | 63 | "\n\n## Step 1:建立契约\n\n更新类型、schema 与最小失败用例,确认现有行为在改动前能够稳定复现。\n\n## Step 2:实现核心路径\n\n按以下文件边界完成实现:\n\n": "\n\n## Step 1: | CODE |
| LOW⚡ | domains/dashboard/web/src/demo-messages.en.json | 64 | "\n\n每个步骤完成后只运行覆盖该步骤的测试,避免在尚未收敛时反复执行全量套件。\n\n## Step 3:补齐失败与恢复\n\n- 覆盖无效输入、外部依赖不可用和状态过期。\n- 确认失败不会留下半写入文件或错误阶段。\n- 验证重 | CODE |
| LOW | …ks/dependency/superpowers/using-git-worktrees/SKILL.md | 16 | ## Step 0: Detect Existing Isolation | COMMENT |
| LOW | …ks/dependency/superpowers/using-git-worktrees/SKILL.md | 47 | ## Step 1: Create Isolated Workspace | COMMENT |
| LOW | …ks/dependency/superpowers/using-git-worktrees/SKILL.md | 102 | ## Step 2: Project Setup | COMMENT |
| LOW | …ks/dependency/superpowers/using-git-worktrees/SKILL.md | 121 | ## Step 3: Verify Clean Baseline | COMMENT |
| LOW⚡ | …hmarks/dependency/superpowers/executing-plans/SKILL.md | 18 | ### Step 1: Load and Review Plan | COMMENT |
| LOW⚡ | …hmarks/dependency/superpowers/executing-plans/SKILL.md | 24 | ### Step 2: Execute Tasks | COMMENT |
| LOW⚡ | …hmarks/dependency/superpowers/executing-plans/SKILL.md | 32 | ### Step 3: Complete Development | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 18 | ### Step 1: Verify Tests | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 40 | ### Step 2: Detect Environment | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 57 | ### Step 3: Determine Base Branch | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 66 | ### Step 4: Present Options | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 95 | ### Step 5: Execute Choice | COMMENT |
| LOW | …cy/superpowers/finishing-a-development-branch/SKILL.md | 161 | ### Step 6: Cleanup Workspace | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | …ins/comet-classic/classic-sdk-recovery-summary.test.ts | 129 | decided.data.continuation.current.approvals.some( | CODE |
| CRITICAL | …ins/comet-classic/classic-sdk-recovery-summary.test.ts | 135 | decided.data.continuation.inspection.commandArgs.slice(1), | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …s/comet-full-workflow/validation/test_full_workflow.py | 179 | # Check if any test file has sentence-related tests | COMMENT |
| LOW | …-lifecycle/validation/test_classic_layout_lifecycle.py | 707 | # Check if any test file has sentence-related tests | COMMENT |
| LOW | …s/039-release/comet-classic-039/scripts/comet-state.sh | 278 | # Check if .comet.yaml already exists | COMMENT |
| LOW | …s/039-release/comet-classic-039/scripts/comet-state.sh | 352 | # Check if .comet.yaml exists | COMMENT |
| LOW | …s/039-release/comet-classic-039/scripts/comet-state.sh | 377 | # Check if .comet.yaml exists | COMMENT |
| LOW | …ency/superpowers/systematic-debugging/find-polluter.sh | 44 | # Check if pollution appeared | COMMENT |
| LOW | eval/scaffold/shell/docker.sh | 278 | # Check if image exists | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .comet/config.yaml | 1 | # Comet 使用的配置格式版本,请勿修改此值。 | COMMENT |
| LOW | .comet/config.yaml | 21 | # Native 规格和 change 的存放根目录;运行时数据始终位于 .comet。 | COMMENT |
| LOW | .comet/config.yaml | 41 | language: zh-CN | COMMENT |
| LOW | …s/039-release/comet-classic-039/scripts/comet-state.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …-release/comet-classic-039/scripts/comet-hook-guard.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ystematic-debugging/condition-based-waiting-example.ts | 141 | // --------------- | COMMENT |
| LOW | …ency/superpowers/brainstorming/scripts/start-server.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | eval/scaffold/shell/setup.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | eval/scaffold/shell/run-claude-loop.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | eval/scaffold/shell/docker.sh | 21 | fi | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | …t-20261013/evidence/continuation/session-evidence.json | 2 | "db94f8f4-e0ff-4398-86be-51dc1683a4f7.jsonl": "{\"type\":\"queue-operation\",\"operation\":\"enqueue\",\"timestamp\":\ | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | domains/skill/platform-install.ts | 799 | // Step 1: Copy skills to central store | COMMENT |
| LOW | domains/skill/platform-install.ts | 828 | // Step 2: Create symlinks from platform dir to central store | COMMENT |
| LOW⚡ | domains/dashboard/web/src/demo-messages.en.json | 63 | "\n\n## Step 1:建立契约\n\n更新类型、schema 与最小失败用例,确认现有行为在改动前能够稳定复现。\n\n## Step 2:实现核心路径\n\n按以下文件边界完成实现:\n\n": "\n\n## Step 1: | CODE |
| LOW⚡ | domains/dashboard/web/src/demo-messages.en.json | 64 | "\n\n每个步骤完成后只运行覆盖该步骤的测试,避免在尚未收敛时反复执行全量套件。\n\n## Step 3:补齐失败与恢复\n\n- 覆盖无效输入、外部依赖不可用和状态过期。\n- 确认失败不会留下半写入文件或错误阶段。\n- 验证重 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | eval/scaffold/__init__.py | 40 | __all__ = [ | CODE |
| LOW | eval/scaffold/python/execution.py | 363 | def _set_if_value(environment: dict[str, str], key: str, value: str | None) -> None: | CODE |
| LOW | eval/scaffold/python/execution.py | 549 | __all__ = [ | CODE |
| LOW | eval/scaffold/python/__init__.py | 109 | __all__ = [ | CODE |
| LOW | eval/scaffold/python/validation/__init__.py | 27 | __all__ = [ | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | eval/scaffold/python/tasks.py | 181 | Render the instruction template with provided variables. Args: **kwargs: Template variables (e.g., | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/domains/dashboard/dashboard-browser.spec.ts | 1931 | element.getAttribute('placeholder'), | CODE |
| LOW | …t/domains/comet-classic/classic-command-checks.test.ts | 396 | data: { scope: 'build', command: 'placeholder', exitCode: 0, cwd }, | CODE |
| LOW | …pendency/superpowers/brainstorming/visual-companion.md | 239 | <div class="placeholder">Placeholder area</div> | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …rks/039-release/comet-classic-039/scripts/comet-env.sh | 7 | # This file is sourced by workflow snippets. Do not set global shell options here. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | eval/scaffold/python/judge_config.py | 108 | CODE | |
| LOW | eval/scaffold/python/execution.py | 103 | CODE | |
| LOW | eval/scaffold/python/treatments.py | 97 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …rks/039-release/comet-classic-039/scripts/comet-env.sh | 4 | # Usage: | COMMENT |
| LOW | eval/scaffold/shell/docker.sh | 5 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | domains/dashboard/server.ts | 202 | async function handleRequest( | CODE |
| LOW | app/commands/daemon-server.ts | 32 | async function handleRequest(request: CometDaemonRequest): Promise<CometDaemonHandlerResult> { | CODE |