Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
This report summarizes scanner evidence for NVIDIA-NeMo/Switchyard, a Rust project with 3,349 GitHub stars. SynthScan examined 180,994 lines of code across 606 source files, recording 1671 pattern matches distributed across 19 syntactic categories. The legacy adjusted pattern signal is 15.6 (Elevated pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 915 finding(s).
Are imports declared and package/API names verified? 248 finding(s).
Are wrappers, guards, and repeated structures necessary? 1139 finding(s).
Which changes need focused human review? 1671 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 1671 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 70 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 72 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 123 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 125 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 222 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 224 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 293 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 295 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 14 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 16 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 161 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 163 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 259 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 261 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 280 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 282 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 316 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 318 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experimental/craft-taskgen/tests/test_search.py | 78 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experimental/craft-taskgen/tests/test_search.py | 80 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 125 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 127 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 206 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 208 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 250 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 252 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 280 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_task_format.py | 282 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 21 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 23 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 44 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 67 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 69 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experimental/craft-taskgen/tests/test_miner.py | 100 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experimental/craft-taskgen/tests/test_miner.py | 102 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 193 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_miner.py | 195 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_rubric_drift.py | 56 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_rubric_drift.py | 61 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 618 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 620 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 3847 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 3849 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4037 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4039 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4158 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4160 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4250 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4252 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4336 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4338 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4572 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4574 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4684 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4686 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4827 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4829 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4977 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4979 | # --------------------------------------------------------------------------- | COMMENT |
| 311 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | mkdocs_hooks.py | 66 | def _rewrite_link_destinations( | CODE |
| LOW | mkdocs_hooks.py | 94 | def _rewrite_outside_code_spans( | CODE |
| LOW | benchmark/run_manifest.py | 140 | def snapshot_dataset_manifest(source: Path | None, run_dir: Path) -> Path | None: | CODE |
| LOW | benchmark/codex_model_catalog_lib.py | 29 | def _fallback_codex_model_template() -> dict[str, Any]: | CODE |
| LOW | benchmark/codex_model_catalog_lib.py | 74 | def _load_codex_model_template(codex_bin: str) -> dict[str, Any]: | CODE |
| LOW | benchmark/codex_model_catalog_lib.py | 104 | def _build_codex_model_catalog( | CODE |
| LOW | benchmark/codex_model_catalog_lib.py | 126 | def _codex_model_display_name(model_id: str) -> str: | CODE |
| LOW | benchmark/prepare_harbor_dataset.py | 128 | def _exported_dataset_candidates(download_root: Path, source_dataset: str) -> list[Path]: | CODE |
| LOW | benchmark/prepare_harbor_dataset.py | 143 | def _proxy_allowlist_hosts_for_dataset(source_dataset: str) -> tuple[str, ...]: | CODE |
| LOW | benchmark/prepare_harbor_dataset.py | 150 | def _find_exported_dataset_root(download_root: Path, source_dataset: str) -> Path: | CODE |
| LOW | benchmark/prepare_harbor_dataset.py | 181 | def _remove_toml_key_from_table(text: str, table: str, key: str) -> str: | CODE |
| LOW | benchmark/nemo_gym/gym_routing_plugin.py | 50 | async def async_post_call_success_hook( | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 72 | def test_dry_run_keeps_api_keys_off_argv(tmp_path: Path, agent: str, model: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 88 | def test_opencode_gateway_dispatch_prepends_nvidia(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 105 | def test_opencode_vllm_dispatch_prepends_vllm(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 125 | def test_opencode_legacy_vllm_input_is_normalized(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 143 | def test_opencode_legacy_nvidia_input_is_normalized(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 162 | def test_openhands_sdk_gateway_prepends_openai_and_wires_llm_env(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 184 | def test_openhands_sdk_idempotent_openai_prefix(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 211 | def test_claude_code_disables_plan_mode_by_default(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 226 | def test_disable_plan_mode_env_opt_out(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 241 | def test_other_agents_no_plan_mode_kwarg(tmp_path: Path): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 254 | def test_sanity_agent_no_model_required(tmp_path: Path, agent: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 269 | def test_sanity_agent_skips_llm_envs(tmp_path: Path, agent: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 290 | def test_sanity_agent_skips_agent_specific_kwargs(tmp_path: Path, agent: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 298 | def test_sanity_agent_keeps_determinism_envs(tmp_path: Path, agent: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 309 | def test_sanity_agent_with_model_drops_it(tmp_path: Path, agent: str): | CODE |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 320 | def test_unknown_agent_rejected(tmp_path: Path): | CODE |
| LOW⚡ | …rimental/craft-taskgen/tests/test_adapters_planning.py | 48 | def test_validate_candidate_accepts_complete_payload() -> None: | CODE |
| LOW⚡ | …rimental/craft-taskgen/tests/test_adapters_planning.py | 52 | def test_validate_candidate_rejects_missing_fields() -> None: | CODE |
| LOW⚡ | …rimental/craft-taskgen/tests/test_adapters_planning.py | 59 | def test_validate_candidate_rejects_docker_without_install() -> None: | CODE |
| LOW⚡ | …rimental/craft-taskgen/tests/test_adapters_planning.py | 66 | def test_convert_single_rejects_candidate_without_pinned_requirements() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 87 | def test_convert_single_emits_requirements_lock_into_environment_dir() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 109 | def test_convert_single_bakes_pinned_agents_into_dockerfile() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 153 | def test_build_dockerfile_includes_pre_install_and_install() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 169 | def test_main_package_name_normalizes() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 179 | def test_convert_single_emits_expected_structure() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 224 | def test_run_convert_skips_invalid_candidate() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 259 | def test_convert_single_applies_candidate_resource_overrides() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 286 | def test_convert_single_uses_default_resources_when_not_declared() -> None: | CODE |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 311 | def test_run_convert_respects_limit() -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 36 | def test_run_import_basic_and_select_compatible(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 99 | def test_run_import_uses_commit_sha_from_instance_id_and_counts(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 156 | def test_run_import_ignores_suffix_after_commit_sha_in_instance_id(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 189 | def test_run_import_fails_fast_for_missing_required_fields(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 212 | def test_run_import_fails_fast_for_non_string_patch(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 230 | def test_run_import_fails_fast_when_instance_id_has_no_commit_sha(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 247 | def test_run_import_fails_fast_when_repo_clone_missing(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 264 | def test_run_import_fails_fast_when_merge_base_fails(tmp_path) -> None: | CODE |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 284 | def test_run_import_zero_score_without_test_patch_and_groups_by_repo(tmp_path) -> None: | CODE |
| LOW⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 75 | def test_happy_path_returns_parsed_result(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 94 | def test_strips_markdown_fences(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 109 | def test_openai_prefix_preserved(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 128 | def test_parse_error_triggers_one_retry_with_feedback(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 152 | def test_parse_retry_preserves_system_prompt_in_single_message( | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 184 | def test_schema_error_triggers_one_retry(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 203 | def test_parse_error_after_retry_raises(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW⚡ | experimental/craft-taskgen/tests/test_llm_judge.py | 227 | def test_transient_error_retried(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 251 | def test_transient_retries_exhausted_raises(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 270 | def test_non_transient_error_not_retried(monkeypatch: pytest.MonkeyPatch) -> None: | CODE |
| 567 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | experimental/craft-taskgen/tests/test_run_manifest.py | 348 | # --vllm-probe on but unreachable URL → vllm_snapshot = null, manifest still written. | COMMENT |
| HIGH⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4679 | assert docker_cmd_arg == "bash /solution/solve.sh && bash /tests/test.sh", ( | CODE |
| HIGH⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 4680 | f"Expected solve.sh && test.sh chain, got {docker_cmd_arg!r}" | CODE |
| HIGH⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 5073 | "RUN apt-get update && apt-get install -y git curl ca-certificates build-essential\n" | CODE |
| HIGH⚡ | experimental/craft-taskgen/tests/test_pipeline.py | 5074 | "RUN git clone https://github.com/python-attrs/cattrs.git /code && cd /code " | CODE |
| HIGH | experimental/craft-taskgen/tests/test_pipeline.py | 2769 | "&& cd /code && git checkout 0000000000000000000000000000000000000001\n" | CODE |
| HIGH⚡ | experimental/craft-taskgen/scripts/analyze_for_site.py | 78 | when the block is missing OR present-but-null (e.g. `{mean: null}`). Both | STRING |
| HIGH | …ripts/swepro/analysis/analyze_interface_confounders.py | 36 | r"no explicit requirements?\.?|not applicable\.?|n/?a|none|null)$", | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2803 | " $(cat /tests/fail_to_pass.txt /tests/pass_to_pass.txt 2>/dev/null) \\\n" | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2804 | " 2>&1 | tee /logs/verifier/verify_full_output.txt || true\n" | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/miner.py | 21 | "after": null, | STRING |
| HIGH⚡ | experimental/craft-taskgen/src/craft_taskgen/docker.py | 154 | " (cd /postmerge && find . -type f -name '*.py' | while IFS= read -r f; do\n" | CODE |
| HIGH⚡ | experimental/craft-taskgen/src/craft_taskgen/docker.py | 161 | f"python3 -m pytest {paths_str} -v --tb=no --continue-on-collection-errors 2>&1 || true\n" | CODE |
| HIGH⚡ | experimental/craft-taskgen/src/craft_taskgen/docker.py | 165 | f"python3 -m pytest {paths_str} -v --tb=no --continue-on-collection-errors 2>&1 || true\n" | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 286 | docker_cmd = "bash /solution/solve.sh && bash /tests/test.sh" if apply_solution else "bash /tests/test.sh" | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/prompts.py | 757 | - Reset git: rm -rf .git && git init && git config user.email test@test.com && | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/prompts.py | 758 | git config user.name Test && git add -A && git commit -m init | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/prompts.py | 1353 | - Reset git: rm -rf .git && git init && git config user.email test@test.com && | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/prompts.py | 1354 | git config user.name Test && git add -A && git commit -m init | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 502 | if (L.match(/^### /)) {{ out.push('<h3>' + L.slice(4) + '</h3>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 503 | else if (L.match(/^## /)) {{ out.push('<h2>' + L.slice(3) + '</h2>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 504 | else if (L.match(/^# /)) {{ out.push('<h1>' + L.slice(2) + '</h1>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 505 | else if (L.match(/^- /)) {{ out.push('<li>' + L.slice(2) + '</li>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 506 | else if (L.match(/^\\d+\\. /)) {{ out.push('<li>' + L.replace(/^\\d+\\.\\s*/, '') + '</li>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 507 | else if (L.trim() === '') {{ if (out.length && out[out.length-1] !== '<br>') out.push('<br>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 507 | else if (L.trim() === '') {{ if (out.length && out[out.length-1] !== '<br>') out.push('<br>'); }} | CODE |
| HIGH⚡ | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 508 | else {{ out.push(L); }} | CODE |
| HIGH | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 647 | if (trunc && trunc.style.display !== 'none') {{ | CODE |
| HIGH⚡ | …ental/craft-taskgen/src/craft_taskgen/search/harbor.py | 57 | RUN apt-get update && apt-get install -y --no-install-recommends curl && \\ | CODE |
| HIGH⚡ | …ental/craft-taskgen/src/craft_taskgen/search/harbor.py | 62 | apt-get remove -y curl && apt-get autoremove -y && \\ | CODE |
| HIGH⚡ | …ental/craft-taskgen/src/craft_taskgen/search/harbor.py | 66 | RUN mkdir -p /etc/codex && cat > /etc/codex/config.toml << 'EOF' | CODE |
| HIGH | …al/craft-taskgen/src/craft_taskgen/adapters/_docker.py | 175 | f"&& cd /repo && git checkout {spec.parent_sha}" | CODE |
| HIGH | …al/craft-taskgen/src/craft_taskgen/adapters/_docker.py | 197 | 'RUN rm -rf .git && git init && git config user.email "agent@test" ' | CODE |
| HIGH | …al/craft-taskgen/src/craft_taskgen/adapters/_docker.py | 198 | "&& git config user.name \"Agent\" && git add -A && git commit -m 'initial commit'" | CODE |
| HIGH | …skgen/src/craft_taskgen/adapters/planning/converter.py | 120 | git remote add upstream https://github.com/{repo}.git 2>/dev/null || true | CODE |
| HIGH | …ft-taskgen/src/craft_taskgen/baselines/run_manifest.py | 284 | Empty-string values are treated as `None` (JSON null) so bash can | STRING |
| HIGH | …ft-taskgen/src/craft_taskgen/baselines/run_manifest.py | 435 | # `--extra foo.bar=null` → JSON null). A string that isn't valid JSON | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/run_manifest.py | 11 | CODE | |
| LOW | benchmark/codex_model_catalog_lib.py | 12 | CODE | |
| LOW | benchmark/codex_model_catalog.py | 6 | CODE | |
| LOW | benchmark/nemo_gym/gym_routing_plugin.py | 6 | CODE | |
| LOW | benchmark/nemo_gym/compare.py | 6 | CODE | |
| LOW | benchmark/closed_book_proxy/proxy/rewriter.py | 6 | CODE | |
| LOW | switchyard/libsy/algorithms.py | 6 | CODE | |
| LOW | switchyard/libsy/algorithms.py | 7 | CODE | |
| LOW | switchyard/libsy/algorithms.py | 8 | CODE | |
| LOW | switchyard/libsy/algorithms.py | 9 | CODE | |
| LOW | switchyard/libsy/algorithms.py | 10 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 6 | CODE | |
| LOW | switchyard/libsy/__init__.py | 24 | CODE | |
| LOW | …erimental/craft-taskgen/tests/test_launcher_dry_run.py | 12 | CODE | |
| LOW | …rimental/craft-taskgen/tests/test_adapters_planning.py | 6 | CODE | |
| LOW | …mental/craft-taskgen/tests/test_import_swebench_pro.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/conftest.py | 11 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_llm_judge.py | 22 | CODE | |
| LOW | …erimental/craft-taskgen/tests/test_score_exclusions.py | 6 | CODE | |
| LOW | …rimental/craft-taskgen/tests/test_evaluate_majority.py | 4 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_smoke_runner.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_search.py | 6 | CODE | |
| LOW | …imental/craft-taskgen/tests/test_reasoning_defaults.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_import_pr_refs.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_task_format.py | 6 | CODE | |
| LOW | …perimental/craft-taskgen/tests/test_planning_scorer.py | 6 | CODE | |
| LOW | …imental/craft-taskgen/tests/test_swebench_alignment.py | 4 | CODE | |
| LOW | …ental/craft-taskgen/tests/test_update_alignment_csv.py | 4 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_docker_cleanup.py | 14 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_miner.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_prefilters.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_import_cli.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_rubric_drift.py | 21 | CODE | |
| LOW | …ental/craft-taskgen/tests/test_clone_swebench_repos.py | 6 | CODE | |
| LOW | …imental/craft-taskgen/tests/test_alignment_majority.py | 4 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_run_manifest.py | 6 | CODE | |
| LOW | …perimental/craft-taskgen/tests/test_adapters_docker.py | 6 | CODE | |
| LOW | …tal/craft-taskgen/tests/test_agent_pass_rate_matrix.py | 4 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_pipeline.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/tests/test_output_cap.py | 6 | CODE | |
| LOW | …mental/craft-taskgen/tests/test_skip_only_detection.py | 13 | CODE | |
| LOW | …ental/craft-taskgen/tests/test_import_skills_dryrun.py | 6 | CODE | |
| LOW | …tal/craft-taskgen/tests/test_adapters_search_native.py | 6 | CODE | |
| LOW | experimental/craft-taskgen/scripts/task_review.py | 88 | CODE | |
| LOW | experimental/craft-taskgen/scripts/filter_by_license.py | 13 | CODE | |
| LOW | …tal/craft-taskgen/scripts/summarize_search_baseline.py | 70 | CODE | |
| 147 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | benchmark/closed_book_proxy/proxy/rewriter.py | 90 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/scripts/task_review.py | 148 | except (OSError, json.JSONDecodeError): | CODE |
| HIGH | …perimental/craft-taskgen/scripts/summarize_baseline.py | 272 | except (OSError, json.JSONDecodeError): | CODE |
| HIGH | …perimental/craft-taskgen/scripts/summarize_baseline.py | 469 | except (OSError, json.JSONDecodeError): | CODE |
| HIGH | …l/craft-taskgen/scripts/classify_localized_failures.py | 361 | except (OSError, json.JSONDecodeError): | CODE |
| HIGH | …l/craft-taskgen/scripts/classify_localized_failures.py | 404 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/scripts/analyze-easiness.py | 164 | except json.JSONDecodeError: | CODE |
| HIGH | experimental/craft-taskgen/scripts/analyze-easiness.py | 255 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/scripts/check_integrity.py | 196 | except Exception: | CODE |
| HIGH | experimental/craft-taskgen/scripts/swepro/render.py | 47 | except json.JSONDecodeError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 877 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 242 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 91 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 530 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3481 | except Exception: | CODE |
| HIGH | …rimental/craft-taskgen/src/craft_taskgen/claude_cli.py | 76 | except (json.JSONDecodeError, TypeError, ValueError): | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 207 | except OSError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 350 | except Exception: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 115 | except ProcessLookupError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 199 | except ProcessLookupError: | CODE |
| HIGH | experimental/craft-taskgen/src/craft_taskgen/docker.py | 317 | except ProcessLookupError: | CODE |
| HIGH | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 136 | except Exception: | CODE |
| HIGH | …erimental/craft-taskgen/src/craft_taskgen/preflight.py | 351 | except Exception: | CODE |
| HIGH | …erimental/craft-taskgen/src/craft_taskgen/preflight.py | 443 | except Exception: | CODE |
| HIGH | …ntal/craft-taskgen/src/craft_taskgen/search/extract.py | 318 | except (IndexError, AttributeError): | CODE |
| HIGH | …kgen/src/craft_taskgen/search/templates/test_runner.py | 477 | except (ValueError, TypeError): | CODE |
| HIGH | scripts/aiperf_runner.py | 74 | except ProcessLookupError: | CODE |
| HIGH | scripts/aiperf_runner.py | 89 | except ProcessLookupError: | CODE |
| HIGH | scripts/run_local_soak_test.py | 164 | except (OSError, urllib.error.URLError, json.JSONDecodeError): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .sir-merge-a-lot.yml | 1 | # .sir-merge-a-lot.yml — switchyard | COMMENT |
| LOW | .sir-merge-a-lot.yml | 21 | # bot was explicitly invited to groom (on_demand mode). Every LLM | COMMENT |
| LOW | benchmark/tb_lite_subset_20.txt | 1 | # Curated 20-task iteration subset for openthoughts-tblite@2.0. | COMMENT |
| LOW | benchmark/prepare_harbor_dataset.py | 201 | pi_version = pins["PI_VERSION"] | COMMENT |
| LOW | benchmark/closed_book_proxy/proxy/allowlist-base.txt | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/tb21-escalation-opus-glm-deepseek.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …profiles/tau2-telecom-custom-opus-qwen-aggressive.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/deepswe-v11-stage-router-luna-sol.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/deepswe-v11-stage-router-luna-sol.toml | 21 | # trial per task | COMMENT |
| LOW | …g-profiles/tau2-telecom-custom-opus-qwen-balanced.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/deepswe-v11-advisor-gate-luna-sol.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/deepswe-v11-advisor-gate-luna-sol.toml | 21 | # Result 57.5% +/- 3.2 solved at $208 +/- 22 per run (about $3.20 per solve); | COMMENT |
| LOW | …outing-profiles/deepswe-v11-plan-execute-luna-sol.toml | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …outing-profiles/deepswe-v11-plan-execute-luna-sol.toml | 21 | # Anchors same harness and conditions, k=3: Sol alone 62.8% +/- 3.1 at | COMMENT |
| LOW | …ft-taskgen/patches/compose-overrides/host-gateway.yaml | 1 | # Harbor compose override: map host.docker.internal -> host-gateway on the | COMMENT |
| LOW | experimental/craft-taskgen/planning/run_plan_impl.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experimental/craft-taskgen/planning/run_plan_impl.sh | 21 | # IMPL_AGENT_KWARGS space-separated "k=v" pairs passed as --agent-kwarg to phase 2 | COMMENT |
| LOW | …tal/craft-taskgen/scripts/summarize_search_baseline.py | 81 | COMMENT | |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 81 | DEFAULT_COHORT_FILE = Path(__file__).resolve().parent.parent / "references" / "v2b-tasks.txt" | COMMENT |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 121 | # during the run. Claude-code only writes `agent/claude-code.txt` (NDJSON); | COMMENT |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 301 | if skip_set: | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 161 | # Strip the dispatch prefix only when it isn't actually the | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 241 | COMMENT | |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 341 | COMMENT | |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 361 | _add_env CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS 1 | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 501 | # (https://code.claude.com/docs/en/env-vars) and takes precedence | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 541 | # paper can cite paper-recommended settings (Qwen3 tech report §3.3 + | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 661 | CMD+=(--agent-kwarg "max_iterations=$(uv run python -c 'from craft_taskgen.adapters._docker import OPENHANDS_SDK_MAX | COMMENT |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 1 | #!/bin/bash | COMMENT |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 21 | # Agent compatibility under firewall: | COMMENT |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 41 | # - codex: requires CODEX_BINARY_PATH (pre-baked tarball). Without | COMMENT |
| LOW | …erimental/craft-taskgen/scripts/build-codex-prebake.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | …perimental/craft-taskgen/scripts/fetch_repo_details.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | …tal/craft-taskgen/scripts/score_e2e_implicit_search.py | 401 | # claude-code writes its raw NDJSON transcript to agent/claude-code.txt but | COMMENT |
| LOW | experimental/craft-taskgen/scripts/rerun-tainted.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experimental/craft-taskgen/scripts/rerun-tainted.sh | 21 | # trial that is ALSO tainted also gets archived. One pass only — | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-pipeline.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-pipeline.sh | 21 | # max_promising_per_repo in the profile. | COMMENT |
| LOW | experimental/craft-taskgen/scripts/swepro/__init__.py | 1 | # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | experimental/craft-taskgen/src/craft_taskgen/config.py | 61 | # self-preference bias mitigation). Defaults to GPT-5.4 via the NVIDIA gateway; | COMMENT |
| LOW | …al/craft-taskgen/src/craft_taskgen/adapters/_docker.py | 41 | CLAUDE_CODE_VERSION = "2.1.118" | COMMENT |
| LOW | …kgen/src/craft_taskgen/baselines/reasoning_defaults.py | 41 | # so the launcher can pass --effort xhigh to the in-container `claude` | COMMENT |
| LOW | crates/libsy-llm-client/src/client.rs | 621 | COMMENT | |
| LOW | crates/libsy-llm-client/src/error.rs | 1 | // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | crates/libsy-llm-client/src/backend.rs | 41 | "context window", | COMMENT |
| LOW | crates/libsy-llm-client/src/backend.rs | 61 | /// Provider-owned headers are rejected so a static value cannot replace | COMMENT |
| LOW | crates/libsy-llm-client/src/lib.rs | 1 | // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | crates/libsy-llm-client/src/raw.rs | 1 | // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | crates/libsy-llm-client/src/run.rs | 1 | // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | crates/libsy-llm-client/src/run.rs | 41 | use crate::{metrics, observability}; | COMMENT |
| LOW | crates/libsy-llm-client/src/observation.rs | 41 | /// | COMMENT |
| LOW | crates/switchyard-py/src/libsy_bindings.rs | 801 | inner: Arc<dyn Algorithm>, | COMMENT |
| LOW | crates/protocol/src/llm.rs | 281 | /// Provider-specific fields that do not have first-class conversation fields. | COMMENT |
| LOW | crates/protocol/src/llm.rs | 301 | /// Original request bodies keyed by source format. | COMMENT |
| LOW | crates/protocol/src/llm.rs | 341 | #[derive(Clone, Debug, Default, PartialEq, Serialize, Deserialize)] | COMMENT |
| LOW | crates/protocol/src/stream.rs | 361 | /// | COMMENT |
| LOW | crates/protocol/src/decision.rs | 21 | /// Position in the request's rubric, including fractional positions. | COMMENT |
| LOW | crates/protocol/src/client.rs | 1 | // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | crates/protocol/src/client.rs | 21 | /// escape hatch for failures that do not fit a shared category. | COMMENT |
| 77 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/nemo_gym/gym_routing_plugin.py | 16 | CODE | |
| LOW | experimental/craft-taskgen/planning/wrap_pipeline.py | 208 | CODE | |
| LOW | experimental/craft-taskgen/planning/wrap_pipeline.py | 303 | CODE | |
| LOW | experimental/craft-taskgen/scripts/task_review.py | 127 | CODE | |
| LOW | experimental/craft-taskgen/scripts/task_review.py | 201 | CODE | |
| LOW | experimental/craft-taskgen/scripts/task_review.py | 261 | CODE | |
| LOW | experimental/craft-taskgen/scripts/task_review.py | 380 | CODE | |
| LOW | …tal/craft-taskgen/scripts/summarize_search_baseline.py | 462 | CODE | |
| LOW | …al/craft-taskgen/scripts/build_first_half_per_trial.py | 50 | CODE | |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 261 | CODE | |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 365 | CODE | |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 498 | CODE | |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 1044 | CODE | |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 210 | CODE | |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 246 | CODE | |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 431 | CODE | |
| LOW | …perimental/craft-taskgen/scripts/summarize_baseline.py | 513 | CODE | |
| LOW | …l/craft-taskgen/scripts/classify_localized_failures.py | 118 | CODE | |
| LOW | …l/craft-taskgen/scripts/classify_localized_failures.py | 172 | CODE | |
| LOW | …l/craft-taskgen/scripts/classify_localized_failures.py | 343 | CODE | |
| LOW | …l/craft-taskgen/scripts/classify_localized_failures.py | 416 | CODE | |
| LOW | experimental/craft-taskgen/scripts/analyze_for_site.py | 183 | CODE | |
| LOW | …mental/craft-taskgen/scripts/agent_pass_rate_matrix.py | 143 | CODE | |
| LOW | …l/craft-taskgen/scripts/compare_pipeline_agent_runs.py | 183 | CODE | |
| LOW | experimental/craft-taskgen/scripts/analyze-easiness.py | 384 | CODE | |
| LOW | …tal/craft-taskgen/scripts/score_e2e_implicit_search.py | 227 | CODE | |
| LOW | …tal/craft-taskgen/scripts/score_e2e_implicit_search.py | 421 | CODE | |
| LOW | …tal/craft-taskgen/scripts/score_e2e_implicit_search.py | 530 | CODE | |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 72 | CODE | |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 129 | CODE | |
| LOW | …al/craft-taskgen/scripts/deep_dive_e2e_trajectories.py | 102 | CODE | |
| LOW | …al/craft-taskgen/scripts/deep_dive_e2e_trajectories.py | 262 | CODE | |
| LOW | …al/craft-taskgen/scripts/deep_dive_e2e_trajectories.py | 286 | CODE | |
| LOW | …al/craft-taskgen/scripts/deep_dive_e2e_trajectories.py | 313 | CODE | |
| LOW | …al/craft-taskgen/scripts/deep_dive_e2e_trajectories.py | 687 | CODE | |
| LOW | …mental/craft-taskgen/scripts/extract_v2b_patch_gold.py | 61 | CODE | |
| LOW | …ntal/craft-taskgen/scripts/inference_endpoint_audit.py | 180 | CODE | |
| LOW | experimental/craft-taskgen/scripts/manage_repo_list.py | 241 | CODE | |
| LOW | experimental/craft-taskgen/scripts/swepro/ingest.py | 176 | CODE | |
| LOW | experimental/craft-taskgen/scripts/swepro/ingest.py | 199 | CODE | |
| LOW | …s/swepro/analysis/build_two_mode_suitability_report.py | 212 | CODE | |
| LOW | …ro/analysis/analyze_swebench_pro_difficulty_proxies.py | 57 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 75 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 96 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 208 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 316 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 390 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2601 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3356 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3956 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3976 | CODE | |
| LOW | …imental/craft-taskgen/src/craft_taskgen/task_format.py | 42 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/config.py | 100 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/miner.py | 425 | CODE | |
| LOW | …rimental/craft-taskgen/src/craft_taskgen/claude_cli.py | 179 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/docker.py | 122 | CODE | |
| LOW | experimental/craft-taskgen/src/craft_taskgen/docker.py | 212 | CODE | |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 120 | CODE | |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 317 | CODE | |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 349 | CODE | |
| 35 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 396 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 531 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 576 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 864 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 884 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-deep-dive.py | 949 | except Exception as e: | CODE |
| LOW | …mental/craft-taskgen/scripts/run_alignment_majority.py | 396 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/scripts/analyze_for_site.py | 124 | except Exception as exc: # noqa: BLE001 — pricing module may raise on malformed entries | CODE |
| LOW | …mental/craft-taskgen/scripts/agent_pass_rate_matrix.py | 391 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/scripts/smoke-llm-judge.py | 76 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/scripts/triage-replay.py | 136 | except Exception as e: # noqa: BLE001 — record per-task failure, keep the batch going | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 91 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 173 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 187 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 202 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 216 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 230 | except Exception as e: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 199 | except Exception as err: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 283 | except Exception as err: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 299 | except Exception as err: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 328 | except Exception as err: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 369 | except Exception as err: | CODE |
| LOW | …erimental/craft-taskgen/scripts/calibrate-alignment.py | 525 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 67 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 97 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 140 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 148 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 187 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/scripts/check_integrity.py | 196 | except Exception: | CODE |
| LOW | …mental/craft-taskgen/scripts/extract_v2b_patch_gold.py | 345 | except Exception as e: # noqa: BLE001 — keep going through the corpus | CODE |
| LOW | …imental/craft-taskgen/scripts/run_evaluate_majority.py | 485 | except Exception as err: | CODE |
| LOW | …ntal/craft-taskgen/scripts/inference_endpoint_audit.py | 144 | except Exception: | CODE |
| LOW | …ripts/swepro/analysis/analyze_interface_confounders.py | 227 | except Exception: | CODE |
| LOW | …ro/analysis/analyze_swebench_pro_difficulty_proxies.py | 43 | except Exception: | CODE |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 380 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 569 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 906 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 1069 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 1115 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 1393 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 1415 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3245 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3270 | except Exception as err: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3340 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3481 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 3568 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 4083 | except Exception: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/steps.py | 4148 | except Exception as e: | CODE |
| MEDIUM | …imental/craft-taskgen/src/craft_taskgen/task_format.py | 178 | print(f"Error: {task_dir} is not a directory") | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/miner.py | 557 | except Exception as e: | CODE |
| MEDIUM | experimental/craft-taskgen/src/craft_taskgen/miner.py | 714 | print(f"Error: {repo_path} is not a directory and is not an owner/repo slug", file=sys.stderr) | CODE |
| MEDIUM | experimental/craft-taskgen/src/craft_taskgen/miner.py | 719 | print(f"Error: failed to clone {github_repo}", file=sys.stderr) | CODE |
| MEDIUM | experimental/craft-taskgen/src/craft_taskgen/miner.py | 731 | print("Error: could not get remote URL — is this a GitHub repo?", file=sys.stderr) | CODE |
| MEDIUM | experimental/craft-taskgen/src/craft_taskgen/miner.py | 736 | print(f"Error: remote URL is not a GitHub URL: {remote_url}", file=sys.stderr) | CODE |
| LOW | …rimental/craft-taskgen/src/craft_taskgen/claude_cli.py | 319 | except Exception as e: | CODE |
| LOW | experimental/craft-taskgen/src/craft_taskgen/docker.py | 350 | except Exception: | CODE |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 136 | except Exception: | CODE |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 331 | except Exception: | CODE |
| LOW | …erimental/craft-taskgen/src/craft_taskgen/dashboard.py | 732 | except Exception as e: | CODE |
| LOW | …/craft-taskgen/src/craft_taskgen/swebench_alignment.py | 352 | except Exception as err: | CODE |
| 23 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …outing-profiles/deepswe-v11-stage-router-luna-sol.toml | 29 | # Inputs the harness supplies. The harness also owns execution, credentials and results. | COMMENT |
| MEDIUM | …outing-profiles/deepswe-v11-stage-router-luna-sol.toml | 33 | # Results stay where the harness writes them (Pier: jobs/<job-name>/). | COMMENT |
| MEDIUM | …outing-profiles/deepswe-v11-advisor-gate-luna-sol.toml | 23 | # Anchors same harness and conditions, k=3: Sol alone 62.8% +/- 3.1 at $743 per | COMMENT |
| MEDIUM | …outing-profiles/deepswe-v11-plan-execute-luna-sol.toml | 21 | # Anchors same harness and conditions, k=3: Sol alone 62.8% +/- 3.1 at | COMMENT |
| MEDIUM | …al/craft-taskgen/scripts/build_first_half_per_trial.py | 205 | # bound on first-half localization, and the regression is robust to | COMMENT |
| MEDIUM | experimental/craft-taskgen/scripts/analyze_for_site.py | 264 | # auto-generated Sphinx HTML files); median is outlier-robust without | COMMENT |
| MEDIUM | …kgen/src/craft_taskgen/search/templates/test_runner.py | 352 | # only, primary alone in denominator. Symmetric and robust to over- and | COMMENT |
| MEDIUM | …ft-taskgen/src/craft_taskgen/baselines/run_manifest.py | 238 | # determinism/compaction/harness/outcomes, but we don't require any | COMMENT |
| MEDIUM | …ft-taskgen/src/craft_taskgen/baselines/run_manifest.py | 449 | # Auto-populate harness.task_dir_digest when tasks_dir is given. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/codex_model_catalog_lib.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | switchyard/__init__.py | 14 | __all__ = ["__version__"] | CODE |
| LOW | switchyard/libsy/algorithms.py | 12 | __all__ = ["llm_classifier", "llm_task_classifier", "noop", "random", "stage_router"] | CODE |
| LOW | switchyard/libsy/__init__.py | 26 | __all__ = [ | CODE |
| LOW | experimental/craft-taskgen/planning/join_scores.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | experimental/craft-taskgen/planning/wrap_pipeline.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | …rimental/craft-taskgen/scripts/update_alignment_csv.py | 99 | def _set_columns(row: list[str], indexes: list[int], value: object, width: int) -> None: | CODE |
| LOW | …ntal/craft-taskgen/src/craft_taskgen/planning/synth.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | …tal/craft-taskgen/src/craft_taskgen/planning/harbor.py | 14 | logger = logging.getLogger(__name__) | CODE |
| LOW | …tal/craft-taskgen/src/craft_taskgen/planning/scorer.py | 46 | logger = logging.getLogger(__name__) | CODE |
| LOW | …al/craft-taskgen/src/craft_taskgen/adapters/_docker.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | …skgen/src/craft_taskgen/adapters/planning/converter.py | 47 | logger = logging.getLogger(__name__) | CODE |
| LOW | …askgen/src/craft_taskgen/adapters/planning/__init__.py | 15 | __all__ = ["run_convert"] | CODE |
| LOW | …/craft-taskgen/src/craft_taskgen/baselines/__init__.py | 36 | __all__ = [ | CODE |
| LOW | switchyard_rust/server.py | 50 | __all__ = ["Server", "ServerConfigError"] | CODE |
| LOW | examples/litellm/src/switchyard_litellm/__init__.py | 8 | __all__ = ["RandomRoutingPlugin", "StageRoutingPlugin", "SwitchyardRoutingPlugin"] | CODE |
| LOW | …tellm/src/switchyard_litellm/configuration/__init__.py | 13 | __all__ = [ | CODE |
| LOW | …litellm/src/switchyard_litellm/configuration/loader.py | 266 | __all__ = [ | CODE |
| LOW | …/switchyard_litellm/configuration/configured_plugin.py | 10 | __all__ = ["ROUTING_PLUGIN"] | CODE |
| LOW | …ellm/src/switchyard_litellm/plugins/request_rewrite.py | 286 | __all__ = ["build_request_patch"] | CODE |
| LOW | …rc/switchyard_litellm/plugins/random_routing_plugin.py | 47 | __all__ = ["RandomRoutingPlugin"] | CODE |
| LOW | …witchyard_litellm/plugins/switchyard_routing_plugin.py | 239 | __all__ = ["SwitchyardRoutingPlugin"] | CODE |
| LOW | …src/switchyard_litellm/plugins/stage_routing_plugin.py | 74 | __all__ = ["StageRoutingPlugin"] | CODE |
| LOW | …les/litellm/src/switchyard_litellm/plugins/__init__.py | 10 | __all__ = ["RandomRoutingPlugin", "StageRoutingPlugin", "SwitchyardRoutingPlugin"] | CODE |
| LOW | …witchyard_litellm/plugins/lite_llm_request_rewriter.py | 133 | __all__ = ["LiteLLMRequestRewriter"] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/nemo_gym/run.sh | 10 | # Step 1: Choose settings and check the setup before starting any services. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 114 | # Step 2: Prepare MMLU-Redux, reusing the prepared dataset if it already exists. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 122 | # Step 3: Start a local LiteLLM server and wait until it is ready. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 146 | # Step 4: Save the checkout versions once for reference and prepare the output folders. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 151 | # Step 5: Evaluate the fixed baseline, then Random routing, on the same tasks. | COMMENT |
| LOW | benchmark/nemo_gym/run.sh | 174 | # Step 6: Stop LiteLLM, then compare the saved fixed and routed runs. | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 386 | # Step 1: Select candidates | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 479 | # Step 2: Evaluate candidates | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 628 | # Step 3: Build task packages | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2444 | # Step 4: Find tests and generate solve.sh (ALIGNMENT_CHECKED → TESTS_DISCOVERED) | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2597 | # Step 5: Docker build + F2P/P2P classification (DOCKERFILE_BUILT → F2P_P2P_CLASSIFIED) | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2887 | # Step 5: F2P/P2P classification (replaces docker validate) | COMMENT |
| LOW | …perimental/craft-taskgen/src/craft_taskgen/pipeline.py | 257 | # Step 1: Select | COMMENT |
| LOW | …perimental/craft-taskgen/src/craft_taskgen/pipeline.py | 285 | # Step 2: Evaluate | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/nemo_gym/run.sh | 10 | # Step 1: Choose settings and check the setup before starting any services. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 114 | # Step 2: Prepare MMLU-Redux, reusing the prepared dataset if it already exists. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 122 | # Step 3: Start a local LiteLLM server and wait until it is ready. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 146 | # Step 4: Save the checkout versions once for reference and prepare the output folders. | COMMENT |
| LOW⚡ | benchmark/nemo_gym/run.sh | 151 | # Step 5: Evaluate the fixed baseline, then Random routing, on the same tasks. | COMMENT |
| LOW | benchmark/nemo_gym/run.sh | 174 | # Step 6: Stop LiteLLM, then compare the saved fixed and routed runs. | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 386 | # Step 1: Select candidates | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 479 | # Step 2: Evaluate candidates | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 628 | # Step 3: Build task packages | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2444 | # Step 4: Find tests and generate solve.sh (ALIGNMENT_CHECKED → TESTS_DISCOVERED) | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2597 | # Step 5: Docker build + F2P/P2P classification (DOCKERFILE_BUILT → F2P_P2P_CLASSIFIED) | COMMENT |
| LOW⚡ | experimental/craft-taskgen/src/craft_taskgen/steps.py | 2887 | # Step 5: F2P/P2P classification (replaces docker validate) | COMMENT |
| LOW | …perimental/craft-taskgen/src/craft_taskgen/pipeline.py | 257 | # Step 1: Select | COMMENT |
| LOW | …perimental/craft-taskgen/src/craft_taskgen/pipeline.py | 285 | # Step 2: Evaluate | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | experimental/craft-taskgen/scripts/run-baselines.sh | 120 | # talk to an LLM, they just orchestrate harbor's own non-LLM agents | COMMENT |
| MEDIUM | …kgen/src/craft_taskgen/baselines/reasoning_defaults.py | 54 | # Sonnet 4.6: "Medium effort (recommended default)" for agentic coding | COMMENT |
| MEDIUM | crates/libsy-llm-client/src/run.rs | 1084 | body: r#"{"error":{"code":"content_policy_violation","message":"request blocked by content polic | CODE |
| MEDIUM | crates/protocol/src/client.rs | 85 | #[error("context window exceeded for model {model}: {message}")] | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | benchmark/nemo_gym/README.md | 46 | export NVIDIA_API_KEY="your-api-key" | CODE |
| HIGH | …erimental/craft-taskgen/src/craft_taskgen/preflight.py | 478 | placeholders = {"", "your-api-key-here", "sk-your-key-here", "changeme"} | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experimental/craft-taskgen/scripts/run-baselines.sh | 10 | # Usage: | COMMENT |
| LOW | experimental/craft-taskgen/scripts/docker-firewall.sh | 12 | # Usage: | COMMENT |
| LOW | …erimental/craft-taskgen/scripts/build-codex-prebake.sh | 18 | # Usage: | COMMENT |
| LOW | experimental/craft-taskgen/scripts/rerun-tainted.sh | 25 | # Usage: | COMMENT |
| LOW | experimental/craft-taskgen/scripts/run-pipeline.sh | 6 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …tal/craft-taskgen/src/craft_taskgen/search/validate.py | 80 | # Check if any qualified class has this method | COMMENT |
| LOW | …review/skills/gold-review/scripts/apply_annotations.py | 142 | # Check if anything changed | COMMENT |
| LOW | …ills/gold-review/scripts/trajectory_integrity_check.py | 207 | # Check if agent read this file or any file containing it | COMMENT |
| LOW | …view/skills/gold-review/scripts/read_gold_functions.py | 63 | # Check if it's inside the right class | COMMENT |
| LOW | …view/skills/gold-review/scripts/read_gold_functions.py | 121 | # Check if it's a simple delegation | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | experimental/craft-taskgen/tests/test_search.py | 171 | # Create a minimal task file | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …erimental/craft-taskgen/tests/test_score_exclusions.py | 61 | CODE | |
| LOW | …tal/craft-taskgen/scripts/score_e2e_implicit_search.py | 205 | CODE | |
| LOW | …tal/craft-taskgen/src/craft_taskgen/planning/scorer.py | 194 | CODE | |
| LOW | switchyard_rust/libsy.py | 299 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ripts/swepro/analysis/analyze_interface_confounders.py | 172 | "placeholder": f"{placeholder_pass}/{placeholder_n} ({pct(placeholder_pass, placeholder_n)})", | CODE |
| LOW | …ripts/swepro/analysis/analyze_interface_confounders.py | 499 | ["repo", "eval", "alignment", "f2p_bucket", "placeholder", "meaningful"], | CODE |