Fully autonomous & self-evolving research from idea to paper. Chat an Idea. Get a Paper. 🦞
This report presents the forensic synthetic code analysis of aiming-lab/AutoResearchClaw, a Python project with 13,799 GitHub stars. SynthScan v2.0 examined 171,220 lines of code across 699 source files, recording 5268 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 54.7 places this repository in the Strong AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 5268 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | config.researchclaw.example.yaml | 136 | # ============================================================================ | COMMENT |
| MEDIUM | config.researchclaw.example.yaml | 138 | # ============================================================================ | COMMENT |
| MEDIUM | prompts.default.yaml | 1 | # ============================================================================= | COMMENT |
| MEDIUM | prompts.default.yaml | 3 | # ============================================================================= | COMMENT |
| MEDIUM | prompts.default.yaml | 16 | # ============================================================================= | COMMENT |
| MEDIUM | run_hep_pipeline.sh | 7 | # ── API credentials ────────────────────────────────────────────── | COMMENT |
| MEDIUM | run_hep_pipeline.sh | 15 | # ── Anthropic (for claude CLI subprocess — ColliderAgent) ──────── | COMMENT |
| MEDIUM | experiments/arc_bench/config/base_config.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/base_config.yaml | 5 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 15 | # ============================================================================ | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S03.yaml | 131 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S03.yaml | 138 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S02.yaml | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S02.yaml | 142 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S01.yaml | 96 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S01.yaml | 103 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 8 | # ============================================================================ | COMMENT |
| 1631 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 407 | def _read_agent_lab_artifacts(run_dir: Path) -> StandardArtifacts: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 169 | def _materialize_stub_data_dir(self, topic: dict, target: Path) -> None: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/base.py | 86 | def _write_standard_artifacts( | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 98 | def _build_submission_from_adapter(artifacts_native: Path, submission_dir: Path, | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 282 | def _metrics_from_metric_value(metric_value: dict) -> dict[str, float]: | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 327 | def _pivot_per_condition_from_entry(entry: dict) -> dict[str, dict[str, float]]: | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 360 | def _format_leaves_for_prompt(leaves: list[dict[str, Any]]) -> str: | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 747 | def _locate_experiment_summary(run_dir: Path, topic_id: str) -> Path | None: | CODE |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 118 | def _read_agent_lab_canonical(run_dir: Path) -> dict[str, Any]: | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 12 | def test_collider_agent_config_has_incremental_field_default_false(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 18 | def test_collider_agent_config_incremental_can_be_enabled(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 23 | def test_run_subparser_accepts_incremental_experiment_flag(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 36 | def test_run_subparser_incremental_experiment_default_false(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 49 | def test_gate_required_returns_true_for_code_generation_when_profile_is_hep_ph(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 55 | def test_gate_required_returns_false_for_code_generation_without_profile(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 63 | def test_gate_required_unaffected_for_existing_gates_when_profile_is_passed(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 71 | def test_default_rollback_for_code_generation_is_experiment_design(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 82 | def test_code_generation_contract_has_collider_alternate_output(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 208 | def test_incremental_snapshot_warns_when_cumulative_footprint_exceeds_threshold( | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 327 | def test_sandbox_merges_results_json_in_incremental_mode(tmp_path, monkeypatch): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 403 | def test_merge_docs_static_logic_handles_missing_snapshots(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 417 | def test_prepare_workspace_in_incremental_mode_assembles_delta_prompt(tmp_path): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 596 | def test_version_rollback_stages_uses_copytree_when_incremental(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 134 | def test_select_output_files_picks_collider_mode_alternate(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 145 | def test_select_output_files_keeps_default_for_non_collider_mode(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 157 | def test_select_output_files_handles_none_contract(): | CODE |
| LOW | tests/test_hep_incremental.py | 163 | def test_executor_treats_code_generation_as_gate_for_hep_ph(tmp_path, monkeypatch): | CODE |
| LOW | tests/test_hep_incremental.py | 452 | def test_prepare_workspace_non_incremental_unchanged(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 469 | def test_prepare_workspace_incremental_skipped_when_no_artifacts(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 619 | def test_version_rollback_stages_default_still_renames(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 633 | def test_executor_does_not_gate_code_generation_for_non_hep_ph(tmp_path, monkeypatch): | CODE |
| LOW⚡ | tests/test_web_scholar.py | 54 | def test_available_always_true(self): | CODE |
| LOW | tests/test_web_scholar.py | 80 | def test_parse_pub_string_authors(self): | CODE |
| LOW | tests/test_web_scholar.py | 95 | def test_parse_pub_missing_fields(self): | CODE |
| LOW | tests/test_web_scholar.py | 113 | def test_search_with_mocked_scholarly(self, mock_scholarly): | CODE |
| LOW | tests/test_web_scholar.py | 133 | def test_search_error_graceful(self, mock_scholarly): | CODE |
| LOW⚡ | tests/test_web_search.py | 51 | def test_parse_ddg_html_basic(self): | CODE |
| LOW⚡ | tests/test_web_search.py | 68 | def test_parse_ddg_html_skips_ddg_links(self): | STRING |
| LOW⚡ | tests/test_web_search.py | 77 | def test_parse_ddg_html_respects_limit(self): | STRING |
| LOW⚡ | tests/test_web_search.py | 92 | def test_search_ddg_fallback_no_api_key(self, mock_urlopen): | STRING |
| LOW | tests/test_web_search.py | 106 | def test_search_ddg_error_graceful(self, mock_urlopen): | STRING |
| LOW | tests/test_web_search.py | 114 | def test_search_tavily_with_mock(self): | STRING |
| LOW | tests/test_web_search.py | 142 | def test_search_multi_deduplication(self, mock_urlopen): | CODE |
| LOW⚡ | tests/test_rc_health.py | 66 | def test_check_python_version_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 72 | def test_check_python_version_fail() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 79 | def test_check_yaml_import_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 85 | def test_check_yaml_import_fail() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 92 | def test_check_config_valid_pass(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 99 | def test_check_config_invalid(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 107 | def test_check_config_missing_file(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 113 | def test_check_llm_connectivity_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 119 | def test_check_llm_connectivity_timeout() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 129 | def test_check_llm_connectivity_http_error() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 309 | def test_check_sandbox_python_exists() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 318 | def test_check_sandbox_python_missing() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 327 | def test_check_matplotlib_available() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 333 | def test_check_matplotlib_missing() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 340 | def test_check_experiment_mode_simulated() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 345 | def test_check_experiment_mode_sandbox() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 350 | def test_run_doctor_all_pass_openai(tmp_path: Path) -> None: | CODE |
| 1674 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/config/credentials_loader.py | 14 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 9 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 10 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 11 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 12 | CODE | |
| LOW | …arc_bench/baseline/adapters/ai_scientist_v2_adapter.py | 14 | CODE | |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 18 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 28 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 11 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 15 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 16 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 52 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/base.py | 20 | CODE | |
| LOW | …ts/arc_bench/baseline/adapters/researchclaw_adapter.py | 9 | CODE | |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 27 | CODE | |
| LOW | experiments/arc_bench/scripts/prepare_run.py | 9 | CODE | |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_manual.py | 28 | CODE | |
| LOW | experiments/arc_bench/scripts/run_bench.py | 16 | CODE | |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 19 | CODE | |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 18 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 17 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 22 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 36 | CODE | |
| LOW | experiments/arc_bench/scripts/_rename_t_to_ml.py | 18 | CODE | |
| LOW | experiments/arc_bench/scripts/_rename_t_to_ml.py | 22 | CODE | |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 13 | CODE | |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 14 | CODE | |
| LOW | tests/test_anthropic.py | 3 | CODE | |
| LOW | tests/test_hep_incremental.py | 3 | CODE | |
| LOW | tests/test_hep_incremental.py | 7 | CODE | |
| LOW | tests/test_hep_incremental.py | 363 | CODE | |
| LOW | tests/test_web_scholar.py | 3 | CODE | |
| LOW | tests/test_web_scholar.py | 6 | CODE | |
| LOW | tests/test_web_scholar.py | 8 | CODE | |
| LOW | tests/test_web_search.py | 3 | CODE | |
| LOW | tests/test_web_search.py | 7 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 3 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 5 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 6 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 8 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 8 | CODE | |
| LOW | tests/test_rc_health.py | 2 | CODE | |
| LOW | tests/test_overleaf.py | 3 | CODE | |
| LOW | tests/test_memory_system.py | 13 | CODE | |
| LOW | tests/test_memory_system.py | 15 | CODE | |
| LOW | tests/test_domain_detector.py | 3 | CODE | |
| LOW | tests/test_domain_detector.py | 5 | CODE | |
| LOW | tests/test_domain_detector.py | 6 | CODE | |
| LOW | tests/test_opencode_bridge.py | 3 | CODE | |
| LOW | tests/test_opencode_bridge.py | 7 | CODE | |
| LOW | tests/test_opencode_bridge.py | 10 | CODE | |
| LOW | tests/test_opencode_bridge.py | 13 | CODE | |
| LOW | tests/test_opencode_bridge.py | 13 | CODE | |
| LOW | tests/test_hitl_integration.py | 4 | CODE | |
| 699 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sentinel.sh | 75 | except Exception: | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 339 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 360 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 439 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 273 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 363 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 376 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 103 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 108 | except Exception: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 120 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 131 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 140 | except Exception: | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 228 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 263 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 443 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 704 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 723 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 231 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 268 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 254 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 274 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 277 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 296 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 305 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 115 | except Exception: | STRING |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 282 | except Exception as exc: # noqa: BLE001 | STRING |
| LOW | experiments/arc_bench/scripts/judge.py | 338 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 681 | except Exception: | CODE |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 69 | except Exception: | CODE |
| LOW | tests/test_v6_improvements.py | 660 | except Exception as e: | CODE |
| LOW | scripts/test_codegen_v2.py | 429 | except Exception: | CODE |
| LOW | scripts/test_codegen_v2.py | 575 | except Exception: | CODE |
| LOW | scripts/test_codegen_v2.py | 586 | except Exception: | CODE |
| LOW | researchclaw/config.py | 1724 | except Exception: | CODE |
| LOW | researchclaw/health.py | 752 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | researchclaw/evolution_aevolve.py | 230 | except Exception: | CODE |
| LOW | researchclaw/evolution_aevolve.py | 283 | except Exception: | CODE |
| LOW | researchclaw/evolution_aevolve.py | 332 | except Exception: | CODE |
| LOW | researchclaw/evolution.py | 560 | except Exception: | CODE |
| LOW | researchclaw/evolution.py | 593 | except Exception: | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 969 | print(f"Error: {e}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 986 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1948 | print(f"Error: --from-yaml file not found: {spec_path}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1954 | print(f"Error: could not parse {spec_path}: {exc}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1957 | print(f"Error: {spec_path} must be a YAML/JSON mapping.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2080 | print("Error: 'profile delete' requires a profile id.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2084 | print(f"Error: {err}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2088 | print(f"Error: profile '{profile_id}' not found.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2160 | print(f"Error: run directory not found: {run_dir}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 137 | print(f"Error: config file not found: {path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 529 | print(f"Error loading config: {exc}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 630 | print("Error: compare requires exactly 2 project names", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 691 | print(f"Error: run_dir not found: {run_dir}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 706 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 732 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 1121 | print(f"Error: no SKILL.md found in {source_path}") | CODE |
| MEDIUM | researchclaw/cli.py | 1126 | print(f"Error: failed to parse {skill_md}") | CODE |
| MEDIUM | researchclaw/cli.py | 1145 | print(f"Error: {path} not found") | CODE |
| MEDIUM | researchclaw/cli.py | 2019 | print(f"Error: {exc}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 2024 | print(f"Error: {exc}", file=sys.stderr) | CODE |
| 312 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/config/credentials_loader.py | 64 | __all__ = ["load_credentials"] | CODE |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 14 | __all__ = [ | CODE |
| LOW | tests/test_rc_runner.py | 648 | def _setup_stage_artifacts(run_dir: Path) -> None: | CODE |
| LOW | tests/test_hitl_branching.py | 30 | def _setup_pipeline(self, run_dir: Path, stages: int = 10) -> None: | CODE |
| LOW | researchclaw/health.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/evolution_aevolve.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/evolution.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/hardware.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/quality.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/report.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/subscriber.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/__init__.py | 13 | __all__ = [ | CODE |
| LOW | researchclaw/collaboration/dedup.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/publisher.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/repository.py | 11 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/paper_verifier.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/runner.py | 206 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/experiment_repair.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/verified_registry.py | 18 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/experiment_diagnosis.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/code_agent.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/requirements_judge.py | 51 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/opencode_bridge.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/_helpers.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/executor.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_analysis.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_code_generation.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_experiment_design.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_execution.py | 41 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_paper_writing.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/stage_impls/_literature.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_synthesis.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_topic.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/stage_impls/_review_publish.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/client.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/acp_client.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/anthropic_adapter.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/domains/detector.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/domains/detector.py | 40 | def set_forced_profile(profile_id: str) -> None: | CODE |
| LOW⚡ | researchclaw/domains/deploy.py | 39 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/domains/deploy.py | 244 | def _set_by_path(data: dict[str, Any], dotted: str, value: Any) -> None: | CODE |
| LOW | researchclaw/domains/deploy.py | 996 | __all__ = [ | STRING |
| LOW | researchclaw/domains/__init__.py | 10 | __all__ = ["DomainProfile", "detect_domain"] | CODE |
| LOW | researchclaw/domains/prompt_adapter.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/domains/adapters/generic.py | 9 | __all__ = ["GenericPromptAdapter"] | CODE |
| LOW | researchclaw/domains/adapters/__init__.py | 20 | __all__ = [ | CODE |
| LOW | researchclaw/calendar/deadlines.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/calendar/__init__.py | 7 | __all__ = [ | CODE |
| LOW⚡ | researchclaw/literature/arxiv_client.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/openalex_client.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/cache.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/__init__.py | 17 | __all__ = [ | CODE |
| LOW⚡ | researchclaw/literature/semantic_scholar.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/search.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/search.py | 307 | def _update_indices(p: Paper, idx: int) -> None: | CODE |
| LOW | researchclaw/literature/trends.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/literature/verify.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/literature/novelty.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/memory/store.py | 18 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/memory/experiment_memory.py | 12 | logger = logging.getLogger(__name__) | CODE |
| 144 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 340 | CODE | |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 98 | CODE | |
| LOW | experiments/arc_bench/scripts/prepare_run.py | 82 | CODE | |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 411 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_manual.py | 68 | CODE | |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 130 | CODE | |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 111 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 221 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 398 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 792 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 1046 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 52 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 83 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 142 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 206 | CODE | |
| LOW | tests/test_rc_cache.py | 100 | CODE | |
| LOW | tests/test_rc_cache.py | 147 | CODE | |
| LOW | tests/test_ssh_and_colab_sandbox.py | 295 | CODE | |
| LOW | tests/test_ssh_and_colab_sandbox.py | 310 | CODE | |
| LOW | tests/test_evolution_aevolve.py | 355 | CODE | |
| LOW | tests/test_evolution_aevolve.py | 375 | CODE | |
| LOW | tests/test_rc_e2e_regression.py | 148 | CODE | |
| LOW | scripts/test_code_agent_live.py | 192 | CODE | |
| LOW | scripts/test_codegen_v2.py | 269 | CODE | |
| LOW | scripts/test_codegen_v2.py | 411 | CODE | |
| LOW | scripts/test_codegen_v2.py | 446 | CODE | |
| LOW | scripts/test_codegen_v2.py | 543 | CODE | |
| LOW | scripts/test_codegen_v2.py | 602 | CODE | |
| LOW | researchclaw/config.py | 1079 | CODE | |
| LOW | researchclaw/health.py | 281 | CODE | |
| LOW | researchclaw/health.py | 304 | CODE | |
| LOW | researchclaw/evolution_aevolve.py | 188 | CODE | |
| LOW | researchclaw/evolution_aevolve.py | 358 | CODE | |
| LOW | researchclaw/evolution.py | 45 | CODE | |
| LOW | researchclaw/evolution.py | 247 | CODE | |
| LOW | researchclaw/evolution.py | 298 | CODE | |
| LOW | researchclaw/evolution.py | 453 | CODE | |
| LOW | researchclaw/cli.py | 50 | CODE | |
| LOW | researchclaw/cli.py | 156 | CODE | |
| LOW | researchclaw/cli.py | 594 | CODE | |
| LOW | researchclaw/cli.py | 1058 | CODE | |
| LOW | researchclaw/cli.py | 1481 | CODE | |
| LOW | researchclaw/cli.py | 1618 | CODE | |
| LOW | researchclaw/cli.py | 1850 | CODE | |
| LOW | researchclaw/report.py | 96 | CODE | |
| LOW | researchclaw/collaboration/repository.py | 75 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 371 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 390 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 484 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 126 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 154 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 209 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 346 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 431 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 915 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1357 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1475 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1597 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1629 | CODE | |
| LOW | researchclaw/pipeline/experiment_repair.py | 543 | CODE | |
| 163 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_v6_improvements.py | 592 | # Step 1: IMP-15 dedup | STRING |
| LOW | tests/test_v6_improvements.py | 606 | # Step 2: IMP-14 cite stripping | STRING |
| LOW | docs/integration-guide.md | 629 | #### Step 1: Install MetaClaw | COMMENT |
| LOW | docs/integration-guide.md | 638 | #### Step 2: Configure | COMMENT |
| LOW | docs/integration-guide.md | 655 | #### Step 3: Run | COMMENT |
| LOW | scripts/test_beast_mode_e2e.py | 177 | # Step 1: Complexity scoring | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 193 | # Step 2: Check OpenCode availability | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 201 | # Step 3: Create test workspace and invoke | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 243 | # Step 4: Evaluate results | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 286 | # Step 5: Quality evaluation | STRING |
| LOW⚡ | researchclaw/evolution_aevolve.py | 452 | # Step 1: Solve — evidence is already collected (lessons + results) | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 455 | # Step 2: Observe | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 462 | # Step 3: Evolve | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 471 | # Step 4: Gate | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 479 | # Step 5: Reload | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 198 | ## Step 1: Execute the phenomenology pipeline | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 201 | ## Step 2: Generate output figures | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1981 | # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1995 | # Step 2: Convert single-key brackets [key] → \cite{key} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2006 | # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b} | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 125 | # Step 1: Detect research domain | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 129 | # Step 2: Analyze available data | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 134 | # Step 3: Generate figure plan via LLM | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1349 | # Step 3: Escape special characters | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1359 | # Step 4: Restore protected regions | COMMENT |
| LOW | researchclaw/templates/converter.py | 1323 | # Step 1: Convert Python-style end-of-line comments → \COMMENT{...} | COMMENT |
| LOW | researchclaw/templates/converter.py | 1336 | # Step 2: Protect existing LaTeX commands and math mode from escaping | COMMENT |
| LOW | …stat_research_agent/agents/stat-experiment-designer.md | 29 | ### Step 1: Design Experiments | COMMENT |
| LOW | …stat_research_agent/agents/stat-experiment-designer.md | 42 | ### Step 2: Build Reproducible Code | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 57 | ### Step 3: Run Pilot Then Full Evaluation | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 62 | ### Step 4: Save Evidence | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 71 | ### Step 5: Write Experiment Summary | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 34 | ### Step 1: Formulation Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 44 | ### Step 2: Method Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 53 | ### Step 3: Theory Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 63 | ### Step 4: Experiment and Comparison Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 72 | ### Step 5: Final Result Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 81 | ### Step 6: Write Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 28 | ### Step 1: Read the Formulation | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 33 | ### Step 2: Propose Candidate Methods | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 43 | ### Step 3: Specify Method Mechanics | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-method-proposer.md | 54 | ### Step 4: Connect Methods to Claims | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-method-proposer.md | 59 | ### Step 5: Write Method Proposal | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 33 | ### Step 1: Write Paper-Style Report | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 48 | ### Step 2: Write README | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 58 | ### Step 3: Keep Claims Grounded | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 36 | ### Step 1: Extract the Scientific Question | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 46 | ### Step 2: Define Formal Objects | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 57 | ### Step 3: State Assumptions | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 68 | ### Step 4: Translate Hypotheses Into Testable Claims | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 78 | ### Step 5: Write Problem Formulation | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 29 | ### Step 1: Identify Theoretical Questions | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 40 | ### Step 2: Derive Main Properties | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 52 | ### Step 3: Derive Experimental Predictions | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 61 | ### Step 4: Write Theory Analysis | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 31 | ### Step 1: Load Evidence | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 35 | ### Step 2: Compare Methods | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 45 | ### Step 3: Interpret Disagreements | COMMENT |
| LOW | …/stat_research_agent/agents/stat-comparison-analyst.md | 56 | ### Step 4: Produce Figures and Tables | COMMENT |
| LOW | …/stat_research_agent/agents/stat-comparison-analyst.md | 65 | ### Step 5: Write Claim Verdicts | COMMENT |
| 38 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | config.researchclaw.example.yaml | 41 | api_key_env: "OPENAI_API_KEY" | COMMENT |
| LOW | config.researchclaw.example.yaml | 141 | # experiment: | COMMENT |
| LOW | config.researchclaw.example.yaml | 161 | # | COMMENT |
| LOW | prompts.default.yaml | 1 | # ============================================================================= | COMMENT |
| LOW | sentinel.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/config/statistics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML11.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML07.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML06.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML10.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML21.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML17.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML01.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML16.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML20.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML19.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML23.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML03.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML15.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML14.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML02.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML22.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML18.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML05.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML13.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML09.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML25.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML24.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML08.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML12.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML04.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/physics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P01.yaml | 81 | COMMENT | |
| LOW | experiments/arc_bench/config/physics/manifests/P06.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P10.yaml | 81 | - process_id: "mumu_to_bbbar_U1_3and14tev" | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P07.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P08.yaml | 81 | # Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judge | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P04.yaml | 81 | # Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judge | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P05.yaml | 81 | rubric_path: "experiments/arc_bench/config/physics/rubrics/P05.json" | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P09.yaml | 81 | gpu_required: false | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P02.yaml | 81 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P03.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/quantum/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/quantum/manifests/Q08.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/quantum/manifests/Q05.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 101 | ) | COMMENT |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 121 | # *internal control-flow pathologies* (lit-review SUMMARY-loop never | COMMENT |
| LOW | experiments/arc_bench/scripts/judge_paper_manual.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/run_agent_lab.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/run_aide.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/judge.py | 821 | # BUG-FIX: Prefer `<primary>_mean` over the single-value | COMMENT |
| LOW | experiments/arc_bench/scripts/run_ais_v2.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 101 | ), | COMMENT |
| LOW | tests/test_rc_contracts.py | 101 | COMMENT | |
| LOW | docs/DOMAIN_INTEGRATION_GUIDE.md | 121 | # Only set this if you added a LAYER 5 sandbox + EXPERIMENT_MODE. | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_literature.py | 841 | # IMP-21: Defensive gate — refuse to run on an empty/missing shortlist. | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2201 | if _uv_is_strict or _uv.in_table: | COMMENT |
| LOW | researchclaw/docker/entrypoint.sh | 1 | #!/bin/bash | COMMENT |
| LOW | researchclaw/domains/deploy.py | 801 | # without cluttering the live config. | COMMENT |
| LOW | researchclaw/data/benchmark_knowledge.yaml | 1 | # BenchmarkAgent Knowledge Base | COMMENT |
| 2 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | config.researchclaw.example.yaml | 173 | # 4. Colab via Google Drive (most robust, no SSH needed): | COMMENT |
| MEDIUM | experiments/arc_bench/scripts/run_ais_v2.py | 476 | # encode the ablation axis levels, e.g. "scaler = robust"). | COMMENT |
| MEDIUM | experiments/arc_bench/scripts/run_bench.py | 38 | # Paper-replication harness we reuse. We import the finalizer directly; the | COMMENT |
| MEDIUM⚡ | tests/test_hep_incremental.py | 404 | """The _merge_docs helper is robust to None / non-dict inputs.""" | STRING |
| MEDIUM | tests/test_hitl_branching.py | 177 | (s7 / "synthesis.md").write_text("# Synthesis\nGap: no robust evaluation") | CODE |
| MEDIUM⚡ | tests/test_rc_executor.py | 2680 | # Check that harness was injected (BUG-DA8-06: dir is now _project_{N}) | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 2704 | # The real harness should be there, not the fake one (BUG-DA8-06) | COMMENT |
| MEDIUM⚡ | scripts/test_codegen_v2.py | 266 | # Code quality analysis (comprehensive) | STRING |
| MEDIUM | researchclaw/domains/detector.py | 96 | # Experiment paradigm | COMMENT |
| MEDIUM | researchclaw/agents/benchmark_agent/acquirer.py | 29 | """Ask LLM to generate a robust data loading function.""" | STRING |
| MEDIUM⚡ | researchclaw/experiment/validator.py | 198 | # Runtime-injected by the experiment harness | COMMENT |
| MEDIUM | researchclaw/experiment/harness_template.py | 110 | # Convenience: create a default harness when imported | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 384 | # R5-4: Inject immutable experiment harness before copying project files | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 387 | # Copy all project files (will NOT overwrite harness — harness name is unique) | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 391 | # Do not allow project to overwrite the harness | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 130 | # Inject experiment harness | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 159 | # Inject harness first (immutable) | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 162 | # Copy project files and subdirectories (skip harness overwrite) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_rc_novelty.py | 237 | # Create a mock paper with overlapping keywords | COMMENT |
| MEDIUM | tests/test_rc_cli.py | 375 | # Create a fake previous run directory with a checkpoint | COMMENT |
| MEDIUM⚡ | tests/test_experiment_repair.py | 649 | # Create a rich existing stage-14 summary | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 2673 | # Create a project dir | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 2696 | # Create a project with a fake experiment_harness.py | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 2729 | # Create a run with very long stdout | COMMENT |
| MEDIUM⚡ | tests/test_fabrication_guards.py | 174 | # Create a failed experiment_summary.json | COMMENT |
| MEDIUM⚡ | tests/test_evolution_aevolve.py | 358 | # Create a fake .claude/skills/test-skill/SKILL.md | COMMENT |
| MEDIUM | researchclaw/llm/acp_client.py | 141 | # Create the session | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 812 | # This file is a domain blueprint. Dropping it into one of the profile | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | README.md | 73 | - **[03/30/2026]** **Flexible Skill Loading** — AutoResearchClaw now supports loading open-source and custom skills from | CODE |
| MEDIUM | experiments/arc_bench/README.md | 31 | │ │ # (paper-content / code-orchestration / | CODE |
| MEDIUM | experiments/arc_bench/baseline/adapters/aide_adapter.py | 75 | # not embed any phase-specific scaffolding into goal/eval". Kept as | COMMENT |
| MEDIUM | experiments/arc_bench/baseline/interventions/T02.json | 9 | "guidance": "- **Canonical result table first**: create one long-form DataFrame with columns `[dataset, noise_leve | CODE |
| MEDIUM⚡ | tests/test_web_integration.py | 100 | # WebSearchAgent — orchestration | COMMENT |
| MEDIUM | docs/DOMAIN_INTEGRATION_GUIDE.md | 148 | # ── Code-gen file scaffold (consumed by adapter.get_blueprint_context) ──── | COMMENT |
| MEDIUM | docs/HITL_GUIDE.md | 17 | 9. [Safety & Guardrails](#9-safety--guardrails) | CODE |
| MEDIUM | researchclaw/evolution.py | 85 | PIPELINE = "pipeline" # Stage orchestration issues | CODE |
| MEDIUM | researchclaw/pipeline/code_agent.py | 1119 | # Extract context window: ±30 lines around error | COMMENT |
| MEDIUM | researchclaw/pipeline/stage_impls/_analysis.py | 657 | # Try FigureAgent first (multi-agent intelligent charts), fall back to visualize.py | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_code_generation.py | 737 | # for internal chain-of-thought). Retry once with even higher limit on empty. | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_code_generation.py | 1223 | # real orchestration (more lines + __main__ guard), prefer it | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_synthesis.py | 117 | # instead of sending empty context to the LLM (pure hallucination). | STRING |
| MEDIUM | researchclaw/domains/deploy.py | 195 | # Nested-block fields: entire sub-dicts (e.g. collider_agent, agentic, | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 327 | # 3. Nested experiment sub-blocks (collider_agent, agentic, ...). | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 962 | # Strip None/empty entries before scaffolding so the rendered YAML | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_v6_improvements.py | 592 | # Step 1: IMP-15 dedup | STRING |
| LOW | tests/test_v6_improvements.py | 606 | # Step 2: IMP-14 cite stripping | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 177 | # Step 1: Complexity scoring | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 193 | # Step 2: Check OpenCode availability | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 201 | # Step 3: Create test workspace and invoke | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 243 | # Step 4: Evaluate results | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 286 | # Step 5: Quality evaluation | STRING |
| LOW⚡ | researchclaw/evolution_aevolve.py | 452 | # Step 1: Solve — evidence is already collected (lessons + results) | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 455 | # Step 2: Observe | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 462 | # Step 3: Evolve | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 471 | # Step 4: Gate | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 479 | # Step 5: Reload | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 198 | ## Step 1: Execute the phenomenology pipeline | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 201 | ## Step 2: Generate output figures | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1981 | # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1995 | # Step 2: Convert single-key brackets [key] → \cite{key} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2006 | # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b} | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 125 | # Step 1: Detect research domain | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 129 | # Step 2: Analyze available data | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 134 | # Step 3: Generate figure plan via LLM | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1349 | # Step 3: Escape special characters | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1359 | # Step 4: Restore protected regions | COMMENT |
| LOW | researchclaw/templates/converter.py | 1323 | # Step 1: Convert Python-style end-of-line comments → \COMMENT{...} | COMMENT |
| LOW | researchclaw/templates/converter.py | 1336 | # Step 2: Protect existing LaTeX commands and math mode from escaping | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | config.researchclaw.example.yaml | 120 | use_docker: false # Set true to run experiments inside Docker on remote host | CODE |
| LOW | sentinel.sh | 108 | # Check if any child processes exist | COMMENT |
| LOW | scripts/test_code_agent_sandbox.py | 240 | # Write files | COMMENT |
| LOW⚡ | scripts/test_codegen_v2.py | 453 | # Write files | COMMENT |
| LOW | scripts/test_codegen_v2.py | 731 | # Write files | COMMENT |
| LOW | researchclaw/hardware.py | 257 | # Check if already installed | COMMENT |
| LOW | researchclaw/pipeline/runner.py | 685 | # Check if repair loop should run | COMMENT |
| LOW | researchclaw/pipeline/runner.py | 1672 | # Check if we've met quality threshold | COMMENT |
| LOW | researchclaw/pipeline/experiment_diagnosis.py | 205 | # Check if only 1 condition | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 416 | # Check if value needs quoting: | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 805 | # Check if importing from a local module that exists | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 1413 | # Write files to a numbered attempt directory | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_execution.py | 1028 | # Check if stdout contains condition labels | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_literature.py | 253 | # Check if query ends with a known search suffix | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 916 | # Check if this looks like a results/experiment table | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1139 | # Check if we're leaving Results for a different top-level section | COMMENT |
| LOW | researchclaw/agents/figure_agent/renderer.py | 228 | # Check if it was saved relative to script CWD | COMMENT |
| LOW | researchclaw/agents/figure_agent/critic.py | 231 | # Check if script contains the expected values | COMMENT |
| LOW | researchclaw/experiment/validator.py | 657 | # Check if this class inherits from another class in the same file | COMMENT |
| LOW | researchclaw/experiment/validator.py | 686 | # Check if all overridden methods have identical AST to parent | COMMENT |
| LOW | researchclaw/experiment/validator.py | 760 | # Check if this variable is used later in the function | COMMENT |
| LOW | researchclaw/templates/converter.py | 1022 | # Check if previous line is a table caption (e.g. **Table 1: ...**) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | experiments/arc_bench/scripts/_inject_p_requirements.py | 132 | results.json metrics MUST contain at least 3 numeric (non-null, finite) | CODE |
| HIGH | researchclaw/servers/monitor.py | 24 | result = await _ssh_command(server.host, "nvidia-smi --query-gpu=utilization.gpu,memory.used,memory.total -- | CODE |
| HIGH | researchclaw/servers/slurm_executor.py | 92 | f"squeue -j {job_id} -h -o '%T' 2>/dev/null || sacct -j {job_id} -n -o State -P 2>/dev/null", | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | researchclaw/report.py | 16 | Generate a Markdown report from a pipeline run directory. Args: run_dir: Path to the run artifacts director | STRING |
| HIGH | researchclaw/memory/store.py | 92 | Add a new memory entry. Args: category: One of "ideation", "experiment", "writing". con | STRING |
| HIGH | researchclaw/hitl/workshops/paper.py | 84 | AI writes a section draft. Args: section_name: Name of the section. context: Relevant c | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sentinel.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/judge_paper_manual.sh | 25 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_agent_lab.sh | 12 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_aide.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_ais_v2.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_rc_full.sh | 6 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_rc_copilot.sh | 8 | # Usage: | COMMENT |
| LOW | scripts/metaclaw_start.sh | 4 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/test_rc_quality.py | 80 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit." | CODE |
| LOW⚡ | tests/test_rc_quality.py | 80 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit." | CODE |
| LOW⚡ | tests/test_rc_quality.py | 82 | assert any("Lorem ipsum" in m.pattern_desc for m in matches) | CODE |
| LOW | tests/test_rc_literature.py | 68 | {"authorId": "2", "name": "John Doe"}, | CODE |
| LOW | tests/test_rc_executor.py | 36 | base_url="http://fake", api_key="fake-key" | CODE |
| LOW⚡ | tests/test_rc_templates.py | 502 | tex = markdown_to_latex(self.SAMPLE_MD, NEURIPS_2024, authors="Jane Doe") | CODE |
| LOW⚡ | tests/test_decision_agent.py | 301 | _FakeLLM(), gemini_api_key="fake-key", use_sdk=False, | CODE |
| LOW⚡ | tests/test_decision_agent.py | 640 | api_key="fake-key", | CODE |
| LOW | tests/test_decision_agent.py | 677 | api_key="fake-key", | CODE |
| LOW | researchclaw/quality.py | 23 | (r"(?i)lorem\s+ipsum", "Lorem ipsum filler"), | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 54 | CODE | |
| LOW | tests/test_servers.py | 21 | CODE | |
| LOW | researchclaw/pipeline/executor.py | 821 | CODE | |
| LOW | researchclaw/literature/verify.py | 974 | CODE | |
| LOW | researchclaw/agents/benchmark_agent/surveyor.py | 240 | CODE | |
| LOW | researchclaw/servers/registry.py | 14 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/test_opencode_bridge.py | 298 | (src / "utils.py").write_text("def helper(): pass") | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 511 | "utils.py": "def helper(): pass\n", | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 517 | files = {"utils.py": "def helper(): pass\n"} | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 581 | "utils.py": "def helper(): pass\n", | CODE |
| LOW | researchclaw/servers/dispatcher.py | 67 | async def execute_task(self, task_id: str) -> dict[str, Any]: | CODE |