Repository Analysis

aiming-lab/AutoResearchClaw

Fully autonomous & self-evolving research from idea to paper. Chat an Idea. Get a Paper. 🦞

54.7 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of aiming-lab/AutoResearchClaw, a Python project with 13,799 GitHub stars. SynthScan v2.0 examined 171,220 lines of code across 699 source files, recording 5268 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 54.7 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

54.7
Adjusted Score
54.7
Raw Score
100%
Time Factor
2026-07-13
Last Push
13.8K
Stars
Python
Language
171.2K
Lines of Code
699
Files
5.3K
Pattern Hits
2026-07-14
Scan Date
0.01
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 6MEDIUM 1766LOW 3496

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 5268 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators1691 hits · 5896 pts
SeverityFileLineSnippetContext
MEDIUMconfig.researchclaw.example.yaml136# ============================================================================COMMENT
MEDIUMconfig.researchclaw.example.yaml138# ============================================================================COMMENT
MEDIUMprompts.default.yaml1# =============================================================================COMMENT
MEDIUMprompts.default.yaml3# =============================================================================COMMENT
MEDIUMprompts.default.yaml16# =============================================================================COMMENT
MEDIUMrun_hep_pipeline.sh7# ── API credentials ──────────────────────────────────────────────COMMENT
MEDIUMrun_hep_pipeline.sh15# ── Anthropic (for claude CLI subprocess — ColliderAgent) ────────COMMENT
MEDIUMexperiments/arc_bench/config/base_config.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/base_config.yaml5# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/statistics/topics.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/statistics/topics.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/statistics/topics.yaml15# ============================================================================COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S03.yaml131# ---------------------------------------------------------------------------COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S03.yaml138# ---------------------------------------------------------------------------COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S02.yaml133# ---------------------------------------------------------------------------COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S02.yaml142# ---------------------------------------------------------------------------COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S01.yaml96# ---------------------------------------------------------------------------COMMENT
MEDIUM…riments/arc_bench/config/statistics/manifests/S01.yaml103# ---------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/topics.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/topics.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/topics.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML11.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML11.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML11.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML07.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML07.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML07.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML06.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML06.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML06.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML10.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML10.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML10.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML21.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML21.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML21.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML17.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML17.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML17.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML01.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML01.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML01.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML16.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML16.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML16.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML20.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML20.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML20.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML19.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML19.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML19.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML23.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML23.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML23.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML03.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML03.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML03.yaml8# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML15.yaml1# ============================================================================COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML15.yaml3# ----------------------------------------------------------------------------COMMENT
MEDIUMexperiments/arc_bench/config/ml/manifests/ML15.yaml8# ============================================================================COMMENT
1631 more matches not shown…
Hyper-Verbose Identifiers1734 hits · 1615 pts
SeverityFileLineSnippetContext
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py407def _read_agent_lab_artifacts(run_dir: Path) -> StandardArtifacts:CODE
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py169 def _materialize_stub_data_dir(self, topic: dict, target: Path) -> None:CODE
LOWexperiments/arc_bench/baseline/adapters/base.py86 def _write_standard_artifacts(CODE
LOWexperiments/arc_bench/scripts/run_baseline.py98def _build_submission_from_adapter(artifacts_native: Path, submission_dir: Path,CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py282def _metrics_from_metric_value(metric_value: dict) -> dict[str, float]:CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py327def _pivot_per_condition_from_entry(entry: dict) -> dict[str, dict[str, float]]:CODE
LOWexperiments/arc_bench/scripts/judge.py360def _format_leaves_for_prompt(leaves: list[dict[str, Any]]) -> str:CODE
LOWexperiments/arc_bench/scripts/judge.py747def _locate_experiment_summary(run_dir: Path, topic_id: str) -> Path | None:CODE
LOWexperiments/arc_bench/scripts/judge_results_only.py118def _read_agent_lab_canonical(run_dir: Path) -> dict[str, Any]:CODE
LOWtests/test_hep_incremental.py12def test_collider_agent_config_has_incremental_field_default_false():CODE
LOWtests/test_hep_incremental.py18def test_collider_agent_config_incremental_can_be_enabled():CODE
LOWtests/test_hep_incremental.py23def test_run_subparser_accepts_incremental_experiment_flag():CODE
LOWtests/test_hep_incremental.py36def test_run_subparser_incremental_experiment_default_false():CODE
LOWtests/test_hep_incremental.py49def test_gate_required_returns_true_for_code_generation_when_profile_is_hep_ph():CODE
LOWtests/test_hep_incremental.py55def test_gate_required_returns_false_for_code_generation_without_profile():CODE
LOWtests/test_hep_incremental.py63def test_gate_required_unaffected_for_existing_gates_when_profile_is_passed():CODE
LOWtests/test_hep_incremental.py71def test_default_rollback_for_code_generation_is_experiment_design():CODE
LOWtests/test_hep_incremental.py82def test_code_generation_contract_has_collider_alternate_output():CODE
LOWtests/test_hep_incremental.py208def test_incremental_snapshot_warns_when_cumulative_footprint_exceeds_threshold(CODE
LOWtests/test_hep_incremental.py327def test_sandbox_merges_results_json_in_incremental_mode(tmp_path, monkeypatch):CODE
LOWtests/test_hep_incremental.py403def test_merge_docs_static_logic_handles_missing_snapshots():CODE
LOWtests/test_hep_incremental.py417def test_prepare_workspace_in_incremental_mode_assembles_delta_prompt(tmp_path):CODE
LOWtests/test_hep_incremental.py596def test_version_rollback_stages_uses_copytree_when_incremental(tmp_path):CODE
LOWtests/test_hep_incremental.py134def test_select_output_files_picks_collider_mode_alternate(tmp_path):CODE
LOWtests/test_hep_incremental.py145def test_select_output_files_keeps_default_for_non_collider_mode(tmp_path):CODE
LOWtests/test_hep_incremental.py157def test_select_output_files_handles_none_contract():CODE
LOWtests/test_hep_incremental.py163def test_executor_treats_code_generation_as_gate_for_hep_ph(tmp_path, monkeypatch):CODE
LOWtests/test_hep_incremental.py452def test_prepare_workspace_non_incremental_unchanged(tmp_path):CODE
LOWtests/test_hep_incremental.py469def test_prepare_workspace_incremental_skipped_when_no_artifacts(tmp_path):CODE
LOWtests/test_hep_incremental.py619def test_version_rollback_stages_default_still_renames(tmp_path):CODE
LOWtests/test_hep_incremental.py633def test_executor_does_not_gate_code_generation_for_non_hep_ph(tmp_path, monkeypatch):CODE
LOWtests/test_web_scholar.py54 def test_available_always_true(self):CODE
LOWtests/test_web_scholar.py80 def test_parse_pub_string_authors(self):CODE
LOWtests/test_web_scholar.py95 def test_parse_pub_missing_fields(self):CODE
LOWtests/test_web_scholar.py113 def test_search_with_mocked_scholarly(self, mock_scholarly):CODE
LOWtests/test_web_scholar.py133 def test_search_error_graceful(self, mock_scholarly):CODE
LOWtests/test_web_search.py51 def test_parse_ddg_html_basic(self):CODE
LOWtests/test_web_search.py68 def test_parse_ddg_html_skips_ddg_links(self):STRING
LOWtests/test_web_search.py77 def test_parse_ddg_html_respects_limit(self):STRING
LOWtests/test_web_search.py92 def test_search_ddg_fallback_no_api_key(self, mock_urlopen):STRING
LOWtests/test_web_search.py106 def test_search_ddg_error_graceful(self, mock_urlopen):STRING
LOWtests/test_web_search.py114 def test_search_tavily_with_mock(self):STRING
LOWtests/test_web_search.py142 def test_search_multi_deduplication(self, mock_urlopen):CODE
LOWtests/test_rc_health.py66def test_check_python_version_pass() -> None:CODE
LOWtests/test_rc_health.py72def test_check_python_version_fail() -> None:CODE
LOWtests/test_rc_health.py79def test_check_yaml_import_pass() -> None:CODE
LOWtests/test_rc_health.py85def test_check_yaml_import_fail() -> None:CODE
LOWtests/test_rc_health.py92def test_check_config_valid_pass(tmp_path: Path) -> None:CODE
LOWtests/test_rc_health.py99def test_check_config_invalid(tmp_path: Path) -> None:CODE
LOWtests/test_rc_health.py107def test_check_config_missing_file(tmp_path: Path) -> None:CODE
LOWtests/test_rc_health.py113def test_check_llm_connectivity_pass() -> None:CODE
LOWtests/test_rc_health.py119def test_check_llm_connectivity_timeout() -> None:CODE
LOWtests/test_rc_health.py129def test_check_llm_connectivity_http_error() -> None:CODE
LOWtests/test_rc_health.py309def test_check_sandbox_python_exists() -> None:CODE
LOWtests/test_rc_health.py318def test_check_sandbox_python_missing() -> None:CODE
LOWtests/test_rc_health.py327def test_check_matplotlib_available() -> None:CODE
LOWtests/test_rc_health.py333def test_check_matplotlib_missing() -> None:CODE
LOWtests/test_rc_health.py340def test_check_experiment_mode_simulated() -> None:CODE
LOWtests/test_rc_health.py345def test_check_experiment_mode_sandbox() -> None:CODE
LOWtests/test_rc_health.py350def test_run_doctor_all_pass_openai(tmp_path: Path) -> None:CODE
1674 more matches not shown…
Unused Imports759 hits · 640 pts
SeverityFileLineSnippetContext
LOWexperiments/arc_bench/config/credentials_loader.py14CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py8CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py8CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py8CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py9CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py10CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py11CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py12CODE
LOW…arc_bench/baseline/adapters/ai_scientist_v2_adapter.py14CODE
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py18CODE
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py28CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py11CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py15CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py16CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py52CODE
LOWexperiments/arc_bench/baseline/adapters/base.py20CODE
LOW…ts/arc_bench/baseline/adapters/researchclaw_adapter.py9CODE
LOWexperiments/arc_bench/scripts/run_baseline.py27CODE
LOWexperiments/arc_bench/scripts/prepare_run.py9CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py24CODE
LOWexperiments/arc_bench/scripts/run_e2e_topic.py24CODE
LOWexperiments/arc_bench/scripts/judge_manual.py28CODE
LOWexperiments/arc_bench/scripts/run_bench.py16CODE
LOWexperiments/arc_bench/scripts/hitl_suggestor.py19CODE
LOWexperiments/arc_bench/scripts/make_manifests.py24CODE
LOWexperiments/arc_bench/scripts/judge.py18CODE
LOWexperiments/arc_bench/scripts/evaluate.py17CODE
LOWexperiments/arc_bench/scripts/evaluate.py22CODE
LOWexperiments/arc_bench/scripts/judge_results_only.py36CODE
LOWexperiments/arc_bench/scripts/_rename_t_to_ml.py18CODE
LOWexperiments/arc_bench/scripts/_rename_t_to_ml.py22CODE
LOWexperiments/arc_bench/scripts/_inject_p_requirements.py13CODE
LOWexperiments/arc_bench/scripts/_inject_p_requirements.py14CODE
LOWtests/test_anthropic.py3CODE
LOWtests/test_hep_incremental.py3CODE
LOWtests/test_hep_incremental.py7CODE
LOWtests/test_hep_incremental.py363CODE
LOWtests/test_web_scholar.py3CODE
LOWtests/test_web_scholar.py6CODE
LOWtests/test_web_scholar.py8CODE
LOWtests/test_web_search.py3CODE
LOWtests/test_web_search.py7CODE
LOWtests/test_convergence_evaluator.py3CODE
LOWtests/test_convergence_evaluator.py5CODE
LOWtests/test_convergence_evaluator.py6CODE
LOWtests/test_convergence_evaluator.py8CODE
LOWtests/test_convergence_evaluator.py8CODE
LOWtests/test_rc_health.py2CODE
LOWtests/test_overleaf.py3CODE
LOWtests/test_memory_system.py13CODE
LOWtests/test_memory_system.py15CODE
LOWtests/test_domain_detector.py3CODE
LOWtests/test_domain_detector.py5CODE
LOWtests/test_domain_detector.py6CODE
LOWtests/test_opencode_bridge.py3CODE
LOWtests/test_opencode_bridge.py7CODE
LOWtests/test_opencode_bridge.py10CODE
LOWtests/test_opencode_bridge.py13CODE
LOWtests/test_opencode_bridge.py13CODE
LOWtests/test_hitl_integration.py4CODE
699 more matches not shown…
Excessive Try-Catch Wrapping372 hits · 347 pts
SeverityFileLineSnippetContext
LOWsentinel.sh75except Exception:CODE
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py339 except Exception as exc: # noqa: BLE001CODE
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py360 except Exception as exc: # noqa: BLE001CODE
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py439 except Exception: # noqa: BLE001CODE
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py273 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py363 except Exception: # noqa: BLE001CODE
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py376 except Exception: # noqa: BLE001CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py103 except Exception as exc:CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py108 except Exception:CODE
LOWexperiments/arc_bench/baseline/adapters/_aide_runner.py120 except Exception as exc:CODE
LOWexperiments/arc_bench/scripts/run_baseline.py131 except Exception: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_baseline.py140 except Exception:CODE
LOWexperiments/arc_bench/scripts/run_baseline.py228 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_baseline.py263 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py443 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py704 except Exception as exc:CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py723 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_e2e_topic.py231 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_e2e_topic.py268 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_bench.py254 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_bench.py274 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_bench.py277 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_bench.py296 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/run_bench.py305 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/hitl_suggestor.py115 except Exception:STRING
LOWexperiments/arc_bench/scripts/make_manifests.py282 except Exception as exc: # noqa: BLE001STRING
LOWexperiments/arc_bench/scripts/judge.py338 except Exception as exc: # noqa: BLE001CODE
LOWexperiments/arc_bench/scripts/judge.py681 except Exception:CODE
LOWexperiments/arc_bench/scripts/judge_results_only.py69 except Exception:CODE
LOWtests/test_v6_improvements.py660 except Exception as e:CODE
LOWscripts/test_codegen_v2.py429 except Exception:CODE
LOWscripts/test_codegen_v2.py575 except Exception:CODE
LOWscripts/test_codegen_v2.py586 except Exception:CODE
LOWresearchclaw/config.py1724 except Exception:CODE
LOWresearchclaw/health.py752 except Exception as exc: # noqa: BLE001CODE
LOWresearchclaw/evolution_aevolve.py230 except Exception:CODE
LOWresearchclaw/evolution_aevolve.py283 except Exception:CODE
LOWresearchclaw/evolution_aevolve.py332 except Exception:CODE
LOWresearchclaw/evolution.py560 except Exception:CODE
LOWresearchclaw/evolution.py593 except Exception:CODE
MEDIUMresearchclaw/cli.py969 print(f"Error: {e}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py986 print(f"Error: config file not found: {config_path}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py1948 print(f"Error: --from-yaml file not found: {spec_path}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py1954 print(f"Error: could not parse {spec_path}: {exc}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py1957 print(f"Error: {spec_path} must be a YAML/JSON mapping.", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py2080 print("Error: 'profile delete' requires a profile id.", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py2084 print(f"Error: {err}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py2088 print(f"Error: profile '{profile_id}' not found.", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py2160 print(f"Error: run directory not found: {run_dir}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py137 print(f"Error: config file not found: {path}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py529 print(f"Error loading config: {exc}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py630 print("Error: compare requires exactly 2 project names", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py691 print(f"Error: run_dir not found: {run_dir}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py706 print(f"Error: config file not found: {config_path}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py732 print(f"Error: config file not found: {config_path}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py1121 print(f"Error: no SKILL.md found in {source_path}")CODE
MEDIUMresearchclaw/cli.py1126 print(f"Error: failed to parse {skill_md}")CODE
MEDIUMresearchclaw/cli.py1145 print(f"Error: {path} not found")CODE
MEDIUMresearchclaw/cli.py2019 print(f"Error: {exc}", file=sys.stderr)CODE
MEDIUMresearchclaw/cli.py2024 print(f"Error: {exc}", file=sys.stderr)CODE
312 more matches not shown…
Modern Structural Boilerplate204 hits · 212 pts
SeverityFileLineSnippetContext
LOWexperiments/arc_bench/config/credentials_loader.py64__all__ = ["load_credentials"]CODE
LOWexperiments/arc_bench/baseline/adapters/__init__.py14__all__ = [CODE
LOWtests/test_rc_runner.py648def _setup_stage_artifacts(run_dir: Path) -> None:CODE
LOWtests/test_hitl_branching.py30 def _setup_pipeline(self, run_dir: Path, stages: int = 10) -> None:CODE
LOWresearchclaw/health.py23logger = logging.getLogger(__name__)CODE
LOWresearchclaw/evolution_aevolve.py31logger = logging.getLogger(__name__)CODE
LOWresearchclaw/evolution.py37logger = logging.getLogger(__name__)CODE
LOWresearchclaw/hardware.py10logger = logging.getLogger(__name__)CODE
LOWresearchclaw/quality.py13logger = logging.getLogger(__name__)CODE
LOWresearchclaw/report.py12logger = logging.getLogger(__name__)CODE
LOWresearchclaw/collaboration/subscriber.py10logger = logging.getLogger(__name__)CODE
LOWresearchclaw/collaboration/__init__.py13__all__ = [CODE
LOWresearchclaw/collaboration/dedup.py9logger = logging.getLogger(__name__)CODE
LOWresearchclaw/collaboration/publisher.py12logger = logging.getLogger(__name__)CODE
LOWresearchclaw/collaboration/repository.py11logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/paper_verifier.py20logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/runner.py206logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/experiment_repair.py32logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/verified_registry.py18logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/experiment_diagnosis.py20logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/code_agent.py34logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/requirements_judge.py51logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/opencode_bridge.py28logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/_helpers.py26logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/executor.py37logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_analysis.py31logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_code_generation.py36logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_experiment_design.py30logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_execution.py41logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_paper_writing.py37logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_literature.py34logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_synthesis.py26logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_topic.py25logger = logging.getLogger(__name__)CODE
LOWresearchclaw/pipeline/stage_impls/_review_publish.py40logger = logging.getLogger(__name__)CODE
LOWresearchclaw/llm/client.py23logger = logging.getLogger(__name__)CODE
LOWresearchclaw/llm/acp_client.py27logger = logging.getLogger(__name__)CODE
LOWresearchclaw/llm/anthropic_adapter.py15logger = logging.getLogger(__name__)CODE
LOWresearchclaw/domains/detector.py25logger = logging.getLogger(__name__)CODE
LOWresearchclaw/domains/detector.py40def set_forced_profile(profile_id: str) -> None:CODE
LOWresearchclaw/domains/deploy.py39logger = logging.getLogger(__name__)CODE
LOWresearchclaw/domains/deploy.py244def _set_by_path(data: dict[str, Any], dotted: str, value: Any) -> None:CODE
LOWresearchclaw/domains/deploy.py996__all__ = [STRING
LOWresearchclaw/domains/__init__.py10__all__ = ["DomainProfile", "detect_domain"]CODE
LOWresearchclaw/domains/prompt_adapter.py23logger = logging.getLogger(__name__)CODE
LOWresearchclaw/domains/adapters/generic.py9__all__ = ["GenericPromptAdapter"]CODE
LOWresearchclaw/domains/adapters/__init__.py20__all__ = [CODE
LOWresearchclaw/calendar/deadlines.py13logger = logging.getLogger(__name__)CODE
LOWresearchclaw/calendar/__init__.py7__all__ = [CODE
LOWresearchclaw/literature/arxiv_client.py33logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/openalex_client.py33logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/cache.py17logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/__init__.py17__all__ = [CODE
LOWresearchclaw/literature/semantic_scholar.py32logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/search.py32logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/search.py307 def _update_indices(p: Paper, idx: int) -> None:CODE
LOWresearchclaw/literature/trends.py8logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/verify.py36logger = logging.getLogger(__name__)CODE
LOWresearchclaw/literature/novelty.py29logger = logging.getLogger(__name__)CODE
LOWresearchclaw/memory/store.py18logger = logging.getLogger(__name__)CODE
LOWresearchclaw/memory/experiment_memory.py12logger = logging.getLogger(__name__)CODE
144 more matches not shown…
Deep Nesting223 hits · 183 pts
SeverityFileLineSnippetContext
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py340CODE
LOWexperiments/arc_bench/scripts/run_baseline.py98CODE
LOWexperiments/arc_bench/scripts/prepare_run.py82CODE
LOWexperiments/arc_bench/scripts/run_ais_v2.py411CODE
LOWexperiments/arc_bench/scripts/judge_manual.py68CODE
LOWexperiments/arc_bench/scripts/hitl_suggestor.py130CODE
LOWexperiments/arc_bench/scripts/make_manifests.py111CODE
LOWexperiments/arc_bench/scripts/judge.py221CODE
LOWexperiments/arc_bench/scripts/judge.py398CODE
LOWexperiments/arc_bench/scripts/judge.py792CODE
LOWexperiments/arc_bench/scripts/judge.py1046CODE
LOWexperiments/arc_bench/scripts/evaluate.py52CODE
LOWexperiments/arc_bench/scripts/evaluate.py83CODE
LOWexperiments/arc_bench/scripts/judge_results_only.py142CODE
LOWexperiments/arc_bench/scripts/judge_results_only.py206CODE
LOWtests/test_rc_cache.py100CODE
LOWtests/test_rc_cache.py147CODE
LOWtests/test_ssh_and_colab_sandbox.py295CODE
LOWtests/test_ssh_and_colab_sandbox.py310CODE
LOWtests/test_evolution_aevolve.py355CODE
LOWtests/test_evolution_aevolve.py375CODE
LOWtests/test_rc_e2e_regression.py148CODE
LOWscripts/test_code_agent_live.py192CODE
LOWscripts/test_codegen_v2.py269CODE
LOWscripts/test_codegen_v2.py411CODE
LOWscripts/test_codegen_v2.py446CODE
LOWscripts/test_codegen_v2.py543CODE
LOWscripts/test_codegen_v2.py602CODE
LOWresearchclaw/config.py1079CODE
LOWresearchclaw/health.py281CODE
LOWresearchclaw/health.py304CODE
LOWresearchclaw/evolution_aevolve.py188CODE
LOWresearchclaw/evolution_aevolve.py358CODE
LOWresearchclaw/evolution.py45CODE
LOWresearchclaw/evolution.py247CODE
LOWresearchclaw/evolution.py298CODE
LOWresearchclaw/evolution.py453CODE
LOWresearchclaw/cli.py50CODE
LOWresearchclaw/cli.py156CODE
LOWresearchclaw/cli.py594CODE
LOWresearchclaw/cli.py1058CODE
LOWresearchclaw/cli.py1481CODE
LOWresearchclaw/cli.py1618CODE
LOWresearchclaw/cli.py1850CODE
LOWresearchclaw/report.py96CODE
LOWresearchclaw/collaboration/repository.py75CODE
LOWresearchclaw/pipeline/paper_verifier.py371CODE
LOWresearchclaw/pipeline/paper_verifier.py390CODE
LOWresearchclaw/pipeline/paper_verifier.py484CODE
LOWresearchclaw/pipeline/runner.py126CODE
LOWresearchclaw/pipeline/runner.py154CODE
LOWresearchclaw/pipeline/runner.py209CODE
LOWresearchclaw/pipeline/runner.py346CODE
LOWresearchclaw/pipeline/runner.py431CODE
LOWresearchclaw/pipeline/runner.py915CODE
LOWresearchclaw/pipeline/runner.py1357CODE
LOWresearchclaw/pipeline/runner.py1475CODE
LOWresearchclaw/pipeline/runner.py1597CODE
LOWresearchclaw/pipeline/runner.py1629CODE
LOWresearchclaw/pipeline/experiment_repair.py543CODE
163 more matches not shown…
Structural Annotation Overuse98 hits · 170 pts
SeverityFileLineSnippetContext
LOWtests/test_v6_improvements.py592 # Step 1: IMP-15 dedupSTRING
LOWtests/test_v6_improvements.py606 # Step 2: IMP-14 cite strippingSTRING
LOWdocs/integration-guide.md629#### Step 1: Install MetaClawCOMMENT
LOWdocs/integration-guide.md638#### Step 2: ConfigureCOMMENT
LOWdocs/integration-guide.md655#### Step 3: RunCOMMENT
LOWscripts/test_beast_mode_e2e.py177 # Step 1: Complexity scoringSTRING
LOWscripts/test_beast_mode_e2e.py193 # Step 2: Check OpenCode availabilitySTRING
LOWscripts/test_beast_mode_e2e.py201 # Step 3: Create test workspace and invokeSTRING
LOWscripts/test_beast_mode_e2e.py243 # Step 4: Evaluate resultsSTRING
LOWscripts/test_beast_mode_e2e.py286 # Step 5: Quality evaluationSTRING
LOWresearchclaw/evolution_aevolve.py452 # Step 1: Solve — evidence is already collected (lessons + results)COMMENT
LOWresearchclaw/evolution_aevolve.py455 # Step 2: ObserveCOMMENT
LOWresearchclaw/evolution_aevolve.py462 # Step 3: EvolveCOMMENT
LOWresearchclaw/evolution_aevolve.py471 # Step 4: GateCOMMENT
LOWresearchclaw/evolution_aevolve.py479 # Step 5: ReloadCOMMENT
LOWresearchclaw/pipeline/stage_impls/_code_generation.py198## Step 1: Execute the phenomenology pipelineCOMMENT
LOWresearchclaw/pipeline/stage_impls/_code_generation.py201## Step 2: Generate output figuresCOMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py1981 # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2}COMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py1995 # Step 2: Convert single-key brackets [key] → \cite{key}COMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py2006 # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b}COMMENT
LOWresearchclaw/agents/figure_agent/planner.py125 # Step 1: Detect research domainCOMMENT
LOWresearchclaw/agents/figure_agent/planner.py129 # Step 2: Analyze available dataCOMMENT
LOWresearchclaw/agents/figure_agent/planner.py134 # Step 3: Generate figure plan via LLMCOMMENT
LOWresearchclaw/templates/converter.py1349 # Step 3: Escape special charactersCOMMENT
LOWresearchclaw/templates/converter.py1359 # Step 4: Restore protected regionsCOMMENT
LOWresearchclaw/templates/converter.py1323 # Step 1: Convert Python-style end-of-line comments → \COMMENT{...}COMMENT
LOWresearchclaw/templates/converter.py1336 # Step 2: Protect existing LaTeX commands and math mode from escapingCOMMENT
LOW…stat_research_agent/agents/stat-experiment-designer.md29### Step 1: Design ExperimentsCOMMENT
LOW…stat_research_agent/agents/stat-experiment-designer.md42### Step 2: Build Reproducible CodeCOMMENT
LOW…stat_research_agent/agents/stat-experiment-designer.md57### Step 3: Run Pilot Then Full EvaluationCOMMENT
LOW…stat_research_agent/agents/stat-experiment-designer.md62### Step 4: Save EvidenceCOMMENT
LOW…stat_research_agent/agents/stat-experiment-designer.md71### Step 5: Write Experiment SummaryCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md34### Step 1: Formulation AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md44### Step 2: Method AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md53### Step 3: Theory AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md63### Step 4: Experiment and Comparison AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md72### Step 5: Final Result AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-quality-auditor.md81### Step 6: Write AuditCOMMENT
LOW…nts/stat_research_agent/agents/stat-method-proposer.md28### Step 1: Read the FormulationCOMMENT
LOW…nts/stat_research_agent/agents/stat-method-proposer.md33### Step 2: Propose Candidate MethodsCOMMENT
LOW…nts/stat_research_agent/agents/stat-method-proposer.md43### Step 3: Specify Method MechanicsCOMMENT
LOW…nts/stat_research_agent/agents/stat-method-proposer.md54### Step 4: Connect Methods to ClaimsCOMMENT
LOW…nts/stat_research_agent/agents/stat-method-proposer.md59### Step 5: Write Method ProposalCOMMENT
LOW…/stat_research_agent/agents/stat-result-synthesizer.md33### Step 1: Write Paper-Style ReportCOMMENT
LOW…/stat_research_agent/agents/stat-result-synthesizer.md48### Step 2: Write READMECOMMENT
LOW…/stat_research_agent/agents/stat-result-synthesizer.md58### Step 3: Keep Claims GroundedCOMMENT
LOW…/stat_research_agent/agents/stat-problem-formulator.md36### Step 1: Extract the Scientific QuestionCOMMENT
LOW…/stat_research_agent/agents/stat-problem-formulator.md46### Step 2: Define Formal ObjectsCOMMENT
LOW…/stat_research_agent/agents/stat-problem-formulator.md57### Step 3: State AssumptionsCOMMENT
LOW…/stat_research_agent/agents/stat-problem-formulator.md68### Step 4: Translate Hypotheses Into Testable ClaimsCOMMENT
LOW…/stat_research_agent/agents/stat-problem-formulator.md78### Step 5: Write Problem FormulationCOMMENT
LOW…nts/stat_research_agent/agents/stat-theory-analyzer.md29### Step 1: Identify Theoretical QuestionsCOMMENT
LOW…nts/stat_research_agent/agents/stat-theory-analyzer.md40### Step 2: Derive Main PropertiesCOMMENT
LOW…nts/stat_research_agent/agents/stat-theory-analyzer.md52### Step 3: Derive Experimental PredictionsCOMMENT
LOW…nts/stat_research_agent/agents/stat-theory-analyzer.md61### Step 4: Write Theory AnalysisCOMMENT
LOW…/stat_research_agent/agents/stat-comparison-analyst.md31### Step 1: Load EvidenceCOMMENT
LOW…/stat_research_agent/agents/stat-comparison-analyst.md35### Step 2: Compare MethodsCOMMENT
LOW…/stat_research_agent/agents/stat-comparison-analyst.md45### Step 3: Interpret DisagreementsCOMMENT
LOW…/stat_research_agent/agents/stat-comparison-analyst.md56### Step 4: Produce Figures and TablesCOMMENT
LOW…/stat_research_agent/agents/stat-comparison-analyst.md65### Step 5: Write Claim VerdictsCOMMENT
38 more matches not shown…
Over-Commented Block62 hits · 60 pts
SeverityFileLineSnippetContext
LOWconfig.researchclaw.example.yaml41 api_key_env: "OPENAI_API_KEY"COMMENT
LOWconfig.researchclaw.example.yaml141# experiment:COMMENT
LOWconfig.researchclaw.example.yaml161#COMMENT
LOWprompts.default.yaml1# =============================================================================COMMENT
LOWsentinel.sh1#!/usr/bin/env bashCOMMENT
LOWexperiments/arc_bench/config/statistics/topics.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML11.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML07.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML06.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML10.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML21.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML17.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML01.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML16.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML20.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML19.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML23.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML03.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML15.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML14.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML02.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML22.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML18.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML05.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML13.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML09.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML25.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML24.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML08.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML12.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/ml/manifests/ML04.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/physics/topics.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P01.yaml81COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P06.yaml81 estimated_wall_clock_sec: 3600COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P10.yaml81 - process_id: "mumu_to_bbbar_U1_3and14tev"COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P07.yaml81 estimated_wall_clock_sec: 3600COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P08.yaml81# Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judgeCOMMENT
LOWexperiments/arc_bench/config/physics/manifests/P04.yaml81# Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judgeCOMMENT
LOWexperiments/arc_bench/config/physics/manifests/P05.yaml81rubric_path: "experiments/arc_bench/config/physics/rubrics/P05.json"COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P09.yaml81 gpu_required: falseCOMMENT
LOWexperiments/arc_bench/config/physics/manifests/P02.yaml81# ---------------------------------------------------------------------------COMMENT
LOWexperiments/arc_bench/config/physics/manifests/P03.yaml81 estimated_wall_clock_sec: 3600COMMENT
LOWexperiments/arc_bench/config/quantum/topics.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/quantum/manifests/Q08.yaml1# ============================================================================COMMENT
LOWexperiments/arc_bench/config/quantum/manifests/Q05.yaml1# ============================================================================COMMENT
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py101 )COMMENT
LOW…ments/arc_bench/baseline/adapters/agent_lab_adapter.py121 # *internal control-flow pathologies* (lit-review SUMMARY-loop neverCOMMENT
LOWexperiments/arc_bench/scripts/judge_paper_manual.sh1#!/usr/bin/env bashCOMMENT
LOWexperiments/arc_bench/scripts/run_agent_lab.sh1#!/usr/bin/env bashCOMMENT
LOWexperiments/arc_bench/scripts/run_aide.sh1#!/usr/bin/env bashCOMMENT
LOWexperiments/arc_bench/scripts/judge.py821 # BUG-FIX: Prefer `<primary>_mean` over the single-valueCOMMENT
LOWexperiments/arc_bench/scripts/run_ais_v2.sh1#!/usr/bin/env bashCOMMENT
LOWexperiments/arc_bench/scripts/_inject_p_requirements.py101 ),COMMENT
LOWtests/test_rc_contracts.py101COMMENT
LOWdocs/DOMAIN_INTEGRATION_GUIDE.md121# Only set this if you added a LAYER 5 sandbox + EXPERIMENT_MODE.COMMENT
LOWresearchclaw/pipeline/stage_impls/_literature.py841 # IMP-21: Defensive gate — refuse to run on an empty/missing shortlist.COMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py2201 if _uv_is_strict or _uv.in_table:COMMENT
LOWresearchclaw/docker/entrypoint.sh1#!/bin/bashCOMMENT
LOWresearchclaw/domains/deploy.py801 # without cluttering the live config.COMMENT
LOWresearchclaw/data/benchmark_knowledge.yaml1# BenchmarkAgent Knowledge BaseCOMMENT
2 more matches not shown…
AI Slop Vocabulary18 hits · 56 pts
SeverityFileLineSnippetContext
MEDIUMconfig.researchclaw.example.yaml173# 4. Colab via Google Drive (most robust, no SSH needed):COMMENT
MEDIUMexperiments/arc_bench/scripts/run_ais_v2.py476 # encode the ablation axis levels, e.g. "scaler = robust").COMMENT
MEDIUMexperiments/arc_bench/scripts/run_bench.py38# Paper-replication harness we reuse. We import the finalizer directly; theCOMMENT
MEDIUMtests/test_hep_incremental.py404 """The _merge_docs helper is robust to None / non-dict inputs."""STRING
MEDIUMtests/test_hitl_branching.py177 (s7 / "synthesis.md").write_text("# Synthesis\nGap: no robust evaluation")CODE
MEDIUMtests/test_rc_executor.py2680 # Check that harness was injected (BUG-DA8-06: dir is now _project_{N})COMMENT
MEDIUMtests/test_rc_executor.py2704 # The real harness should be there, not the fake one (BUG-DA8-06)COMMENT
MEDIUMscripts/test_codegen_v2.py266# Code quality analysis (comprehensive)STRING
MEDIUMresearchclaw/domains/detector.py96 # Experiment paradigmCOMMENT
MEDIUMresearchclaw/agents/benchmark_agent/acquirer.py29 """Ask LLM to generate a robust data loading function."""STRING
MEDIUMresearchclaw/experiment/validator.py198 # Runtime-injected by the experiment harnessCOMMENT
MEDIUMresearchclaw/experiment/harness_template.py110# Convenience: create a default harness when importedCOMMENT
MEDIUMresearchclaw/experiment/sandbox.py384 # R5-4: Inject immutable experiment harness before copying project filesCOMMENT
MEDIUMresearchclaw/experiment/sandbox.py387 # Copy all project files (will NOT overwrite harness — harness name is unique)COMMENT
MEDIUMresearchclaw/experiment/sandbox.py391 # Do not allow project to overwrite the harnessCOMMENT
MEDIUMresearchclaw/experiment/docker_sandbox.py130 # Inject experiment harnessCOMMENT
MEDIUMresearchclaw/experiment/docker_sandbox.py159 # Inject harness first (immutable)COMMENT
MEDIUMresearchclaw/experiment/docker_sandbox.py162 # Copy project files and subdirectories (skip harness overwrite)COMMENT
Self-Referential Comments10 hits · 39 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_rc_novelty.py237 # Create a mock paper with overlapping keywordsCOMMENT
MEDIUMtests/test_rc_cli.py375 # Create a fake previous run directory with a checkpointCOMMENT
MEDIUMtests/test_experiment_repair.py649 # Create a rich existing stage-14 summaryCOMMENT
MEDIUMtests/test_rc_executor.py2673 # Create a project dirCOMMENT
MEDIUMtests/test_rc_executor.py2696 # Create a project with a fake experiment_harness.pyCOMMENT
MEDIUMtests/test_rc_executor.py2729 # Create a run with very long stdoutCOMMENT
MEDIUMtests/test_fabrication_guards.py174 # Create a failed experiment_summary.jsonCOMMENT
MEDIUMtests/test_evolution_aevolve.py358 # Create a fake .claude/skills/test-skill/SKILL.mdCOMMENT
MEDIUMresearchclaw/llm/acp_client.py141 # Create the sessionCOMMENT
MEDIUMresearchclaw/domains/deploy.py812# This file is a domain blueprint. Dropping it into one of the profileCOMMENT
Modern AI Meta-Vocabulary16 hits · 34 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md73- **[03/30/2026]** **Flexible Skill Loading** — AutoResearchClaw now supports loading open-source and custom skills fromCODE
MEDIUMexperiments/arc_bench/README.md31│ │ # (paper-content / code-orchestration /CODE
MEDIUMexperiments/arc_bench/baseline/adapters/aide_adapter.py75 # not embed any phase-specific scaffolding into goal/eval". Kept asCOMMENT
MEDIUMexperiments/arc_bench/baseline/interventions/T02.json9 "guidance": "- **Canonical result table first**: create one long-form DataFrame with columns `[dataset, noise_leveCODE
MEDIUMtests/test_web_integration.py100# WebSearchAgent — orchestrationCOMMENT
MEDIUMdocs/DOMAIN_INTEGRATION_GUIDE.md148# ── Code-gen file scaffold (consumed by adapter.get_blueprint_context) ────COMMENT
MEDIUMdocs/HITL_GUIDE.md179. [Safety & Guardrails](#9-safety--guardrails)CODE
MEDIUMresearchclaw/evolution.py85 PIPELINE = "pipeline" # Stage orchestration issuesCODE
MEDIUMresearchclaw/pipeline/code_agent.py1119 # Extract context window: ±30 lines around errorCOMMENT
MEDIUMresearchclaw/pipeline/stage_impls/_analysis.py657 # Try FigureAgent first (multi-agent intelligent charts), fall back to visualize.pySTRING
MEDIUMresearchclaw/pipeline/stage_impls/_code_generation.py737 # for internal chain-of-thought). Retry once with even higher limit on empty.STRING
MEDIUMresearchclaw/pipeline/stage_impls/_code_generation.py1223 # real orchestration (more lines + __main__ guard), prefer itSTRING
MEDIUMresearchclaw/pipeline/stage_impls/_synthesis.py117 # instead of sending empty context to the LLM (pure hallucination).STRING
MEDIUMresearchclaw/domains/deploy.py195# Nested-block fields: entire sub-dicts (e.g. collider_agent, agentic,COMMENT
MEDIUMresearchclaw/domains/deploy.py327 # 3. Nested experiment sub-blocks (collider_agent, agentic, ...).COMMENT
MEDIUMresearchclaw/domains/deploy.py962 # Strip None/empty entries before scaffolding so the rendered YAMLSTRING
Verbosity Indicators24 hits · 32 pts
SeverityFileLineSnippetContext
LOWtests/test_v6_improvements.py592 # Step 1: IMP-15 dedupSTRING
LOWtests/test_v6_improvements.py606 # Step 2: IMP-14 cite strippingSTRING
LOWscripts/test_beast_mode_e2e.py177 # Step 1: Complexity scoringSTRING
LOWscripts/test_beast_mode_e2e.py193 # Step 2: Check OpenCode availabilitySTRING
LOWscripts/test_beast_mode_e2e.py201 # Step 3: Create test workspace and invokeSTRING
LOWscripts/test_beast_mode_e2e.py243 # Step 4: Evaluate resultsSTRING
LOWscripts/test_beast_mode_e2e.py286 # Step 5: Quality evaluationSTRING
LOWresearchclaw/evolution_aevolve.py452 # Step 1: Solve — evidence is already collected (lessons + results)COMMENT
LOWresearchclaw/evolution_aevolve.py455 # Step 2: ObserveCOMMENT
LOWresearchclaw/evolution_aevolve.py462 # Step 3: EvolveCOMMENT
LOWresearchclaw/evolution_aevolve.py471 # Step 4: GateCOMMENT
LOWresearchclaw/evolution_aevolve.py479 # Step 5: ReloadCOMMENT
LOWresearchclaw/pipeline/stage_impls/_code_generation.py198## Step 1: Execute the phenomenology pipelineCOMMENT
LOWresearchclaw/pipeline/stage_impls/_code_generation.py201## Step 2: Generate output figuresCOMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py1981 # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2}COMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py1995 # Step 2: Convert single-key brackets [key] → \cite{key}COMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py2006 # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b}COMMENT
LOWresearchclaw/agents/figure_agent/planner.py125 # Step 1: Detect research domainCOMMENT
LOWresearchclaw/agents/figure_agent/planner.py129 # Step 2: Analyze available dataCOMMENT
LOWresearchclaw/agents/figure_agent/planner.py134 # Step 3: Generate figure plan via LLMCOMMENT
LOWresearchclaw/templates/converter.py1349 # Step 3: Escape special charactersCOMMENT
LOWresearchclaw/templates/converter.py1359 # Step 4: Restore protected regionsCOMMENT
LOWresearchclaw/templates/converter.py1323 # Step 1: Convert Python-style end-of-line comments → \COMMENT{...}COMMENT
LOWresearchclaw/templates/converter.py1336 # Step 2: Protect existing LaTeX commands and math mode from escapingCOMMENT
Redundant / Tautological Comments22 hits · 29 pts
SeverityFileLineSnippetContext
LOWconfig.researchclaw.example.yaml120 use_docker: false # Set true to run experiments inside Docker on remote hostCODE
LOWsentinel.sh108 # Check if any child processes existCOMMENT
LOWscripts/test_code_agent_sandbox.py240 # Write filesCOMMENT
LOWscripts/test_codegen_v2.py453 # Write filesCOMMENT
LOWscripts/test_codegen_v2.py731 # Write filesCOMMENT
LOWresearchclaw/hardware.py257 # Check if already installedCOMMENT
LOWresearchclaw/pipeline/runner.py685 # Check if repair loop should runCOMMENT
LOWresearchclaw/pipeline/runner.py1672 # Check if we've met quality thresholdCOMMENT
LOWresearchclaw/pipeline/experiment_diagnosis.py205 # Check if only 1 conditionCOMMENT
LOWresearchclaw/pipeline/code_agent.py416 # Check if value needs quoting:COMMENT
LOWresearchclaw/pipeline/code_agent.py805 # Check if importing from a local module that existsCOMMENT
LOWresearchclaw/pipeline/code_agent.py1413 # Write files to a numbered attempt directoryCOMMENT
LOWresearchclaw/pipeline/stage_impls/_execution.py1028 # Check if stdout contains condition labelsCOMMENT
LOWresearchclaw/pipeline/stage_impls/_literature.py253 # Check if query ends with a known search suffixCOMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py916 # Check if this looks like a results/experiment tableCOMMENT
LOWresearchclaw/pipeline/stage_impls/_review_publish.py1139 # Check if we're leaving Results for a different top-level sectionCOMMENT
LOWresearchclaw/agents/figure_agent/renderer.py228 # Check if it was saved relative to script CWDCOMMENT
LOWresearchclaw/agents/figure_agent/critic.py231 # Check if script contains the expected valuesCOMMENT
LOWresearchclaw/experiment/validator.py657 # Check if this class inherits from another class in the same fileCOMMENT
LOWresearchclaw/experiment/validator.py686 # Check if all overridden methods have identical AST to parentCOMMENT
LOWresearchclaw/experiment/validator.py760 # Check if this variable is used later in the functionCOMMENT
LOWresearchclaw/templates/converter.py1022 # Check if previous line is a table caption (e.g. **Table 1: ...**)COMMENT
Cross-Language Confusion3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHexperiments/arc_bench/scripts/_inject_p_requirements.py132 results.json metrics MUST contain at least 3 numeric (non-null, finite)CODE
HIGHresearchclaw/servers/monitor.py24 result = await _ssh_command(server.host, "nvidia-smi --query-gpu=utilization.gpu,memory.used,memory.total --CODE
HIGHresearchclaw/servers/slurm_executor.py92 f"squeue -j {job_id} -h -o '%T' 2>/dev/null || sacct -j {job_id} -n -o State -P 2>/dev/null",CODE
Docstring Block Structure3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHresearchclaw/report.py16Generate a Markdown report from a pipeline run directory. Args: run_dir: Path to the run artifacts directorSTRING
HIGHresearchclaw/memory/store.py92Add a new memory entry. Args: category: One of "ideation", "experiment", "writing". conSTRING
HIGHresearchclaw/hitl/workshops/paper.py84AI writes a section draft. Args: section_name: Name of the section. context: Relevant cSTRING
Example Usage Blocks8 hits · 12 pts
SeverityFileLineSnippetContext
LOWsentinel.sh7# Usage:COMMENT
LOWexperiments/arc_bench/scripts/judge_paper_manual.sh25# Usage:COMMENT
LOWexperiments/arc_bench/scripts/run_agent_lab.sh12# Usage:COMMENT
LOWexperiments/arc_bench/scripts/run_aide.sh7# Usage:COMMENT
LOWexperiments/arc_bench/scripts/run_ais_v2.sh7# Usage:COMMENT
LOWexperiments/arc_bench/scripts/run_rc_full.sh6# Usage:COMMENT
LOWexperiments/arc_bench/scripts/run_rc_copilot.sh8# Usage:COMMENT
LOWscripts/metaclaw_start.sh4# Usage:COMMENT
Fake / Example Data10 hits · 9 pts
SeverityFileLineSnippetContext
LOWtests/test_rc_quality.py80 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit."CODE
LOWtests/test_rc_quality.py80 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit."CODE
LOWtests/test_rc_quality.py82 assert any("Lorem ipsum" in m.pattern_desc for m in matches)CODE
LOWtests/test_rc_literature.py68 {"authorId": "2", "name": "John Doe"},CODE
LOWtests/test_rc_executor.py36 base_url="http://fake", api_key="fake-key"CODE
LOWtests/test_rc_templates.py502 tex = markdown_to_latex(self.SAMPLE_MD, NEURIPS_2024, authors="Jane Doe")CODE
LOWtests/test_decision_agent.py301 _FakeLLM(), gemini_api_key="fake-key", use_sdk=False,CODE
LOWtests/test_decision_agent.py640 api_key="fake-key",CODE
LOWtests/test_decision_agent.py677 api_key="fake-key",CODE
LOWresearchclaw/quality.py23 (r"(?i)lorem\s+ipsum", "Lorem ipsum filler"),CODE
AI Structural Patterns6 hits · 4 pts
SeverityFileLineSnippetContext
LOWexperiments/arc_bench/baseline/adapters/aide_adapter.py54CODE
LOWtests/test_servers.py21CODE
LOWresearchclaw/pipeline/executor.py821CODE
LOWresearchclaw/literature/verify.py974CODE
LOWresearchclaw/agents/benchmark_agent/surveyor.py240CODE
LOWresearchclaw/servers/registry.py14CODE
Overly Generic Function Names5 hits · 4 pts
SeverityFileLineSnippetContext
LOWtests/test_opencode_bridge.py298 (src / "utils.py").write_text("def helper(): pass")CODE
LOWtests/test_opencode_bridge.py511 "utils.py": "def helper(): pass\n",CODE
LOWtests/test_opencode_bridge.py517 files = {"utils.py": "def helper(): pass\n"}CODE
LOWtests/test_opencode_bridge.py581 "utils.py": "def helper(): pass\n",CODE
LOWresearchclaw/servers/dispatcher.py67 async def execute_task(self, task_id: str) -> dict[str, Any]:CODE