Fully autonomous & self-evolving research from idea to paper. Chat an Idea. Get a Paper. 🦞
This report summarizes scanner evidence for aiming-lab/AutoResearchClaw, a Python project with 14,618 GitHub stars. SynthScan examined 174,325 lines of code across 706 source files, recording 5618 pattern matches distributed across 20 syntactic categories. The legacy adjusted pattern signal is 60.9 (High pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 2300 finding(s).
Are imports declared and package/API names verified? 779 finding(s).
Are wrappers, guards, and repeated structures necessary? 4343 finding(s).
Which changes need focused human review? 5618 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 5618 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | config.researchclaw.example.yaml | 147 | # ============================================================================ | COMMENT |
| MEDIUM | config.researchclaw.example.yaml | 149 | # ============================================================================ | COMMENT |
| MEDIUM | prompts.default.yaml | 1 | # ============================================================================= | COMMENT |
| MEDIUM | prompts.default.yaml | 3 | # ============================================================================= | COMMENT |
| MEDIUM | prompts.default.yaml | 16 | # ============================================================================= | COMMENT |
| MEDIUM | run_hep_pipeline.sh | 7 | # ── API credentials ────────────────────────────────────────────── | COMMENT |
| MEDIUM | run_hep_pipeline.sh | 15 | # ── Anthropic (for claude CLI subprocess — ColliderAgent) ──────── | COMMENT |
| MEDIUM | experiments/arc_bench/config/base_config.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/base_config.yaml | 5 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/arc_bench/config/statistics/topics.yaml | 15 | # ============================================================================ | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S03.yaml | 131 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S03.yaml | 138 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S02.yaml | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S02.yaml | 142 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S01.yaml | 96 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …riments/arc_bench/config/statistics/manifests/S01.yaml | 103 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/topics.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML11.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML07.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML06.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML10.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML21.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML17.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML01.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML16.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML20.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML19.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML23.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML03.yaml | 8 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 1 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 3 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | experiments/arc_bench/config/ml/manifests/ML15.yaml | 8 | # ============================================================================ | COMMENT |
| 1648 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 407 | def _read_agent_lab_artifacts(run_dir: Path) -> StandardArtifacts: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 169 | def _materialize_stub_data_dir(self, topic: dict, target: Path) -> None: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/base.py | 86 | def _write_standard_artifacts( | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 98 | def _build_submission_from_adapter(artifacts_native: Path, submission_dir: Path, | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 282 | def _metrics_from_metric_value(metric_value: dict) -> dict[str, float]: | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 327 | def _pivot_per_condition_from_entry(entry: dict) -> dict[str, dict[str, float]]: | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 360 | def _format_leaves_for_prompt(leaves: list[dict[str, Any]]) -> str: | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 747 | def _locate_experiment_summary(run_dir: Path, topic_id: str) -> Path | None: | CODE |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 118 | def _read_agent_lab_canonical(run_dir: Path) -> dict[str, Any]: | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 12 | def test_collider_agent_config_has_incremental_field_default_false(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 18 | def test_collider_agent_config_incremental_can_be_enabled(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 23 | def test_run_subparser_accepts_incremental_experiment_flag(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 36 | def test_run_subparser_incremental_experiment_default_false(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 49 | def test_gate_required_returns_true_for_code_generation_when_profile_is_hep_ph(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 55 | def test_gate_required_returns_false_for_code_generation_without_profile(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 63 | def test_gate_required_unaffected_for_existing_gates_when_profile_is_passed(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 71 | def test_default_rollback_for_code_generation_is_experiment_design(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 82 | def test_code_generation_contract_has_collider_alternate_output(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 208 | def test_incremental_snapshot_warns_when_cumulative_footprint_exceeds_threshold( | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 327 | def test_sandbox_merges_results_json_in_incremental_mode(tmp_path, monkeypatch): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 403 | def test_merge_docs_static_logic_handles_missing_snapshots(): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 417 | def test_prepare_workspace_in_incremental_mode_assembles_delta_prompt(tmp_path): | CODE |
| LOW⚡ | tests/test_hep_incremental.py | 596 | def test_version_rollback_stages_uses_copytree_when_incremental(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 134 | def test_select_output_files_picks_collider_mode_alternate(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 145 | def test_select_output_files_keeps_default_for_non_collider_mode(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 157 | def test_select_output_files_handles_none_contract(): | CODE |
| LOW | tests/test_hep_incremental.py | 163 | def test_executor_treats_code_generation_as_gate_for_hep_ph(tmp_path, monkeypatch): | CODE |
| LOW | tests/test_hep_incremental.py | 452 | def test_prepare_workspace_non_incremental_unchanged(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 469 | def test_prepare_workspace_incremental_skipped_when_no_artifacts(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 619 | def test_version_rollback_stages_default_still_renames(tmp_path): | CODE |
| LOW | tests/test_hep_incremental.py | 633 | def test_executor_does_not_gate_code_generation_for_non_hep_ph(tmp_path, monkeypatch): | CODE |
| LOW⚡ | tests/test_web_scholar.py | 54 | def test_available_always_true(self): | CODE |
| LOW | tests/test_web_scholar.py | 80 | def test_parse_pub_string_authors(self): | CODE |
| LOW | tests/test_web_scholar.py | 95 | def test_parse_pub_missing_fields(self): | CODE |
| LOW | tests/test_web_scholar.py | 113 | def test_search_with_mocked_scholarly(self, mock_scholarly): | CODE |
| LOW | tests/test_web_scholar.py | 133 | def test_search_error_graceful(self, mock_scholarly): | CODE |
| LOW⚡ | tests/test_web_search.py | 51 | def test_parse_ddg_html_basic(self): | CODE |
| LOW⚡ | tests/test_web_search.py | 68 | def test_parse_ddg_html_skips_ddg_links(self): | STRING |
| LOW⚡ | tests/test_web_search.py | 77 | def test_parse_ddg_html_respects_limit(self): | STRING |
| LOW⚡ | tests/test_web_search.py | 92 | def test_search_ddg_fallback_no_api_key(self, mock_urlopen): | STRING |
| LOW | tests/test_web_search.py | 106 | def test_search_ddg_error_graceful(self, mock_urlopen): | STRING |
| LOW | tests/test_web_search.py | 114 | def test_search_tavily_with_mock(self): | STRING |
| LOW | tests/test_web_search.py | 142 | def test_search_multi_deduplication(self, mock_urlopen): | CODE |
| LOW⚡ | tests/test_rc_health.py | 67 | def test_check_python_version_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 73 | def test_check_python_version_fail() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 80 | def test_check_yaml_import_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 86 | def test_check_yaml_import_fail() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 93 | def test_check_config_valid_pass(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 100 | def test_check_config_invalid(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 108 | def test_check_config_missing_file(tmp_path: Path) -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 114 | def test_check_llm_connectivity_pass() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 120 | def test_check_llm_connectivity_timeout() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 130 | def test_check_llm_connectivity_http_error() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 310 | def test_check_sandbox_python_exists() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 319 | def test_check_sandbox_python_missing() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 328 | def test_check_matplotlib_available() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 334 | def test_check_matplotlib_missing() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 341 | def test_check_experiment_mode_simulated() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 346 | def test_check_experiment_mode_sandbox() -> None: | CODE |
| LOW⚡ | tests/test_rc_health.py | 351 | def test_run_doctor_all_pass_openai(tmp_path: Path) -> None: | CODE |
| 1738 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …arc_bench/baseline/adapters/ai_scientist_v2_adapter.py | 220 | except json.JSONDecodeError: | CODE |
| HIGH | …arc_bench/baseline/adapters/ai_scientist_v2_adapter.py | 228 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/baseline/adapters/_aide_runner.py | 108 | except Exception: | CODE |
| HIGH | …ts/arc_bench/baseline/adapters/researchclaw_adapter.py | 191 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/scripts/run_baseline.py | 149 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/scripts/run_baseline.py | 140 | except Exception: | CODE |
| HIGH | experiments/arc_bench/scripts/run_baseline.py | 131 | except Exception: # noqa: BLE001 | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 1037 | except IndexError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 191 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 215 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 233 | except OSError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 962 | except json.JSONDecodeError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 1073 | except OSError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 134 | except OSError: | CODE |
| HIGH | experiments/arc_bench/scripts/judge.py | 1081 | except OSError: | CODE |
| HIGH | experiments/arc_bench/scripts/_rename_t_to_ml.py | 149 | except OSError: | CODE |
| HIGH | scripts/test_codegen_v2.py | 575 | except Exception: | CODE |
| HIGH | scripts/test_codegen_v2.py | 429 | except Exception: | CODE |
| HIGH | scripts/test_codegen_v2.py | 515 | except ValueError: | CODE |
| HIGH | researchclaw/evolution.py | 269 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/evolution.py | 349 | except (TypeError, ValueError): | CODE |
| HIGH | researchclaw/cli.py | 186 | except Exception: # noqa: BLE001 | CODE |
| HIGH | researchclaw/hardware.py | 229 | except (FileNotFoundError, subprocess.TimeoutExpired, OSError): | CODE |
| HIGH | researchclaw/collaboration/publisher.py | 83 | except json.JSONDecodeError: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 457 | except Exception: # noqa: BLE001 | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1566 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1609 | except (json.JSONDecodeError, ValueError, TypeError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1863 | except Exception: # noqa: BLE001 | CODE |
| HIGH | researchclaw/pipeline/runner.py | 173 | except ( | CODE |
| HIGH | researchclaw/pipeline/runner.py | 200 | except (json.JSONDecodeError, OSError, TypeError, ValueError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 865 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1582 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1861 | except Exception: # noqa: BLE001 | CODE |
| HIGH | researchclaw/pipeline/runner.py | 96 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 257 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 271 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 504 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 515 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 548 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/runner.py | 657 | except Exception: # noqa: BLE001 | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1386 | except (TypeError, ValueError, KeyError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 263 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 389 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 692 | except (json.JSONDecodeError, OSError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 316 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/runner.py | 1393 | except (TypeError, ValueError, KeyError): | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 846 | except ImportError: | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 592 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 556 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 575 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 564 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/experiment_repair.py | 582 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | researchclaw/pipeline/verified_registry.py | 295 | except (OSError, _json_rd.JSONDecodeError, Exception): # noqa: BLE001 | CODE |
| HIGH | researchclaw/pipeline/debate.py | 75 | except ValueError: | CODE |
| HIGH | researchclaw/pipeline/code_agent.py | 1473 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | researchclaw/pipeline/code_agent.py | 873 | except SyntaxError: | CODE |
| HIGH | researchclaw/pipeline/code_agent.py | 1480 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | researchclaw/pipeline/code_agent.py | 1490 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | researchclaw/pipeline/code_agent.py | 656 | except Exception: | CODE |
| HIGH | researchclaw/pipeline/opencode_bridge.py | 648 | except SyntaxError: | CODE |
| 183 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/config/credentials_loader.py | 14 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 8 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 9 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 10 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 11 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 12 | CODE | |
| LOW | …arc_bench/baseline/adapters/ai_scientist_v2_adapter.py | 14 | CODE | |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 18 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 28 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 11 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 15 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 16 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 52 | CODE | |
| LOW | experiments/arc_bench/baseline/adapters/base.py | 20 | CODE | |
| LOW | …ts/arc_bench/baseline/adapters/researchclaw_adapter.py | 9 | CODE | |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 27 | CODE | |
| LOW | experiments/arc_bench/scripts/prepare_run.py | 9 | CODE | |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_manual.py | 28 | CODE | |
| LOW | experiments/arc_bench/scripts/run_bench.py | 16 | CODE | |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 19 | CODE | |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 24 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 18 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 17 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 22 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 36 | CODE | |
| LOW | experiments/arc_bench/scripts/_rename_t_to_ml.py | 18 | CODE | |
| LOW | experiments/arc_bench/scripts/_rename_t_to_ml.py | 22 | CODE | |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 13 | CODE | |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 14 | CODE | |
| LOW | tests/test_anthropic.py | 3 | CODE | |
| LOW | tests/test_hep_incremental.py | 3 | CODE | |
| LOW | tests/test_hep_incremental.py | 7 | CODE | |
| LOW | tests/test_hep_incremental.py | 363 | CODE | |
| LOW | tests/test_web_scholar.py | 3 | CODE | |
| LOW | tests/test_web_scholar.py | 6 | CODE | |
| LOW | tests/test_web_scholar.py | 8 | CODE | |
| LOW | tests/test_web_search.py | 3 | CODE | |
| LOW | tests/test_web_search.py | 7 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 3 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 5 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 6 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 8 | CODE | |
| LOW | tests/test_convergence_evaluator.py | 8 | CODE | |
| LOW | tests/test_rc_health.py | 2 | CODE | |
| LOW | tests/test_overleaf.py | 3 | CODE | |
| LOW | tests/test_memory_system.py | 13 | CODE | |
| LOW | tests/test_memory_system.py | 15 | CODE | |
| LOW | tests/test_domain_detector.py | 3 | CODE | |
| LOW | tests/test_domain_detector.py | 5 | CODE | |
| LOW | tests/test_domain_detector.py | 6 | CODE | |
| LOW | tests/test_opencode_bridge.py | 3 | CODE | |
| LOW | tests/test_opencode_bridge.py | 7 | CODE | |
| LOW | tests/test_opencode_bridge.py | 10 | CODE | |
| LOW | tests/test_opencode_bridge.py | 13 | CODE | |
| LOW | tests/test_opencode_bridge.py | 13 | CODE | |
| LOW | tests/test_hitl_integration.py | 4 | CODE | |
| 706 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sentinel.sh | 75 | except Exception: | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 339 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 360 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 439 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 273 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 363 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 376 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 103 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 108 | except Exception: | CODE |
| LOW | experiments/arc_bench/baseline/adapters/_aide_runner.py | 120 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 131 | except Exception: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 140 | except Exception: | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 228 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 263 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 443 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 704 | except Exception as exc: | CODE |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 723 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 231 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_e2e_topic.py | 268 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 254 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 274 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 277 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 296 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/run_bench.py | 305 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 115 | except Exception: | STRING |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 282 | except Exception as exc: # noqa: BLE001 | STRING |
| LOW | experiments/arc_bench/scripts/judge.py | 338 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | experiments/arc_bench/scripts/judge.py | 681 | except Exception: | CODE |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 69 | except Exception: | CODE |
| LOW | tests/test_v6_improvements.py | 660 | except Exception as e: | CODE |
| LOW | scripts/test_codegen_v2.py | 429 | except Exception: | CODE |
| LOW | scripts/test_codegen_v2.py | 575 | except Exception: | CODE |
| LOW | scripts/test_codegen_v2.py | 586 | except Exception: | CODE |
| LOW | researchclaw/config.py | 1759 | except Exception: | CODE |
| LOW | researchclaw/health.py | 754 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | researchclaw/evolution_aevolve.py | 230 | except Exception: | CODE |
| LOW | researchclaw/evolution_aevolve.py | 283 | except Exception: | CODE |
| LOW | researchclaw/evolution_aevolve.py | 332 | except Exception: | CODE |
| LOW | researchclaw/evolution.py | 560 | except Exception: | CODE |
| LOW | researchclaw/evolution.py | 593 | except Exception: | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 999 | print(f"Error: {e}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1016 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1978 | print(f"Error: --from-yaml file not found: {spec_path}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1984 | print(f"Error: could not parse {spec_path}: {exc}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 1987 | print(f"Error: {spec_path} must be a YAML/JSON mapping.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2110 | print("Error: 'profile delete' requires a profile id.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2114 | print(f"Error: {err}", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2118 | print(f"Error: profile '{profile_id}' not found.", file=sys.stderr) | CODE |
| MEDIUM⚡ | researchclaw/cli.py | 2190 | print(f"Error: run directory not found: {run_dir}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 137 | print(f"Error: config file not found: {path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 529 | print(f"Error loading config: {exc}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 630 | print("Error: compare requires exactly 2 project names", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 691 | print(f"Error: run_dir not found: {run_dir}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 706 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 732 | print(f"Error: config file not found: {config_path}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 1151 | print(f"Error: no SKILL.md found in {source_path}") | CODE |
| MEDIUM | researchclaw/cli.py | 1156 | print(f"Error: failed to parse {skill_md}") | CODE |
| MEDIUM | researchclaw/cli.py | 1175 | print(f"Error: {path} not found") | CODE |
| MEDIUM | researchclaw/cli.py | 2049 | print(f"Error: {exc}", file=sys.stderr) | CODE |
| MEDIUM | researchclaw/cli.py | 2054 | print(f"Error: {exc}", file=sys.stderr) | CODE |
| 322 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/config/credentials_loader.py | 64 | __all__ = ["load_credentials"] | CODE |
| LOW | experiments/arc_bench/baseline/adapters/__init__.py | 14 | __all__ = [ | CODE |
| LOW | tests/test_rc_runner.py | 648 | def _setup_stage_artifacts(run_dir: Path) -> None: | CODE |
| LOW | tests/test_hitl_branching.py | 30 | def _setup_pipeline(self, run_dir: Path, stages: int = 10) -> None: | CODE |
| LOW | researchclaw/health.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/evolution_aevolve.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/evolution.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/hardware.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/quality.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/report.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/subscriber.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/__init__.py | 13 | __all__ = [ | CODE |
| LOW | researchclaw/collaboration/dedup.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/publisher.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/collaboration/repository.py | 11 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/paper_verifier.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/runner.py | 206 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/experiment_repair.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/verified_registry.py | 18 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/debate.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/experiment_diagnosis.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/code_agent.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/requirements_judge.py | 51 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/opencode_bridge.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/tournament.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/_helpers.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/executor.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_analysis.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_code_generation.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_experiment_design.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_execution.py | 41 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_paper_writing.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/stage_impls/_literature.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_synthesis.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/pipeline/stage_impls/_topic.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/pipeline/stage_impls/_review_publish.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/client.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/acp_client.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/llm/anthropic_adapter.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/domains/detector.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/domains/detector.py | 40 | def set_forced_profile(profile_id: str) -> None: | CODE |
| LOW⚡ | researchclaw/domains/deploy.py | 39 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/domains/deploy.py | 244 | def _set_by_path(data: dict[str, Any], dotted: str, value: Any) -> None: | CODE |
| LOW | researchclaw/domains/deploy.py | 996 | __all__ = [ | STRING |
| LOW | researchclaw/domains/__init__.py | 10 | __all__ = ["DomainProfile", "detect_domain"] | CODE |
| LOW | researchclaw/domains/prompt_adapter.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/domains/adapters/generic.py | 9 | __all__ = ["GenericPromptAdapter"] | CODE |
| LOW | researchclaw/domains/adapters/__init__.py | 20 | __all__ = [ | CODE |
| LOW | researchclaw/calendar/deadlines.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/calendar/__init__.py | 7 | __all__ = [ | CODE |
| LOW⚡ | researchclaw/literature/arxiv_client.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/openalex_client.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/cache.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/__init__.py | 17 | __all__ = [ | CODE |
| LOW⚡ | researchclaw/literature/semantic_scholar.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/search.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | researchclaw/literature/search.py | 307 | def _update_indices(p: Paper, idx: int) -> None: | CODE |
| LOW | researchclaw/literature/trends.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/literature/verify.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | researchclaw/literature/novelty.py | 29 | logger = logging.getLogger(__name__) | CODE |
| 146 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 340 | CODE | |
| LOW | experiments/arc_bench/scripts/run_baseline.py | 98 | CODE | |
| LOW | experiments/arc_bench/scripts/prepare_run.py | 82 | CODE | |
| LOW | experiments/arc_bench/scripts/run_ais_v2.py | 411 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_manual.py | 68 | CODE | |
| LOW | experiments/arc_bench/scripts/hitl_suggestor.py | 130 | CODE | |
| LOW | experiments/arc_bench/scripts/make_manifests.py | 111 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 221 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 398 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 792 | CODE | |
| LOW | experiments/arc_bench/scripts/judge.py | 1046 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 52 | CODE | |
| LOW | experiments/arc_bench/scripts/evaluate.py | 83 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 142 | CODE | |
| LOW | experiments/arc_bench/scripts/judge_results_only.py | 206 | CODE | |
| LOW | tests/test_rc_cache.py | 100 | CODE | |
| LOW | tests/test_rc_cache.py | 147 | CODE | |
| LOW | tests/test_ssh_and_colab_sandbox.py | 295 | CODE | |
| LOW | tests/test_ssh_and_colab_sandbox.py | 310 | CODE | |
| LOW | tests/test_evolution_aevolve.py | 355 | CODE | |
| LOW | tests/test_evolution_aevolve.py | 375 | CODE | |
| LOW | tests/test_rc_e2e_regression.py | 148 | CODE | |
| LOW | scripts/test_code_agent_live.py | 192 | CODE | |
| LOW | scripts/test_codegen_v2.py | 269 | CODE | |
| LOW | scripts/test_codegen_v2.py | 411 | CODE | |
| LOW | scripts/test_codegen_v2.py | 446 | CODE | |
| LOW | scripts/test_codegen_v2.py | 543 | CODE | |
| LOW | scripts/test_codegen_v2.py | 602 | CODE | |
| LOW | researchclaw/config.py | 1104 | CODE | |
| LOW | researchclaw/health.py | 281 | CODE | |
| LOW | researchclaw/health.py | 304 | CODE | |
| LOW | researchclaw/evolution_aevolve.py | 188 | CODE | |
| LOW | researchclaw/evolution_aevolve.py | 358 | CODE | |
| LOW | researchclaw/evolution.py | 45 | CODE | |
| LOW | researchclaw/evolution.py | 247 | CODE | |
| LOW | researchclaw/evolution.py | 298 | CODE | |
| LOW | researchclaw/evolution.py | 453 | CODE | |
| LOW | researchclaw/cli.py | 50 | CODE | |
| LOW | researchclaw/cli.py | 156 | CODE | |
| LOW | researchclaw/cli.py | 594 | CODE | |
| LOW | researchclaw/cli.py | 1088 | CODE | |
| LOW | researchclaw/cli.py | 1511 | CODE | |
| LOW | researchclaw/cli.py | 1648 | CODE | |
| LOW | researchclaw/cli.py | 1880 | CODE | |
| LOW | researchclaw/report.py | 96 | CODE | |
| LOW | researchclaw/collaboration/repository.py | 75 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 371 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 390 | CODE | |
| LOW | researchclaw/pipeline/paper_verifier.py | 484 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 126 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 154 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 209 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 346 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 431 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 915 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1357 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1475 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1597 | CODE | |
| LOW | researchclaw/pipeline/runner.py | 1629 | CODE | |
| LOW | researchclaw/pipeline/experiment_repair.py | 543 | CODE | |
| 165 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_v6_improvements.py | 592 | # Step 1: IMP-15 dedup | STRING |
| LOW | tests/test_v6_improvements.py | 606 | # Step 2: IMP-14 cite stripping | STRING |
| LOW | docs/integration-guide.md | 629 | #### Step 1: Install MetaClaw | COMMENT |
| LOW | docs/integration-guide.md | 638 | #### Step 2: Configure | COMMENT |
| LOW | docs/integration-guide.md | 655 | #### Step 3: Run | COMMENT |
| LOW | scripts/test_beast_mode_e2e.py | 177 | # Step 1: Complexity scoring | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 193 | # Step 2: Check OpenCode availability | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 201 | # Step 3: Create test workspace and invoke | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 243 | # Step 4: Evaluate results | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 286 | # Step 5: Quality evaluation | STRING |
| LOW⚡ | researchclaw/evolution_aevolve.py | 452 | # Step 1: Solve — evidence is already collected (lessons + results) | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 455 | # Step 2: Observe | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 462 | # Step 3: Evolve | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 471 | # Step 4: Gate | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 479 | # Step 5: Reload | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 198 | ## Step 1: Execute the phenomenology pipeline | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 201 | ## Step 2: Generate output figures | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2038 | # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2052 | # Step 2: Convert single-key brackets [key] → \cite{key} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2063 | # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b} | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 125 | # Step 1: Detect research domain | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 129 | # Step 2: Analyze available data | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 134 | # Step 3: Generate figure plan via LLM | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1349 | # Step 3: Escape special characters | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1359 | # Step 4: Restore protected regions | COMMENT |
| LOW | researchclaw/templates/converter.py | 1323 | # Step 1: Convert Python-style end-of-line comments → \COMMENT{...} | COMMENT |
| LOW | researchclaw/templates/converter.py | 1336 | # Step 2: Protect existing LaTeX commands and math mode from escaping | COMMENT |
| LOW | …stat_research_agent/agents/stat-experiment-designer.md | 29 | ### Step 1: Design Experiments | COMMENT |
| LOW | …stat_research_agent/agents/stat-experiment-designer.md | 42 | ### Step 2: Build Reproducible Code | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 57 | ### Step 3: Run Pilot Then Full Evaluation | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 62 | ### Step 4: Save Evidence | COMMENT |
| LOW⚡ | …stat_research_agent/agents/stat-experiment-designer.md | 71 | ### Step 5: Write Experiment Summary | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 34 | ### Step 1: Formulation Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 44 | ### Step 2: Method Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 53 | ### Step 3: Theory Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 63 | ### Step 4: Experiment and Comparison Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 72 | ### Step 5: Final Result Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-quality-auditor.md | 81 | ### Step 6: Write Audit | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 28 | ### Step 1: Read the Formulation | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 33 | ### Step 2: Propose Candidate Methods | COMMENT |
| LOW⚡ | …nts/stat_research_agent/agents/stat-method-proposer.md | 43 | ### Step 3: Specify Method Mechanics | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-method-proposer.md | 54 | ### Step 4: Connect Methods to Claims | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-method-proposer.md | 59 | ### Step 5: Write Method Proposal | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 33 | ### Step 1: Write Paper-Style Report | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 48 | ### Step 2: Write README | COMMENT |
| LOW | …/stat_research_agent/agents/stat-result-synthesizer.md | 58 | ### Step 3: Keep Claims Grounded | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 36 | ### Step 1: Extract the Scientific Question | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 46 | ### Step 2: Define Formal Objects | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 57 | ### Step 3: State Assumptions | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 68 | ### Step 4: Translate Hypotheses Into Testable Claims | COMMENT |
| LOW | …/stat_research_agent/agents/stat-problem-formulator.md | 78 | ### Step 5: Write Problem Formulation | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 29 | ### Step 1: Identify Theoretical Questions | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 40 | ### Step 2: Derive Main Properties | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 52 | ### Step 3: Derive Experimental Predictions | COMMENT |
| LOW | …nts/stat_research_agent/agents/stat-theory-analyzer.md | 61 | ### Step 4: Write Theory Analysis | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 31 | ### Step 1: Load Evidence | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 35 | ### Step 2: Compare Methods | COMMENT |
| LOW⚡ | …/stat_research_agent/agents/stat-comparison-analyst.md | 45 | ### Step 3: Interpret Disagreements | COMMENT |
| LOW | …/stat_research_agent/agents/stat-comparison-analyst.md | 56 | ### Step 4: Produce Figures and Tables | COMMENT |
| LOW | …/stat_research_agent/agents/stat-comparison-analyst.md | 65 | ### Step 5: Write Claim Verdicts | COMMENT |
| 38 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | config.researchclaw.example.yaml | 41 | api_key_env: "OPENAI_API_KEY" | COMMENT |
| LOW | config.researchclaw.example.yaml | 61 | # api_key_env: "ATLASCLOUD_API_KEY" | COMMENT |
| LOW | config.researchclaw.example.yaml | 141 | complexity_threshold: 0.2 # 0.0-1.0 — higher = only trigger on complex experiments | COMMENT |
| LOW | config.researchclaw.example.yaml | 161 | # 2. Lab server (Docker — most secure): | COMMENT |
| LOW | config.researchclaw.example.yaml | 181 | # setup_commands: | COMMENT |
| LOW | config.researchclaw.example.yaml | 221 | COMMENT | |
| LOW | prompts.default.yaml | 1 | # ============================================================================= | COMMENT |
| LOW | sentinel.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/config/statistics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML11.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML07.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML06.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML10.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML21.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML17.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML01.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML16.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML20.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML19.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML23.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML03.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML15.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML14.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML02.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML22.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML18.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML05.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML13.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML09.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML25.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML24.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML08.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML12.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/ml/manifests/ML04.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/physics/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P01.yaml | 81 | COMMENT | |
| LOW | experiments/arc_bench/config/physics/manifests/P06.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P10.yaml | 81 | - process_id: "mumu_to_bbbar_U1_3and14tev" | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P07.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P08.yaml | 81 | # Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judge | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P04.yaml | 81 | # Agent-mode requirements (consumed by researchclaw.pipeline.requirements_judge | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P05.yaml | 81 | rubric_path: "experiments/arc_bench/config/physics/rubrics/P05.json" | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P09.yaml | 81 | gpu_required: false | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P02.yaml | 81 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | experiments/arc_bench/config/physics/manifests/P03.yaml | 81 | estimated_wall_clock_sec: 3600 | COMMENT |
| LOW | experiments/arc_bench/config/quantum/topics.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/quantum/manifests/Q08.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | experiments/arc_bench/config/quantum/manifests/Q05.yaml | 1 | # ============================================================================ | COMMENT |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 101 | ) | COMMENT |
| LOW | …ments/arc_bench/baseline/adapters/agent_lab_adapter.py | 121 | # *internal control-flow pathologies* (lit-review SUMMARY-loop never | COMMENT |
| LOW | experiments/arc_bench/scripts/judge_paper_manual.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/run_agent_lab.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/run_aide.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/judge.py | 821 | # BUG-FIX: Prefer `<primary>_mean` over the single-value | COMMENT |
| LOW | experiments/arc_bench/scripts/run_ais_v2.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | experiments/arc_bench/scripts/_inject_p_requirements.py | 101 | ), | COMMENT |
| LOW | tests/test_rc_contracts.py | 101 | COMMENT | |
| LOW | docs/DOMAIN_INTEGRATION_GUIDE.md | 121 | # Only set this if you added a LAYER 5 sandbox + EXPERIMENT_MODE. | COMMENT |
| LOW | researchclaw/config.py | 401 | # Default points at the symlink under external/agents/ (see | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_literature.py | 701 | overlap = sum(1 for kw in topic_keywords if kw in text_blob) | COMMENT |
| 6 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | config.researchclaw.example.yaml | 184 | # 4. Colab via Google Drive (most robust, no SSH needed): | COMMENT |
| MEDIUM | experiments/arc_bench/scripts/run_ais_v2.py | 476 | # encode the ablation axis levels, e.g. "scaler = robust"). | COMMENT |
| MEDIUM | experiments/arc_bench/scripts/run_bench.py | 38 | # Paper-replication harness we reuse. We import the finalizer directly; the | COMMENT |
| MEDIUM⚡ | tests/test_hep_incremental.py | 404 | """The _merge_docs helper is robust to None / non-dict inputs.""" | STRING |
| MEDIUM | tests/test_hitl_branching.py | 177 | (s7 / "synthesis.md").write_text("# Synthesis\nGap: no robust evaluation") | CODE |
| MEDIUM⚡ | tests/test_rc_executor.py | 3091 | # Check that harness was injected (BUG-DA8-06: dir is now _project_{N}) | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 3115 | # The real harness should be there, not the fake one (BUG-DA8-06) | COMMENT |
| MEDIUM⚡ | scripts/test_codegen_v2.py | 266 | # Code quality analysis (comprehensive) | STRING |
| MEDIUM | researchclaw/domains/detector.py | 96 | # Experiment paradigm | COMMENT |
| MEDIUM | researchclaw/agents/benchmark_agent/acquirer.py | 29 | """Ask LLM to generate a robust data loading function.""" | STRING |
| MEDIUM⚡ | researchclaw/experiment/validator.py | 198 | # Runtime-injected by the experiment harness | COMMENT |
| MEDIUM | researchclaw/experiment/harness_template.py | 110 | # Convenience: create a default harness when imported | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 384 | # R5-4: Inject immutable experiment harness before copying project files | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 387 | # Copy all project files (will NOT overwrite harness — harness name is unique) | COMMENT |
| MEDIUM⚡ | researchclaw/experiment/sandbox.py | 391 | # Do not allow project to overwrite the harness | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 130 | # Inject experiment harness | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 159 | # Inject harness first (immutable) | COMMENT |
| MEDIUM | researchclaw/experiment/docker_sandbox.py | 162 | # Copy project files and subdirectories (skip harness overwrite) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_rc_novelty.py | 237 | # Create a mock paper with overlapping keywords | COMMENT |
| MEDIUM | tests/test_rc_cli.py | 375 | # Create a fake previous run directory with a checkpoint | COMMENT |
| MEDIUM⚡ | tests/test_experiment_repair.py | 649 | # Create a rich existing stage-14 summary | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 3084 | # Create a project dir | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 3107 | # Create a project with a fake experiment_harness.py | COMMENT |
| MEDIUM⚡ | tests/test_rc_executor.py | 3140 | # Create a run with very long stdout | COMMENT |
| MEDIUM⚡ | tests/test_fabrication_guards.py | 174 | # Create a failed experiment_summary.json | COMMENT |
| MEDIUM⚡ | tests/test_evolution_aevolve.py | 358 | # Create a fake .claude/skills/test-skill/SKILL.md | COMMENT |
| MEDIUM | researchclaw/llm/acp_client.py | 149 | # Create the session | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 812 | # This file is a domain blueprint. Dropping it into one of the profile | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | README.md | 73 | - **[03/30/2026]** **Flexible Skill Loading** — AutoResearchClaw now supports loading open-source and custom skills from | CODE |
| MEDIUM | experiments/arc_bench/README.md | 31 | │ │ # (paper-content / code-orchestration / | CODE |
| MEDIUM | experiments/arc_bench/baseline/adapters/aide_adapter.py | 75 | # not embed any phase-specific scaffolding into goal/eval". Kept as | COMMENT |
| MEDIUM | experiments/arc_bench/baseline/interventions/T02.json | 9 | "guidance": "- **Canonical result table first**: create one long-form DataFrame with columns `[dataset, noise_leve | CODE |
| MEDIUM⚡ | tests/test_web_integration.py | 100 | # WebSearchAgent — orchestration | COMMENT |
| MEDIUM | docs/DOMAIN_INTEGRATION_GUIDE.md | 148 | # ── Code-gen file scaffold (consumed by adapter.get_blueprint_context) ──── | COMMENT |
| MEDIUM | docs/HITL_GUIDE.md | 17 | 9. [Safety & Guardrails](#9-safety--guardrails) | CODE |
| MEDIUM | researchclaw/evolution.py | 85 | PIPELINE = "pipeline" # Stage orchestration issues | CODE |
| MEDIUM | researchclaw/pipeline/code_agent.py | 1125 | # Extract context window: ±30 lines around error | COMMENT |
| MEDIUM | researchclaw/pipeline/tournament.py | 138 | # candidates_succeeded, gets fed to the judge (which can hallucinate a score | COMMENT |
| MEDIUM | researchclaw/pipeline/stage_impls/_analysis.py | 657 | # Try FigureAgent first (multi-agent intelligent charts), fall back to visualize.py | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_code_generation.py | 737 | # for internal chain-of-thought). Retry once with even higher limit on empty. | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_code_generation.py | 1223 | # real orchestration (more lines + __main__ guard), prefer it | STRING |
| MEDIUM | researchclaw/pipeline/stage_impls/_synthesis.py | 183 | # instead of sending empty context to the LLM (pure hallucination). | STRING |
| MEDIUM | researchclaw/domains/deploy.py | 195 | # Nested-block fields: entire sub-dicts (e.g. collider_agent, agentic, | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 327 | # 3. Nested experiment sub-blocks (collider_agent, agentic, ...). | COMMENT |
| MEDIUM | researchclaw/domains/deploy.py | 962 | # Strip None/empty entries before scaffolding so the rendered YAML | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_v6_improvements.py | 592 | # Step 1: IMP-15 dedup | STRING |
| LOW | tests/test_v6_improvements.py | 606 | # Step 2: IMP-14 cite stripping | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 177 | # Step 1: Complexity scoring | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 193 | # Step 2: Check OpenCode availability | STRING |
| LOW⚡ | scripts/test_beast_mode_e2e.py | 201 | # Step 3: Create test workspace and invoke | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 243 | # Step 4: Evaluate results | STRING |
| LOW | scripts/test_beast_mode_e2e.py | 286 | # Step 5: Quality evaluation | STRING |
| LOW⚡ | researchclaw/evolution_aevolve.py | 452 | # Step 1: Solve — evidence is already collected (lessons + results) | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 455 | # Step 2: Observe | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 462 | # Step 3: Evolve | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 471 | # Step 4: Gate | COMMENT |
| LOW⚡ | researchclaw/evolution_aevolve.py | 479 | # Step 5: Reload | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 198 | ## Step 1: Execute the phenomenology pipeline | COMMENT |
| LOW⚡ | researchclaw/pipeline/stage_impls/_code_generation.py | 201 | ## Step 2: Generate output figures | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2038 | # Step 1: Convert multi-key brackets [key1, key2] → \cite{key1, key2} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2052 | # Step 2: Convert single-key brackets [key] → \cite{key} | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 2063 | # Step 3: Merge adjacent \cite{a} \cite{b} → \cite{a, b} | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 125 | # Step 1: Detect research domain | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 129 | # Step 2: Analyze available data | COMMENT |
| LOW⚡ | researchclaw/agents/figure_agent/planner.py | 134 | # Step 3: Generate figure plan via LLM | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1349 | # Step 3: Escape special characters | COMMENT |
| LOW⚡ | researchclaw/templates/converter.py | 1359 | # Step 4: Restore protected regions | COMMENT |
| LOW | researchclaw/templates/converter.py | 1323 | # Step 1: Convert Python-style end-of-line comments → \COMMENT{...} | COMMENT |
| LOW | researchclaw/templates/converter.py | 1336 | # Step 2: Protect existing LaTeX commands and math mode from escaping | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | config.researchclaw.example.yaml | 131 | use_docker: false # Set true to run experiments inside Docker on remote host | CODE |
| LOW | sentinel.sh | 108 | # Check if any child processes exist | COMMENT |
| LOW | scripts/test_code_agent_sandbox.py | 240 | # Write files | COMMENT |
| LOW⚡ | scripts/test_codegen_v2.py | 453 | # Write files | COMMENT |
| LOW | scripts/test_codegen_v2.py | 731 | # Write files | COMMENT |
| LOW | researchclaw/hardware.py | 257 | # Check if already installed | COMMENT |
| LOW | researchclaw/pipeline/runner.py | 685 | # Check if repair loop should run | COMMENT |
| LOW | researchclaw/pipeline/runner.py | 1672 | # Check if we've met quality threshold | COMMENT |
| LOW | researchclaw/pipeline/experiment_diagnosis.py | 205 | # Check if only 1 condition | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 416 | # Check if value needs quoting: | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 811 | # Check if importing from a local module that exists | COMMENT |
| LOW | researchclaw/pipeline/code_agent.py | 1419 | # Write files to a numbered attempt directory | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_execution.py | 1028 | # Check if stdout contains condition labels | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_literature.py | 278 | # Check if query ends with a known search suffix | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 973 | # Check if this looks like a results/experiment table | COMMENT |
| LOW | researchclaw/pipeline/stage_impls/_review_publish.py | 1196 | # Check if we're leaving Results for a different top-level section | COMMENT |
| LOW | researchclaw/agents/figure_agent/renderer.py | 228 | # Check if it was saved relative to script CWD | COMMENT |
| LOW | researchclaw/agents/figure_agent/critic.py | 231 | # Check if script contains the expected values | COMMENT |
| LOW | researchclaw/experiment/validator.py | 657 | # Check if this class inherits from another class in the same file | COMMENT |
| LOW | researchclaw/experiment/validator.py | 686 | # Check if all overridden methods have identical AST to parent | COMMENT |
| LOW | researchclaw/experiment/validator.py | 760 | # Check if this variable is used later in the function | COMMENT |
| LOW | researchclaw/templates/converter.py | 1022 | # Check if previous line is a table caption (e.g. **Table 1: ...**) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | experiments/arc_bench/scripts/_inject_p_requirements.py | 132 | results.json metrics MUST contain at least 3 numeric (non-null, finite) | CODE |
| HIGH | researchclaw/servers/monitor.py | 24 | result = await _ssh_command(server.host, "nvidia-smi --query-gpu=utilization.gpu,memory.used,memory.total -- | CODE |
| HIGH | researchclaw/servers/slurm_executor.py | 92 | f"squeue -j {job_id} -h -o '%T' 2>/dev/null || sacct -j {job_id} -n -o State -P 2>/dev/null", | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | researchclaw/report.py | 16 | Generate a Markdown report from a pipeline run directory. Args: run_dir: Path to the run artifacts director | STRING |
| HIGH | researchclaw/memory/store.py | 92 | Add a new memory entry. Args: category: One of "ideation", "experiment", "writing". con | STRING |
| HIGH | researchclaw/hitl/workshops/paper.py | 84 | AI writes a section draft. Args: section_name: Name of the section. context: Relevant c | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sentinel.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/judge_paper_manual.sh | 25 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_agent_lab.sh | 12 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_aide.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_ais_v2.sh | 7 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_rc_full.sh | 6 | # Usage: | COMMENT |
| LOW | experiments/arc_bench/scripts/run_rc_copilot.sh | 8 | # Usage: | COMMENT |
| LOW | scripts/metaclaw_start.sh | 4 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/test_rc_quality.py | 80 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit." | CODE |
| LOW⚡ | tests/test_rc_quality.py | 80 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit." | CODE |
| LOW⚡ | tests/test_rc_quality.py | 82 | assert any("Lorem ipsum" in m.pattern_desc for m in matches) | CODE |
| LOW | tests/test_rc_literature.py | 69 | {"authorId": "2", "name": "John Doe"}, | CODE |
| LOW | tests/test_rc_executor.py | 37 | base_url="http://fake", api_key="fake-key" | CODE |
| LOW⚡ | tests/test_rc_templates.py | 502 | tex = markdown_to_latex(self.SAMPLE_MD, NEURIPS_2024, authors="Jane Doe") | CODE |
| LOW⚡ | tests/test_decision_agent.py | 301 | _FakeLLM(), gemini_api_key="fake-key", use_sdk=False, | CODE |
| LOW⚡ | tests/test_decision_agent.py | 640 | api_key="fake-key", | CODE |
| LOW | tests/test_decision_agent.py | 677 | api_key="fake-key", | CODE |
| LOW | researchclaw/quality.py | 23 | (r"(?i)lorem\s+ipsum", "Lorem ipsum filler"), | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | experiments/arc_bench/baseline/adapters/aide_adapter.py | 54 | CODE | |
| LOW | tests/test_servers.py | 21 | CODE | |
| LOW | researchclaw/pipeline/executor.py | 821 | CODE | |
| LOW | researchclaw/literature/verify.py | 974 | CODE | |
| LOW | researchclaw/agents/benchmark_agent/surveyor.py | 240 | CODE | |
| LOW | researchclaw/servers/registry.py | 14 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/test_opencode_bridge.py | 298 | (src / "utils.py").write_text("def helper(): pass") | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 511 | "utils.py": "def helper(): pass\n", | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 517 | files = {"utils.py": "def helper(): pass\n"} | CODE |
| LOW⚡ | tests/test_opencode_bridge.py | 581 | "utils.py": "def helper(): pass\n", | CODE |
| LOW | researchclaw/servers/dispatcher.py | 67 | async def execute_task(self, task_id: str) -> dict[str, Any]: | CODE |