Repository Analysis

alexzhang13/rlm

General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.

34.3 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of alexzhang13/rlm, a Python project with 5,257 GitHub stars. SynthScan v2.0 examined 36,548 lines of code across 155 source files, recording 740 pattern matches distributed across 17 syntactic categories. The overall adjusted score of 34.3 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

34.3
Adjusted Score
34.3
Raw Score
100%
Time Factor
2026-06-26
Last Push
5.3K
Stars
Python
Language
36.5K
Lines of Code
155
Files
740
Pattern Hits
2026-07-14
Scan Date
0.34
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 53MEDIUM 166LOW 521

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 740 distinct pattern matches across 17 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators132 hits · 408 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_ipython_repl.py121# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py123# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py147# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py149# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py168# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py170# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py196# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py198# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py237# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py239# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py266# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py268# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py310# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py312# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py370# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py372# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py458# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py460# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py495# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py497# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py515# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py517# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py530# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py532# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py544# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py546# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py549# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py551# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py601# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py603# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py715# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py717# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py766# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py768# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py24# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py26# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py84# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py86# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_depth_metadata.py44# ========================================================================COMMENT
MEDIUMtests/test_depth_metadata.py46# ========================================================================COMMENT
MEDIUMtests/test_depth_metadata.py379# ========================================================================COMMENT
MEDIUMtests/test_depth_metadata.py381# ========================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py95# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py97# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py25# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py27# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py51# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py53# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py333# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py335# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py16# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py18# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py141# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py143# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py199# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py201# =============================================================================COMMENT
MEDIUMrlm/logger/verbose.py20# ============================================================================COMMENT
MEDIUMrlm/logger/verbose.py22# ============================================================================COMMENT
MEDIUMrlm/environments/local_repl.py50# =============================================================================COMMENT
MEDIUMrlm/environments/local_repl.py52# =============================================================================COMMENT
72 more matches not shown…
Hyper-Verbose Identifiers298 hits · 293 pts
SeverityFileLineSnippetContext
LOWtests/test_multi_turn_integration.py41 def test_environment_reused_in_persistent_mode(self):CODE
LOWtests/test_multi_turn_integration.py65 def test_context_accumulation_across_calls(self):CODE
LOWtests/test_multi_turn_integration.py91 def test_history_accumulation_across_calls(self):CODE
LOWtests/test_multi_turn_integration.py119 def test_variable_persistence_across_completions(self):CODE
LOWtests/test_multi_turn_integration.py152 def test_prompt_includes_context_count(self):CODE
LOWtests/test_multi_turn_integration.py175 def test_prompt_includes_history_count(self):CODE
LOWtests/test_multi_turn_integration.py202 def test_can_access_previous_context_in_code(self):CODE
LOWtests/test_multi_turn_integration.py228 def test_can_access_history_in_code(self):CODE
LOWtests/test_multi_turn_integration.py258 def test_non_persistent_creates_fresh_environment(self):CODE
LOWtests/test_multi_turn_integration.py279 def test_default_is_non_persistent(self):CODE
LOWtests/test_multi_turn_integration.py291 def test_context_manager_cleanup(self):CODE
LOWtests/test_multi_turn_integration.py332 def test_unsupported_environment_raises_error(self):CODE
LOWtests/test_multi_turn_integration.py342 def test_local_environment_supported(self):CODE
LOWtests/test_multi_turn_integration.py353 def test_docker_environment_supported(self):CODE
LOWtests/test_multi_turn_integration.py369 def test_three_turn_conversation(self):CODE
LOWtests/test_parsing.py28 def test_multiple_code_blocks(self):CODE
LOWtests/test_parsing.py48 def test_non_repl_code_blocks_ignored(self):CODE
LOWtests/test_parsing.py62 def test_multiline_code_block(self):STRING
LOWtests/test_parsing.py81 def test_answer_dict_ready_true_sets_final_answer(self):CODE
LOWtests/test_parsing.py90 def test_answer_dict_unset_keeps_final_answer_none(self):CODE
LOWtests/test_parsing.py99 def test_answer_dict_rebind_with_ready(self):CODE
LOWtests/test_parsing.py108 def test_answer_content_can_be_non_string(self):CODE
LOWtests/test_parsing.py137 def test_excludes_private_vars(self):CODE
LOWtests/test_parsing.py153 def test_iteration_with_code_blocks(self):CODE
LOWtests/test_parsing.py167 def test_iteration_without_code_blocks(self):CODE
LOWtests/test_parsing.py177 def test_truncates_long_results(self):CODE
LOWtests/test_parsing.py208 def test_list_of_message_dicts(self):CODE
LOWtests/test_local_repl_persistent.py13 def test_add_context_versioning(self):CODE
LOWtests/test_local_repl_persistent.py24 def test_update_handler_address(self):CODE
LOWtests/test_local_repl_persistent.py31 def test_add_context_auto_increment(self):CODE
LOWtests/test_local_repl_persistent.py43 def test_contexts_accessible_in_code(self):CODE
LOWtests/test_local_repl_persistent.py54 def test_context_alias_points_to_first(self):CODE
LOWtests/test_local_repl_persistent.py91 def test_add_multiple_histories(self):CODE
LOWtests/test_local_repl_persistent.py108 def test_history_accessible_via_code(self):CODE
LOWtests/test_local_repl_persistent.py134 def test_can_iterate_histories_in_code(self):CODE
LOWtests/test_local_repl_persistent.py159 def test_variables_persist_with_contexts(self):CODE
LOWtests/test_local_repl_persistent.py174 def test_variables_persist_with_histories(self):CODE
LOWtests/test_local_repl_persistent.py189 def test_full_persistent_session_simulation(self):CODE
LOWtests/test_imports.py49 def test_openai_client_import(self):CODE
LOWtests/test_imports.py56 def test_anthropic_client_import(self):CODE
LOWtests/test_imports.py63 def test_portkey_client_import(self):CODE
LOWtests/test_imports.py249 def test_no_duplicate_names_in_rlm_all(self):CODE
LOWtests/test_imports.py259 def test_no_duplicate_names_in_logger_all(self):CODE
LOWtests/test_imports.py269 def test_all_declarations_match_exports(self):CODE
LOWtests/test_imports.py456 def test_all_environment_classes_importable(self):CODE
LOWtests/test_imports.py36 def test_clients_module_import(self):CODE
LOWtests/test_imports.py108 def test_core_lm_handler_import(self):CODE
LOWtests/test_imports.py114 def test_core_comms_utils_import(self):CODE
LOWtests/test_imports.py136 def test_environments_module_import(self):CODE
LOWtests/test_imports.py178 def test_get_environment_function(self):CODE
LOWtests/test_imports.py188 def test_logger_module_import(self):CODE
LOWtests/test_imports.py346 def test_no_naming_conflicts_across_modules(self):CODE
LOWtests/test_imports.py424 def test_all_client_classes_importable(self):CODE
LOWtests/test_docker_repl_persistent.py47 def test_satisfies_persistence_protocol(self, repl):CODE
LOWtests/test_docker_repl_persistent.py52 def test_add_context_versioning_and_access(self, repl):CODE
LOWtests/test_docker_repl_persistent.py59 def test_add_context_auto_increment(self, repl):CODE
LOWtests/test_docker_repl_persistent.py66 def test_context_alias_points_to_first(self, repl):CODE
LOWtests/test_docker_repl_persistent.py79 def test_add_history_versioning(self, repl):CODE
LOWtests/test_docker_repl_persistent.py88 def test_history_alias_points_to_first(self, repl):CODE
LOWtests/test_docker_repl_persistent.py93 def test_add_history_deep_copy(self, repl):CODE
238 more matches not shown…
Cross-File Repetition37 hits · 185 pts
SeverityFileLineSnippetContext
HIGHtests/test_multi_turn_integration.py0render a model response that submits ``content`` as the final answer.STRING
HIGHtests/test_subcall.py0render a model response that submits ``content`` as the final answer.STRING
HIGHtests/test_depth_metadata.py0render a model response that submits ``content`` as the final answer.STRING
HIGHrlm/environments/daytona_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/e2b_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/modal_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/daytona_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/e2b_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/modal_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/daytona_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/e2b_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/modal_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/daytona_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/modal_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/e2b_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/daytona_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/e2b_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/prime_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/modal_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/daytona_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/prime_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/modal_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/e2b_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/daytona_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/prime_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/modal_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/daytona_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/e2b_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/prime_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/modal_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/daytona_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/e2b_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/prime_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/modal_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/e2b_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
HIGHrlm/environments/prime_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
HIGHrlm/environments/modal_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
Excessive Try-Catch Wrapping118 hits · 118 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py46 except Exception:CODE
LOWtraining/environments/oolong/oolong/env.py61 except Exception:CODE
LOWtraining/environments/oolong/oolong/env.py66 except Exception:CODE
LOWtraining/src/rlm_train/worker.py133 except Exception:CODE
LOWtraining/src/rlm_train/worker.py224 except Exception:CODE
LOWtraining/src/rlm_train/worker.py232 except Exception as e:CODE
LOWtraining/src/rlm_train/env.py182 except Exception as e: # noqa: BLE001CODE
LOWtraining/src/rlm_train/env.py234 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py71 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py139 except Exception as e:CODE
LOWtraining/src/rlm_train/proxy.py147 except Exception as e: # noqa: BLE001CODE
LOWtraining/src/rlm_train/proxy.py153 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py164 except Exception as e:CODE
LOWtraining/src/rlm_train/proxy.py175 except Exception as e: # noqa: BLE001CODE
LOWtraining/src/rlm_train/proxy.py185 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py202 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py205 except Exception as e: # noqa: BLE001CODE
LOWtests/test_imports.py437 except Exception:CODE
LOWtests/test_imports.py445 except Exception:CODE
LOWtests/test_imports.py453 except Exception:CODE
LOWtests/test_imports.py475 except Exception:CODE
LOWtests/test_imports.py484 except Exception:CODE
LOWtests/test_docker_repl_persistent.py21 except Exception:CODE
LOWtests/test_docker_repl_robustness.py34 except Exception:CODE
LOWtests/clients/portkey.py19 except Exception as e:CODE
LOWrlm/core/rlm.py754 except Exception as e:CODE
LOWrlm/core/rlm.py801 except Exception:CODE
LOWrlm/core/rlm.py852 except Exception as e:CODE
LOWrlm/core/rlm.py869 except Exception:CODE
LOWrlm/core/lm_handler.py47 except Exception as e:CODE
MEDIUMrlm/core/lm_handler.py20def handle(self):CODE
LOWrlm/core/types.py33 except Exception:CODE
LOWrlm/core/types.py285 except Exception:CODE
LOWrlm/core/types.py302 except Exception:CODE
LOWrlm/core/comms_utils.py223 except Exception as e:CODE
LOWrlm/core/comms_utils.py266 except Exception as e:CODE
LOWrlm/environments/local_repl.py46 except Exception:CODE
LOWrlm/environments/local_repl.py279 except Exception as e:CODE
LOWrlm/environments/local_repl.py310 except Exception as e:CODE
LOWrlm/environments/local_repl.py329 except Exception as e:CODE
LOWrlm/environments/local_repl.py361 except Exception as e:CODE
LOWrlm/environments/local_repl.py378 except Exception as e:CODE
LOWrlm/environments/local_repl.py569 except Exception as e:CODE
LOWrlm/environments/local_repl.py596 except Exception:CODE
LOWrlm/environments/daytona_repl.py254 except Exception as e:CODE
LOWrlm/environments/daytona_repl.py238 except Exception as e:CODE
LOWrlm/environments/daytona_repl.py339except Exception as e:CODE
LOWrlm/environments/daytona_repl.py517 except Exception:STRING
LOWrlm/environments/daytona_repl.py563 except Exception:STRING
LOWrlm/environments/daytona_repl.py687 except Exception:STRING
LOWrlm/environments/daytona_repl.py693 except Exception:STRING
MEDIUMrlm/environments/ipython_repl.py148def handle(self) -> None:CODE
MEDIUMrlm/environments/ipython_repl.py663def _setup_in_process(self) -> None:CODE
MEDIUMrlm/environments/ipython_repl.py1507def __del__(self) -> None:CODE
LOWrlm/environments/ipython_repl.py158 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py161 except Exception:CODE
LOWrlm/environments/ipython_repl.py211 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py231 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py433 except Exception:CODE
LOWrlm/environments/ipython_repl.py872 except Exception as e:CODE
58 more matches not shown…
Cross-Language Confusion (JS/TS)9 hits · 58 pts
SeverityFileLineSnippetContext
HIGHdocs/src/app/page.tsx115print(result.response)`} />CODE
HIGHdocs/src/app/page.tsx131print(result.response)`} />CODE
HIGHdocs/src/app/page.tsx147print(result.response)`} />CODE
HIGHdocs/src/app/api/page.tsx26print(result.response)`} />CODE
HIGHdocs/src/app/trajectories/page.tsx61 print(f"Iteration {iteration['iteration']}")CODE
HIGHdocs/src/app/trajectories/page.tsx62 print(f"Prompt: {iteration['prompt'][:100]}...")CODE
HIGHdocs/src/app/trajectories/page.tsx63 print(f"Code: {iteration.get('code', 'N/A')}")CODE
HIGHdocs/src/app/trajectories/page.tsx64 print(f"Result: {iteration.get('result', {}).get('stdout', 'N/A')}")CODE
HIGHdocs/src/app/trajectories/page.tsx65 print("---")`} />CODE
Unused Imports39 hits · 37 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py3CODE
LOWtraining/environments/oolong/oolong/__init__.py1CODE
LOWtraining/src/rlm_train/rubric.py3CODE
LOWtraining/src/rlm_train/worker.py3CODE
LOWtraining/src/rlm_train/env.py3CODE
LOWtraining/src/rlm_train/proxy.py3CODE
LOWtraining/src/rlm_train/__init__.py1CODE
LOWtraining/src/rlm_train/__init__.py2CODE
LOWtraining/src/rlm_train/__init__.py2CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py4CODE
LOWtraining/src/rlm_train/repl/subprocess.py3CODE
LOWtraining/src/rlm_train/repl/__init__.py1CODE
LOWtraining/src/rlm_train/repl/__init__.py1CODE
LOWtraining/src/rlm_train/repl/__init__.py2CODE
LOWtraining/src/rlm_train/repl/base.py1CODE
LOWtests/test_ipython_repl.py10CODE
LOWtests/test_ipython_repl.py30CODE
LOWtests/test_ipython_repl.py31CODE
LOWrlm/__init__.py1CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/logger/__init__.py1CODE
LOWrlm/logger/__init__.py2CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/ipython_repl.py18CODE
Deep Nesting36 hits · 33 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py91CODE
LOWtraining/src/rlm_train/worker.py351CODE
LOWtraining/src/rlm_train/worker.py171CODE
LOWtraining/src/rlm_train/worker.py309CODE
LOWtraining/src/rlm_train/proxy.py39CODE
LOWtraining/src/rlm_train/proxy.py157CODE
LOWtraining/src/rlm_train/proxy.py212CODE
LOWtests/test_subcall.py361CODE
LOWrlm/clients/__init__.py11CODE
LOWrlm/clients/gemini.py97CODE
LOWrlm/clients/openai.py54CODE
LOWrlm/clients/openai.py148CODE
LOWrlm/clients/anthropic.py66CODE
LOWrlm/core/rlm.py326CODE
LOWrlm/core/types.py270CODE
LOWrlm/environments/local_repl.py335CODE
LOWrlm/environments/local_repl.py514CODE
LOWrlm/environments/local_repl.py547CODE
LOWrlm/environments/daytona_repl.py156CODE
LOWrlm/environments/daytona_repl.py568CODE
LOWrlm/environments/__init__.py45CODE
LOWrlm/environments/ipython_repl.py1143CODE
LOWrlm/environments/ipython_repl.py1263CODE
LOWrlm/environments/ipython_repl.py1303CODE
LOWrlm/environments/e2b_repl.py393CODE
LOWrlm/environments/docker_repl.py217CODE
LOWrlm/environments/docker_repl.py74CODE
LOWrlm/environments/prime_repl.py463CODE
LOWrlm/environments/modal_repl.py396CODE
LOWrlm/utils/parsing.py110CODE
LOWrlm/utils/token_utils.py92CODE
LOWexamples/depth_metadata_example.py31CODE
LOWexamples/depth_metadata_example.py77CODE
LOWexamples/rlm_query_batched_example.py31CODE
LOWexamples/rlm_query_batched_example.py74CODE
LOWexamples/daytona_repl_example.py38CODE
Modern AI Meta-Vocabulary14 hits · 27 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_ipython_repl.py731 # parent REPL. Any other scaffold (llm_query, SHOW_VARS, ...)COMMENT
MEDIUMtests/test_local_repl.py219 # After scaffold restore, the rebound dict has been wrapped back into theCOMMENT
MEDIUMrlm/environments/local_repl.py564 # Restore scaffold so model overwrites (context = ..., llm_query = ...) don't persistCOMMENT
MEDIUMrlm/environments/daytona_repl.py345# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/ipython_repl.py595 # mode the LM can reach this REPL via any scaffold bound method'sSTRING
MEDIUMrlm/environments/ipython_repl.py602 # scaffold is plain functions with no ``__self__``.STRING
MEDIUMrlm/environments/ipython_repl.py700 # Inject scaffold functionsSTRING
MEDIUMrlm/environments/ipython_repl.py754 # Bootstrap scaffold inside the kernelSTRING
MEDIUMrlm/environments/ipython_repl.py1107 # scaffold bound method) to call back into the parent. TheSTRING
MEDIUMrlm/environments/ipython_repl.py1216 # Re-inject scaffold in case user code overwrote itSTRING
MEDIUMrlm/environments/e2b_repl.py240# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/docker_repl.py388# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/prime_repl.py256# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/modal_repl.py257# Restore scaffold aliases if overwritten by executed codeCOMMENT
Structural Annotation Overuse9 hits · 18 pts
SeverityFileLineSnippetContext
LOWdocs/getting-started.md67### Step 1: Set Up API KeysCOMMENT
LOWdocs/getting-started.md78### Step 2: Basic UsageCOMMENT
LOWdocs/getting-started.md101### Step 3: Enable Verbose OutputCOMMENT
LOWdocs/src/components/CodeBlock.tsx36 // Step 1: Protect strings by replacing with markersCOMMENT
LOWdocs/src/components/CodeBlock.tsx44 // Step 2: Highlight keywordsCOMMENT
LOWdocs/src/components/CodeBlock.tsx48 // Step 3: Highlight functionsCOMMENT
LOWdocs/src/components/CodeBlock.tsx51 // Step 4: Highlight numbersCOMMENT
LOWdocs/src/components/CodeBlock.tsx54 // Step 5: Highlight commentsCOMMENT
LOWdocs/src/components/CodeBlock.tsx57 // Step 6: Restore strings with highlightingCOMMENT
Cross-Language Confusion5 hits · 18 pts
SeverityFileLineSnippetContext
HIGHrlm/environments/daytona_repl.py42 "apt-get update && apt-get install -y build-essential \CODE
HIGHrlm/environments/docker_repl.py747 "rm -rf /workspace/* /workspace/.[!.]* 2>/dev/null || true",STRING
HIGHrlm/environments/prime_repl.py420 f"cat {self.broker_job.stdout_log_file} 2>/dev/null || echo 'No stdout log'",STRING
HIGHrlm/environments/prime_repl.py424 f"cat {self.broker_job.stderr_log_file} 2>/dev/null || echo 'No stderr log'",STRING
HIGHrlm/environments/prime_repl.py355 apt_cmd = "apt-get update && apt-get install -y " + " ".join(APT_PACKAGES)STRING
Verbosity Indicators6 hits · 14 pts
SeverityFileLineSnippetContext
LOWdocs/src/components/CodeBlock.tsx36 // Step 1: Protect strings by replacing with markersCOMMENT
LOWdocs/src/components/CodeBlock.tsx44 // Step 2: Highlight keywordsCOMMENT
LOWdocs/src/components/CodeBlock.tsx48 // Step 3: Highlight functionsCOMMENT
LOWdocs/src/components/CodeBlock.tsx51 // Step 4: Highlight numbersCOMMENT
LOWdocs/src/components/CodeBlock.tsx54 // Step 5: Highlight commentsCOMMENT
LOWdocs/src/components/CodeBlock.tsx57 // Step 6: Restore strings with highlightingCOMMENT
Modern Structural Boilerplate16 hits · 13 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py186__all__ = ["load_environment"]CODE
LOWtraining/environments/oolong/oolong/__init__.py3__all__ = ["load_environment"]CODE
LOWtraining/src/rlm_train/worker.py161 def _setup_namespace(self) -> None:CODE
LOWtraining/src/rlm_train/env.py26logger = logging.getLogger(__name__)CODE
LOWtraining/src/rlm_train/proxy.py14logger = logging.getLogger(__name__)CODE
LOWtraining/src/rlm_train/__init__.py8__all__ = [CODE
LOWtraining/src/rlm_train/repl/__init__.py4__all__ = ["ReplBackend", "ExecResult", "SubprocessReplBackend"]CODE
LOWrlm/__init__.py10__all__ = [CODE
LOWrlm/logger/__init__.py4__all__ = ["RLMLogger", "VerbosePrinter"]CODE
LOWrlm/environments/local_repl.py441 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOWrlm/environments/__init__.py28__all__ = [CODE
LOWrlm/environments/ipython_repl.py1079 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOWrlm/environments/ipython_repl.py663 def _setup_in_process(self) -> None:STRING
LOWrlm/environments/ipython_repl.py713 def _setup_subprocess(self) -> None:STRING
LOWrlm/environments/base_env.py314 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOWrlm/environments/docker_repl.py573 def update_handler_address(self, address: tuple[str, int]) -> None:STRING
Self-Referential Comments6 hits · 10 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_subcall.py46 # Create a fake child RLM class to capture initialization paramsCOMMENT
MEDIUMtests/clients/test_timeout.py62 # Create a mock client that raises timeoutCOMMENT
MEDIUMrlm/environments/daytona_repl.py497 # Create a session for the broker serverSTRING
MEDIUMrlm/environments/e2b_repl.py313 # Create the sandbox using the recommended Sandbox.create() APISTRING
MEDIUMrlm/environments/prime_repl.py338 # Create the clientSTRING
MEDIUMrlm/environments/prime_repl.py341 # Create the sandboxSTRING
Magic Placeholder Names2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHdocs/getting-started.md356 "API_KEY": "your-api-key", # Non-callable values become variablesCODE
HIGHdocs/getting-started.md381 "API_KEY": {"tool": "your-api-key", "description": "API key for the weather service"},CODE
AI Structural Patterns10 hits · 8 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py149CODE
LOWtraining/src/rlm_train/env.py32CODE
LOWrlm/core/rlm.py49CODE
LOWrlm/core/rlm.py704CODE
LOWrlm/environments/local_repl.py153CODE
LOWrlm/environments/daytona_repl.py378CODE
LOWrlm/environments/ipython_repl.py520CODE
LOWrlm/environments/docker_repl.py425CODE
LOWrlm/environments/prime_repl.py289CODE
LOWrlm/environments/modal_repl.py290CODE
Redundant / Tautological Comments1 hit · 2 pts
SeverityFileLineSnippetContext
LOWtests/test_imports.py332 # Check if dependency is availableCOMMENT
Over-Commented Block2 hits · 1 pts
SeverityFileLineSnippetContext
LOWrlm/environments/ipython_repl.py581 self._lock = threading.RLock()COMMENT
LOWrlm/environments/ipython_repl.py601 # is already shielded by process isolation: the kernel-sideCOMMENT