Home / alexzhang13 / rlm
AI Slop Code RIsk Monitor

alexzhang13/rlm

General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.

40.0 High pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for alexzhang13/rlm, a Python project with 5,678 GitHub stars. SynthScan examined 36,550 lines of code across 155 source files, recording 785 pattern matches distributed across 18 syntactic categories. The legacy adjusted pattern signal is 40.0 (High pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

40.0
Adjusted Signal
40.0
Raw Pattern Score
100%
Time Factor
2026-09-24
Last Push
5.7K
Stars
Python
Language
36.5K
Lines of Code
155
Files
785
Pattern Hits
2026-10-12
Scan Date
0.63
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 42.1/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 382 finding(s).

Hallucinated Dependency & Supply Chain Risk 15.4/100 · LOW

Are imports declared and package/API names verified? 55 finding(s).

Agent Over-Engineering Ratio 81.6/100 · CRITICAL

Are wrappers, guards, and repeated structures necessary? 656 finding(s).

PR Review Velocity Impact 88.9/100 · CRITICAL

Which changes need focused human review? 785 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 98MEDIUM 166LOW 521

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 785 distinct pattern matches across 18 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Decorative Section Separators132 hits · 404 pts
SeverityFileLineSnippetContext
MEDIUM⚡tests/test_ipython_repl.py121# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py123# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py147# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py149# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py168# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py170# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py196# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py198# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py237# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py239# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py266# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py268# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py310# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py312# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py370# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py372# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py458# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py460# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py495# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py497# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py515# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py517# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py530# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py532# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py544# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py546# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py549# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py551# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py601# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py603# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py715# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py717# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py766# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ipython_repl.py768# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py24# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py26# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py84# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ipython_repl.py86# -----------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_depth_metadata.py44# ========================================================================COMMENT
MEDIUM⚡tests/test_depth_metadata.py46# ========================================================================COMMENT
MEDIUM⚡tests/test_depth_metadata.py379# ========================================================================COMMENT
MEDIUM⚡tests/test_depth_metadata.py381# ========================================================================COMMENT
MEDIUM⚡tests/repl/test_custom_tools.py95# =============================================================================COMMENT
MEDIUM⚡tests/repl/test_custom_tools.py97# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py25# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py27# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py51# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py53# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py333# =============================================================================COMMENT
MEDIUMtests/repl/test_custom_tools.py335# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py16# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py18# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py141# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py143# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py199# =============================================================================COMMENT
MEDIUMrlm/core/comms_utils.py201# =============================================================================COMMENT
MEDIUMrlm/logger/verbose.py20# ============================================================================COMMENT
MEDIUMrlm/logger/verbose.py22# ============================================================================COMMENT
MEDIUM⚡rlm/environments/local_repl.py50# =============================================================================COMMENT
MEDIUM⚡rlm/environments/local_repl.py52# =============================================================================COMMENT
72 more matches not shown…
Hyper-Verbose Identifiers298 hits · 290 pts
SeverityFileLineSnippetContext
LOWtests/test_multi_turn_integration.py41 def test_environment_reused_in_persistent_mode(self):CODE
LOWtests/test_multi_turn_integration.py65 def test_context_accumulation_across_calls(self):CODE
LOWtests/test_multi_turn_integration.py91 def test_history_accumulation_across_calls(self):CODE
LOWtests/test_multi_turn_integration.py119 def test_variable_persistence_across_completions(self):CODE
LOWtests/test_multi_turn_integration.py152 def test_prompt_includes_context_count(self):CODE
LOWtests/test_multi_turn_integration.py175 def test_prompt_includes_history_count(self):CODE
LOWtests/test_multi_turn_integration.py202 def test_can_access_previous_context_in_code(self):CODE
LOWtests/test_multi_turn_integration.py228 def test_can_access_history_in_code(self):CODE
LOWtests/test_multi_turn_integration.py258 def test_non_persistent_creates_fresh_environment(self):CODE
LOWtests/test_multi_turn_integration.py279 def test_default_is_non_persistent(self):CODE
LOWtests/test_multi_turn_integration.py291 def test_context_manager_cleanup(self):CODE
LOWtests/test_multi_turn_integration.py332 def test_unsupported_environment_raises_error(self):CODE
LOWtests/test_multi_turn_integration.py342 def test_local_environment_supported(self):CODE
LOWtests/test_multi_turn_integration.py353 def test_docker_environment_supported(self):CODE
LOWtests/test_multi_turn_integration.py369 def test_three_turn_conversation(self):CODE
LOWtests/test_parsing.py28 def test_multiple_code_blocks(self):CODE
LOWtests/test_parsing.py48 def test_non_repl_code_blocks_ignored(self):CODE
LOWtests/test_parsing.py62 def test_multiline_code_block(self):STRING
LOW⚡tests/test_parsing.py81 def test_answer_dict_ready_true_sets_final_answer(self):CODE
LOW⚡tests/test_parsing.py90 def test_answer_dict_unset_keeps_final_answer_none(self):CODE
LOW⚡tests/test_parsing.py99 def test_answer_dict_rebind_with_ready(self):CODE
LOW⚡tests/test_parsing.py108 def test_answer_content_can_be_non_string(self):CODE
LOWtests/test_parsing.py137 def test_excludes_private_vars(self):CODE
LOWtests/test_parsing.py153 def test_iteration_with_code_blocks(self):CODE
LOWtests/test_parsing.py167 def test_iteration_without_code_blocks(self):CODE
LOWtests/test_parsing.py177 def test_truncates_long_results(self):CODE
LOWtests/test_parsing.py208 def test_list_of_message_dicts(self):CODE
LOWtests/test_local_repl_persistent.py13 def test_add_context_versioning(self):CODE
LOWtests/test_local_repl_persistent.py24 def test_update_handler_address(self):CODE
LOWtests/test_local_repl_persistent.py31 def test_add_context_auto_increment(self):CODE
LOWtests/test_local_repl_persistent.py43 def test_contexts_accessible_in_code(self):CODE
LOWtests/test_local_repl_persistent.py54 def test_context_alias_points_to_first(self):CODE
LOWtests/test_local_repl_persistent.py91 def test_add_multiple_histories(self):CODE
LOWtests/test_local_repl_persistent.py108 def test_history_accessible_via_code(self):CODE
LOWtests/test_local_repl_persistent.py134 def test_can_iterate_histories_in_code(self):CODE
LOWtests/test_local_repl_persistent.py159 def test_variables_persist_with_contexts(self):CODE
LOWtests/test_local_repl_persistent.py174 def test_variables_persist_with_histories(self):CODE
LOWtests/test_local_repl_persistent.py189 def test_full_persistent_session_simulation(self):CODE
LOW⚡tests/test_imports.py49 def test_openai_client_import(self):CODE
LOW⚡tests/test_imports.py56 def test_anthropic_client_import(self):CODE
LOW⚡tests/test_imports.py63 def test_portkey_client_import(self):CODE
LOW⚡tests/test_imports.py249 def test_no_duplicate_names_in_rlm_all(self):CODE
LOW⚡tests/test_imports.py259 def test_no_duplicate_names_in_logger_all(self):CODE
LOW⚡tests/test_imports.py269 def test_all_declarations_match_exports(self):CODE
LOW⚡tests/test_imports.py456 def test_all_environment_classes_importable(self):CODE
LOWtests/test_imports.py36 def test_clients_module_import(self):CODE
LOWtests/test_imports.py108 def test_core_lm_handler_import(self):CODE
LOWtests/test_imports.py114 def test_core_comms_utils_import(self):CODE
LOWtests/test_imports.py136 def test_environments_module_import(self):CODE
LOWtests/test_imports.py178 def test_get_environment_function(self):CODE
LOWtests/test_imports.py188 def test_logger_module_import(self):CODE
LOWtests/test_imports.py346 def test_no_naming_conflicts_across_modules(self):CODE
LOWtests/test_imports.py424 def test_all_client_classes_importable(self):CODE
LOW⚡tests/test_docker_repl_persistent.py47 def test_satisfies_persistence_protocol(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py52 def test_add_context_versioning_and_access(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py59 def test_add_context_auto_increment(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py66 def test_context_alias_points_to_first(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py79 def test_add_history_versioning(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py88 def test_history_alias_points_to_first(self, repl):CODE
LOW⚡tests/test_docker_repl_persistent.py93 def test_add_history_deep_copy(self, repl):CODE
238 more matches not shown…
Empty Error Handlers45 hits · 225 pts
SeverityFileLineSnippetContext
HIGHtraining/src/rlm_train/worker.py133except Exception:CODE
HIGHtraining/src/rlm_train/repl/subprocess.py153except TimeoutError:CODE
HIGHtraining/src/rlm_train/repl/subprocess.py81except (TimeoutError, BrokenPipeError, ConnectionResetError, WorkerProtocolError):CODE
HIGHtraining/src/rlm_train/repl/subprocess.py87except ProcessLookupError:CODE
HIGHtraining/src/rlm_train/repl/subprocess.py98except (asyncio.CancelledError, Exception):CODE
HIGHtests/test_imports.py437except Exception:CODE
HIGHtests/test_imports.py445except Exception:CODE
HIGHtests/test_imports.py453except Exception:CODE
HIGHtests/test_imports.py475except Exception:CODE
HIGHtests/test_imports.py484except Exception:CODE
HIGHtests/test_depth_metadata.py107except RuntimeError:CODE
HIGHtests/test_depth_metadata.py132except RuntimeError:CODE
HIGHrlm/core/rlm.py801except Exception:CODE
HIGHrlm/core/rlm.py869except Exception:CODE
HIGHrlm/core/lm_handler.py42except (BrokenPipeError, ConnectionError, ConnectionResetError, OSError):CODE
HIGHrlm/environments/local_repl.py596except Exception:CODE
HIGHrlm/environments/local_repl.py46except Exception:CODE
HIGHrlm/environments/daytona_repl.py561except requests.exceptions.RequestException:CODE
HIGHrlm/environments/daytona_repl.py563except Exception:CODE
HIGHrlm/environments/daytona_repl.py687except Exception:CODE
HIGHrlm/environments/daytona_repl.py693except Exception:CODE
HIGHrlm/environments/ipython_repl.py1497except Exception:CODE
HIGHrlm/environments/ipython_repl.py1510except Exception:CODE
HIGHrlm/environments/ipython_repl.py1480except Exception:CODE
HIGHrlm/environments/ipython_repl.py1484except Exception:CODE
HIGHrlm/environments/ipython_repl.py156except (BrokenPipeError, ConnectionError, ConnectionResetError, OSError):CODE
HIGHrlm/environments/ipython_repl.py649except Exception:CODE
HIGHrlm/environments/ipython_repl.py1341except Exception:CODE
HIGHrlm/environments/ipython_repl.py1456except Exception:CODE
HIGHrlm/environments/ipython_repl.py1462except Exception:CODE
HIGHrlm/environments/ipython_repl.py1468except Exception:CODE
HIGHrlm/environments/ipython_repl.py161except Exception:CODE
HIGHrlm/environments/e2b_repl.py356except Exception:CODE
HIGHrlm/environments/e2b_repl.py386except requests.exceptions.RequestException:CODE
HIGHrlm/environments/e2b_repl.py388except Exception:CODE
HIGHrlm/environments/e2b_repl.py500except Exception:CODE
HIGHrlm/environments/docker_repl.py110except (BrokenPipeError, ConnectionError, OSError):CODE
HIGHrlm/environments/prime_repl.py588except Exception:CODE
HIGHrlm/environments/prime_repl.py411except Exception:CODE
HIGHrlm/environments/prime_repl.py456except requests.exceptions.RequestException:CODE
HIGHrlm/environments/prime_repl.py458except Exception:CODE
HIGHrlm/environments/prime_repl.py582except Exception:CODE
HIGHrlm/environments/modal_repl.py389except requests.exceptions.RequestException:CODE
HIGHrlm/environments/modal_repl.py391except Exception:CODE
HIGHrlm/environments/modal_repl.py503except Exception:CODE
Cross-File Repetition37 hits · 185 pts
SeverityFileLineSnippetContext
HIGHtests/test_multi_turn_integration.py0render a model response that submits ``content`` as the final answer.STRING
HIGHtests/test_subcall.py0render a model response that submits ``content`` as the final answer.STRING
HIGHtests/test_depth_metadata.py0render a model response that submits ``content`` as the final answer.STRING
HIGHrlm/environments/daytona_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/e2b_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/modal_repl.py0import json import threading import uuid from flask import flask, request, jsonify app = flask(__name__) # request queueSTRING
HIGHrlm/environments/daytona_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/e2b_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/modal_repl.py0data = request.json request_id = str(uuid.uuid4()) event = threading.event() with lock: pending_requests[request_id] = {STRING
HIGHrlm/environments/daytona_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/e2b_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/modal_repl.py0with lock: pending = [ {"id": rid, "request": entry["request"]} for rid, entry in pending_requests.items() if entry["resSTRING
HIGHrlm/environments/daytona_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/modal_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/e2b_repl.py0data = request.json request_id = data.get("id") response = data.get("response") with lock: if request_id in pending_requSTRING
HIGHrlm/environments/daytona_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/e2b_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/prime_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/modal_repl.py0import sys import io import json import base64 import traceback import os import requests try: import dill except importSTRING
HIGHrlm/environments/daytona_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/prime_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/modal_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/e2b_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "single", "prompt": prompt, "model": model}}, tSTRING
HIGHrlm/environments/daytona_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/prime_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/modal_repl.py0try: response = requests.post( f"{{broker_url}}/enqueue", json={{"type": "batched", "prompts": prompts, "model": model, STRING
HIGHrlm/environments/daytona_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/e2b_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/prime_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/modal_repl.py0poll the broker for pending llm requests and handle them.STRING
HIGHrlm/environments/daytona_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/e2b_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/prime_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/modal_repl.py0' else: context_json = json.dumps(context_payload) escaped_json = context_json.replace("\\", "\\\\").replace("'", "\\'")STRING
HIGHrlm/environments/e2b_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
HIGHrlm/environments/prime_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
HIGHrlm/environments/modal_repl.py0build a script that executes code with state persistence. llm queries go through the local broker server.STRING
Excessive Try-Catch Wrapping118 hits · 111 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py46 except Exception:CODE
LOWtraining/environments/oolong/oolong/env.py61 except Exception:CODE
LOWtraining/environments/oolong/oolong/env.py66 except Exception:CODE
LOWtraining/src/rlm_train/worker.py133 except Exception:CODE
LOWtraining/src/rlm_train/worker.py224 except Exception:CODE
LOWtraining/src/rlm_train/worker.py232 except Exception as e:CODE
LOWtraining/src/rlm_train/env.py182 except Exception as e: # noqa: BLE001CODE
LOWtraining/src/rlm_train/env.py234 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py71 except Exception:CODE
LOW⚡training/src/rlm_train/proxy.py139 except Exception as e:CODE
LOW⚡training/src/rlm_train/proxy.py147 except Exception as e: # noqa: BLE001CODE
LOW⚡training/src/rlm_train/proxy.py153 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py164 except Exception as e:CODE
LOWtraining/src/rlm_train/proxy.py175 except Exception as e: # noqa: BLE001CODE
LOWtraining/src/rlm_train/proxy.py185 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py202 except Exception:CODE
LOWtraining/src/rlm_train/proxy.py205 except Exception as e: # noqa: BLE001CODE
LOW⚡tests/test_imports.py437 except Exception:CODE
LOW⚡tests/test_imports.py445 except Exception:CODE
LOW⚡tests/test_imports.py453 except Exception:CODE
LOWtests/test_imports.py475 except Exception:CODE
LOWtests/test_imports.py484 except Exception:CODE
LOWtests/test_docker_repl_persistent.py21 except Exception:CODE
LOWtests/test_docker_repl_robustness.py34 except Exception:CODE
LOWtests/clients/portkey.py19 except Exception as e:CODE
LOWrlm/core/rlm.py754 except Exception as e:CODE
LOWrlm/core/rlm.py801 except Exception:CODE
LOWrlm/core/rlm.py852 except Exception as e:CODE
LOWrlm/core/rlm.py869 except Exception:CODE
LOWrlm/core/lm_handler.py47 except Exception as e:CODE
MEDIUMrlm/core/lm_handler.py20def handle(self):CODE
LOWrlm/core/types.py33 except Exception:CODE
LOWrlm/core/types.py285 except Exception:CODE
LOWrlm/core/types.py302 except Exception:CODE
LOWrlm/core/comms_utils.py223 except Exception as e:CODE
LOWrlm/core/comms_utils.py266 except Exception as e:CODE
LOW⚡rlm/environments/local_repl.py46 except Exception:CODE
LOWrlm/environments/local_repl.py279 except Exception as e:CODE
LOWrlm/environments/local_repl.py310 except Exception as e:CODE
LOWrlm/environments/local_repl.py329 except Exception as e:CODE
LOWrlm/environments/local_repl.py361 except Exception as e:CODE
LOWrlm/environments/local_repl.py378 except Exception as e:CODE
LOWrlm/environments/local_repl.py569 except Exception as e:CODE
LOWrlm/environments/local_repl.py596 except Exception:CODE
LOW⚡rlm/environments/daytona_repl.py254 except Exception as e:CODE
LOWrlm/environments/daytona_repl.py238 except Exception as e:CODE
LOWrlm/environments/daytona_repl.py339except Exception as e:CODE
LOWrlm/environments/daytona_repl.py517 except Exception:STRING
LOWrlm/environments/daytona_repl.py563 except Exception:STRING
LOWrlm/environments/daytona_repl.py687 except Exception:STRING
LOWrlm/environments/daytona_repl.py693 except Exception:STRING
MEDIUMrlm/environments/ipython_repl.py148def handle(self) -> None:CODE
MEDIUMrlm/environments/ipython_repl.py663def _setup_in_process(self) -> None:CODE
MEDIUMrlm/environments/ipython_repl.py1507def __del__(self) -> None:CODE
LOWrlm/environments/ipython_repl.py158 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py161 except Exception:CODE
LOWrlm/environments/ipython_repl.py211 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py231 except Exception as e:CODE
LOWrlm/environments/ipython_repl.py433 except Exception:CODE
LOWrlm/environments/ipython_repl.py872 except Exception as e:CODE
58 more matches not shown…
Cross-Language Confusion (JS/TS)9 hits · 58 pts
SeverityFileLineSnippetContext
HIGHdocs/src/app/page.tsx115print(result.response)`} />CODE
HIGHdocs/src/app/page.tsx131print(result.response)`} />CODE
HIGHdocs/src/app/page.tsx147print(result.response)`} />CODE
HIGHdocs/src/app/api/page.tsx26print(result.response)`} />CODE
HIGH⚡docs/src/app/trajectories/page.tsx61 print(f"Iteration {iteration['iteration']}")CODE
HIGH⚡docs/src/app/trajectories/page.tsx62 print(f"Prompt: {iteration['prompt'][:100]}...")CODE
HIGH⚡docs/src/app/trajectories/page.tsx63 print(f"Code: {iteration.get('code', 'N/A')}")CODE
HIGH⚡docs/src/app/trajectories/page.tsx64 print(f"Result: {iteration.get('result', {}).get('stdout', 'N/A')}")CODE
HIGH⚡docs/src/app/trajectories/page.tsx65 print("---")`} />CODE
Unused Imports39 hits · 37 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py3CODE
LOWtraining/environments/oolong/oolong/__init__.py1CODE
LOWtraining/src/rlm_train/rubric.py3CODE
LOWtraining/src/rlm_train/worker.py3CODE
LOWtraining/src/rlm_train/env.py3CODE
LOWtraining/src/rlm_train/proxy.py3CODE
LOWtraining/src/rlm_train/__init__.py1CODE
LOWtraining/src/rlm_train/__init__.py2CODE
LOWtraining/src/rlm_train/__init__.py2CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py3CODE
LOWtraining/src/rlm_train/__init__.py4CODE
LOWtraining/src/rlm_train/repl/subprocess.py3CODE
LOWtraining/src/rlm_train/repl/__init__.py1CODE
LOWtraining/src/rlm_train/repl/__init__.py1CODE
LOWtraining/src/rlm_train/repl/__init__.py2CODE
LOWtraining/src/rlm_train/repl/base.py1CODE
LOWtests/test_ipython_repl.py10CODE
LOWtests/test_ipython_repl.py30CODE
LOWtests/test_ipython_repl.py31CODE
LOWrlm/__init__.py1CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/__init__.py2CODE
LOWrlm/logger/__init__.py1CODE
LOWrlm/logger/__init__.py2CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/__init__.py3CODE
LOWrlm/environments/ipython_repl.py18CODE
Deep Nesting36 hits · 32 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py91CODE
LOWtraining/src/rlm_train/worker.py351CODE
LOWtraining/src/rlm_train/worker.py171CODE
LOWtraining/src/rlm_train/worker.py309CODE
LOWtraining/src/rlm_train/proxy.py39CODE
LOWtraining/src/rlm_train/proxy.py157CODE
LOWtraining/src/rlm_train/proxy.py212CODE
LOWtests/test_subcall.py361CODE
LOWrlm/clients/__init__.py11CODE
LOWrlm/clients/gemini.py97CODE
LOWrlm/clients/openai.py54CODE
LOWrlm/clients/openai.py148CODE
LOWrlm/clients/anthropic.py66CODE
LOWrlm/core/rlm.py326CODE
LOWrlm/core/types.py270CODE
LOWrlm/environments/local_repl.py335CODE
LOWrlm/environments/local_repl.py514CODE
LOWrlm/environments/local_repl.py547CODE
LOWrlm/environments/daytona_repl.py156CODE
LOWrlm/environments/daytona_repl.py568CODE
LOWrlm/environments/__init__.py45CODE
LOWrlm/environments/ipython_repl.py1143CODE
LOWrlm/environments/ipython_repl.py1263CODE
LOWrlm/environments/ipython_repl.py1303CODE
LOWrlm/environments/e2b_repl.py393CODE
LOWrlm/environments/docker_repl.py217CODE
LOWrlm/environments/docker_repl.py74CODE
LOWrlm/environments/prime_repl.py463CODE
LOWrlm/environments/modal_repl.py396CODE
LOWrlm/utils/parsing.py110CODE
LOWrlm/utils/token_utils.py92CODE
LOWexamples/depth_metadata_example.py31CODE
LOWexamples/depth_metadata_example.py77CODE
LOWexamples/rlm_query_batched_example.py31CODE
LOWexamples/rlm_query_batched_example.py74CODE
LOWexamples/daytona_repl_example.py38CODE
Modern AI Meta-Vocabulary14 hits · 27 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_ipython_repl.py731 # parent REPL. Any other scaffold (llm_query, SHOW_VARS, ...)COMMENT
MEDIUM⚡tests/test_local_repl.py219 # After scaffold restore, the rebound dict has been wrapped back into theCOMMENT
MEDIUMrlm/environments/local_repl.py564 # Restore scaffold so model overwrites (context = ..., llm_query = ...) don't persistCOMMENT
MEDIUMrlm/environments/daytona_repl.py345# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/ipython_repl.py595 # mode the LM can reach this REPL via any scaffold bound method'sSTRING
MEDIUMrlm/environments/ipython_repl.py602 # scaffold is plain functions with no ``__self__``.STRING
MEDIUMrlm/environments/ipython_repl.py700 # Inject scaffold functionsSTRING
MEDIUMrlm/environments/ipython_repl.py754 # Bootstrap scaffold inside the kernelSTRING
MEDIUMrlm/environments/ipython_repl.py1107 # scaffold bound method) to call back into the parent. TheSTRING
MEDIUMrlm/environments/ipython_repl.py1216 # Re-inject scaffold in case user code overwrote itSTRING
MEDIUMrlm/environments/e2b_repl.py240# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/docker_repl.py388# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/prime_repl.py256# Restore scaffold aliases if overwritten by executed codeCOMMENT
MEDIUMrlm/environments/modal_repl.py257# Restore scaffold aliases if overwritten by executed codeCOMMENT
Structural Annotation Overuse9 hits · 18 pts
SeverityFileLineSnippetContext
LOWdocs/getting-started.md67### Step 1: Set Up API KeysCOMMENT
LOWdocs/getting-started.md78### Step 2: Basic UsageCOMMENT
LOWdocs/getting-started.md101### Step 3: Enable Verbose OutputCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx36 // Step 1: Protect strings by replacing with markersCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx44 // Step 2: Highlight keywordsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx48 // Step 3: Highlight functionsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx51 // Step 4: Highlight numbersCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx54 // Step 5: Highlight commentsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx57 // Step 6: Restore strings with highlightingCOMMENT
Cross-Language Confusion5 hits · 18 pts
SeverityFileLineSnippetContext
HIGHrlm/environments/daytona_repl.py42 "apt-get update && apt-get install -y build-essential \CODE
HIGHrlm/environments/docker_repl.py747 "rm -rf /workspace/* /workspace/.[!.]* 2>/dev/null || true",STRING
HIGH⚡rlm/environments/prime_repl.py420 f"cat {self.broker_job.stdout_log_file} 2>/dev/null || echo 'No stdout log'",STRING
HIGH⚡rlm/environments/prime_repl.py424 f"cat {self.broker_job.stderr_log_file} 2>/dev/null || echo 'No stderr log'",STRING
HIGHrlm/environments/prime_repl.py355 apt_cmd = "apt-get update && apt-get install -y " + " ".join(APT_PACKAGES)STRING
Verbosity Indicators6 hits · 14 pts
SeverityFileLineSnippetContext
LOW⚡docs/src/components/CodeBlock.tsx36 // Step 1: Protect strings by replacing with markersCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx44 // Step 2: Highlight keywordsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx48 // Step 3: Highlight functionsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx51 // Step 4: Highlight numbersCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx54 // Step 5: Highlight commentsCOMMENT
LOW⚡docs/src/components/CodeBlock.tsx57 // Step 6: Restore strings with highlightingCOMMENT
Modern Structural Boilerplate16 hits · 13 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py186__all__ = ["load_environment"]CODE
LOWtraining/environments/oolong/oolong/__init__.py3__all__ = ["load_environment"]CODE
LOWtraining/src/rlm_train/worker.py161 def _setup_namespace(self) -> None:CODE
LOWtraining/src/rlm_train/env.py26logger = logging.getLogger(__name__)CODE
LOWtraining/src/rlm_train/proxy.py14logger = logging.getLogger(__name__)CODE
LOWtraining/src/rlm_train/__init__.py8__all__ = [CODE
LOWtraining/src/rlm_train/repl/__init__.py4__all__ = ["ReplBackend", "ExecResult", "SubprocessReplBackend"]CODE
LOWrlm/__init__.py10__all__ = [CODE
LOWrlm/logger/__init__.py4__all__ = ["RLMLogger", "VerbosePrinter"]CODE
LOWrlm/environments/local_repl.py441 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOWrlm/environments/__init__.py28__all__ = [CODE
LOWrlm/environments/ipython_repl.py1079 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOW⚡rlm/environments/ipython_repl.py663 def _setup_in_process(self) -> None:STRING
LOWrlm/environments/ipython_repl.py713 def _setup_subprocess(self) -> None:STRING
LOWrlm/environments/base_env.py314 def update_handler_address(self, address: tuple[str, int]) -> None:CODE
LOWrlm/environments/docker_repl.py573 def update_handler_address(self, address: tuple[str, int]) -> None:STRING
Magic Placeholder Names2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHdocs/getting-started.md356 "API_KEY": "your-api-key", # Non-callable values become variablesCODE
HIGHdocs/getting-started.md381 "API_KEY": {"tool": "your-api-key", "description": "API key for the weather service"},CODE
Self-Referential Comments6 hits · 8 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_subcall.py46 # Create a fake child RLM class to capture initialization paramsCOMMENT
MEDIUMtests/clients/test_timeout.py62 # Create a mock client that raises timeoutCOMMENT
MEDIUMrlm/environments/daytona_repl.py497 # Create a session for the broker serverSTRING
MEDIUMrlm/environments/e2b_repl.py313 # Create the sandbox using the recommended Sandbox.create() APISTRING
MEDIUMrlm/environments/prime_repl.py338 # Create the clientSTRING
MEDIUMrlm/environments/prime_repl.py341 # Create the sandboxSTRING
AI Structural Patterns10 hits · 8 pts
SeverityFileLineSnippetContext
LOWtraining/environments/oolong/oolong/env.py149CODE
LOWtraining/src/rlm_train/env.py32CODE
LOWrlm/core/rlm.py49CODE
LOWrlm/core/rlm.py704CODE
LOWrlm/environments/local_repl.py153CODE
LOWrlm/environments/daytona_repl.py378CODE
LOWrlm/environments/ipython_repl.py520CODE
LOWrlm/environments/docker_repl.py425CODE
LOWrlm/environments/prime_repl.py289CODE
LOWrlm/environments/modal_repl.py290CODE
Redundant / Tautological Comments1 hit · 2 pts
SeverityFileLineSnippetContext
LOWtests/test_imports.py332 # Check if dependency is availableCOMMENT
Over-Commented Block2 hits · 1 pts
SeverityFileLineSnippetContext
LOWrlm/environments/ipython_repl.py581 self._lock = threading.RLock()COMMENT
LOWrlm/environments/ipython_repl.py601 # is already shielded by process isolation: the kernel-sideCOMMENT