AI Slop Code RIsk Monitor

marin-community/marin

Open-source framework for the research and development of foundation models.

17.7 Elevated pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for marin-community/marin, a Python project with 3,930 GitHub stars. SynthScan examined 1,088,848 lines of code across 4393 source files, recording 14832 pattern matches distributed across 27 syntactic categories. The legacy adjusted pattern signal is 17.7 (Elevated pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

17.7
Adjusted Signal
17.7
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
3.9K
Stars
Python
Language
1.1M
Lines of Code
4.4K
Files
14.8K
Pattern Hits
2026-10-12
Scan Date
0.09
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 40.3/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 11314 finding(s).

Hallucinated Dependency & Supply Chain Risk 6.7/100 · LOW

Are imports declared and package/API names verified? 902 finding(s).

Agent Over-Engineering Ratio 52.1/100 · HIGH

Are wrappers, guards, and repeated structures necessary? 12644 finding(s).

PR Review Velocity Impact 59.5/100 · HIGH

Which changes need focused human review? 14832 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 4HIGH 400MEDIUM 1404LOW 13024

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 14832 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers9892 hits · 9352 pts
SeverityFileLineSnippetContext
LOWinfra/pre-commit.py476def check_trailing_whitespace(files: list[pathlib.Path], fix: bool) -> int:CODE
LOWinfra/pre-commit.py602def check_markdown_precommit_invocation(files: list[pathlib.Path], fix: bool) -> int:CODE
LOWinfra/pre-commit.py669def _should_skip_skill_reference(reference: str) -> bool:CODE
LOWinfra/mkdocs_hooks.py13def _lower_external_inventory_failure(record: logging.LogRecord) -> bool:CODE
LOWinfra/check_docs_source_links.py73def _iter_relative_check_files() -> list[Path]:CODE
LOWinfra/lint/rules/cruft/ml-parallel-source-impl.yaml18 def reconcile_request_from_plan(plan): ... # new-wire builderCODE
LOWinfra/lint/rules/cruft/ml-parallel-source-impl.yaml19 def legacy_translator_request(plan): ... # old-wire builder from same plan.request.desiredCODE
LOW⚡infra/lint/rules/cruft/ml-slop-test.yaml62 def test_build_launch_command():CODE
LOW⚡infra/lint/rules/cruft/ml-slop-test.yaml70 def test_make_runner_returns_runner():CODE
LOW⚡infra/lint/rules/cruft/ml-slop-test.yaml73 def test_profile_has_remote_mcp():CODE
LOWinfra/lint/rules/prose/ml-vestigial-qualifier.yaml18 def reconcile_workers_via_reconcile(...): ... # stutter; just reconcile_workers.CODE
LOWinfra/ci/run_tests.py114def omit_locally_excluded_modules(invocation: PytestInvocation | None, repo_root: Path) -> PytestInvocation | None:CODE
LOWinfra/ci/select_tests.py418def dependencies_by_test_file(scope: str, repo_root: Path, known: set[str]) -> dict[str, set[str]]:CODE
LOWinfra/ci/select_tests.py519def _matching_resolution_markers(package: dict, active_extras: set[str]) -> tuple[str, ...] | None:CODE
LOWinfra/ci/select_tests.py626def levanter_tpu_dependencies_changed(base_ref: str | None, repo_root: Path) -> bool:CODE
LOWinfra/ci/select_tests.py789def torch_membership_for_test_file(path: Path) -> tuple[bool, bool]:CODE
LOWinfra/ci/select_tests.py981def selected_scope_test_paths(matrix: list[MatrixLeg], scope: str) -> list[str]:CODE
LOWinfra/ci/select_tests.py987def accelerator_suite_test_paths(CODE
LOWinfra/ci/analyze_import_graph.py51def all_dependencies_by_test_file(repo_root: Path, known: set[str]) -> dict[str, set[str]]:CODE
LOWinfra/ci/analyze_import_graph.py59def dependent_tests_by_module(test_deps: dict[str, set[str]]) -> dict[str, set[str]]:CODE
LOWinfra/deploy/tests/test_cli.py79def test_service_rollout_applies_stack_from_project_directory(CODE
LOWinfra/deploy/tests/test_cli.py109def test_service_rollout_loads_secret_environment(deployment_record: DeploymentRecord) -> None:CODE
LOWinfra/deploy/tests/test_cli.py124def test_service_rollout_preserves_pulumi_failure_exit_code(CODE
LOWinfra/grafana/tests/conftest.py22def install_finelog_dialect_macros(database) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py350def test_the_run_variable_offers_a_run_the_trainer_reported(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py363def test_the_trainer_panels_render_for_that_run(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py381def test_percentile_panels_compute_over_all_executions_in_each_bucket(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py423def test_the_node_agent_joins_through_node_name_without_a_run_id(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py434def test_the_engine_panels_select_by_metric_name_alone(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py456def test_a_trainer_that_stops_stamping_node_name_blanks_the_accelerator_panel(store) -> None:CODE
LOW⚡infra/grafana/tests/test_rl_runs_dashboard.py474def test_the_producer_census_separates_the_engine_series_from_the_trainer(store) -> None:CODE
LOW⚡infra/grafana/tests/test_rl_runs_dashboard.py482def test_the_census_still_answers_on_a_deployment_that_has_no_harbor_namespace(store) -> None:CODE
LOW⚡infra/grafana/tests/test_rl_runs_dashboard.py489def test_the_census_is_empty_rather_than_broken_on_a_deployment_holding_none_of_them() -> None:CODE
LOW⚡infra/grafana/tests/test_rl_runs_dashboard.py493def test_the_census_quotes_a_run_id_carrying_an_apostrophe() -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py510def test_every_timeseries_panel_declares_the_columns_its_projection_returns(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py528def test_every_panel_has_a_distinct_title_id_and_slot() -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py542def test_ray_panels_exclude_cumulative_snapshots_and_never_mix_states(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py552def test_engine_rates_keep_two_actors_that_both_report_engine_zero_apart(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py582def test_engine_panels_read_the_embedded_stream_as_well_as_the_standalone_one(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py614def test_every_labelled_series_panel_names_the_series_without_its_column() -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py634def test_a_listed_run_opens_the_view_framed_on_that_run() -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py663def test_a_listed_run_opens_the_dashboard_whose_picker_offers_it(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py714def test_the_recent_runs_query_returns_a_row_per_run_and_cluster(store) -> None:CODE
LOWinfra/grafana/tests/test_rl_runs_dashboard.py725def test_a_listed_run_opens_a_window_that_contains_its_last_sample(store) -> None:CODE
LOW⚡infra/grafana/tests/test_provisioning.py420def test_finelog_health_alert_pages_critical_after_five_minutes():CODE
LOW⚡infra/grafana/tests/test_provisioning.py428def test_finelog_relay_alert_pages_stalled_or_missing_namespaces():CODE
LOW⚡infra/grafana/tests/test_provisioning.py436def test_node_deadlock_alert_pages_critical_after_five_minutes():CODE
LOW⚡infra/grafana/tests/test_provisioning.py443def test_zephyr_stall_alert_is_a_warning_after_five_minutes():CODE
LOW⚡infra/grafana/tests/test_provisioning.py450def test_training_stall_alert_pages_each_hero_run_after_five_minutes():CODE
LOWinfra/grafana/tests/test_provisioning.py73def _create_levanter_stream_view(database: duckdb.DuckDBPyConnection) -> None:CODE
LOWinfra/grafana/tests/test_provisioning.py126def test_alert_rules_have_resolvable_datasources_and_refids():CODE
LOWinfra/grafana/tests/test_provisioning.py138def test_alert_rules_define_nodata_and_error_behavior():CODE
LOWinfra/grafana/tests/test_provisioning.py218def test_every_rule_query_url_answers_on_the_bridge():CODE
LOWinfra/grafana/tests/test_provisioning.py234def test_configured_finelog_query_dependent_alerts_stay_normal_when_query_path_is_unavailable():CODE
LOWinfra/grafana/tests/test_provisioning.py254def test_alert_queries_select_exactly_one_numeric_column():CODE
LOWinfra/grafana/tests/test_provisioning.py265def test_policies_reference_provisioned_contact_points():CODE
LOWinfra/grafana/tests/test_provisioning.py275def test_warning_alerts_remain_visible_without_notifications():CODE
LOWinfra/grafana/tests/test_provisioning.py294def test_coreweave_storage_capacity_pages_critical_ops():CODE
LOWinfra/grafana/tests/test_provisioning.py403def test_every_slack_alert_goes_through_the_bridge_and_none_through_grafana():CODE
LOWinfra/grafana/tests/test_provisioning.py467def test_training_loss_alert_selects_the_hero_operator_behavior():CODE
9832 more matches not shown…
Decorative Section Separators1230 hits · 4265 pts
SeverityFileLineSnippetContext
MEDIUMinfra/ci/select_tests.py228# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py230# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py295# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py297# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py346# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py348# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py429# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py431# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py834# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py836# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py1134# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/ci/select_tests.py1136# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py99# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py286# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py288# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py520# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py522# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py663# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py665# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py1021# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/codehealth/review_quality.py1023# ---------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py314# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py316# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py703# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py705# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py933# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/app.py935# --------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py162# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py164# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py212# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py214# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py249# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/samples.py251# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py241# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py243# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py413# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py415# --------------------------------------------------------------------------------------------------COMMENT
MEDIUMexperiments/ferries/daily.py41# ---------------------------COMMENT
MEDIUMexperiments/ferries/daily.py43# ---------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py50# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py57# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py106# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py108# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py191# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py196# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py242# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py244# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py269# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/grug/recovery/minimal_wedge_repro.py273# --------------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py128# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py130# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py174# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py176# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py279# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py281# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py509# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py511# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py613# ----------------------------------------------------------------------COMMENT
MEDIUMexperiments/datakit/scripts/sync_datakit.py615# ----------------------------------------------------------------------COMMENT
1170 more matches not shown…
Cross-Language Confusion138 hits · 766 pts
SeverityFileLineSnippetContext
HIGH⚡infra/tpu-ci/vm_manager.py145systemctl stop unattended-upgrades.service || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py146systemctl disable unattended-upgrades.service || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py147systemctl mask unattended-upgrades.service || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py148pkill -9 -f unattended-upgrade || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py149killall -9 apt apt-get || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py270 ./svc.sh stop || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py271 ./svc.sh uninstall || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py276 sudo -u $RUNNER_USER ./config.sh remove --token $REGISTRATION_TOKEN || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py621sudo journalctl -u google-startup-scripts.service -n {lines} --no-pager || echo "No startup script logs found"CODE
HIGH⚡infra/tpu-ci/vm_manager.py625grep "startup-script exit status" /var/log/syslog | tail -5 || echo "No completion marker found in syslog"CODE
HIGH⚡infra/tpu-ci/vm_manager.py631 cat ~/.docker/config.json | jq -r '.auths | keys[]' 2>/dev/null || echo "Unable to parse Docker auth config"CODE
HIGH⚡infra/tpu-ci/vm_manager.py664 -exec echo "{{}} ---" \\; -exec tail -n 50 {{}} \\; 2>/dev/null || trueCODE
HIGH⚡infra/tpu-ci/vm_manager.py669ps aux | grep -E "(Runner.Listener|Runner.Worker)" | grep -v grep || echo "No runner processes found"CODE
HIGH⚡infra/tpu-ci/vm_manager.py673sudo docker ps -a || trueCODE
HIGHinfra/tpu-ci/vm_manager.py165if ! command -v docker &> /dev/null; thenCODE
HIGHinfra/tpu-ci/vm_manager.py649sudo systemctl status actions.runner.* --no-pager || trueCODE
HIGHinfra/tpu-ci/vm_manager.py653sudo journalctl -u actions.runner.* -n {lines} --no-pager || trueCODE
HIGHinfra/tpu-ci/vm_manager.py775sudo rm -f /tmp/libtpu_lockfile || trueCODE
HIGHinfra/tpu-ci/vm_manager.py776sudo lsof -t /dev/vfio/* 2>/dev/null | xargs -r sudo kill -9 || trueCODE
HIGHinfra/ducky/__main__.py29DASHBOARD_BUILD = "cd lib/ducky/dashboard && { test -d node_modules || npm ci; } && npm run build"CODE
HIGH⚡infra/marina/tests/test_filer.py65 ("rows.jsonl", b'{"nested":{"a":[1,2]}}\n{"nested":null}\n', [{"nested": {"a": [1, 2]}}, {"nested": None}]),CODE
HIGHinfra/marina/src/marina/journeys.py47 if (!(element.offsetWidth || element.offsetHeight)) continueCODE
HIGHinfra/marina/src/marina/journeys.py53 seen.push(`${element.tagName.toLowerCase()}:${label}`)CODE
HIGH…g/task_curation/datasets/skyrl/scorers/ifeval_utils.py303# func actually accepts (the spec carries all possible keys, most set to null).COMMENT
HIGH⚡…/task_curation/datasets/tasktrove/repository_pytest.py38 git -c safe.directory="$ws" clean -ffdx -- "$path" >/dev/null 2>&1 || trueCODE
HIGH⚡…/task_curation/datasets/tasktrove/repository_pytest.py40 if git -c safe.directory="$ws" cat-file -e TRUSTED_SHA:"$path" 2>/dev/null; thenCODE
HIGH⚡…/task_curation/datasets/tasktrove/repository_pytest.py42 elif [ -n "FALLBACK_SHA" ] && git -c safe.directory="$ws" cat-file -e FALLBACK_SHA:"$path" 2>/dev/null; thenCODE
HIGH…aining/task_curation/datasets/tasktrove/swe_rebench.py60uv init --python 3.12 --no-progress >/dev/null 2>&1 || trueCODE
HIGH…ration/datasets/tasktrove/conversion/verifyit_build.py21 "RUN command -v git >/dev/null || (apt-get update && apt-get install -y --no-install-recommends git"CODE
HIGH…/post_training/task_curation/tests/test_swe_rebench.py75 b"uv init --python 3.12 --no-progress >/dev/null 2>&1 || true\n"CODE
HIGH…st_training/task_curation/tests/test_tasktrove_code.py65SEED_SCRIPT = b"mkdir -p /workspace && printf 'x' > /workspace/notes.txt\n"CODE
HIGH⚡experiments/rl_data_reviews/make_review.py43Positive observations MUST have kind observation and severity info or null; list actual defects with kind issue.CODE
HIGH⚡experiments/rl_data_reviews/make_review.py46"metrics": [{"key": string, "value": number|string|boolean|null, "scale": null}],CODE
HIGH⚡experiments/rl_data_reviews/make_review.py48"severity": "info"|"low"|"medium"|"high"|"critical"|null}],CODE
HIGHexperiments/rl_data_reviews/make_review.py59"metrics": [{"key": string, "value": number|string|boolean|null, "scale": null}],CODE
HIGHexperiments/rl_data_reviews/make_review.py61"severity": "info"|"low"|"medium"|"high"|"critical"|null}],CODE
HIGHexperiments/june_tpu_67b_a2b/moe/sft_67b_a2b_2stage.py44 cd ~/Documents/marin && source secrets.env # or "$DC_AGENT_SECRET_ENV"STRING
HIGHexperiments/sft/launcher.py535 # for a mixture, where epoch semantics are undefined) and keeps the ``auto_build_caches`` path.COMMENT
HIGHexperiments/datakit/decontam/viewer/report.py53 var vals=[],idxs=[];parts.forEach(function(p,i){if(isTok[i]){vals.push(p);idxs.push(i)}});CODE
HIGHtests/execution/test_artifact.py243 '{"name": "datasets/x", "version": "v1", "fingerprint": "abc", "result": null}'CODE
HIGHtests/inference/test_openai_batch.py78 return _Response(b'{"status":"completed","output_file_id":"output-1","error_file_id":null}')CODE
HIGHtests/inference/test_openai_batch.py357 b'{"status":"in_progress","request_counts":{"total":64,"completed":64,"failed":0},"output_file_id":null}'CODE
HIGHscripts/iris/dev_tpu.py507uv sync --all-packages --extra=tpu --python=3.12 || trueCODE
HIGHscripts/ci/wait_for.py241_RECORD_JQ = '.[]|{id:.id,author:(.user.login//""),body:(.body//""),url:(.html_url//""),state:(.state//null)}'CODE
HIGHlib/shellbox/tests/test_daytona_machine.py196 graded = await machine.run(Command(("sh", "-c", 'test "$(cat answer)" = 12 && printf 1.0')))CODE
HIGH⚡lib/shellbox/tests/test_local_machine.py347 script = "id -u; grep CapEff /proc/self/status; echo written > /tmp/user-file && echo wrote"CODE
HIGHlib/shellbox/tests/test_local_machine.py257 await machine.run(Command(("sh", "-c", "mkdir -p /logs/verifier && echo 0.5 > /logs/verifier/reward.txt")))CODE
HIGHlib/shellbox/tests/test_local_machine.py313 script = "touch /usr/shellbox-test 2>/dev/null || echo refused; touch /etc/shellbox-test 2>/dev/null || echo refusedCODE
HIGHlib/shellbox/src/shellbox/backends/iris/machine.py160 uid, name = (await self._checked("id -u && id -un")).split()CODE
HIGHlib/shellbox/src/shellbox/backends/qemu/machine.py295 check = await self.run(Command(("/bin/sh", "-c", "test -x /bin/bash && test -x /harbor/pty-agent")))CODE
HIGHlib/iris/tests/cluster/backends/k8s/test_coreweave.py653 deleting them on stop would break a plain `iris cluster stop && iris cluster start`.STRING
HIGHlib/iris/tests/cluster/node_agent/test_kubernetes.py437 assert metrics["n1"] == NodeMetrics() # present but all-null, not droppedCODE
HIGHlib/iris/tests/e2e/gpu_gang_smoke.py549 "patch", "pod", pod, "-n", self.namespace, "--type=merge", "-p", '{"metadata":{"finalizers":null}}'CODE
HIGHlib/iris/tests/e2e/test_smoke.py814 return routeReady && loaded;CODE
HIGHlib/iris/src/iris/cluster/setup_scripts.py194 'cd "$IRIS_WORKDIR" 2>/dev/null || true\n'STRING
HIGH⚡lib/iris/src/iris/cluster/platforms/vm_lifecycle.py137 f"sudo docker inspect --format='{{{{.State.Status}}}}' {container_name} 2>/dev/null || echo 'not_found'",CODE
HIGHlib/iris/src/iris/cluster/platforms/k8s/controller.py888 + f". Run: cd infra/pulumi && pulumi stack select {config.name} && pulumi up"CODE
HIGH⚡…src/iris/cluster/platforms/gcp/controller_bootstrap.py41 sudo apt-get update -qq || trueCODE
HIGH⚡…src/iris/cluster/platforms/gcp/controller_bootstrap.py42 sudo apt-get install -y -qq sysstat || trueCODE
HIGH⚡…src/iris/cluster/platforms/gcp/controller_bootstrap.py45 sudo sed -i 's/^ENABLED="false"/ENABLED="true"/' /etc/default/sysstat || trueCODE
78 more matches not shown…
Unused Imports731 hits · 656 pts
SeverityFileLineSnippetContext
LOWinfra/lint/catalog.py6CODE
LOWinfra/grafana/src/grafana_migrations/__init__.py6CODE
LOWinfra/grafana/src/grafana_migrations/__init__.py6CODE
LOWinfra/codehealth/refinement_sync.py6CODE
LOWinfra/codehealth/rule_probe.py6CODE
LOWinfra/codehealth/review_store.py6CODE
LOWinfra/codehealth/refinement_tools.py6CODE
LOWinfra/codehealth/github_review_corpus.py6CODE
LOWinfra/marina/apps/evaldash/metrics.py18CODE
LOWinfra/marina/apps/evaldash/review.py17CODE
LOWinfra/marina/apps/evaldash/results_db.py15CODE
LOWinfra/marina/apps/evaldash/cluster.py14CODE
LOWinfra/marina/apps/evaldash/app.py28CODE
LOWinfra/marina/apps/evaldash/record_reconciliation.py6CODE
LOWinfra/marina/apps/evaldash/samples.py18CODE
LOWinfra/marina/apps/evaldash/fixtures.py19CODE
LOWinfra/marina/apps/zephyr/backend/app.py11CODE
LOWinfra/marina/src/marina/discovery.py6CODE
LOWinfra/loom/infrastructure.py6CODE
LOWinfra/loom/tests/test_infrastructure.py4CODE
LOWexperiments/post_training/snowball_online_eagle.py18CODE
LOWexperiments/post_training/test_async_rl.py4CODE
LOWexperiments/post_training/iceball_micro.py23CODE
LOWexperiments/post_training/async_rl.py26CODE
LOWexperiments/post_training/task_curation/rl_smoke.py10CODE
LOW…orers/skyrl_gym/envs/nemotron_ultra/rdkit_chemistry.py5CODE
LOW…ltra/scorers/skyrl_gym/envs/nemotron_ultra/code_gen.py5CODE
LOW…ltra/scorers/skyrl_gym/envs/nemotron_ultra/calendar.py5CODE
LOW…on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py5CODE
LOW…tra/scorers/skyrl_gym/envs/nemotron_ultra/tool_call.py5CODE
LOW…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py5CODE
LOW…skyrl_gym/envs/nemotron_ultra/instruction_following.py5CODE
LOW…s/skyrl_gym/envs/nemotron_ultra/format_verification.py5CODE
LOW…curation/datasets/skyrl/scorers/text_to_sql_scoring.py30CODE
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py33CODE
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py34CODE
LOW…k_curation/datasets/skyrl/scorers/apps_testing_util.py5CODE
LOW…k_curation/datasets/skyrl/scorers/apps_testing_util.py18CODE
LOW…k_curation/datasets/skyrl/scorers/apps_testing_util.py19CODE
LOW…s/arc/scorers/skyrl_gym/envs/nemotron_ultra/sandbox.py5CODE
LOW…ets/arc/scorers/skyrl_gym/envs/nemotron_ultra/nvarc.py5CODE
LOWexperiments/post_training/mismatch_probe/metrics.py6CODE
LOWexperiments/post_training/mismatch_probe/launch.py6CODE
LOWexperiments/post_training/mismatch_probe/report.py6CODE
LOWexperiments/post_training/curriculum_rl/launch.py21CODE
LOWexperiments/post_training/curriculum_rl/pool.py23CODE
LOWexperiments/post_training/task_curriculum/models.py6CODE
LOW…s/post_training/task_curriculum/task_mapping/models.py6CODE
LOW…ts/post_training/task_curriculum/task_mapping/cache.py6CODE
LOWexperiments/post_training/cat_count_canary/launcher.py6CODE
LOWexperiments/post_training/cat_count_canary/data.py6CODE
LOW…periments/post_training/curriculum_sft/self_distill.py17CODE
LOWexperiments/post_training/curriculum_sft/code_tasks.py19CODE
LOWexperiments/post_training/curriculum_sft/generation.py14CODE
LOWexperiments/post_training/curriculum_sft/science.py18CODE
LOWexperiments/grug/__init__.py4CODE
LOWexperiments/grug/__init__.py4CODE
LOWexperiments/grug/moe_hero_ep/harrier_mix_2026_08_18.py14CODE
LOW…periments/grug/moe_hero_ep/harrier_mix_2026_08_17_1.py6CODE
LOWexperiments/grug/recovery/run_ablations.py21CODE
671 more matches not shown…
Excessive Try-Catch Wrapping581 hits · 610 pts
SeverityFileLineSnippetContext
LOWinfra/pre-commit.py379 except Exception:CODE
LOWinfra/pre-commit.py414 except Exception as e:CODE
LOWinfra/pre-commit.py421 except Exception as e:CODE
LOWinfra/pre-commit.py487 except Exception:CODE
LOWinfra/pre-commit.py537 except Exception:CODE
LOWinfra/pre-commit.py567 except Exception as e:CODE
LOWinfra/pre-commit.py614 except Exception:CODE
LOWinfra/pre-commit.py687 except Exception as e:CODE
LOWinfra/pre-commit.py718 except Exception as e:CODE
LOWinfra/pre-commit.py1045 except Exception as e:CODE
LOWinfra/linter.py239 except Exception:CODE
LOWinfra/lint/rules/robustness/ml-try-except-fallback.yaml19 except Exception:CODE
LOWinfra/grafana/benchmarks/inference_query_cost.py74 except Exception as error:CODE
LOWinfra/grafana/src/cache.py133 except Exception as error:CODE
LOWinfra/grafana/src/grafana_migrations/engine.py111 except Exception:CODE
LOWinfra/tpu-ci/setup.py369 except Exception as e:CODE
LOWinfra/tpu-ci/setup.py384 except Exception as e:CODE
LOWinfra/tpu-ci/setup.py552 except Exception as e:CODE
LOWinfra/tpu-ci/vm_manager.py408 except Exception as e:CODE
LOWinfra/tpu-ci/vm_manager.py455 except Exception as e:CODE
LOWinfra/tpu-ci/vm_manager.py465 except Exception as e:CODE
LOWinfra/tpu-ci/vm_manager.py482 except Exception as e:CODE
LOWinfra/tpu-ci/vm_manager.py547 except Exception as e:CODE
LOWinfra/codehealth/refinement_sync.py170 except Exception as error:CODE
LOWinfra/codehealth/rule_probe.py220 except Exception as error:STRING
LOWinfra/marina/apps/echo/sync/main.py249 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/review.py246 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/cluster.py117 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/cluster.py152 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/app.py643 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/app.py657 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/app.py723 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/app.py790 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/app.py877 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/record_reconciliation.py88 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/record_reconciliation.py97 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/record_reconciliation.py124 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/samples.py265 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/samples.py369 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/samples.py482 except Exception as exc:CODE
LOWinfra/marina/apps/evaldash/samples.py538 except Exception as exc:CODE
LOWinfra/marina/apps/zephyr/backend/app.py180 except Exception as error:CODE
LOWinfra/marina/apps/zephyr/backend/app.py281 except Exception as error:CODE
LOWinfra/marina/apps/zephyr/backend/app.py287 except Exception as error:CODE
MEDIUMinfra/marina/apps/zephyr/backend/app.py284def run_namespaces() -> list[str]:CODE
LOWinfra/marina/src/marina/applets.py1060 except Exception as error:CODE
LOWinfra/xprof/gateway.py216 except Exception:CODE
LOWinfra/xprof/gateway.py308 except Exception as exc:CODE
LOWexperiments/post_training/task_curation/local.py94 except Exception as error:CODE
LOWexperiments/post_training/task_curation/campaign.py215 except Exception as error:CODE
LOWexperiments/post_training/task_curation/campaign.py221 except Exception:CODE
LOW…ining/task_curation/datasets/reasoning_gym/generate.py81 except Exception as error:CODE
LOW…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py125 except Exception as error:CODE
LOW…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py138 except Exception as error:CODE
LOW…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py146 except Exception as error:CODE
LOW…skyrl_gym/envs/nemotron_ultra/instruction_following.py45 except Exception as error:CODE
LOW…curation/datasets/skyrl/scorers/text_to_sql_scoring.py227 except Exception:CODE
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py247 except Exception:STRING
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py279 except Exception:STRING
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py321 except Exception:CODE
521 more matches not shown…
Modern Structural Boilerplate593 hits · 603 pts
SeverityFileLineSnippetContext
LOWinfra/ci/run_status.py18logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/finelog_source.py29logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/server.py183logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/github_app.py24logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/github_source.py26logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/rl_producers.py16logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/k8s_source.py50logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/iris_source.py25logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/loom_alerts.py33logger = logging.getLogger(__name__)CODE
LOWinfra/grafana/src/grafana_migrations/__main__.py17logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/echo/models.py20logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/echo/app.py81logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/echo/migrate.py26logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/evaldash/review.py28logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/evaldash/results_db.py48logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/evaldash/results_db.py313def set_model_archived(engine: Engine, model_name: str, archived: bool, updated_by: str | None) -> None:CODE
LOWinfra/marina/apps/evaldash/cluster.py32logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/evaldash/app.py99logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/evaldash/app.py391 def _set_snapshot(self, records: list[EvalRunRecord]) -> None:CODE
LOWinfra/marina/apps/evaldash/app.py424 def set_model_archived(self, model_name: str, archived: bool, updated_by: str | None) -> None:CODE
LOWinfra/marina/apps/evaldash/app.py667 def set_catalog_error(self, error: str | None) -> None:CODE
LOWinfra/marina/apps/evaldash/app.py678 def set_model_archived(self, model_name: str, archived: bool, updated_by: str | None) -> None:CODE
LOWinfra/marina/apps/evaldash/app.py816 def _set_cycle_error(self, error: str | None) -> None:CODE
LOWinfra/marina/apps/evaldash/samples.py45logger = logging.getLogger(__name__)CODE
LOWinfra/marina/apps/zephyr/backend/app.py110logger = logging.getLogger(__name__)CODE
LOWinfra/marina/src/marina/db.py25logger = logging.getLogger(__name__)CODE
LOWinfra/marina/src/marina/db.py134 def _set_search_path(dbapi_connection, _record) -> None:CODE
LOWinfra/marina/src/marina/db.py153 def _set_role_and_search_path(dbapi_connection, _record) -> None:CODE
LOWinfra/marina/src/marina/journeys.py29logger = logging.getLogger(__name__)CODE
LOWinfra/marina/src/marina/cli.py422def set_applet_mode(applet_id: str, mode: str, service_url: str) -> None:CODE
LOWinfra/pulumi/src/iac/iris/deploy.py41logger = logging.getLogger(__name__)CODE
LOWinfra/xprof/gateway.py29logger = logging.getLogger(__name__)CODE
LOWinfra/xprof/gateway.py75 def set_size(self, size: int) -> None:CODE
LOWinfra/xprof/server.py26logger = logging.getLogger(__name__)CODE
LOWinfra/xprof/rust_proxy.py13logger = logging.getLogger(__name__)CODE
LOWexperiments/evals/federated_inference_proxy_demo.py41logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/iceball_micro.py73logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/task_curation/campaign.py26logger = logging.getLogger(__name__)CODE
LOW…g/task_curation/datasets/skyrl/scorers/ifeval_utils.py19logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_rl/launch.py71logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_rl/pool.py43logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_rl/report.py61logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/cat_count_canary/data.py19logger = logging.getLogger(__name__)CODE
LOW…periments/post_training/curriculum_sft/self_distill.py59logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_sft/code_tasks.py57logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_sft/finance.py36logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_sft/generation.py44logger = logging.getLogger(__name__)CODE
LOWexperiments/post_training/curriculum_sft/science.py52logger = logging.getLogger(__name__)CODE
LOW…/post_training/curriculum_sft/instruction_following.py34logger = logging.getLogger(__name__)CODE
LOWexperiments/ferries/grug_multislice_smoke.py41logger = logging.getLogger(__name__)CODE
LOWexperiments/ferries/datakit_reference_ferry.py29logger = logging.getLogger(__name__)CODE
LOWexperiments/ferries/datakit_nemotron_ferry.py33logger = logging.getLogger(__name__)CODE
LOWexperiments/grug/dispatch.py17logger = logging.getLogger(__name__)CODE
LOWexperiments/grug/__init__.py6__all__ = ["base", "moe"]CODE
LOWexperiments/grug/checkpointing.py19logger = logging.getLogger(__name__)CODE
LOWexperiments/grug/moe_hero_ep/adamh.py100__all__ = ["ScaleByAdamHState", "scale_by_adamh"]CODE
LOWexperiments/grug/moe_hero_ep/checkpoints.py18logger = logging.getLogger(__name__)CODE
LOWexperiments/grug/moe_hero_ep/model.py1572__all__ = [CODE
LOWexperiments/grug/moe_hero_ep/train.py81logger = logging.getLogger(__name__)CODE
LOWexperiments/grug/moe_hero_ep/train.py1364__all__ = [CODE
533 more matches not shown…
Empty Error Handlers117 hits · 585 pts
SeverityFileLineSnippetContext
HIGHinfra/pre-commit.py537except Exception:CODE
HIGHinfra/grafana/src/server.py348except ValueError:CODE
HIGHinfra/xprof/server.py40except OSError:CODE
HIGH…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py66except (ValueError, AttributeError):CODE
HIGH…rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py41except (ValueError, AttributeError):CODE
HIGH…/task_curation/datasets/skyrl/scorers/livecodebench.py247except Exception:CODE
HIGH…/task_curation/datasets/skyrl/scorers/livecodebench.py309except SystemExit:CODE
HIGH…k_curation/datasets/skyrl/scorers/apps_testing_util.py518except SystemExit as e:CODE
HIGH…k_curation/datasets/skyrl/scorers/apps_testing_util.py408except Exception as e:CODE
HIGH…k_curation/datasets/skyrl/scorers/apps_testing_util.py415except Exception as e:CODE
HIGHtests/test_integration_test.py83except subprocess.TimeoutExpired:CODE
HIGHtests/test_integration_test.py87except ProcessLookupError:CODE
HIGHtests/integration_test.py229except FileNotFoundError:CODE
HIGHscripts/ci/iris_monitor.py1005except (urllib.error.URLError, ConnectionError, TimeoutError, OSError):CODE
HIGHscripts/ci/iris_monitor.py400except json.JSONDecodeError:CODE
HIGHscripts/debug/decode_tokens.py90except Exception:CODE
HIGHlib/shellbox/tests/test_daytona_machine.py67except ProcessLookupError:CODE
HIGHlib/shellbox/tests/test_docker_machine.py94except ProcessLookupError:CODE
HIGHlib/shellbox/src/shellbox/backends/docker/machine.py107except (BrokenPipeError, ConnectionResetError):CODE
HIGHlib/shellbox/src/shellbox/backends/local/machine.py204except (BrokenPipeError, ConnectionResetError):CODE
HIGHlib/iris/tests/conftest.py170except (OSError, ValueError):CODE
HIGHlib/iris/tests/conftest.py161except ValueError:CODE
HIGH…cluster/backends/gcp/test_cloud_service_integration.py69except Exception:CODE
HIGH…cluster/backends/gcp/test_cloud_service_integration.py62except (json.JSONDecodeError, UnicodeDecodeError):CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1469except Exception:CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1490except Exception:CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1510except Exception:CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1530except Exception:CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1563except Exception:CODE
HIGH…b/iris/tests/cluster/controller/test_demand_routing.py1582except Exception:CODE
HIGHlib/iris/scripts/benchmark_controller.py241except Exception:CODE
HIGHlib/iris/scripts/benchmark_controller.py474except sqlite3.OperationalError:CODE
HIGHlib/iris/scripts/benchmark_controller.py480except sqlite3.OperationalError:CODE
HIGHlib/iris/scripts/benchmark_controller.py331except Exception:CODE
HIGHlib/iris/src/iris/env_resources.py107except (FileNotFoundError, PermissionError):CODE
HIGHlib/iris/src/iris/env_resources.py121except (FileNotFoundError, PermissionError, ValueError, IndexError):CODE
HIGHlib/iris/src/iris/test_util.py47except FileNotFoundError:CODE
HIGHlib/iris/src/iris/managed_thread.py268except ValueError:CODE
HIGHlib/iris/src/iris/cluster/process_status.py49except (OSError, ValueError, IndexError):CODE
HIGHlib/iris/src/iris/cluster/process_status.py66except OSError:CODE
HIGHlib/iris/src/iris/cluster/platforms/types.py89except (FileNotFoundError, ValueError, ProcessLookupError, PermissionError):CODE
HIGHlib/iris/src/iris/cluster/platforms/k8s/service.py872except (subprocess.TimeoutExpired, OSError):CODE
HIGHlib/iris/src/iris/cluster/platforms/k8s/controller.py1184except (ValueError, AttributeError):CODE
HIGHlib/iris/src/iris/cluster/platforms/gcp/cloud.py508except google.api_core.exceptions.NotFound:CODE
HIGHlib/iris/src/iris/cluster/backends/k8s/tasks.py1558except (ValueError, AttributeError):CODE
HIGHlib/iris/src/iris/cluster/runtime/profile.py392except (ProcessLookupError, PermissionError):CODE
HIGHlib/iris/src/iris/cluster/runtime/docker.py335except ValueError:CODE
HIGHlib/iris/src/iris/cluster/runtime/process.py231except ProcessLookupError:CODE
HIGHlib/iris/src/iris/cluster/worker/worker.py787except RuntimeError:CODE
HIGHlib/iris/src/iris/cluster/worker/worker.py403except RuntimeError:CODE
HIGHlib/iris/src/iris/cluster/worker/task_attempt.py485except RuntimeError:CODE
HIGHlib/iris/src/iris/cluster/worker/env_probe.py204except FileNotFoundError:CODE
HIGHlib/iris/src/iris/cluster/worker/env_probe.py619except (OSError, ValueError):CODE
HIGHlib/iris/src/iris/cluster/worker/env_probe.py627except OSError:CODE
HIGHlib/iris/src/iris/cluster/worker/env_probe.py650except (OSError, ValueError, IndexError):CODE
HIGHlib/iris/src/iris/cluster/worker/env_probe.py664except (OSError, ValueError, IndexError):CODE
HIGHlib/iris/src/iris/cli/cluster.py481except AlreadyExists:CODE
HIGHlib/iris/src/iris/cli/cluster.py1779except Exception:CODE
HIGHlib/iris/src/iris/jax/multigpu_main.py152except subprocess.TimeoutExpired:CODE
HIGHlib/iris/src/iris/actor/client.py53except ValueError:CODE
57 more matches not shown…
Deep Nesting586 hits · 548 pts
SeverityFileLineSnippetContext
LOWinfra/pre-commit.py244CODE
LOWinfra/pre-commit.py363CODE
LOWinfra/pre-commit.py390CODE
LOWinfra/pre-commit.py476CODE
LOWinfra/pre-commit.py517CODE
LOWinfra/pre-commit.py549CODE
LOWinfra/pre-commit.py602CODE
LOWinfra/pre-commit.py675CODE
LOWinfra/linter.py376CODE
LOWinfra/check_docs_source_links.py48CODE
LOWinfra/ci/select_tests.py267CODE
LOWinfra/ci/select_tests.py533CODE
LOWinfra/ci/select_tests.py688CODE
LOWinfra/ci/select_tests.py789CODE
LOWinfra/ci/select_tests.py931CODE
LOWinfra/ci/analyze_import_graph.py221CODE
LOWinfra/grafana/tests/test_provisioning.py687CODE
LOWinfra/grafana/tests/test_provisioning.py854CODE
LOWinfra/grafana/tests/test_vllm_observability.py168CODE
LOWinfra/grafana/benchmarks/inference_query_cost.py181CODE
LOWinfra/grafana/src/github_source.py118CODE
LOWinfra/grafana/src/training_stalls.py156CODE
LOWinfra/grafana/src/dashboard_dataset.py120CODE
LOWinfra/grafana/src/nightly.py186CODE
LOWinfra/codehealth/complexity.py86CODE
LOWinfra/codehealth/github_review_corpus.py744CODE
LOWinfra/marina/database_grants.py59CODE
LOWinfra/marina/applets/filer/server/app.py78CODE
LOWinfra/marina/applets/filer/server/app.py140CODE
LOWinfra/marina/applets/filer/server/app.py200CODE
LOWinfra/marina/applets/filer/server/app.py248CODE
LOWinfra/marina/tests/test_rl_data_catalog.py209CODE
LOWinfra/marina/apps/echo/app.py702CODE
LOWinfra/marina/apps/plantt/app.py86CODE
LOWinfra/marina/apps/evaldash/review.py137CODE
LOWinfra/marina/apps/evaldash/fixtures.py168CODE
LOWinfra/marina/src/marina/db.py164CODE
LOWinfra/marina/src/marina/applets.py277CODE
LOWinfra/marina/src/marina/applets.py875CODE
LOWinfra/marina/src/marina/local_postgres.py22CODE
LOWinfra/marina/src/marina/cli.py116CODE
LOWinfra/marina/src/marina/cli.py274CODE
LOWinfra/pulumi/iam_principal.py132CODE
LOWinfra/pulumi/src/iac/github/audit.py181CODE
LOWinfra/pulumi/src/iac/github/resources.py104CODE
LOWexperiments/marin_tokenizer.py35CODE
LOWexperiments/post_training/async_rl.py278CODE
LOWexperiments/post_training/task_curation/local.py49CODE
LOWexperiments/post_training/task_curation/campaign.py161CODE
LOWexperiments/post_training/task_curation/pipeline.py474CODE
LOW…ining/task_curation/datasets/nemotron_ultra/graders.py322CODE
LOW…ltra/scorers/skyrl_gym/envs/nemotron_ultra/calendar.py22CODE
LOW…on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py77CODE
LOW…on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py103CODE
LOW…st_training/task_curation/datasets/skyrl/preference.py298CODE
LOW…curation/datasets/skyrl/scorers/text_to_sql_scoring.py89CODE
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py449CODE
LOW…/task_curation/datasets/skyrl/scorers/livecodebench.py570CODE
LOW…k_curation/datasets/skyrl/scorers/apps_testing_util.py133CODE
LOW…k_curation/datasets/skyrl/scorers/apps_testing_util.py604CODE
526 more matches not shown…
Cross-File Repetition94 hits · 470 pts
SeverityFileLineSnippetContext
HIGHexperiments/post_training/curriculum_sft/code_trial.py0build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows.STRING
HIGH…eriments/post_training/curriculum_sft/finance_trial.py0build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows.STRING
HIGH…training/curriculum_sft/instruction_following_trial.py0build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows.STRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grugSTRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grugSTRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grugSTRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing thSTRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing thSTRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing thSTRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0muon gradient transformation for the stacked model (2d/3d/4d leaves).STRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0muon gradient transformation for the stacked model (2d/3d/4d leaves).STRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0muon gradient transformation for the stacked model (2d/3d/4d leaves).STRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambiguiSTRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambiguiSTRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambiguiSTRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0run newton-schulz on a matrix that is already local to one device.STRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0run newton-schulz on a matrix that is already local to one device.STRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0run newton-schulz on a matrix that is already local to one device.STRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0run batched newton-schulz with quack symmetric products (x @ x.t).STRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0run batched newton-schulz with quack symmetric products (x @ x.t).STRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0run batched newton-schulz with quack symmetric products (x @ x.t).STRING
HIGHexperiments/grug/moe_hero_ep/grugmuon_hero.py0distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis.STRING
HIGHexperiments/grug/moe_hero_fsdp/grugmuon_hero.py0distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis.STRING
HIGHexperiments/grug/fast_track/grugmuon_stacked.py0distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis.STRING
HIGHexperiments/grug/moe_hero_ep/model.py0moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing lossSTRING
HIGHexperiments/grug/moe_hero_fsdp/model.py0moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing lossSTRING
HIGHexperiments/grug/moe_pipeline/model.py0moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing lossSTRING
HIGHexperiments/grug/moe/model.py0moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing lossSTRING
HIGHexperiments/june_tpu_67b_a2b/moe/model.py0moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing lossSTRING
HIGHexperiments/grug/moe_hero_ep/model.py0learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1STRING
HIGHexperiments/grug/moe_hero_fsdp/model.py0learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1STRING
HIGHexperiments/grug/fast_track/model.py0learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1STRING
HIGHexperiments/grug/moe/model.py0learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1STRING
HIGHexperiments/june_tpu_67b_a2b/moe/model.py0learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1STRING
HIGHexperiments/grug/moe_hero_ep/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/grug/moe_hero_fsdp/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/grug/fast_track/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/grug/moe/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/grug/base/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/june_tpu_67b_a2b/moe/model.py0return a small abstract mesh and token sharding for lowering contract tests.STRING
HIGHexperiments/grug/moe_hero_ep/model.py0set router biases from qb betas (computed on previous step).STRING
HIGHexperiments/grug/moe_hero_fsdp/train.py0set router biases from qb betas (computed on previous step).STRING
HIGHexperiments/grug/fast_track/train.py0set router biases from qb betas (computed on previous step).STRING
HIGHexperiments/grug/moe/train.py0set router biases from qb betas (computed on previous step).STRING
HIGHexperiments/june_tpu_67b_a2b/moe/train.py0set router biases from qb betas (computed on previous step).STRING
HIGHexperiments/grug/moe_hero_ep/optimizer.py0restore named mesh sharding without touching single-device arrays.STRING
HIGHexperiments/grug/moe_hero_fsdp/optimizer.py0restore named mesh sharding without touching single-device arrays.STRING
HIGHexperiments/grug/fast_track/optimizer.py0restore named mesh sharding without touching single-device arrays.STRING
HIGHexperiments/grug/moe/optimizer.py0restore named mesh sharding without touching single-device arrays.STRING
HIGHexperiments/june_tpu_67b_a2b/moe/optimizer.py0restore named mesh sharding without touching single-device arrays.STRING
HIGHexperiments/grug/moe_hero_ep/optimizer.py0muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (scSTRING
HIGHexperiments/grug/moe_hero_fsdp/optimizer.py0muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (scSTRING
HIGHexperiments/grug/fast_track/optimizer.py0muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (scSTRING
HIGHexperiments/grug/moe_hero_ep/optimizer.py0muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step.STRING
HIGHexperiments/grug/moe_hero_fsdp/optimizer.py0muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step.STRING
HIGHexperiments/grug/fast_track/optimizer.py0muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step.STRING
HIGHexperiments/grug/moe_hero_ep/heuristic.py0muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule).STRING
HIGHexperiments/grug/moe_hero_fsdp/heuristic.py0muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule).STRING
HIGHexperiments/grug/fast_track/heuristic.py0muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule).STRING
HIGHexperiments/grug/moe_pipeline/model.py0per-block gradient checkpointing. "recompute_all" reruns the whole block in backward (lowest memory); "save_moe" keeps tSTRING
34 more matches not shown…
Over-Commented Block429 hits · 418 pts
SeverityFileLineSnippetContext
LOWpyproject.toml21 "marin-rigging[secrets]",COMMENT
LOWpyproject.toml81# names one, so our intentional pre-releases resolve while everything else staysCOMMENT
LOWpyproject.toml281target-version = "py312"COMMENT
LOWpyproject.toml301# imports except to break a circular import or guard an optional dep)COMMENT
LOWpyproject.toml541 "docker: mark tests that require a Docker daemon",COMMENT
LOWinfra/ci/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/deploy/src/marin_deploy/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/grafana/Pulumi.marin-grafana.yaml1config:COMMENT
LOWinfra/grafana/entrypoint.sh1#!/bin/bashCOMMENT
LOWinfra/grafana/__main__.py41# The cloudsql stack (infra/cloudsql) publishes the marin-metadata connection name that backsCOMMENT
LOWinfra/grafana/tests/test_sources.py501def test_wandb_run_activity_separates_active_time_from_downtime():COMMENT
LOWinfra/grafana/provisioning/datasources/finelog.yaml1# Copyright The Marin AuthorsCOMMENT
LOWinfra/grafana/provisioning/datasources/k8s.yaml1# Copyright The Marin AuthorsCOMMENT
LOWinfra/grafana/provisioning/alerting/rules.yaml1# Copyright The Marin AuthorsCOMMENT
LOWinfra/grafana/provisioning/alerting/contact-points.yaml1# Copyright The Marin AuthorsCOMMENT
LOWinfra/grafana/src/k8s_source.py101COMMENT
LOWinfra/grafana/src/k8s_source.py121# otherwise falls back to the runtime signature of exit 255, reason Error, and aCOMMENT
LOWinfra/grafana/src/wandb_source.py41_RUN_URL = "https://wandb.ai/{entity}/{project}/runs/{run}"COMMENT
LOWinfra/grafana/src/wandb_source.py61# step's `throughput/tokens_per_second`, which a checkpoint or eval step drivesCOMMENT
LOWinfra/tpu-ci/vm_manager.py1#!/usr/bin/env python3COMMENT
LOWinfra/tpu-ci/vm_manager.py421 logging.info(f"[{zone}] Found {len(vms)} TPU VMs")COMMENT
LOWinfra/marina/applets/rl_data_catalog/server/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/applets/filer/server/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/web/markdown.ts1// The subset of Markdown the apps display, turned into a tree.COMMENT
LOWinfra/marina/tests/notes_app/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOW…/marina/examples/problem-set-applet/server/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/apps/plantt/tests/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/apps/evaldash/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/apps/tasktrove/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/marina/apps/zephyr/backend/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/iris/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/coreweave/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/gcp/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/gcp/iam_data.yaml1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/gcp/cloud_run.py81COMMENT
LOWinfra/pulumi/src/iac/gcp/iam_config.py41 "serviceAccount:",COMMENT
LOWinfra/pulumi/src/iac/github/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWinfra/pulumi/src/iac/kubernetes/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWconfig/external/migration.toml1# Fork migration descriptors.COMMENT
LOWconfig/external/migration.toml21# fork with more than one pin has one section per pin (the vllm fork has `vllm` and `vllm-gpu`).COMMENT
LOWexperiments/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/coral/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/evals/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/post_training/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/post_training/async_rl.py181 max_steps: intCOMMENT
LOW…riments/post_training/task_curation/images/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOW…/datasets/nemotron_ultra/scorers/skyrl_gym/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOW…sets/nemotron_ultra/scorers/skyrl_gym/envs/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOW…ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py1# Copyright 2024 Bytedance Ltd. and/or its affiliatesCOMMENT
LOW…g/task_curation/datasets/skyrl/scorers/ifeval_utils.py1# IFEval constraint checkers for RLVR-style instruction-following rewards.COMMENT
LOW…_training/task_curation/datasets/tasktrove/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOW…ask_curation/datasets/tasktrove/conversion/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/post_training/mismatch_probe/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/grug/moe_hero_ep/__init__.py1# Copyright The Marin AuthorsCOMMENT
LOWexperiments/grug/moe_hero_ep/small_scale_abl_launch.py121# likewise routes the 4D expert-stack Newton-Schulz through QuACK'sCOMMENT
LOWexperiments/grug/moe_hero_ep/model.py61from levanter.grug.loss import BlockSizes, fused_linear_softmax_cross_entropy_lossCOMMENT
LOWexperiments/grug/moe_hero_ep/model.py581 q = rearrange(q_flat, "... (n d) -> ... n d", d=head_dim)COMMENT
LOWexperiments/grug/moe_hero_ep/train.py101# `(fraction x 184.3 GiB - persistent state) x slop`. At 0.75 / 85 that is 87.7 GiB, below theCOMMENT
LOWexperiments/grug/moe_hero_ep/train.py241 # carry offload raises the memory fraction and the percentage together; seeCOMMENT
369 more matches not shown…
Docstring Block Structure46 hits · 230 pts
SeverityFileLineSnippetContext
HIGHexperiments/coral/batch_calibration.py49Estimate parameter and activation bytes for a dense transformer. Args: parameter_count: Number of trainableSTRING
HIGHexperiments/coral/batch_calibration.py93Return total HBM bytes for a global batch. Args: parameter_bytes: Model parameter memory. optimizerSTRING
HIGHexperiments/coral/batch_calibration.py123Select Levanter parallelism settings that fit a global batch on TPUs. Args: tpu: TPU topology name acceptedSTRING
HIGHexperiments/datakit/testbed/sampler.py170Sample ``source``'s normalized shards to a target row count. Probes a single shard for rows-per-file, then computesSTRING
HIGH.agents/projects/iris_pypi_mirror/spec.md52Build uv env vars that point dependency resolution at AR remote PyPI repos. Caller responsibilities (not enforced hSTRING
HIGH.agents/projects/executor_in_training_job/spec.md48Run any ExecutorSteps embedded in `config`, then return a copy of `config` with all InputName / OutputName / VersionSTRING
HIGHlib/iris/src/iris/cluster/types.py587Create a DeviceConfig for a GPU device. Args: variant: GPU variant string (e.g., "H100", "A100"). cSTRING
HIGHlib/iris/src/iris/cluster/types.py610Parse human-readable memory string to bytes. Supports various formats: - "8G", "8GB", "8 GB", "8 gigabytes" STRING
HIGHlib/iris/src/iris/cluster/types.py839Derive namespace from hierarchical job ID. The namespace is the first component of the job ID hierarchy. STRING
HIGH…ris/src/iris/cluster/platforms/gcp/worker_bootstrap.py129Render a template string with {{ variable }} placeholders. Uses ``{{ variable }}`` syntax (double braces with exactSTRING
HIGHlib/iris/src/iris/cluster/runtime/types.py202Run setup_commands (uv sync, pip install, etc). Blocks until setup completes. If there are no setup_commands, STRING
HIGHlib/iris/src/iris/cluster/runtime/types.py257Profile the running process using py-spy (CPU), memray (memory), or thread dump. Args: duration_secSTRING
HIGHlib/iris/src/iris/cluster/runtime/docker.py462Run setup_commands (uv sync, pip install, etc) in a temporary container. Creates a temporary container that runSTRING
HIGH…iris/src/iris/cluster/controller/autoscaler/factory.py45Create autoscaler from WorkerInfraProvider and explicit config. Args: platform: WorkerInfraProvider instancSTRING
HIGHlib/iris/src/iris/cluster/worker/task_attempt.py496Profile the running container process. Args: duration_seconds: How long to sample profiSTRING
HIGHlib/iris/src/iris/cluster/client/remote_client.py264Wait for job to complete with exponential backoff polling. If the controller becomes unavailable, retries with STRING
HIGHlib/iris/src/iris/jax/init.py115Poll the endpoint registry until the coordinator address appears. Args: resolver: Namespaced resolver for tSTRING
HIGHlib/iris/src/iris/rpc/errors.py166Execute an RPC call with exponential backoff retry. Retries stop when either ``max_attempts`` is exhausted **or** STRING
HIGHlib/iris/src/iris/rpc/errors.py220Poll an RPC endpoint, tolerating transient unavailability. Calls ``poll_fn`` in a loop. On retryable errors the fuSTRING
HIGHlib/iris/src/iris/client/worker_pool.py117Execute a pickled callable and return the result. Args: serialized_callable: cloudpickle-serializedSTRING
HIGHlib/iris/src/iris/client/worker_pool.py323Block until result is available. Args: timeout: Maximum time to wait in seconds Returns: STRING
HIGHlib/iris/src/iris/client/client.py554Wait for job to complete. Args: timeout: Maximum wait time in seconds poll_interval: UpSTRING
HIGHlib/iris/src/iris/client/client.py937Submit a job with automatic job_id hierarchy. Args: entrypoint: Job entrypoint (callable + args/kwaSTRING
HIGHlib/iris/src/iris/client/client.py1423Get an allocated port by name. Args: name: Port name (e.g., "actor") Returns: STRING
HIGHlib/levanter/src/levanter/eval_harness.py118 Call a function with retry logic and exponential backoff. Handles HuggingFace rate limit errors (HTTP 429) by STRING
HIGHlib/levanter/src/levanter/compat/hf_checkpoints.py131Build a validated generation_config dict from explicit EOS token IDs. The returned dict is suitable for writing as STRING
HIGHlib/levanter/src/levanter/recovery/faults.py79Parse a fault assignment from the environment. Args: env: Mapping to read from; defaults to ``os.enSTRING
HIGHlib/levanter/src/levanter/tracker/tracker_fns.py244 Get or set the global tracker. Note that setting the global tracker is not thread-safe, and using a tracker froSTRING
HIGHlib/levanter/src/levanter/tracker/tracker_fns.py288 Lookup a tracker in the current global tracker with the provided name. Args: name: Name of the trackerSTRING
HIGHlib/levanter/src/levanter/models/llama.py135Convert to HuggingFace's LlamaConfig Args: vocab_size (int, optional): Vocabulary size of the tokenSTRING
HIGHlib/marin/tools/get_hf_dataset_schema.py126 Get the schema of a Hugging Face dataset. Args: dataset_name: Name of the dataset (e.g., 'wikitext', 'STRING
HIGH…/processing/classification/deduplication/fuzzy_dups.py242Mark fuzzy-duplicate cluster membership across one or more ``MinHashAttrData`` inputs. All inputs must share identiSTRING
HIGHlib/marin/src/marin/scaling_laws/tpu_utils.py46Select the smallest TPU slice that fits the estimated memory. Args: estimated_memory_bytes: Estimated memorSTRING
HIGH…rin/src/marin/transform/huggingface/dataset_to_eval.py348 Transform a single HuggingFace dataset example to QA format. Args: example: Raw example from HuggingFaSTRING
HIGH…rin/src/marin/transform/huggingface/dataset_to_eval.py480 Converts HuggingFace datasets to JSONL files for evaluation or decontamination. This function processes dataseSTRING
HIGHlib/haliax/src/haliax/debug.py58 Checks for common issues in a module, such as reused arrays and static arrays. Equinox modules (and therefore HSTRING
HIGHlib/haliax/src/haliax/_src/einsum.py32Compute the tensor contraction of the input arrays according to Haliax's named variant of the Einstein summation conSTRING
HIGHlib/haliax/src/haliax/nn/conv.py168 Args: inputs (NamedArray): Input array key (PRNGKeyArray: Not used, compat with other mSTRING
HIGHlib/haliax/src/haliax/nn/conv.py324 Args: inputs (NamedArray): Input array key (PRNGKeyArray: Not used, compat with other mSTRING
HIGHlib/haliax/src/haliax/nn/pool.py35 General function for pooling. Broadly based on the Flax implementation. Pooling functions are implemented usinSTRING
HIGHlib/rigging/src/rigging/config_discovery.py112Resolve a cluster name (or path) to an existing YAML config file. If ``name`` is already an existing file path, it STRING
HIGHlib/zephyr/src/zephyr/readers.py455Load records from file as JSONL, Parquet, or Vortex. The spec's ``format`` selects the reader; ``auto`` (the defaulSTRING
HIGHlib/zephyr/src/zephyr/readers.py514Load a Parquet file and yield ``pa.RecordBatch`` objects. Only Parquet files are supported. Raises ``RuntimeError``STRING
HIGHlib/zephyr/src/zephyr/dataset.py93Format output path with shard information. Args: pattern: Path pattern with {shard}, {total}, {basename} plSTRING
HIGHlib/zephyr/src/zephyr/dataset.py414Create dataset from file glob pattern. This method finds all files matching the glob pattern and returns a STRING
HIGHlib/zephyr/src/zephyr/dataset.py1030Streaming merge join for already-sorted, co-partitioned datasets. Preconditions: - Both datasets have tSTRING
Modern AI Meta-Vocabulary47 hits · 137 pts
SeverityFileLineSnippetContext
MEDIUMAGENTS.md63# Lint review — agentic pass over the branch diff against the infra/lint/ catalogCOMMENT
MEDIUMinfra/README.md65 # Your processing logic here - no manual worker orchestration neededCOMMENT
MEDIUMinfra/lint/rules/cruft/ml-duplicate-logic-block.yaml36 def _run_ping_loop(self): ... # same scaffold, only the wrapped call differsCODE
MEDIUMinfra/ci/select_tests.py76# orchestration itself. Locally, their import-dependent tests are sufficient;COMMENT
MEDIUMinfra/codehealth/review_quality.py140# Pluggable so the backend can change without touching batching orchestration.COMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py71# A representative vLLM serving profile shared by the lm-eval runs; agentic and legacy runs override itCOMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py618 # An agentic run that lost one of its ten trials to a timeout: the aggregate is over theCOMMENT
MEDIUMinfra/marina/apps/evaldash/fixtures.py624 runtime_minutes=42.0, # agentic sandbox rollouts run far longer than the lm-eval tasksCODE
MEDIUMinfra/marina/apps/evaldash/web/src/types/api.ts415// samples, and `trajectory_uri` for `agentic` samples. The one unbounded payload, the agenticCOMMENT
MEDIUMinfra/marina/apps/evaldash/web/src/types/api.ts449// Agent Trajectory Interchange Format (ATIF): one agentic run's steps. A step is either a userCOMMENT
MEDIUMexperiments/post_training/snowball_online_eagle.py51 "s3://marin-us-east-02a/marin/exports/grug/june-67b-a2b-sft-s3-agentic/step-1903/hf-bf16-vllm/"CODE
MEDIUMexperiments/evaluation/models.py131 # tokens, so skip_special_tokens=false keeps the chain-of-thought from being stripped before scoringCOMMENT
MEDIUMexperiments/evaluation/evals.py324 # --- Harbor (agentic registry benchmarks) ---COMMENT
MEDIUMexperiments/evaluation/README.md262# A capped agentic validation run (2 tasks).COMMENT
MEDIUMexperiments/evaluation/configs/harbor/aime-smoke.yaml18 # This is an integration smoke, not the production agentic AIME benchmark. One bounded modelCOMMENT
MEDIUMexperiments/evaluation/configs/evalchemy/aime24.yaml7# No max_tokens: Evalchemy sizes AIME24 responses from the served context window minus theCOMMENT
MEDIUMexperiments/evaluation/serve/models/README.md60agent: # AgentConfig -> the Harbor/agentic agentCODE
MEDIUM…e/models/marin-community/grug-agentic-s3-step1903.yaml2location: s3://marin-us-east-02a/marin/exports/grug/june-67b-a2b-sft-s3-agentic/step-1903/hf-bf16-vllm/CODE
MEDIUM⚡tests/evals/test_evalchemy_config.py365 # lm-eval assumes a 2048-token window unless told otherwise, silently left-truncating few-shotCOMMENT
MEDIUMtests/snapshots/web/expected/resiliparse/dbrx.md76## Quality on Long-Context Tasks and RAGCOMMENT
MEDIUM⚡tests/snapshots/web/inputs/dbrx.html163</script><script type="text/javascript" defer="">(function(){function b(){!1===c&&(c=!0,Munchkin.init("094-YMS-629"))}vaCODE
MEDIUM⚡tests/snapshots/web/inputs/dbrx.html164</style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks.CODE
MEDIUM⚡tests/snapshots/web/inputs/dbrx.html164</style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks.CODE
MEDIUMtests/evaluation/test_eval_archive.py1125 # A legacy Harbor run: one agentic sample referencing a trajectory by an in-place path.COMMENT
MEDIUMtests/evaluation/test_eval_archive.py1149 # The migrated agentic sample points at a finestore:// trajectory the archive resolves.COMMENT
MEDIUM.agents/projects/20260130_fray_lite_research.md78#### Job orchestration (`rl_job.py`)COMMENT
MEDIUM.agents/projects/eval-rollup-design.md175 kind: SampleKind # multiple_choice | generation | agenticCODE
MEDIUM.agents/projects/eval-rollup-design.md184 # agenticCOMMENT
MEDIUM.agents/projects/20260130_fray_lite_design.md590### Job orchestration (`rl_job.py`)COMMENT
MEDIUM.agents/projects/20260130_fray_lite_design.md870│ ├── tpu.py # TPU orchestration (copied from v1 ray.tpu.execution)CODE
MEDIUM…gents/projects/20260430-zephyr-performance/research.md208#### RAG with Codebase ContextCOMMENT
MEDIUMdocs/debug-log-agentic-daytona.md1# Debugging log for agentic Daytona validationCOMMENT
MEDIUMdocs/debug-log-agentic-daytona.md27- Register the [#7246](https://github.com/marin-community/marin/pull/7246) agentic presets asCODE
MEDIUMdocs/debug-log-agentic-daytona.md27- Register the [#7246](https://github.com/marin-community/marin/pull/7246) agentic presets asCODE
MEDIUMdocs/reports/marin-8b-retro.md632For code generation, we use [HumanEval](https://github.com/openai/human-eval) - which continues to be the standard benchCODE
MEDIUMscripts/ci/wait_for.py375# the structure: strip the scaffolding and a placeholder has no prose left.COMMENT
MEDIUMscripts/ci/wait_for.py392# multi-agent correctness review…"), while the shortest real review leaves 121. Nothing landsCOMMENT
MEDIUMscripts/ci/wait_for.py449 # Drop the verdict itself ("no issues") and the checklist scaffolding ("- [x] ValidateCOMMENT
MEDIUM.github/workflows/marin-release-libs-wheels.yaml29 # package-owned source_patterns; orchestration-only changes do not publish.COMMENT
MEDIUM.github/workflows/agentic-lint.yaml3# Best-effort Loom lint review. The `agentic-lint` label records that a PR hasCOMMENT
MEDIUMlib/iris/src/iris/cluster/controller/auth.py135# agentic datagen/eval job can hold one capability URL for its whole run insteadCOMMENT
MEDIUMlib/levanter/.agents/projects/inference.md63### 2. HTTP server scaffoldCOMMENT
MEDIUMlib/marin/src/marin/evaluation/evalchemy/runner.py113 # served context window minus its stored longest prompt (evalchemy#132).COMMENT
MEDIUM⚡lib/marin/src/marin/evaluation/evalchemy/client.py32# prompt reserve, so the model config's context window sets its budget the way Evalchemy's ownCOMMENT
MEDIUM⚡lib/marin/src/marin/evaluation/evalchemy/client.py40# vLLM returns HTTP 400 when prompt_tokens + max_tokens exceeds the served context window. ReserveCOMMENT
MEDIUM⚡lib/marin/src/marin/evaluation/evalchemy/client.py45# tokens against its context window (a loglikelihood request adds one output token to aCOMMENT
MEDIUMlib/marin/src/marin/evaluation/evalchemy/runtime.py23# Keep CPU-only PyTorch as a compatibility floor for benchmark orchestration and grading code.COMMENT
Self-Referential Comments44 hits · 132 pts
SeverityFileLineSnippetContext
MEDIUMexperiments/marin_tokenizer.py53 # Create a temporary directory that may be RAM-basedCOMMENT
MEDIUMexperiments/grug/moe_hero_ep/trigger_hero.sh48# Create the tracker lineage once, outside the coordinator and training retry loops.COMMENT
MEDIUMtests/test_evaluator_utils.py12 # Create a temporary directoryCOMMENT
MEDIUM⚡…cluster/backends/gcp/test_cloud_service_integration.py514 # Create a VM firstCOMMENT
MEDIUMlib/iris/tests/cluster/backends/gcp/test_platform.py1155 # Create a VM but set it to non-READY stateCOMMENT
MEDIUMlib/iris/tests/cluster/controller/test_autoscaler.py541 # Create a slice with 4 VMsCOMMENT
MEDIUMlib/iris/tests/cluster/worker/test_worker.py444 # Create a handle that stays running until killedCOMMENT
MEDIUMlib/iris/tests/cluster/worker/test_worker.py468 # Create a handle that stays running until killedCOMMENT
MEDIUMlib/iris/tests/cluster/worker/test_worker.py502 # Create a handle that stays running until killedCOMMENT
MEDIUMlib/iris/src/iris/cluster/worker/worker.py377 # Create a handle wrapping the existing containerCOMMENT
MEDIUMlib/iris/src/iris/cluster/worker/worker.py749 # Create a minimal TaskAttemptConfig. Expensive setup (port allocation,COMMENT
MEDIUMlib/fray/src/fray/local_backend.py215 # Create a synthetic job handle that is immediately succeededCOMMENT
MEDIUMlib/fray/src/fray/iris_backend.py793 # Create a single job with N replicasCOMMENT
MEDIUMlib/levanter/infra/cluster/job-cluster.yaml38 # Create a Persistent Disk w/ 100 GBsCOMMENT
MEDIUMlib/levanter/tests/test_hyena.py18 # Create a test config that matches the PyTorch exampleCOMMENT
MEDIUMlib/levanter/tests/test_hyena.py33 # Create a random input tensor with shape matching the PyTorch exampleCOMMENT
MEDIUMlib/levanter/tests/test_hyena.py38 # Define a function to compute the sum of a specific position's outputCOMMENT
MEDIUMlib/levanter/tests/test_background_iterable.py29 # Create a BackgroundIterable instance with an empty producer functionCOMMENT
MEDIUM⚡lib/levanter/tests/test_background_iterable.py51 # Create a producer function that raises an exceptionCOMMENT
MEDIUM⚡lib/levanter/tests/test_background_iterable.py55 # Create a BackgroundIterable instance with the producer function that raises an exceptionCOMMENT
MEDIUM⚡lib/levanter/tests/test_sharded_dataset.py58 # Create a simple datasetCOMMENT
MEDIUMlib/levanter/tests/test_skip_step.py362 # Create a SkipStepState instanceCOMMENT
MEDIUMlib/levanter/tests/test_sft.py36 # Create a simple model with random embeddingsCOMMENT
MEDIUMlib/levanter/tests/test_sft.py42 # Create a mock model with LlamaEmbeddingCOMMENT
MEDIUMlib/levanter/tests/test_packing.py51 # Create a packed exampleCOMMENT
MEDIUMlib/levanter/tests/test_packing.py76 # Create a single JaggedArrayStore with four documents.COMMENT
MEDIUMlib/levanter/tests/test_packing.py385 # Create a single-leaf dataset of 4 documents (as in test 1) with offsets [0,100,300,450,600].COMMENT
MEDIUMlib/levanter/tests/test_packing.py506 # Create a dataset with a single document that's too longCOMMENT
MEDIUM⚡lib/levanter/tests/test_jax_utils.py226 # Create a module and a target treeCOMMENT
MEDIUMlib/levanter/scripts/gcs_bulk_delete.py29 # Define the transfer jobCOMMENT
MEDIUMlib/levanter/scripts/gcs_bulk_delete.py41 # Create the transfer jobCOMMENT
MEDIUMlib/levanter/src/levanter/compat/hf_checkpoints.py1658 # Create a temporary directory that persists through the context managerCOMMENT
MEDIUMlib/levanter/src/levanter/optim/skipstep.py18# Define the state structure for the optimizerCOMMENT
MEDIUMlib/levanter/src/levanter/utils/thread_utils.py10# Create a ThreadPoolExecutorCOMMENT
MEDIUMlib/levanter/src/levanter/models/hyena.py468 # Create a new axis with the same dimensions to avoid naming collisionCOMMENT
MEDIUMlib/levanter/src/levanter/data/packing.py195 # Create the LmExampleCOMMENT
MEDIUMlib/levanter/src/levanter/data/audio.py149 """This class represents a dataset source with URLs or hf name/id."""STRING
MEDIUMlib/levanter/src/levanter/data/audio.py426 """This class represents a mixture of datasets with their associated weights."""STRING
MEDIUMlib/levanter/src/levanter/data/text/datasets.py246 """This class represents a dataset source with URLs or hf name/id."""STRING
MEDIUM…n/src/marin/transform/wikipedia/transform_wikipedia.py147 # Create a new <p> tag and insert the br tags plus the display mathCOMMENT
MEDIUM…marin/transform/conversation/transform_conversation.py140 # Create a unique ID for the row based on the textCOMMENT
MEDIUMlib/haliax/src/haliax/__init__.py208 # Create a NamedArray along a single axisSTRING
MEDIUMlib/haliax/src/haliax/nn/scan.py669 # Create a function that captures the additional argumentsCOMMENT
MEDIUMlib/dupekit/tests/test_bloom.py116 # Create a large bloom filter to ensure chunking happensCOMMENT
AI Structural Patterns136 hits · 122 pts
SeverityFileLineSnippetContext
LOWinfra/grafana/tests/conftest.py85CODE
LOWinfra/grafana/tests/test_k8s_source.py729CODE
LOWinfra/grafana/tests/test_async_rl_dashboard.py136CODE
LOWinfra/marina/apps/evaldash/metrics.py573CODE
LOWinfra/marina/apps/evaldash/app.py1300CODE
LOWinfra/marina/apps/evaldash/tests/test_metrics.py36CODE
LOWinfra/marina/apps/tasktrove/app.py316CODE
LOW…ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py351CODE
LOWexperiments/post_training/mismatch_probe/test_report.py32CODE
LOWexperiments/post_training/cat_count_canary/launcher.py203CODE
LOWexperiments/post_training/cat_count_canary/launcher.py369CODE
LOWexperiments/ferries/canary_ferry.py210CODE
LOWexperiments/grug/moe_hero_ep/memory_soak.py121CODE
LOWexperiments/grug/moe_hero_ep/small_scale_abl_launch.py283CODE
LOWexperiments/grug/moe_hero_ep/launch_diagnostics.py91CODE
LOWexperiments/grug/moe_hero_fsdp/launch.py265CODE
LOWexperiments/grug/fast_track/launch.py254CODE
LOWexperiments/datasets/instruction.py135CODE
LOWexperiments/datakit/embeddings/luxical/pipeline.py306CODE
LOWexperiments/datakit/testbed/train.py125CODE
LOWexperiments/datakit/store/datakit_store.py573CODE
LOWtests/evaluation/test_eval_stats.py53CODE
LOWtests/evaluation/test_eval_stats.py495CODE
LOWscripts/training/time_to_train/parse_wandb_runs.py111CODE
LOWlib/shellbox/src/shellbox/backends/qemu/environment.py37CODE
LOWlib/iris/tests/cluster/runtime/test_env_parity.py26CODE
LOWlib/iris/tests/cluster/worker/test_worker.py1297CODE
LOWlib/iris/scripts/install_kueue.py222CODE
LOWlib/iris/scripts/benchmark_controller.py1646CODE
LOWlib/iris/src/iris/cluster/platforms/gcp/fake.py68CODE
LOWlib/iris/src/iris/cluster/controller/dashboard.py193CODE
LOWlib/iris/src/iris/cluster/worker/worker.py142CODE
LOWlib/iris/src/iris/cluster/client/protocol.py22CODE
LOWlib/iris/src/iris/cluster/client/remote_client.py150CODE
LOWlib/iris/src/iris/cli/job.py564CODE
LOWlib/iris/src/iris/cli/job.py722CODE
LOWlib/iris/src/iris/testing/controller.py677CODE
LOWlib/iris/src/iris/testing/controller.py877CODE
LOWlib/iris/src/iris/testing/e2e.py102CODE
LOWlib/iris/src/iris/testing/journeys/world.py174CODE
LOWlib/iris/src/iris/client/client.py913CODE
LOWlib/finelog/src/finelog/client/log_client.py255CODE
LOWlib/levanter/tests/test_new_loader.py93CODE
LOWlib/levanter/tests/test_new_loader.py139CODE
LOWlib/levanter/tests/test_attention.py699CODE
LOWlib/levanter/src/levanter/config.py144CODE
LOWlib/levanter/src/levanter/eval_harness.py1708CODE
LOWlib/levanter/src/levanter/eval_harness.py378CODE
LOWlib/levanter/src/levanter/eval_harness.py389CODE
LOWlib/levanter/src/levanter/eval_harness.py393CODE
LOWlib/levanter/src/levanter/checkpoint.py990CODE
LOWlib/levanter/src/levanter/eval.py281CODE
LOW…evanter/kernels/pallas/fused_cross_entropy_loss/api.py720CODE
LOW…evanter/kernels/pallas/fused_cross_entropy_loss/api.py739CODE
LOW…evanter/kernels/pallas/fused_cross_entropy_loss/api.py757CODE
LOW…evanter/kernels/pallas/fused_cross_entropy_loss/xla.py681CODE
LOWlib/levanter/src/levanter/kernels/pallas/mamba3/api.py524CODE
LOWlib/levanter/src/levanter/kernels/pallas/mamba3/api.py652CODE
LOWlib/levanter/src/levanter/kernels/pallas/mamba3/api.py693CODE
LOWlib/levanter/src/levanter/kernels/pallas/mamba3/api.py860CODE
76 more matches not shown…
AI Slop Vocabulary41 hits · 117 pts
SeverityFileLineSnippetContext
MEDIUMinfra/linter.py245# review harness supplies the real identity through the environment. ACOMMENT
MEDIUMinfra/linter.py754 # Drop lanes whose diff-size floor the change doesn't clear (only the holistic meta laneCOMMENT
MEDIUMinfra/tpu-ci/vm_manager.py710 # For static mode, get comprehensive diagnosticsCOMMENT
MEDIUMinfra/marina/apps/evaldash/web/package-lock.json2178 "resolved": "https://registry.npmjs.org/robust-predicates/-/robust-predicates-3.0.3.tgz",CODE
MEDIUMinfra/marina/apps/evaldash/tests/test_metrics.py410 # Two benchmarks under the same names are not the same benchmarks if different harness versionsCOMMENT
MEDIUMexperiments/evals/task_configs.py10# TODO: add more once supported in lm-eval-harness and/or tested on our endCOMMENT
MEDIUM…ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py14# Adapted from https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/hendrycks_math/utils.pyCOMMENT
MEDIUMexperiments/post_training/curriculum_sft/code_tasks.py67# Printed before the harness's JSON result so output written by the executed code cannot be mistaken for it.COMMENT
MEDIUMexperiments/references/reference_training_pipeline.py79# A nano model: this harness measures path-liveness and delta-vs-baseline, not absoluteCOMMENT
MEDIUMexperiments/evaluation/evals.py347# The comprehensive per-model benchmark set: every model x task pair runs (and is recorded) as itsCOMMENT
MEDIUMexperiments/evaluation/evals.py363# The baseline lm-eval-harness NLP suite: 14 deterministic loglikelihood/greedy tasks, runnable onCOMMENT
MEDIUMexperiments/datakit/decontam/viewer/report.py48// Works at the token level so highlighting is robust to newlines/indentation:COMMENT
MEDIUMtests/snapshots/stackexchange/inputs/chemistry_3.json3 "text": "# Flammability (NFPA) - how is it defined?\n\nI was reading up on a wonderful little chemical compound knowCODE
MEDIUM⚡tests/snapshots/web/inputs/dbrx.html164</style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks.CODE
MEDIUM⚡tests/snapshots/web/inputs/dbrx.html164</style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks.CODE
MEDIUMtests/snapshots/dclm_hq/inputs/hq_1.html231<li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-texCODE
MEDIUMtests/snapshots/dclm_hq/inputs/hq_1.html682<li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-texCODE
MEDIUMtests/datakit/decontam/test_prepare_eval_corpus.py32# A rendered prompt embeds the passage (as lm-eval-harness doc_to_text does).COMMENT
MEDIUM⚡lib/iris/scripts/install_kueue.py220# Install core (importable; the click command and the smoke harness both call it).COMMENT
MEDIUM⚡lib/iris/scripts/benchmark_controller.py152# RPC harness: real Controller(dry_run=True) + Connect sync clientCOMMENT
MEDIUM⚡lib/iris/scripts/benchmark_controller.py388# Bench harnessCOMMENT
MEDIUMlib/iris/scripts/benchmark_controller.py279 # exercise the endpoint registry set this to ``harness.make_endpoint_client``.COMMENT
MEDIUM⚡lib/iris/src/iris/testing/cluster.py57# ServiceTestHarness — parameterized GCP / K8s controller service harnessCOMMENT
MEDIUMlib/iris/src/iris/testing/cluster.py148 # Share the harness tracker so the service registers into and reads livenessCOMMENT
MEDIUMlib/iris/src/iris/testing/cluster.py149 # through the same object this harness's ControllerTestState exposes.COMMENT
MEDIUMlib/finelog/rust/Cargo.toml157# Compiles the deterministic fault-injection harness (`test_support`) and theCOMMENT
MEDIUMlib/verifyit/src/verifyit/preparation/text.py96 # Separate fixed-width arrays preserve harness Unicode lowering for each batch.COMMENT
MEDIUMlib/levanter/tests/test_eval_harness.py23 # Create chat-like requests with contexts formatted via the chat template, matching harness usageCOMMENT
MEDIUMlib/levanter/src/levanter/eval_harness.py1536 # remove the ",none" suffix, which eval-harness adds by default for some reasonCOMMENT
LOWlib/levanter/src/levanter/trainer.py204 # we can't just use `lambda: model` because JAX jit can't see captures, but it can see jax partialsCOMMENT
MEDIUM…evanter/kernels/pallas/fused_cross_entropy_loss/api.py174 # Keep TPU default stable and robust unless Pallas is explicitly requested.COMMENT
MEDIUMlib/levanter/src/levanter/callbacks/_metrics.py122 # Accumulate MFU samples over a trailing window for robust distribution stats.COMMENT
MEDIUMlib/levanter/src/levanter/recovery/faults.py38# Environment variables the harness sets on each trainer subprocess.COMMENT
LOWlib/levanter/src/levanter/tracker/tracker_fns.py102 # and we just return the metrics dictionaryCOMMENT
MEDIUMlib/levanter/src/levanter/data/sharded_datasource.py356 # (1) is cheating a bit, but it's fast and works in most cases we care about. (2) is more robust, but slower.COMMENT
MEDIUMlib/marin/src/marin/scaling_laws/isoflop_analysis.py237 """Fit a robust quadratic in log10(x) space using Huber loss.STRING
MEDIUMlib/marin/src/marin/execution/step_runner.py220 # inherit it explicitly. More robust than contextvars.copy_context()COMMENT
MEDIUMlib/marin/src/marin/evaluation/evalchemy/result.py83 # A retried evaluation leaves a second complete tree under the harness's scratch directory,COMMENT
LOWlib/haliax/src/haliax/core.py1173 # scalar case: just add one axis so it doesn't get too madCOMMENT
LOWlib/haliax/src/haliax/core.py1657 # maybe just add a context manager to allow it?COMMENT
MEDIUMlib/rigging/src/rigging/log_setup.py192 # faulthandler writes to a raw fd; a harness that captures sys.stderrCOMMENT
Structural Annotation Overuse44 hits · 79 pts
SeverityFileLineSnippetContext
LOW⚡experiments/tutorials/hello_world.py73# Step 1: generate the data. build_config resolves ctx.output_path to the artifact's output dir.COMMENT
LOW⚡experiments/tutorials/hello_world.py82# Step 2: compute statistics over the generated data. ctx.artifact_path(_data) gives the pathCOMMENT
LOW⚡tests/execution/test_step_runner.py120 # Step 1: downloadCOMMENT
LOW⚡tests/execution/test_step_runner.py124 # Step 2: tokenize — load upstream artifact, run, saveCOMMENT
LOW.agents/projects/20260303_iris_autoscaler_design.md729### Step 1: COOLDOWN State + AT_CAPACITY Rename (No Capacity Math Changes)COMMENT
LOW.agents/projects/20260303_iris_autoscaler_design.md739### Step 2: Additive Resource PackingCOMMENT
LOW.agents/docs/smoke-test-dry-run.md640### Step 1: Extract `local_platform.py` from `demo_cluster.py`COMMENT
LOW.agents/docs/smoke-test-dry-run.md650### Step 2: Proto + `LocalController` + config wiringCOMMENT
LOW⚡.agents/docs/smoke-test-dry-run.md671### Step 4: Smoke test integrationCOMMENT
LOW⚡.agents/docs/smoke-test-dry-run.md679### Step 5: Simplify `demo_cluster.py`COMMENT
LOW⚡.agents/docs/smoke-test-dry-run.md686### Step 6: CLI integration (optional)COMMENT
LOW.agents/docs/cluster-logging.md166### Step 1: Extract `stream_docker_logs()` into debug.pyCOMMENT
LOW.agents/docs/cluster-logging.md178### Step 2: Add `LogStreamHandle` and `start_log_streaming()` to ClusterManagerCOMMENT
LOW.agents/docs/cluster-logging.md191### Step 3: Add `log_dir` parameter to `connect()`COMMENT
LOW.agents/docs/cluster-logging.md204### Step 4: Simplify smoke-test.pyCOMMENT
LOWdocs/tutorials/first-experiment.md32## Step 1: Tokenize the datasetCOMMENT
LOWdocs/tutorials/first-experiment.md55## Step 2: Choose a model configurationCOMMENT
LOWdocs/tutorials/first-experiment.md78## Step 3: Assemble the training runCOMMENT
LOWdocs/tutorials/first-experiment.md120## Step 4: Wire the main blockCOMMENT
LOWdocs/tutorials/storage-bucket.md17## Step 1: Choose a Region and NameCOMMENT
LOWdocs/tutorials/storage-bucket.md31## Step 2: Create the BucketCOMMENT
LOWdocs/tutorials/storage-bucket.md53## Step 3: Disable Soft DeleteCOMMENT
LOWdocs/tutorials/storage-bucket.md73## Step 4: TTL Scratch Prefixes (`tmp/ttl=Nd/`)COMMENT
LOWdocs/tutorials/storage-bucket.md119## Step 5: Wire It Into Marin / LevanterCOMMENT
LOWlib/levanter/.agents/projects/gcs_serialization.md115 # Step 1: collective gather so every device sees every host's chunk.COMMENT
LOW⚡lib/levanter/docs/recipes/port-models.md14## Step 1: Write the ConfigCOMMENT
LOW⚡lib/levanter/docs/recipes/port-models.md20## Step 2: Implement the ModelCOMMENT
LOW⚡lib/levanter/docs/recipes/port-models.md26## Step 3: Add Serialization Support (if needed)COMMENT
LOW⚡lib/levanter/docs/recipes/port-models.md32## Step 4: Write TestsCOMMENT
LOWlib/levanter/docs/recipes/port-models.md45## Step 5: Create a "nano" configCOMMENT
LOWlib/levanter/docs/guides/Training-Data-Guide.md7## Step 1: Identify the Format for Each DatasetCOMMENT
LOWlib/levanter/docs/guides/Training-Data-Guide.md19## Step 2: Prepare Your DataCOMMENT
LOWlib/levanter/docs/guides/Training-Data-Guide.md47## Step 3: Write Your ConfigCOMMENT
LOWlib/levanter/docs/guides/Training-Data-Guide.md189## Step 4: Launch TrainingCOMMENT
LOW…evanter/docs/tutorials/Fine-Tuning-Semantic-Parsing.md69### Step 1: Prepare the DatasetCOMMENT
LOW…evanter/docs/tutorials/Fine-Tuning-Semantic-Parsing.md108### Step 2: Fine-tune the ModelCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py196 # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each,COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py199 # Step 2: init O_i = 0, sumexp_i = 0, max_i = -infCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py221 # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each,COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py227 # Step 8: compute Sij = QiKj^TCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py263 # Step 9: Compute m_i^j = max(m_i^{j-1}, rowmax(S_i^j)), P_i^j = exp(S_i^j - m_i^j),COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py272 # Step 10: Compute O_i = diag(exp(m_i^{j-1} - m_i^j) O_i + P_i^j V_jCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py287 # Step 12: compute O_i = diag(\ell_i^{Tc})^{-1} O_i^{Tc}COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py289 # Step 13: compute L_i = m_i^{Tc} + log(\ell_i^{Tc})COMMENT
Redundant / Tautological Comments24 hits · 36 pts
SeverityFileLineSnippetContext
LOWinfra/pre-commit.py782 # Check if any pb2 file exists alreadyCOMMENT
LOWinfra/tpu-ci/setup.py163 # Check if user is authenticated to ghcr.ioCOMMENT
LOW⚡infra/tpu-ci/vm_manager.py264# Check if runner is configured by looking for config files OR .runner fileCOMMENT
LOWscripts/pm/itemize_experiment_issues.py116 # Check if any of the URLs are already in the contentCOMMENT
LOWscripts/pm/itemize_experiment_issues.py153 # Check if any of the URLs are already in existing_reportsCOMMENT
LOWscripts/debug/decode_tokens.py83 # Check if it looks like a token listCOMMENT
LOWscripts/speedrun/onboarding_setup.sh47 # Check if a 'marin' directory exists in the current pathCOMMENT
LOW⚡scripts/speedrun/onboarding_setup.sh137# Check if uv is installedCOMMENT
LOWscripts/speedrun/onboarding_setup.sh219# Check if branch exists, if not create itCOMMENT
LOWscripts/speedrun/onboarding_setup.sh280# Check if origin points to the main community repo (indicating it's not a personal fork)COMMENT
LOWlib/iris/tests/cluster/backends/gcp/test_platform.py1165 # Set VM to STAGING so it never reaches READYCOMMENT
LOW…is/src/iris/cluster/controller/scheduling/scheduler.py846 # Assign tasks to workers in orderCOMMENT
LOWlib/iris/src/iris/cluster/worker/task_attempt.py918 # Check if we should stopCOMMENT
LOW⚡lib/levanter/tests/test_prp.py51 # Check if all elements are unique, which is a necessary condition for a bijective functionCOMMENT
LOWlib/levanter/tests/test_skip_step.py280 # Check if it has init and update attributesCOMMENT
LOWlib/levanter/tests/test_skip_step.py375 # Check if the unflattened state matches the originalCOMMENT
LOWlib/levanter/scripts/clean_old_checkpoints.py43 # Check if this checkpoint is the largest complete checkpointCOMMENT
LOWlib/levanter/scripts/clean_old_checkpoints.py48 # Check if this checkpoint ends in '000' and is the largest of suchCOMMENT
LOWlib/levanter/scripts/preproc/split-pile-shards.py60 # Check if compressor exists for this category, if not create itCOMMENT
LOWlib/levanter/src/levanter/eval_harness.py149 # Check if this is a rate limit error from HuggingFaceCOMMENT
LOW…src/levanter/grug/attention/_fa4_cute_segmented_bwd.py189 # Check if block size setting is out of shared memory capacityCOMMENT
LOWlib/marin/src/marin/markdown/markdown.py926 # Check if base is an operator usually taking limitsCOMMENT
LOW…n/src/marin/transform/wikipedia/transform_wikipedia.py127 # Check if this is display math by looking for <dd> inside <dl>COMMENT
LOWlib/haliax/tests/test_axis.py144 # Check if the element is in the correct orderCOMMENT
Hallucination Indicators4 hits · 35 pts
SeverityFileLineSnippetContext
CRITICALtests/evaluation/test_evaluation.py1404 assert evaluation.identity.eval_ref.evalchemy.judge.model_dump() == {STRING
CRITICALlib/levanter/tests/test_apertus.py250 lev_alpha_p = float(layer.mlp.act_fn.alpha_p.array.item())CODE
CRITICALlib/levanter/tests/test_apertus.py251 lev_alpha_n = float(layer.mlp.act_fn.alpha_n.array.item())CODE
CRITICALlib/marin/src/marin/inference/serve_dashboard.html93`+l.text,this.inlineQueue.pop(),this.inlineQueue.at(-1).src=n.text):t.push(l);continue}if(e){this.infiniteLoopError(e.chCODE
Verbosity Indicators15 hits · 33 pts
SeverityFileLineSnippetContext
LOW⚡experiments/tutorials/hello_world.py73# Step 1: generate the data. build_config resolves ctx.output_path to the artifact's output dir.COMMENT
LOW⚡experiments/tutorials/hello_world.py82# Step 2: compute statistics over the generated data. ctx.artifact_path(_data) gives the pathCOMMENT
LOW⚡tests/execution/test_step_runner.py120 # Step 1: downloadCOMMENT
LOW⚡tests/execution/test_step_runner.py124 # Step 2: tokenize — load upstream artifact, run, saveCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py196 # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each,COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py199 # Step 2: init O_i = 0, sumexp_i = 0, max_i = -infCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py221 # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each,COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py227 # Step 8: compute Sij = QiKj^TCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py263 # Step 9: Compute m_i^j = max(m_i^{j-1}, rowmax(S_i^j)), P_i^j = exp(S_i^j - m_i^j),COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py272 # Step 10: Compute O_i = diag(exp(m_i^{j-1} - m_i^j) O_i + P_i^j V_jCOMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py287 # Step 12: compute O_i = diag(\ell_i^{Tc})^{-1} O_i^{Tc}COMMENT
LOW⚡lib/levanter/src/levanter/layers/flash_attention.py289 # Step 13: compute L_i = m_i^{Tc} + log(\ell_i^{Tc})COMMENT
LOW⚡…src/levanter/grug/attention/_fa4_cute_segmented_bwd.py323 # Do we need to check if we overshot kBlockM when we load Q?COMMENT
LOW⚡…src/levanter/grug/attention/_fa4_cute_segmented_bwd.py325 # Do we need to check if we overshot kBlockN when we load K?COMMENT
LOW⚡…src/levanter/grug/attention/_fa4_cute_segmented_bwd.py333 # Do we need to check if we overshot kBlockN when we load V?COMMENT
Fake / Example Data27 hits · 31 pts
SeverityFileLineSnippetContext
LOW⚡tests/datakit/test_decon.py769 {"id": "eval", "text": "lorem ipsum dolor sit amet consectetur"},CODE
LOW⚡tests/datakit/test_decon.py769 {"id": "eval", "text": "lorem ipsum dolor sit amet consectetur"},CODE
LOW⚡tests/datakit/test_decon.py775 "text": "LOREM IPSUM DOLOR SIT AMET CONSECTETUR",CODE
LOW⚡tests/datakit/test_decon.py775 "text": "LOREM IPSUM DOLOR SIT AMET CONSECTETUR",CODE
LOWlib/iris/tests/cluster/backends/gcp/test_gcp_service.py439 svc._token = "fake-token"CODE
LOWlib/iris/tests/cluster/backends/gcp/test_gcp_service.py530 svc._token = "fake-token"CODE
LOW…cluster/backends/gcp/test_cloud_service_integration.py292 s._token = "fake-token"CODE
LOW⚡lib/iris/tests/cluster/controller/test_auth.py742 admin_users=["admin@example.com"],CODE
LOW⚡lib/iris/tests/cluster/controller/test_auth.py748 assert auth.role_policy.role_for("admin@example.com") == "admin"CODE
LOWlib/iris/tests/cluster/controller/test_auth.py674 return VerifiedIdentity(user_id="admin@example.com", role=self._role)CODE
LOWlib/iris/tests/cluster/controller/test_auth.py691 assert seen == [VerifiedIdentity(user_id="admin@example.com", role="admin")]CODE
LOW⚡lib/iris/src/iris/testing/config.py27 "placeholder": ScaleGroupConfig(CODE
LOW⚡lib/iris/src/iris/testing/config.py28 name="placeholder",CODE
LOW⚡lib/levanter/tests/test_tokenizers.py250 # Lorem ipsumCOMMENT
LOW⚡lib/levanter/tests/test_tokenizers.py251 "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt.",CODE
LOW⚡lib/levanter/tests/test_tokenizers.py251 "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt.",CODE
LOWlib/levanter/tests/test_tokenizers.py208 "user@example.com",CODE
LOW⚡lib/levanter/tests/test_text.py155 lorem = """Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et doCODE
LOW⚡lib/levanter/tests/test_text.py155 lorem = """Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et doCODE
LOW⚡lib/levanter/tests/test_text.py177 text = "lorem ipsum dolor sit amet " * 12_000 # ~324k charsCODE
LOW⚡lib/levanter/tests/test_text.py177 text = "lorem ipsum dolor sit amet " * 12_000 # ~324k charsCODE
LOW⚡lib/levanter/tests/test_text.py305 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et "CODE
LOW⚡lib/levanter/tests/test_text.py305 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et "CODE
LOWlib/marin/src/marin/inference/serve_dashboard.html49${t}`}let lM={type:"function",function:{name:"bash",description:"Run a Bash command in the persistent workspace rooted aCODE
LOW⚡lib/rigging/tests/test_server_auth.py163 roles = {"admin@example.com": "admin"}CODE
LOW⚡lib/rigging/tests/test_server_auth.py168 payload = {"aud": "/projects/1/global/backendServices/2", "email": "admin@example.com"}CODE
LOW⚡lib/rigging/tests/test_server_auth.py171 assert identity == VerifiedIdentity(user_id="admin@example.com", role="admin")CODE
Synthetic Comment Markers3 hits · 18 pts
SeverityFileLineSnippetContext
HIGHtests/snapshots/dclm_hq/inputs/hq_2.html87<p>Each locomotive is equipped with a mobile <a href="http://www.dccwiki.com/Decoder" class="extiw" title="dcc:Decoder">CODE
HIGHtests/snapshots/dclm_hq/inputs/hq_2.html426<p>Each locomotive is equipped with a mobile <a href="http://www.dccwiki.com/Decoder" class="extiw" title="dcc:Decoder">CODE
HIGHdocs/dev-guide/contributing.md13## AI-generated contributionsCOMMENT
Cross-Language Confusion (JS/TS)2 hits · 10 pts
SeverityFileLineSnippetContext
HIGH…arin/src/marin/inference/dashboard/src/lib/examples.ts52print("test passed")CODE
HIGH…arin/src/marin/inference/dashboard/src/lib/examples.ts86print("configuration is valid")CODE
Overly Generic Function Names3 hits · 4 pts
SeverityFileLineSnippetContext
LOW…iments/rl_data_reviews/review_runtime/harbor_worker.py19async def run_task(data: dict, root: Path) -> dict:CODE
LOW…periments/rl_data_reviews/review_runtime/gym_worker.py20def run_task(data: dict, root: Path, api_key: str | None) -> dict:CODE
LOW⚡tests/infra/ci/test_select_tests.py238 write(tmp_path, "lib/iris/tests/test_utils.py", "def helper():\n pass\n")CODE
Example Usage Blocks2 hits · 3 pts
SeverityFileLineSnippetContext
LOWscripts/iris/run_smoke_cw.sh8# Usage:COMMENT
LOWlib/levanter/scripts/clean_old_checkpoints.py78# Usage example:COMMENT
Slop Phrases1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/snapshots/stackexchange/inputs/chemistry_2.json3 "text": "# Hierarchy of electronic wavefunctions\n\n*The previous question contained too much unnecessary informatioCODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMlib/levanter/tests/test_background_iterable.py164CODE
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOWlib/levanter/src/levanter/models/gpt2_hyena.py68 # TODO: implementCOMMENT