Open-source framework for the research and development of foundation models.
This report summarizes scanner evidence for marin-community/marin, a Python project with 3,930 GitHub stars. SynthScan examined 1,088,848 lines of code across 4393 source files, recording 14832 pattern matches distributed across 27 syntactic categories. The legacy adjusted pattern signal is 17.7 (Elevated pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 11314 finding(s).
Are imports declared and package/API names verified? 902 finding(s).
Are wrappers, guards, and repeated structures necessary? 12644 finding(s).
Which changes need focused human review? 14832 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 14832 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/pre-commit.py | 476 | def check_trailing_whitespace(files: list[pathlib.Path], fix: bool) -> int: | CODE |
| LOW | infra/pre-commit.py | 602 | def check_markdown_precommit_invocation(files: list[pathlib.Path], fix: bool) -> int: | CODE |
| LOW | infra/pre-commit.py | 669 | def _should_skip_skill_reference(reference: str) -> bool: | CODE |
| LOW | infra/mkdocs_hooks.py | 13 | def _lower_external_inventory_failure(record: logging.LogRecord) -> bool: | CODE |
| LOW | infra/check_docs_source_links.py | 73 | def _iter_relative_check_files() -> list[Path]: | CODE |
| LOW | infra/lint/rules/cruft/ml-parallel-source-impl.yaml | 18 | def reconcile_request_from_plan(plan): ... # new-wire builder | CODE |
| LOW | infra/lint/rules/cruft/ml-parallel-source-impl.yaml | 19 | def legacy_translator_request(plan): ... # old-wire builder from same plan.request.desired | CODE |
| LOW⚡ | infra/lint/rules/cruft/ml-slop-test.yaml | 62 | def test_build_launch_command(): | CODE |
| LOW⚡ | infra/lint/rules/cruft/ml-slop-test.yaml | 70 | def test_make_runner_returns_runner(): | CODE |
| LOW⚡ | infra/lint/rules/cruft/ml-slop-test.yaml | 73 | def test_profile_has_remote_mcp(): | CODE |
| LOW | infra/lint/rules/prose/ml-vestigial-qualifier.yaml | 18 | def reconcile_workers_via_reconcile(...): ... # stutter; just reconcile_workers. | CODE |
| LOW | infra/ci/run_tests.py | 114 | def omit_locally_excluded_modules(invocation: PytestInvocation | None, repo_root: Path) -> PytestInvocation | None: | CODE |
| LOW | infra/ci/select_tests.py | 418 | def dependencies_by_test_file(scope: str, repo_root: Path, known: set[str]) -> dict[str, set[str]]: | CODE |
| LOW | infra/ci/select_tests.py | 519 | def _matching_resolution_markers(package: dict, active_extras: set[str]) -> tuple[str, ...] | None: | CODE |
| LOW | infra/ci/select_tests.py | 626 | def levanter_tpu_dependencies_changed(base_ref: str | None, repo_root: Path) -> bool: | CODE |
| LOW | infra/ci/select_tests.py | 789 | def torch_membership_for_test_file(path: Path) -> tuple[bool, bool]: | CODE |
| LOW | infra/ci/select_tests.py | 981 | def selected_scope_test_paths(matrix: list[MatrixLeg], scope: str) -> list[str]: | CODE |
| LOW | infra/ci/select_tests.py | 987 | def accelerator_suite_test_paths( | CODE |
| LOW | infra/ci/analyze_import_graph.py | 51 | def all_dependencies_by_test_file(repo_root: Path, known: set[str]) -> dict[str, set[str]]: | CODE |
| LOW | infra/ci/analyze_import_graph.py | 59 | def dependent_tests_by_module(test_deps: dict[str, set[str]]) -> dict[str, set[str]]: | CODE |
| LOW | infra/deploy/tests/test_cli.py | 79 | def test_service_rollout_applies_stack_from_project_directory( | CODE |
| LOW | infra/deploy/tests/test_cli.py | 109 | def test_service_rollout_loads_secret_environment(deployment_record: DeploymentRecord) -> None: | CODE |
| LOW | infra/deploy/tests/test_cli.py | 124 | def test_service_rollout_preserves_pulumi_failure_exit_code( | CODE |
| LOW | infra/grafana/tests/conftest.py | 22 | def install_finelog_dialect_macros(database) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 350 | def test_the_run_variable_offers_a_run_the_trainer_reported(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 363 | def test_the_trainer_panels_render_for_that_run(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 381 | def test_percentile_panels_compute_over_all_executions_in_each_bucket(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 423 | def test_the_node_agent_joins_through_node_name_without_a_run_id(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 434 | def test_the_engine_panels_select_by_metric_name_alone(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 456 | def test_a_trainer_that_stops_stamping_node_name_blanks_the_accelerator_panel(store) -> None: | CODE |
| LOW⚡ | infra/grafana/tests/test_rl_runs_dashboard.py | 474 | def test_the_producer_census_separates_the_engine_series_from_the_trainer(store) -> None: | CODE |
| LOW⚡ | infra/grafana/tests/test_rl_runs_dashboard.py | 482 | def test_the_census_still_answers_on_a_deployment_that_has_no_harbor_namespace(store) -> None: | CODE |
| LOW⚡ | infra/grafana/tests/test_rl_runs_dashboard.py | 489 | def test_the_census_is_empty_rather_than_broken_on_a_deployment_holding_none_of_them() -> None: | CODE |
| LOW⚡ | infra/grafana/tests/test_rl_runs_dashboard.py | 493 | def test_the_census_quotes_a_run_id_carrying_an_apostrophe() -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 510 | def test_every_timeseries_panel_declares_the_columns_its_projection_returns(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 528 | def test_every_panel_has_a_distinct_title_id_and_slot() -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 542 | def test_ray_panels_exclude_cumulative_snapshots_and_never_mix_states(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 552 | def test_engine_rates_keep_two_actors_that_both_report_engine_zero_apart(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 582 | def test_engine_panels_read_the_embedded_stream_as_well_as_the_standalone_one(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 614 | def test_every_labelled_series_panel_names_the_series_without_its_column() -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 634 | def test_a_listed_run_opens_the_view_framed_on_that_run() -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 663 | def test_a_listed_run_opens_the_dashboard_whose_picker_offers_it(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 714 | def test_the_recent_runs_query_returns_a_row_per_run_and_cluster(store) -> None: | CODE |
| LOW | infra/grafana/tests/test_rl_runs_dashboard.py | 725 | def test_a_listed_run_opens_a_window_that_contains_its_last_sample(store) -> None: | CODE |
| LOW⚡ | infra/grafana/tests/test_provisioning.py | 420 | def test_finelog_health_alert_pages_critical_after_five_minutes(): | CODE |
| LOW⚡ | infra/grafana/tests/test_provisioning.py | 428 | def test_finelog_relay_alert_pages_stalled_or_missing_namespaces(): | CODE |
| LOW⚡ | infra/grafana/tests/test_provisioning.py | 436 | def test_node_deadlock_alert_pages_critical_after_five_minutes(): | CODE |
| LOW⚡ | infra/grafana/tests/test_provisioning.py | 443 | def test_zephyr_stall_alert_is_a_warning_after_five_minutes(): | CODE |
| LOW⚡ | infra/grafana/tests/test_provisioning.py | 450 | def test_training_stall_alert_pages_each_hero_run_after_five_minutes(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 73 | def _create_levanter_stream_view(database: duckdb.DuckDBPyConnection) -> None: | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 126 | def test_alert_rules_have_resolvable_datasources_and_refids(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 138 | def test_alert_rules_define_nodata_and_error_behavior(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 218 | def test_every_rule_query_url_answers_on_the_bridge(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 234 | def test_configured_finelog_query_dependent_alerts_stay_normal_when_query_path_is_unavailable(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 254 | def test_alert_queries_select_exactly_one_numeric_column(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 265 | def test_policies_reference_provisioned_contact_points(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 275 | def test_warning_alerts_remain_visible_without_notifications(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 294 | def test_coreweave_storage_capacity_pages_critical_ops(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 403 | def test_every_slack_alert_goes_through_the_bridge_and_none_through_grafana(): | CODE |
| LOW | infra/grafana/tests/test_provisioning.py | 467 | def test_training_loss_alert_selects_the_hero_operator_behavior(): | CODE |
| 9832 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | infra/ci/select_tests.py | 228 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 230 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 295 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 297 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 346 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 348 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 429 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 431 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 834 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 836 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 1134 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/ci/select_tests.py | 1136 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 97 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 99 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 286 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 288 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 520 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 522 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 663 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 665 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 1021 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 1023 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 314 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 316 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 703 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 705 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 933 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/app.py | 935 | # -------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 162 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 164 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 212 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 214 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 249 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/samples.py | 251 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 241 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 243 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 413 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 415 | # -------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/ferries/daily.py | 41 | # --------------------------- | COMMENT |
| MEDIUM | experiments/ferries/daily.py | 43 | # --------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 50 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 57 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 106 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 108 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 191 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 196 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 242 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 244 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 269 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/grug/recovery/minimal_wedge_repro.py | 273 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 128 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 130 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 174 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 176 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 279 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 281 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 509 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 511 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 613 | # ---------------------------------------------------------------------- | COMMENT |
| MEDIUM | experiments/datakit/scripts/sync_datakit.py | 615 | # ---------------------------------------------------------------------- | COMMENT |
| 1170 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 145 | systemctl stop unattended-upgrades.service || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 146 | systemctl disable unattended-upgrades.service || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 147 | systemctl mask unattended-upgrades.service || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 148 | pkill -9 -f unattended-upgrade || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 149 | killall -9 apt apt-get || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 270 | ./svc.sh stop || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 271 | ./svc.sh uninstall || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 276 | sudo -u $RUNNER_USER ./config.sh remove --token $REGISTRATION_TOKEN || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 621 | sudo journalctl -u google-startup-scripts.service -n {lines} --no-pager || echo "No startup script logs found" | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 625 | grep "startup-script exit status" /var/log/syslog | tail -5 || echo "No completion marker found in syslog" | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 631 | cat ~/.docker/config.json | jq -r '.auths | keys[]' 2>/dev/null || echo "Unable to parse Docker auth config" | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 664 | -exec echo "{{}} ---" \\; -exec tail -n 50 {{}} \\; 2>/dev/null || true | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 669 | ps aux | grep -E "(Runner.Listener|Runner.Worker)" | grep -v grep || echo "No runner processes found" | CODE |
| HIGH⚡ | infra/tpu-ci/vm_manager.py | 673 | sudo docker ps -a || true | CODE |
| HIGH | infra/tpu-ci/vm_manager.py | 165 | if ! command -v docker &> /dev/null; then | CODE |
| HIGH | infra/tpu-ci/vm_manager.py | 649 | sudo systemctl status actions.runner.* --no-pager || true | CODE |
| HIGH | infra/tpu-ci/vm_manager.py | 653 | sudo journalctl -u actions.runner.* -n {lines} --no-pager || true | CODE |
| HIGH | infra/tpu-ci/vm_manager.py | 775 | sudo rm -f /tmp/libtpu_lockfile || true | CODE |
| HIGH | infra/tpu-ci/vm_manager.py | 776 | sudo lsof -t /dev/vfio/* 2>/dev/null | xargs -r sudo kill -9 || true | CODE |
| HIGH | infra/ducky/__main__.py | 29 | DASHBOARD_BUILD = "cd lib/ducky/dashboard && { test -d node_modules || npm ci; } && npm run build" | CODE |
| HIGH⚡ | infra/marina/tests/test_filer.py | 65 | ("rows.jsonl", b'{"nested":{"a":[1,2]}}\n{"nested":null}\n', [{"nested": {"a": [1, 2]}}, {"nested": None}]), | CODE |
| HIGH | infra/marina/src/marina/journeys.py | 47 | if (!(element.offsetWidth || element.offsetHeight)) continue | CODE |
| HIGH | infra/marina/src/marina/journeys.py | 53 | seen.push(`${element.tagName.toLowerCase()}:${label}`) | CODE |
| HIGH | …g/task_curation/datasets/skyrl/scorers/ifeval_utils.py | 303 | # func actually accepts (the spec carries all possible keys, most set to null). | COMMENT |
| HIGH⚡ | …/task_curation/datasets/tasktrove/repository_pytest.py | 38 | git -c safe.directory="$ws" clean -ffdx -- "$path" >/dev/null 2>&1 || true | CODE |
| HIGH⚡ | …/task_curation/datasets/tasktrove/repository_pytest.py | 40 | if git -c safe.directory="$ws" cat-file -e TRUSTED_SHA:"$path" 2>/dev/null; then | CODE |
| HIGH⚡ | …/task_curation/datasets/tasktrove/repository_pytest.py | 42 | elif [ -n "FALLBACK_SHA" ] && git -c safe.directory="$ws" cat-file -e FALLBACK_SHA:"$path" 2>/dev/null; then | CODE |
| HIGH | …aining/task_curation/datasets/tasktrove/swe_rebench.py | 60 | uv init --python 3.12 --no-progress >/dev/null 2>&1 || true | CODE |
| HIGH | …ration/datasets/tasktrove/conversion/verifyit_build.py | 21 | "RUN command -v git >/dev/null || (apt-get update && apt-get install -y --no-install-recommends git" | CODE |
| HIGH | …/post_training/task_curation/tests/test_swe_rebench.py | 75 | b"uv init --python 3.12 --no-progress >/dev/null 2>&1 || true\n" | CODE |
| HIGH | …st_training/task_curation/tests/test_tasktrove_code.py | 65 | SEED_SCRIPT = b"mkdir -p /workspace && printf 'x' > /workspace/notes.txt\n" | CODE |
| HIGH⚡ | experiments/rl_data_reviews/make_review.py | 43 | Positive observations MUST have kind observation and severity info or null; list actual defects with kind issue. | CODE |
| HIGH⚡ | experiments/rl_data_reviews/make_review.py | 46 | "metrics": [{"key": string, "value": number|string|boolean|null, "scale": null}], | CODE |
| HIGH⚡ | experiments/rl_data_reviews/make_review.py | 48 | "severity": "info"|"low"|"medium"|"high"|"critical"|null}], | CODE |
| HIGH | experiments/rl_data_reviews/make_review.py | 59 | "metrics": [{"key": string, "value": number|string|boolean|null, "scale": null}], | CODE |
| HIGH | experiments/rl_data_reviews/make_review.py | 61 | "severity": "info"|"low"|"medium"|"high"|"critical"|null}], | CODE |
| HIGH | experiments/june_tpu_67b_a2b/moe/sft_67b_a2b_2stage.py | 44 | cd ~/Documents/marin && source secrets.env # or "$DC_AGENT_SECRET_ENV" | STRING |
| HIGH | experiments/sft/launcher.py | 535 | # for a mixture, where epoch semantics are undefined) and keeps the ``auto_build_caches`` path. | COMMENT |
| HIGH | experiments/datakit/decontam/viewer/report.py | 53 | var vals=[],idxs=[];parts.forEach(function(p,i){if(isTok[i]){vals.push(p);idxs.push(i)}}); | CODE |
| HIGH | tests/execution/test_artifact.py | 243 | '{"name": "datasets/x", "version": "v1", "fingerprint": "abc", "result": null}' | CODE |
| HIGH | tests/inference/test_openai_batch.py | 78 | return _Response(b'{"status":"completed","output_file_id":"output-1","error_file_id":null}') | CODE |
| HIGH | tests/inference/test_openai_batch.py | 357 | b'{"status":"in_progress","request_counts":{"total":64,"completed":64,"failed":0},"output_file_id":null}' | CODE |
| HIGH | scripts/iris/dev_tpu.py | 507 | uv sync --all-packages --extra=tpu --python=3.12 || true | CODE |
| HIGH | scripts/ci/wait_for.py | 241 | _RECORD_JQ = '.[]|{id:.id,author:(.user.login//""),body:(.body//""),url:(.html_url//""),state:(.state//null)}' | CODE |
| HIGH | lib/shellbox/tests/test_daytona_machine.py | 196 | graded = await machine.run(Command(("sh", "-c", 'test "$(cat answer)" = 12 && printf 1.0'))) | CODE |
| HIGH⚡ | lib/shellbox/tests/test_local_machine.py | 347 | script = "id -u; grep CapEff /proc/self/status; echo written > /tmp/user-file && echo wrote" | CODE |
| HIGH | lib/shellbox/tests/test_local_machine.py | 257 | await machine.run(Command(("sh", "-c", "mkdir -p /logs/verifier && echo 0.5 > /logs/verifier/reward.txt"))) | CODE |
| HIGH | lib/shellbox/tests/test_local_machine.py | 313 | script = "touch /usr/shellbox-test 2>/dev/null || echo refused; touch /etc/shellbox-test 2>/dev/null || echo refused | CODE |
| HIGH | lib/shellbox/src/shellbox/backends/iris/machine.py | 160 | uid, name = (await self._checked("id -u && id -un")).split() | CODE |
| HIGH | lib/shellbox/src/shellbox/backends/qemu/machine.py | 295 | check = await self.run(Command(("/bin/sh", "-c", "test -x /bin/bash && test -x /harbor/pty-agent"))) | CODE |
| HIGH | lib/iris/tests/cluster/backends/k8s/test_coreweave.py | 653 | deleting them on stop would break a plain `iris cluster stop && iris cluster start`. | STRING |
| HIGH | lib/iris/tests/cluster/node_agent/test_kubernetes.py | 437 | assert metrics["n1"] == NodeMetrics() # present but all-null, not dropped | CODE |
| HIGH | lib/iris/tests/e2e/gpu_gang_smoke.py | 549 | "patch", "pod", pod, "-n", self.namespace, "--type=merge", "-p", '{"metadata":{"finalizers":null}}' | CODE |
| HIGH | lib/iris/tests/e2e/test_smoke.py | 814 | return routeReady && loaded; | CODE |
| HIGH | lib/iris/src/iris/cluster/setup_scripts.py | 194 | 'cd "$IRIS_WORKDIR" 2>/dev/null || true\n' | STRING |
| HIGH⚡ | lib/iris/src/iris/cluster/platforms/vm_lifecycle.py | 137 | f"sudo docker inspect --format='{{{{.State.Status}}}}' {container_name} 2>/dev/null || echo 'not_found'", | CODE |
| HIGH | lib/iris/src/iris/cluster/platforms/k8s/controller.py | 888 | + f". Run: cd infra/pulumi && pulumi stack select {config.name} && pulumi up" | CODE |
| HIGH⚡ | …src/iris/cluster/platforms/gcp/controller_bootstrap.py | 41 | sudo apt-get update -qq || true | CODE |
| HIGH⚡ | …src/iris/cluster/platforms/gcp/controller_bootstrap.py | 42 | sudo apt-get install -y -qq sysstat || true | CODE |
| HIGH⚡ | …src/iris/cluster/platforms/gcp/controller_bootstrap.py | 45 | sudo sed -i 's/^ENABLED="false"/ENABLED="true"/' /etc/default/sysstat || true | CODE |
| 78 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/lint/catalog.py | 6 | CODE | |
| LOW | infra/grafana/src/grafana_migrations/__init__.py | 6 | CODE | |
| LOW | infra/grafana/src/grafana_migrations/__init__.py | 6 | CODE | |
| LOW | infra/codehealth/refinement_sync.py | 6 | CODE | |
| LOW | infra/codehealth/rule_probe.py | 6 | CODE | |
| LOW | infra/codehealth/review_store.py | 6 | CODE | |
| LOW | infra/codehealth/refinement_tools.py | 6 | CODE | |
| LOW | infra/codehealth/github_review_corpus.py | 6 | CODE | |
| LOW | infra/marina/apps/evaldash/metrics.py | 18 | CODE | |
| LOW | infra/marina/apps/evaldash/review.py | 17 | CODE | |
| LOW | infra/marina/apps/evaldash/results_db.py | 15 | CODE | |
| LOW | infra/marina/apps/evaldash/cluster.py | 14 | CODE | |
| LOW | infra/marina/apps/evaldash/app.py | 28 | CODE | |
| LOW | infra/marina/apps/evaldash/record_reconciliation.py | 6 | CODE | |
| LOW | infra/marina/apps/evaldash/samples.py | 18 | CODE | |
| LOW | infra/marina/apps/evaldash/fixtures.py | 19 | CODE | |
| LOW | infra/marina/apps/zephyr/backend/app.py | 11 | CODE | |
| LOW | infra/marina/src/marina/discovery.py | 6 | CODE | |
| LOW | infra/loom/infrastructure.py | 6 | CODE | |
| LOW | infra/loom/tests/test_infrastructure.py | 4 | CODE | |
| LOW | experiments/post_training/snowball_online_eagle.py | 18 | CODE | |
| LOW | experiments/post_training/test_async_rl.py | 4 | CODE | |
| LOW | experiments/post_training/iceball_micro.py | 23 | CODE | |
| LOW | experiments/post_training/async_rl.py | 26 | CODE | |
| LOW | experiments/post_training/task_curation/rl_smoke.py | 10 | CODE | |
| LOW | …orers/skyrl_gym/envs/nemotron_ultra/rdkit_chemistry.py | 5 | CODE | |
| LOW | …ltra/scorers/skyrl_gym/envs/nemotron_ultra/code_gen.py | 5 | CODE | |
| LOW | …ltra/scorers/skyrl_gym/envs/nemotron_ultra/calendar.py | 5 | CODE | |
| LOW | …on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py | 5 | CODE | |
| LOW | …tra/scorers/skyrl_gym/envs/nemotron_ultra/tool_call.py | 5 | CODE | |
| LOW | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 5 | CODE | |
| LOW | …skyrl_gym/envs/nemotron_ultra/instruction_following.py | 5 | CODE | |
| LOW | …s/skyrl_gym/envs/nemotron_ultra/format_verification.py | 5 | CODE | |
| LOW | …curation/datasets/skyrl/scorers/text_to_sql_scoring.py | 30 | CODE | |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 33 | CODE | |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 34 | CODE | |
| LOW | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 5 | CODE | |
| LOW | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 18 | CODE | |
| LOW | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 19 | CODE | |
| LOW | …s/arc/scorers/skyrl_gym/envs/nemotron_ultra/sandbox.py | 5 | CODE | |
| LOW | …ets/arc/scorers/skyrl_gym/envs/nemotron_ultra/nvarc.py | 5 | CODE | |
| LOW | experiments/post_training/mismatch_probe/metrics.py | 6 | CODE | |
| LOW | experiments/post_training/mismatch_probe/launch.py | 6 | CODE | |
| LOW | experiments/post_training/mismatch_probe/report.py | 6 | CODE | |
| LOW | experiments/post_training/curriculum_rl/launch.py | 21 | CODE | |
| LOW | experiments/post_training/curriculum_rl/pool.py | 23 | CODE | |
| LOW | experiments/post_training/task_curriculum/models.py | 6 | CODE | |
| LOW | …s/post_training/task_curriculum/task_mapping/models.py | 6 | CODE | |
| LOW | …ts/post_training/task_curriculum/task_mapping/cache.py | 6 | CODE | |
| LOW | experiments/post_training/cat_count_canary/launcher.py | 6 | CODE | |
| LOW | experiments/post_training/cat_count_canary/data.py | 6 | CODE | |
| LOW | …periments/post_training/curriculum_sft/self_distill.py | 17 | CODE | |
| LOW | experiments/post_training/curriculum_sft/code_tasks.py | 19 | CODE | |
| LOW | experiments/post_training/curriculum_sft/generation.py | 14 | CODE | |
| LOW | experiments/post_training/curriculum_sft/science.py | 18 | CODE | |
| LOW | experiments/grug/__init__.py | 4 | CODE | |
| LOW | experiments/grug/__init__.py | 4 | CODE | |
| LOW | experiments/grug/moe_hero_ep/harrier_mix_2026_08_18.py | 14 | CODE | |
| LOW | …periments/grug/moe_hero_ep/harrier_mix_2026_08_17_1.py | 6 | CODE | |
| LOW | experiments/grug/recovery/run_ablations.py | 21 | CODE | |
| 671 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/pre-commit.py | 379 | except Exception: | CODE |
| LOW | infra/pre-commit.py | 414 | except Exception as e: | CODE |
| LOW | infra/pre-commit.py | 421 | except Exception as e: | CODE |
| LOW | infra/pre-commit.py | 487 | except Exception: | CODE |
| LOW | infra/pre-commit.py | 537 | except Exception: | CODE |
| LOW | infra/pre-commit.py | 567 | except Exception as e: | CODE |
| LOW | infra/pre-commit.py | 614 | except Exception: | CODE |
| LOW | infra/pre-commit.py | 687 | except Exception as e: | CODE |
| LOW | infra/pre-commit.py | 718 | except Exception as e: | CODE |
| LOW | infra/pre-commit.py | 1045 | except Exception as e: | CODE |
| LOW | infra/linter.py | 239 | except Exception: | CODE |
| LOW | infra/lint/rules/robustness/ml-try-except-fallback.yaml | 19 | except Exception: | CODE |
| LOW | infra/grafana/benchmarks/inference_query_cost.py | 74 | except Exception as error: | CODE |
| LOW | infra/grafana/src/cache.py | 133 | except Exception as error: | CODE |
| LOW | infra/grafana/src/grafana_migrations/engine.py | 111 | except Exception: | CODE |
| LOW | infra/tpu-ci/setup.py | 369 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/setup.py | 384 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/setup.py | 552 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/vm_manager.py | 408 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/vm_manager.py | 455 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/vm_manager.py | 465 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/vm_manager.py | 482 | except Exception as e: | CODE |
| LOW | infra/tpu-ci/vm_manager.py | 547 | except Exception as e: | CODE |
| LOW | infra/codehealth/refinement_sync.py | 170 | except Exception as error: | CODE |
| LOW | infra/codehealth/rule_probe.py | 220 | except Exception as error: | STRING |
| LOW | infra/marina/apps/echo/sync/main.py | 249 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/review.py | 246 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/cluster.py | 117 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/cluster.py | 152 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 643 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 657 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 723 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 790 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 877 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/record_reconciliation.py | 88 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/record_reconciliation.py | 97 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/record_reconciliation.py | 124 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/samples.py | 265 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/samples.py | 369 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/samples.py | 482 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/evaldash/samples.py | 538 | except Exception as exc: | CODE |
| LOW | infra/marina/apps/zephyr/backend/app.py | 180 | except Exception as error: | CODE |
| LOW | infra/marina/apps/zephyr/backend/app.py | 281 | except Exception as error: | CODE |
| LOW | infra/marina/apps/zephyr/backend/app.py | 287 | except Exception as error: | CODE |
| MEDIUM | infra/marina/apps/zephyr/backend/app.py | 284 | def run_namespaces() -> list[str]: | CODE |
| LOW | infra/marina/src/marina/applets.py | 1060 | except Exception as error: | CODE |
| LOW | infra/xprof/gateway.py | 216 | except Exception: | CODE |
| LOW | infra/xprof/gateway.py | 308 | except Exception as exc: | CODE |
| LOW | experiments/post_training/task_curation/local.py | 94 | except Exception as error: | CODE |
| LOW | experiments/post_training/task_curation/campaign.py | 215 | except Exception as error: | CODE |
| LOW | experiments/post_training/task_curation/campaign.py | 221 | except Exception: | CODE |
| LOW | …ining/task_curation/datasets/reasoning_gym/generate.py | 81 | except Exception as error: | CODE |
| LOW | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 125 | except Exception as error: | CODE |
| LOW | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 138 | except Exception as error: | CODE |
| LOW | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 146 | except Exception as error: | CODE |
| LOW | …skyrl_gym/envs/nemotron_ultra/instruction_following.py | 45 | except Exception as error: | CODE |
| LOW | …curation/datasets/skyrl/scorers/text_to_sql_scoring.py | 227 | except Exception: | CODE |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 247 | except Exception: | STRING |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 279 | except Exception: | STRING |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 321 | except Exception: | CODE |
| 521 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/ci/run_status.py | 18 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/finelog_source.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/server.py | 183 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/github_app.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/github_source.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/rl_producers.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/k8s_source.py | 50 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/iris_source.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/loom_alerts.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/grafana/src/grafana_migrations/__main__.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/echo/models.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/echo/app.py | 81 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/echo/migrate.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/evaldash/review.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/evaldash/results_db.py | 48 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/evaldash/results_db.py | 313 | def set_model_archived(engine: Engine, model_name: str, archived: bool, updated_by: str | None) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/cluster.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 99 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 391 | def _set_snapshot(self, records: list[EvalRunRecord]) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 424 | def set_model_archived(self, model_name: str, archived: bool, updated_by: str | None) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 667 | def set_catalog_error(self, error: str | None) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 678 | def set_model_archived(self, model_name: str, archived: bool, updated_by: str | None) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/app.py | 816 | def _set_cycle_error(self, error: str | None) -> None: | CODE |
| LOW | infra/marina/apps/evaldash/samples.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/apps/zephyr/backend/app.py | 110 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/src/marina/db.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/src/marina/db.py | 134 | def _set_search_path(dbapi_connection, _record) -> None: | CODE |
| LOW | infra/marina/src/marina/db.py | 153 | def _set_role_and_search_path(dbapi_connection, _record) -> None: | CODE |
| LOW | infra/marina/src/marina/journeys.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/marina/src/marina/cli.py | 422 | def set_applet_mode(applet_id: str, mode: str, service_url: str) -> None: | CODE |
| LOW | infra/pulumi/src/iac/iris/deploy.py | 41 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/xprof/gateway.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/xprof/gateway.py | 75 | def set_size(self, size: int) -> None: | CODE |
| LOW | infra/xprof/server.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | infra/xprof/rust_proxy.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/evals/federated_inference_proxy_demo.py | 41 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/iceball_micro.py | 73 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/task_curation/campaign.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | …g/task_curation/datasets/skyrl/scorers/ifeval_utils.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_rl/launch.py | 71 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_rl/pool.py | 43 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_rl/report.py | 61 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/cat_count_canary/data.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | …periments/post_training/curriculum_sft/self_distill.py | 59 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_sft/code_tasks.py | 57 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_sft/finance.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_sft/generation.py | 44 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/post_training/curriculum_sft/science.py | 52 | logger = logging.getLogger(__name__) | CODE |
| LOW | …/post_training/curriculum_sft/instruction_following.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/ferries/grug_multislice_smoke.py | 41 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/ferries/datakit_reference_ferry.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/ferries/datakit_nemotron_ferry.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/grug/dispatch.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/grug/__init__.py | 6 | __all__ = ["base", "moe"] | CODE |
| LOW | experiments/grug/checkpointing.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/grug/moe_hero_ep/adamh.py | 100 | __all__ = ["ScaleByAdamHState", "scale_by_adamh"] | CODE |
| LOW | experiments/grug/moe_hero_ep/checkpoints.py | 18 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/grug/moe_hero_ep/model.py | 1572 | __all__ = [ | CODE |
| LOW | experiments/grug/moe_hero_ep/train.py | 81 | logger = logging.getLogger(__name__) | CODE |
| LOW | experiments/grug/moe_hero_ep/train.py | 1364 | __all__ = [ | CODE |
| 533 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | infra/pre-commit.py | 537 | except Exception: | CODE |
| HIGH | infra/grafana/src/server.py | 348 | except ValueError: | CODE |
| HIGH | infra/xprof/server.py | 40 | except OSError: | CODE |
| HIGH | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 66 | except (ValueError, AttributeError): | CODE |
| HIGH | …rs/skyrl_gym/envs/nemotron_ultra/structured_outputs.py | 41 | except (ValueError, AttributeError): | CODE |
| HIGH | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 247 | except Exception: | CODE |
| HIGH | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 309 | except SystemExit: | CODE |
| HIGH | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 518 | except SystemExit as e: | CODE |
| HIGH | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 408 | except Exception as e: | CODE |
| HIGH | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 415 | except Exception as e: | CODE |
| HIGH | tests/test_integration_test.py | 83 | except subprocess.TimeoutExpired: | CODE |
| HIGH | tests/test_integration_test.py | 87 | except ProcessLookupError: | CODE |
| HIGH | tests/integration_test.py | 229 | except FileNotFoundError: | CODE |
| HIGH | scripts/ci/iris_monitor.py | 1005 | except (urllib.error.URLError, ConnectionError, TimeoutError, OSError): | CODE |
| HIGH | scripts/ci/iris_monitor.py | 400 | except json.JSONDecodeError: | CODE |
| HIGH | scripts/debug/decode_tokens.py | 90 | except Exception: | CODE |
| HIGH | lib/shellbox/tests/test_daytona_machine.py | 67 | except ProcessLookupError: | CODE |
| HIGH | lib/shellbox/tests/test_docker_machine.py | 94 | except ProcessLookupError: | CODE |
| HIGH | lib/shellbox/src/shellbox/backends/docker/machine.py | 107 | except (BrokenPipeError, ConnectionResetError): | CODE |
| HIGH | lib/shellbox/src/shellbox/backends/local/machine.py | 204 | except (BrokenPipeError, ConnectionResetError): | CODE |
| HIGH | lib/iris/tests/conftest.py | 170 | except (OSError, ValueError): | CODE |
| HIGH | lib/iris/tests/conftest.py | 161 | except ValueError: | CODE |
| HIGH | …cluster/backends/gcp/test_cloud_service_integration.py | 69 | except Exception: | CODE |
| HIGH | …cluster/backends/gcp/test_cloud_service_integration.py | 62 | except (json.JSONDecodeError, UnicodeDecodeError): | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1469 | except Exception: | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1490 | except Exception: | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1510 | except Exception: | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1530 | except Exception: | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1563 | except Exception: | CODE |
| HIGH | …b/iris/tests/cluster/controller/test_demand_routing.py | 1582 | except Exception: | CODE |
| HIGH | lib/iris/scripts/benchmark_controller.py | 241 | except Exception: | CODE |
| HIGH | lib/iris/scripts/benchmark_controller.py | 474 | except sqlite3.OperationalError: | CODE |
| HIGH | lib/iris/scripts/benchmark_controller.py | 480 | except sqlite3.OperationalError: | CODE |
| HIGH | lib/iris/scripts/benchmark_controller.py | 331 | except Exception: | CODE |
| HIGH | lib/iris/src/iris/env_resources.py | 107 | except (FileNotFoundError, PermissionError): | CODE |
| HIGH | lib/iris/src/iris/env_resources.py | 121 | except (FileNotFoundError, PermissionError, ValueError, IndexError): | CODE |
| HIGH | lib/iris/src/iris/test_util.py | 47 | except FileNotFoundError: | CODE |
| HIGH | lib/iris/src/iris/managed_thread.py | 268 | except ValueError: | CODE |
| HIGH | lib/iris/src/iris/cluster/process_status.py | 49 | except (OSError, ValueError, IndexError): | CODE |
| HIGH | lib/iris/src/iris/cluster/process_status.py | 66 | except OSError: | CODE |
| HIGH | lib/iris/src/iris/cluster/platforms/types.py | 89 | except (FileNotFoundError, ValueError, ProcessLookupError, PermissionError): | CODE |
| HIGH | lib/iris/src/iris/cluster/platforms/k8s/service.py | 872 | except (subprocess.TimeoutExpired, OSError): | CODE |
| HIGH | lib/iris/src/iris/cluster/platforms/k8s/controller.py | 1184 | except (ValueError, AttributeError): | CODE |
| HIGH | lib/iris/src/iris/cluster/platforms/gcp/cloud.py | 508 | except google.api_core.exceptions.NotFound: | CODE |
| HIGH | lib/iris/src/iris/cluster/backends/k8s/tasks.py | 1558 | except (ValueError, AttributeError): | CODE |
| HIGH | lib/iris/src/iris/cluster/runtime/profile.py | 392 | except (ProcessLookupError, PermissionError): | CODE |
| HIGH | lib/iris/src/iris/cluster/runtime/docker.py | 335 | except ValueError: | CODE |
| HIGH | lib/iris/src/iris/cluster/runtime/process.py | 231 | except ProcessLookupError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/worker.py | 787 | except RuntimeError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/worker.py | 403 | except RuntimeError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/task_attempt.py | 485 | except RuntimeError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/env_probe.py | 204 | except FileNotFoundError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/env_probe.py | 619 | except (OSError, ValueError): | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/env_probe.py | 627 | except OSError: | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/env_probe.py | 650 | except (OSError, ValueError, IndexError): | CODE |
| HIGH | lib/iris/src/iris/cluster/worker/env_probe.py | 664 | except (OSError, ValueError, IndexError): | CODE |
| HIGH | lib/iris/src/iris/cli/cluster.py | 481 | except AlreadyExists: | CODE |
| HIGH | lib/iris/src/iris/cli/cluster.py | 1779 | except Exception: | CODE |
| HIGH | lib/iris/src/iris/jax/multigpu_main.py | 152 | except subprocess.TimeoutExpired: | CODE |
| HIGH | lib/iris/src/iris/actor/client.py | 53 | except ValueError: | CODE |
| 57 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/pre-commit.py | 244 | CODE | |
| LOW | infra/pre-commit.py | 363 | CODE | |
| LOW | infra/pre-commit.py | 390 | CODE | |
| LOW | infra/pre-commit.py | 476 | CODE | |
| LOW | infra/pre-commit.py | 517 | CODE | |
| LOW | infra/pre-commit.py | 549 | CODE | |
| LOW | infra/pre-commit.py | 602 | CODE | |
| LOW | infra/pre-commit.py | 675 | CODE | |
| LOW | infra/linter.py | 376 | CODE | |
| LOW | infra/check_docs_source_links.py | 48 | CODE | |
| LOW | infra/ci/select_tests.py | 267 | CODE | |
| LOW | infra/ci/select_tests.py | 533 | CODE | |
| LOW | infra/ci/select_tests.py | 688 | CODE | |
| LOW | infra/ci/select_tests.py | 789 | CODE | |
| LOW | infra/ci/select_tests.py | 931 | CODE | |
| LOW | infra/ci/analyze_import_graph.py | 221 | CODE | |
| LOW | infra/grafana/tests/test_provisioning.py | 687 | CODE | |
| LOW | infra/grafana/tests/test_provisioning.py | 854 | CODE | |
| LOW | infra/grafana/tests/test_vllm_observability.py | 168 | CODE | |
| LOW | infra/grafana/benchmarks/inference_query_cost.py | 181 | CODE | |
| LOW | infra/grafana/src/github_source.py | 118 | CODE | |
| LOW | infra/grafana/src/training_stalls.py | 156 | CODE | |
| LOW | infra/grafana/src/dashboard_dataset.py | 120 | CODE | |
| LOW | infra/grafana/src/nightly.py | 186 | CODE | |
| LOW | infra/codehealth/complexity.py | 86 | CODE | |
| LOW | infra/codehealth/github_review_corpus.py | 744 | CODE | |
| LOW | infra/marina/database_grants.py | 59 | CODE | |
| LOW | infra/marina/applets/filer/server/app.py | 78 | CODE | |
| LOW | infra/marina/applets/filer/server/app.py | 140 | CODE | |
| LOW | infra/marina/applets/filer/server/app.py | 200 | CODE | |
| LOW | infra/marina/applets/filer/server/app.py | 248 | CODE | |
| LOW | infra/marina/tests/test_rl_data_catalog.py | 209 | CODE | |
| LOW | infra/marina/apps/echo/app.py | 702 | CODE | |
| LOW | infra/marina/apps/plantt/app.py | 86 | CODE | |
| LOW | infra/marina/apps/evaldash/review.py | 137 | CODE | |
| LOW | infra/marina/apps/evaldash/fixtures.py | 168 | CODE | |
| LOW | infra/marina/src/marina/db.py | 164 | CODE | |
| LOW | infra/marina/src/marina/applets.py | 277 | CODE | |
| LOW | infra/marina/src/marina/applets.py | 875 | CODE | |
| LOW | infra/marina/src/marina/local_postgres.py | 22 | CODE | |
| LOW | infra/marina/src/marina/cli.py | 116 | CODE | |
| LOW | infra/marina/src/marina/cli.py | 274 | CODE | |
| LOW | infra/pulumi/iam_principal.py | 132 | CODE | |
| LOW | infra/pulumi/src/iac/github/audit.py | 181 | CODE | |
| LOW | infra/pulumi/src/iac/github/resources.py | 104 | CODE | |
| LOW | experiments/marin_tokenizer.py | 35 | CODE | |
| LOW | experiments/post_training/async_rl.py | 278 | CODE | |
| LOW | experiments/post_training/task_curation/local.py | 49 | CODE | |
| LOW | experiments/post_training/task_curation/campaign.py | 161 | CODE | |
| LOW | experiments/post_training/task_curation/pipeline.py | 474 | CODE | |
| LOW | …ining/task_curation/datasets/nemotron_ultra/graders.py | 322 | CODE | |
| LOW | …ltra/scorers/skyrl_gym/envs/nemotron_ultra/calendar.py | 22 | CODE | |
| LOW | …on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py | 77 | CODE | |
| LOW | …on_ultra/scorers/skyrl_gym/envs/nemotron_ultra/mcqa.py | 103 | CODE | |
| LOW | …st_training/task_curation/datasets/skyrl/preference.py | 298 | CODE | |
| LOW | …curation/datasets/skyrl/scorers/text_to_sql_scoring.py | 89 | CODE | |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 449 | CODE | |
| LOW | …/task_curation/datasets/skyrl/scorers/livecodebench.py | 570 | CODE | |
| LOW | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 133 | CODE | |
| LOW | …k_curation/datasets/skyrl/scorers/apps_testing_util.py | 604 | CODE | |
| 526 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | experiments/post_training/curriculum_sft/code_trial.py | 0 | build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows. | STRING |
| HIGH | …eriments/post_training/curriculum_sft/finance_trial.py | 0 | build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows. | STRING |
| HIGH | …training/curriculum_sft/instruction_following_trial.py | 0 | build baseline and trained ifeval/ifbench evaluations around one sft run on self-distilled rows. | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grug | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grug | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | newton-schulz orthogonalization for the always-stacked ep grug moe model. opinionated companion to ``levanter.optim.grug | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing th | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing th | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | batch mesh axes with size > 1, excluding the cross-rack dcn axis. orthogonalization stays within a rack: distributing th | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | muon gradient transformation for the stacked model (2d/3d/4d leaves). | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | muon gradient transformation for the stacked model (2d/3d/4d leaves). | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | muon gradient transformation for the stacked model (2d/3d/4d leaves). | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambigui | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambigui | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | newton-schulz on a single matrix, fully replicated across devices. replicates before iterating to avoid sharding ambigui | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | run newton-schulz on a matrix that is already local to one device. | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | run newton-schulz on a matrix that is already local to one device. | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | run newton-schulz on a matrix that is already local to one device. | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | run batched newton-schulz with quack symmetric products (x @ x.t). | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | run batched newton-schulz with quack symmetric products (x @ x.t). | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | run batched newton-schulz with quack symmetric products (x @ x.t). | STRING |
| HIGH | experiments/grug/moe_hero_ep/grugmuon_hero.py | 0 | distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis. | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/grugmuon_hero.py | 0 | distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis. | STRING |
| HIGH | experiments/grug/fast_track/grugmuon_stacked.py | 0 | distribute a matrix stack over the intra-rack batch axes, zero-padding the leading axis. | STRING |
| HIGH | experiments/grug/moe_hero_ep/model.py | 0 | moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing loss | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/model.py | 0 | moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing loss | STRING |
| HIGH | experiments/grug/moe_pipeline/model.py | 0 | moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing loss | STRING |
| HIGH | experiments/grug/moe/model.py | 0 | moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing loss | STRING |
| HIGH | experiments/june_tpu_67b_a2b/moe/model.py | 0 | moe grug variant model. architecture: qb-routed moe with gatednorm, xsa, sigmoid combine weights. no load-balancing loss | STRING |
| HIGH | experiments/grug/moe_hero_ep/model.py | 0 | learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1 | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/model.py | 0 | learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1 | STRING |
| HIGH | experiments/grug/fast_track/model.py | 0 | learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1 | STRING |
| HIGH | experiments/grug/moe/model.py | 0 | learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1 | STRING |
| HIGH | experiments/june_tpu_67b_a2b/moe/model.py | 0 | learnable per-dimension gating. compensates for adamh's bounded activation norms. see https://arxiv.org/abs/2601.22966v1 | STRING |
| HIGH | experiments/grug/moe_hero_ep/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/grug/fast_track/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/grug/moe/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/grug/base/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/june_tpu_67b_a2b/moe/model.py | 0 | return a small abstract mesh and token sharding for lowering contract tests. | STRING |
| HIGH | experiments/grug/moe_hero_ep/model.py | 0 | set router biases from qb betas (computed on previous step). | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/train.py | 0 | set router biases from qb betas (computed on previous step). | STRING |
| HIGH | experiments/grug/fast_track/train.py | 0 | set router biases from qb betas (computed on previous step). | STRING |
| HIGH | experiments/grug/moe/train.py | 0 | set router biases from qb betas (computed on previous step). | STRING |
| HIGH | experiments/june_tpu_67b_a2b/moe/train.py | 0 | set router biases from qb betas (computed on previous step). | STRING |
| HIGH | experiments/grug/moe_hero_ep/optimizer.py | 0 | restore named mesh sharding without touching single-device arrays. | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/optimizer.py | 0 | restore named mesh sharding without touching single-device arrays. | STRING |
| HIGH | experiments/grug/fast_track/optimizer.py | 0 | restore named mesh sharding without touching single-device arrays. | STRING |
| HIGH | experiments/grug/moe/optimizer.py | 0 | restore named mesh sharding without touching single-device arrays. | STRING |
| HIGH | experiments/june_tpu_67b_a2b/moe/optimizer.py | 0 | restore named mesh sharding without touching single-device arrays. | STRING |
| HIGH | experiments/grug/moe_hero_ep/optimizer.py | 0 | muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (sc | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/optimizer.py | 0 | muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (sc | STRING |
| HIGH | experiments/grug/fast_track/optimizer.py | 0 | muonh hyperball step: move along the orthogonalized direction, then project back to the parameter's frobenius sphere (sc | STRING |
| HIGH | experiments/grug/moe_hero_ep/optimizer.py | 0 | muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step. | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/optimizer.py | 0 | muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step. | STRING |
| HIGH | experiments/grug/fast_track/optimizer.py | 0 | muonh transform for the stacked model: newton-schulz direction + frobenius hyperball step. | STRING |
| HIGH | experiments/grug/moe_hero_ep/heuristic.py | 0 | muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule). | STRING |
| HIGH | experiments/grug/moe_hero_fsdp/heuristic.py | 0 | muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule). | STRING |
| HIGH | experiments/grug/fast_track/heuristic.py | 0 | muonh optimizer with lr / beta2 / epsilon scaled to this token budget (1pct-noclip schedule). | STRING |
| HIGH | experiments/grug/moe_pipeline/model.py | 0 | per-block gradient checkpointing. "recompute_all" reruns the whole block in backward (lowest memory); "save_moe" keeps t | STRING |
| 34 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | pyproject.toml | 21 | "marin-rigging[secrets]", | COMMENT |
| LOW | pyproject.toml | 81 | # names one, so our intentional pre-releases resolve while everything else stays | COMMENT |
| LOW | pyproject.toml | 281 | target-version = "py312" | COMMENT |
| LOW | pyproject.toml | 301 | # imports except to break a circular import or guard an optional dep) | COMMENT |
| LOW | pyproject.toml | 541 | "docker: mark tests that require a Docker daemon", | COMMENT |
| LOW | infra/ci/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/deploy/src/marin_deploy/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/grafana/Pulumi.marin-grafana.yaml | 1 | config: | COMMENT |
| LOW | infra/grafana/entrypoint.sh | 1 | #!/bin/bash | COMMENT |
| LOW | infra/grafana/__main__.py | 41 | # The cloudsql stack (infra/cloudsql) publishes the marin-metadata connection name that backs | COMMENT |
| LOW | infra/grafana/tests/test_sources.py | 501 | def test_wandb_run_activity_separates_active_time_from_downtime(): | COMMENT |
| LOW | infra/grafana/provisioning/datasources/finelog.yaml | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/grafana/provisioning/datasources/k8s.yaml | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/grafana/provisioning/alerting/rules.yaml | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/grafana/provisioning/alerting/contact-points.yaml | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/grafana/src/k8s_source.py | 101 | COMMENT | |
| LOW | infra/grafana/src/k8s_source.py | 121 | # otherwise falls back to the runtime signature of exit 255, reason Error, and a | COMMENT |
| LOW | infra/grafana/src/wandb_source.py | 41 | _RUN_URL = "https://wandb.ai/{entity}/{project}/runs/{run}" | COMMENT |
| LOW | infra/grafana/src/wandb_source.py | 61 | # step's `throughput/tokens_per_second`, which a checkpoint or eval step drives | COMMENT |
| LOW | infra/tpu-ci/vm_manager.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | infra/tpu-ci/vm_manager.py | 421 | logging.info(f"[{zone}] Found {len(vms)} TPU VMs") | COMMENT |
| LOW | infra/marina/applets/rl_data_catalog/server/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/applets/filer/server/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/web/markdown.ts | 1 | // The subset of Markdown the apps display, turned into a tree. | COMMENT |
| LOW | infra/marina/tests/notes_app/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | …/marina/examples/problem-set-applet/server/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/apps/plantt/tests/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/apps/evaldash/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/apps/tasktrove/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/marina/apps/zephyr/backend/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/iris/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/coreweave/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/gcp/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/gcp/iam_data.yaml | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/gcp/cloud_run.py | 81 | COMMENT | |
| LOW | infra/pulumi/src/iac/gcp/iam_config.py | 41 | "serviceAccount:", | COMMENT |
| LOW | infra/pulumi/src/iac/github/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | infra/pulumi/src/iac/kubernetes/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | config/external/migration.toml | 1 | # Fork migration descriptors. | COMMENT |
| LOW | config/external/migration.toml | 21 | # fork with more than one pin has one section per pin (the vllm fork has `vllm` and `vllm-gpu`). | COMMENT |
| LOW | experiments/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/coral/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/evals/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/post_training/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/post_training/async_rl.py | 181 | max_steps: int | COMMENT |
| LOW | …riments/post_training/task_curation/images/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | …/datasets/nemotron_ultra/scorers/skyrl_gym/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | …sets/nemotron_ultra/scorers/skyrl_gym/envs/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | …ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py | 1 | # Copyright 2024 Bytedance Ltd. and/or its affiliates | COMMENT |
| LOW | …g/task_curation/datasets/skyrl/scorers/ifeval_utils.py | 1 | # IFEval constraint checkers for RLVR-style instruction-following rewards. | COMMENT |
| LOW | …_training/task_curation/datasets/tasktrove/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | …ask_curation/datasets/tasktrove/conversion/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/post_training/mismatch_probe/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/grug/moe_hero_ep/__init__.py | 1 | # Copyright The Marin Authors | COMMENT |
| LOW | experiments/grug/moe_hero_ep/small_scale_abl_launch.py | 121 | # likewise routes the 4D expert-stack Newton-Schulz through QuACK's | COMMENT |
| LOW | experiments/grug/moe_hero_ep/model.py | 61 | from levanter.grug.loss import BlockSizes, fused_linear_softmax_cross_entropy_loss | COMMENT |
| LOW | experiments/grug/moe_hero_ep/model.py | 581 | q = rearrange(q_flat, "... (n d) -> ... n d", d=head_dim) | COMMENT |
| LOW | experiments/grug/moe_hero_ep/train.py | 101 | # `(fraction x 184.3 GiB - persistent state) x slop`. At 0.75 / 85 that is 87.7 GiB, below the | COMMENT |
| LOW | experiments/grug/moe_hero_ep/train.py | 241 | # carry offload raises the memory fraction and the percentage together; see | COMMENT |
| 369 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | experiments/coral/batch_calibration.py | 49 | Estimate parameter and activation bytes for a dense transformer. Args: parameter_count: Number of trainable | STRING |
| HIGH | experiments/coral/batch_calibration.py | 93 | Return total HBM bytes for a global batch. Args: parameter_bytes: Model parameter memory. optimizer | STRING |
| HIGH | experiments/coral/batch_calibration.py | 123 | Select Levanter parallelism settings that fit a global batch on TPUs. Args: tpu: TPU topology name accepted | STRING |
| HIGH | experiments/datakit/testbed/sampler.py | 170 | Sample ``source``'s normalized shards to a target row count. Probes a single shard for rows-per-file, then computes | STRING |
| HIGH | .agents/projects/iris_pypi_mirror/spec.md | 52 | Build uv env vars that point dependency resolution at AR remote PyPI repos. Caller responsibilities (not enforced h | STRING |
| HIGH | .agents/projects/executor_in_training_job/spec.md | 48 | Run any ExecutorSteps embedded in `config`, then return a copy of `config` with all InputName / OutputName / Version | STRING |
| HIGH | lib/iris/src/iris/cluster/types.py | 587 | Create a DeviceConfig for a GPU device. Args: variant: GPU variant string (e.g., "H100", "A100"). c | STRING |
| HIGH | lib/iris/src/iris/cluster/types.py | 610 | Parse human-readable memory string to bytes. Supports various formats: - "8G", "8GB", "8 GB", "8 gigabytes" | STRING |
| HIGH | lib/iris/src/iris/cluster/types.py | 839 | Derive namespace from hierarchical job ID. The namespace is the first component of the job ID hierarchy. | STRING |
| HIGH | …ris/src/iris/cluster/platforms/gcp/worker_bootstrap.py | 129 | Render a template string with {{ variable }} placeholders. Uses ``{{ variable }}`` syntax (double braces with exact | STRING |
| HIGH | lib/iris/src/iris/cluster/runtime/types.py | 202 | Run setup_commands (uv sync, pip install, etc). Blocks until setup completes. If there are no setup_commands, | STRING |
| HIGH | lib/iris/src/iris/cluster/runtime/types.py | 257 | Profile the running process using py-spy (CPU), memray (memory), or thread dump. Args: duration_sec | STRING |
| HIGH | lib/iris/src/iris/cluster/runtime/docker.py | 462 | Run setup_commands (uv sync, pip install, etc) in a temporary container. Creates a temporary container that run | STRING |
| HIGH | …iris/src/iris/cluster/controller/autoscaler/factory.py | 45 | Create autoscaler from WorkerInfraProvider and explicit config. Args: platform: WorkerInfraProvider instanc | STRING |
| HIGH | lib/iris/src/iris/cluster/worker/task_attempt.py | 496 | Profile the running container process. Args: duration_seconds: How long to sample profi | STRING |
| HIGH | lib/iris/src/iris/cluster/client/remote_client.py | 264 | Wait for job to complete with exponential backoff polling. If the controller becomes unavailable, retries with | STRING |
| HIGH | lib/iris/src/iris/jax/init.py | 115 | Poll the endpoint registry until the coordinator address appears. Args: resolver: Namespaced resolver for t | STRING |
| HIGH | lib/iris/src/iris/rpc/errors.py | 166 | Execute an RPC call with exponential backoff retry. Retries stop when either ``max_attempts`` is exhausted **or** | STRING |
| HIGH | lib/iris/src/iris/rpc/errors.py | 220 | Poll an RPC endpoint, tolerating transient unavailability. Calls ``poll_fn`` in a loop. On retryable errors the fu | STRING |
| HIGH | lib/iris/src/iris/client/worker_pool.py | 117 | Execute a pickled callable and return the result. Args: serialized_callable: cloudpickle-serialized | STRING |
| HIGH | lib/iris/src/iris/client/worker_pool.py | 323 | Block until result is available. Args: timeout: Maximum time to wait in seconds Returns: | STRING |
| HIGH | lib/iris/src/iris/client/client.py | 554 | Wait for job to complete. Args: timeout: Maximum wait time in seconds poll_interval: Up | STRING |
| HIGH | lib/iris/src/iris/client/client.py | 937 | Submit a job with automatic job_id hierarchy. Args: entrypoint: Job entrypoint (callable + args/kwa | STRING |
| HIGH | lib/iris/src/iris/client/client.py | 1423 | Get an allocated port by name. Args: name: Port name (e.g., "actor") Returns: | STRING |
| HIGH | lib/levanter/src/levanter/eval_harness.py | 118 | Call a function with retry logic and exponential backoff. Handles HuggingFace rate limit errors (HTTP 429) by | STRING |
| HIGH | lib/levanter/src/levanter/compat/hf_checkpoints.py | 131 | Build a validated generation_config dict from explicit EOS token IDs. The returned dict is suitable for writing as | STRING |
| HIGH | lib/levanter/src/levanter/recovery/faults.py | 79 | Parse a fault assignment from the environment. Args: env: Mapping to read from; defaults to ``os.en | STRING |
| HIGH | lib/levanter/src/levanter/tracker/tracker_fns.py | 244 | Get or set the global tracker. Note that setting the global tracker is not thread-safe, and using a tracker fro | STRING |
| HIGH | lib/levanter/src/levanter/tracker/tracker_fns.py | 288 | Lookup a tracker in the current global tracker with the provided name. Args: name: Name of the tracker | STRING |
| HIGH | lib/levanter/src/levanter/models/llama.py | 135 | Convert to HuggingFace's LlamaConfig Args: vocab_size (int, optional): Vocabulary size of the token | STRING |
| HIGH | lib/marin/tools/get_hf_dataset_schema.py | 126 | Get the schema of a Hugging Face dataset. Args: dataset_name: Name of the dataset (e.g., 'wikitext', ' | STRING |
| HIGH | …/processing/classification/deduplication/fuzzy_dups.py | 242 | Mark fuzzy-duplicate cluster membership across one or more ``MinHashAttrData`` inputs. All inputs must share identi | STRING |
| HIGH | lib/marin/src/marin/scaling_laws/tpu_utils.py | 46 | Select the smallest TPU slice that fits the estimated memory. Args: estimated_memory_bytes: Estimated memor | STRING |
| HIGH | …rin/src/marin/transform/huggingface/dataset_to_eval.py | 348 | Transform a single HuggingFace dataset example to QA format. Args: example: Raw example from HuggingFa | STRING |
| HIGH | …rin/src/marin/transform/huggingface/dataset_to_eval.py | 480 | Converts HuggingFace datasets to JSONL files for evaluation or decontamination. This function processes datase | STRING |
| HIGH | lib/haliax/src/haliax/debug.py | 58 | Checks for common issues in a module, such as reused arrays and static arrays. Equinox modules (and therefore H | STRING |
| HIGH | lib/haliax/src/haliax/_src/einsum.py | 32 | Compute the tensor contraction of the input arrays according to Haliax's named variant of the Einstein summation con | STRING |
| HIGH | lib/haliax/src/haliax/nn/conv.py | 168 | Args: inputs (NamedArray): Input array key (PRNGKeyArray: Not used, compat with other m | STRING |
| HIGH | lib/haliax/src/haliax/nn/conv.py | 324 | Args: inputs (NamedArray): Input array key (PRNGKeyArray: Not used, compat with other m | STRING |
| HIGH | lib/haliax/src/haliax/nn/pool.py | 35 | General function for pooling. Broadly based on the Flax implementation. Pooling functions are implemented usin | STRING |
| HIGH | lib/rigging/src/rigging/config_discovery.py | 112 | Resolve a cluster name (or path) to an existing YAML config file. If ``name`` is already an existing file path, it | STRING |
| HIGH | lib/zephyr/src/zephyr/readers.py | 455 | Load records from file as JSONL, Parquet, or Vortex. The spec's ``format`` selects the reader; ``auto`` (the defaul | STRING |
| HIGH | lib/zephyr/src/zephyr/readers.py | 514 | Load a Parquet file and yield ``pa.RecordBatch`` objects. Only Parquet files are supported. Raises ``RuntimeError`` | STRING |
| HIGH | lib/zephyr/src/zephyr/dataset.py | 93 | Format output path with shard information. Args: pattern: Path pattern with {shard}, {total}, {basename} pl | STRING |
| HIGH | lib/zephyr/src/zephyr/dataset.py | 414 | Create dataset from file glob pattern. This method finds all files matching the glob pattern and returns a | STRING |
| HIGH | lib/zephyr/src/zephyr/dataset.py | 1030 | Streaming merge join for already-sorted, co-partitioned datasets. Preconditions: - Both datasets have t | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | AGENTS.md | 63 | # Lint review — agentic pass over the branch diff against the infra/lint/ catalog | COMMENT |
| MEDIUM | infra/README.md | 65 | # Your processing logic here - no manual worker orchestration needed | COMMENT |
| MEDIUM | infra/lint/rules/cruft/ml-duplicate-logic-block.yaml | 36 | def _run_ping_loop(self): ... # same scaffold, only the wrapped call differs | CODE |
| MEDIUM | infra/ci/select_tests.py | 76 | # orchestration itself. Locally, their import-dependent tests are sufficient; | COMMENT |
| MEDIUM | infra/codehealth/review_quality.py | 140 | # Pluggable so the backend can change without touching batching orchestration. | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 71 | # A representative vLLM serving profile shared by the lm-eval runs; agentic and legacy runs override it | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 618 | # An agentic run that lost one of its ten trials to a timeout: the aggregate is over the | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/fixtures.py | 624 | runtime_minutes=42.0, # agentic sandbox rollouts run far longer than the lm-eval tasks | CODE |
| MEDIUM | infra/marina/apps/evaldash/web/src/types/api.ts | 415 | // samples, and `trajectory_uri` for `agentic` samples. The one unbounded payload, the agentic | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/web/src/types/api.ts | 449 | // Agent Trajectory Interchange Format (ATIF): one agentic run's steps. A step is either a user | COMMENT |
| MEDIUM | experiments/post_training/snowball_online_eagle.py | 51 | "s3://marin-us-east-02a/marin/exports/grug/june-67b-a2b-sft-s3-agentic/step-1903/hf-bf16-vllm/" | CODE |
| MEDIUM | experiments/evaluation/models.py | 131 | # tokens, so skip_special_tokens=false keeps the chain-of-thought from being stripped before scoring | COMMENT |
| MEDIUM | experiments/evaluation/evals.py | 324 | # --- Harbor (agentic registry benchmarks) --- | COMMENT |
| MEDIUM | experiments/evaluation/README.md | 262 | # A capped agentic validation run (2 tasks). | COMMENT |
| MEDIUM | experiments/evaluation/configs/harbor/aime-smoke.yaml | 18 | # This is an integration smoke, not the production agentic AIME benchmark. One bounded model | COMMENT |
| MEDIUM | experiments/evaluation/configs/evalchemy/aime24.yaml | 7 | # No max_tokens: Evalchemy sizes AIME24 responses from the served context window minus the | COMMENT |
| MEDIUM | experiments/evaluation/serve/models/README.md | 60 | agent: # AgentConfig -> the Harbor/agentic agent | CODE |
| MEDIUM | …e/models/marin-community/grug-agentic-s3-step1903.yaml | 2 | location: s3://marin-us-east-02a/marin/exports/grug/june-67b-a2b-sft-s3-agentic/step-1903/hf-bf16-vllm/ | CODE |
| MEDIUM⚡ | tests/evals/test_evalchemy_config.py | 365 | # lm-eval assumes a 2048-token window unless told otherwise, silently left-truncating few-shot | COMMENT |
| MEDIUM | tests/snapshots/web/expected/resiliparse/dbrx.md | 76 | ## Quality on Long-Context Tasks and RAG | COMMENT |
| MEDIUM⚡ | tests/snapshots/web/inputs/dbrx.html | 163 | </script><script type="text/javascript" defer="">(function(){function b(){!1===c&&(c=!0,Munchkin.init("094-YMS-629"))}va | CODE |
| MEDIUM⚡ | tests/snapshots/web/inputs/dbrx.html | 164 | </style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. | CODE |
| MEDIUM⚡ | tests/snapshots/web/inputs/dbrx.html | 164 | </style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. | CODE |
| MEDIUM | tests/evaluation/test_eval_archive.py | 1125 | # A legacy Harbor run: one agentic sample referencing a trajectory by an in-place path. | COMMENT |
| MEDIUM | tests/evaluation/test_eval_archive.py | 1149 | # The migrated agentic sample points at a finestore:// trajectory the archive resolves. | COMMENT |
| MEDIUM | .agents/projects/20260130_fray_lite_research.md | 78 | #### Job orchestration (`rl_job.py`) | COMMENT |
| MEDIUM | .agents/projects/eval-rollup-design.md | 175 | kind: SampleKind # multiple_choice | generation | agentic | CODE |
| MEDIUM | .agents/projects/eval-rollup-design.md | 184 | # agentic | COMMENT |
| MEDIUM | .agents/projects/20260130_fray_lite_design.md | 590 | ### Job orchestration (`rl_job.py`) | COMMENT |
| MEDIUM | .agents/projects/20260130_fray_lite_design.md | 870 | │ ├── tpu.py # TPU orchestration (copied from v1 ray.tpu.execution) | CODE |
| MEDIUM | …gents/projects/20260430-zephyr-performance/research.md | 208 | #### RAG with Codebase Context | COMMENT |
| MEDIUM | docs/debug-log-agentic-daytona.md | 1 | # Debugging log for agentic Daytona validation | COMMENT |
| MEDIUM | docs/debug-log-agentic-daytona.md | 27 | - Register the [#7246](https://github.com/marin-community/marin/pull/7246) agentic presets as | CODE |
| MEDIUM | docs/debug-log-agentic-daytona.md | 27 | - Register the [#7246](https://github.com/marin-community/marin/pull/7246) agentic presets as | CODE |
| MEDIUM | docs/reports/marin-8b-retro.md | 632 | For code generation, we use [HumanEval](https://github.com/openai/human-eval) - which continues to be the standard bench | CODE |
| MEDIUM | scripts/ci/wait_for.py | 375 | # the structure: strip the scaffolding and a placeholder has no prose left. | COMMENT |
| MEDIUM | scripts/ci/wait_for.py | 392 | # multi-agent correctness review…"), while the shortest real review leaves 121. Nothing lands | COMMENT |
| MEDIUM | scripts/ci/wait_for.py | 449 | # Drop the verdict itself ("no issues") and the checklist scaffolding ("- [x] Validate | COMMENT |
| MEDIUM | .github/workflows/marin-release-libs-wheels.yaml | 29 | # package-owned source_patterns; orchestration-only changes do not publish. | COMMENT |
| MEDIUM | .github/workflows/agentic-lint.yaml | 3 | # Best-effort Loom lint review. The `agentic-lint` label records that a PR has | COMMENT |
| MEDIUM | lib/iris/src/iris/cluster/controller/auth.py | 135 | # agentic datagen/eval job can hold one capability URL for its whole run instead | COMMENT |
| MEDIUM | lib/levanter/.agents/projects/inference.md | 63 | ### 2. HTTP server scaffold | COMMENT |
| MEDIUM | lib/marin/src/marin/evaluation/evalchemy/runner.py | 113 | # served context window minus its stored longest prompt (evalchemy#132). | COMMENT |
| MEDIUM⚡ | lib/marin/src/marin/evaluation/evalchemy/client.py | 32 | # prompt reserve, so the model config's context window sets its budget the way Evalchemy's own | COMMENT |
| MEDIUM⚡ | lib/marin/src/marin/evaluation/evalchemy/client.py | 40 | # vLLM returns HTTP 400 when prompt_tokens + max_tokens exceeds the served context window. Reserve | COMMENT |
| MEDIUM⚡ | lib/marin/src/marin/evaluation/evalchemy/client.py | 45 | # tokens against its context window (a loglikelihood request adds one output token to a | COMMENT |
| MEDIUM | lib/marin/src/marin/evaluation/evalchemy/runtime.py | 23 | # Keep CPU-only PyTorch as a compatibility floor for benchmark orchestration and grading code. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | experiments/marin_tokenizer.py | 53 | # Create a temporary directory that may be RAM-based | COMMENT |
| MEDIUM | experiments/grug/moe_hero_ep/trigger_hero.sh | 48 | # Create the tracker lineage once, outside the coordinator and training retry loops. | COMMENT |
| MEDIUM | tests/test_evaluator_utils.py | 12 | # Create a temporary directory | COMMENT |
| MEDIUM⚡ | …cluster/backends/gcp/test_cloud_service_integration.py | 514 | # Create a VM first | COMMENT |
| MEDIUM | lib/iris/tests/cluster/backends/gcp/test_platform.py | 1155 | # Create a VM but set it to non-READY state | COMMENT |
| MEDIUM | lib/iris/tests/cluster/controller/test_autoscaler.py | 541 | # Create a slice with 4 VMs | COMMENT |
| MEDIUM | lib/iris/tests/cluster/worker/test_worker.py | 444 | # Create a handle that stays running until killed | COMMENT |
| MEDIUM | lib/iris/tests/cluster/worker/test_worker.py | 468 | # Create a handle that stays running until killed | COMMENT |
| MEDIUM | lib/iris/tests/cluster/worker/test_worker.py | 502 | # Create a handle that stays running until killed | COMMENT |
| MEDIUM | lib/iris/src/iris/cluster/worker/worker.py | 377 | # Create a handle wrapping the existing container | COMMENT |
| MEDIUM | lib/iris/src/iris/cluster/worker/worker.py | 749 | # Create a minimal TaskAttemptConfig. Expensive setup (port allocation, | COMMENT |
| MEDIUM | lib/fray/src/fray/local_backend.py | 215 | # Create a synthetic job handle that is immediately succeeded | COMMENT |
| MEDIUM | lib/fray/src/fray/iris_backend.py | 793 | # Create a single job with N replicas | COMMENT |
| MEDIUM | lib/levanter/infra/cluster/job-cluster.yaml | 38 | # Create a Persistent Disk w/ 100 GBs | COMMENT |
| MEDIUM | lib/levanter/tests/test_hyena.py | 18 | # Create a test config that matches the PyTorch example | COMMENT |
| MEDIUM | lib/levanter/tests/test_hyena.py | 33 | # Create a random input tensor with shape matching the PyTorch example | COMMENT |
| MEDIUM | lib/levanter/tests/test_hyena.py | 38 | # Define a function to compute the sum of a specific position's output | COMMENT |
| MEDIUM | lib/levanter/tests/test_background_iterable.py | 29 | # Create a BackgroundIterable instance with an empty producer function | COMMENT |
| MEDIUM⚡ | lib/levanter/tests/test_background_iterable.py | 51 | # Create a producer function that raises an exception | COMMENT |
| MEDIUM⚡ | lib/levanter/tests/test_background_iterable.py | 55 | # Create a BackgroundIterable instance with the producer function that raises an exception | COMMENT |
| MEDIUM⚡ | lib/levanter/tests/test_sharded_dataset.py | 58 | # Create a simple dataset | COMMENT |
| MEDIUM | lib/levanter/tests/test_skip_step.py | 362 | # Create a SkipStepState instance | COMMENT |
| MEDIUM | lib/levanter/tests/test_sft.py | 36 | # Create a simple model with random embeddings | COMMENT |
| MEDIUM | lib/levanter/tests/test_sft.py | 42 | # Create a mock model with LlamaEmbedding | COMMENT |
| MEDIUM | lib/levanter/tests/test_packing.py | 51 | # Create a packed example | COMMENT |
| MEDIUM | lib/levanter/tests/test_packing.py | 76 | # Create a single JaggedArrayStore with four documents. | COMMENT |
| MEDIUM | lib/levanter/tests/test_packing.py | 385 | # Create a single-leaf dataset of 4 documents (as in test 1) with offsets [0,100,300,450,600]. | COMMENT |
| MEDIUM | lib/levanter/tests/test_packing.py | 506 | # Create a dataset with a single document that's too long | COMMENT |
| MEDIUM⚡ | lib/levanter/tests/test_jax_utils.py | 226 | # Create a module and a target tree | COMMENT |
| MEDIUM | lib/levanter/scripts/gcs_bulk_delete.py | 29 | # Define the transfer job | COMMENT |
| MEDIUM | lib/levanter/scripts/gcs_bulk_delete.py | 41 | # Create the transfer job | COMMENT |
| MEDIUM | lib/levanter/src/levanter/compat/hf_checkpoints.py | 1658 | # Create a temporary directory that persists through the context manager | COMMENT |
| MEDIUM | lib/levanter/src/levanter/optim/skipstep.py | 18 | # Define the state structure for the optimizer | COMMENT |
| MEDIUM | lib/levanter/src/levanter/utils/thread_utils.py | 10 | # Create a ThreadPoolExecutor | COMMENT |
| MEDIUM | lib/levanter/src/levanter/models/hyena.py | 468 | # Create a new axis with the same dimensions to avoid naming collision | COMMENT |
| MEDIUM | lib/levanter/src/levanter/data/packing.py | 195 | # Create the LmExample | COMMENT |
| MEDIUM | lib/levanter/src/levanter/data/audio.py | 149 | """This class represents a dataset source with URLs or hf name/id.""" | STRING |
| MEDIUM | lib/levanter/src/levanter/data/audio.py | 426 | """This class represents a mixture of datasets with their associated weights.""" | STRING |
| MEDIUM | lib/levanter/src/levanter/data/text/datasets.py | 246 | """This class represents a dataset source with URLs or hf name/id.""" | STRING |
| MEDIUM | …n/src/marin/transform/wikipedia/transform_wikipedia.py | 147 | # Create a new <p> tag and insert the br tags plus the display math | COMMENT |
| MEDIUM | …marin/transform/conversation/transform_conversation.py | 140 | # Create a unique ID for the row based on the text | COMMENT |
| MEDIUM | lib/haliax/src/haliax/__init__.py | 208 | # Create a NamedArray along a single axis | STRING |
| MEDIUM | lib/haliax/src/haliax/nn/scan.py | 669 | # Create a function that captures the additional arguments | COMMENT |
| MEDIUM | lib/dupekit/tests/test_bloom.py | 116 | # Create a large bloom filter to ensure chunking happens | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/grafana/tests/conftest.py | 85 | CODE | |
| LOW | infra/grafana/tests/test_k8s_source.py | 729 | CODE | |
| LOW | infra/grafana/tests/test_async_rl_dashboard.py | 136 | CODE | |
| LOW | infra/marina/apps/evaldash/metrics.py | 573 | CODE | |
| LOW | infra/marina/apps/evaldash/app.py | 1300 | CODE | |
| LOW | infra/marina/apps/evaldash/tests/test_metrics.py | 36 | CODE | |
| LOW | infra/marina/apps/tasktrove/app.py | 316 | CODE | |
| LOW | …ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py | 351 | CODE | |
| LOW | experiments/post_training/mismatch_probe/test_report.py | 32 | CODE | |
| LOW | experiments/post_training/cat_count_canary/launcher.py | 203 | CODE | |
| LOW | experiments/post_training/cat_count_canary/launcher.py | 369 | CODE | |
| LOW | experiments/ferries/canary_ferry.py | 210 | CODE | |
| LOW | experiments/grug/moe_hero_ep/memory_soak.py | 121 | CODE | |
| LOW | experiments/grug/moe_hero_ep/small_scale_abl_launch.py | 283 | CODE | |
| LOW | experiments/grug/moe_hero_ep/launch_diagnostics.py | 91 | CODE | |
| LOW | experiments/grug/moe_hero_fsdp/launch.py | 265 | CODE | |
| LOW | experiments/grug/fast_track/launch.py | 254 | CODE | |
| LOW | experiments/datasets/instruction.py | 135 | CODE | |
| LOW | experiments/datakit/embeddings/luxical/pipeline.py | 306 | CODE | |
| LOW | experiments/datakit/testbed/train.py | 125 | CODE | |
| LOW | experiments/datakit/store/datakit_store.py | 573 | CODE | |
| LOW | tests/evaluation/test_eval_stats.py | 53 | CODE | |
| LOW | tests/evaluation/test_eval_stats.py | 495 | CODE | |
| LOW | scripts/training/time_to_train/parse_wandb_runs.py | 111 | CODE | |
| LOW | lib/shellbox/src/shellbox/backends/qemu/environment.py | 37 | CODE | |
| LOW | lib/iris/tests/cluster/runtime/test_env_parity.py | 26 | CODE | |
| LOW | lib/iris/tests/cluster/worker/test_worker.py | 1297 | CODE | |
| LOW | lib/iris/scripts/install_kueue.py | 222 | CODE | |
| LOW | lib/iris/scripts/benchmark_controller.py | 1646 | CODE | |
| LOW | lib/iris/src/iris/cluster/platforms/gcp/fake.py | 68 | CODE | |
| LOW | lib/iris/src/iris/cluster/controller/dashboard.py | 193 | CODE | |
| LOW | lib/iris/src/iris/cluster/worker/worker.py | 142 | CODE | |
| LOW | lib/iris/src/iris/cluster/client/protocol.py | 22 | CODE | |
| LOW | lib/iris/src/iris/cluster/client/remote_client.py | 150 | CODE | |
| LOW | lib/iris/src/iris/cli/job.py | 564 | CODE | |
| LOW | lib/iris/src/iris/cli/job.py | 722 | CODE | |
| LOW | lib/iris/src/iris/testing/controller.py | 677 | CODE | |
| LOW | lib/iris/src/iris/testing/controller.py | 877 | CODE | |
| LOW | lib/iris/src/iris/testing/e2e.py | 102 | CODE | |
| LOW | lib/iris/src/iris/testing/journeys/world.py | 174 | CODE | |
| LOW | lib/iris/src/iris/client/client.py | 913 | CODE | |
| LOW | lib/finelog/src/finelog/client/log_client.py | 255 | CODE | |
| LOW | lib/levanter/tests/test_new_loader.py | 93 | CODE | |
| LOW | lib/levanter/tests/test_new_loader.py | 139 | CODE | |
| LOW | lib/levanter/tests/test_attention.py | 699 | CODE | |
| LOW | lib/levanter/src/levanter/config.py | 144 | CODE | |
| LOW | lib/levanter/src/levanter/eval_harness.py | 1708 | CODE | |
| LOW | lib/levanter/src/levanter/eval_harness.py | 378 | CODE | |
| LOW | lib/levanter/src/levanter/eval_harness.py | 389 | CODE | |
| LOW | lib/levanter/src/levanter/eval_harness.py | 393 | CODE | |
| LOW | lib/levanter/src/levanter/checkpoint.py | 990 | CODE | |
| LOW | lib/levanter/src/levanter/eval.py | 281 | CODE | |
| LOW | …evanter/kernels/pallas/fused_cross_entropy_loss/api.py | 720 | CODE | |
| LOW | …evanter/kernels/pallas/fused_cross_entropy_loss/api.py | 739 | CODE | |
| LOW | …evanter/kernels/pallas/fused_cross_entropy_loss/api.py | 757 | CODE | |
| LOW | …evanter/kernels/pallas/fused_cross_entropy_loss/xla.py | 681 | CODE | |
| LOW | lib/levanter/src/levanter/kernels/pallas/mamba3/api.py | 524 | CODE | |
| LOW | lib/levanter/src/levanter/kernels/pallas/mamba3/api.py | 652 | CODE | |
| LOW | lib/levanter/src/levanter/kernels/pallas/mamba3/api.py | 693 | CODE | |
| LOW | lib/levanter/src/levanter/kernels/pallas/mamba3/api.py | 860 | CODE | |
| 76 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | infra/linter.py | 245 | # review harness supplies the real identity through the environment. A | COMMENT |
| MEDIUM | infra/linter.py | 754 | # Drop lanes whose diff-size floor the change doesn't clear (only the holistic meta lane | COMMENT |
| MEDIUM | infra/tpu-ci/vm_manager.py | 710 | # For static mode, get comprehensive diagnostics | COMMENT |
| MEDIUM | infra/marina/apps/evaldash/web/package-lock.json | 2178 | "resolved": "https://registry.npmjs.org/robust-predicates/-/robust-predicates-3.0.3.tgz", | CODE |
| MEDIUM | infra/marina/apps/evaldash/tests/test_metrics.py | 410 | # Two benchmarks under the same names are not the same benchmarks if different harness versions | COMMENT |
| MEDIUM | experiments/evals/task_configs.py | 10 | # TODO: add more once supported in lm-eval-harness and/or tested on our end | COMMENT |
| MEDIUM | …ts/nemotron_ultra/scorers/skyrl_gym/envs/aime/utils.py | 14 | # Adapted from https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/hendrycks_math/utils.py | COMMENT |
| MEDIUM | experiments/post_training/curriculum_sft/code_tasks.py | 67 | # Printed before the harness's JSON result so output written by the executed code cannot be mistaken for it. | COMMENT |
| MEDIUM | experiments/references/reference_training_pipeline.py | 79 | # A nano model: this harness measures path-liveness and delta-vs-baseline, not absolute | COMMENT |
| MEDIUM | experiments/evaluation/evals.py | 347 | # The comprehensive per-model benchmark set: every model x task pair runs (and is recorded) as its | COMMENT |
| MEDIUM | experiments/evaluation/evals.py | 363 | # The baseline lm-eval-harness NLP suite: 14 deterministic loglikelihood/greedy tasks, runnable on | COMMENT |
| MEDIUM | experiments/datakit/decontam/viewer/report.py | 48 | // Works at the token level so highlighting is robust to newlines/indentation: | COMMENT |
| MEDIUM | tests/snapshots/stackexchange/inputs/chemistry_3.json | 3 | "text": "# Flammability (NFPA) - how is it defined?\n\nI was reading up on a wonderful little chemical compound know | CODE |
| MEDIUM⚡ | tests/snapshots/web/inputs/dbrx.html | 164 | </style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. | CODE |
| MEDIUM⚡ | tests/snapshots/web/inputs/dbrx.html | 164 | </style><p><span class="b2">Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. | CODE |
| MEDIUM | tests/snapshots/dclm_hq/inputs/hq_1.html | 231 | <li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-tex | CODE |
| MEDIUM | tests/snapshots/dclm_hq/inputs/hq_1.html | 682 | <li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-tex | CODE |
| MEDIUM | tests/datakit/decontam/test_prepare_eval_corpus.py | 32 | # A rendered prompt embeds the passage (as lm-eval-harness doc_to_text does). | COMMENT |
| MEDIUM⚡ | lib/iris/scripts/install_kueue.py | 220 | # Install core (importable; the click command and the smoke harness both call it). | COMMENT |
| MEDIUM⚡ | lib/iris/scripts/benchmark_controller.py | 152 | # RPC harness: real Controller(dry_run=True) + Connect sync client | COMMENT |
| MEDIUM⚡ | lib/iris/scripts/benchmark_controller.py | 388 | # Bench harness | COMMENT |
| MEDIUM | lib/iris/scripts/benchmark_controller.py | 279 | # exercise the endpoint registry set this to ``harness.make_endpoint_client``. | COMMENT |
| MEDIUM⚡ | lib/iris/src/iris/testing/cluster.py | 57 | # ServiceTestHarness — parameterized GCP / K8s controller service harness | COMMENT |
| MEDIUM | lib/iris/src/iris/testing/cluster.py | 148 | # Share the harness tracker so the service registers into and reads liveness | COMMENT |
| MEDIUM | lib/iris/src/iris/testing/cluster.py | 149 | # through the same object this harness's ControllerTestState exposes. | COMMENT |
| MEDIUM | lib/finelog/rust/Cargo.toml | 157 | # Compiles the deterministic fault-injection harness (`test_support`) and the | COMMENT |
| MEDIUM | lib/verifyit/src/verifyit/preparation/text.py | 96 | # Separate fixed-width arrays preserve harness Unicode lowering for each batch. | COMMENT |
| MEDIUM | lib/levanter/tests/test_eval_harness.py | 23 | # Create chat-like requests with contexts formatted via the chat template, matching harness usage | COMMENT |
| MEDIUM | lib/levanter/src/levanter/eval_harness.py | 1536 | # remove the ",none" suffix, which eval-harness adds by default for some reason | COMMENT |
| LOW | lib/levanter/src/levanter/trainer.py | 204 | # we can't just use `lambda: model` because JAX jit can't see captures, but it can see jax partials | COMMENT |
| MEDIUM | …evanter/kernels/pallas/fused_cross_entropy_loss/api.py | 174 | # Keep TPU default stable and robust unless Pallas is explicitly requested. | COMMENT |
| MEDIUM | lib/levanter/src/levanter/callbacks/_metrics.py | 122 | # Accumulate MFU samples over a trailing window for robust distribution stats. | COMMENT |
| MEDIUM | lib/levanter/src/levanter/recovery/faults.py | 38 | # Environment variables the harness sets on each trainer subprocess. | COMMENT |
| LOW | lib/levanter/src/levanter/tracker/tracker_fns.py | 102 | # and we just return the metrics dictionary | COMMENT |
| MEDIUM | lib/levanter/src/levanter/data/sharded_datasource.py | 356 | # (1) is cheating a bit, but it's fast and works in most cases we care about. (2) is more robust, but slower. | COMMENT |
| MEDIUM | lib/marin/src/marin/scaling_laws/isoflop_analysis.py | 237 | """Fit a robust quadratic in log10(x) space using Huber loss. | STRING |
| MEDIUM | lib/marin/src/marin/execution/step_runner.py | 220 | # inherit it explicitly. More robust than contextvars.copy_context() | COMMENT |
| MEDIUM | lib/marin/src/marin/evaluation/evalchemy/result.py | 83 | # A retried evaluation leaves a second complete tree under the harness's scratch directory, | COMMENT |
| LOW | lib/haliax/src/haliax/core.py | 1173 | # scalar case: just add one axis so it doesn't get too mad | COMMENT |
| LOW | lib/haliax/src/haliax/core.py | 1657 | # maybe just add a context manager to allow it? | COMMENT |
| MEDIUM | lib/rigging/src/rigging/log_setup.py | 192 | # faulthandler writes to a raw fd; a harness that captures sys.stderr | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | experiments/tutorials/hello_world.py | 73 | # Step 1: generate the data. build_config resolves ctx.output_path to the artifact's output dir. | COMMENT |
| LOW⚡ | experiments/tutorials/hello_world.py | 82 | # Step 2: compute statistics over the generated data. ctx.artifact_path(_data) gives the path | COMMENT |
| LOW⚡ | tests/execution/test_step_runner.py | 120 | # Step 1: download | COMMENT |
| LOW⚡ | tests/execution/test_step_runner.py | 124 | # Step 2: tokenize — load upstream artifact, run, save | COMMENT |
| LOW | .agents/projects/20260303_iris_autoscaler_design.md | 729 | ### Step 1: COOLDOWN State + AT_CAPACITY Rename (No Capacity Math Changes) | COMMENT |
| LOW | .agents/projects/20260303_iris_autoscaler_design.md | 739 | ### Step 2: Additive Resource Packing | COMMENT |
| LOW | .agents/docs/smoke-test-dry-run.md | 640 | ### Step 1: Extract `local_platform.py` from `demo_cluster.py` | COMMENT |
| LOW | .agents/docs/smoke-test-dry-run.md | 650 | ### Step 2: Proto + `LocalController` + config wiring | COMMENT |
| LOW⚡ | .agents/docs/smoke-test-dry-run.md | 671 | ### Step 4: Smoke test integration | COMMENT |
| LOW⚡ | .agents/docs/smoke-test-dry-run.md | 679 | ### Step 5: Simplify `demo_cluster.py` | COMMENT |
| LOW⚡ | .agents/docs/smoke-test-dry-run.md | 686 | ### Step 6: CLI integration (optional) | COMMENT |
| LOW | .agents/docs/cluster-logging.md | 166 | ### Step 1: Extract `stream_docker_logs()` into debug.py | COMMENT |
| LOW | .agents/docs/cluster-logging.md | 178 | ### Step 2: Add `LogStreamHandle` and `start_log_streaming()` to ClusterManager | COMMENT |
| LOW | .agents/docs/cluster-logging.md | 191 | ### Step 3: Add `log_dir` parameter to `connect()` | COMMENT |
| LOW | .agents/docs/cluster-logging.md | 204 | ### Step 4: Simplify smoke-test.py | COMMENT |
| LOW | docs/tutorials/first-experiment.md | 32 | ## Step 1: Tokenize the dataset | COMMENT |
| LOW | docs/tutorials/first-experiment.md | 55 | ## Step 2: Choose a model configuration | COMMENT |
| LOW | docs/tutorials/first-experiment.md | 78 | ## Step 3: Assemble the training run | COMMENT |
| LOW | docs/tutorials/first-experiment.md | 120 | ## Step 4: Wire the main block | COMMENT |
| LOW | docs/tutorials/storage-bucket.md | 17 | ## Step 1: Choose a Region and Name | COMMENT |
| LOW | docs/tutorials/storage-bucket.md | 31 | ## Step 2: Create the Bucket | COMMENT |
| LOW | docs/tutorials/storage-bucket.md | 53 | ## Step 3: Disable Soft Delete | COMMENT |
| LOW | docs/tutorials/storage-bucket.md | 73 | ## Step 4: TTL Scratch Prefixes (`tmp/ttl=Nd/`) | COMMENT |
| LOW | docs/tutorials/storage-bucket.md | 119 | ## Step 5: Wire It Into Marin / Levanter | COMMENT |
| LOW | lib/levanter/.agents/projects/gcs_serialization.md | 115 | # Step 1: collective gather so every device sees every host's chunk. | COMMENT |
| LOW⚡ | lib/levanter/docs/recipes/port-models.md | 14 | ## Step 1: Write the Config | COMMENT |
| LOW⚡ | lib/levanter/docs/recipes/port-models.md | 20 | ## Step 2: Implement the Model | COMMENT |
| LOW⚡ | lib/levanter/docs/recipes/port-models.md | 26 | ## Step 3: Add Serialization Support (if needed) | COMMENT |
| LOW⚡ | lib/levanter/docs/recipes/port-models.md | 32 | ## Step 4: Write Tests | COMMENT |
| LOW | lib/levanter/docs/recipes/port-models.md | 45 | ## Step 5: Create a "nano" config | COMMENT |
| LOW | lib/levanter/docs/guides/Training-Data-Guide.md | 7 | ## Step 1: Identify the Format for Each Dataset | COMMENT |
| LOW | lib/levanter/docs/guides/Training-Data-Guide.md | 19 | ## Step 2: Prepare Your Data | COMMENT |
| LOW | lib/levanter/docs/guides/Training-Data-Guide.md | 47 | ## Step 3: Write Your Config | COMMENT |
| LOW | lib/levanter/docs/guides/Training-Data-Guide.md | 189 | ## Step 4: Launch Training | COMMENT |
| LOW | …evanter/docs/tutorials/Fine-Tuning-Semantic-Parsing.md | 69 | ### Step 1: Prepare the Dataset | COMMENT |
| LOW | …evanter/docs/tutorials/Fine-Tuning-Semantic-Parsing.md | 108 | ### Step 2: Fine-tune the Model | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 196 | # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each, | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 199 | # Step 2: init O_i = 0, sumexp_i = 0, max_i = -inf | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 221 | # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each, | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 227 | # Step 8: compute Sij = QiKj^T | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 263 | # Step 9: Compute m_i^j = max(m_i^{j-1}, rowmax(S_i^j)), P_i^j = exp(S_i^j - m_i^j), | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 272 | # Step 10: Compute O_i = diag(exp(m_i^{j-1} - m_i^j) O_i + P_i^j V_j | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 287 | # Step 12: compute O_i = diag(\ell_i^{Tc})^{-1} O_i^{Tc} | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 289 | # Step 13: compute L_i = m_i^{Tc} + log(\ell_i^{Tc}) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/pre-commit.py | 782 | # Check if any pb2 file exists already | COMMENT |
| LOW | infra/tpu-ci/setup.py | 163 | # Check if user is authenticated to ghcr.io | COMMENT |
| LOW⚡ | infra/tpu-ci/vm_manager.py | 264 | # Check if runner is configured by looking for config files OR .runner file | COMMENT |
| LOW | scripts/pm/itemize_experiment_issues.py | 116 | # Check if any of the URLs are already in the content | COMMENT |
| LOW | scripts/pm/itemize_experiment_issues.py | 153 | # Check if any of the URLs are already in existing_reports | COMMENT |
| LOW | scripts/debug/decode_tokens.py | 83 | # Check if it looks like a token list | COMMENT |
| LOW | scripts/speedrun/onboarding_setup.sh | 47 | # Check if a 'marin' directory exists in the current path | COMMENT |
| LOW⚡ | scripts/speedrun/onboarding_setup.sh | 137 | # Check if uv is installed | COMMENT |
| LOW | scripts/speedrun/onboarding_setup.sh | 219 | # Check if branch exists, if not create it | COMMENT |
| LOW | scripts/speedrun/onboarding_setup.sh | 280 | # Check if origin points to the main community repo (indicating it's not a personal fork) | COMMENT |
| LOW | lib/iris/tests/cluster/backends/gcp/test_platform.py | 1165 | # Set VM to STAGING so it never reaches READY | COMMENT |
| LOW | …is/src/iris/cluster/controller/scheduling/scheduler.py | 846 | # Assign tasks to workers in order | COMMENT |
| LOW | lib/iris/src/iris/cluster/worker/task_attempt.py | 918 | # Check if we should stop | COMMENT |
| LOW⚡ | lib/levanter/tests/test_prp.py | 51 | # Check if all elements are unique, which is a necessary condition for a bijective function | COMMENT |
| LOW | lib/levanter/tests/test_skip_step.py | 280 | # Check if it has init and update attributes | COMMENT |
| LOW | lib/levanter/tests/test_skip_step.py | 375 | # Check if the unflattened state matches the original | COMMENT |
| LOW | lib/levanter/scripts/clean_old_checkpoints.py | 43 | # Check if this checkpoint is the largest complete checkpoint | COMMENT |
| LOW | lib/levanter/scripts/clean_old_checkpoints.py | 48 | # Check if this checkpoint ends in '000' and is the largest of such | COMMENT |
| LOW | lib/levanter/scripts/preproc/split-pile-shards.py | 60 | # Check if compressor exists for this category, if not create it | COMMENT |
| LOW | lib/levanter/src/levanter/eval_harness.py | 149 | # Check if this is a rate limit error from HuggingFace | COMMENT |
| LOW | …src/levanter/grug/attention/_fa4_cute_segmented_bwd.py | 189 | # Check if block size setting is out of shared memory capacity | COMMENT |
| LOW | lib/marin/src/marin/markdown/markdown.py | 926 | # Check if base is an operator usually taking limits | COMMENT |
| LOW | …n/src/marin/transform/wikipedia/transform_wikipedia.py | 127 | # Check if this is display math by looking for <dd> inside <dl> | COMMENT |
| LOW | lib/haliax/tests/test_axis.py | 144 | # Check if the element is in the correct order | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | tests/evaluation/test_evaluation.py | 1404 | assert evaluation.identity.eval_ref.evalchemy.judge.model_dump() == { | STRING |
| CRITICAL | lib/levanter/tests/test_apertus.py | 250 | lev_alpha_p = float(layer.mlp.act_fn.alpha_p.array.item()) | CODE |
| CRITICAL | lib/levanter/tests/test_apertus.py | 251 | lev_alpha_n = float(layer.mlp.act_fn.alpha_n.array.item()) | CODE |
| CRITICAL | lib/marin/src/marin/inference/serve_dashboard.html | 93 | `+l.text,this.inlineQueue.pop(),this.inlineQueue.at(-1).src=n.text):t.push(l);continue}if(e){this.infiniteLoopError(e.ch | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | experiments/tutorials/hello_world.py | 73 | # Step 1: generate the data. build_config resolves ctx.output_path to the artifact's output dir. | COMMENT |
| LOW⚡ | experiments/tutorials/hello_world.py | 82 | # Step 2: compute statistics over the generated data. ctx.artifact_path(_data) gives the path | COMMENT |
| LOW⚡ | tests/execution/test_step_runner.py | 120 | # Step 1: download | COMMENT |
| LOW⚡ | tests/execution/test_step_runner.py | 124 | # Step 2: tokenize — load upstream artifact, run, save | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 196 | # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each, | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 199 | # Step 2: init O_i = 0, sumexp_i = 0, max_i = -inf | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 221 | # Step 1: Divide Q into 𝑇𝑟 = \ceil(𝑁/Br) blocks of size Br x d each, | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 227 | # Step 8: compute Sij = QiKj^T | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 263 | # Step 9: Compute m_i^j = max(m_i^{j-1}, rowmax(S_i^j)), P_i^j = exp(S_i^j - m_i^j), | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 272 | # Step 10: Compute O_i = diag(exp(m_i^{j-1} - m_i^j) O_i + P_i^j V_j | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 287 | # Step 12: compute O_i = diag(\ell_i^{Tc})^{-1} O_i^{Tc} | COMMENT |
| LOW⚡ | lib/levanter/src/levanter/layers/flash_attention.py | 289 | # Step 13: compute L_i = m_i^{Tc} + log(\ell_i^{Tc}) | COMMENT |
| LOW⚡ | …src/levanter/grug/attention/_fa4_cute_segmented_bwd.py | 323 | # Do we need to check if we overshot kBlockM when we load Q? | COMMENT |
| LOW⚡ | …src/levanter/grug/attention/_fa4_cute_segmented_bwd.py | 325 | # Do we need to check if we overshot kBlockN when we load K? | COMMENT |
| LOW⚡ | …src/levanter/grug/attention/_fa4_cute_segmented_bwd.py | 333 | # Do we need to check if we overshot kBlockN when we load V? | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/datakit/test_decon.py | 769 | {"id": "eval", "text": "lorem ipsum dolor sit amet consectetur"}, | CODE |
| LOW⚡ | tests/datakit/test_decon.py | 769 | {"id": "eval", "text": "lorem ipsum dolor sit amet consectetur"}, | CODE |
| LOW⚡ | tests/datakit/test_decon.py | 775 | "text": "LOREM IPSUM DOLOR SIT AMET CONSECTETUR", | CODE |
| LOW⚡ | tests/datakit/test_decon.py | 775 | "text": "LOREM IPSUM DOLOR SIT AMET CONSECTETUR", | CODE |
| LOW | lib/iris/tests/cluster/backends/gcp/test_gcp_service.py | 439 | svc._token = "fake-token" | CODE |
| LOW | lib/iris/tests/cluster/backends/gcp/test_gcp_service.py | 530 | svc._token = "fake-token" | CODE |
| LOW | …cluster/backends/gcp/test_cloud_service_integration.py | 292 | s._token = "fake-token" | CODE |
| LOW⚡ | lib/iris/tests/cluster/controller/test_auth.py | 742 | admin_users=["admin@example.com"], | CODE |
| LOW⚡ | lib/iris/tests/cluster/controller/test_auth.py | 748 | assert auth.role_policy.role_for("admin@example.com") == "admin" | CODE |
| LOW | lib/iris/tests/cluster/controller/test_auth.py | 674 | return VerifiedIdentity(user_id="admin@example.com", role=self._role) | CODE |
| LOW | lib/iris/tests/cluster/controller/test_auth.py | 691 | assert seen == [VerifiedIdentity(user_id="admin@example.com", role="admin")] | CODE |
| LOW⚡ | lib/iris/src/iris/testing/config.py | 27 | "placeholder": ScaleGroupConfig( | CODE |
| LOW⚡ | lib/iris/src/iris/testing/config.py | 28 | name="placeholder", | CODE |
| LOW⚡ | lib/levanter/tests/test_tokenizers.py | 250 | # Lorem ipsum | COMMENT |
| LOW⚡ | lib/levanter/tests/test_tokenizers.py | 251 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt.", | CODE |
| LOW⚡ | lib/levanter/tests/test_tokenizers.py | 251 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt.", | CODE |
| LOW | lib/levanter/tests/test_tokenizers.py | 208 | "user@example.com", | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 155 | lorem = """Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et do | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 155 | lorem = """Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et do | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 177 | text = "lorem ipsum dolor sit amet " * 12_000 # ~324k chars | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 177 | text = "lorem ipsum dolor sit amet " * 12_000 # ~324k chars | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 305 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et " | CODE |
| LOW⚡ | lib/levanter/tests/test_text.py | 305 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et " | CODE |
| LOW | lib/marin/src/marin/inference/serve_dashboard.html | 49 | ${t}`}let lM={type:"function",function:{name:"bash",description:"Run a Bash command in the persistent workspace rooted a | CODE |
| LOW⚡ | lib/rigging/tests/test_server_auth.py | 163 | roles = {"admin@example.com": "admin"} | CODE |
| LOW⚡ | lib/rigging/tests/test_server_auth.py | 168 | payload = {"aud": "/projects/1/global/backendServices/2", "email": "admin@example.com"} | CODE |
| LOW⚡ | lib/rigging/tests/test_server_auth.py | 171 | assert identity == VerifiedIdentity(user_id="admin@example.com", role="admin") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/snapshots/dclm_hq/inputs/hq_2.html | 87 | <p>Each locomotive is equipped with a mobile <a href="http://www.dccwiki.com/Decoder" class="extiw" title="dcc:Decoder"> | CODE |
| HIGH | tests/snapshots/dclm_hq/inputs/hq_2.html | 426 | <p>Each locomotive is equipped with a mobile <a href="http://www.dccwiki.com/Decoder" class="extiw" title="dcc:Decoder"> | CODE |
| HIGH | docs/dev-guide/contributing.md | 13 | ## AI-generated contributions | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …arin/src/marin/inference/dashboard/src/lib/examples.ts | 52 | print("test passed") | CODE |
| HIGH | …arin/src/marin/inference/dashboard/src/lib/examples.ts | 86 | print("configuration is valid") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …iments/rl_data_reviews/review_runtime/harbor_worker.py | 19 | async def run_task(data: dict, root: Path) -> dict: | CODE |
| LOW | …periments/rl_data_reviews/review_runtime/gym_worker.py | 20 | def run_task(data: dict, root: Path, api_key: str | None) -> dict: | CODE |
| LOW⚡ | tests/infra/ci/test_select_tests.py | 238 | write(tmp_path, "lib/iris/tests/test_utils.py", "def helper():\n pass\n") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/iris/run_smoke_cw.sh | 8 | # Usage: | COMMENT |
| LOW | lib/levanter/scripts/clean_old_checkpoints.py | 78 | # Usage example: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/snapshots/stackexchange/inputs/chemistry_2.json | 3 | "text": "# Hierarchy of electronic wavefunctions\n\n*The previous question contained too much unnecessary informatio | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | lib/levanter/tests/test_background_iterable.py | 164 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lib/levanter/src/levanter/models/gpt2_hyena.py | 68 | # TODO: implement | COMMENT |