Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
This report presents the forensic synthetic code analysis of OpenPipe/ART, a Python project with 10,677 GitHub stars. SynthScan v2.0 examined 253,388 lines of code across 674 source files, recording 4365 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 17.3 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 4365 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | vllm_runtime/tests/test_dedicated_server.py | 55 | def test_fast_metrics_listener_auth_keepalive_and_scalar_payload() -> None: | CODE |
| LOW | vllm_runtime/tests/test_dedicated_server.py | 77 | def test_fast_metrics_listener_reads_updated_shared_snapshot() -> None: | CODE |
| LOW | vllm_runtime/tests/test_dedicated_server.py | 98 | def test_fast_metrics_listener_reports_unpublished_snapshot() -> None: | CODE |
| LOW | vllm_runtime/tests/test_dedicated_server.py | 112 | def test_fast_metrics_listener_stops_and_restarts_on_same_port() -> None: | CODE |
| LOW | vllm_runtime/tests/test_dedicated_server.py | 128 | def test_fast_metrics_url_uses_controller_routable_host(monkeypatch) -> None: | CODE |
| LOW | vllm_runtime/tests/test_dedicated_server.py | 143 | def test_runtime_sleep_route_returns_engine_validation_error(monkeypatch) -> None: | CODE |
| LOW | vllm_runtime/tests/test_binary_routes.py | 13 | def test_exact_expert_count_and_dtype_roundtrip(self) -> None: | CODE |
| LOW | vllm_runtime/tests/test_binary_routes.py | 47 | def test_capture_registers_vllm_authoritative_route_layout(self) -> None: | CODE |
| LOW | vllm_runtime/tests/test_binary_routes.py | 78 | def test_resolves_only_registered_padding_layers(self) -> None: | CODE |
| LOW | vllm_runtime/tests/test_binary_routes.py | 101 | def test_rejects_missing_capture_on_routed_layer(self) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/moe_lora_patches.py | 59 | def patch_small_batch_moe_lora_intermediate_dtype() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 107 | def _patch_policy_cache_hashing() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 114 | def generate_block_hash_extra_keys( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 321 | async def declare_initial_lora_policy( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 358 | def _patch_model_runner_output_type() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 447 | def _policy_history_from_cache_salt(cache_salt: str | None) -> str | None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 523 | def _apply_lora_alias_policy_cache_salt( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 549 | def _patch_engine_core_output_type() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 636 | def _patch_worker_policy_span_capture() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 732 | def _patch_scheduler_policy_span_transport() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 774 | def _patch_output_processor_policy_span_accumulation() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 836 | def _patch_openai_response_policy_spans() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 844 | async def chat_completion_full_generator( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 884 | def _patch_lora_alias_resolution() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 948 | def _patch_engine_request_admission() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1028 | async def _cleanup_failed_admission( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1071 | def _patch_load_inplace_storage() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1099 | def _patch_policy_lora_update_rpc() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1122 | def art_declare_loaded_lora_policy( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1155 | def art_apply_lora_policy_update( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1164 | def art_declare_loaded_lora_policy( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1177 | def _apply_policy_lora_update( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1207 | def _transition_scheduler_policy_history( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1295 | def _validate_continued_policy_update( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1312 | def _rebase_preempted_request_policy_history(request: Any) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1343 | def _scheduler_hash_block_size(scheduler: Any) -> int: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1350 | def _policy_lora_request_from_payload( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1366 | def policy_lora_request_payload(lora_request: PolicyLoRARequest) -> dict[str, Any]: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1405 | def _validate_worker_lora_update( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1455 | def _policy_context_from_runner(runner: Any) -> dict[str, dict[str, Any]]: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1472 | def _lora_request_for_input_batch_req(input_batch: Any, req_id: str) -> Any | None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1483 | def _policy_metadata_for_lora_request(lora_request: Any | None) -> dict[str, Any]: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1496 | def _record_worker_lora_policy(lora_request: Any) -> dict[str, Any]: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1532 | def _immutable_policy_version_from_lora_name(lora_name: str) -> int | None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1537 | def _attach_policy_spans_to_model_output( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1561 | def _attach_policy_span_context_to_sample_output( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1571 | def _policy_span_context_from_sample_output(output: Any) -> dict[str, dict[str, Any]]: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1583 | def _engine_core_policy_spans_by_request( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1617 | def _append_current_policy_spans(req_state: Any, token_count: int) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1649 | def _record_request_output_spans( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1661 | def _policy_spans_by_choice_from_final_output( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/metrics.py | 203 | def record_policy_cache_salt_audit( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/metrics.py | 217 | def record_policy_cache_waiting_update( | CODE |
| LOW⚡ | vllm_runtime/src/art_vllm_runtime/metrics.py | 264 | def record_policy_cache_salt_audit(*, lora_request: bool, salted: bool) -> None: | CODE |
| LOW⚡ | vllm_runtime/src/art_vllm_runtime/metrics.py | 268 | def record_policy_cache_waiting_update(*, updated: int, skipped_started: int) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 49 | def encode_routed_experts_response( | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 165 | def _register_model_route_layout(model_config: Any) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 201 | def patch_binary_routed_experts_response() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 234 | def patch_pipeline_routed_experts() -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 315 | def patch_pipeline_routed_experts_validation() -> None: | CODE |
| 2817 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | vllm_runtime/tests/test_binary_routes.py | 1 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 7 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/metrics.py | 3 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/binary_routes.py | 1 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/__init__.py | 1 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/__init__.py | 1 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/fast_metrics.py | 3 | CODE | |
| LOW | tests/unit/test_exchange_training_model_selection.py | 1 | CODE | |
| LOW | tests/unit/test_strip_logprobs.py | 3 | CODE | |
| LOW | tests/unit/test_strip_logprobs.py | 5 | CODE | |
| LOW | tests/unit/test_strip_logprobs.py | 7 | CODE | |
| LOW | tests/unit/test_trainer_rank_weird_shapes.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_weird_shapes.py | 14 | CODE | |
| LOW | tests/unit/test_trainer_rank_weird_shapes.py | 31 | CODE | |
| LOW | tests/unit/test_moe_routing_real_path.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_check.py | 1 | CODE | |
| LOW | tests/unit/test_prefix_tree_grad_parity.py | 1 | CODE | |
| LOW | tests/unit/test_distributed_inference_metrics.py | 1 | CODE | |
| LOW | tests/unit/test_multi_checkpoint_inference.py | 14 | CODE | |
| LOW | tests/unit/test_multi_checkpoint_inference.py | 15 | CODE | |
| LOW | tests/unit/test_multi_checkpoint_inference.py | 19 | CODE | |
| LOW | tests/unit/test_tau_bench_client.py | 1 | CODE | |
| LOW | tests/unit/test_dsv4_vllm_runtime_patches.py | 1 | CODE | |
| LOW | tests/unit/test_prefix_tree_attention_builder.py | 1 | CODE | |
| LOW | tests/unit/test_moe_routing_replay.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_validation.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_validation.py | 65 | CODE | |
| LOW | tests/unit/test_trajectory_copy.py | 9 | CODE | |
| LOW | tests/unit/test_prefix_tree_packing.py | 1 | CODE | |
| LOW | tests/unit/test_trajectory_parquet.py | 13 | CODE | |
| LOW | tests/unit/test_trajectory_parquet.py | 16 | CODE | |
| LOW | tests/unit/test_trajectory_parquet.py | 23 | CODE | |
| LOW | tests/unit/test_trajectory_parquet.py | 45 | CODE | |
| LOW | tests/unit/test_trajectory_parquet.py | 45 | CODE | |
| LOW | tests/unit/test_prefix_tree.py | 1 | CODE | |
| LOW | tests/unit/test_openai_stream.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_custom_tensors.py | 1 | CODE | |
| LOW | tests/unit/test_trainer_rank_telemetry.py | 1 | CODE | |
| LOW | tests/unit/test_megatron_reference_logprobs.py | 1 | CODE | |
| LOW | tests/unit/trajectories/test_tensorized_models.py | 1 | CODE | |
| LOW | tests/unit/trajectories/test_tokenize.py | 1 | CODE | |
| LOW | tests/unit/trajectories/test_capture.py | 1 | CODE | |
| LOW | tests/unit/trajectories/test_compact_serialization.py | 1 | CODE | |
| LOW | tests/integration/test_multi_checkpoint_training.py | 18 | CODE | |
| LOW | tests/integration/test_lora_quack_cutover.py | 1 | CODE | |
| LOW | tests/integration/distributed/test_replica_update.py | 1 | CODE | |
| LOW | tests/integration/distributed/test_public_api.py | 1 | CODE | |
| LOW | tests/integration/megatron/metrics.py | 1 | CODE | |
| LOW | tests/integration/megatron/metrics.py | 3 | CODE | |
| LOW | tests/integration/megatron/conftest.py | 6 | CODE | |
| LOW | tests/integration/megatron/artifacts.py | 9 | CODE | |
| LOW | tests/integration/megatron/routing_replay/bundle.py | 1 | CODE | |
| LOW | tests/integration/megatron/routing_replay/bundle.py | 3 | CODE | |
| LOW | tests/integration/megatron/routing_replay/trace.py | 1 | CODE | |
| LOW | …n/megatron/cp_attn/megatron_attention_oracle_worker.py | 1 | CODE | |
| LOW | …/megatron/cp_attn/megatron_attention_oracle_harness.py | 1 | CODE | |
| LOW | …/megatron/cp_attn/megatron_attention_oracle_harness.py | 6 | CODE | |
| LOW | …megatron/cp_attn/test_attention_packed_vs_flattened.py | 1 | CODE | |
| LOW | …megatron/cp_attn/test_attention_packed_vs_flattened.py | 14 | CODE | |
| LOW | …n/gdn_shared_prefix/test_qwen35_gdn_topology_oracle.py | 1 | CODE | |
| 619 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | skypilot-config.yaml | 358 | # ---------------------------------------------------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 22 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 24 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 130 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 132 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 198 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 200 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 254 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 256 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 296 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 298 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 403 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | tests/unit/test_multi_checkpoint_inference.py | 405 | # ============================================================================= | COMMENT |
| MEDIUM | scripts/deploy-model.py | 15 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/deploy-model.py | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/deploy-model.py | 45 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/deploy-model.py | 47 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 62 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 64 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 72 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 74 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 89 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 91 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 99 | # ======================================================================== | COMMENT |
| MEDIUM⚡ | dev/sft/sft-warmup.py | 101 | # ======================================================================== | COMMENT |
| MEDIUM | dev/sft/sft-warmup.py | 116 | # ======================================================================== | COMMENT |
| MEDIUM | dev/sft/sft-warmup.py | 118 | # ======================================================================== | COMMENT |
| MEDIUM | src/art/types.py | 83 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | src/art/types.py | 85 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | src/art/model.py | 727 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | src/art/model.py | 729 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | src/art/model.py | 1444 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | src/art/model.py | 1446 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | src/art/serverless/backend.py | 726 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | src/art/serverless/backend.py | 728 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | src/art/utils/trajectory_migration.py | 26 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | src/art/utils/trajectory_migration.py | 28 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | src/art/utils/trajectory_migration.py | 171 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | src/art/utils/trajectory_migration.py | 173 | # ============================================================================ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 81 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 83 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 108 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 110 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 133 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 135 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 140 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 142 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 204 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 206 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 226 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 228 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 243 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …benchmarking/charts/percentage_comparison_bar_chart.py | 245 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 74 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 76 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 134 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 136 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 163 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 167 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | …t/utils/benchmarking/charts/training_progress_chart.py | 180 | # ------------------------------------------------------------------ | COMMENT |
| 31 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 636 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 732 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 1207 | CODE | |
| LOW | vllm_runtime/src/art_vllm_runtime/fast_metrics.py | 336 | CODE | |
| LOW | tests/integration.py | 82 | CODE | |
| LOW | tests/integration.py | 176 | CODE | |
| LOW | tests/integration.py | 231 | CODE | |
| LOW | tests/unit/test_frontend_logging.py | 958 | CODE | |
| LOW | tests/unit/test_prefix_tree_attention_builder.py | 564 | CODE | |
| LOW | tests/unit/test_trainer_rank_validation.py | 2901 | CODE | |
| LOW | tests/unit/test_prefix_tree.py | 265 | CODE | |
| LOW | tests/unit/test_prefix_tree.py | 367 | CODE | |
| LOW | tests/unit/test_prefix_tree.py | 388 | CODE | |
| LOW | tests/unit/test_prefix_tree.py | 441 | CODE | |
| LOW | tests/unit/test_trainer_rank_custom_tensors.py | 167 | CODE | |
| LOW | tests/unit/trajectories/test_capture.py | 254 | CODE | |
| LOW | tests/unit/trajectories/test_capture.py | 539 | CODE | |
| LOW | tests/unit/trajectories/test_compact_serialization.py | 624 | CODE | |
| LOW | …n/megatron/cp_attn/megatron_attention_oracle_worker.py | 43 | CODE | |
| LOW | …atron/gdn_shared_prefix/test_real_gdn_native_fla_cp.py | 602 | CODE | |
| LOW | …shared_prefix/test_real_gdn_cp1_packed_vs_flattened.py | 50 | CODE | |
| LOW | …ntegration/megatron/gdn_shared_prefix/packed_layout.py | 30 | CODE | |
| LOW | …ntegration/megatron/gdn_shared_prefix/packed_layout.py | 212 | CODE | |
| LOW | …egration/megatron/gdn_shared_prefix/real_gdn_oracle.py | 86 | CODE | |
| LOW | …/runtime_isolation/test_live_megatron_backend_smoke.py | 504 | CODE | |
| LOW | …s/integration/megatron/train_inf_mismatch/real_path.py | 649 | CODE | |
| LOW | …s/integration/megatron/train_inf_mismatch/real_path.py | 757 | CODE | |
| LOW | …s/integration/megatron/train_inf_mismatch/real_path.py | 1101 | CODE | |
| LOW | …tegration/megatron/train_inf_mismatch/output_parity.py | 511 | CODE | |
| LOW | …_inf_mismatch/vllm_forward_trace_site/sitecustomize.py | 454 | CODE | |
| LOW | …ts/integration/megatron/model_support/forward_trace.py | 1806 | CODE | |
| LOW | …ts/integration/megatron/model_support/forward_trace.py | 2085 | CODE | |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 67 | CODE | |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 149 | CODE | |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 307 | CODE | |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 330 | CODE | |
| LOW | …ration/megatron/model_support/prefix_tree_workloads.py | 8 | CODE | |
| LOW | …ration/megatron/model_support/workflow_stage_worker.py | 157 | CODE | |
| LOW | …ration/megatron/model_support/workflow_stage_worker.py | 296 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 103 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 277 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 325 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 953 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 1578 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 1968 | CODE | |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 984 | CODE | |
| LOW | …atron/model_support/test_dsv4_real_path_correctness.py | 41 | CODE | |
| LOW | …egration/megatron/model_support/workflow_throughput.py | 1732 | CODE | |
| LOW | …tegration/megatron/model_support/workflow_scheduler.py | 784 | CODE | |
| LOW | …tegration/megatron/model_support/workflow_scheduler.py | 912 | CODE | |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 1108 | CODE | |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 2468 | CODE | |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 2186 | CODE | |
| LOW | …ts/integration/megatron/model_support/lora_coverage.py | 109 | CODE | |
| LOW | …ration/megatron/model_support/routing_replay_bundle.py | 263 | CODE | |
| LOW | tests/integration/megatron/model_support/workflow.py | 507 | CODE | |
| LOW | tests/integration/megatron/model_support/workflow.py | 644 | CODE | |
| LOW | tests/integration/megatron/model_support/workflow.py | 1010 | CODE | |
| LOW | tests/integration/megatron/model_support/workflow.py | 1272 | CODE | |
| LOW | …tegration/megatron/model_support/packing_invariance.py | 598 | CODE | |
| 252 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/integration.py | 280 | print(f"Error parsing indexes '{indexes_str}': {e}") | CODE |
| MEDIUM | tests/integration.py | 316 | print("Error: No valid notebook indexes specified") | STRING |
| LOW | tests/integration/test_multi_checkpoint_training.py | 202 | except Exception: | CODE |
| LOW | tests/integration/test_push_and_fork.py | 112 | except Exception: | CODE |
| LOW | tests/integration/test_push_and_fork.py | 194 | except Exception: | CODE |
| LOW | tests/integration/test_push_and_fork.py | 257 | except Exception: | CODE |
| LOW | tests/integration/megatron/routing_replay/trace.py | 342 | except Exception: | CODE |
| LOW | …ts/integration/megatron/gdn_shared_prefix/artifacts.py | 109 | except Exception: | CODE |
| LOW | …sts/integration/megatron/lora/test_lora_disk_codecs.py | 89 | except Exception as exc: | CODE |
| LOW | …rain_inf_mismatch/test_live_real_path_output_parity.py | 127 | except Exception as error: | CODE |
| LOW | …s/integration/megatron/train_inf_mismatch/real_path.py | 1320 | except Exception: | CODE |
| LOW | …_inf_mismatch/vllm_forward_trace_site/sitecustomize.py | 289 | except Exception as exc: | CODE |
| LOW | …_inf_mismatch/vllm_forward_trace_site/sitecustomize.py | 363 | except Exception as exc: | CODE |
| LOW | …ts/integration/megatron/model_support/forward_trace.py | 122 | except Exception: | CODE |
| LOW | …ts/integration/megatron/model_support/forward_trace.py | 142 | except Exception: | CODE |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 412 | except Exception as exc: | CODE |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 455 | except Exception: | CODE |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 479 | except Exception as exc: | CODE |
| LOW | …egration/megatron/model_support/workflow_forkserver.py | 490 | except Exception as cleanup_error: | CODE |
| LOW | …ration/megatron/model_support/workflow_stage_worker.py | 270 | except Exception as exc: | CODE |
| LOW | …ration/megatron/model_support/workflow_stage_worker.py | 314 | except Exception as exc: | CODE |
| LOW | …tegration/megatron/model_support/workflow_scheduler.py | 1321 | except Exception as exc: | CODE |
| LOW⚡ | …s/integration/megatron/model_support/oracle_harness.py | 1007 | except Exception: | CODE |
| LOW⚡ | …s/integration/megatron/model_support/oracle_harness.py | 1015 | except Exception: | CODE |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 935 | except Exception: | CODE |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 1566 | except Exception: | CODE |
| LOW | …ntegration/megatron/model_support/fp32_grouped_gemm.py | 19 | except Exception: | CODE |
| LOW | tests/integration/megatron/model_support/workflow.py | 1095 | except Exception as exc: | CODE |
| LOW | tests/integration/megatron/model_support/workflow.py | 1132 | except Exception as exc: | CODE |
| LOW | tests/integration/megatron/model_support/workflow.py | 1161 | except Exception as exc: | CODE |
| LOW | tests/integration/megatron/model_support/workflow.py | 1173 | except Exception as exc: | CODE |
| LOW | .agents/skills/train-sft/SKILL.md | 55 | except Exception as e: | CODE |
| LOW | examples/2048/utils.py | 150 | except Exception: | CODE |
| LOW | examples/2048/rollout.py | 67 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 145 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 177 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 234 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 253 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 269 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/test_scenario_generation.py | 313 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/mcp_rl/checks.py | 104 | except Exception as e: | CODE |
| MEDIUM | examples/mcp-rl/mcp_rl/checks.py | 105 | print(f"Error during LLM evaluation: {e}") | CODE |
| LOW | examples/mcp-rl/mcp_rl/rollout.py | 182 | except Exception as e: | CODE |
| MEDIUM | examples/mcp-rl/mcp_rl/rollout.py | 183 | print(f"Error checking success: {e}") | CODE |
| LOW | examples/mcp-rl/mcp_rl/rollout.py | 219 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/mcp_rl/rollout.py | 234 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/mcp_rl/rollout.py | 238 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/mcp_rl/train.py | 213 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/mcp_rl/scenario_generator.py | 68 | except Exception: | CODE |
| MEDIUM | examples/mcp-rl/mcp_rl/scenario_generator.py | 221 | print(f"Error: Server params file not found: {args.server_params_path}") | CODE |
| LOW | examples/mcp-rl/mcp_rl/scenario_generator.py | 251 | except Exception as e: | CODE |
| MEDIUM | examples/mcp-rl/mcp_rl/scenario_generator.py | 252 | print(f"Error generating scenarios: {e}") | CODE |
| LOW | …amples/mcp-rl/servers/python/mcp_balldontlie/server.py | 273 | except Exception as e: | CODE |
| LOW | examples/mcp-rl/servers/python/mcp_googlemaps/server.py | 441 | except Exception as e: | CODE |
| LOW | …mples/mcp-rl/servers/python/mcp_alphavantage/server.py | 314 | except Exception as e: | CODE |
| LOW | examples/tic_tac_toe_self_play/game_utils.py | 49 | except Exception: | CODE |
| LOW | examples/tic_tac_toe_self_play/game_utils.py | 61 | except Exception as e: | CODE |
| LOW | examples/tic_tac_toe_self_play/rollout.py | 78 | except Exception as e: | CODE |
| LOW | examples/tic_tac_toe/game_utils.py | 53 | except Exception: | CODE |
| LOW | examples/tic_tac_toe/game_utils.py | 59 | except Exception as e: | CODE |
| 127 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | vllm_runtime/src/art_vllm_runtime/policy_spans.py | 541 | def _set_pydantic_extra(model: Any, key: str, value: Any) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/metrics.py | 187 | def set_writer(self, writer: FastMetricsSharedWriter | None) -> None: | CODE |
| LOW⚡ | vllm_runtime/src/art_vllm_runtime/metrics.py | 260 | def set_fast_metrics_writer(writer: FastMetricsSharedWriter | None) -> None: | CODE |
| LOW | vllm_runtime/src/art_vllm_runtime/__init__.py | 6 | __all__ = [ | CODE |
| LOW | tests/unit/test_moe_routing_replay.py | 170 | def set_target_indices(self, topk_indices: torch.Tensor) -> None: | CODE |
| LOW | tests/unit/test_moe_routing_replay.py | 174 | def set_router_replay_action(self, action: Any) -> None: | CODE |
| LOW | tests/integration/megatron/routing_replay/bundle.py | 5 | __all__ = ["build_bundle_from_forward_trace_dir"] | CODE |
| LOW | …tegration/megatron/train_inf_mismatch/output_parity.py | 776 | def _set_seed(seed: int) -> None: | CODE |
| LOW | tests/integration/megatron/trainability/__init__.py | 17 | __all__ = [ | CODE |
| LOW | …ts/integration/megatron/model_support/oracle_worker.py | 205 | def _set_deterministic_seed(seed: int) -> None: | CODE |
| LOW | …s/integration/megatron/model_support/gdn_trace_uids.py | 28 | def set_module_token_uids(self, module: Any, token_uids: Tensor | None) -> None: | CODE |
| LOW⚡ | …s/integration/megatron/model_support/gdn_trace_uids.py | 89 | def set_out_proj_lora_token_uids(self, gdn: Any, hidden_states: Tensor) -> None: | CODE |
| LOW⚡ | …s/integration/megatron/model_support/gdn_trace_uids.py | 98 | def set_out_norm_token_uids(self, gdn: Any, token_uids: Tensor) -> None: | CODE |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 603 | def update_router_ids(self, reference_ids, candidate_ids) -> None: # type: ignore[no-untyped-def] | CODE |
| LOW | tests/integration/megatron/model_support/hf_parity.py | 476 | __all__ = [ | CODE |
| LOW | examples/mcp-rl/mcp_rl/__init__.py | 6 | __all__ = ["rollout", "McpScenario", "McpServer", "AlphaMcpServer"] | CODE |
| LOW | src/art/metrics.py | 776 | def _update_throughput_metrics(self, result: dict[str, float]) -> None: | CODE |
| LOW | src/art/gather.py | 239 | def update_pbar(self, n: int) -> None: | CODE |
| LOW | src/art/__init__.py | 97 | __all__ = [ | CODE |
| LOW | src/art/model.py | 1505 | def set_cost_calculator(self, calculator: CostCalculator | None) -> None: | CODE |
| LOW | src/art/langgraph/__init__.py | 3 | __all__ = ["wrap_rollout", "init_chat_model"] | CODE |
| LOW | src/art/tinker/__init__.py | 5 | __all__ = ["TinkerBackend", "get_renderer_name", "OpenAICompatibleTinkerServer"] | CODE |
| LOW | src/art/distributed/host_admission.py | 447 | def _update_digest(digest: hashlib._Hash, value: bytes) -> None: | CODE |
| LOW | src/art/distributed/art_runtime.py | 78 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/art/distributed/rollout.py | 201 | def set_target(self, target_workers: int) -> None: ... | CODE |
| LOW | src/art/distributed/rollout.py | 203 | def set_workers(self, worker_ids: tuple[int, ...]) -> None: ... | CODE |
| LOW | src/art/distributed/rollout.py | 247 | def set_target(self, target_workers: int) -> None: | CODE |
| LOW | src/art/distributed/rollout.py | 251 | def set_workers(self, worker_ids: tuple[int, ...]) -> None: | CODE |
| LOW | src/art/distributed/rollout.py | 416 | def set_maxsize(self, maxsize: int) -> None: | CODE |
| LOW | src/art/distributed/rollout.py | 978 | def set_target(self, target_workers: int) -> None: | CODE |
| LOW | src/art/distributed/rollout.py | 989 | def set_workers(self, worker_ids: tuple[int, ...]) -> None: | CODE |
| LOW | src/art/tinker_native/__init__.py | 3 | __all__ = ["TinkerNativeBackend"] | CODE |
| LOW | src/art/serverless/__init__.py | 3 | __all__ = ["ServerlessBackend"] | CODE |
| LOW | src/art/tau_bench/client.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/art/tau_bench/__init__.py | 15 | __all__ = [ | CODE |
| LOW | src/art/rewards/__init__.py | 3 | __all__ = ["ruler", "ruler_score_group"] | CODE |
| LOW | src/art/pipeline_tuner/__init__.py | 27 | __all__ = [ | CODE |
| LOW | src/art/pipeline_tuner/worker_controller.py | 15 | def set_target(self, target_workers: int) -> None: | CODE |
| LOW | src/art/utils/__init__.py | 10 | __all__ = [ | CODE |
| LOW | src/art/utils/deploy_model.py | 36 | __all__ = [ | CODE |
| LOW | src/art/utils/managed_process.py | 26 | def set_parent_death_signal(parent_pid: int, sig: signal.Signals) -> None: | CODE |
| LOW | src/art/utils/strip_logprobs.py | 6 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/art/utils/deployment/__init__.py | 23 | __all__ = [ | CODE |
| LOW | src/art/utils/benchmarking/charts/__init__.py | 4 | __all__ = ["percentage_comparison_bar_chart", "training_progress_chart"] | CODE |
| LOW | src/art/mcp/__init__.py | 12 | __all__ = [ | CODE |
| LOW | src/art/local/backend.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/art/local/__init__.py | 3 | __all__ = ["LocalBackend"] | CODE |
| LOW | src/art/pipeline_trainer/__init__.py | 16 | __all__ = [ | CODE |
| LOW | src/art/pipeline_trainer/checkpoint_retention.py | 65 | __all__ = [ | CODE |
| LOW | src/art/pipeline_trainer/status.py | 89 | def set_step(self, step: int) -> None: | CODE |
| LOW | src/art/trainer_rank/_impl.py | 1904 | def _set_default_slot(self, ref: "LoRASlotRef") -> None: | CODE |
| LOW | src/art/trainer_rank/_impl.py | 3552 | def _set_hybridep_rows(rows: int) -> None: | CODE |
| LOW | src/art/trainer_rank/_impl.py | 4439 | __all__ = [ | CODE |
| LOW | src/art/trainer_rank/__init__.py | 355 | __all__ = [ | CODE |
| LOW | src/art/dev/__init__.py | 23 | __all__ = [ | CODE |
| LOW | src/art/trajectories/tensors.py | 353 | __all__ = [ | CODE |
| LOW | src/art/trajectories/__init__.py | 1409 | __all__ = [ | CODE |
| LOW | src/art/trajectories/_selection.py | 113 | __all__ = [ | CODE |
| LOW | src/art/trajectories/_capture/core.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/art/megatron/distributed_service.py | 100 | logger = logging.getLogger(__name__) | CODE |
| 29 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/test_backend_train_api.py | 6 | cd /workspace/ART && source .venv/bin/activate | STRING |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 119 | mock_stream_response = b"""data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","cre | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 121 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 123 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 125 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 127 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 129 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | tests/unit/test_auto_trajectory.py | 131 | data: {"id":"chatcmpl-aa0d1e3261414f53acafc2f8e53bf9d6","object":"chat.completion.chunk","created":1755831263,"model":"t | CODE |
| HIGH⚡ | scripts/bump_version.py | 78 | f"1. Commit the change: git add pyproject.toml uv.lock && git commit -m 'Bump version to {new}'" | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | examples/mcp-rl/mcp_rl/mcp_server.py | 140 | Apply a tool with given arguments. Args: tool_name: Name of the tool to call arguments: | STRING |
| HIGH | examples/mcp-rl/mcp_rl/mcp_server.py | 244 | Execute a tool via the API server. Args: tool_name: Name of the tool to call arguments: | STRING |
| HIGH | examples/just-the-facts/just_the_facts/utils.py | 10 | Scrape article text from a news URL (Fox News, MSNBC, etc.) Args: url: The URL of the news article to | STRING |
| HIGH | src/art/openai.py | 35 | Consume a chat completion stream and build a complete ChatCompletion object. This function processes a stream of Ch | STRING |
| HIGH | src/art/utils/model_config.py | 28 | Detect instruction and response parts from a tokenizer's chat template. Args: tokenizer: A tokenizer with a | STRING |
| HIGH | src/art/utils/model_config.py | 80 | Get instruction and response parts for a model. Checks for explicit model configuration first, then falls back to | STRING |
| HIGH | src/art/utils/sft.py | 53 | Count the number of non-empty rows in a JSONL file. Args: file_path: Path to JSONL file Returns: | STRING |
| HIGH | src/art/utils/sft.py | 282 | Stream trajectories from a JSONL file for one or more epochs. Uses buffer-based shuffling to randomize order w | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | skypilot-config.yaml | 235 | # \# Create a private VPC image and paste its ID in the following format: | COMMENT |
| MEDIUM | skypilot-config.yaml | 317 | # \# Create a S3 bucket named sky-dataset, uploads the contents of | COMMENT |
| MEDIUM | tests/unit/test_frontend_logging.py | 280 | # Create a mock trainable model with step > 0 | COMMENT |
| MEDIUM | tests/unit/test_trajectory_copy.py | 145 | # Create a memo dict with a circular reference | COMMENT |
| MEDIUM | tests/unit/test_trajectory_parquet.py | 988 | # Create a JSONL file with enough content to benefit from compression | COMMENT |
| MEDIUM | examples/mcp-rl/mcp_rl/scenario_generator.py | 113 | # Define the JSON schema for the response | COMMENT |
| MEDIUM | src/art/test/test_step_skipping.py | 39 | # Create a temporary directory for the test | COMMENT |
| MEDIUM | src/art/test/test_step_skipping.py | 45 | # Create a test model | COMMENT |
| MEDIUM | src/art/distributed/monarch_actor.py | 15 | # This module is imported only by explicit distributed runtime construction. | COMMENT |
| MEDIUM | src/art/tinker_native/backend.py | 1147 | # Create a sampler client from the new weights | COMMENT |
| MEDIUM | src/art/serverless/backend.py | 792 | # Create a temporary directory that won't be cleaned up automatically | COMMENT |
| MEDIUM | src/art/rewards/ruler.py | 321 | # Create a new trajectory with the same data but fresh objects | STRING |
| MEDIUM | src/art/utils/litellm.py | 83 | # Create the OpenAI Choice object | COMMENT |
| MEDIUM | src/art/utils/old_benchmarking/generate_line_graphs.py | 55 | plt.figure() # Create a new figure for each metric | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 2402 | CODE | |
| LOW | …s/integration/megatron/model_support/oracle_harness.py | 1273 | CODE | |
| LOW | dev/trainer_rank_check.py | 43 | CODE | |
| LOW | dev/megatron_review_perf.py | 39 | CODE | |
| LOW | src/art/_backend_training.py | 37 | CODE | |
| LOW | src/art/model.py | 493 | CODE | |
| LOW | src/art/model.py | 541 | CODE | |
| LOW | src/art/model.py | 1464 | CODE | |
| LOW | src/art/distributed/packing.py | 281 | CODE | |
| LOW | src/art/tinker_native/backend.py | 332 | CODE | |
| LOW | src/art/serverless/backend.py | 227 | CODE | |
| LOW | src/art/tau_bench/client.py | 227 | CODE | |
| LOW | src/art/tau_bench/rollout.py | 31 | CODE | |
| LOW | src/art/tau_bench/rollout.py | 48 | CODE | |
| LOW | src/art/tau_bench/rollout.py | 67 | CODE | |
| LOW | src/art/utils/sft.py | 145 | CODE | |
| LOW | src/art/utils/sft.py | 342 | CODE | |
| LOW | src/art/utils/strip_logprobs.py | 32 | CODE | |
| LOW | src/art/local/backend.py | 1286 | CODE | |
| LOW | src/art/local/backend.py | 2135 | CODE | |
| LOW | src/art/pipeline_trainer/trainer.py | 189 | CODE | |
| LOW | src/art/trajectories/_serialization.py | 290 | CODE | |
| LOW | src/art/trajectories/_serialization.py | 341 | CODE | |
| LOW | src/art/trajectories/__init__.py | 786 | CODE | |
| LOW | src/art/trajectories/__init__.py | 813 | CODE | |
| LOW | src/art/trajectories/__init__.py | 1007 | CODE | |
| LOW | src/art/trajectories/__init__.py | 1034 | CODE | |
| LOW | src/art/megatron/prefix_tree_state.py | 61 | CODE | |
| LOW | src/art/megatron/train.py | 408 | CODE | |
| LOW | src/art/megatron/train.py | 2608 | CODE | |
| LOW | src/art/megatron/_hybrid_ep/deep_ep/hybrid_ep_buffer.py | 56 | CODE | |
| LOW | src/art/megatron/_hybrid_ep/deep_ep/hybrid_ep_buffer.py | 220 | CODE | |
| LOW | src/art/megatron/_hybrid_ep/deep_ep/hybrid_ep_buffer.py | 367 | CODE | |
| LOW | src/art/megatron/runtime/bridge_runtime.py | 589 | CODE | |
| LOW | src/art/megatron/runtime/te_cutlass_grouped_gemm.py | 32 | CODE | |
| LOW | src/art/megatron/dsv4/deepseek_v4.py | 467 | CODE | |
| LOW | src/art/megatron/dsv4/layer.py | 273 | CODE | |
| LOW | src/art/megatron/gdn/operator.py | 390 | CODE | |
| LOW | src/art/megatron/flex_attn/attention.py | 262 | CODE | |
| LOW | src/art/megatron/flex_attn/flash_dlse_patch.py | 220 | CODE | |
| LOW | src/art/megatron/context_parallel/core_attention.py | 137 | CODE | |
| LOW | src/art/megatron/context_parallel/runtime.py | 2181 | CODE | |
| LOW | src/art/megatron/model_support/handlers/gemma4.py | 1067 | CODE | |
| LOW | src/art/megatron/model_support/handlers/gemma4.py | 1167 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | skypilot-config.yaml | 1 | # Title: Task YAML — SkyPilot documentation | COMMENT |
| LOW | skypilot-config.yaml | 21 | # \# which \`sky\` is called. | COMMENT |
| LOW | skypilot-config.yaml | 41 | # \# if this is specified. | COMMENT |
| LOW | skypilot-config.yaml | 61 | # \# Format: {<name\>:<count\>, ...} | COMMENT |
| LOW | skypilot-config.yaml | 81 | # \# E.g., 32+ means first try to find an instance type with \>\= 32 GiB. If | COMMENT |
| LOW | skypilot-config.yaml | 101 | # \# If \`EAGER\_NEXT\_REGION\` is specified, the job will go to the next region | COMMENT |
| LOW | skypilot-config.yaml | 121 | # \# low: 1000 IOPS; read 90 MB/s; write 90 MB/s | COMMENT |
| LOW | skypilot-config.yaml | 141 | # \# be removed until the cluster is terminated. | COMMENT |
| LOW | skypilot-config.yaml | 161 | # # | COMMENT |
| LOW | skypilot-config.yaml | 181 | # \# Docker support | COMMENT |
| LOW | skypilot-config.yaml | 201 | # \# custom images in multiple regions): | COMMENT |
| LOW | skypilot-config.yaml | 221 | # \# image\_id: skypilot:gpu-ubuntu-2004 | COMMENT |
| LOW | skypilot-config.yaml | 241 | # \# To use a more limited but easier to manage tool: | COMMENT |
| LOW | skypilot-config.yaml | 261 | # \# outside of \`any\_of\`, \`ordered\` will be used as the default values for | COMMENT |
| LOW | skypilot-config.yaml | 281 | # \# \`sky launch/exec --env ENV=val\` (if ENV is present). | COMMENT |
| LOW | skypilot-config.yaml | 301 | # envs: | COMMENT |
| LOW | skypilot-config.yaml | 321 | # # | COMMENT |
| LOW | skypilot-config.yaml | 341 | # # | COMMENT |
| LOW | skypilot-config.yaml | 361 | COMMENT | |
| LOW | …tegration/megatron/train_inf_mismatch/output_parity.py | 21 | # These gates are intentionally bf16-scale, not fp32 oracle-scale. A 2026-05-18 | COMMENT |
| LOW | requirements/backend.vcs.txt | 1 | # Pinned backend dependencies that must come from VCS (not allowed in PyPI metadata). | COMMENT |
| LOW | src/art/tinker/server.py | 521 | base_model = model_path_or_base_model | COMMENT |
| LOW | …benchmarking/charts/percentage_comparison_bar_chart.py | 241 | ax.spines["right"].set_visible(False) | COMMENT |
| LOW | src/art/megatron/_hybrid_ep/deep_ep/hybrid_ep_buffer.py | 381 | num_permuted_tokens: int = None, | COMMENT |
| LOW | …tron/_hybrid_ep/csrc/hybrid_ep/buffer/nixl_connector.h | 1 | // SPDX-License-Identifier: MIT | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | examples/mcp-rl/servers/python/mcp_googlemaps/README.md | 39 | python server.py --api-key YOUR_API_KEY | CODE |
| HIGH | examples/mcp-rl/servers/python/mcp_googlemaps/README.md | 44 | export GOOGLE_MAPS_API_KEY=your_api_key | CODE |
| HIGH | …mples/mcp-rl/servers/python/mcp_alphavantage/README.md | 25 | python server.py --api-key YOUR_API_KEY | CODE |
| HIGH | …mples/mcp-rl/servers/python/mcp_alphavantage/README.md | 30 | export ALPHAVANTAGE_API_KEY=your_api_key | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | .agents/skills/train-sft/SKILL.md | 14 | ## Step 1: Determine Training Scenario | COMMENT |
| LOW⚡ | .agents/skills/train-sft/SKILL.md | 22 | ## Step 2: Determine Backend | COMMENT |
| LOW⚡ | .agents/skills/train-sft/SKILL.md | 28 | ## Step 3: Select and Validate Dataset (JSONL scenario) | COMMENT |
| LOW | .agents/skills/train-sft/SKILL.md | 68 | ## Step 4: Gather Base Parameters | COMMENT |
| LOW | .agents/skills/train-sft/SKILL.md | 84 | ## Step 5: Gather Hyperparameters | COMMENT |
| LOW | .agents/skills/train-sft/SKILL.md | 111 | ## Step 6: Generate the Training Script | COMMENT |
| LOW | .agents/skills/train-sft/SKILL.md | 287 | ## Step 7: Write and Offer to Run | STRING |
| LOW⚡ | src/art/local/backend.py | 2091 | # Step 1: Ensure checkpoint exists at original_checkpoint_dir | COMMENT |
| LOW | src/art/local/backend.py | 2115 | # Step 2: Handle local_path if provided | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | examples/hn_title_generator/reference_grpo_trainer.py | 289 | if scores: # Check if scores list is not empty | CODE |
| LOW | examples/hn_title_generator/reference_grpo_trainer.py | 310 | if v_list: # Check if list for metric is not empty | CODE |
| LOW | scripts/publish.sh | 8 | # Check if PYPI_ART_TOKEN is set | COMMENT |
| LOW | src/art/utils/s3_checkpoint_utils.py | 166 | # Check if it's a 4-digit checkpoint directory (old format) | COMMENT |
| LOW | src/art/utils/s3_checkpoint_utils.py | 192 | # Check if already exists in new location | COMMENT |
| LOW | src/art/utils/s3.py | 133 | # Check if bucket exists | COMMENT |
| LOW⚡ | src/art/local/backend.py | 2086 | # Check if checkpoint exists in the original training location | COMMENT |
| LOW | src/art/megatron/dsv4/encoding.py | 347 | # Check if previous message has a task - if so, this is a task output (no thinking) | COMMENT |
| LOW | src/mp_actors/move.py | 256 | # Check if it's a method or property | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | …benchmarking/charts/percentage_comparison_bar_chart.py | 231 | # Remove y-axis label, ticks, and spine as requested | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/unit/test_frontend_logging.py | 1160 | CODE | |
| MEDIUM | src/art/tinker/service.py | 220 | CODE | |
| MEDIUM | src/art/tinker_native/backend.py | 501 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | src/art/local/backend.py | 2091 | # Step 1: Ensure checkpoint exists at original_checkpoint_dir | COMMENT |
| LOW | src/art/local/backend.py | 2115 | # Step 2: Handle local_path if provided | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | examples/hn_title_generator/train.py | 138 | # Be robust to variations like "True.", " False", etc. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | skypilot-config.yaml | 156 | # \# Example usage: | COMMENT |