Go ahead and axolotl questions
This report presents the forensic synthetic code analysis of axolotl-ai-cloud/axolotl, a Python project with 12,195 GitHub stars. SynthScan v2.0 examined 247,275 lines of code across 1305 source files, recording 3651 pattern matches distributed across 24 syntactic categories. The overall adjusted score of 20.8 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 3651 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_glm_dsa_cp_validation.py | 29 | def test_config_validation_recovers_inherited_defaults(): | CODE |
| LOW | tests/test_glm_dsa_cp_validation.py | 48 | def test_config_validation_recovers_known_none_defaults(): | CODE |
| LOW | tests/test_glm_dsa_cp_validation.py | 64 | def test_config_validation_retry_accepts_field_names(): | CODE |
| LOW | tests/test_glm_dsa_cp_validation.py | 85 | def test_dsa_cp_skips_flash_and_ring_requirement(self, monkeypatch): | CODE |
| LOW | tests/test_glm_dsa_cp_validation.py | 100 | def test_cp_without_dsa_still_requires_flash(self, monkeypatch): | CODE |
| LOW | tests/test_glm_dsa_cp_validation.py | 107 | def test_dsa_without_cp_leaves_ring_attn_func_none(self, monkeypatch): | CODE |
| LOW | tests/test_empty_tokenization.py | 32 | def test_metharme_tokenize_empty_does_not_crash(no_bos_tokenizer): | CODE |
| LOW | tests/test_empty_tokenization.py | 38 | def test_reflection_tokenize_empty_does_not_crash(no_bos_tokenizer): | CODE |
| LOW⚡ | tests/test_fp32_norms.py | 53 | def test_suffix_matches_multiple_norm_families(): | CODE |
| LOW⚡ | tests/test_fp32_norms.py | 60 | def test_suffix_does_not_match_non_norm_modules(): | CODE |
| LOW⚡ | tests/test_fp32_norms.py | 67 | def test_explicit_classname_matches_custom_norm(): | CODE |
| LOW⚡ | tests/test_fp32_norms.py | 71 | def test_fully_qualified_pattern_matches_exact_path(): | CODE |
| LOW⚡ | tests/test_fp32_norms.py | 77 | def test_mixed_patterns_suffix_and_qualified(): | CODE |
| LOW | tests/test_fp32_norms.py | 107 | def test_meta_device_is_supported(monkeypatch): | CODE |
| LOW | tests/test_fp32_norms.py | 128 | def test_passthrough_fully_shard_kwargs_are_used(monkeypatch): | CODE |
| LOW | tests/test_fp32_norms.py | 159 | def test_no_matches_warns_and_returns_zero(caplog): | CODE |
| LOW | tests/test_fp32_norms.py | 177 | def test_explicit_classes_override_defaults(monkeypatch): | CODE |
| LOW | tests/test_utils_tee.py | 25 | def test_file_only_stream_writes_after_prepare(monkeypatch): | CODE |
| LOW | tests/test_utils_tee.py | 50 | def test_stdout_is_mirrored_after_prepare(capsys, monkeypatch): | CODE |
| LOW | tests/test_utils_tee.py | 72 | def test_truncate_vs_append_behavior(monkeypatch): | CODE |
| LOW | tests/test_vectorized_scanner.py | 81 | def test_longest_prefix_wins_at_same_position(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 94 | def test_pixtral_shared_end_marker_rewind(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 144 | def test_train_on_eos_last_only_final_turn_unmasked(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 153 | def test_empty_end_tokens_runs_to_eos(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 172 | def test_non_trainable_role_end_marker_leak_gate(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 194 | def test_non_trainable_role_include_end_false_no_leak(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 213 | def test_truncated_final_turn_no_end(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 235 | def test_empty_roles_to_train_masks_all(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 242 | def test_adversarial_first_token_collision(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 416 | def test_catalog_smoke_per_shape(shape_name): | CODE |
| LOW | tests/test_vectorized_scanner.py | 484 | def test_back_to_back_user_assistant_pairs(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 530 | def test_user_with_no_end_then_assistant(self): | CODE |
| LOW | tests/test_vectorized_scanner.py | 548 | def _build_long_multi_end_sequence( | CODE |
| LOW | tests/test_vectorized_scanner.py | 598 | def test_bisect_first_end_in_span_explicit(): | CODE |
| LOW | tests/test_vectorized_scanner.py | 611 | def test_differential_fuzz_long_spans(): | CODE |
| LOW⚡ | tests/conftest.py | 261 | # def download_fozzie_alpaca_dpo_dataset(): | COMMENT |
| LOW⚡ | tests/conftest.py | 163 | def download_tiny_llama_model(): | CODE |
| LOW⚡ | tests/conftest.py | 168 | def download_tiny_mistral_model(): | CODE |
| LOW⚡ | tests/conftest.py | 173 | def download_tiny_mixtral_model(): | CODE |
| LOW⚡ | tests/conftest.py | 183 | def download_tiny_falcon_model(): | CODE |
| LOW⚡ | tests/conftest.py | 237 | def download_argilla_distilabel_intel_orca_dpo_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 245 | def download_argilla_ultrafeedback_binarized_preferences_cleaned_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 253 | def download_argilla_ultrafeedback_binarized_preferences_cleaned_kto_dataset(): | CODE |
| LOW | tests/conftest.py | 275 | # def dataset_fozzie_alpaca_dpo_dataset( | COMMENT |
| LOW⚡ | tests/conftest.py | 292 | def download_arcee_ai_distilabel_intel_orca_dpo_pairs_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 300 | def download_argilla_dpo_pairs_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 308 | def download_tiny_shakespeare_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 314 | def download_evolkit_kd_sample_dataset(): | CODE |
| LOW⚡ | tests/conftest.py | 322 | def download_deepseek_model_fixture(): | CODE |
| LOW⚡ | tests/conftest.py | 327 | def download_huggyllama_model_fixture(): | CODE |
| LOW | tests/conftest.py | 28 | def _apply_transformers_test_shims(): | CODE |
| LOW | tests/conftest.py | 70 | def pytest_runtest_makereport(item, call): # pylint: disable=unused-argument | CODE |
| LOW | tests/conftest.py | 88 | def retry_on_request_exceptions(max_retries=3, delay=1): | CODE |
| LOW | tests/conftest.py | 112 | def snapshot_download_w_retry(*args, **kwargs): | CODE |
| LOW | tests/conftest.py | 131 | def download_ds_fixture_bundle(): | CODE |
| LOW | tests/conftest.py | 203 | def download_tatsu_lab_alpaca_dataset(): | CODE |
| LOW | tests/conftest.py | 490 | def tokenizer_huggyllama_w_special_tokens( | CODE |
| LOW | tests/conftest.py | 656 | def dataset_winglian_tiny_shakespeare( | CODE |
| LOW | tests/conftest.py | 686 | def dataset_argilla_ultrafeedback_binarized_preferences_cleaned( | CODE |
| LOW | tests/test_tokenizers.py | 44 | def test_special_tokens_modules_to_save(self): | CODE |
| 2071 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_ebft_kernels.py | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 24 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 98 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 100 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 164 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 166 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ebft_kernels.py | 239 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 23 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 25 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 174 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 176 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 371 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_triton_kernels.py | 373 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_triton_kernels.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_triton_kernels.py | 48 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_triton_kernels.py | 291 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_triton_kernels.py | 293 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_http_weight_sync.py | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_http_weight_sync.py | 19 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_http_weight_sync.py | 61 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_http_weight_sync.py | 63 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_http_weight_sync.py | 111 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_http_weight_sync.py | 113 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/integrations/test_gemma4_moe.py | 173 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_gemma4_moe.py | 175 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_gemma4_moe.py | 444 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_gemma4_moe.py | 446 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 22 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 24 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 118 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 120 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 498 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 500 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 45 | # ─── Helpers ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 121 | # ─── Model shape configs ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 139 | # ─── Forward tests ────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 186 | # ─── Backward dX tests ────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 220 | # ─── Backward LoRA gradient tests ─────────────────────────────────────────── | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora_kernels.py | 291 | # ─── Full autograd tests ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 24 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 26 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 272 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 274 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 306 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 308 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 652 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | tests/integrations/test_scattermoe_lora.py | 654 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora.py | 204 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora.py | 206 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora.py | 346 | # ============================================================================ | COMMENT |
| MEDIUM | tests/integrations/test_scattermoe_lora.py | 348 | # ============================================================================ | COMMENT |
| MEDIUM | …sts/integrations/test_scattermoe_autotune_telemetry.py | 12 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …sts/integrations/test_scattermoe_autotune_telemetry.py | 14 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …sts/integrations/test_scattermoe_autotune_telemetry.py | 81 | # ========================================================================= | COMMENT |
| MEDIUM | …sts/integrations/test_scattermoe_autotune_telemetry.py | 83 | # ========================================================================= | COMMENT |
| MEDIUM⚡ | …sts/integrations/test_scattermoe_autotune_telemetry.py | 207 | # ========================================================================= | COMMENT |
| MEDIUM⚡ | …sts/integrations/test_scattermoe_autotune_telemetry.py | 209 | # ========================================================================= | COMMENT |
| MEDIUM⚡ | …sts/integrations/test_scattermoe_autotune_telemetry.py | 381 | # ========================================================================= | COMMENT |
| MEDIUM⚡ | …sts/integrations/test_scattermoe_autotune_telemetry.py | 383 | # ========================================================================= | COMMENT |
| 343 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_fp32_norms.py | 3 | CODE | |
| LOW | tests/test_vectorized_scanner.py | 21 | CODE | |
| LOW | tests/test_process_labels_fusion.py | 9 | CODE | |
| LOW | tests/test_mm_collator_warnings.py | 3 | CODE | |
| LOW | tests/test_no_legacy_attn_reads.py | 8 | CODE | |
| LOW | tests/utils/test_cuda13.py | 3 | CODE | |
| LOW | tests/integrations/test_gemma4_moe.py | 451 | CODE | |
| LOW | …rnels/scattermoe_lora/test_scattermoe_lora_m_bucket.py | 22 | CODE | |
| LOW | tests/integrations/kernels/scattermoe_lora/conftest.py | 19 | CODE | |
| LOW | …/scattermoe_lora/test_scattermoe_lora_int64_indices.py | 33 | CODE | |
| LOW | …ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py | 25 | CODE | |
| LOW | …ns/kernels/scattermoe_lora/test_nvfp4_fsdp_sharding.py | 30 | CODE | |
| LOW | …ons/kernels/scattermoe_lora/test_grouped_fp4_guards.py | 14 | CODE | |
| LOW | …grations/kernels/scattermoe_lora/bench_int64_kernel.py | 26 | CODE | |
| LOW | …kernels/scattermoe_lora/test_nvfp4_weight_converter.py | 22 | CODE | |
| LOW | …rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py | 30 | CODE | |
| LOW | …ions/kernels/scattermoe_lora/test_grouped_fp4_train.py | 23 | CODE | |
| LOW | …termoe_lora/test_parallel_experts_large_batch_repro.py | 32 | CODE | |
| LOW | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 15 | CODE | |
| LOW | …/scattermoe_lora/test_gates_backward_autocast_dtype.py | 13 | CODE | |
| LOW | …tions/kernels/scattermoe_lora/test_grouped_fp4_perf.py | 23 | CODE | |
| LOW | …els/scattermoe_lora/test_grouped_fp4_weight_scale_2.py | 24 | CODE | |
| LOW | …s/integrations/kernels/dsv4/test_dsv4_attention_ops.py | 36 | CODE | |
| LOW | tests/e2e/multigpu/test_fsdp2_fp32_norms.py | 11 | CODE | |
| LOW | tests/e2e/multigpu/_fp32_norms_dtype_capture.py | 9 | CODE | |
| LOW | tests/monkeypatch/test_float8_fsdp_sharding.py | 20 | CODE | |
| LOW | tests/prompt_strategies/test_chat_templates_mistral.py | 9 | CODE | |
| LOW | src/axolotl/train.py | 3 | CODE | |
| LOW | src/axolotl/train.py | 46 | CODE | |
| LOW | src/axolotl/train.py | 46 | CODE | |
| LOW | src/axolotl/kernels/op_registry.py | 10 | CODE | |
| LOW | src/axolotl/core/training_args.py | 5 | CODE | |
| LOW | src/axolotl/core/builders/__init__.py | 3 | CODE | |
| LOW | src/axolotl/core/builders/__init__.py | 4 | CODE | |
| LOW | src/axolotl/core/trainers/__init__.py | 7 | CODE | |
| LOW | src/axolotl/core/trainers/base.py | 3 | CODE | |
| LOW | …olotl/core/trainers/mixins/activation_checkpointing.py | 48 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 5 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 6 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 7 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 8 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 9 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 10 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 11 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/__init__.py | 12 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/strided.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/strided.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/strided.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/strided.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/grpo/trainer.py | 54 | CODE | |
| LOW | src/axolotl/utils/tee.py | 6 | CODE | |
| LOW | src/axolotl/utils/cuda13.py | 3 | CODE | |
| LOW | src/axolotl/utils/fp32_norms.py | 3 | CODE | |
| LOW | src/axolotl/utils/ctx_managers/__init__.py | 5 | CODE | |
| LOW | src/axolotl/utils/callbacks/swanlab.py | 3 | CODE | |
| LOW | src/axolotl/utils/callbacks/__init__.py | 3 | CODE | |
| LOW | src/axolotl/utils/callbacks/comet_.py | 12 | CODE | |
| LOW | src/axolotl/utils/callbacks/lisa.py | 18 | CODE | |
| LOW | src/axolotl/utils/callbacks/mlflow_.py | 15 | CODE | |
| 224 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .runpod/src/utils.py | 40 | CODE | |
| LOW | .runpod/src/utils.py | 59 | CODE | |
| LOW | tests/test_vectorized_scanner.py | 364 | CODE | |
| LOW | tests/test_vectorized_scanner.py | 548 | CODE | |
| LOW | tests/test_process_labels_fusion.py | 232 | CODE | |
| LOW | tests/test_weighted_loss.py | 15 | CODE | |
| LOW | tests/core/test_async_grpo.py | 275 | CODE | |
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 178 | CODE | |
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 215 | CODE | |
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 255 | CODE | |
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 301 | CODE | |
| LOW | tests/utils/lora/test_merge_lora.py | 1832 | CODE | |
| LOW | …ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py | 331 | CODE | |
| LOW | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 55 | CODE | |
| LOW | tests/e2e/multigpu/solo/test_grpo.py | 25 | CODE | |
| LOW | tests/monkeypatch/test_gemma4_unified_fused_attn.py | 25 | CODE | |
| LOW | tests/prompt_strategies/test_chat_templates_advanced.py | 728 | CODE | |
| LOW | tests/prompt_strategies/test_chat_templates_advanced.py | 1409 | CODE | |
| LOW | docs/scripts/generate_examples_docs.py | 94 | CODE | |
| LOW | docs/scripts/generate_examples_docs.py | 215 | CODE | |
| LOW | docs/scripts/generate_examples_docs.py | 286 | CODE | |
| LOW | docs/scripts/generate_examples_docs.py | 107 | CODE | |
| LOW | docs/scripts/generate_config_docs.py | 50 | CODE | |
| LOW | docs/scripts/generate_config_docs.py | 126 | CODE | |
| LOW | docs/scripts/generate_config_docs.py | 263 | CODE | |
| LOW | docs/scripts/generate_config_docs.py | 438 | CODE | |
| LOW | docs/scripts/generate_config_docs.py | 591 | CODE | |
| LOW | scripts/analyze_profile.py | 338 | CODE | |
| LOW | scripts/analyze_profile.py | 565 | CODE | |
| LOW | scripts/analyze_profile.py | 651 | CODE | |
| LOW | scripts/analyze_profile.py | 774 | CODE | |
| LOW | scripts/analyze_profile.py | 888 | CODE | |
| LOW | scripts/analyze_profile.py | 975 | CODE | |
| LOW | scripts/analyze_profile.py | 1079 | CODE | |
| LOW | scripts/analyze_profile.py | 1338 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 393 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 510 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 695 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 176 | CODE | |
| LOW | src/axolotl/prompters.py | 48 | CODE | |
| LOW | src/axolotl/train.py | 254 | CODE | |
| LOW | src/axolotl/train.py | 415 | CODE | |
| LOW | src/axolotl/kernels/autotune_telemetry.py | 46 | CODE | |
| LOW | src/axolotl/core/chat/messages.py | 134 | CODE | |
| LOW | src/axolotl/core/builders/rl.py | 39 | CODE | |
| LOW | src/axolotl/core/builders/rl.py | 101 | CODE | |
| LOW | src/axolotl/core/builders/causal.py | 467 | CODE | |
| LOW | src/axolotl/core/builders/base.py | 292 | CODE | |
| LOW | src/axolotl/core/builders/base.py | 570 | CODE | |
| LOW | src/axolotl/core/builders/base.py | 293 | CODE | |
| LOW | src/axolotl/core/trainers/utils.py | 22 | CODE | |
| LOW | src/axolotl/core/trainers/utils.py | 38 | CODE | |
| LOW | …olotl/core/trainers/mixins/activation_checkpointing.py | 153 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/layer_offloading.py | 24 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/optimizer.py | 22 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/optimizer.py | 107 | CODE | |
| LOW | src/axolotl/core/trainers/mixins/scheduler.py | 27 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/__init__.py | 79 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/trainer.py | 144 | CODE | |
| LOW | src/axolotl/core/trainers/ebft/trainer.py | 186 | CODE | |
| 181 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_attn_implementation.py | 44 | def _xformers_available(): | CODE |
| LOW | tests/test_attn_implementation.py | 62 | except Exception: # pylint: disable=broad-except | CODE |
| LOW | tests/core/test_builders.py | 266 | except Exception: | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 1541 | except Exception: # pragma: no cover | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 1551 | except Exception as ex: # pragma: no cover - torchao API / device gaps | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 1647 | except Exception: # pragma: no cover | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 1657 | except Exception as ex: # pragma: no cover | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 2138 | except Exception: # pragma: no cover | CODE |
| LOW | tests/utils/lora/test_merge_lora.py | 2151 | except Exception as ex: # pragma: no cover | CODE |
| MEDIUM | tests/integrations/test_gemma4_moe.py | 449 | def _can_import_sonicmoe(): | CODE |
| LOW⚡ | tests/integrations/test_gemma4_moe.py | 454 | except Exception: | CODE |
| LOW | …ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py | 65 | except Exception: | CODE |
| MEDIUM | …ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py | 56 | def gpu_name() -> str: | CODE |
| LOW | …grations/kernels/scattermoe_lora/bench_int64_kernel.py | 59 | except Exception: | CODE |
| MEDIUM | …grations/kernels/scattermoe_lora/bench_int64_kernel.py | 51 | def gpu_name() -> str: | CODE |
| LOW | …rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py | 61 | except Exception: | CODE |
| LOW | …rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py | 371 | except Exception: | CODE |
| LOW | …els/scattermoe_lora/test_grouped_fp4_weight_scale_2.py | 52 | except Exception: | CODE |
| LOW | …sts/e2e/kernels/test_lora_mlp_geglu_moe_correctness.py | 20 | except Exception: # pragma: no cover | CODE |
| MEDIUM | tests/e2e/integrations/test_scattermoe_lora_kernels.py | 42 | def wrapper(*args, **kwargs): | CODE |
| LOW⚡ | tests/e2e/integrations/test_scattermoe_lora_kernels.py | 45 | except Exception as exc: # pylint: disable=broad-except | CODE |
| LOW | tests/monkeypatch/test_sdpa_varlen.py | 165 | except Exception: # pylint: disable=broad-except | CODE |
| LOW | docs/scripts/generate_config_docs.py | 503 | except Exception: | CODE |
| LOW | docs/scripts/generate_config_docs.py | 607 | except Exception as e: | CODE |
| LOW | examples/orpheus/README.md | 79 | except Exception as e: | CODE |
| LOW | examples/orpheus/README.md | 240 | except Exception as e: | CODE |
| LOW | scripts/analyze_profile.py | 1388 | except Exception: | CODE |
| LOW | src/axolotl/train.py | 91 | except Exception: # pylint: disable=broad-exception-caught | CODE |
| LOW | src/axolotl/kernels/quantize.py | 154 | except Exception: | CODE |
| LOW | src/axolotl/kernels/autotune_telemetry.py | 42 | except Exception: # pylint: disable=broad-exception-caught | CODE |
| LOW | src/axolotl/kernels/op_registry.py | 50 | except Exception as exc: # pylint: disable=broad-exception-caught | CODE |
| LOW | src/axolotl/core/trainers/base.py | 859 | except Exception as exc: # pylint: disable=broad-except | CODE |
| LOW | src/axolotl/core/trainers/base.py | 892 | except Exception as exc: # pylint: disable=broad-except | CODE |
| LOW | src/axolotl/core/trainers/ebft/trainer.py | 501 | except Exception as e: | CODE |
| LOW | src/axolotl/core/trainers/grpo/async_trainer.py | 1177 | except Exception as exc: | CODE |
| LOW⚡ | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 207 | except Exception: | CODE |
| LOW⚡ | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 336 | except Exception: | CODE |
| LOW⚡ | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 340 | except Exception: | CODE |
| LOW | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 444 | except Exception: | CODE |
| LOW | src/axolotl/utils/tee.py | 41 | except Exception: | CODE |
| LOW | src/axolotl/utils/tee.py | 70 | except Exception: | CODE |
| LOW | src/axolotl/utils/tee.py | 162 | except Exception: | CODE |
| LOW | src/axolotl/utils/config/__init__.py | 134 | except Exception: | CODE |
| MEDIUM | src/axolotl/utils/config/__init__.py | 122 | def get_device(): | CODE |
| LOW | src/axolotl/utils/callbacks/generation.py | 38 | except Exception as e: | CODE |
| LOW | src/axolotl/utils/callbacks/swanlab.py | 90 | except Exception as err: | CODE |
| LOW | src/axolotl/utils/callbacks/swanlab.py | 124 | except Exception as err: | CODE |
| LOW | src/axolotl/utils/callbacks/__init__.py | 374 | except Exception as exc: | CODE |
| LOW | src/axolotl/utils/callbacks/__init__.py | 435 | except Exception: | CODE |
| LOW | src/axolotl/utils/callbacks/opentelemetry.py | 72 | except Exception as e: | CODE |
| LOW | src/axolotl/utils/callbacks/opentelemetry.py | 132 | except Exception as e: | CODE |
| LOW | src/axolotl/utils/callbacks/opentelemetry.py | 221 | except Exception as e: | CODE |
| LOW | src/axolotl/utils/schemas/config.py | 1895 | except Exception: # pylint: disable=broad-exception-caught | CODE |
| LOW | src/axolotl/utils/data/shared.py | 564 | except Exception: | CODE |
| LOW | src/axolotl/utils/generation/sft.py | 128 | except Exception as e: | CODE |
| LOW | src/axolotl/utils/generation/sft.py | 132 | except Exception as e: | CODE |
| LOW | src/axolotl/cli/config.py | 157 | except Exception as err: | CODE |
| LOW | src/axolotl/cli/preprocess.py | 88 | except Exception as exc: | CODE |
| LOW | src/axolotl/cli/chat.py | 326 | except Exception: # pylint: disable=broad-exception-caught | CODE |
| LOW | src/axolotl/cli/chat.py | 366 | except Exception: # pylint: disable=broad-exception-caught | CODE |
| 109 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | examples/swanlab/dpo-swanlab-full-featured.yml | 13 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/dpo-swanlab-full-featured.yml | 145 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/dpo-swanlab-full-featured.yml | 147 | # swanlab_api_key: your-api-key | COMMENT |
| HIGH | examples/swanlab/lora-swanlab-profiling.yml | 12 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/lora-swanlab-profiling.yml | 92 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/lora-swanlab-profiling.yml | 94 | # swanlab_api_key: your-api-key | COMMENT |
| HIGH | examples/swanlab/README.md | 22 | export SWANLAB_API_KEY=your-api-key | CODE |
| HIGH | examples/swanlab/README.md | 43 | export SWANLAB_API_KEY=your-api-key | CODE |
| HIGH | examples/swanlab/README.md | 66 | export SWANLAB_API_KEY=your-api-key | CODE |
| HIGH | examples/swanlab/README.md | 149 | export SWANLAB_API_KEY=your-api-key | CODE |
| HIGH | examples/swanlab/README.md | 156 | swanlab_api_key: your-api-key | CODE |
| HIGH | examples/swanlab/custom_trainer_profiling.py | 247 | export SWANLAB_API_KEY=your-api-key | STRING |
| HIGH | examples/swanlab/dpo-swanlab-completions.yml | 12 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/dpo-swanlab-completions.yml | 104 | # export SWANLAB_API_KEY=your-api-key | COMMENT |
| HIGH⚡ | examples/swanlab/dpo-swanlab-completions.yml | 106 | # swanlab_api_key: your-api-key | COMMENT |
| HIGH | src/axolotl/integrations/swanlab/plugins.py | 88 | " export SWANLAB_API_KEY=your-api-key\n" | CODE |
| HIGH | src/axolotl/integrations/swanlab/plugins.py | 89 | " 2. Add 'swanlab_api_key: your-api-key' to config (less secure)\n" | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 46 | swanlab_api_key: YOUR_API_KEY # Optional: can also use env var SWANLAB_API_KEY | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 53 | export SWANLAB_API_KEY=your-api-key-here | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 841 | 1. Set environment variable: `export SWANLAB_API_KEY=your-api-key` | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 842 | 2. Add to config (less secure): `swanlab_api_key: your-api-key` | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 938 | export SWANLAB_API_KEY=your-api-key-here | CODE |
| HIGH | src/axolotl/integrations/swanlab/README.md | 949 | swanlab_api_key: your-api-key-here | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .axolotl-complete.bash | 18 | # Check if previous word is in our list | COMMENT |
| LOW | tests/e2e/integrations/test_scattermoe_lora_kernels.py | 809 | # Set weights to match test data | COMMENT |
| LOW | tests/e2e/patched/test_peft_embeddings.py | 59 | # Check if the embeddings are upcast correctly | COMMENT |
| LOW | tests/prompt_strategies/test_chat_templates_advanced.py | 644 | # Check if system message is not present in input_ids | COMMENT |
| LOW | tests/prompt_strategies/test_chat_templates_advanced.py | 715 | # Check if responses are labeled correctly based on role | COMMENT |
| LOW | docs/scripts/generate_examples_docs.py | 123 | # Check if target is outside examples_dir | COMMENT |
| LOW | docs/scripts/generate_examples_docs.py | 153 | # Check if this exact path is in allowlist | COMMENT |
| LOW | docs/scripts/generate_examples_docs.py | 243 | # Check if this is a parent page that has sub-pages | COMMENT |
| LOW | docs/scripts/generate_config_docs.py | 180 | # Check if this type itself is a Pydantic model | COMMENT |
| LOW | docs/scripts/generate_config_docs.py | 395 | # Check if this starts a new group (blank line before or significant gap) | COMMENT |
| LOW | docs/scripts/generate_config_docs.py | 674 | # Check if this field has nested models | COMMENT |
| LOW | scripts/cloud-entrypoint.sh | 29 | # Check if the word looks like the start of a key | COMMENT |
| LOW | scripts/cloud-entrypoint.sh | 72 | # Check if JUPYTER_PASSWORD is set and not empty | COMMENT |
| LOW | scripts/cloud-entrypoint.sh | 74 | # Set JUPYTER_TOKEN to the value of JUPYTER_PASSWORD | COMMENT |
| LOW | scripts/analyze_profile.py | 1110 | # Check if this small block is surrounded by inactive | COMMENT |
| LOW | scripts/cloud-entrypoint-term.sh | 25 | # Check if the word looks like the start of a key | COMMENT |
| LOW | scripts/cloud-entrypoint-term.sh | 63 | # Check if JUPYTER_PASSWORD is set and not empty | COMMENT |
| LOW | scripts/cloud-entrypoint-term.sh | 65 | # Set JUPYTER_TOKEN to the value of JUPYTER_PASSWORD | COMMENT |
| LOW | src/axolotl/train.py | 530 | # Check if the `token_ids_to_fix` kwarg exists in the fix_untrained_tokens args | COMMENT |
| LOW | src/axolotl/core/trainers/ebft/strided.py | 408 | # Check if we can share weights (PEFT model on single GPU) | COMMENT |
| LOW | src/axolotl/core/trainers/grpo/async_trainer.py | 1274 | # Check if model has FP8 weights | COMMENT |
| LOW | src/axolotl/utils/tee.py | 157 | # Close the file handle if open | COMMENT |
| LOW | src/axolotl/utils/freeze.py | 39 | # Check if any path component matches a vision/audio prefix | COMMENT |
| LOW | src/axolotl/utils/trainer.py | 223 | # Check if single example or batched by looking at the first element | COMMENT |
| LOW | src/axolotl/utils/trainer.py | 269 | # Check if single example or batch | COMMENT |
| LOW | src/axolotl/utils/callbacks/swanlab.py | 48 | # Check if SwanLab run is initialized | COMMENT |
| LOW | src/axolotl/utils/callbacks/swanlab.py | 163 | # Check if SwanLab is initialized | COMMENT |
| LOW | src/axolotl/utils/callbacks/lisa.py | 59 | # Check if it's time to switch active layers, including at step 0 | COMMENT |
| LOW⚡ | src/axolotl/utils/schemas/datasets.py | 216 | # Set chat_template to tokenizer_default if not set | COMMENT |
| LOW | src/axolotl/utils/samplers/multipack.py | 237 | # Assign bins to ranks - each rank gets every n-th bin | COMMENT |
| LOW | src/axolotl/utils/data/shared.py | 182 | # Check if it's a HuggingFace dataset | COMMENT |
| LOW | src/axolotl/utils/data/shared.py | 185 | # Check if it's a cloud storage path and get appropriate filesystem | COMMENT |
| LOW | src/axolotl/utils/data/streaming.py | 209 | # Set this to 1 so downstream data_loader doesn't try to increase the batch size | COMMENT |
| LOW | src/axolotl/utils/mistral/mistral_tokenizer.py | 65 | # Check if MistralRequestValidator has a _mode attribute. | COMMENT |
| LOW | src/axolotl/cli/config.py | 114 | # Check if the config is a valid HTTPS URL to a .yml or .yaml file | COMMENT |
| LOW | src/axolotl/cli/checks.py | 42 | # Verify if token is valid | COMMENT |
| LOW | src/axolotl/cli/utils/fetch.py | 35 | # Check if file exists and needs updating | COMMENT |
| LOW⚡ | src/axolotl/cli/utils/train.py | 27 | # Check if rdzv_endpoint is present | COMMENT |
| LOW⚡ | src/axolotl/cli/utils/train.py | 31 | # Check if rdzv_backend is already provided | COMMENT |
| LOW⚡ | src/axolotl/cli/utils/train.py | 36 | # Check if rdzv_id is already provided | COMMENT |
| LOW | src/axolotl/integrations/nemo_gym/server.py | 93 | # Check if already running | COMMENT |
| LOW | src/axolotl/integrations/cut_cross_entropy/__init__.py | 61 | # Check if cut_cross_entropy is installed | COMMENT |
| LOW | src/axolotl/integrations/cut_cross_entropy/__init__.py | 74 | # Check if Axolotl's cce fork is installed | COMMENT |
| LOW | src/axolotl/integrations/swanlab/plugins.py | 50 | # Check if SwanLab is enabled | COMMENT |
| LOW | src/axolotl/integrations/swanlab/plugins.py | 446 | # Check if Lark webhook URL is configured | COMMENT |
| LOW⚡ | src/axolotl/integrations/swanlab/plugins.py | 503 | # Check if completion logging is enabled | COMMENT |
| LOW⚡ | src/axolotl/integrations/swanlab/plugins.py | 509 | # Check if trainer is an RLHF trainer | COMMENT |
| LOW | src/axolotl/integrations/swanlab/profiling.py | 40 | # Check if SwanLab is enabled and initialized | COMMENT |
| LOW | src/axolotl/integrations/swanlab/profiling.py | 184 | # Check if should log based on config | COMMENT |
| LOW | src/axolotl/integrations/swanlab/profiling.py | 186 | # Check if SwanLab is enabled | COMMENT |
| LOW | src/axolotl/scripts/vllm_worker_ext.py | 67 | # Check if this is a simple direct param (exists as-is) | COMMENT |
| LOW | src/axolotl/telemetry/callbacks.py | 102 | # Check if we should report metrics | COMMENT |
| LOW | src/axolotl/telemetry/errors.py | 50 | # Check if this line contains a file path | COMMENT |
| LOW | src/axolotl/loaders/utils.py | 77 | # Check if image_size is not set and load image size from model config if available | COMMENT |
| LOW | src/axolotl/monkeypatch/deepspeed_utils.py | 33 | # Check if already patched | COMMENT |
| LOW | src/axolotl/monkeypatch/lora_kernels.py | 253 | # Check if already patched | STRING |
| LOW | src/axolotl/monkeypatch/attention/xformers.py | 45 | # Check if we have sliding window attention | COMMENT |
| LOW⚡ | …/axolotl/monkeypatch/transformers/trainer_loss_calc.py | 49 | # Check if already patched | COMMENT |
| LOW⚡ | …/axolotl/monkeypatch/transformers/trainer_loss_calc.py | 54 | # Check if the patterns exist | COMMENT |
| LOW⚡ | …/axolotl/monkeypatch/transformers/trainer_loss_calc.py | 108 | # Check if already patched | COMMENT |
| 7 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .runpod/requirements.txt | 1 | # Required Python packages get listed here, one per line. | COMMENT |
| LOW | .runpod/src/config/config.yaml | 1 | # # This is the huggingface model that contains *.pt, *.safetensors, or *.bin files | COMMENT |
| LOW | .runpod/src/config/config.yaml | 21 | # tokenizer_use_fast: | COMMENT |
| LOW | .runpod/src/config/config.yaml | 41 | COMMENT | |
| LOW | .runpod/src/config/config.yaml | 61 | # float16: true | COMMENT |
| LOW | .runpod/src/config/config.yaml | 81 | # - path: repo | COMMENT |
| LOW | .runpod/src/config/config.yaml | 101 | COMMENT | |
| LOW | .runpod/src/config/config.yaml | 121 | # dataset_shard_num: | COMMENT |
| LOW | .runpod/src/config/config.yaml | 141 | # sample_packing_eff_est: | COMMENT |
| LOW | .runpod/src/config/config.yaml | 161 | # # - gate_proj | COMMENT |
| LOW | .runpod/src/config/config.yaml | 181 | # # Must use either 'lora' or 'qlora' adapter, and does not support fsdp or deepspeed | COMMENT |
| LOW | .runpod/src/config/config.yaml | 201 | # # Training hyperparameters | COMMENT |
| LOW | .runpod/src/config/config.yaml | 221 | # max_steps: | COMMENT |
| LOW | .runpod/src/config/config.yaml | 241 | # lr_scheduler: # 'one_cycle' | empty for cosine | COMMENT |
| LOW | .runpod/src/config/config.yaml | 261 | # # - adafactor | COMMENT |
| LOW | .runpod/src/config/config.yaml | 281 | COMMENT | |
| LOW | .runpod/src/config/config.yaml | 301 | # # xpos RoPE see https://github.com/kaiokendev/cutoff-len-is-context-len/blob/main/util/xpos_rope_llama_monkey_patch.py | COMMENT |
| LOW | .runpod/src/config/config.yaml | 321 | # # Add extra tokens. | COMMENT |
| LOW | tests/conftest.py | 261 | # def download_fozzie_alpaca_dpo_dataset(): | COMMENT |
| LOW | tests/integrations/test_swanlab.py | 1 | # Copyright 2024 Axolotl AI. All rights reserved. | COMMENT |
| LOW | …s/kernels/scattermoe_lora/test_mxfp4_expert_weights.py | 61 | # Per-shape Strategy-B tolerances. Forward outputs accumulate K dot-products | COMMENT |
| LOW | …rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py | 341 | dn.float().pow(2).mean().backward() | COMMENT |
| LOW | tests/e2e/multigpu/solo/__init__.py | 1 | # Tests under this directory should get run "solo" on their own as they | COMMENT |
| LOW | examples/gemma4/26b-a4b-moe-bnb-lora.yaml | 1 | # Gemma-4-26B-A4B MoE QLoRA on a bf16 checkpoint quantized to bnb-4bit at load — the throughput- | COMMENT |
| LOW | examples/ebft/qwen35-4b-ebft-structured-async.yaml | 1 | # EBFT Structured Mode: Qwen3.5-4B (hybrid linear attention) | COMMENT |
| LOW | examples/ebft/qwen35-4b-ebft-structured.yaml | 1 | # EBFT Structured Mode: Qwen3.5-4B (hybrid linear attention) | COMMENT |
| LOW | examples/ebft/llama-1b-ebft-opencode.yaml | 1 | # EBFT: Energy-Based Fine-Tuning with Llama-3.2-1B on OpenCodeInstruct | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 1 | # SwanLab Full-Featured DPO Training Example | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 141 | # Workspace for team collaboration (shared experiments) | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 161 | swanlab_completion_log_interval: 100 # Log every 100 steps | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 181 | # export SWANLAB_LARK_WEBHOOK_URL=https://open.feishu.cn/... | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 201 | # - Identify bottlenecks in training loop | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 221 | COMMENT | |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 241 | # Expected Training Behavior | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 261 | # INFO: Only rank 0 will initialize SwanLab | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 281 | # ============================================================================ | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 301 | # If SwanLab initialization fails: | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-full-featured.yml | 321 | # 1. Verify use_swanlab is true | COMMENT |
| LOW | examples/swanlab/lora-swanlab-profiling.yml | 1 | # SwanLab LoRA Training Example with Performance Profiling | COMMENT |
| LOW | examples/swanlab/lora-swanlab-profiling.yml | 101 | # ============================================================================ | COMMENT |
| LOW | examples/swanlab/lora-swanlab-profiling.yml | 121 | COMMENT | |
| LOW | examples/swanlab/lora-swanlab-profiling.yml | 141 | # Then compare profiling metrics in SwanLab dashboard to see performance impact | COMMENT |
| LOW | examples/swanlab/lora-swanlab-profiling.yml | 161 | # | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-completions.yml | 1 | # SwanLab DPO Training Example with Completion Logging | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-completions.yml | 101 | COMMENT | |
| LOW | examples/swanlab/dpo-swanlab-completions.yml | 121 | # View the table in SwanLab dashboard under "rlhf_completions" | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-completions.yml | 141 | # Get real-time training notifications in your team chat | COMMENT |
| LOW | examples/swanlab/dpo-swanlab-completions.yml | 161 | COMMENT | |
| LOW | src/axolotl/kernels/lora.py | 1061 | # Magnitude gradients: d_mag = sum_t(grad * combined) / weight_norm | COMMENT |
| LOW | src/axolotl/core/training_args_base.py | 201 | chat_template: Optional[str] = field( | COMMENT |
| LOW | src/axolotl/core/builders/base.py | 1 | # Copyright 2024 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/core/trainers/grpo/async_trainer.py | 1321 | # The design has two modes that have to be threaded carefully: | COMMENT |
| LOW | src/axolotl/core/trainers/grpo/fast_async_trainer.py | 1 | # Copyright 2020-2026 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/utils/lora.py | 1 | # Copyright 2025 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/utils/optimizers/sinkgd_triton.py | 1 | # Copyright 2026 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/utils/optimizers/sinkgd.py | 1 | # Copyright 2026 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/integrations/config.py | 1 | # Copyright 2024 Axolotl AI. All rights reserved. | COMMENT |
| LOW | src/axolotl/integrations/base.py | 1 | # Copyright 2024 Axolotl AI. All rights reserved. | COMMENT |
| LOW | …tl/integrations/nemo_gym/examples/nemo_gym_sudoku.yaml | 1 | # Axolotl + NeMo Gym: Sudoku RL Training Example | COMMENT |
| LOW | …ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml | 1 | # Axolotl + NeMo Gym: Multi-Turn Tool-Use RL Training Example | COMMENT |
| 40 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/e2e/multigpu/test_fsdp2.py | 0 | verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129m | STRING |
| HIGH | tests/e2e/multigpu/test_dist_muon_fsdp2.py | 0 | verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129m | STRING |
| HIGH | tests/e2e/multigpu/test_fsdp1.py | 0 | verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129m | STRING |
| HIGH | src/axolotl/cli/preprocess.py | 0 | parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: ad | STRING |
| HIGH | src/axolotl/cli/merge_sharded_fsdp_weights.py | 0 | parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: ad | STRING |
| HIGH | src/axolotl/cli/train.py | 0 | parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: ad | STRING |
| HIGH | src/axolotl/cli/evaluate.py | 0 | parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: ad | STRING |
| HIGH | src/axolotl/integrations/liger/models/qwen3_5.py | 0 | args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked | STRING |
| HIGH | src/axolotl/integrations/liger/models/qwen3_5_moe.py | 0 | args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked | STRING |
| HIGH | src/axolotl/integrations/liger/models/base.py | 0 | args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked | STRING |
| HIGH | src/axolotl/monkeypatch/models/qwen3/fused_attn.py | 0 | unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight. | STRING |
| HIGH | …c/axolotl/monkeypatch/models/qwen3_5_moe/fused_attn.py | 0 | unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight. | STRING |
| HIGH | src/axolotl/monkeypatch/models/qwen3_5/fused_attn.py | 0 | unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight. | STRING |
| HIGH | src/axolotl/monkeypatch/models/qwen3_moe/fused_attn.py | 0 | unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight. | STRING |
| HIGH | src/axolotl/prompt_strategies/bradley_terry/llama3.py | 0 | chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilab | STRING |
| HIGH | src/axolotl/prompt_strategies/dpo/chatml.py | 0 | chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilab | STRING |
| HIGH | src/axolotl/prompt_strategies/dpo/llama3.py | 0 | chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilab | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/conftest.py | 547 | # Create a temporary directory | COMMENT |
| MEDIUM⚡ | tests/test_packed_pretraining.py | 38 | # Create a list of 2000 random texts rather than just using it within the | COMMENT |
| MEDIUM⚡ | tests/test_packed_pretraining.py | 42 | # Create an IterableDataset | COMMENT |
| MEDIUM | tests/integrations/test_diffusion.py | 43 | # Create a minimal trainer instance just for testing methods | COMMENT |
| MEDIUM | tests/e2e/utils.py | 23 | # Create a temporary directory | COMMENT |
| MEDIUM | tests/e2e/kernels/test_lora.py | 42 | # Create main state with nested state | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 684 | # Create a new dataset with modified role names | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 758 | # Create a new dataset with the train and train_detail fields | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 1214 | # Create a situation where eot_tokens contains eos_token | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 1299 | # Create a non-existent token that definitely won't be in the template | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 1350 | # Create a custom chat template that uses our EOT token | COMMENT |
| MEDIUM | tests/prompt_strategies/test_chat_templates_advanced.py | 1425 | # Create a list to test different train_on_eot settings | COMMENT |
| MEDIUM | docs/scripts/generate_examples_docs.py | 83 | # Create a unique asset path based on source directory name | COMMENT |
| MEDIUM | scripts/cloud-entrypoint.sh | 21 | # Create the authorized_keys file if it doesn't exist | COMMENT |
| MEDIUM | scripts/cloud-entrypoint-term.sh | 17 | # Create the authorized_keys file if it doesn't exist | COMMENT |
| MEDIUM | src/axolotl/train.py | 195 | # Define the context managers to use | COMMENT |
| MEDIUM | src/axolotl/core/trainers/grpo/trainer.py | 245 | # Create the dataloader | COMMENT |
| MEDIUM | src/axolotl/utils/tokenization.py | 90 | # Create a delimiter based on text_only flag | COMMENT |
| MEDIUM | src/axolotl/utils/ctx_managers/sequence_parallel.py | 74 | # Create a boolean mask tensor for this rank's chunk | COMMENT |
| MEDIUM | src/axolotl/utils/ctx_managers/sequence_parallel.py | 224 | # Create a partially applied version of the apply_sequence_parallelism function | COMMENT |
| MEDIUM | src/axolotl/utils/schemas/utils.py | 31 | data = data.copy() # Create a copy to avoid modifying the original | CODE |
| MEDIUM | src/axolotl/utils/samplers/multipack.py | 100 | # Create a new bin if needed and if we haven't reached the limit | COMMENT |
| MEDIUM | src/axolotl/cli/delinearize_llama4.py | 117 | # Create a new state dict for the converted model | COMMENT |
| MEDIUM | src/axolotl/loaders/tokenizer.py | 54 | # Create the tokenizer directory in output_dir if it doesn't exist | COMMENT |
| MEDIUM | src/axolotl/monkeypatch/attention/flex_attn.py | 35 | # Create a new instance if one doesn't already exist | COMMENT |
| MEDIUM | …onkeypatch/models/mistral3/mistral_common_tokenizer.py | 22 | # Define the replacement | COMMENT |
| MEDIUM | src/axolotl/prompt_strategies/chat_template.py | 363 | # Create a new list to store tokens that should be kept | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | src/axolotl/core/trainers/grpo/__init__.py | 249 | Returns the reward function from the given fully qualified name, or the path to the reward function model. | STRING |
| HIGH | src/axolotl/utils/quantization.py | 61 | This function is used to build a post-training quantization config. Args: weight_dtype: The dtype to u | STRING |
| HIGH | src/axolotl/utils/schemas/utils.py | 9 | Handle backwards compatibility between legacy message field mapping and new property mapping system. Previousl | STRING |
| HIGH | src/axolotl/utils/chat_templates/base.py | 31 | Finds the correct chat_template based on the user's choice, jinja_template, and tokenizer. Args: user_ | STRING |
| HIGH | src/axolotl/utils/data/rl.py | 129 | Filter out samples that exceed maximum sequence length. Args: sample: Dataset sample to check. rl: | STRING |
| HIGH | src/axolotl/utils/data/rl.py | 186 | Check sequence length and raise ValueError if exceeded. Used as a filter function for ``excess_length_strategy: rai | STRING |
| HIGH | src/axolotl/cli/config.py | 97 | First, determines if the passed config is a valid HTTPS URL. Then, attempts to query for it and parse its conte | STRING |
| HIGH | src/axolotl/cli/config.py | 163 | Helper method for choosing a `axolotl` config YAML file (considering only files ending with `.yml` or `.yaml`). | STRING |
| HIGH | src/axolotl/cli/agent_docs/__init__.py | 84 | Return the content of an agent doc by topic name. Args: topic: One of the keys in TOPICS, or "overview" (de | STRING |
| HIGH | src/axolotl/integrations/base.py | 316 | Loads a plugin based on the given plugin name. The plugin name should be in the format "module_name.class_name". Th | STRING |
| HIGH | src/axolotl/integrations/expert_parallel/shard.py | 159 | Slice expert weights along dim 0 per the EP rank. Args: model: A built (but not yet FSDP-wrapped) HuggingFa | STRING |
| HIGH | src/axolotl/loaders/utils.py | 152 | Loads and configures a model configuration from HuggingFace or local sources. This function determines the appropri | STRING |
| HIGH | src/axolotl/monkeypatch/lora_kernels.py | 155 | Get the appropriate attention class by inspecting the model config. Uses dynamic import to support any model ar | STRING |
| HIGH | src/axolotl/monkeypatch/lora_kernels.py | 461 | Applies optimized Triton kernel patches to a PEFT model. Patches a PEFT model with optimized implementations f | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL⚡ | src/axolotl/integrations/kernels/autotune_callback.py | 56 | props = triton.runtime.driver.active.utils.get_device_properties(idx) | CODE |
| CRITICAL⚡ | …tions/kernels/libs/scattermoe_lora/kernels/lora_ops.py | 190 | props = triton.runtime.driver.active.utils.get_device_properties( | CODE |
| CRITICAL | src/axolotl/integrations/kernels/libs/dsv4/attention.py | 50 | return triton.runtime.driver.active.utils.get_device_properties(dev)[ | CODE |
| CRITICAL | …axolotl/integrations/kernels/libs/glm_dsa/_autotune.py | 21 | props = triton.runtime.driver.active.utils.get_device_properties(dev) | CODE |
| CRITICAL | src/axolotl/monkeypatch/attention/xformers.py | 72 | xformers.ops.fmha.attn_bias.BlockDiagonalCausalMask.from_seqlens( | CODE |
| CRITICAL | src/axolotl/monkeypatch/attention/xformers.py | 94 | attn_bias = xformers.ops.fmha.attn_bias.BlockDiagonalCausalMask.from_seqlens( | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | pyproject.toml | 62 | # lm eval harness | COMMENT |
| MEDIUM⚡ | …ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py | 296 | # Timing harness | COMMENT |
| MEDIUM⚡ | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 181 | # 2. Memory bound across skew (THE skew guard) — a robust op's peak must NOT scale with routing | COMMENT |
| MEDIUM⚡ | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 183 | # BALANCED peak (scale-robust, no magic absolute). A capacity-padded impl (cap=max) blows up at | COMMENT |
| MEDIUM⚡ | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 212 | # robust: skew peak within 1.5x of balanced. capacity-padded all_to_one is many x -> fails. | COMMENT |
| MEDIUM⚡ | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 229 | # cap this process to a fraction that comfortably fits the robust path but not an E*cap blowup | COMMENT |
| MEDIUM⚡ | …tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py | 234 | ) # robust needs ~12x routed + model; blowup needs ~Ex more | CODE |
| MEDIUM | examples/archived/xgen-7b/xgen-7b-8k-qlora.yml | 31 | # "We find hyperparameters to be largely robust across datasets" | COMMENT |
| MEDIUM | examples/archived/falcon/config-7b-qlora.yml | 33 | # "We find hyperparameters to be largely robust across datasets" | COMMENT |
| MEDIUM | .github/workflows/tests-nightly.yml | 5 | # to this file or the cicd/ harness. | COMMENT |
| LOW | src/axolotl/cli/utils/sweeps.py | 61 | # If no paired values, just use regular combinations | COMMENT |
| MEDIUM | …ions/kernels/libs/scattermoe_lora/nvfp4_moe_loading.py | 96 | # robust NVFP4 signal (uint8 qdata) — distinguishing NVFP4 from FP8 (which also carries a | COMMENT |
| MEDIUM | …tions/kernels/libs/scattermoe_lora/kernels/lora_ops.py | 2554 | (128, 32, 64, 8, 3), # robust fallback within the stock search space | CODE |
| MEDIUM | …/axolotl/integrations/kernels/libs/glm_dsa/dispatch.py | 1 | """Length-aware dispatch for GLM-5.2 DSA attention — robust across short and long sequences. | STRING |
| LOW | src/axolotl/integrations/kd/collator.py | 211 | # just pass straight to parent. | COMMENT |
| LOW | src/axolotl/prompt_strategies/chat_template.py | 643 | # grid info, etc.); just set the fields we computed locally. | COMMENT |
| LOW | src/axolotl/prompt_strategies/ebft/ebft_strided_chat.py | 20 | # For preview: just return the first user message | COMMENT |
| MEDIUM | src/axolotl/prompt_strategies/ebft/ebft_reasoning.py | 280 | # directly in the input_ids (robust to tokenization alignment). | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ions/kernels/scattermoe_lora/test_mxfp4_integration.py | 225 | CODE | |
| LOW | tests/e2e/integrations/test_scattermoe_lora_kernels.py | 182 | CODE | |
| LOW | tests/e2e/integrations/test_scattermoe_lora_kernels.py | 1573 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 53 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 758 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 805 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 881 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 1165 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 1218 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 1255 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 1308 | CODE | |
| LOW | src/axolotl/processing_strategies.py | 1361 | CODE | |
| LOW | src/axolotl/kernels/lora.py | 762 | CODE | |
| LOW | src/axolotl/kernels/lora.py | 818 | CODE | |
| LOW | src/axolotl/kernels/lora.py | 1781 | CODE | |
| LOW | src/axolotl/core/trainers/grpo/async_trainer.py | 2872 | CODE | |
| LOW | src/axolotl/core/trainers/grpo/trainer.py | 86 | CODE | |
| LOW | src/axolotl/utils/ctx_managers/sequence_parallel.py | 416 | CODE | |
| LOW | src/axolotl/utils/optimizers/sinkgd_triton.py | 381 | CODE | |
| LOW | src/axolotl/utils/optimizers/adopt.py | 40 | CODE | |
| LOW | src/axolotl/utils/optimizers/sinkgd.py | 249 | CODE | |
| LOW | src/axolotl/utils/samplers/multipack.py | 257 | CODE | |
| LOW | src/axolotl/utils/mistral/mistral_tokenizer.py | 182 | CODE | |
| LOW | src/axolotl/models/mamba/configuration_mamba.py | 15 | CODE | |
| LOW | src/axolotl/cli/chat.py | 847 | CODE | |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1480 | CODE | |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1744 | CODE | |
| LOW | …s/kernels/libs/scattermoe_lora/parallel_linear_lora.py | 569 | CODE | |
| LOW | …l/integrations/kernels/libs/scattermoe_lora/experts.py | 371 | CODE | |
| LOW | …l/integrations/kernels/libs/scattermoe_lora/experts.py | 600 | CODE | |
| LOW | …els/libs/scattermoe_lora/cutlass_fp4/grouped_kernel.py | 1426 | CODE | |
| LOW | src/axolotl/integrations/lm_eval/cli.py | 31 | CODE | |
| LOW | src/axolotl/integrations/kd/chat_template.py | 34 | CODE | |
| LOW | src/axolotl/integrations/kd/kernels/liger.py | 120 | CODE | |
| LOW | src/axolotl/integrations/kd/kernels/liger.py | 180 | CODE | |
| LOW | src/axolotl/integrations/kd/kernels/liger.py | 429 | CODE | |
| LOW | src/axolotl/integrations/diffusion/generation.py | 15 | CODE | |
| LOW | src/axolotl/integrations/diffusion/generation.py | 318 | CODE | |
| LOW | src/axolotl/integrations/liger/models/jamba.py | 19 | CODE | |
| LOW | src/axolotl/integrations/liger/models/qwen3_5.py | 15 | CODE | |
| LOW | src/axolotl/integrations/liger/models/deepseekv2.py | 15 | CODE | |
| LOW | src/axolotl/integrations/liger/models/qwen3_5_moe.py | 14 | CODE | |
| LOW | src/axolotl/monkeypatch/stablelm_attn_hijack_flash.py | 247 | CODE | |
| LOW | src/axolotl/monkeypatch/attention/xformers.py | 19 | CODE | |
| LOW | src/axolotl/monkeypatch/models/qwen3_next/modeling.py | 275 | CODE | |
| LOW | src/axolotl/monkeypatch/models/voxtral/modeling.py | 18 | CODE | |
| LOW | …l/monkeypatch/models/kimi_linear/configuration_kimi.py | 17 | CODE | |
| LOW | …xolotl/monkeypatch/models/kimi_linear/modeling_kimi.py | 1285 | CODE | |
| LOW | src/axolotl/monkeypatch/models/falcon_h1/modeling.py | 302 | CODE | |
| LOW | src/axolotl/monkeypatch/ring_attn/patch.py | 56 | CODE | |
| LOW | src/axolotl/monkeypatch/ring_attn/adapters/batch.py | 61 | CODE | |
| LOW | src/axolotl/prompt_strategies/chat_template.py | 42 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | src/axolotl/core/builders/__init__.py | 6 | __all__ = ["HFCausalTrainerBuilder", "HFRLTrainerBuilder"] | CODE |
| LOW | src/axolotl/core/trainers/__init__.py | 10 | __all__ = [ | CODE |
| LOW | src/axolotl/core/trainers/grpo/async_trainer.py | 615 | def set_trainer(self, trainer) -> None: | CODE |
| LOW | src/axolotl/core/trainers/grpo/sampler.py | 166 | def set_epoch(self, epoch: int) -> None: | CODE |
| LOW | src/axolotl/utils/optimizers/adopt.py | 36 | __all__ = ["ADOPT", "adopt"] | CODE |
| LOW | src/axolotl/utils/chat_templates/__init__.py | 14 | __all__ = [ | CODE |
| LOW | src/axolotl/utils/data/__init__.py | 14 | __all__ = [ | CODE |
| LOW | src/axolotl/utils/mistral/__init__.py | 6 | __all__ = ["HFMistralTokenizer", "Mistral3Processor"] | CODE |
| LOW | src/axolotl/utils/generation/__init__.py | 5 | __all__ = ["generate_samples", "format_generation_for_logging"] | CODE |
| LOW | src/axolotl/utils/collators/__init__.py | 12 | __all__ = [ | CODE |
| LOW | src/axolotl/cli/utils/__init__.py | 15 | __all__ = [ | CODE |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1140 | def _update_config_vocab_size(output_path: Path, vocab_size: int) -> None: | CODE |
| LOW | src/axolotl/integrations/nemo_gym/__init__.py | 20 | __all__ = [ | CODE |
| LOW | src/axolotl/integrations/kernels/__init__.py | 4 | __all__ = [ | CODE |
| LOW | …/integrations/kernels/libs/scattermoe_lora/__init__.py | 10 | __all__ = [ | CODE |
| LOW⚡ | …tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py | 26 | def set_chunk_size_override(n) -> None: | CODE |
| LOW⚡ | …tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py | 30 | def set_layer_gc_active(flag) -> None: | CODE |
| LOW⚡ | …tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py | 34 | def set_bnb_fast(flag) -> None: | CODE |
| LOW | …grations/kernels/libs/scattermoe_lora/grouped_train.py | 36 | def set_grouped_backend_override(backend) -> None: | CODE |
| LOW | …tions/kernels/libs/scattermoe_lora/kernels/__init__.py | 12 | __all__ = ["ops", "lora_ops"] | CODE |
| LOW | src/axolotl/integrations/kernels/libs/dsv4/__init__.py | 11 | __all__ = [ | CODE |
| LOW | …/axolotl/integrations/kernels/libs/glm_dsa/__init__.py | 15 | __all__ = [ | CODE |
| LOW | …axolotl/integrations/kernels/libs/sonicmoe/__init__.py | 24 | __all__ = [ | CODE |
| LOW | …/axolotl/integrations/kernels/libs/sonicmoe/experts.py | 296 | __all__ = [ | CODE |
| LOW | src/axolotl/integrations/kd/kernels/__init__.py | 7 | __all__ = ["LigerFusedLinearKLTopKLogprobLoss"] | CODE |
| LOW | src/axolotl/integrations/diffusion/__init__.py | 10 | __all__ = [ | CODE |
| LOW | src/axolotl/integrations/diffusion/callbacks.py | 14 | logger = logging.getLogger(__name__) | CODE |
| LOW | src/axolotl/integrations/densemixer/__init__.py | 5 | __all__ = ["DenseMixerPlugin"] | CODE |
| LOW | src/axolotl/integrations/hatchery/__init__.py | 15 | __all__ = ["HatcheryArgs", "HatcheryConfig", "HatcheryPlugin"] | CODE |
| LOW | src/axolotl/integrations/swanlab/__init__.py | 6 | __all__ = ["SwanLabConfig", "SwanLabPlugin"] | CODE |
| LOW | src/axolotl/integrations/liger/__init__.py | 25 | __all__ = [ | CODE |
| LOW | src/axolotl/integrations/llm_compressor/__init__.py | 5 | __all__ = ["LLMCompressorPlugin"] | CODE |
| LOW | src/axolotl/integrations/mora/__init__.py | 6 | __all__ = ["MoraArgs", "MoraConfig", "MoraPlugin", "MoraType"] | CODE |
| LOW | src/axolotl/integrations/expert_parallel/experts_fn.py | 34 | def set_token_capacity(cap: int | None) -> None: | CODE |
| LOW | src/axolotl/integrations/expert_parallel/experts_fn.py | 79 | def set_valid_token_mask(mask: torch.Tensor | None) -> None: | CODE |
| LOW | src/axolotl/integrations/expert_parallel/__init__.py | 23 | __all__ = [ | CODE |
| LOW | src/axolotl/loaders/__init__.py | 9 | __all__ = [ | CODE |
| LOW | src/axolotl/monkeypatch/gemma4_hybrid_mask.py | 60 | def set_flash_d512(enabled: bool) -> None: | CODE |
| LOW | src/axolotl/monkeypatch/attention/large_head.py | 28 | def set_large_head_policy(policy: str | None) -> None: | CODE |
| LOW | src/axolotl/monkeypatch/attention/large_head.py | 33 | def set_large_head_packed(packed: bool | None) -> None: | CODE |
| LOW | src/axolotl/monkeypatch/tiled_mlp/__init__.py | 10 | __all__ = [ | CODE |
| LOW | src/axolotl/monkeypatch/trainer/__init__.py | 3 | __all__ = ["entropy_from_logits", "selective_log_softmax"] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | src/axolotl/core/trainers/grpo/async_trainer.py | 803 | VLLMGeneration._init_vllm = _orig_init_vllm # type: ignore[possibly-undefined] | CODE |
| HIGH | src/axolotl/utils/schemas/config.py | 888 | "flash_attn dependency. Left unset (null) it auto-enables when supported (torch >= " | CODE |
| HIGH | src/axolotl/cli/config_options.py | 2321 | "With sample packing + attn_implementation=sdpa, route packed rows through torch.nn.attention.varlen.varlen_attn | CODE |
| HIGH | src/axolotl/cli/cloud/modal_.py | 116 | f"RUN cd /workspace/axolotl && git fetch && git checkout {self.config.branch} && git pull", | CODE |
| HIGH | src/axolotl/integrations/nemo_gym/server.py | 69 | ["bash", "-c", "source .venv/bin/activate && uv sync"], | CODE |
| HIGH | src/axolotl/integrations/kd/kernels/liger.py | 36 | 0.0 for Forward KL (P_teacher || P_student). | STRING |
| HIGH | src/axolotl/integrations/kd/kernels/liger.py | 37 | 1.0 for Reverse KL (P_student || P_teacher). | STRING |
| HIGH | src/axolotl/integrations/cut_cross_entropy/__init__.py | 38 | '`pip uninstall -y cut-cross-entropy && pip install "cut-cross-entropy[transformers] @ git+https://github.com/axolot | CODE |
| HIGH | …xolotl/monkeypatch/models/kimi_linear/modeling_kimi.py | 45 | "Plese run `pip uninstall fla-core flash-linear-attention -y && pip install git+https://github.com/fla-org/flash | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_processing_strategies.py | 56 | # Generic fake tokenizer/processor scaffold | COMMENT |
| MEDIUM | examples/ebft/llama-1b-ebft-strided.yaml | 12 | context_length: 8 # context window per block | CODE |
| MEDIUM | examples/ebft/llama-1b-ebft-strided-structured.yaml | 12 | context_length: 8 # context window per block | CODE |
| MEDIUM | examples/ebft/README.md | 100 | context_length: 8 # context window per block (paper default: 8) | CODE |
| MEDIUM | examples/mistral-medium-3_5/README.md | 3 | [Mistral Medium 3.5](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B) is a 128B parameter dense multimodal mode | CODE |
| MEDIUM | src/axolotl/core/trainers/ebft/strided.py | 153 | # Rule 1: Generated token attends to its context window in the prompt | COMMENT |
| MEDIUM | src/axolotl/core/trainers/ebft/strided.py | 917 | # Last token of the context window predicts the first rollout token | COMMENT |
| MEDIUM | src/axolotl/integrations/nemo_gym/README.md | 77 | # Agent server (orchestrates multi-turn via /run) | COMMENT |
| MEDIUM | …ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml | 4 | # using NeMo Gym's agentic environments. The model generates responses, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .runpod/src/config/config.yaml | 65 | # # HuggingFace dataset repo | s3://,gs:// path | "json" for local dataset, make sure to fill data_files | COMMENT |
| LOW | src/axolotl/utils/callbacks/profiler.py | 89 | # make sure to record if we happen to have more steps than steps to profile | COMMENT |
| LOW | src/axolotl/cli/utils/train.py | 187 | # make sure to flush stdout and stderr before replacing the process | COMMENT |
| LOW | src/axolotl/cli/utils/train.py | 213 | # make sure to flush stdout and stderr before replacing the process | COMMENT |
| LOW | src/axolotl/integrations/kd/collator_online_teacher.py | 531 | # TODO make sure to figure out which input in sub_batch_features to update the batch in the original | COMMENT |
| LOW | src/axolotl/integrations/liger/models/jamba.py | 146 | ) # make sure to reside in the same device | CODE |
| MEDIUM | src/axolotl/prompt_strategies/context_qa.py | 107 | "Therefore, I'm unable to answer your question based on the given context.", | CODE |
| MEDIUM | src/axolotl/prompt_strategies/creative_acr.py | 33 | refusal: whether the Response refuses to answer the Question. Responses containing language similar to "As an AI languag | CODE |
| MEDIUM | src/axolotl/prompt_strategies/creative_acr.py | 90 | refusal: whether the Response refuses to answer the Question. Responses containing language similar to "As an AI languag | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 139 | # Step 5 - shouldn't check (not divisible by 10) | COMMENT |
| LOW | tests/utils/callbacks/test_dynamic_checkpoint.py | 145 | # Step 10 - should check | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1614 | # Step 1: Fuse — MergeModulelist (stack experts) per source pattern | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1660 | # Step 2: Build the fused key name and merge LoRA | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1728 | # Step 3: Save in fused format (runtime format) so that the merged | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1968 | # Step 0: dequantize quantized weights so the LoRA delta folds into the TRUE weight (a raw read | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1983 | # Step 1: Handle fused weight conversions (MoE experts) if applicable | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 2004 | # Step 2: Merge remaining (non-fused) tensors with LoRA | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | src/axolotl/cli/utils/lora_merge.py | 1614 | # Step 1: Fuse — MergeModulelist (stack experts) per source pattern | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1660 | # Step 2: Build the fused key name and merge LoRA | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1728 | # Step 3: Save in fused format (runtime format) so that the merged | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1968 | # Step 0: dequantize quantized weights so the LoRA delta folds into the TRUE weight (a raw read | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 1983 | # Step 1: Handle fused weight conversions (MoE experts) if applicable | COMMENT |
| LOW | src/axolotl/cli/utils/lora_merge.py | 2004 | # Step 2: Merge remaining (non-fused) tensors with LoRA | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …tl/integrations/nemo_gym/examples/nemo_gym_sudoku.yaml | 11 | # Usage: | COMMENT |
| LOW | …ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml | 15 | # Usage: | COMMENT |
| LOW | …integrations/nemo_gym/examples/nemo_gym_multi_env.yaml | 12 | # Usage: | COMMENT |
| LOW | src/axolotl/integrations/hatchery/__init__.py | 17 | # Usage: | COMMENT |
| LOW | …axolotl/integrations/hatchery/examples/tinker_sft.yaml | 3 | # Usage: | COMMENT |
| LOW | src/axolotl/loaders/tokenizer.py | 291 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_data.py | 40 | "lorem ipsum dolor sit amet.", | CODE |
| LOW | tests/test_data.py | 40 | "lorem ipsum dolor sit amet.", | CODE |
| LOW | tests/test_prompt_tokenizers.py | 75 | "instruction": "hello cruel. lorem ipsum dolor sit amet.", | CODE |
| LOW | tests/test_prompt_tokenizers.py | 75 | "instruction": "hello cruel. lorem ipsum dolor sit amet.", | CODE |
| LOW⚡ | src/axolotl/utils/data/sft.py | 255 | f.write("lorem ipsum dolor sit amet\n") | CODE |
| LOW⚡ | src/axolotl/utils/data/sft.py | 255 | f.write("lorem ipsum dolor sit amet\n") | CODE |
| LOW | src/axolotl/integrations/nemo_gym/README.md | 72 | api_key: dummy_key | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | README.md | 175 | - [API Reference](https://docs.axolotl.ai/docs/api/) - Auto-generated code documentation | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | src/axolotl/models/mamba/modeling_mamba.py | 89 | CODE | |
| MEDIUM | src/axolotl/models/mamba/modeling_mamba.py | 90 | CODE |