Repository Analysis

axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

20.8 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of axolotl-ai-cloud/axolotl, a Python project with 12,195 GitHub stars. SynthScan v2.0 examined 247,275 lines of code across 1305 source files, recording 3651 pattern matches distributed across 24 syntactic categories. The overall adjusted score of 20.8 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

20.8
Adjusted Score
20.8
Raw Score
100%
Time Factor
2026-07-13
Last Push
12.2K
Stars
Python
Language
247.3K
Lines of Code
1.3K
Files
3.7K
Pattern Hits
2026-07-14
Scan Date
0.05
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 6HIGH 64MEDIUM 475LOW 3106

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 3651 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers2131 hits · 2157 pts
SeverityFileLineSnippetContext
LOWtests/test_glm_dsa_cp_validation.py29def test_config_validation_recovers_inherited_defaults():CODE
LOWtests/test_glm_dsa_cp_validation.py48def test_config_validation_recovers_known_none_defaults():CODE
LOWtests/test_glm_dsa_cp_validation.py64def test_config_validation_retry_accepts_field_names():CODE
LOWtests/test_glm_dsa_cp_validation.py85 def test_dsa_cp_skips_flash_and_ring_requirement(self, monkeypatch):CODE
LOWtests/test_glm_dsa_cp_validation.py100 def test_cp_without_dsa_still_requires_flash(self, monkeypatch):CODE
LOWtests/test_glm_dsa_cp_validation.py107 def test_dsa_without_cp_leaves_ring_attn_func_none(self, monkeypatch):CODE
LOWtests/test_empty_tokenization.py32def test_metharme_tokenize_empty_does_not_crash(no_bos_tokenizer):CODE
LOWtests/test_empty_tokenization.py38def test_reflection_tokenize_empty_does_not_crash(no_bos_tokenizer):CODE
LOWtests/test_fp32_norms.py53def test_suffix_matches_multiple_norm_families():CODE
LOWtests/test_fp32_norms.py60def test_suffix_does_not_match_non_norm_modules():CODE
LOWtests/test_fp32_norms.py67def test_explicit_classname_matches_custom_norm():CODE
LOWtests/test_fp32_norms.py71def test_fully_qualified_pattern_matches_exact_path():CODE
LOWtests/test_fp32_norms.py77def test_mixed_patterns_suffix_and_qualified():CODE
LOWtests/test_fp32_norms.py107def test_meta_device_is_supported(monkeypatch):CODE
LOWtests/test_fp32_norms.py128def test_passthrough_fully_shard_kwargs_are_used(monkeypatch):CODE
LOWtests/test_fp32_norms.py159def test_no_matches_warns_and_returns_zero(caplog):CODE
LOWtests/test_fp32_norms.py177def test_explicit_classes_override_defaults(monkeypatch):CODE
LOWtests/test_utils_tee.py25def test_file_only_stream_writes_after_prepare(monkeypatch):CODE
LOWtests/test_utils_tee.py50def test_stdout_is_mirrored_after_prepare(capsys, monkeypatch):CODE
LOWtests/test_utils_tee.py72def test_truncate_vs_append_behavior(monkeypatch):CODE
LOWtests/test_vectorized_scanner.py81 def test_longest_prefix_wins_at_same_position(self):CODE
LOWtests/test_vectorized_scanner.py94 def test_pixtral_shared_end_marker_rewind(self):CODE
LOWtests/test_vectorized_scanner.py144 def test_train_on_eos_last_only_final_turn_unmasked(self):CODE
LOWtests/test_vectorized_scanner.py153 def test_empty_end_tokens_runs_to_eos(self):CODE
LOWtests/test_vectorized_scanner.py172 def test_non_trainable_role_end_marker_leak_gate(self):CODE
LOWtests/test_vectorized_scanner.py194 def test_non_trainable_role_include_end_false_no_leak(self):CODE
LOWtests/test_vectorized_scanner.py213 def test_truncated_final_turn_no_end(self):CODE
LOWtests/test_vectorized_scanner.py235 def test_empty_roles_to_train_masks_all(self):CODE
LOWtests/test_vectorized_scanner.py242 def test_adversarial_first_token_collision(self):CODE
LOWtests/test_vectorized_scanner.py416def test_catalog_smoke_per_shape(shape_name):CODE
LOWtests/test_vectorized_scanner.py484 def test_back_to_back_user_assistant_pairs(self):CODE
LOWtests/test_vectorized_scanner.py530 def test_user_with_no_end_then_assistant(self):CODE
LOWtests/test_vectorized_scanner.py548def _build_long_multi_end_sequence(CODE
LOWtests/test_vectorized_scanner.py598def test_bisect_first_end_in_span_explicit():CODE
LOWtests/test_vectorized_scanner.py611def test_differential_fuzz_long_spans():CODE
LOWtests/conftest.py261# def download_fozzie_alpaca_dpo_dataset():COMMENT
LOWtests/conftest.py163def download_tiny_llama_model():CODE
LOWtests/conftest.py168def download_tiny_mistral_model():CODE
LOWtests/conftest.py173def download_tiny_mixtral_model():CODE
LOWtests/conftest.py183def download_tiny_falcon_model():CODE
LOWtests/conftest.py237def download_argilla_distilabel_intel_orca_dpo_dataset():CODE
LOWtests/conftest.py245def download_argilla_ultrafeedback_binarized_preferences_cleaned_dataset():CODE
LOWtests/conftest.py253def download_argilla_ultrafeedback_binarized_preferences_cleaned_kto_dataset():CODE
LOWtests/conftest.py275# def dataset_fozzie_alpaca_dpo_dataset(COMMENT
LOWtests/conftest.py292def download_arcee_ai_distilabel_intel_orca_dpo_pairs_dataset():CODE
LOWtests/conftest.py300def download_argilla_dpo_pairs_dataset():CODE
LOWtests/conftest.py308def download_tiny_shakespeare_dataset():CODE
LOWtests/conftest.py314def download_evolkit_kd_sample_dataset():CODE
LOWtests/conftest.py322def download_deepseek_model_fixture():CODE
LOWtests/conftest.py327def download_huggyllama_model_fixture():CODE
LOWtests/conftest.py28def _apply_transformers_test_shims():CODE
LOWtests/conftest.py70def pytest_runtest_makereport(item, call): # pylint: disable=unused-argumentCODE
LOWtests/conftest.py88def retry_on_request_exceptions(max_retries=3, delay=1):CODE
LOWtests/conftest.py112def snapshot_download_w_retry(*args, **kwargs):CODE
LOWtests/conftest.py131def download_ds_fixture_bundle():CODE
LOWtests/conftest.py203def download_tatsu_lab_alpaca_dataset():CODE
LOWtests/conftest.py490def tokenizer_huggyllama_w_special_tokens(CODE
LOWtests/conftest.py656def dataset_winglian_tiny_shakespeare(CODE
LOWtests/conftest.py686def dataset_argilla_ultrafeedback_binarized_preferences_cleaned(CODE
LOWtests/test_tokenizers.py44 def test_special_tokens_modules_to_save(self):CODE
2071 more matches not shown…
Decorative Section Separators403 hits · 1361 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_ebft_kernels.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py98# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py100# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py164# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py166# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py237# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ebft_kernels.py239# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py23# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py25# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py174# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py176# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py371# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py373# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py48# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py291# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_triton_kernels.py293# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py17# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py19# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py111# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_http_weight_sync.py113# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py173# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py175# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py444# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py446# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py22# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py24# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py118# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py120# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py498# ============================================================================COMMENT
MEDIUMtests/integrations/test_gemma4_moe.py500# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py45# ─── Helpers ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py121# ─── Model shape configs ────────────────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py139# ─── Forward tests ──────────────────────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py186# ─── Backward dX tests ──────────────────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py220# ─── Backward LoRA gradient tests ───────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora_kernels.py291# ─── Full autograd tests ────────────────────────────────────────────────────COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py24# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py26# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py272# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py274# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py306# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py308# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py652# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py654# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py204# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py206# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py346# ============================================================================COMMENT
MEDIUMtests/integrations/test_scattermoe_lora.py348# ============================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py12# ---------------------------------------------------------------------------COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py14# ---------------------------------------------------------------------------COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py81# =========================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py83# =========================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py207# =========================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py209# =========================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py381# =========================================================================COMMENT
MEDIUM…sts/integrations/test_scattermoe_autotune_telemetry.py383# =========================================================================COMMENT
343 more matches not shown…
Unused Imports284 hits · 282 pts
SeverityFileLineSnippetContext
LOWtests/test_fp32_norms.py3CODE
LOWtests/test_vectorized_scanner.py21CODE
LOWtests/test_process_labels_fusion.py9CODE
LOWtests/test_mm_collator_warnings.py3CODE
LOWtests/test_no_legacy_attn_reads.py8CODE
LOWtests/utils/test_cuda13.py3CODE
LOWtests/integrations/test_gemma4_moe.py451CODE
LOW…rnels/scattermoe_lora/test_scattermoe_lora_m_bucket.py22CODE
LOWtests/integrations/kernels/scattermoe_lora/conftest.py19CODE
LOW…/scattermoe_lora/test_scattermoe_lora_int64_indices.py33CODE
LOW…ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py25CODE
LOW…ns/kernels/scattermoe_lora/test_nvfp4_fsdp_sharding.py30CODE
LOW…ons/kernels/scattermoe_lora/test_grouped_fp4_guards.py14CODE
LOW…grations/kernels/scattermoe_lora/bench_int64_kernel.py26CODE
LOW…kernels/scattermoe_lora/test_nvfp4_weight_converter.py22CODE
LOW…rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py30CODE
LOW…ions/kernels/scattermoe_lora/test_grouped_fp4_train.py23CODE
LOW…termoe_lora/test_parallel_experts_large_batch_repro.py32CODE
LOW…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py15CODE
LOW…/scattermoe_lora/test_gates_backward_autocast_dtype.py13CODE
LOW…tions/kernels/scattermoe_lora/test_grouped_fp4_perf.py23CODE
LOW…els/scattermoe_lora/test_grouped_fp4_weight_scale_2.py24CODE
LOW…s/integrations/kernels/dsv4/test_dsv4_attention_ops.py36CODE
LOWtests/e2e/multigpu/test_fsdp2_fp32_norms.py11CODE
LOWtests/e2e/multigpu/_fp32_norms_dtype_capture.py9CODE
LOWtests/monkeypatch/test_float8_fsdp_sharding.py20CODE
LOWtests/prompt_strategies/test_chat_templates_mistral.py9CODE
LOWsrc/axolotl/train.py3CODE
LOWsrc/axolotl/train.py46CODE
LOWsrc/axolotl/train.py46CODE
LOWsrc/axolotl/kernels/op_registry.py10CODE
LOWsrc/axolotl/core/training_args.py5CODE
LOWsrc/axolotl/core/builders/__init__.py3CODE
LOWsrc/axolotl/core/builders/__init__.py4CODE
LOWsrc/axolotl/core/trainers/__init__.py7CODE
LOWsrc/axolotl/core/trainers/base.py3CODE
LOW…olotl/core/trainers/mixins/activation_checkpointing.py48CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py5CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py6CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py7CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py8CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py9CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py10CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py11CODE
LOWsrc/axolotl/core/trainers/mixins/__init__.py12CODE
LOWsrc/axolotl/core/trainers/ebft/strided.py24CODE
LOWsrc/axolotl/core/trainers/ebft/strided.py24CODE
LOWsrc/axolotl/core/trainers/ebft/strided.py24CODE
LOWsrc/axolotl/core/trainers/ebft/strided.py24CODE
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py24CODE
LOWsrc/axolotl/core/trainers/grpo/trainer.py54CODE
LOWsrc/axolotl/utils/tee.py6CODE
LOWsrc/axolotl/utils/cuda13.py3CODE
LOWsrc/axolotl/utils/fp32_norms.py3CODE
LOWsrc/axolotl/utils/ctx_managers/__init__.py5CODE
LOWsrc/axolotl/utils/callbacks/swanlab.py3CODE
LOWsrc/axolotl/utils/callbacks/__init__.py3CODE
LOWsrc/axolotl/utils/callbacks/comet_.py12CODE
LOWsrc/axolotl/utils/callbacks/lisa.py18CODE
LOWsrc/axolotl/utils/callbacks/mlflow_.py15CODE
224 more matches not shown…
Deep Nesting241 hits · 224 pts
SeverityFileLineSnippetContext
LOW.runpod/src/utils.py40CODE
LOW.runpod/src/utils.py59CODE
LOWtests/test_vectorized_scanner.py364CODE
LOWtests/test_vectorized_scanner.py548CODE
LOWtests/test_process_labels_fusion.py232CODE
LOWtests/test_weighted_loss.py15CODE
LOWtests/core/test_async_grpo.py275CODE
LOWtests/utils/callbacks/test_dynamic_checkpoint.py178CODE
LOWtests/utils/callbacks/test_dynamic_checkpoint.py215CODE
LOWtests/utils/callbacks/test_dynamic_checkpoint.py255CODE
LOWtests/utils/callbacks/test_dynamic_checkpoint.py301CODE
LOWtests/utils/lora/test_merge_lora.py1832CODE
LOW…ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py331CODE
LOW…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py55CODE
LOWtests/e2e/multigpu/solo/test_grpo.py25CODE
LOWtests/monkeypatch/test_gemma4_unified_fused_attn.py25CODE
LOWtests/prompt_strategies/test_chat_templates_advanced.py728CODE
LOWtests/prompt_strategies/test_chat_templates_advanced.py1409CODE
LOWdocs/scripts/generate_examples_docs.py94CODE
LOWdocs/scripts/generate_examples_docs.py215CODE
LOWdocs/scripts/generate_examples_docs.py286CODE
LOWdocs/scripts/generate_examples_docs.py107CODE
LOWdocs/scripts/generate_config_docs.py50CODE
LOWdocs/scripts/generate_config_docs.py126CODE
LOWdocs/scripts/generate_config_docs.py263CODE
LOWdocs/scripts/generate_config_docs.py438CODE
LOWdocs/scripts/generate_config_docs.py591CODE
LOWscripts/analyze_profile.py338CODE
LOWscripts/analyze_profile.py565CODE
LOWscripts/analyze_profile.py651CODE
LOWscripts/analyze_profile.py774CODE
LOWscripts/analyze_profile.py888CODE
LOWscripts/analyze_profile.py975CODE
LOWscripts/analyze_profile.py1079CODE
LOWscripts/analyze_profile.py1338CODE
LOWsrc/axolotl/processing_strategies.py393CODE
LOWsrc/axolotl/processing_strategies.py510CODE
LOWsrc/axolotl/processing_strategies.py695CODE
LOWsrc/axolotl/processing_strategies.py176CODE
LOWsrc/axolotl/prompters.py48CODE
LOWsrc/axolotl/train.py254CODE
LOWsrc/axolotl/train.py415CODE
LOWsrc/axolotl/kernels/autotune_telemetry.py46CODE
LOWsrc/axolotl/core/chat/messages.py134CODE
LOWsrc/axolotl/core/builders/rl.py39CODE
LOWsrc/axolotl/core/builders/rl.py101CODE
LOWsrc/axolotl/core/builders/causal.py467CODE
LOWsrc/axolotl/core/builders/base.py292CODE
LOWsrc/axolotl/core/builders/base.py570CODE
LOWsrc/axolotl/core/builders/base.py293CODE
LOWsrc/axolotl/core/trainers/utils.py22CODE
LOWsrc/axolotl/core/trainers/utils.py38CODE
LOW…olotl/core/trainers/mixins/activation_checkpointing.py153CODE
LOWsrc/axolotl/core/trainers/mixins/layer_offloading.py24CODE
LOWsrc/axolotl/core/trainers/mixins/optimizer.py22CODE
LOWsrc/axolotl/core/trainers/mixins/optimizer.py107CODE
LOWsrc/axolotl/core/trainers/mixins/scheduler.py27CODE
LOWsrc/axolotl/core/trainers/ebft/__init__.py79CODE
LOWsrc/axolotl/core/trainers/ebft/trainer.py144CODE
LOWsrc/axolotl/core/trainers/ebft/trainer.py186CODE
181 more matches not shown…
Excessive Try-Catch Wrapping169 hits · 190 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_attn_implementation.py44def _xformers_available():CODE
LOWtests/test_attn_implementation.py62 except Exception: # pylint: disable=broad-exceptCODE
LOWtests/core/test_builders.py266 except Exception:CODE
LOWtests/utils/lora/test_merge_lora.py1541 except Exception: # pragma: no coverCODE
LOWtests/utils/lora/test_merge_lora.py1551 except Exception as ex: # pragma: no cover - torchao API / device gapsCODE
LOWtests/utils/lora/test_merge_lora.py1647 except Exception: # pragma: no coverCODE
LOWtests/utils/lora/test_merge_lora.py1657 except Exception as ex: # pragma: no coverCODE
LOWtests/utils/lora/test_merge_lora.py2138 except Exception: # pragma: no coverCODE
LOWtests/utils/lora/test_merge_lora.py2151 except Exception as ex: # pragma: no coverCODE
MEDIUMtests/integrations/test_gemma4_moe.py449def _can_import_sonicmoe():CODE
LOWtests/integrations/test_gemma4_moe.py454 except Exception:CODE
LOW…ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py65 except Exception:CODE
MEDIUM…ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py56def gpu_name() -> str:CODE
LOW…grations/kernels/scattermoe_lora/bench_int64_kernel.py59 except Exception:CODE
MEDIUM…grations/kernels/scattermoe_lora/bench_int64_kernel.py51def gpu_name() -> str:CODE
LOW…rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py61 except Exception:CODE
LOW…rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py371 except Exception:CODE
LOW…els/scattermoe_lora/test_grouped_fp4_weight_scale_2.py52 except Exception:CODE
LOW…sts/e2e/kernels/test_lora_mlp_geglu_moe_correctness.py20except Exception: # pragma: no coverCODE
MEDIUMtests/e2e/integrations/test_scattermoe_lora_kernels.py42def wrapper(*args, **kwargs):CODE
LOWtests/e2e/integrations/test_scattermoe_lora_kernels.py45 except Exception as exc: # pylint: disable=broad-exceptCODE
LOWtests/monkeypatch/test_sdpa_varlen.py165 except Exception: # pylint: disable=broad-exceptCODE
LOWdocs/scripts/generate_config_docs.py503 except Exception:CODE
LOWdocs/scripts/generate_config_docs.py607 except Exception as e:CODE
LOWexamples/orpheus/README.md79 except Exception as e:CODE
LOWexamples/orpheus/README.md240 except Exception as e:CODE
LOWscripts/analyze_profile.py1388 except Exception:CODE
LOWsrc/axolotl/train.py91 except Exception: # pylint: disable=broad-exception-caughtCODE
LOWsrc/axolotl/kernels/quantize.py154 except Exception:CODE
LOWsrc/axolotl/kernels/autotune_telemetry.py42 except Exception: # pylint: disable=broad-exception-caughtCODE
LOWsrc/axolotl/kernels/op_registry.py50 except Exception as exc: # pylint: disable=broad-exception-caughtCODE
LOWsrc/axolotl/core/trainers/base.py859 except Exception as exc: # pylint: disable=broad-exceptCODE
LOWsrc/axolotl/core/trainers/base.py892 except Exception as exc: # pylint: disable=broad-exceptCODE
LOWsrc/axolotl/core/trainers/ebft/trainer.py501 except Exception as e:CODE
LOWsrc/axolotl/core/trainers/grpo/async_trainer.py1177 except Exception as exc:CODE
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py207 except Exception:CODE
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py336 except Exception:CODE
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py340 except Exception:CODE
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py444 except Exception:CODE
LOWsrc/axolotl/utils/tee.py41 except Exception:CODE
LOWsrc/axolotl/utils/tee.py70 except Exception:CODE
LOWsrc/axolotl/utils/tee.py162 except Exception:CODE
LOWsrc/axolotl/utils/config/__init__.py134 except Exception:CODE
MEDIUMsrc/axolotl/utils/config/__init__.py122def get_device():CODE
LOWsrc/axolotl/utils/callbacks/generation.py38 except Exception as e:CODE
LOWsrc/axolotl/utils/callbacks/swanlab.py90 except Exception as err:CODE
LOWsrc/axolotl/utils/callbacks/swanlab.py124 except Exception as err:CODE
LOWsrc/axolotl/utils/callbacks/__init__.py374 except Exception as exc:CODE
LOWsrc/axolotl/utils/callbacks/__init__.py435 except Exception:CODE
LOWsrc/axolotl/utils/callbacks/opentelemetry.py72 except Exception as e:CODE
LOWsrc/axolotl/utils/callbacks/opentelemetry.py132 except Exception as e:CODE
LOWsrc/axolotl/utils/callbacks/opentelemetry.py221 except Exception as e:CODE
LOWsrc/axolotl/utils/schemas/config.py1895 except Exception: # pylint: disable=broad-exception-caughtCODE
LOWsrc/axolotl/utils/data/shared.py564 except Exception:CODE
LOWsrc/axolotl/utils/generation/sft.py128 except Exception as e:CODE
LOWsrc/axolotl/utils/generation/sft.py132 except Exception as e:CODE
LOWsrc/axolotl/cli/config.py157 except Exception as err:CODE
LOWsrc/axolotl/cli/preprocess.py88 except Exception as exc:CODE
LOWsrc/axolotl/cli/chat.py326 except Exception: # pylint: disable=broad-exception-caughtCODE
LOWsrc/axolotl/cli/chat.py366 except Exception: # pylint: disable=broad-exception-caughtCODE
109 more matches not shown…
Magic Placeholder Names23 hits · 161 pts
SeverityFileLineSnippetContext
HIGHexamples/swanlab/dpo-swanlab-full-featured.yml13# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/dpo-swanlab-full-featured.yml145# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/dpo-swanlab-full-featured.yml147# swanlab_api_key: your-api-keyCOMMENT
HIGHexamples/swanlab/lora-swanlab-profiling.yml12# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/lora-swanlab-profiling.yml92# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/lora-swanlab-profiling.yml94# swanlab_api_key: your-api-keyCOMMENT
HIGHexamples/swanlab/README.md22export SWANLAB_API_KEY=your-api-keyCODE
HIGHexamples/swanlab/README.md43export SWANLAB_API_KEY=your-api-keyCODE
HIGHexamples/swanlab/README.md66export SWANLAB_API_KEY=your-api-keyCODE
HIGHexamples/swanlab/README.md149export SWANLAB_API_KEY=your-api-keyCODE
HIGHexamples/swanlab/README.md156swanlab_api_key: your-api-keyCODE
HIGHexamples/swanlab/custom_trainer_profiling.py247 export SWANLAB_API_KEY=your-api-keySTRING
HIGHexamples/swanlab/dpo-swanlab-completions.yml12# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/dpo-swanlab-completions.yml104# export SWANLAB_API_KEY=your-api-keyCOMMENT
HIGHexamples/swanlab/dpo-swanlab-completions.yml106# swanlab_api_key: your-api-keyCOMMENT
HIGHsrc/axolotl/integrations/swanlab/plugins.py88 " export SWANLAB_API_KEY=your-api-key\n"CODE
HIGHsrc/axolotl/integrations/swanlab/plugins.py89 " 2. Add 'swanlab_api_key: your-api-key' to config (less secure)\n"CODE
HIGHsrc/axolotl/integrations/swanlab/README.md46swanlab_api_key: YOUR_API_KEY # Optional: can also use env var SWANLAB_API_KEYCODE
HIGHsrc/axolotl/integrations/swanlab/README.md53export SWANLAB_API_KEY=your-api-key-hereCODE
HIGHsrc/axolotl/integrations/swanlab/README.md8411. Set environment variable: `export SWANLAB_API_KEY=your-api-key`CODE
HIGHsrc/axolotl/integrations/swanlab/README.md8422. Add to config (less secure): `swanlab_api_key: your-api-key`CODE
HIGHsrc/axolotl/integrations/swanlab/README.md938export SWANLAB_API_KEY=your-api-key-hereCODE
HIGHsrc/axolotl/integrations/swanlab/README.md949swanlab_api_key: your-api-key-hereCODE
Redundant / Tautological Comments67 hits · 106 pts
SeverityFileLineSnippetContext
LOW.axolotl-complete.bash18 # Check if previous word is in our listCOMMENT
LOWtests/e2e/integrations/test_scattermoe_lora_kernels.py809 # Set weights to match test dataCOMMENT
LOWtests/e2e/patched/test_peft_embeddings.py59 # Check if the embeddings are upcast correctlyCOMMENT
LOWtests/prompt_strategies/test_chat_templates_advanced.py644 # Check if system message is not present in input_idsCOMMENT
LOWtests/prompt_strategies/test_chat_templates_advanced.py715 # Check if responses are labeled correctly based on roleCOMMENT
LOWdocs/scripts/generate_examples_docs.py123 # Check if target is outside examples_dirCOMMENT
LOWdocs/scripts/generate_examples_docs.py153 # Check if this exact path is in allowlistCOMMENT
LOWdocs/scripts/generate_examples_docs.py243 # Check if this is a parent page that has sub-pagesCOMMENT
LOWdocs/scripts/generate_config_docs.py180 # Check if this type itself is a Pydantic modelCOMMENT
LOWdocs/scripts/generate_config_docs.py395 # Check if this starts a new group (blank line before or significant gap)COMMENT
LOWdocs/scripts/generate_config_docs.py674 # Check if this field has nested modelsCOMMENT
LOWscripts/cloud-entrypoint.sh29 # Check if the word looks like the start of a keyCOMMENT
LOWscripts/cloud-entrypoint.sh72# Check if JUPYTER_PASSWORD is set and not emptyCOMMENT
LOWscripts/cloud-entrypoint.sh74 # Set JUPYTER_TOKEN to the value of JUPYTER_PASSWORDCOMMENT
LOWscripts/analyze_profile.py1110 # Check if this small block is surrounded by inactiveCOMMENT
LOWscripts/cloud-entrypoint-term.sh25 # Check if the word looks like the start of a keyCOMMENT
LOWscripts/cloud-entrypoint-term.sh63# Check if JUPYTER_PASSWORD is set and not emptyCOMMENT
LOWscripts/cloud-entrypoint-term.sh65 # Set JUPYTER_TOKEN to the value of JUPYTER_PASSWORDCOMMENT
LOWsrc/axolotl/train.py530 # Check if the `token_ids_to_fix` kwarg exists in the fix_untrained_tokens argsCOMMENT
LOWsrc/axolotl/core/trainers/ebft/strided.py408 # Check if we can share weights (PEFT model on single GPU)COMMENT
LOWsrc/axolotl/core/trainers/grpo/async_trainer.py1274 # Check if model has FP8 weightsCOMMENT
LOWsrc/axolotl/utils/tee.py157 # Close the file handle if openCOMMENT
LOWsrc/axolotl/utils/freeze.py39 # Check if any path component matches a vision/audio prefixCOMMENT
LOWsrc/axolotl/utils/trainer.py223 # Check if single example or batched by looking at the first elementCOMMENT
LOWsrc/axolotl/utils/trainer.py269 # Check if single example or batchCOMMENT
LOWsrc/axolotl/utils/callbacks/swanlab.py48 # Check if SwanLab run is initializedCOMMENT
LOWsrc/axolotl/utils/callbacks/swanlab.py163 # Check if SwanLab is initializedCOMMENT
LOWsrc/axolotl/utils/callbacks/lisa.py59 # Check if it's time to switch active layers, including at step 0COMMENT
LOWsrc/axolotl/utils/schemas/datasets.py216 # Set chat_template to tokenizer_default if not setCOMMENT
LOWsrc/axolotl/utils/samplers/multipack.py237 # Assign bins to ranks - each rank gets every n-th binCOMMENT
LOWsrc/axolotl/utils/data/shared.py182 # Check if it's a HuggingFace datasetCOMMENT
LOWsrc/axolotl/utils/data/shared.py185 # Check if it's a cloud storage path and get appropriate filesystemCOMMENT
LOWsrc/axolotl/utils/data/streaming.py209 # Set this to 1 so downstream data_loader doesn't try to increase the batch sizeCOMMENT
LOWsrc/axolotl/utils/mistral/mistral_tokenizer.py65 # Check if MistralRequestValidator has a _mode attribute.COMMENT
LOWsrc/axolotl/cli/config.py114 # Check if the config is a valid HTTPS URL to a .yml or .yaml fileCOMMENT
LOWsrc/axolotl/cli/checks.py42 # Verify if token is validCOMMENT
LOWsrc/axolotl/cli/utils/fetch.py35 # Check if file exists and needs updatingCOMMENT
LOWsrc/axolotl/cli/utils/train.py27 # Check if rdzv_endpoint is presentCOMMENT
LOWsrc/axolotl/cli/utils/train.py31 # Check if rdzv_backend is already providedCOMMENT
LOWsrc/axolotl/cli/utils/train.py36 # Check if rdzv_id is already providedCOMMENT
LOWsrc/axolotl/integrations/nemo_gym/server.py93 # Check if already runningCOMMENT
LOWsrc/axolotl/integrations/cut_cross_entropy/__init__.py61 # Check if cut_cross_entropy is installedCOMMENT
LOWsrc/axolotl/integrations/cut_cross_entropy/__init__.py74 # Check if Axolotl's cce fork is installedCOMMENT
LOWsrc/axolotl/integrations/swanlab/plugins.py50 # Check if SwanLab is enabledCOMMENT
LOWsrc/axolotl/integrations/swanlab/plugins.py446 # Check if Lark webhook URL is configuredCOMMENT
LOWsrc/axolotl/integrations/swanlab/plugins.py503 # Check if completion logging is enabledCOMMENT
LOWsrc/axolotl/integrations/swanlab/plugins.py509 # Check if trainer is an RLHF trainerCOMMENT
LOWsrc/axolotl/integrations/swanlab/profiling.py40 # Check if SwanLab is enabled and initializedCOMMENT
LOWsrc/axolotl/integrations/swanlab/profiling.py184 # Check if should log based on configCOMMENT
LOWsrc/axolotl/integrations/swanlab/profiling.py186 # Check if SwanLab is enabledCOMMENT
LOWsrc/axolotl/scripts/vllm_worker_ext.py67 # Check if this is a simple direct param (exists as-is)COMMENT
LOWsrc/axolotl/telemetry/callbacks.py102 # Check if we should report metricsCOMMENT
LOWsrc/axolotl/telemetry/errors.py50 # Check if this line contains a file pathCOMMENT
LOWsrc/axolotl/loaders/utils.py77 # Check if image_size is not set and load image size from model config if availableCOMMENT
LOWsrc/axolotl/monkeypatch/deepspeed_utils.py33 # Check if already patchedCOMMENT
LOWsrc/axolotl/monkeypatch/lora_kernels.py253 # Check if already patchedSTRING
LOWsrc/axolotl/monkeypatch/attention/xformers.py45 # Check if we have sliding window attentionCOMMENT
LOW…/axolotl/monkeypatch/transformers/trainer_loss_calc.py49 # Check if already patchedCOMMENT
LOW…/axolotl/monkeypatch/transformers/trainer_loss_calc.py54 # Check if the patterns existCOMMENT
LOW…/axolotl/monkeypatch/transformers/trainer_loss_calc.py108 # Check if already patchedCOMMENT
7 more matches not shown…
Over-Commented Block100 hits · 92 pts
SeverityFileLineSnippetContext
LOW.runpod/requirements.txt1# Required Python packages get listed here, one per line.COMMENT
LOW.runpod/src/config/config.yaml1# # This is the huggingface model that contains *.pt, *.safetensors, or *.bin filesCOMMENT
LOW.runpod/src/config/config.yaml21# tokenizer_use_fast:COMMENT
LOW.runpod/src/config/config.yaml41COMMENT
LOW.runpod/src/config/config.yaml61# float16: trueCOMMENT
LOW.runpod/src/config/config.yaml81# - path: repoCOMMENT
LOW.runpod/src/config/config.yaml101COMMENT
LOW.runpod/src/config/config.yaml121# dataset_shard_num:COMMENT
LOW.runpod/src/config/config.yaml141# sample_packing_eff_est:COMMENT
LOW.runpod/src/config/config.yaml161# # - gate_projCOMMENT
LOW.runpod/src/config/config.yaml181# # Must use either 'lora' or 'qlora' adapter, and does not support fsdp or deepspeedCOMMENT
LOW.runpod/src/config/config.yaml201# # Training hyperparametersCOMMENT
LOW.runpod/src/config/config.yaml221# max_steps:COMMENT
LOW.runpod/src/config/config.yaml241# lr_scheduler: # 'one_cycle' | empty for cosineCOMMENT
LOW.runpod/src/config/config.yaml261# # - adafactorCOMMENT
LOW.runpod/src/config/config.yaml281COMMENT
LOW.runpod/src/config/config.yaml301# # xpos RoPE see https://github.com/kaiokendev/cutoff-len-is-context-len/blob/main/util/xpos_rope_llama_monkey_patch.pyCOMMENT
LOW.runpod/src/config/config.yaml321# # Add extra tokens.COMMENT
LOWtests/conftest.py261# def download_fozzie_alpaca_dpo_dataset():COMMENT
LOWtests/integrations/test_swanlab.py1# Copyright 2024 Axolotl AI. All rights reserved.COMMENT
LOW…s/kernels/scattermoe_lora/test_mxfp4_expert_weights.py61# Per-shape Strategy-B tolerances. Forward outputs accumulate K dot-productsCOMMENT
LOW…rnels/scattermoe_lora/test_grouped_fp4_dequant_path.py341 dn.float().pow(2).mean().backward()COMMENT
LOWtests/e2e/multigpu/solo/__init__.py1# Tests under this directory should get run "solo" on their own as theyCOMMENT
LOWexamples/gemma4/26b-a4b-moe-bnb-lora.yaml1# Gemma-4-26B-A4B MoE QLoRA on a bf16 checkpoint quantized to bnb-4bit at load — the throughput-COMMENT
LOWexamples/ebft/qwen35-4b-ebft-structured-async.yaml1# EBFT Structured Mode: Qwen3.5-4B (hybrid linear attention)COMMENT
LOWexamples/ebft/qwen35-4b-ebft-structured.yaml1# EBFT Structured Mode: Qwen3.5-4B (hybrid linear attention)COMMENT
LOWexamples/ebft/llama-1b-ebft-opencode.yaml1# EBFT: Energy-Based Fine-Tuning with Llama-3.2-1B on OpenCodeInstructCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml1# SwanLab Full-Featured DPO Training ExampleCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml141# Workspace for team collaboration (shared experiments)COMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml161swanlab_completion_log_interval: 100 # Log every 100 stepsCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml181# export SWANLAB_LARK_WEBHOOK_URL=https://open.feishu.cn/...COMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml201# - Identify bottlenecks in training loopCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml221COMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml241# Expected Training BehaviorCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml261# INFO: Only rank 0 will initialize SwanLabCOMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml281# ============================================================================COMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml301# If SwanLab initialization fails:COMMENT
LOWexamples/swanlab/dpo-swanlab-full-featured.yml321# 1. Verify use_swanlab is trueCOMMENT
LOWexamples/swanlab/lora-swanlab-profiling.yml1# SwanLab LoRA Training Example with Performance ProfilingCOMMENT
LOWexamples/swanlab/lora-swanlab-profiling.yml101# ============================================================================COMMENT
LOWexamples/swanlab/lora-swanlab-profiling.yml121COMMENT
LOWexamples/swanlab/lora-swanlab-profiling.yml141# Then compare profiling metrics in SwanLab dashboard to see performance impactCOMMENT
LOWexamples/swanlab/lora-swanlab-profiling.yml161#COMMENT
LOWexamples/swanlab/dpo-swanlab-completions.yml1# SwanLab DPO Training Example with Completion LoggingCOMMENT
LOWexamples/swanlab/dpo-swanlab-completions.yml101COMMENT
LOWexamples/swanlab/dpo-swanlab-completions.yml121# View the table in SwanLab dashboard under "rlhf_completions"COMMENT
LOWexamples/swanlab/dpo-swanlab-completions.yml141# Get real-time training notifications in your team chatCOMMENT
LOWexamples/swanlab/dpo-swanlab-completions.yml161COMMENT
LOWsrc/axolotl/kernels/lora.py1061 # Magnitude gradients: d_mag = sum_t(grad * combined) / weight_normCOMMENT
LOWsrc/axolotl/core/training_args_base.py201 chat_template: Optional[str] = field(COMMENT
LOWsrc/axolotl/core/builders/base.py1# Copyright 2024 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/core/trainers/grpo/async_trainer.py1321 # The design has two modes that have to be threaded carefully:COMMENT
LOWsrc/axolotl/core/trainers/grpo/fast_async_trainer.py1# Copyright 2020-2026 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/utils/lora.py1# Copyright 2025 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/utils/optimizers/sinkgd_triton.py1# Copyright 2026 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/utils/optimizers/sinkgd.py1# Copyright 2026 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/integrations/config.py1# Copyright 2024 Axolotl AI. All rights reserved.COMMENT
LOWsrc/axolotl/integrations/base.py1# Copyright 2024 Axolotl AI. All rights reserved.COMMENT
LOW…tl/integrations/nemo_gym/examples/nemo_gym_sudoku.yaml1# Axolotl + NeMo Gym: Sudoku RL Training ExampleCOMMENT
LOW…ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml1# Axolotl + NeMo Gym: Multi-Turn Tool-Use RL Training ExampleCOMMENT
40 more matches not shown…
Cross-File Repetition17 hits · 85 pts
SeverityFileLineSnippetContext
HIGHtests/e2e/multigpu/test_fsdp2.py0verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129mSTRING
HIGHtests/e2e/multigpu/test_dist_muon_fsdp2.py0verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129mSTRING
HIGHtests/e2e/multigpu/test_fsdp1.py0verify that training completed successfully — artifacts, no-nan, loss stayed in qwen2-pretraining scale (tiny-qwen2-129mSTRING
HIGHsrc/axolotl/cli/preprocess.py0parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: adSTRING
HIGHsrc/axolotl/cli/merge_sharded_fsdp_weights.py0parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: adSTRING
HIGHsrc/axolotl/cli/train.py0parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: adSTRING
HIGHsrc/axolotl/cli/evaluate.py0parses `axolotl` config, cli args, and calls `do_evaluate`. args: config: path to `axolotl` config yaml file. kwargs: adSTRING
HIGHsrc/axolotl/integrations/liger/models/qwen3_5.py0args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked STRING
HIGHsrc/axolotl/integrations/liger/models/qwen3_5_moe.py0args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked STRING
HIGHsrc/axolotl/integrations/liger/models/base.py0args: labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked STRING
HIGHsrc/axolotl/monkeypatch/models/qwen3/fused_attn.py0unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight.STRING
HIGH…c/axolotl/monkeypatch/models/qwen3_5_moe/fused_attn.py0unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight.STRING
HIGHsrc/axolotl/monkeypatch/models/qwen3_5/fused_attn.py0unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight.STRING
HIGHsrc/axolotl/monkeypatch/models/qwen3_moe/fused_attn.py0unwrap peft ``modulestosavewrapper`` so the kernel reads the active adapter's weight.STRING
HIGHsrc/axolotl/prompt_strategies/bradley_terry/llama3.py0chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilabSTRING
HIGHsrc/axolotl/prompt_strategies/dpo/chatml.py0chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilabSTRING
HIGHsrc/axolotl/prompt_strategies/dpo/llama3.py0chatml transforms for datasets with system, input, chosen, rejected ex. https://huggingface.co/datasets/argilla/distilabSTRING
Self-Referential Comments27 hits · 83 pts
SeverityFileLineSnippetContext
MEDIUMtests/conftest.py547 # Create a temporary directoryCOMMENT
MEDIUMtests/test_packed_pretraining.py38 # Create a list of 2000 random texts rather than just using it within theCOMMENT
MEDIUMtests/test_packed_pretraining.py42 # Create an IterableDatasetCOMMENT
MEDIUMtests/integrations/test_diffusion.py43 # Create a minimal trainer instance just for testing methodsCOMMENT
MEDIUMtests/e2e/utils.py23 # Create a temporary directoryCOMMENT
MEDIUMtests/e2e/kernels/test_lora.py42 # Create main state with nested stateCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py684 # Create a new dataset with modified role namesCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py758 # Create a new dataset with the train and train_detail fieldsCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py1214 # Create a situation where eot_tokens contains eos_tokenCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py1299 # Create a non-existent token that definitely won't be in the templateCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py1350 # Create a custom chat template that uses our EOT tokenCOMMENT
MEDIUMtests/prompt_strategies/test_chat_templates_advanced.py1425 # Create a list to test different train_on_eot settingsCOMMENT
MEDIUMdocs/scripts/generate_examples_docs.py83 # Create a unique asset path based on source directory nameCOMMENT
MEDIUMscripts/cloud-entrypoint.sh21 # Create the authorized_keys file if it doesn't existCOMMENT
MEDIUMscripts/cloud-entrypoint-term.sh17 # Create the authorized_keys file if it doesn't existCOMMENT
MEDIUMsrc/axolotl/train.py195 # Define the context managers to useCOMMENT
MEDIUMsrc/axolotl/core/trainers/grpo/trainer.py245 # Create the dataloaderCOMMENT
MEDIUMsrc/axolotl/utils/tokenization.py90 # Create a delimiter based on text_only flagCOMMENT
MEDIUMsrc/axolotl/utils/ctx_managers/sequence_parallel.py74 # Create a boolean mask tensor for this rank's chunkCOMMENT
MEDIUMsrc/axolotl/utils/ctx_managers/sequence_parallel.py224 # Create a partially applied version of the apply_sequence_parallelism functionCOMMENT
MEDIUMsrc/axolotl/utils/schemas/utils.py31 data = data.copy() # Create a copy to avoid modifying the originalCODE
MEDIUMsrc/axolotl/utils/samplers/multipack.py100 # Create a new bin if needed and if we haven't reached the limitCOMMENT
MEDIUMsrc/axolotl/cli/delinearize_llama4.py117 # Create a new state dict for the converted modelCOMMENT
MEDIUMsrc/axolotl/loaders/tokenizer.py54 # Create the tokenizer directory in output_dir if it doesn't existCOMMENT
MEDIUMsrc/axolotl/monkeypatch/attention/flex_attn.py35 # Create a new instance if one doesn't already existCOMMENT
MEDIUM…onkeypatch/models/mistral3/mistral_common_tokenizer.py22 # Define the replacementCOMMENT
MEDIUMsrc/axolotl/prompt_strategies/chat_template.py363 # Create a new list to store tokens that should be keptCOMMENT
Docstring Block Structure14 hits · 70 pts
SeverityFileLineSnippetContext
HIGHsrc/axolotl/core/trainers/grpo/__init__.py249 Returns the reward function from the given fully qualified name, or the path to the reward function model. STRING
HIGHsrc/axolotl/utils/quantization.py61 This function is used to build a post-training quantization config. Args: weight_dtype: The dtype to uSTRING
HIGHsrc/axolotl/utils/schemas/utils.py9 Handle backwards compatibility between legacy message field mapping and new property mapping system. PreviouslSTRING
HIGHsrc/axolotl/utils/chat_templates/base.py31 Finds the correct chat_template based on the user's choice, jinja_template, and tokenizer. Args: user_STRING
HIGHsrc/axolotl/utils/data/rl.py129Filter out samples that exceed maximum sequence length. Args: sample: Dataset sample to check. rl: STRING
HIGHsrc/axolotl/utils/data/rl.py186Check sequence length and raise ValueError if exceeded. Used as a filter function for ``excess_length_strategy: raiSTRING
HIGHsrc/axolotl/cli/config.py97 First, determines if the passed config is a valid HTTPS URL. Then, attempts to query for it and parse its conteSTRING
HIGHsrc/axolotl/cli/config.py163 Helper method for choosing a `axolotl` config YAML file (considering only files ending with `.yml` or `.yaml`).STRING
HIGHsrc/axolotl/cli/agent_docs/__init__.py84Return the content of an agent doc by topic name. Args: topic: One of the keys in TOPICS, or "overview" (deSTRING
HIGHsrc/axolotl/integrations/base.py316Loads a plugin based on the given plugin name. The plugin name should be in the format "module_name.class_name". ThSTRING
HIGHsrc/axolotl/integrations/expert_parallel/shard.py159Slice expert weights along dim 0 per the EP rank. Args: model: A built (but not yet FSDP-wrapped) HuggingFaSTRING
HIGHsrc/axolotl/loaders/utils.py152Loads and configures a model configuration from HuggingFace or local sources. This function determines the appropriSTRING
HIGHsrc/axolotl/monkeypatch/lora_kernels.py155 Get the appropriate attention class by inspecting the model config. Uses dynamic import to support any model arSTRING
HIGHsrc/axolotl/monkeypatch/lora_kernels.py461 Applies optimized Triton kernel patches to a PEFT model. Patches a PEFT model with optimized implementations fSTRING
Hallucination Indicators6 hits · 70 pts
SeverityFileLineSnippetContext
CRITICALsrc/axolotl/integrations/kernels/autotune_callback.py56 props = triton.runtime.driver.active.utils.get_device_properties(idx)CODE
CRITICAL…tions/kernels/libs/scattermoe_lora/kernels/lora_ops.py190 props = triton.runtime.driver.active.utils.get_device_properties(CODE
CRITICALsrc/axolotl/integrations/kernels/libs/dsv4/attention.py50 return triton.runtime.driver.active.utils.get_device_properties(dev)[CODE
CRITICAL…axolotl/integrations/kernels/libs/glm_dsa/_autotune.py21 props = triton.runtime.driver.active.utils.get_device_properties(dev)CODE
CRITICALsrc/axolotl/monkeypatch/attention/xformers.py72 xformers.ops.fmha.attn_bias.BlockDiagonalCausalMask.from_seqlens(CODE
CRITICALsrc/axolotl/monkeypatch/attention/xformers.py94 attn_bias = xformers.ops.fmha.attn_bias.BlockDiagonalCausalMask.from_seqlens(CODE
AI Slop Vocabulary18 hits · 52 pts
SeverityFileLineSnippetContext
MEDIUMpyproject.toml62 # lm eval harnessCOMMENT
MEDIUM…ts/integrations/kernels/scattermoe_lora/bench_mxfp4.py296# Timing harnessCOMMENT
MEDIUM…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py181# 2. Memory bound across skew (THE skew guard) — a robust op's peak must NOT scale with routingCOMMENT
MEDIUM…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py183# BALANCED peak (scale-robust, no magic absolute). A capacity-padded impl (cap=max) blows up atCOMMENT
MEDIUM…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py212 # robust: skew peak within 1.5x of balanced. capacity-padded all_to_one is many x -> fails.COMMENT
MEDIUM…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py229 # cap this process to a fraction that comfortably fits the robust path but not an E*cap blowupCOMMENT
MEDIUM…tions/kernels/scattermoe_lora/test_grouped_fp4_skew.py234 ) # robust needs ~12x routed + model; blowup needs ~Ex moreCODE
MEDIUMexamples/archived/xgen-7b/xgen-7b-8k-qlora.yml31# "We find hyperparameters to be largely robust across datasets"COMMENT
MEDIUMexamples/archived/falcon/config-7b-qlora.yml33# "We find hyperparameters to be largely robust across datasets"COMMENT
MEDIUM.github/workflows/tests-nightly.yml5 # to this file or the cicd/ harness.COMMENT
LOWsrc/axolotl/cli/utils/sweeps.py61 # If no paired values, just use regular combinationsCOMMENT
MEDIUM…ions/kernels/libs/scattermoe_lora/nvfp4_moe_loading.py96# robust NVFP4 signal (uint8 qdata) — distinguishing NVFP4 from FP8 (which also carries aCOMMENT
MEDIUM…tions/kernels/libs/scattermoe_lora/kernels/lora_ops.py2554 (128, 32, 64, 8, 3), # robust fallback within the stock search spaceCODE
MEDIUM…/axolotl/integrations/kernels/libs/glm_dsa/dispatch.py1"""Length-aware dispatch for GLM-5.2 DSA attention — robust across short and long sequences.STRING
LOWsrc/axolotl/integrations/kd/collator.py211 # just pass straight to parent.COMMENT
LOWsrc/axolotl/prompt_strategies/chat_template.py643 # grid info, etc.); just set the fields we computed locally.COMMENT
LOWsrc/axolotl/prompt_strategies/ebft/ebft_strided_chat.py20 # For preview: just return the first user messageCOMMENT
MEDIUMsrc/axolotl/prompt_strategies/ebft/ebft_reasoning.py280 # directly in the input_ids (robust to tokenization alignment).COMMENT
AI Structural Patterns52 hits · 50 pts
SeverityFileLineSnippetContext
LOW…ions/kernels/scattermoe_lora/test_mxfp4_integration.py225CODE
LOWtests/e2e/integrations/test_scattermoe_lora_kernels.py182CODE
LOWtests/e2e/integrations/test_scattermoe_lora_kernels.py1573CODE
LOWsrc/axolotl/processing_strategies.py53CODE
LOWsrc/axolotl/processing_strategies.py758CODE
LOWsrc/axolotl/processing_strategies.py805CODE
LOWsrc/axolotl/processing_strategies.py881CODE
LOWsrc/axolotl/processing_strategies.py1165CODE
LOWsrc/axolotl/processing_strategies.py1218CODE
LOWsrc/axolotl/processing_strategies.py1255CODE
LOWsrc/axolotl/processing_strategies.py1308CODE
LOWsrc/axolotl/processing_strategies.py1361CODE
LOWsrc/axolotl/kernels/lora.py762CODE
LOWsrc/axolotl/kernels/lora.py818CODE
LOWsrc/axolotl/kernels/lora.py1781CODE
LOWsrc/axolotl/core/trainers/grpo/async_trainer.py2872CODE
LOWsrc/axolotl/core/trainers/grpo/trainer.py86CODE
LOWsrc/axolotl/utils/ctx_managers/sequence_parallel.py416CODE
LOWsrc/axolotl/utils/optimizers/sinkgd_triton.py381CODE
LOWsrc/axolotl/utils/optimizers/adopt.py40CODE
LOWsrc/axolotl/utils/optimizers/sinkgd.py249CODE
LOWsrc/axolotl/utils/samplers/multipack.py257CODE
LOWsrc/axolotl/utils/mistral/mistral_tokenizer.py182CODE
LOWsrc/axolotl/models/mamba/configuration_mamba.py15CODE
LOWsrc/axolotl/cli/chat.py847CODE
LOWsrc/axolotl/cli/utils/lora_merge.py1480CODE
LOWsrc/axolotl/cli/utils/lora_merge.py1744CODE
LOW…s/kernels/libs/scattermoe_lora/parallel_linear_lora.py569CODE
LOW…l/integrations/kernels/libs/scattermoe_lora/experts.py371CODE
LOW…l/integrations/kernels/libs/scattermoe_lora/experts.py600CODE
LOW…els/libs/scattermoe_lora/cutlass_fp4/grouped_kernel.py1426CODE
LOWsrc/axolotl/integrations/lm_eval/cli.py31CODE
LOWsrc/axolotl/integrations/kd/chat_template.py34CODE
LOWsrc/axolotl/integrations/kd/kernels/liger.py120CODE
LOWsrc/axolotl/integrations/kd/kernels/liger.py180CODE
LOWsrc/axolotl/integrations/kd/kernels/liger.py429CODE
LOWsrc/axolotl/integrations/diffusion/generation.py15CODE
LOWsrc/axolotl/integrations/diffusion/generation.py318CODE
LOWsrc/axolotl/integrations/liger/models/jamba.py19CODE
LOWsrc/axolotl/integrations/liger/models/qwen3_5.py15CODE
LOWsrc/axolotl/integrations/liger/models/deepseekv2.py15CODE
LOWsrc/axolotl/integrations/liger/models/qwen3_5_moe.py14CODE
LOWsrc/axolotl/monkeypatch/stablelm_attn_hijack_flash.py247CODE
LOWsrc/axolotl/monkeypatch/attention/xformers.py19CODE
LOWsrc/axolotl/monkeypatch/models/qwen3_next/modeling.py275CODE
LOWsrc/axolotl/monkeypatch/models/voxtral/modeling.py18CODE
LOW…l/monkeypatch/models/kimi_linear/configuration_kimi.py17CODE
LOW…xolotl/monkeypatch/models/kimi_linear/modeling_kimi.py1285CODE
LOWsrc/axolotl/monkeypatch/models/falcon_h1/modeling.py302CODE
LOWsrc/axolotl/monkeypatch/ring_attn/patch.py56CODE
LOWsrc/axolotl/monkeypatch/ring_attn/adapters/batch.py61CODE
LOWsrc/axolotl/prompt_strategies/chat_template.py42CODE
Modern Structural Boilerplate42 hits · 42 pts
SeverityFileLineSnippetContext
LOWsrc/axolotl/core/builders/__init__.py6__all__ = ["HFCausalTrainerBuilder", "HFRLTrainerBuilder"]CODE
LOWsrc/axolotl/core/trainers/__init__.py10__all__ = [CODE
LOWsrc/axolotl/core/trainers/grpo/async_trainer.py615 def set_trainer(self, trainer) -> None:CODE
LOWsrc/axolotl/core/trainers/grpo/sampler.py166 def set_epoch(self, epoch: int) -> None:CODE
LOWsrc/axolotl/utils/optimizers/adopt.py36__all__ = ["ADOPT", "adopt"]CODE
LOWsrc/axolotl/utils/chat_templates/__init__.py14__all__ = [CODE
LOWsrc/axolotl/utils/data/__init__.py14__all__ = [CODE
LOWsrc/axolotl/utils/mistral/__init__.py6__all__ = ["HFMistralTokenizer", "Mistral3Processor"]CODE
LOWsrc/axolotl/utils/generation/__init__.py5__all__ = ["generate_samples", "format_generation_for_logging"]CODE
LOWsrc/axolotl/utils/collators/__init__.py12__all__ = [CODE
LOWsrc/axolotl/cli/utils/__init__.py15__all__ = [CODE
LOWsrc/axolotl/cli/utils/lora_merge.py1140def _update_config_vocab_size(output_path: Path, vocab_size: int) -> None:CODE
LOWsrc/axolotl/integrations/nemo_gym/__init__.py20__all__ = [CODE
LOWsrc/axolotl/integrations/kernels/__init__.py4__all__ = [CODE
LOW…/integrations/kernels/libs/scattermoe_lora/__init__.py10__all__ = [CODE
LOW…tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py26def set_chunk_size_override(n) -> None:CODE
LOW…tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py30def set_layer_gc_active(flag) -> None:CODE
LOW…tegrations/kernels/libs/scattermoe_lora/chunked_bnb.py34def set_bnb_fast(flag) -> None:CODE
LOW…grations/kernels/libs/scattermoe_lora/grouped_train.py36def set_grouped_backend_override(backend) -> None:CODE
LOW…tions/kernels/libs/scattermoe_lora/kernels/__init__.py12__all__ = ["ops", "lora_ops"]CODE
LOWsrc/axolotl/integrations/kernels/libs/dsv4/__init__.py11__all__ = [CODE
LOW…/axolotl/integrations/kernels/libs/glm_dsa/__init__.py15__all__ = [CODE
LOW…axolotl/integrations/kernels/libs/sonicmoe/__init__.py24__all__ = [CODE
LOW…/axolotl/integrations/kernels/libs/sonicmoe/experts.py296__all__ = [CODE
LOWsrc/axolotl/integrations/kd/kernels/__init__.py7__all__ = ["LigerFusedLinearKLTopKLogprobLoss"]CODE
LOWsrc/axolotl/integrations/diffusion/__init__.py10__all__ = [CODE
LOWsrc/axolotl/integrations/diffusion/callbacks.py14logger = logging.getLogger(__name__)CODE
LOWsrc/axolotl/integrations/densemixer/__init__.py5__all__ = ["DenseMixerPlugin"]CODE
LOWsrc/axolotl/integrations/hatchery/__init__.py15__all__ = ["HatcheryArgs", "HatcheryConfig", "HatcheryPlugin"]CODE
LOWsrc/axolotl/integrations/swanlab/__init__.py6__all__ = ["SwanLabConfig", "SwanLabPlugin"]CODE
LOWsrc/axolotl/integrations/liger/__init__.py25__all__ = [CODE
LOWsrc/axolotl/integrations/llm_compressor/__init__.py5__all__ = ["LLMCompressorPlugin"]CODE
LOWsrc/axolotl/integrations/mora/__init__.py6__all__ = ["MoraArgs", "MoraConfig", "MoraPlugin", "MoraType"]CODE
LOWsrc/axolotl/integrations/expert_parallel/experts_fn.py34def set_token_capacity(cap: int | None) -> None:CODE
LOWsrc/axolotl/integrations/expert_parallel/experts_fn.py79def set_valid_token_mask(mask: torch.Tensor | None) -> None:CODE
LOWsrc/axolotl/integrations/expert_parallel/__init__.py23__all__ = [CODE
LOWsrc/axolotl/loaders/__init__.py9__all__ = [CODE
LOWsrc/axolotl/monkeypatch/gemma4_hybrid_mask.py60def set_flash_d512(enabled: bool) -> None:CODE
LOWsrc/axolotl/monkeypatch/attention/large_head.py28def set_large_head_policy(policy: str | None) -> None:CODE
LOWsrc/axolotl/monkeypatch/attention/large_head.py33def set_large_head_packed(packed: bool | None) -> None:CODE
LOWsrc/axolotl/monkeypatch/tiled_mlp/__init__.py10__all__ = [CODE
LOWsrc/axolotl/monkeypatch/trainer/__init__.py3__all__ = ["entropy_from_logits", "selective_log_softmax"]CODE
Cross-Language Confusion9 hits · 40 pts
SeverityFileLineSnippetContext
HIGHsrc/axolotl/core/trainers/grpo/async_trainer.py803 VLLMGeneration._init_vllm = _orig_init_vllm # type: ignore[possibly-undefined]CODE
HIGHsrc/axolotl/utils/schemas/config.py888 "flash_attn dependency. Left unset (null) it auto-enables when supported (torch >= "CODE
HIGHsrc/axolotl/cli/config_options.py2321 "With sample packing + attn_implementation=sdpa, route packed rows through torch.nn.attention.varlen.varlen_attnCODE
HIGHsrc/axolotl/cli/cloud/modal_.py116 f"RUN cd /workspace/axolotl && git fetch && git checkout {self.config.branch} && git pull",CODE
HIGHsrc/axolotl/integrations/nemo_gym/server.py69 ["bash", "-c", "source .venv/bin/activate && uv sync"],CODE
HIGHsrc/axolotl/integrations/kd/kernels/liger.py36 0.0 for Forward KL (P_teacher || P_student).STRING
HIGHsrc/axolotl/integrations/kd/kernels/liger.py37 1.0 for Reverse KL (P_student || P_teacher).STRING
HIGHsrc/axolotl/integrations/cut_cross_entropy/__init__.py38 '`pip uninstall -y cut-cross-entropy && pip install "cut-cross-entropy[transformers] @ git+https://github.com/axolotCODE
HIGH…xolotl/monkeypatch/models/kimi_linear/modeling_kimi.py45 "Plese run `pip uninstall fla-core flash-linear-attention -y && pip install git+https://github.com/fla-org/flashCODE
Modern AI Meta-Vocabulary9 hits · 23 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_processing_strategies.py56# Generic fake tokenizer/processor scaffoldCOMMENT
MEDIUMexamples/ebft/llama-1b-ebft-strided.yaml12 context_length: 8 # context window per blockCODE
MEDIUMexamples/ebft/llama-1b-ebft-strided-structured.yaml12 context_length: 8 # context window per blockCODE
MEDIUMexamples/ebft/README.md100 context_length: 8 # context window per block (paper default: 8)CODE
MEDIUMexamples/mistral-medium-3_5/README.md3[Mistral Medium 3.5](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B) is a 128B parameter dense multimodal modeCODE
MEDIUMsrc/axolotl/core/trainers/ebft/strided.py153 # Rule 1: Generated token attends to its context window in the promptCOMMENT
MEDIUMsrc/axolotl/core/trainers/ebft/strided.py917 # Last token of the context window predicts the first rollout tokenCOMMENT
MEDIUMsrc/axolotl/integrations/nemo_gym/README.md77# Agent server (orchestrates multi-turn via /run)COMMENT
MEDIUM…ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml4# using NeMo Gym's agentic environments. The model generates responses,COMMENT
Slop Phrases9 hits · 14 pts
SeverityFileLineSnippetContext
LOW.runpod/src/config/config.yaml65# # HuggingFace dataset repo | s3://,gs:// path | "json" for local dataset, make sure to fill data_filesCOMMENT
LOWsrc/axolotl/utils/callbacks/profiler.py89 # make sure to record if we happen to have more steps than steps to profileCOMMENT
LOWsrc/axolotl/cli/utils/train.py187 # make sure to flush stdout and stderr before replacing the processCOMMENT
LOWsrc/axolotl/cli/utils/train.py213 # make sure to flush stdout and stderr before replacing the processCOMMENT
LOWsrc/axolotl/integrations/kd/collator_online_teacher.py531 # TODO make sure to figure out which input in sub_batch_features to update the batch in the originalCOMMENT
LOWsrc/axolotl/integrations/liger/models/jamba.py146 ) # make sure to reside in the same deviceCODE
MEDIUMsrc/axolotl/prompt_strategies/context_qa.py107 "Therefore, I'm unable to answer your question based on the given context.",CODE
MEDIUMsrc/axolotl/prompt_strategies/creative_acr.py33refusal: whether the Response refuses to answer the Question. Responses containing language similar to "As an AI languagCODE
MEDIUMsrc/axolotl/prompt_strategies/creative_acr.py90refusal: whether the Response refuses to answer the Question. Responses containing language similar to "As an AI languagCODE
Structural Annotation Overuse8 hits · 12 pts
SeverityFileLineSnippetContext
LOWtests/utils/callbacks/test_dynamic_checkpoint.py139 # Step 5 - shouldn't check (not divisible by 10)COMMENT
LOWtests/utils/callbacks/test_dynamic_checkpoint.py145 # Step 10 - should checkCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1614 # Step 1: Fuse — MergeModulelist (stack experts) per source patternCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1660 # Step 2: Build the fused key name and merge LoRACOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1728 # Step 3: Save in fused format (runtime format) so that the mergedCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1968 # Step 0: dequantize quantized weights so the LoRA delta folds into the TRUE weight (a raw readCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1983 # Step 1: Handle fused weight conversions (MoE experts) if applicableCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py2004 # Step 2: Merge remaining (non-fused) tensors with LoRACOMMENT
Verbosity Indicators6 hits · 9 pts
SeverityFileLineSnippetContext
LOWsrc/axolotl/cli/utils/lora_merge.py1614 # Step 1: Fuse — MergeModulelist (stack experts) per source patternCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1660 # Step 2: Build the fused key name and merge LoRACOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1728 # Step 3: Save in fused format (runtime format) so that the mergedCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1968 # Step 0: dequantize quantized weights so the LoRA delta folds into the TRUE weight (a raw readCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py1983 # Step 1: Handle fused weight conversions (MoE experts) if applicableCOMMENT
LOWsrc/axolotl/cli/utils/lora_merge.py2004 # Step 2: Merge remaining (non-fused) tensors with LoRACOMMENT
Example Usage Blocks6 hits · 9 pts
SeverityFileLineSnippetContext
LOW…tl/integrations/nemo_gym/examples/nemo_gym_sudoku.yaml11# Usage:COMMENT
LOW…ntegrations/nemo_gym/examples/nemo_gym_multi_turn.yaml15# Usage:COMMENT
LOW…integrations/nemo_gym/examples/nemo_gym_multi_env.yaml12# Usage:COMMENT
LOWsrc/axolotl/integrations/hatchery/__init__.py17# Usage:COMMENT
LOW…axolotl/integrations/hatchery/examples/tinker_sft.yaml3# Usage:COMMENT
LOWsrc/axolotl/loaders/tokenizer.py291 # Usage:COMMENT
Fake / Example Data7 hits · 8 pts
SeverityFileLineSnippetContext
LOWtests/test_data.py40 "lorem ipsum dolor sit amet.",CODE
LOWtests/test_data.py40 "lorem ipsum dolor sit amet.",CODE
LOWtests/test_prompt_tokenizers.py75 "instruction": "hello cruel. lorem ipsum dolor sit amet.",CODE
LOWtests/test_prompt_tokenizers.py75 "instruction": "hello cruel. lorem ipsum dolor sit amet.",CODE
LOWsrc/axolotl/utils/data/sft.py255 f.write("lorem ipsum dolor sit amet\n")CODE
LOWsrc/axolotl/utils/data/sft.py255 f.write("lorem ipsum dolor sit amet\n")CODE
LOWsrc/axolotl/integrations/nemo_gym/README.md72 api_key: dummy_keyCODE
Synthetic Comment Markers1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHREADME.md175- [API Reference](https://docs.axolotl.ai/docs/api/) - Auto-generated code documentationCODE
Dead Code2 hits · 4 pts
SeverityFileLineSnippetContext
MEDIUMsrc/axolotl/models/mamba/modeling_mamba.py89CODE
MEDIUMsrc/axolotl/models/mamba/modeling_mamba.py90CODE