Repository Analysis

linkedin/Liger-Kernel

Efficient Triton Kernels for LLM Training

21.4 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of linkedin/Liger-Kernel, a Python project with 6,542 GitHub stars. SynthScan v2.0 examined 112,531 lines of code across 409 source files, recording 1621 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 21.4 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

21.4
Adjusted Score
21.4
Raw Score
100%
Time Factor
2026-08-02
Last Push
6.5K
Stars
Python
Language
112.5K
Lines of Code
409
Files
1.6K
Pattern Hits
2026-08-02
Scan Date
0.12
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 50MEDIUM 278LOW 1293

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1621 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators262 hits · 938 pts
SeverityFileLineSnippetContext
MEDIUMbenchmark/scripts/benchmark_model_configs.py122# ── MoE Model Profiles ───────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/scripts/benchmark_model_configs.py134# ── Dense Model Profiles ─────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/scripts/benchmark_model_configs.py579 # ---------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_model_configs.py581 # ---------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py34# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py37# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py64# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py66# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py84# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py86# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py130# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py132# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py170# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/scripts/benchmark_fused_moe.py172# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/utils.py34# =============================================================================COMMENT
MEDIUMtest/utils.py36# =============================================================================COMMENT
MEDIUMtest/transformers/test_utils.py24# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_utils.py26# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_utils.py105# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_utils.py107# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_utils.py148# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_utils.py150# -----------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py206# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py208# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py360# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py365# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py382# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py386# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py499# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py501# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py528# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py533# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py45# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py47# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py73# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py75# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py556# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_cross_entropy.py562# =============================================================================COMMENT
MEDIUMtest/transformers/test_geglu.py270# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_geglu.py272# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py27# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py29# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py71# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py114# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py116# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py168# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_fused_moe.py170# ---------------------------------------------------------------------------COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py42# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py44# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py61# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py63# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py77# =============================================================================COMMENT
MEDIUMtest/transformers/test_cutedsl_rms_norm.py79# =============================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py284# ===========================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py286# ===========================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py347# ===========================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py349# ===========================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py48# ===========================================================================COMMENT
MEDIUMtest/megatron/test_cross_entropy.py50# ===========================================================================COMMENT
202 more matches not shown…
Hyper-Verbose Identifiers583 hits · 554 pts
SeverityFileLineSnippetContext
LOWsetup.py31def get_optional_dependencies():CODE
LOWbenchmark/BENCHMARK_GUIDELINES.md113def _resolve_model_config_geglu(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/BENCHMARK_GUIDELINES.md133def bench_speed_geglu_model_config(input):CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py74def _setup_sparse_multi_token_attention(input: SingleBenchmarkRunInput):CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py131def bench_speed_sparse_multi_token_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py161def bench_memory_sparse_multi_token_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py176def _resolve_model_config_sparse_multi_token_attention(input: SingleBenchmarkRunInput):CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py196def bench_speed_sparse_multi_token_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_sparse_multi_token_attention.py226def bench_memory_sparse_multi_token_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py28def _setup_modulated_rms_norm(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py60def bench_speed_modulated_rms_norm(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py67def bench_memory_modulated_rms_norm(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py72def _resolve_model_config_modulated_rms_norm(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py89def bench_speed_modulated_rms_norm_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_modulated_rms_norm.py96def bench_memory_modulated_rms_norm_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_mhc.py158def _resolve_model_config_mhc(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_mhc.py182def bench_speed_mhc_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_mhc.py208def bench_memory_mhc_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_grpo_loss_kernel.py141def bench_memory_grpo_loss_kernel(CODE
LOWbenchmark/scripts/benchmark_grpo_loss_kernel.py197def bench_speed_grpo_loss_kernel(CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py282def _resolve_model_config_tiled_mlp(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py303def bench_speed_tiled_mlp_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py345def bench_memory_tiled_mlp_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py379def _run_tiled_mlp_benchmarks(args, activation_type, hidden_act, kernel_name):CODE
LOWbenchmark/scripts/benchmark_mhc_lm.py370def _resolve_model_config_mhc_lm(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_mhc_lm.py393def bench_speed_mhc_lm_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_mhc_lm.py419def bench_memory_mhc_lm_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/utils.py232def get_current_file_directory() -> str:CODE
LOWbenchmark/scripts/utils.py254def _print_benchmarking_banner(metric_name: str, kernel_name: str):CODE
LOWbenchmark/scripts/utils.py276def update_benchmark_data_csv(CODE
LOWbenchmark/scripts/utils.py471def parse_benchmark_script_args():CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py59 def _create_neighborhood_mask(self, seq_len: int, device: torch.device) -> torch.Tensor:CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py103def _setup_fused_neighborhood_attention(input: SingleBenchmarkRunInput):CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py166def bench_speed_fused_neighborhood_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py202def bench_memory_fused_neighborhood_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py217def _resolve_model_config_fused_neighborhood_attention(input: SingleBenchmarkRunInput):CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py238def bench_speed_fused_neighborhood_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py272def bench_memory_fused_neighborhood_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_distill_cosine_loss.py88def setup_distill_cosine_loss(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_model_configs.py239def get_benchmark_model_config(model_name: Optional[str] = None) -> ModelConfig:CODE
LOWbenchmark/scripts/benchmark_model_configs.py253def estimate_kernel_peak_memory(probe_fn: Callable[[], torch.Tensor]) -> int:CODE
LOWbenchmark/scripts/benchmark_model_configs.py322def compute_seq_len_sweep_config(CODE
LOWbenchmark/scripts/benchmark_model_configs.py381def compute_model_config_sweep_config(CODE
LOW…chmark/scripts/benchmark_fused_linear_cross_entropy.py50def setup_fused_linear_cross_entropy(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_megatron_rms_norm.py89def bench_speed_megatron_rms_norm(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_megatron_rms_norm.py128def bench_memory_megatron_rms_norm(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py48def _setup_multi_token_attention(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py101def bench_speed_multi_token_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py131def bench_memory_multi_token_attention(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py147def _resolve_model_config_multi_token_attention(input: SingleBenchmarkRunInput):CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py168def bench_speed_multi_token_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWbenchmark/scripts/benchmark_multi_token_attention.py198def bench_memory_multi_token_attention_model_config(input: SingleBenchmarkRunInput) -> SingleBenchmarkRunOutput:CODE
LOWtest/utils.py278def load_image_processing_config(config_path: str) -> dict:CODE
LOWtest/utils.py335def revert_liger_kernel_to_granite(model_config: MiniModelConfig):CODE
LOWtest/utils.py347def revert_liger_kernel_to_llama(model_config: MiniModelConfig):CODE
LOWtest/utils.py371def revert_liger_kernel_to_mllama(model_config: MiniModelConfig, model_type: str = "causal_lm"):CODE
LOWtest/utils.py417def revert_liger_kernel_to_ministral(model_config: MiniModelConfig):CODE
LOWtest/utils.py429def revert_liger_kernel_to_mistral(model_config: MiniModelConfig):CODE
LOWtest/utils.py441def revert_liger_kernel_to_mixtral(model_config: MiniModelConfig):CODE
LOWtest/utils.py453def revert_liger_kernel_to_gemma(model_config: MiniModelConfig):CODE
523 more matches not shown…
Unused Imports320 hits · 223 pts
SeverityFileLineSnippetContext
LOWbenchmark/scripts/benchmark_megatron_cross_entropy.py32CODE
LOWtest/convergence/fp32/test_mini_models_multimodal.py306CODE
LOWtest/convergence/bf16/test_mini_models_multimodal.py278CODE
LOWtest/transformers/test_monkey_patch.py287CODE
LOWtest/transformers/test_monkey_patch.py288CODE
LOWtest/transformers/test_monkey_patch.py289CODE
LOWtest/transformers/test_monkey_patch.py290CODE
LOWtest/transformers/test_monkey_patch.py291CODE
LOWtest/transformers/test_monkey_patch.py292CODE
LOWtest/transformers/test_monkey_patch.py293CODE
LOWtest/transformers/test_monkey_patch.py294CODE
LOWtest/transformers/test_monkey_patch.py295CODE
LOWtest/transformers/test_monkey_patch.py296CODE
LOWtest/transformers/test_monkey_patch.py297CODE
LOWtest/transformers/test_monkey_patch.py298CODE
LOWtest/transformers/test_monkey_patch.py299CODE
LOWtest/transformers/test_monkey_patch.py300CODE
LOWtest/transformers/test_monkey_patch.py301CODE
LOWtest/transformers/test_monkey_patch.py302CODE
LOWtest/transformers/test_monkey_patch.py303CODE
LOWtest/transformers/test_monkey_patch.py304CODE
LOWtest/transformers/test_monkey_patch.py305CODE
LOWtest/transformers/test_monkey_patch.py306CODE
LOWtest/transformers/test_monkey_patch.py307CODE
LOWtest/transformers/test_monkey_patch.py308CODE
LOWtest/transformers/test_monkey_patch.py309CODE
LOWtest/transformers/test_monkey_patch.py310CODE
LOWtest/transformers/test_trainer_integration.py6CODE
LOWtest/transformers/test_transformers.py6CODE
LOWtest/transformers/test_transformers.py7CODE
LOWtest/transformers/test_transformers.py8CODE
LOWtest/transformers/test_transformers.py9CODE
LOWtest/transformers/test_transformers.py10CODE
LOWtest/transformers/test_transformers.py11CODE
LOWtest/transformers/test_transformers.py12CODE
LOWtest/transformers/test_transformers.py13CODE
LOWtest/transformers/test_transformers.py14CODE
LOWtest/transformers/test_transformers.py15CODE
LOWtest/megatron/test_cross_entropy.py26CODE
LOWexamples/megatron/run_mode2_hand_spec.py32CODE
LOWexamples/megatron/run_mode1_monkey_patch.py28CODE
LOWsrc/liger_kernel/utils.py2CODE
LOWsrc/liger_kernel/triton/__init__.py1CODE
LOW…er_kernel/transformers/vocab_parallel_cross_entropy.py28CODE
LOWsrc/liger_kernel/transformers/__init__.py6CODE
LOWsrc/liger_kernel/transformers/__init__.py7CODE
LOWsrc/liger_kernel/transformers/__init__.py8CODE
LOWsrc/liger_kernel/transformers/__init__.py9CODE
LOWsrc/liger_kernel/transformers/__init__.py10CODE
LOWsrc/liger_kernel/transformers/__init__.py11CODE
LOWsrc/liger_kernel/transformers/__init__.py12CODE
LOWsrc/liger_kernel/transformers/__init__.py13CODE
LOWsrc/liger_kernel/transformers/__init__.py14CODE
LOWsrc/liger_kernel/transformers/__init__.py15CODE
LOWsrc/liger_kernel/transformers/__init__.py16CODE
LOWsrc/liger_kernel/transformers/__init__.py17CODE
LOWsrc/liger_kernel/transformers/__init__.py18CODE
LOWsrc/liger_kernel/transformers/__init__.py19CODE
LOWsrc/liger_kernel/transformers/__init__.py20CODE
LOWsrc/liger_kernel/transformers/__init__.py21CODE
260 more matches not shown…
Cross-File Repetition40 hits · 200 pts
SeverityFileLineSnippetContext
HIGHbenchmark/scripts/benchmark_rms_norm.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_swiglu.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_geglu.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_layer_norm.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_dyt.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_group_norm.py0create input tensor and layer from benchmark config.STRING
HIGHbenchmark/scripts/benchmark_poly_norm.py0create input tensor and layer from benchmark config.STRING
HIGH.agents/skills/liger-kernel-dev/templates/benchmark.md0create input tensor and layer from benchmark config.STRING
HIGHtest/convergence/fp32/test_mini_models_multimodal.py0create a mini version model the commented values are the original valuesSTRING
HIGHtest/convergence/fp32/test_mini_models_with_logits.py0create a mini version model the commented values are the original valuesSTRING
HIGHtest/convergence/fp32/test_mini_models.py0create a mini version model the commented values are the original valuesSTRING
HIGHtest/convergence/bf16/test_mini_models_multimodal.py0create a mini version model the commented values are the original valuesSTRING
HIGHtest/convergence/bf16/test_mini_models_with_logits.py0create a mini version model the commented values are the original valuesSTRING
HIGHtest/convergence/bf16/test_mini_models.py0create a mini version model the commented values are the original valuesSTRING
HIGHsrc/liger_kernel/transformers/model/olmo3.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/mistral.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/olmo2.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/ministral.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3_moe.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/nemotron.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/llama.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3_5.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/gemma2.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/glm4.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/hunyuan_v1.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3_5_moe.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/gemma3.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/gemma.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3_next.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen2.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/smollm3.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/mixtral.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/exaone4.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen2_vl.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen2_5_vl.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGHsrc/liger_kernel/transformers/model/qwen3_vl.py0labels (`torch.longtensor` of shape `(batch_size, sequence_length)`, *optional*): labels for computing the masked languaSTRING
HIGH…ops/backends/_ascend/ops/fused_linear_cross_entropy.py0calculate optimal block size using compute_default_tiling_strategySTRING
HIGHsrc/liger_kernel/ops/backends/_ascend/ops/jsd.py0calculate optimal block size using compute_default_tiling_strategySTRING
HIGHsrc/liger_kernel/ops/backends/_ascend/ops/dyt.py0calculate optimal block size using compute_default_tiling_strategySTRING
AI Structural Patterns103 hits · 102 pts
SeverityFileLineSnippetContext
LOW…mark/scripts/benchmark_fused_neighborhood_attention.py100CODE
LOWbenchmark/scripts/benchmark_model_configs.py448CODE
LOWbenchmark/scripts/benchmark_model_configs.py525CODE
LOWtest/transformers/test_flex_attention.py118CODE
LOWtest/transformers/test_cutedsl_cross_entropy.py76CODE
LOWtest/transformers/test_cutedsl_cross_entropy.py115CODE
LOWtest/transformers/test_fused_neighborhood_attention.py435CODE
LOWtest/transformers/test_fused_neighborhood_attention.py93CODE
LOWtest/transformers/test_fused_neighborhood_attention.py225CODE
LOWtest/transformers/test_poly_norm.py78CODE
LOWtest/transformers/test_fused_linear_cross_entropy.py37CODE
LOWtest/transformers/test_fused_linear_cross_entropy.py71CODE
LOWtest/chunked_loss/test_dpo_loss.py636CODE
LOWtest/chunked_loss/test_grpo_loss.py35CODE
LOWtest/chunked_loss/test_grpo_loss.py81CODE
LOWtest/chunked_loss/test_grpo_loss.py294CODE
LOWexamples/medusa/medusa_util.py130CODE
LOWsrc/liger_kernel/transformers/fsdp.py50CODE
LOWsrc/liger_kernel/transformers/cross_entropy.py10CODE
LOW…iger_kernel/transformers/fused_linear_cross_entropy.py10CODE
LOWsrc/liger_kernel/transformers/grpo_loss.py9CODE
LOWsrc/liger_kernel/transformers/functional.py44CODE
LOWsrc/liger_kernel/transformers/functional.py81CODE
LOW…er_kernel/transformers/fused_neighborhood_attention.py114CODE
LOW…er_kernel/transformers/fused_neighborhood_attention.py193CODE
LOW…er_kernel/transformers/fused_neighborhood_attention.py204CODE
LOWsrc/liger_kernel/transformers/model/olmo3.py15CODE
LOWsrc/liger_kernel/transformers/model/phi3.py15CODE
LOWsrc/liger_kernel/transformers/model/internvl.py17CODE
LOWsrc/liger_kernel/transformers/model/qwen2_vl.py34CODE
LOWsrc/liger_kernel/transformers/model/llama4.py15CODE
LOWsrc/liger_kernel/transformers/model/qwen3_vl_moe.py17CODE
LOWsrc/liger_kernel/transformers/model/mistral.py15CODE
LOWsrc/liger_kernel/transformers/model/deepseek_v4.py10CODE
LOWsrc/liger_kernel/transformers/model/olmo2.py13CODE
LOWsrc/liger_kernel/transformers/model/paligemma.py20CODE
LOWsrc/liger_kernel/transformers/model/qwen2_5_vl.py34CODE
LOWsrc/liger_kernel/transformers/model/ministral.py14CODE
LOWsrc/liger_kernel/transformers/model/qwen3_vl.py16CODE
LOWsrc/liger_kernel/transformers/model/gemma4.py25CODE
LOWsrc/liger_kernel/transformers/model/gemma4.py162CODE
LOWsrc/liger_kernel/transformers/model/qwen3_moe.py15CODE
LOWsrc/liger_kernel/transformers/model/nemotron.py16CODE
LOWsrc/liger_kernel/transformers/model/llava.py13CODE
LOWsrc/liger_kernel/transformers/model/mllama.py15CODE
LOWsrc/liger_kernel/transformers/model/llama.py24CODE
LOWsrc/liger_kernel/transformers/model/qwen3_5.py17CODE
LOWsrc/liger_kernel/transformers/model/qwen3_5.py129CODE
LOWsrc/liger_kernel/transformers/model/gemma2.py18CODE
LOWsrc/liger_kernel/transformers/model/glm4.py13CODE
LOWsrc/liger_kernel/transformers/model/smolvlm.py21CODE
LOWsrc/liger_kernel/transformers/model/hunyuan_v1.py12CODE
LOWsrc/liger_kernel/transformers/model/qwen3_5_moe.py18CODE
LOWsrc/liger_kernel/transformers/model/qwen3_5_moe.py161CODE
LOWsrc/liger_kernel/transformers/model/gemma3.py19CODE
LOWsrc/liger_kernel/transformers/model/gemma3.py152CODE
LOWsrc/liger_kernel/transformers/model/glm4v_moe.py12CODE
LOWsrc/liger_kernel/transformers/model/gpt_oss.py15CODE
LOWsrc/liger_kernel/transformers/model/gemma.py15CODE
LOWsrc/liger_kernel/transformers/model/qwen3_next.py18CODE
43 more matches not shown…
Structural Annotation Overuse51 hits · 88 pts
SeverityFileLineSnippetContext
LOW.agents/skills/liger-kernel-dev/validator.md7### Step 1: Checkstyle (Fast Gate)COMMENT
LOW.agents/skills/liger-kernel-dev/validator.md21### Step 2: Unit Tests (Hard Gate)COMMENT
LOW.agents/skills/liger-kernel-dev/validator.md42### Step 3: BenchmarksCOMMENT
LOW.agents/skills/liger-kernel-dev/validator.md51### Step 4: Generate PlotsCOMMENT
LOW.agents/skills/liger-kernel-dev/validator.md59### Step 5: Optional ncu ProfilingCOMMENT
LOW.agents/skills/liger-kernel-dev/validator.md78### Step 6: Report ResultsCOMMENT
LOW…ts/skills/liger-kernel-dev/templates/functional-api.md5### Step 1: Add ImportCOMMENT
LOW…ts/skills/liger-kernel-dev/templates/functional-api.md13### Step 2: Add FunctionCOMMENT
LOW.agents/skills/liger-autopatch/validator.md11### Step 1: Syntax CheckCOMMENT
LOW.agents/skills/liger-autopatch/validator.md17### Step 2: Instance Patching TestCOMMENT
LOW.agents/skills/liger-autopatch/validator.md32### Step 3: Convergence Tests (requires GPU)COMMENT
LOW.agents/skills/liger-autopatch/validator.md63### Step 4: CheckstyleCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md182### Step 1: Swap In the VariantCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md188### Step 2: Run a Minimal Correctness CheckCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md196### Step 3: Interpret ResultsCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md204### Step 4: Restore the OriginalCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md226### Step 1: Swap In the VariantCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md232### Step 2: Run the Full BenchmarkCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md240### Step 3: Capture ResultsCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md248### Step 4: Parse ResultsCOMMENT
LOW.agents/skills/liger-kernel-perf/optimizer.md259### Step 5: Restore the OriginalCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md14### Step 1: Set Up WorkspaceCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md20### Step 2: Detect GPU ArchitectureCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md34### Step 3: Run Baseline BenchmarksCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md48### Step 4: Check for NCU AvailabilityCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md79### Step 5: Analyze Kernel CodeCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md112### Step 6: Classify BottleneckCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md130### Step 7: Produce Optimization ProfileCOMMENT
LOW.agents/skills/liger-kernel-perf/profiler.md144### Step 8: Present to User (Interactive Mode)COMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md35### Step 1: Validate Inputs and Read ContextCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md47### Step 2: Apply the Winning VariantCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md57### Step 3: Run the Full Test Suite (HARD GATE)COMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md99### Step 4: Run CheckstyleCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md125### Step 5: Generate Comparison PlotsCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md209### Step 6: Generate the Final Optimization ReportCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md247### Step 7: Create Pull RequestCOMMENT
LOW.agents/skills/liger-kernel-perf/finalizer.md362### Step 8: Present the Before/After SummaryCOMMENT
LOW.github/workflows/benchmark.yml122 # Step 5: Checkout gh-pages branch in a subfolderAdd commentMore actionsCOMMENT
LOW.github/workflows/benchmark.yml129 # Step 6: Copy benchmark CSV to gh-pages directoryCOMMENT
LOW.github/workflows/benchmark.yml152 # Step 7: Append commit hash to commits.txt if not already presentCOMMENT
LOW.github/workflows/benchmark.yml164 # Step 7: Commit and pushCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py691 # Step 1: Get per-token log probs using existing Triton kernelCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py694 # Step 2: Compute sequence-level importance weightsCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py715 # Step 3: Run Triton kernel with pre-computed coefficientsCOMMENT
LOWsrc/liger_kernel/ops/backends/README.md61### Step 1: Create the directoryCOMMENT
LOWsrc/liger_kernel/ops/backends/README.md69### Step 2: Register the implementationCOMMENT
LOWsrc/liger_kernel/ops/backends/README.md88### Step 3: Ensure device detection worksCOMMENT
LOWsrc/liger_kernel/ops/backends/README.md103### Step 4: Implement the operatorsCOMMENT
LOWsrc/liger_kernel/ops/backends/README.md122### Step 5: Export from `ops/__init__.py`COMMENT
LOWsrc/liger_kernel/chunked_loss/fused_linear_ppo.py278 # Step 1: compute logprobs OUTSIDE compile (custom autograd, memory-efficient)COMMENT
LOWsrc/liger_kernel/chunked_loss/fused_linear_ppo.py298 # Step 2: compute loss INSIDE compile (just math, torch.compile-friendly)COMMENT
Excessive Try-Catch Wrapping89 hits · 79 pts
SeverityFileLineSnippetContext
LOWbenchmark/benchmarks_visualizer.py210 except Exception as e:CODE
LOWbenchmark/benchmarks_visualizer.py356 except Exception:CODE
LOWtest/triton/test_triton_monkey_patch.py13 except Exception:CODE
MEDIUMtest/triton/test_triton_monkey_patch.py10def test_import_from_root():CODE
LOWtest/transformers/test_llama4_rope.py16except Exception:CODE
LOWtest/transformers/test_qwen2vl_mrope.py12except Exception:CODE
MEDIUMtest/transformers/test_monkey_patch.py60def is_mllama_available():CODE
LOWtest/transformers/test_monkey_patch.py311 except Exception:CODE
LOWtest/transformers/test_monkey_patch.py512 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py609 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py706 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py774 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py883 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py992 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1072 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1147 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1242 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1287 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1333 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1384 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1478 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1517 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1560 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1609 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1663 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1702 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1749 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1808 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1861 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py1959 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2027 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2110 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2149 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2191 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2241 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2310 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2379 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2430 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2499 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2568 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2619 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2683 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2759 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2798 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2844 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2890 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py2936 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3006 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3121 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3162 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3231 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3298 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3406 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3458 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3507 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3586 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3637 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3680 except Exception as e:CODE
LOWtest/transformers/test_monkey_patch.py3720 except Exception as e:CODE
LOWtest/transformers/test_trainer_integration.py7 except Exception:CODE
29 more matches not shown…
Deep Nesting95 hits · 78 pts
SeverityFileLineSnippetContext
LOWsetup.py10CODE
LOWsetup.py100CODE
LOWbenchmark/benchmarks_visualizer.py177CODE
LOWbenchmark/scripts/benchmark_mhc.py29CODE
LOWbenchmark/scripts/benchmark_tvd.py24CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py162CODE
LOWbenchmark/scripts/benchmark_tiled_mlp.py61CODE
LOWbenchmark/scripts/utils.py117CODE
LOWbenchmark/scripts/utils.py276CODE
LOWbenchmark/scripts/utils.py375CODE
LOWbenchmark/scripts/benchmark_model_configs.py525CODE
LOWbenchmark/scripts/benchmark_megatron_rms_norm.py69CODE
LOWbenchmark/scripts/benchmark_megatron_cross_entropy.py105CODE
LOWbenchmark/scripts/benchmark_megatron_cross_entropy.py184CODE
LOWtest/convergence/fp32/test_mini_models_multimodal.py1181CODE
LOWtest/convergence/bf16/test_mini_models_multimodal.py1064CODE
LOWtest/transformers/test_tvd.py16CODE
LOWtest/transformers/test_monkey_patch.py517CODE
LOWtest/transformers/test_monkey_patch.py614CODE
LOWtest/transformers/test_monkey_patch.py711CODE
LOWtest/transformers/test_monkey_patch.py779CODE
LOWtest/transformers/test_monkey_patch.py888CODE
LOWtest/transformers/test_monkey_patch.py997CODE
LOWtest/transformers/test_monkey_patch.py1564CODE
LOWtest/transformers/test_monkey_patch.py2196CODE
LOWtest/transformers/test_monkey_patch.py3011CODE
LOWtest/transformers/test_monkey_patch.py3167CODE
LOWtest/transformers/test_monkey_patch.py3236CODE
LOWtest/transformers/test_monkey_patch.py3349CODE
LOWtest/transformers/test_monkey_patch.py3411CODE
LOWtest/transformers/test_monkey_patch.py3591CODE
LOWtest/transformers/test_grpo_loss.py484CODE
LOWtest/transformers/test_grpo_loss.py713CODE
LOWtest/chunked_loss/test_dpo_loss.py919CODE
LOWtest/chunked_loss/test_grpo_loss.py1057CODE
LOWtest/chunked_loss/test_grpo_loss.py81CODE
LOWtest/chunked_loss/test_grpo_loss.py203CODE
LOWexamples/medusa/callback.py363CODE
LOWexamples/medusa/train.py131CODE
LOWsrc/liger_kernel/utils.py17CODE
LOWsrc/liger_kernel/transformers/grpo_loss.py9CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py432CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py523CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py799CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1064CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1151CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1243CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1722CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1860CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py1955CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2044CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2123CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2479CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2568CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2672CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py2956CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py3057CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py3154CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py3315CODE
LOWsrc/liger_kernel/ops/cross_entropy.py31CODE
35 more matches not shown…
Cross-Language Confusion7 hits · 32 pts
SeverityFileLineSnippetContext
HIGHsrc/liger_kernel/transformers/jsd.py11 JSD(\beta)(P || Q)CODE
HIGHsrc/liger_kernel/transformers/jsd.py17 This differs from the standard mathematical notation :math:`JSD(P || Q)` whereCODE
HIGHsrc/liger_kernel/ops/jsd.py146 JSD(\beta)(P || Q)CODE
HIGHsrc/liger_kernel/ops/jsd.py153 This differs from the standard mathematical notation :math:`JSD(P || Q)` whereCODE
HIGHsrc/liger_kernel/ops/backends/_ascend/ops/jsd.py174 JSD(\beta)(P || Q)CODE
HIGHsrc/liger_kernel/ops/backends/_ascend/ops/jsd.py181 This differs from the standard mathematical notation :math:`JSD(P || Q)` whereCODE
HIGHsrc/liger_kernel/ops/cutile/ops/kl_div.py8Computes KL(y_true || y_pred) where y_pred is in log-space.STRING
AI Slop Vocabulary8 hits · 20 pts
SeverityFileLineSnippetContext
LOWbenchmark/scripts/benchmark_embedding.py24# NOTE: For torch compile, we will just use default inductor settings. No further customizationCOMMENT
LOWtest/megatron/test_monkey_patch.py499 # Skip Liger kernel — just return a CPU-friendly tensor in the right shape.COMMENT
MEDIUMsrc/liger_kernel/triton/monkey_patch.py20 # use temp dir to be robust against program interruptionsCOMMENT
MEDIUMsrc/liger_kernel/transformers/monkey_patch.py1360 # also drop the MagicMock the test harness substitutes forCOMMENT
MEDIUMsrc/liger_kernel/ops/backends/_ascend/ops/softmax.py243 # Calculate optimal ROWS_PER_BLOCK to utilize UB efficientlyCOMMENT
MEDIUMsrc/liger_kernel/chunked_loss/dpo_loss.py98 # cDPO / robust loss: assumes a fraction `label_smoothing` of preference labels are flipped.COMMENT
MEDIUM…ernel/chunked_loss/fused_linear_unpaired_preference.py66 # TODO: Tune CHUNK_SIZE to fully utilize the GPUCOMMENT
MEDIUM…c/liger_kernel/chunked_loss/fused_linear_preference.py70 # TODO: Tune CHUNK_SIZE to fully utilize the GPUCOMMENT
Over-Commented Block21 hits · 20 pts
SeverityFileLineSnippetContext
LOWtest/convergence/bf16/test_mini_models_with_logits.py2001 # 1e-3,COMMENT
LOWtest/convergence/bf16/test_mini_models.py2261 # "mini_mixtral",COMMENT
LOWtest/convergence/bf16/test_mini_models.py2301 ),COMMENT
LOWtest/megatron/test_monkey_patch.py581 )COMMENT
LOWexamples/medusa/callback.py281 self.state.elapsed_tokens_seen / self.state.elapsed_time,COMMENT
LOWexamples/medusa/callback.py301 # total_flos = sum(current_flos) # across all GPUsCOMMENT
LOWexamples/medusa/train.py1# This code is based on tatsu-lab/stanford_alpaca. Below is the original copyright:COMMENT
LOWsrc/liger_kernel/transformers/functional.py421 # In practice, these come from your transformer layersCOMMENT
LOWsrc/liger_kernel/transformers/model/pixtral.py1# Pixtral vision encoder does not require a custom forward function.COMMENT
LOWsrc/liger_kernel/ops/cross_entropy.py181 # = log (e^(max(X)) * sum(e ^ (X_i - max(X))))COMMENT
LOWsrc/liger_kernel/ops/mhc.py181 )COMMENT
LOWsrc/liger_kernel/ops/fused_moe_kernels.py1# Triton kernels for fused MoE expert computation.COMMENT
LOWsrc/liger_kernel/ops/fused_moe_kernels.py21COMMENT
LOWsrc/liger_kernel/ops/cutedsl/ops/cross_entropy.py361 g_am = fmax(g_am, aw)COMMENT
LOWsrc/liger_kernel/ops/cutedsl/ops/cross_entropy.py421COMMENT
LOWsrc/liger_kernel/ops/cutedsl/ops/cross_entropy.py621 has_weight = weight is not NoneCOMMENT
LOW…ernel/ops/backends/_ascend/ascend-ub-manager-design.md481# - tiling_dims: (0,) means first dimension can be tiledCOMMENT
LOWsrc/liger_kernel/ops/backends/_ascend/ops/tvd.py81 tl.store(loss_row_ptr, loss_sum)COMMENT
LOW…liger_kernel/ops/backends/_ascend/ops/qwen2vl_mrope.py121 # * k_left: BLOCK_K * (pad_hd // 2) elementsCOMMENT
LOWsrc/liger_kernel/ops/backends/_ascend/ops/rope.py101 # - cos_vals and sin_vals are loaded once outside loops (shared): pad_hd // 2 elements eachCOMMENT
LOWsrc/liger_kernel/megatron/rms_norm.py61 hidden_size = (hidden_size,)COMMENT
Verbosity Indicators9 hits · 16 pts
SeverityFileLineSnippetContext
LOW.github/workflows/benchmark.yml122 # Step 5: Checkout gh-pages branch in a subfolderAdd commentMore actionsCOMMENT
LOW.github/workflows/benchmark.yml129 # Step 6: Copy benchmark CSV to gh-pages directoryCOMMENT
LOW.github/workflows/benchmark.yml152 # Step 7: Append commit hash to commits.txt if not already presentCOMMENT
LOW.github/workflows/benchmark.yml164 # Step 7: Commit and pushCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py691 # Step 1: Get per-token log probs using existing Triton kernelCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py694 # Step 2: Compute sequence-level importance weightsCOMMENT
LOWsrc/liger_kernel/ops/grpo_loss.py715 # Step 3: Run Triton kernel with pre-computed coefficientsCOMMENT
LOWsrc/liger_kernel/chunked_loss/fused_linear_ppo.py278 # Step 1: compute logprobs OUTSIDE compile (custom autograd, memory-efficient)COMMENT
LOWsrc/liger_kernel/chunked_loss/fused_linear_ppo.py298 # Step 2: compute loss INSIDE compile (just math, torch.compile-friendly)COMMENT
Docstring Block Structure3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHbenchmark/benchmarks_visualizer.py270Loads the benchmark data from the CSV file and filters it based on the configuration. Applies filters in order: kerSTRING
HIGHsrc/liger_kernel/ops/backends/registry.py75 Select the implementation for the current device. Args: device: Device type from ``infer_device()`` (eSTRING
HIGHsrc/liger_kernel/ops/backends/_ascend/ub_manager.py256 Compute tiling strategy using the default strategy function. This function directly calls the default strategySTRING
Redundant / Tautological Comments10 hits · 15 pts
SeverityFileLineSnippetContext
LOWtest/utils.py163 # Check if the shapes of the tensors matchCOMMENT
LOWtest/utils.py195 # Check if all elements are closeCOMMENT
LOWtest/transformers/test_swiglu.py417 # Check if gradients are close for xCOMMENT
LOWtest/transformers/test_mm_int8int2.py62 # Print the results (optional, can be commented out)COMMENT
LOWtest/transformers/test_mm_int8int2.py66 # Check if outputs are close within the given tolerancesCOMMENT
LOWtest/transformers/test_monkey_patch.py59# Check if optional modules are availableCOMMENT
LOWexamples/medusa/train.py170 # Set everything to be ignored, except the assistant partCOMMENT
LOWsrc/liger_kernel/transformers/__init__.py86# Check if 'transformers' is installedCOMMENT
LOWsrc/liger_kernel/transformers/monkey_patch.py69 # Check if the module is a PEFT ModulesToSaveWrapperCOMMENT
LOWsrc/liger_kernel/transformers/monkey_patch.py104 # Check if the module is a PEFT ModulesToSaveWrapperCOMMENT
Modern Structural Boilerplate10 hits · 10 pts
SeverityFileLineSnippetContext
LOWsrc/liger_kernel/transformers/auto_model.py10logger = logging.getLogger(__name__)CODE
LOWsrc/liger_kernel/transformers/__init__.py173__all__ = [CODE
LOWsrc/liger_kernel/transformers/monkey_patch.py51logger = logging.getLogger(__name__)CODE
LOWsrc/liger_kernel/transformers/experimental/__init__.py3__all__ = [CODE
LOWsrc/liger_kernel/transformers/model/gemma2.py15logger = logging.getLogger(__name__)CODE
LOWsrc/liger_kernel/ops/cutedsl/ops/__init__.py21__all__ = [CODE
LOWsrc/liger_kernel/ops/backends/_ascend/ops/__init__.py90__all__ = [CODE
LOWsrc/liger_kernel/ops/cutile/ops/__init__.py44__all__ = [CODE
LOWsrc/liger_kernel/megatron/__init__.py24__all__ = [CODE
LOWsrc/liger_kernel/megatron/monkey_patch.py7logger = logging.getLogger(__name__)CODE
Self-Referential Comments3 hits · 9 pts
SeverityFileLineSnippetContext
MEDIUMbenchmark/scripts/benchmark_tiled_mlp.py148 # Define the MLP forward function for DeepSpeed TiledMLPCOMMENT
MEDIUMexamples/medusa/medusa_util.py109 # Create a list of Medusa headsCOMMENT
MEDIUMexamples/medusa/train.py282 # Create the train and eval datasetsCOMMENT
Slop Phrases5 hits · 5 pts
SeverityFileLineSnippetContext
LOWsrc/liger_kernel/transformers/model/qwen3_moe.py134 loss += self.router_aux_loss_coef * aux_loss.to(loss.device) # make sure to reside in the same deviceCODE
LOWsrc/liger_kernel/transformers/model/qwen3_5_moe.py137 loss += self.router_aux_loss_coef * aux_loss.to(loss.device) # make sure to reside in the same deviceCODE
LOWsrc/liger_kernel/transformers/model/gpt_oss.py201 loss += self.router_aux_loss_coef * aux_loss.to(loss.device) # make sure to reside in the same deviceCODE
LOWsrc/liger_kernel/transformers/model/qwen3_next.py135 loss += self.router_aux_loss_coef * aux_loss.to(loss.device) # make sure to reside in the same deviceCODE
LOWsrc/liger_kernel/transformers/model/mixtral.py144 loss += self.router_aux_loss_coef * aux_loss.to(loss.device) # make sure to reside in the same deviceCODE
Modern AI Meta-Vocabulary1 hit · 4 pts
SeverityFileLineSnippetContext
MEDIUM…s/backends/_ascend/ops/fused_neighborhood_attention.py1821# Backward orchestrationCOMMENT
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOWtest/resources/scripts/generate_tokenized_dataset.py39 # Example usage:COMMENT