Repository Analysis

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

18.2 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of sgl-project/sglang, a Python project with 30,284 GitHub stars. SynthScan v2.0 examined 1,868,365 lines of code across 6345 source files, recording 26429 pattern matches distributed across 25 syntactic categories. The overall adjusted score of 18.2 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

18.2
Adjusted Score
18.2
Raw Score
100%
Time Factor
2026-07-14
Last Push
30.3K
Stars
Python
Language
1.9M
Lines of Code
6.3K
Files
26.4K
Pattern Hits
2026-07-14
Scan Date
0.08
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 8HIGH 470MEDIUM 2665LOW 23286

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 26429 distinct pattern matches across 25 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers13875 hits · 13623 pts
SeverityFileLineSnippetContext
LOWbenchmark/dspy/bench_dspy_intro.py136 def validate_context_and_answer(example, pred, trace=None):CODE
LOW…ing_window_attention_triton/bench_triton_swa_kernel.py11def extend_attention_fwd_torch(CODE
LOWbenchmark/kernels/all_gather/benchmark_aiter.py175def expected_logical_all_gather(CODE
LOWbenchmark/kernels/all_gather/benchmark_aiter.py230def install_aiter_aot_import_shims() -> None:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py122def cleanup_flashinfer_workspace(ipc_handles):CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py85def setup_flashinfer_workspace(CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py153 def get_trtllm_fused_allreduce_kwargs(self):CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py163def flashinfer_fused_allreduce_rmsnorm(CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py288def standard_allreduce_rmsnorm(CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py398def standard_allreduce_rmsnorm_native(CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py479def standard_allreduce_rmsnorm_native_compiled(CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py895def prepare_results_with_speedups(results_dict):CODE
LOW…uler_batch/benchmark_write_req_to_token_pool_triton.py12def write_req_to_token_pool_triton(CODE
LOW…uler_batch/benchmark_write_req_to_token_pool_triton.py49def write_req_to_token_pool_triton_optimize(CODE
LOW…uler_batch/benchmark_write_req_to_token_pool_triton.py91def write_req_to_token_pool_reference(CODE
LOW…uler_batch/benchmark_write_req_to_token_pool_triton.py114def test_write_req_to_token_pool():CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py24def calculate_shard_intermediate_size(CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py209def get_rocm_configs_compute_bound() -> List[Dict[str, int]]:CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py232def get_configs_compute_bound() -> List[Dict[str, int]]:CODE
LOW…pseek/benchmark_deepgemm_dsv3_router_gemm_blackwell.py137def get_benchmark_plot_friendly(tp_sizes):CODE
LOW…nels/deepseek/benchmark_deepgemm_fp8_gemm_blackwell.py231def get_benchmark_plot_friendly(tp_size):CODE
LOW…hmark/kernels/quantization/tuning_block_wise_kernel.py148def get_rocm_configs_compute_bound():CODE
LOW…hmark/kernels/quantization/tuning_block_wise_kernel.py171def get_configs_compute_bound():CODE
LOW…s/decoding_attention_triton/triton_flashinfer_cudnn.py98def decode_attention_flashinfer(dtype, head_num_q, head_num_kv):CODE
LOWbenchmark/mmmu/bench_sglang.py127async def process_sample_with_semaphore(CODE
LOWbenchmark/mmmu/eval_utils.py292def _parse_explicit_multi_choice_answer(response, all_choices):CODE
LOWbenchmark/mmmu/eval_utils.py303def parse_multi_choice_response(response, all_choices, index2ans):CODE
LOW…hmark/bench_pynccl_allocator/bench_segment_tracking.py56def bench_register_segments_with_comm(CODE
LOW…hmark/bench_pynccl_allocator/bench_segment_tracking.py114def bench_with_various_segment_counts(CODE
LOWbenchmark/ocr/eval_utils.py440def eval_math_formula_accuracy(test: dict, ocr_output: str) -> bool:CODE
LOWbenchmark/scheduler/bench_token_storage.py84def _batch_tensor_from_pyarrays(parts: list[array]) -> torch.Tensor:CODE
LOWbenchmark/scheduler/bench_token_storage.py256def microbench_torch_tensor_paths(CODE
LOWbenchmark/hicache/bench_mix.py299async def async_request_sglang_generate(CODE
LOWbenchmark/hicache/bench_warm_cache.py90def _create_bench_client_session() -> aiohttp.ClientSession:CODE
LOWbenchmark/hicache/bench_warm_cache.py97async def async_request_sglang_generate(CODE
LOWbenchmark/hicache/bench_warm_cache.py413def maybe_write_summary_jsonl(CODE
LOWbenchmark/hicache/bench_warm_cache.py472async def benchmark_shared_prefix_pct(CODE
LOWbenchmark/hicache/bench_serving.py71async def async_request_openai_completions(CODE
LOWbenchmark/hicache/data_processing.py150def sample_ultrachat_requests(CODE
LOWbenchmark/hicache/data_processing.py434def sample_generated_shared_prefix_requests(CODE
LOWbenchmark/hicache/bench_hicache_write_back.py69def _validate_mha_correctness(CODE
LOWbenchmark/hicache/bench_hicache_write_back.py88def _validate_mla_correctness(CODE
LOWbenchmark/prefill_only/bench_score.py65def create_score_request_builder():CODE
LOWbenchmark/prefill_only/bench_score.py80 def generate_text_with_token_count_local(num_toks):CODE
LOWbenchmark/prefill_only/bench_score.py120def build_warmup_score_request() -> dict:CODE
LOWbenchmark/prefill_only/util.py46def generate_text_with_token_count(CODE
LOWbenchmark/prefill_only/util.py106def prepare_all_requests_parallel(CODE
LOWbenchmark/prefill_only/util.py398async def perform_global_warmup_and_freeze(CODE
LOWbenchmark/prefill_only/bench_embeddings.py100def validate_embeddings_response(response_data: dict) -> bool:CODE
LOWbenchmark/prefill_only/bench_embeddings.py110def build_warmup_embeddings_request() -> dict:CODE
LOW…nchmark/bench_in_batch_prefix/bench_in_batch_prefix.py76def test_batch_by_batch_with_hint(all_prompts, gen_len):CODE
LOWbenchmark/asr/bench_sglang.py55def run_asr_transcription_sync(client, model_name, y, sr, language=None):CODE
LOWbenchmark/asr/bench_sglang.py75def run_asr_transcription_stream_sync(CODE
LOWbenchmark/benchmark_batch/benchmark_tokenizer.py179def generate_random_token_ids(*, num_prompts, num_tokens, tokenizer):CODE
LOWbenchmark/lora/lora_bench.py48async def async_request_openai_completions(CODE
LOW…ark/bench_linear_attention/bench_cutedsl_kda_decode.py155def run_prefill_then_decode_baseline(inp):CODE
LOW…ark/bench_linear_attention/bench_cutedsl_kda_decode.py191def run_prefill_then_decode_cutedsl(inp):CODE
LOWbenchmark/generative_agents/agent_functions.py56def generate_event_triple_prompt(persona_name, action):CODE
LOWbenchmark/generative_agents/agent_functions.py89def generate_pronunciatio_prompt(action):CODE
LOWbenchmark/generative_agents/agent_functions.py158def action_location_sector_prompt(CODE
13815 more matches not shown…
Decorative Section Separators2144 hits · 6986 pts
SeverityFileLineSnippetContext
MEDIUM…hmark/kernels/quantization/tuning_block_wise_kernel.py13# ==============================================================================COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py128# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py130# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py181# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py183# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py333# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py335# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py390# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py392# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py367# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py369# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py372# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py374# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py54# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py56# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py67# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py86# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py88# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py214# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py216# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py263# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py265# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py310# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py312# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py565# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py567# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py625# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/bench_sglang.py627# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py30# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py32# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py75# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py77# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py273# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py275# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/ocr/generate_report.py322# ---------------------------------------------------------------------------STRING
MEDIUMbenchmark/ocr/generate_report.py324# ---------------------------------------------------------------------------STRING
MEDIUMbenchmark/ocr/eval_utils.py22# ── Unicode normalization ─────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py50# ── Matching helpers ──────────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py96# ── olmOCR-bench test evaluators ─────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py190# ── Table parsing helpers ─────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py291 # ── 1. Structured tables (HTML <tr>/<td> or Markdown) ────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py342 # ── 2. Flat <table>…</table> fallback (DeepSeek-OCR-2 format) ────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py429# Math formula evaluation ─────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py467# ── Main dispatcher ───────────────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py510# ── Aggregation & reporting ───────────────────────────────────────────────────COMMENT
MEDIUMbenchmark/ocr/eval_utils.py602# ── Normalized Edit Distance (OmniDocBench-style text quality metric) ─────────COMMENT
MEDIUMbenchmark/lora/lora_bench.py13# ==============================================================================COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py39# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py41# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py89# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py91# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py155# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py157# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py206# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py208# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py299# ---------------------------------------------------------------------------COMMENT
MEDIUMbenchmark/bench_linear_attention/bench_gdn_decode.py301# ---------------------------------------------------------------------------COMMENT
MEDIUM…rk/bench_linear_attention/bench_kda_prefill_cutedsl.py49# ---------------------------------------------------------------------------COMMENT
MEDIUM…rk/bench_linear_attention/bench_kda_prefill_cutedsl.py51# ---------------------------------------------------------------------------COMMENT
2084 more matches not shown…
Unused Imports2672 hits · 2496 pts
SeverityFileLineSnippetContext
LOWbenchmark/kernels/all_gather/benchmark_aiter.py16CODE
LOW…ls/deepseek/benchmark_cute_dsl_fp8_paged_mqa_logits.py3CODE
LOWbenchmark/scheduler/bench_token_storage.py25CODE
LOWbenchmark/hicache/perf.py1CODE
LOWbenchmark/hicache/bench_hicache_write_back.py1CODE
LOWbenchmark/bench_linear_attention/bench_gdn_qkv_split.py1CODE
LOW…router/tests/scripts/generate_kv_events_hash_parity.py48CODE
LOW…perimental/sgl-router/tests/e2e/test_tokenize_smoke.py5CODE
LOWexperimental/sgl-router/tests/e2e/conftest.py21CODE
LOWexperimental/sgl-router/tests/e2e/test_chat_smoke.py5CODE
LOWexperimental/sgl-router/tests/e2e/test_chat_smoke.py8CODE
LOWexperimental/sgl-router/tests/e2e/infra/gateway.py25CODE
LOWexperimental/sgl-router/tests/e2e/infra/model_specs.py16CODE
LOWexperimental/sgl-router/tests/e2e/infra/model_pool.py19CODE
LOW…al/sgl-router/tests/e2e/k8s_integration/fake_worker.py10CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_lifecycle.py14CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_lifecycle.py16CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_lifecycle.py19CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_lifecycle.py20CODE
LOW…ental/sgl-router/tests/e2e/k8s_integration/conftest.py12CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_discovery.py8CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_discovery.py11CODE
LOW…sgl-router/tests/e2e/k8s_integration/test_discovery.py12CODE
LOW…uter/tests/e2e/k8s_integration/test_cross_namespace.py15CODE
LOW…uter/tests/e2e/k8s_integration/test_cross_namespace.py18CODE
LOW…outer/tests/e2e/k8s_integration/test_reconciliation.py16CODE
LOW…outer/tests/e2e/k8s_integration/test_reconciliation.py18CODE
LOW…l-router/tests/e2e/chat_completions/test_validation.py14CODE
LOW…r/tests/e2e/chat_completions/test_load_based_policy.py6CODE
LOW…ts/e2e/chat_completions/test_two_router_convergence.py38CODE
LOWtest/manual/test_ray_engine.py25CODE
LOWtest/manual/quant/test_block_fp8.py679CODE
LOWtest/manual/layers/moe/bench_mxfp4_sm90_kernels.py21CODE
LOWtest/manual/kv_canary/test_self_e2e_baseline_dsv4.py1CODE
LOWtest/manual/hicache/test_pp_with_hicache.py79CODE
LOWtest/registered/kernels/test_gemma4_fused_routing.py12CODE
LOWtest/registered/kernels/test_sm120_paged_mqa_logits.py18CODE
LOWtest/registered/kernels/test_flash_mla_backends.py22CODE
LOWtest/registered/attention/test_kda_prefill_flashkda.py34CODE
LOW…ion/unittests/dual_chunk/test_dual_chunk_flash_attn.py50CODE
LOW…ed/unit/layers/quantization/test_mxfp4_sm90_cutlass.py14CODE
LOW…ed/unit/layers/quantization/test_mxfp4_sm90_cutlass.py174CODE
LOW…unit/hardware_backend/mlx/test_runner_init_contract.py8CODE
LOW…tered/unit/hardware_backend/mlx/test_mlx_pool_dtype.py17CODE
LOW…hardware_backend/mlx/test_mlx_quantization_override.py7CODE
LOW…d/unit/hardware_backend/mlx/test_attention_patching.py3CODE
LOW…ered/unit/hardware_backend/mlx/test_scheduler_mixin.py14CODE
LOW…istered/unit/hardware_backend/mlx/test_quantization.py13CODE
LOW…hardware_backend/mlx/test_mlx_reference_correctness.py36CODE
LOW…ed/unit/hardware_backend/mlx/test_tp_worker_routing.py28CODE
LOW…tered/unit/hardware_backend/mlx/test_metal_profiler.py14CODE
LOW…/hardware_backend/mlx/test_mlx_runner_pool_contract.py13CODE
LOWtest/registered/unit/distributed/test_parallel_state.py37CODE
LOWtest/registered/unit/distributed/test_vmm_utils.py12CODE
LOW…stered/unit/managers/test_customized_info_streaming.py1CODE
LOW…t/registered/unit/scripted_runtime/test_http_server.py1CODE
LOW…red/unit/scripted_runtime/test_tokenizer_recv_proxy.py1CODE
LOW…d/unit/scripted_runtime/test_background_http_poster.py1CODE
LOW…d/unit/scripted_runtime/test_scripted_runtime_utils.py1CODE
LOW…egistered/unit/scripted_runtime/test_scheduler_hook.py1CODE
2612 more matches not shown…
Cross-File Repetition399 hits · 1995 pts
SeverityFileLineSnippetContext
HIGH…hmark/kernels/quantization/tuning_block_wise_kernel.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGHpython/sglang/kernels/ops/quantization/int8_kernel.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGHpython/sglang/kernels/ops/quantization/fp8_kernel.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGHbenchmark/tree_of_thought_v0/bench_sglang.py0please generate a high-level plan for solving the following question. as the first step, just say what method and idea ySTRING
HIGHbenchmark/tree_of_thought_v0/bench_other.py0please generate a high-level plan for solving the following question. as the first step, just say what method and idea ySTRING
HIGHbenchmark/tree_of_thought_deep/bench_sglang.py0please generate a high-level plan for solving the following question. as the first step, just say what method and idea ySTRING
HIGHbenchmark/tree_of_thought_deep/lmql_funcs.py0please generate a high-level plan for solving the following question. as the first step, just say what method and idea ySTRING
HIGHbenchmark/tree_of_thought_deep/bench_other.py0please generate a high-level plan for solving the following question. as the first step, just say what method and idea ySTRING
HIGHbenchmark/tree_of_thought_v0/bench_sglang.py0the plan looks good! now, use real numbers and do the calculation. please solve the question step-by-step according to tSTRING
HIGHbenchmark/tree_of_thought_v0/bench_other.py0the plan looks good! now, use real numbers and do the calculation. please solve the question step-by-step according to tSTRING
HIGHbenchmark/tree_of_thought_deep/bench_sglang.py0the plan looks good! now, use real numbers and do the calculation. please solve the question step-by-step according to tSTRING
HIGHbenchmark/tree_of_thought_deep/lmql_funcs.py0the plan looks good! now, use real numbers and do the calculation. please solve the question step-by-step according to tSTRING
HIGHbenchmark/tree_of_thought_deep/bench_other.py0the plan looks good! now, use real numbers and do the calculation. please solve the question step-by-step according to tSTRING
HIGHbenchmark/tree_of_thought_v0/bench_sglang.py0okay. now, evaluate your own solution and give it a score on a scale of 1 to 5. please do rigorous check of the correctnSTRING
HIGHbenchmark/tree_of_thought_v0/bench_other.py0okay. now, evaluate your own solution and give it a score on a scale of 1 to 5. please do rigorous check of the correctnSTRING
HIGHbenchmark/tree_of_thought_deep/bench_sglang.py0okay. now, evaluate your own solution and give it a score on a scale of 1 to 5. please do rigorous check of the correctnSTRING
HIGHbenchmark/tree_of_thought_deep/lmql_funcs.py0okay. now, evaluate your own solution and give it a score on a scale of 1 to 5. please do rigorous check of the correctnSTRING
HIGHbenchmark/tree_of_thought_deep/bench_other.py0okay. now, evaluate your own solution and give it a score on a scale of 1 to 5. please do rigorous check of the correctnSTRING
HIGHbenchmark/tip_suggestion/bench_sglang.py0please expand a tip for a topic into a detailed paragraph. topic: staying healthy tip: regular exercise paragraph: incorSTRING
HIGHbenchmark/tip_suggestion/lmql_funcs.py0please expand a tip for a topic into a detailed paragraph. topic: staying healthy tip: regular exercise paragraph: incorSTRING
HIGHbenchmark/tip_suggestion/bench_other.py0please expand a tip for a topic into a detailed paragraph. topic: staying healthy tip: regular exercise paragraph: incorSTRING
HIGHbenchmark/json_jump_forward/bench_sglang.py0"house": "(gryffindor|slytherin|ravenclaw|hufflepuff)",\nSTRING
HIGHbenchmark/json_jump_forward/bench_other.py0"house": "(gryffindor|slytherin|ravenclaw|hufflepuff)",\nSTRING
HIGHexamples/frontend_language/usage/json_decode.py0"house": "(gryffindor|slytherin|ravenclaw|hufflepuff)",\nSTRING
HIGHbenchmark/json_jump_forward/bench_sglang.py0"blood status": "(pure-blood|half-blood|muggle-born)",\nSTRING
HIGHbenchmark/json_jump_forward/bench_other.py0"blood status": "(pure-blood|half-blood|muggle-born)",\nSTRING
HIGHexamples/frontend_language/usage/json_decode.py0"blood status": "(pure-blood|half-blood|muggle-born)",\nSTRING
HIGHbenchmark/json_jump_forward/bench_sglang.py0"occupation": "(student|teacher|auror|ministry of magic|death eater|order of the phoenix)",\nSTRING
HIGHbenchmark/json_jump_forward/bench_other.py0"occupation": "(student|teacher|auror|ministry of magic|death eater|order of the phoenix)",\nSTRING
HIGHexamples/frontend_language/usage/json_decode.py0"occupation": "(student|teacher|auror|ministry of magic|death eater|order of the phoenix)",\nSTRING
HIGHbenchmark/tree_of_thought_deep/bench_sglang.py0based on your reflection, do you change your mind? now, give me the final answer after careful consideration.STRING
HIGHbenchmark/tree_of_thought_deep/lmql_funcs.py0based on your reflection, do you change your mind? now, give me the final answer after careful consideration.STRING
HIGHbenchmark/tree_of_thought_deep/bench_other.py0based on your reflection, do you change your mind? now, give me the final answer after careful consideration.STRING
HIGH…ph/test_piecewise_cuda_graph_support_1_gpu_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/quant/test_nvfp4_gemm_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/quant/test_awq_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/distributed/test_dp_attention_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGH…/manual/models/test_nvidia_nemotron_3_nano_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/mla/test_mla_flashinfer_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/mla/test_flashmla_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/mla/test_mla_int8_deepseek_v3_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGH…al/4-gpu-models/test_qwen3_next_models_mtp_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/4-gpu-models/test_qwen35_models_archived.py0archived test classes split out of test/registered/4-gpu-models/test_qwen35_models.py. originally registered with `regisSTRING
HIGHtest/manual/quant/test_block_fp8.py0this function performs matrix multiplication with block-wise quantization using native torch. it takes two input tensorsSTRING
HIGHtest/manual/quant/test_block_fp8_deep_gemm_blackwell.py0this function performs matrix multiplication with block-wise quantization using native torch. it takes two input tensorsSTRING
HIGHtest/registered/quant/test_block_int8.py0this function performs matrix multiplication with block-wise quantization using native torch. it takes two input tensorsSTRING
HIGHtest/manual/nightly/test_vlms_vit_cuda_graph.py0evaluate a vlm on the mmmu validation set with lmms-eval. only `model_version` (checkpoint) and `chat_template` vary; weSTRING
HIGHtest/manual/nightly/test_vlms_vit_flashinfer_cudnn.py0evaluate a vlm on the mmmu validation set with lmms-eval. only `model_version` (checkpoint) and `chat_template` vary; weSTRING
HIGHtest/manual/nightly/test_vlms_piecewise_cuda_graph.py0evaluate a vlm on the mmmu validation set with lmms-eval. only `model_version` (checkpoint) and `chat_template` vary; weSTRING
HIGHpython/sglang/test/kits/mmmu_vlm_kit.py0evaluate a vlm on the mmmu validation set with lmms-eval. only `model_version` (checkpoint) and `chat_template` vary; weSTRING
HIGHtest/manual/nightly/test_vlms_vit_cuda_graph.py0common method to run vlm mmmu benchmark test. args: model: model to test output_path: path for output logs test_name: opSTRING
HIGHtest/manual/nightly/test_vlms_vit_flashinfer_cudnn.py0common method to run vlm mmmu benchmark test. args: model: model to test output_path: path for output logs test_name: opSTRING
HIGHtest/manual/nightly/test_vlms_piecewise_cuda_graph.py0common method to run vlm mmmu benchmark test. args: model: model to test output_path: path for output logs test_name: opSTRING
HIGHpython/sglang/test/kits/mmmu_vlm_kit.py0common method to run vlm mmmu benchmark test. args: model: model to test output_path: path for output logs test_name: opSTRING
HIGHtest/manual/models/test_nvidia_nemotron_nano_v2_vl.py0`--limit=0.1`: 10 percent of each task - this is fine for testing since the nominal result isn't interesting - this run STRING
HIGHtest/registered/models_e2e/test_ministral3_models.py0`--limit=0.1`: 10 percent of each task - this is fine for testing since the nominal result isn't interesting - this run STRING
HIGHtest/registered/models_e2e/test_ministral4_models.py0`--limit=0.1`: 10 percent of each task - this is fine for testing since the nominal result isn't interesting - this run STRING
HIGHtest/registered/quant/test_int8_kernel.py0matrix multiplication function that supports per-token input quantization and per-column weight quantizationSTRING
HIGHtest/registered/cpu/utils.py0matrix multiplication function that supports per-token input quantization and per-column weight quantizationSTRING
HIGH…t/registered/moe/test_triton_moe_channel_fp8_kernel.py0matrix multiplication function that supports per-token input quantization and per-column weight quantizationSTRING
339 more matches not shown…
Excessive Try-Catch Wrapping1707 hits · 1975 pts
SeverityFileLineSnippetContext
LOWbenchmark/bench_adaptive_speculative.py70 except Exception as e:CODE
LOWbenchmark/kernels/all_gather/benchmark_aiter.py365 except Exception:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py117 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py130 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py47except Exception: # pragma: no cover - fallback on non-supported platformsCODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py651 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py665 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py684 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py701 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py721 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py738 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py763 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py788 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py812 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py829 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py855 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py883 except Exception as e:CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py1084 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_aiter.py227 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_aiter.py237 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_aiter.py253 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_aiter.py265 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_aiter.py305 except Exception:CODE
LOWbenchmark/kernels/all_reduce/benchmark_all_reduce.py245 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_all_reduce.py255 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_all_reduce.py274 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_all_reduce.py284 except Exception as e:CODE
LOWbenchmark/kernels/all_reduce/benchmark_all_reduce.py324 except Exception:CODE
LOWbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py228 except Exception:CODE
LOWbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py305 except Exception:CODE
LOWbenchmark/mmmu/bench_sglang.py64 except Exception:CODE
LOWbenchmark/mmmu/bench_hf.py35 except Exception as first_exception:CODE
LOWbenchmark/mmmu/bench_hf.py60 except Exception as second_exception:CODE
LOWbenchmark/mmmu/eval_utils.py195 except Exception as exc:CODE
MEDIUMbenchmark/mmmu/eval_utils.py514 print(f"Error to extract answer from: {pred_i}")CODE
LOWbenchmark/json_schema/bench_sglang.py104 except Exception as e:CODE
MEDIUM…hmark/bench_pynccl_allocator/bench_segment_tracking.py195 print("Error: CUDA is not available. This benchmark requires a GPU.")CODE
LOWbenchmark/ocr/bench_sglang.py363 except Exception:CODE
LOWbenchmark/ocr/bench_sglang.py449 except Exception as exc:CODE
LOWbenchmark/ocr/bench_sglang.py460 except Exception as exc:CODE
LOWbenchmark/ocr/bench_sglang.py686 except Exception as exc:CODE
LOWbenchmark/ocr/eval_utils.py503 except Exception as exc:CODE
LOWbenchmark/hicache/bench_mix.py362 except Exception as e:CODE
LOWbenchmark/hicache/bench_mix.py423 except Exception as e:CODE
MEDIUMbenchmark/hicache/bench_mix.py479 print(f"Error processing response for client {user_data}: {e}")CODE
MEDIUMbenchmark/hicache/bench_mix.py417def handle_request(self, user_data):CODE
LOWbenchmark/hicache/bench_warm_cache.py169 except Exception as exc:CODE
LOWbenchmark/hicache/bench_serving.py194 except Exception:CODE
LOWbenchmark/hicache/bench_serving.py214 except Exception:CODE
LOWbenchmark/hicache/bench_serving.py273 except Exception as e:CODE
MEDIUMbenchmark/hicache/bench_serving.py632 print(f"Error running benchmark for request rate: {request_rate}")CODE
LOWbenchmark/hicache/bench_serving.py739 except Exception as e:CODE
MEDIUMbenchmark/hicache/bench_multiturn.py180 print(f"Error writing to JSONL file: {e}")CODE
LOWbenchmark/hicache/bench_multiturn.py395 except Exception as e:CODE
MEDIUMbenchmark/hicache/bench_multiturn.py543 print(f"Error processing response for client {client_id}: {e}")CODE
LOWbenchmark/hicache/bench_multiturn.py552 except Exception as e:CODE
LOWbenchmark/prefill_only/bench_score.py108 except Exception as e:CODE
MEDIUMbenchmark/prefill_only/bench_score.py109 print(f"Error building request {index}: {e}")CODE
LOWbenchmark/prefill_only/util.py131 except Exception as e:CODE
MEDIUMbenchmark/prefill_only/util.py132 print(f"Error building request {index}: {e}")CODE
1647 more matches not shown…
Deep Nesting1746 hits · 1510 pts
SeverityFileLineSnippetContext
LOWbenchmark/kernels/all_gather/benchmark_aiter.py290CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py606CODE
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py895CODE
LOW…hmark/kernels/all_reduce/benchmark_fused_ar_rms_amd.py367CODE
LOW…/fused_moe_triton/benchmark_torch_compile_fused_moe.py16CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py33CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py209CODE
LOWbenchmark/kernels/fused_moe_triton/common_utils.py232CODE
LOW…ls/deepseek/benchmark_cute_dsl_fp8_paged_mqa_logits.py89CODE
LOW…hmark/kernels/quantization/tuning_block_wise_kernel.py148CODE
LOW…hmark/kernels/quantization/tuning_block_wise_kernel.py171CODE
LOWbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py133CODE
LOWbenchmark/kernels/lora_csgmv/tune_lora_csgmv.py151CODE
LOWbenchmark/kernels/deepep/deepep_utils.py157CODE
LOWbenchmark/kernels/deepep/tuning_deepep.py30CODE
LOW…s/decoding_attention_triton/triton_flashinfer_cudnn.py159CODE
LOWbenchmark/mmmu/eval_utils.py154CODE
LOWbenchmark/mmmu/eval_utils.py303CODE
LOWbenchmark/mmmu/eval_utils.py423CODE
LOWbenchmark/mmmu/eval_utils.py528CODE
LOWbenchmark/mmmu/eval_utils.py430CODE
LOWbenchmark/json_schema/bench_sglang.py29CODE
LOWbenchmark/ocr/bench_sglang.py430CODE
LOWbenchmark/ocr/generate_report.py148CODE
LOWbenchmark/ocr/eval_utils.py263CODE
LOWbenchmark/ocr/eval_utils.py390CODE
LOWbenchmark/line_retrieval/bench_sglang.py30CODE
LOWbenchmark/hicache/bench_mix.py299CODE
LOWbenchmark/hicache/nextqa.py9CODE
LOWbenchmark/hicache/bench_warm_cache.py97CODE
LOWbenchmark/hicache/bench_serving.py71CODE
LOWbenchmark/hicache/bench_serving.py286CODE
LOWbenchmark/hicache/data_processing.py37CODE
LOWbenchmark/hicache/data_processing.py198CODE
LOWbenchmark/hicache/data_processing.py267CODE
LOWbenchmark/hicache/data_processing.py520CODE
LOWbenchmark/hicache/bench_multiturn.py435CODE
LOWbenchmark/hicache/bench_multiturn.py555CODE
LOWbenchmark/prefill_only/util.py106CODE
LOWbenchmark/prefill_only/util.py284CODE
LOWbenchmark/reasoning_benchmark/answer_extraction.py8CODE
LOWbenchmark/reasoning_benchmark/answer_extraction.py182CODE
LOWbenchmark/reasoning_benchmark/answer_extraction.py214CODE
LOWbenchmark/reasoning_benchmark/eval_utils.py59CODE
LOWbenchmark/asr/bench_sglang.py75CODE
LOWbenchmark/json_jump_forward/bench_other.py132CODE
LOWbenchmark/lora/lora_bench.py48CODE
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py359CODE
LOWbenchmark/bench_linear_attention/bench_gdn_prefill.py520CODE
LOWexperimental/sgl-router/tests/e2e/infra/gateway.py234CODE
LOWexperimental/sgl-router/tests/e2e/infra/gateway.py348CODE
LOWexperimental/sgl-router/tests/e2e/infra/model_pool.py95CODE
LOW…outer/tests/e2e/k8s_integration/test_reconciliation.py85CODE
LOW…l-router/tests/e2e/chat_completions/test_validation.py62CODE
LOWtest/manual/test_quick_allreduce.py106CODE
LOWtest/manual/test_quick_allreduce.py274CODE
LOWtest/manual/test_triton_attention_rocm_mla.py224CODE
LOWtest/manual/test_logprobs.py99CODE
LOWtest/manual/test_logprobs.py302CODE
LOWtest/manual/test_triton_moe_wna16.py16CODE
1686 more matches not shown…
Modern Structural Boilerplate1019 hits · 1041 pts
SeverityFileLineSnippetContext
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py54logger = logging.getLogger(__name__)CODE
LOWbenchmark/hicache/bench_mix.py20logger = logging.getLogger(__name__)CODE
LOWbenchmark/prefill_only/bench_embeddings.py35logger = logging.getLogger(__name__)CODE
LOWexperimental/sgl-router/tests/e2e/conftest.py37logger = logging.getLogger(__name__)CODE
LOWexperimental/sgl-router/tests/e2e/infra/gateway.py39logger = logging.getLogger(__name__)CODE
LOWexperimental/sgl-router/tests/e2e/infra/model_pool.py34logger = logging.getLogger(__name__)CODE
LOW…ental/sgl-router/tests/e2e/k8s_integration/conftest.py22logger = logging.getLogger(__name__)CODE
LOWtest/manual/ascend/disaggregation_utils.py18logger = logging.getLogger(__name__)CODE
LOW…d/unit/hardware_backend/mlx/test_attention_patching.py83def _set_runner_decode_context_defaults(runner) -> None:CODE
LOW…d/unit/hardware_backend/mlx/test_attention_patching.py90def _set_dummy_server_args_for_auxiliary_state_tests() -> None:CODE
LOWtest/registered/ascend/interface/test_npu_api_encode.py21logger = logging.getLogger(__name__)CODE
LOW…tered/ascend/basic_function/quant/test_npu_gguf_moe.py21logger = logging.getLogger(__name__)CODE
LOW…tered/ascend/basic_function/quant/test_npu_gptq_moe.py22logger = logging.getLogger(__name__)CODE
LOW…/ascend/basic_function/quant/test_npu_autoround_moe.py22logger = logging.getLogger(__name__)CODE
LOW…egistered/ascend/basic_function/quant/test_npu_gguf.py19logger = logging.getLogger(__name__)CODE
LOW…scend/basic_function/quant/test_npu_autoround_dense.py20logger = logging.getLogger(__name__)CODE
LOW…ered/ascend/reward_models/test_npu_gemma_2_27b_v0_2.py12logger = logging.getLogger(__name__)CODE
LOWtest/registered/observability/test_tracing.py46logger = logging.getLogger(__name__)CODE
LOW…egistered/observability/test_tracing_disaggregation.py34logger = logging.getLogger(__name__)CODE
LOWtest/registered/vlm/test_vision_chunked_prefill.py37logger = logging.getLogger(__name__)CODE
LOWtest/registered/amd/test_zimage_turbo.py24logger = logging.getLogger(__name__)CODE
LOWtest/registered/amd/test_wan22_fp8_mla.py26logger = logging.getLogger(__name__)CODE
LOWtest/registered/rl/test_return_routed_experts.py36logger = logging.getLogger(__name__)CODE
LOWtest/registered/rl/test_return_indexer_topk.py32logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernel_api_logging.py66def _setup_logger() -> None:CODE
LOWpython/sglang/__init__.py81__all__ = [CODE
LOWpython/sglang/_mps_stub.py98def set_device(device: Any) -> None: # noqa: ARG001CODE
LOWpython/sglang/utils.py32logger = logging.getLogger(__name__)CODE
LOWpython/sglang/benchmark/dspark_sps_profiler.py23logger = logging.getLogger(__name__)CODE
LOWpython/sglang/benchmark/dspark_sps_profiler.py836def set_forced_budget_frac(*, base_url: str, frac: Optional[float]) -> None:CODE
LOWpython/sglang/benchmark/dspark_sts_fit.py16logger = logging.getLogger(__name__)CODE
LOWpython/sglang/benchmark/datasets/__init__.py51__all__ = [CODE
LOWpython/sglang/kernels/__init__.py52__all__ = [CODE
LOWpython/sglang/kernels/fused_op.py109def set_fused_op_backend(backend: Optional[KernelBackend]) -> None:CODE
LOWpython/sglang/kernels/ops/attention/decode_attention.py32logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/attention/__init__.py43__all__ = []CODE
LOWpython/sglang/kernels/ops/attention/deepseek_v4_rope.py10logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/attention/deepseek_v4_rope.py263def set_batched_rope(enabled: bool = True) -> None:CODE
LOWpython/sglang/kernels/ops/grammar/__init__.py26__all__ = []CODE
LOWpython/sglang/kernels/ops/memory/__init__.py30__all__ = []CODE
LOWpython/sglang/kernels/ops/layernorm/mhc.py15logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/layernorm/__init__.py329__all__ = [CODE
LOWpython/sglang/kernels/ops/mamba/__init__.py86__all__ = ["causal_conv1d_fwd", "causal_conv1d_update"]CODE
LOWpython/sglang/kernels/ops/activation/__init__.py164__all__ = [CODE
LOWpython/sglang/kernels/ops/sampling/__init__.py56__all__ = ["top_k_renorm_probs", "top_p_renorm_probs"]CODE
LOWpython/sglang/kernels/ops/diffusion/__init__.py105__all__ = [CODE
LOWpython/sglang/kernels/ops/kvcache/__init__.py56__all__ = ["reshape_and_cache_flash"]CODE
LOW…hon/sglang/kernels/ops/kvcache/trtllm_fp8_kv_kernel.py22logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/gemm/lora_tuning_config.py41logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/gemm/__init__.py111__all__ = ["fp8_scaled_mm", "dsv3_fused_a_gemm", "dsv3_router_gemm"]CODE
LOWpython/sglang/kernels/ops/quantization/int8_kernel.py27logger = logging.getLogger(__name__)CODE
LOW…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py3011__all__ = [CODE
LOWpython/sglang/kernels/ops/quantization/fp8_kernel.py119logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/quantization/__init__.py117__all__ = [CODE
LOWpython/sglang/kernels/ops/speculative/__init__.py33__all__ = []CODE
LOWpython/sglang/kernels/ops/communication/__init__.py12__all__ = []CODE
LOWpython/sglang/kernels/ops/spatial/__init__.py49__all__ = ["get_sm_available", "create_greenctx_stream_by_value"]CODE
LOWpython/sglang/kernels/ops/moe/ep_moe_kernels.py9logger = logging.getLogger(__name__)CODE
LOWpython/sglang/kernels/ops/moe/__init__.py116__all__ = ["moe_align_block_size", "topk_softmax"]CODE
LOWpython/sglang/test/otel_collector.py23logger = logging.getLogger(__name__)CODE
959 more matches not shown…
Over-Commented Block1027 hits · 992 pts
SeverityFileLineSnippetContext
LOW…hmark/kernels/quantization/tuning_block_wise_kernel.py1# Copyright 2025 SGLang TeamCOMMENT
LOWbenchmark/lora/lora_bench.py1# Copyright 2023-2024 SGLang TeamCOMMENT
LOW…ental/sgl-router/tests/proxy/pd_bootstrap_injection.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…perimental/sgl-router/tests/proxy/graceful_shutdown.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…mental/sgl-router/tests/proxy/cache_aware_input_ids.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…perimental/sgl-router/tests/proxy/pd_pool_isolation.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/tests/proxy/chat_routing.rs841 .await;COMMENT
LOWexperimental/sgl-router/tests/proxy/sticky_input_ids.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/tests/proxy/common/streaming.rs21 use http_body_util::BodyExt;COMMENT
LOW…imental/sgl-router/tests/component/tokenizer/parity.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…sgl-router/tests/component/policies/cache_aware_zmq.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…/tests/component/policies/kv_events_two_subscribers.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…/tests/component/policies/kv_events_two_subscribers.rs141 elapsed < Duration::from_millis(100),COMMENT
LOW…/tests/component/policies/kv_events_tree_concurrent.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…uter/tests/component/policies/kv_events_hash_parity.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOW…sgl-router/tests/component/workers/concurrent_state.rs81 let snapshot = r.workers_for(&model);COMMENT
LOWexperimental/sgl-router/tests/e2e/conftest.py41# Mirrors SMG's e2e_test/conftest.py sys.path setup.COMMENT
LOWexperimental/sgl-router/tests/e2e/requirements.txt1httpx==0.27.2COMMENT
LOW…ts/e2e/chat_completions/test_two_router_convergence.py41import timeCOMMENT
LOW…ts/e2e/chat_completions/test_two_router_convergence.py221 # 1. Direct-warm each worker with its own prefix. Must happenCOMMENT
LOWexperimental/sgl-router/benches/tree_lookup.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/main.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/proxy/sse.rs21///COMMENT
LOWexperimental/sgl-router/src/proxy/sse.rs41/// The opaque `Box<dyn Send + 'static>` accepts any drop-only payload — mostCOMMENT
LOWexperimental/sgl-router/src/config/types.rs81 #[value(name = "power_of_two")]COMMENT
LOWexperimental/sgl-router/src/config/types.rs141pub struct ModelConfig {COMMENT
LOWexperimental/sgl-router/src/config/types.rs161#[derive(Debug, Clone, Copy)]COMMENT
LOWexperimental/sgl-router/src/config/types.rs201/// (`x-sgl-decode-url`, `x-sgl-router-error-code`).COMMENT
LOWexperimental/sgl-router/src/config/types.rs261#[derive(Debug, Clone)]COMMENT
LOWexperimental/sgl-router/src/config/types.rs281/// Two operating modes, distinguished by which selector flags are set:COMMENT
LOWexperimental/sgl-router/src/config/types.rs301/// resolved [`K8sDiscoveryMode`] once, at construction inCOMMENT
LOWexperimental/sgl-router/src/config/types.rs381/// `"app=sglang"`) past the identical-selector check, even thoughCOMMENT
LOWexperimental/sgl-router/src/config/types.rs441COMMENT
LOWexperimental/sgl-router/src/config/types.rs461 // here and let the K8s API be the syntax authority. PDCOMMENT
LOWexperimental/sgl-router/src/config/types.rs781 /// `classify_mode`'s prefill-first ordering would funnel every sliceCOMMENT
LOWexperimental/sgl-router/src/config/cli.rs21/// Discovery is mutually exclusive: pass `--worker-urls` for a staticCOMMENT
LOWexperimental/sgl-router/src/config/cli.rs41 #[arg(long)]COMMENT
LOWexperimental/sgl-router/src/config/cli.rs61COMMENT
LOWexperimental/sgl-router/src/config/cli.rs81 /// to `round_robin`.COMMENT
LOWexperimental/sgl-router/src/config/cli.rs101 #[arg(long)]COMMENT
LOWexperimental/sgl-router/src/config/cli.rs121 #[arg(long, default_value_t = default_proxy_request_timeout_secs())]COMMENT
LOWexperimental/sgl-router/src/tokenizer/chat_template.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/tokenizer/chat_template.rs81COMMENT
LOWexperimental/sgl-router/src/tokenizer/chat_template.rs101 .context("compile chat template from tokenizer_config.json")?;COMMENT
LOWexperimental/sgl-router/src/tokenizer/adapter.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/tokenizer/dsv4.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/tokenizer/dsv4.rs21//! system content at the front of the prompt, so a tools-carrying requestCOMMENT
LOWexperimental/sgl-router/src/tokenizer/mod.rs281 /// `😀` (`\xF0\x9F\x98\x80`) encodes to its raw byte token ids:COMMENT
LOWexperimental/sgl-router/src/tokenizer/mod.rs301 vec![240, 159, 152, 128],COMMENT
LOWexperimental/sgl-router/src/health/circuit_breaker.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/health/circuit_breaker.rs81 /// probe slot. Calling `allow()` for filtering would leak probe slotsCOMMENT
LOWexperimental/sgl-router/src/health/circuit_breaker.rs101 /// Single-lock snapshot of `(admit, state_code)` for the `/metrics`COMMENT
LOWexperimental/sgl-router/src/discovery/types.rs41/// new worker becomes available, and [`DiscoveryEvent::Removed`] when itCOMMENT
LOWexperimental/sgl-router/src/discovery/types.rs61}COMMENT
LOWexperimental/sgl-router/src/discovery/k8s.rs81///COMMENT
LOWexperimental/sgl-router/src/discovery/k8s.rs141 });COMMENT
LOWexperimental/sgl-router/src/discovery/k8s.rs221 Ok(())COMMENT
LOWexperimental/sgl-router/src/discovery/k8s.rs781 /// plumbing is verified, not just "some prefill registered"),COMMENT
LOWexperimental/sgl-router/src/discovery/static_urls.rs1// SPDX-FileCopyrightText: Copyright (c) 2026 The SGLang AuthorsCOMMENT
LOWexperimental/sgl-router/src/server/error.rs21 /// build error). `source` captures the full anyhow chain for server-sideCOMMENT
967 more matches not shown…
Structural Annotation Overuse333 hits · 579 pts
SeverityFileLineSnippetContext
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py104 # Step 1: split (same as forward_decode)COMMENT
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py107 # Step 2: view + reshape (same as forward_decode)COMMENT
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py112 # Step 3: fused gating + recurrent updateCOMMENT
LOW…mark/bench_linear_attention/bench_fused_gate_cumsum.py79 # Step 1: gate activation using torch opsCOMMENT
LOW…mark/bench_linear_attention/bench_fused_gate_cumsum.py87 # Step 2: chunk-local cumsumCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh38# Step 1: Create kind cluster (idempotent)COMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh50# Step 2: Build Docker images (unless SKIP_DOCKER_BUILD=1)COMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh75# Step 3: Load images into kindCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh82# Step 4: Apply namespace and RBACCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh89# Step 5: Deploy 3 fake-worker replicas behind a ServiceCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh144# Step 6: Deploy sgl-router. It is configured entirely via CLI flags inCOMMENT
LOWtest/manual/test_tokenizer_manager.py336 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py342 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py348 # Step 3: Extract results (simulated tokenizer output)COMMENT
LOWtest/manual/test_tokenizer_manager.py367 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py373 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py379 # Step 3: Extract results (simulated tokenizer output for cross-encoder)COMMENT
LOWtest/manual/test_tokenizer_manager.py396 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py402 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py408 # Step 3: Extract results (simulated tokenizer output)COMMENT
LOWtest/manual/dsv4/test_fused_compress_attn_hip.py312 # Step 1: write current tokens to state (same for both paths)COMMENT
LOWtest/registered/unit/managers/test_hisparse_unit.py457 # Step 1: load the first TOP_K positions from host (no newest token —COMMENT
LOWtest/registered/unit/managers/test_hisparse_unit.py466 # Step 2: half overlap (hit) + half new (miss).COMMENT
LOWtest/registered/unit/parser/test_reasoning_parser.py726 # Step 1: Send partial end tag when not in reasoning modeCOMMENT
LOWtest/registered/unit/parser/test_reasoning_parser.py732 # Step 2: Send normal text that doesn't complete the end tagCOMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py134 # Step 1: inc_lock_ref (pop_preallocated locks the matched node)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py150 # Step 2: cache_unfinished_req (dec old lock, inc new lock)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py153 # Step 3: cache_finished_req with is_insert=True (dec lock)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py182 # Step 1: inc_lock_ref on root (simulates get_new_prebuilt_batch)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py199 # Step 2: cache_unfinished_req (dec root=no-op, inc new leaf)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py202 # Step 3: cache_finished_req (dec leaf)COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py693 # Step 1: Insert [1,2,3] to create first nodeCOMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py705 # Step 2: Insert [1,2,3,4,5,6,7] with prev_prefix_len=0 (free all matched)COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py722 # Step 3: Insert [1,2,3,4,5,6,7,8] with prev_prefix_len=2COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py740 # Step 4: Insert [1,2,3,4,5,6,7,8,9] with prev_prefix_len=8 (covers all matched)COMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py793 # Step 1: insert 1 pageCOMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py797 # Step 2: insert 2 pages with prev_prefix_len=0 → frees overlap of 1 pageCOMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py815 # Step 3: insert 3 pages with prev_prefix_len=len(seq_2p) → nothing freedCOMMENT
LOW…v_canary/test_self_e2e_perturb_real_kv_unused_cache.py45 # Step 1: first batch builds radix entries that will become orphans once finished.COMMENT
LOW…v_canary/test_self_e2e_perturb_real_kv_unused_cache.py47 # Step 2: second batch drives more forward passes so the sweep cadence firesCOMMENT
LOWtest/registered/cpu/utils.py72 # Step 2: compute per-block max abs values → scaleCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py584 # Step 1: reasoning parserCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py588 # Step 2: feed normal_text into tool call parser (like serving_chat.py does)COMMENT
LOWtest/registered/function_call/test_kimik2_detector.py620 # Step 1: reasoning parserCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py625 # Step 2: tool call parser on normal_textCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4368 # Step 2: baseline runs the known-good attention kernel.COMMENT
LOWtest/registered/debug_utils/test_dumper.py4371 # Step 3: graft output. baseline sends attn_out to target with aCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4383 # Step 1: graft input. target sends its real q to baseline alongCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4392 # Step 2: target runs the (suspected buggy) attention kernel —COMMENT
LOWtest/registered/debug_utils/test_dumper.py4396 # Step 3: graft output. baseline sends its (good) attn_out toCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4357 # Step 1: graft input. target sends its q to baseline; baseline'sCOMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2206 # Step 0: prefill with 2 sequences (3+2 tokens)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2215 # Step 1: decode (1 token per sequence)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2267 # Step 0: prefill — seq A (3 tokens) + seq B (2 tokens)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4723 # Step 1: Create 4 target ranks where moe_tp is absent from ranks 2-3.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4726 # Step 2: _is_jointly_determined is called with parent_axes={tp, moe_tp}STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4728 # Step 3: edp remains undeclared → ValueError emitted as error record.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4825 # Step 1: 4 target ranks with TP=2, CP=2 (replicated), EDP=4.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4827 # Step 2: _is_jointly_determined is called with parent_axes={tp, cp}, child=edp.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4829 # Step 3: CP replicated picks one rank per tp group → TP concat → correct shape.STRING
273 more matches not shown…
AI Structural Patterns573 hits · 538 pts
SeverityFileLineSnippetContext
LOW…pseek/benchmark_deepgemm_dsv3_router_gemm_blackwell.py49CODE
LOW…chmark/kernels/deepseek/benchmark_deepgemm_fp8_gemm.py156CODE
LOW…chmark/kernels/deepseek/benchmark_deepgemm_fp8_gemm.py175CODE
LOW…nels/deepseek/benchmark_deepgemm_fp8_gemm_blackwell.py95CODE
LOW…nels/deepseek/benchmark_deepgemm_fp8_gemm_blackwell.py109CODE
LOWbenchmark/hicache/bench_serving.py684CODE
LOWbenchmark/reasoning_benchmark/answer_extraction.py211CODE
LOWbenchmark/multi_turn_chat/long_prompt_multi_turn.py22CODE
LOWbenchmark/fla/benchmark_layernorm_gated.py15CODE
LOWbenchmark/lora/lora_bench.py350CODE
LOWtest/manual/openai_server/features/test_cache_report.py68CODE
LOWtest/manual/openai_server/features/test_cache_report.py80CODE
LOWtest/manual/openai_server/features/test_cache_report.py91CODE
LOW…t/manual/entrypoints/http_server/test_abort_request.py78CODE
LOWtest/registered/kernels/test_flash_mla_backends.py242CODE
LOWtest/registered/attention/test_verify_splitkv.py85CODE
LOW…gistered/unit/model_executor/test_pool_configurator.py37CODE
LOW…t/registered/unit/sampling/test_sampling_batch_info.py425CODE
LOWtest/registered/unit/mem_cache/test_registry.py22CODE
LOW…stered/unit/mem_cache/test_mooncake_group_semantics.py235CODE
LOW…egistered/unit/mem_cache/test_hicache_file_lru_unit.py43CODE
LOW…egistered/unit/mem_cache/test_hicache_file_lru_unit.py76CODE
LOW…tered/unit/mem_cache/test_unified_radix_cache_bench.py680CODE
LOWtest/registered/kv_canary/test_self_unit_violation.py25CODE
LOW…t/registered/openai_server/basic/test_openai_server.py465CODE
LOW…t/registered/openai_server/basic/test_openai_server.py501CODE
LOW…/openai_server/validation/test_large_max_new_tokens.py79CODE
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2705CODE
LOW…g_utils/comparator/tensor_comparator/test_formatter.py301CODE
LOWtest/registered/jit/test_flash_attention_4.py405CODE
LOWtest/registered/jit/kv_canary/test_write_hand.py73CODE
LOWtest/registered/jit/kv_canary/test_pipeline_e2e.py183CODE
LOW…egistered/jit/diffusion/test_fused_norm_scale_shift.py140CODE
LOW…egistered/jit/diffusion/test_fused_norm_scale_shift.py163CODE
LOWtest/registered/perf/test_bench_serving_1gpu_part1.py257CODE
LOWtest/registered/bench_fn/test_benchmark_datasets_api.py787CODE
LOWtest/registered/rl/test_update_weights_from_disk.py138CODE
LOWtest/registered/rl/test_update_weights_from_disk.py146CODE
LOWtest/registered/rl/test_update_weights_from_disk.py154CODE
LOWtest/registered/rl/test_update_weights_from_tensor.py226CODE
LOWtest/registered/rl/test_update_weights_from_tensor.py234CODE
LOWtest/registered/rl/test_update_weights_from_tensor.py247CODE
LOWpython/sglang/benchmark/serving.py1303CODE
LOWpython/sglang/benchmark/one_batch_server.py527CODE
LOWpython/sglang/kernels/ops/attention/extend_attention.py622CODE
LOWpython/sglang/kernels/ops/attention/extend_attention.py1082CODE
LOWpython/sglang/kernels/ops/attention/verify_splitkv.py689CODE
LOW…glang/kernels/ops/kvcache/trtllm_mha_graph_metadata.py125CODE
LOW…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py2825CODE
LOWpython/sglang/kernels/ops/quantization/awq_triton.py339CODE
LOWpython/sglang/kernels/ops/moe/rocm_moe_utils.py28CODE
LOWpython/sglang/kernels/ops/moe/rocm_moe_utils.py66CODE
LOW…hon/sglang/kernels/ops/moe/fused_moe_triton_kernels.py714CODE
LOWpython/sglang/kernels/ops/moe/mxfp8_moe_amd_gfx95.py358CODE
LOW…ng/kernels/ops/moe/trtllm_lora_temp/virtual_experts.py625CODE
LOW…ng/kernels/ops/moe/trtllm_lora_temp/virtual_experts.py1114CODE
LOWpython/sglang/test/test_deterministic.py96CODE
LOWpython/sglang/test/test_utils.py1093CODE
LOWpython/sglang/test/test_utils.py1167CODE
LOWpython/sglang/test/simple_eval_longbench_v2.py113CODE
513 more matches not shown…
Verbosity Indicators276 hits · 492 pts
SeverityFileLineSnippetContext
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py104 # Step 1: split (same as forward_decode)COMMENT
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py107 # Step 2: view + reshape (same as forward_decode)COMMENT
LOWbenchmark/bench_linear_attention/bench_gdn_decode.py112 # Step 3: fused gating + recurrent updateCOMMENT
LOW…mark/bench_linear_attention/bench_fused_gate_cumsum.py79 # Step 1: gate activation using torch opsCOMMENT
LOW…mark/bench_linear_attention/bench_fused_gate_cumsum.py87 # Step 2: chunk-local cumsumCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh38# Step 1: Create kind cluster (idempotent)COMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh50# Step 2: Build Docker images (unless SKIP_DOCKER_BUILD=1)COMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh75# Step 3: Load images into kindCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh82# Step 4: Apply namespace and RBACCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh89# Step 5: Deploy 3 fake-worker replicas behind a ServiceCOMMENT
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh144# Step 6: Deploy sgl-router. It is configured entirely via CLI flags inCOMMENT
LOWtest/manual/test_tokenizer_manager.py336 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py342 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py348 # Step 3: Extract results (simulated tokenizer output)COMMENT
LOWtest/manual/test_tokenizer_manager.py367 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py373 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py379 # Step 3: Extract results (simulated tokenizer output for cross-encoder)COMMENT
LOWtest/manual/test_tokenizer_manager.py396 # Step 1: Detect formatCOMMENT
LOWtest/manual/test_tokenizer_manager.py402 # Step 2: Prepare inputCOMMENT
LOWtest/manual/test_tokenizer_manager.py408 # Step 3: Extract results (simulated tokenizer output)COMMENT
LOWtest/manual/dsv4/test_fused_compress_attn_hip.py312 # Step 1: write current tokens to state (same for both paths)COMMENT
LOWtest/registered/unit/managers/test_hisparse_unit.py457 # Step 1: load the first TOP_K positions from host (no newest token —COMMENT
LOWtest/registered/unit/managers/test_hisparse_unit.py466 # Step 2: half overlap (hit) + half new (miss).COMMENT
LOWtest/registered/unit/parser/test_reasoning_parser.py726 # Step 1: Send partial end tag when not in reasoning modeCOMMENT
LOWtest/registered/unit/parser/test_reasoning_parser.py732 # Step 2: Send normal text that doesn't complete the end tagCOMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py134 # Step 1: inc_lock_ref (pop_preallocated locks the matched node)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py150 # Step 2: cache_unfinished_req (dec old lock, inc new lock)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py153 # Step 3: cache_finished_req with is_insert=True (dec lock)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py182 # Step 1: inc_lock_ref on root (simulates get_new_prebuilt_batch)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py199 # Step 2: cache_unfinished_req (dec root=no-op, inc new leaf)COMMENT
LOW…egistered/unit/mem_cache/test_decode_radix_lock_ref.py202 # Step 3: cache_finished_req (dec leaf)COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py693 # Step 1: Insert [1,2,3] to create first nodeCOMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py705 # Step 2: Insert [1,2,3,4,5,6,7] with prev_prefix_len=0 (free all matched)COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py722 # Step 3: Insert [1,2,3,4,5,6,7,8] with prev_prefix_len=2COMMENT
LOWtest/registered/unit/mem_cache/test_mamba_unittest.py740 # Step 4: Insert [1,2,3,4,5,6,7,8,9] with prev_prefix_len=8 (covers all matched)COMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py793 # Step 1: insert 1 pageCOMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py797 # Step 2: insert 2 pages with prev_prefix_len=0 → frees overlap of 1 pageCOMMENT
LOW…ed/unit/mem_cache/test_unified_radix_cache_unittest.py815 # Step 3: insert 3 pages with prev_prefix_len=len(seq_2p) → nothing freedCOMMENT
LOW…v_canary/test_self_e2e_perturb_real_kv_unused_cache.py45 # Step 1: first batch builds radix entries that will become orphans once finished.COMMENT
LOW…v_canary/test_self_e2e_perturb_real_kv_unused_cache.py47 # Step 2: second batch drives more forward passes so the sweep cadence firesCOMMENT
LOWtest/registered/cpu/utils.py72 # Step 2: compute per-block max abs values → scaleCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py584 # Step 1: reasoning parserCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py588 # Step 2: feed normal_text into tool call parser (like serving_chat.py does)COMMENT
LOWtest/registered/function_call/test_kimik2_detector.py620 # Step 1: reasoning parserCOMMENT
LOWtest/registered/function_call/test_kimik2_detector.py625 # Step 2: tool call parser on normal_textCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4368 # Step 2: baseline runs the known-good attention kernel.COMMENT
LOWtest/registered/debug_utils/test_dumper.py4371 # Step 3: graft output. baseline sends attn_out to target with aCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4383 # Step 1: graft input. target sends its real q to baseline alongCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4392 # Step 2: target runs the (suspected buggy) attention kernel —COMMENT
LOWtest/registered/debug_utils/test_dumper.py4396 # Step 3: graft output. baseline sends its (good) attn_out toCOMMENT
LOWtest/registered/debug_utils/test_dumper.py4357 # Step 1: graft input. target sends its q to baseline; baseline'sCOMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2206 # Step 0: prefill with 2 sequences (3+2 tokens)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2215 # Step 1: decode (1 token per sequence)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py2267 # Step 0: prefill — seq A (3 tokens) + seq B (2 tokens)COMMENT
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4723 # Step 1: Create 4 target ranks where moe_tp is absent from ranks 2-3.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4726 # Step 2: _is_jointly_determined is called with parent_axes={tp, moe_tp}STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4728 # Step 3: edp remains undeclared → ValueError emitted as error record.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4825 # Step 1: 4 target ranks with TP=2, CP=2 (replicated), EDP=4.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4827 # Step 2: _is_jointly_determined is called with parent_axes={tp, cp}, child=edp.STRING
LOW…t/registered/debug_utils/comparator/test_entrypoint.py4829 # Step 3: CP replicated picks one rank per tp group → TP concat → correct shape.STRING
216 more matches not shown…
Self-Referential Comments140 hits · 430 pts
SeverityFileLineSnippetContext
MEDIUMbenchmark/dspy/bench_dspy_intro.py95 # Define the predictor.COMMENT
MEDIUMbenchmark/dspy/bench_dspy_intro.py107 # Define the predictor. Notice we're just changing the class. The signature BasicQA is unchanged.COMMENT
MEDIUMbenchmark/mmmu/data_utils.py157 # Create a JSON object with the filename as the key and caption as the valueCOMMENT
MEDIUMbenchmark/hicache/bench_mix.py24# Create a lock for thread-safe debug log writingCOMMENT
MEDIUMbenchmark/prefill_only/bench_score.py157 # Create the request builder function with shared tokenizerCOMMENT
MEDIUMbenchmark/prefill_only/util.py173 # Create the full request list by cycling through unique requestsCOMMENT
MEDIUMbenchmark/multi_turn_chat/long_prompt_multi_turn.py29 # Create a unique cache filename based on the arguments that affect generationCOMMENT
MEDIUMexperimental/sgl-router/tests/e2e/infra/gateway.py43# This file is at `experimental/sgl-router/tests/e2e/infra/gateway.py`,COMMENT
MEDIUMtest/manual/test_weight_validation.py75 # Create a minimal valid safetensors fileCOMMENT
MEDIUMtest/manual/test_weight_validation.py166 # Create a broken symlink for the index fileCOMMENT
MEDIUMtest/manual/test_modelopt_fp8kvcache.py15 # Create a ModelOptFp8Config objectCOMMENT
MEDIUMtest/manual/test_config_integration.py27 # Create a temporary config fileCOMMENT
MEDIUMtest/manual/test_config_integration.py82 # Create a temporary config fileCOMMENT
MEDIUMtest/manual/test_config_integration.py113 # Create a temporary config fileCOMMENT
MEDIUMtest/manual/test_async_dynamic_batch_tokenizer.py54 # Create a proper BatchEncoding-like object that supports dict operationsCOMMENT
MEDIUMtest/manual/test_async_dynamic_batch_tokenizer.py193 # Create a new async tokenizer with a failing tokenizerCOMMENT
MEDIUMtest/manual/attention/test_flashattn_backend.py66 # Create a large enough req_to_token_pool to fit the test usage.COMMENT
MEDIUMtest/manual/attention/test_flashattn_mla_backend.py54 # Create a proper req_to_token_pool with the req_to_token attributeCOMMENT
MEDIUM…ual/lang_frontend/test_separate_reasoning_execution.py72 # Create a mock backend to avoid AttributeError in __del__COMMENT
MEDIUM…ual/lang_frontend/test_separate_reasoning_execution.py75 # Create a StreamExecutor with necessary setupCOMMENT
MEDIUM…ual/lang_frontend/test_separate_reasoning_execution.py106 # Create a gen expression and a separate_reasoning expressionCOMMENT
MEDIUMtest/manual/debug_utils/run_with_retry.py37 # Create a TestFile with a reasonable estimated timeCOMMENT
MEDIUMtest/manual/eval/test_longbench_v2_eval.py73 # Create a temporary JSON file with sample dataCOMMENT
MEDIUMtest/registered/quant/test_quant_config_parsing.py23 # Create a raw instanceCOMMENT
MEDIUMtest/registered/kernels/test_dsa_indexer.py78 # Create a simple page table for testingCOMMENT
MEDIUMtest/registered/kernels/test_dsa_indexer.py94 # Create a simple page table for testing with page size 1COMMENT
MEDIUM…st/registered/attention/test_wave_attention_kernels.py186 # Define the varying parameter valuesCOMMENT
MEDIUM…/registered/attention/test_triton_attention_kernels.py314 # Define the varying parameter valuesCOMMENT
MEDIUM…egistered/attention/test_normal_decode_set_metadata.py129 # Create a simple SWA KV pool for testingCOMMENT
MEDIUM…egistered/attention/test_normal_decode_set_metadata.py150 # Create a minimal mock that inherits from SWAKVPool to pass isinstance checkCOMMENT
MEDIUMtest/registered/unit/distributed/test_parallel_state.py95 # Create a mock group objectCOMMENT
MEDIUMtest/registered/unit/distributed/test_parallel_state.py195 # Create a mock group objectCOMMENT
MEDIUM…stered/unit/function_call/test_function_call_parser.py496 # Create a concrete implementation of BaseFormatDetector for testingCOMMENT
MEDIUM…tered/unit/mem_cache/test_radix_cache_slru_accuracy.py56 # Create a cache with the memory poolsCOMMENT
MEDIUM…ed/unit/mem_cache/test_unified_radix_cache_unittest.py2031 # Create a chain: root -> A -> B -> C (3 levels)COMMENT
MEDIUM…t/registered/unit/model_loader/test_modelopt_loader.py77 # Create a basic model config with unified quantization flagCOMMENT
MEDIUM…egistered/unit/entrypoints/openai/test_serving_chat.py732 # Create a mock conversation object that will be returned by generate_chat_convCOMMENT
MEDIUM…egistered/unit/entrypoints/openai/test_serving_chat.py1380 # Create a mock conversation objectCOMMENT
MEDIUMtest/registered/cpu/utils.py465 # Create a new tensor with alternating valuesCOMMENT
MEDIUMtest/registered/cpu/utils.py488 # Create a tensor with the E2M1 valuesCOMMENT
MEDIUMtest/registered/cpu/test_mamba.py23 """This function is intended to align with the l2norm implementation in the FLA library."""STRING
MEDIUM…registered/hicache/test_hicache_storage_3fs_backend.py26 # Create a temporary JSON config file for HF3FSCOMMENT
MEDIUMtest/registered/lora/test_chunked_sgmv_backend.py199 # Create a minimal mock ForwardBatch for the testCOMMENT
MEDIUMtest/registered/lora/test_chunked_sgmv_backend.py231 # Create a minimal backend instance to access _get_segments_infoCOMMENT
MEDIUMtest/registered/rl/test_update_weights_from_tensor.py134 # Create a small set of parameters for testingCOMMENT
MEDIUMtest/registered/rl/test_update_weights_from_tensor.py148 # Create a flattened bucketCOMMENT
MEDIUMtest/registered/rl/test_update_weights_from_tensor.py155 # Create the dict format expected by _update_weights_from_flattened_bucketCOMMENT
MEDIUMtest/registered/rl/test_update_weights_from_tensor.py165 # Create a list where each rank contains the same serialized dataCOMMENT
MEDIUMpython/sglang/benchmark/serving.py1372 # Create a temporary DatasetRow object for warmupCOMMENT
MEDIUMpython/sglang/benchmark/serving.py1388 # Create the test input onceCOMMENT
MEDIUMpython/sglang/benchmark/serving.py2521 # Create a mutually exclusive group for profiling URLsCOMMENT
MEDIUMpython/sglang/kernels/ops/attention/deepseek_v4_rope.py12# This module is imported during model-registry discovery. Keep it free ofCOMMENT
MEDIUMpython/sglang/kernels/ops/layernorm/mhc.py17# This module is imported during model-registry discovery. Do not import the realCOMMENT
MEDIUM…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py115 """This class implements batched matrix multiplication (C = A x SFA x B x SFB) with support for various data typesSTRING
MEDIUMpython/sglang/kernels/ops/quantization/awq_triton.py152 # Create the necessary shifts to use to unpack.COMMENT
MEDIUMpython/sglang/test/nightly_bench_utils.py72 # Create a combined link or use the first available oneCOMMENT
MEDIUMpython/sglang/jit_kernel/ngram_embedding.py135 # Create an empty tensor for ignore_tokensCOMMENT
MEDIUM…/sglang/srt/layers/attention/flashattention_backend.py2984 # Create a modified version for local attention that only processes the last tokenCOMMENT
MEDIUM…/sglang/srt/layers/attention/flashattention_backend.py3357 # Create a block_table for the local attention blocksCOMMENT
MEDIUM…/sglang/srt/layers/attention/dsa/index_buf_accessor.py636 # Define the token range within the block and the K dimension range handled by the thread.COMMENT
80 more matches not shown…
Redundant / Tautological Comments259 hits · 395 pts
SeverityFileLineSnippetContext
LOW…shinfer_allreduce_fusion/benchmark_fused_collective.py1160 # Check if running with torchrun (required for collective operations)STRING
LOWbenchmark/json_schema/bench_sglang.py97 # Check if the outputs are validCOMMENT
LOWbenchmark/ceval/bench_sglang.py112 # Print resultsCOMMENT
LOWbenchmark/prefill_only/util.py163 # Check if we have any valid requestsCOMMENT
LOWbenchmark/boolq/bench_sglang.py89 # Print resultsCOMMENT
LOWbenchmark/gsm8k/bench_sglang.py143 # Print resultsCOMMENT
LOWbenchmark/gsm8k/bench_other.py129 # Print resultsCOMMENT
LOWbenchmark/mmlu/bench_sglang.py179 # Print resultsCOMMENT
LOWtest/manual/test_schedule_policy.py89 # Check if FCFS keeps the original orderCOMMENT
LOWtest/manual/test_schedule_policy.py114 # Check if priority enabled fcfs ordering is applied.COMMENT
LOWtest/manual/test_schedule_policy.py140 # Check if priority enabled fcfs ordering is applied.COMMENT
LOWtest/manual/test_schedule_policy.py162 # Check if priority enabled fcfs ordering is applied.COMMENT
LOWtest/manual/test_schedule_policy.py186 # Check if priority enabled fcfs ordering is applied.COMMENT
LOWtest/manual/test_schedule_policy.py212 # Check if priority enabled fcfs ordering is applied.COMMENT
LOW…nual/kv_transfer/test_mooncake_transfer_engine_init.py201 # Check if mooncake should be usedCOMMENT
LOW…tered/unit/mem_cache/test_radix_cache_slru_accuracy.py108 # Check if the frequently accessed key-value is still presentCOMMENT
LOW…tered/unit/mem_cache/test_radix_cache_slru_accuracy.py114 # Check if the first low-frequency key-value has been evictedCOMMENT
LOW…tered/unit/mem_cache/test_radix_cache_slru_accuracy.py126 # Check if the tensor is empty, which indicates the key was not found (evicted)COMMENT
LOW…t/registered/unit/model_loader/test_modelopt_export.py27# Check if modelopt is availableCOMMENT
LOW…d/unit/batch_invariant_ops/test_batch_invariant_ops.py53 # Check if results are identicalCOMMENT
LOW…d/unit/batch_invariant_ops/test_batch_invariant_ops.py178 # Check if results are identicalCOMMENT
LOW…registered/disaggregation/test_disaggregation_basic.py214 # Check if servers are still healthyCOMMENT
LOW…/ascend/interface/test_npu_openai_server_ignore_eos.py84 # Check if ignore_eos resulted in more tokens or exactly max_tokensCOMMENT
LOW…nd/basic_function/offloading/test_npu_offload_modes.py70 # Check if server is running (basic functionality test)COMMENT
LOW…nai_server/validation/test_openai_server_ignore_eos.py75 # Check if ignore_eos resulted in more tokens or exactly max_tokensCOMMENT
LOWtest/registered/observability/test_tracing.py77 # Check if it's a RequestStageConfig (has stage_name and level attributes)COMMENT
LOW…stered/amd/disaggregation/test_disaggregation_basic.py321 # Check if servers are still healthyCOMMENT
LOW…t/registered/amd/accuracy/mi30x/test_gsm8k_eval_amd.py286 # Print resultsCOMMENT
LOW…gistered/amd/accuracy/mi30x/test_vlms_mmmu_eval_amd.py255 # Print resultsCOMMENT
LOW…istered/jit/test_amd_deterministic_custom_allreduce.py93 # Check if inputs fit in bufferCOMMENT
LOWtest/registered/jit/test_pos_enc.py480 # Print resultsCOMMENT
LOW…/registered/rl/test_update_weights_from_distributed.py643 # Check if the weights of lm_head are tied with embed_tokens.COMMENT
LOWpython/sglang/utils.py420 # Check if the cache file already existsCOMMENT
LOWpython/sglang/benchmark/serving.py1411 # Check if at least one warmup request succeededCOMMENT
LOWpython/sglang/benchmark/one_batch.py710 # Print output textsCOMMENT
LOWpython/sglang/benchmark/utils.py102 # Check if the cache file already existsCOMMENT
LOWpython/sglang/benchmark/one_batch_server.py802 # Print resultsCOMMENT
LOWpython/sglang/kernels/ops/attention/metadata.py371 # Check if we should use the specialized fast path for page_size=1, no SWACOMMENT
LOWpython/sglang/kernels/ops/attention/extend_attention.py963 # Check if we can skip this tileCOMMENT
LOWpython/sglang/kernels/ops/attention/pad.py295 # Check if we're in CUDA graph mode (buffers are pre-allocated)COMMENT
LOWpython/sglang/kernels/ops/gemm/embedding_lora_a.py56 # Check if this token is within the segmentCOMMENT
LOWpython/sglang/kernels/ops/gemm/embedding_lora_a.py70 # Check if this is an extra tokenCOMMENT
LOW…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py490 # Check if input data types are compatible with MMA instructionCOMMENT
LOWpython/sglang/kernels/ops/speculative/spec_tree.py223 # Check if we've reached end of sibling listCOMMENT
LOWpython/sglang/test/few_shot_gsm8k_engine.py135 # Print resultsCOMMENT
LOWpython/sglang/test/send_one.py238 # Print resultsCOMMENT
LOWpython/sglang/test/runners.py497 # Check if the text is empty or only whitespace.COMMENT
LOWpython/sglang/test/runners.py792 # Check if the text is empty or only whitespace.COMMENT
LOWpython/sglang/test/few_shot_gsm8k.py138 # Print resultsCOMMENT
LOWpython/sglang/test/ascend/e2e/run_npu_e2e_test.py378 # Check if current line matches expected patternCOMMENT
LOWpython/sglang/test/ascend/e2e/run_npu_e2e_test.py465 # Check if pattern was successfully matchedCOMMENT
LOWpython/sglang/test/ci/ci_utils.py238 # Check if we should retryCOMMENT
LOW…/sglang/test/server_fixtures/disaggregation_fixture.py274 # Check if port is activeCOMMENT
LOWpython/sglang/srt/dllm/mixin/scheduler.py309 # Check if batch is fullCOMMENT
LOWpython/sglang/srt/disaggregation/decode.py1889 # Check if request was aborted due to corruptionCOMMENT
LOWpython/sglang/srt/layers/sampler.py541 # Check if any requests actually need logprobs computationCOMMENT
LOWpython/sglang/srt/layers/attention/xpu_backend.py508 # Check if we should use local attentionCOMMENT
LOWpython/sglang/srt/layers/attention/dsa_backend.py902 # Check if MHA FP8 dequantization is neededCOMMENT
LOWpython/sglang/srt/layers/attention/dsa_backend.py2799 # Check if sequence meets criteria for MHA_ONE_SHOTCOMMENT
LOW…/sglang/srt/layers/attention/flashattention_backend.py1149 # Check if we should use local attentionCOMMENT
199 more matches not shown…
Cross-Language Confusion37 hits · 200 pts
SeverityFileLineSnippetContext
HIGHbenchmark/hicache/bench_mix.py465 self.user_generator.push(CODE
HIGHexperimental/sgl-router/tests/e2e/infra/gateway.py329 "Build it first: `cd experimental/sgl-router && cargo build --release` "CODE
HIGHtest/manual/models/test_qwen3_asr.py630 f"first commit's previous_item_id must be JSON null, got {committed_1!r}",CODE
HIGHtest/manual/debug_utils/test_log_parser.py16 """[{"line":"(SGLangEngine pid=35555) [2025-10-31 03:45:20 TP0] Decode batch [51341], #running-req: 317, #toSTRING
HIGH…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py2552 :param c_sf_ptr: Pointer to scale factor tensor for C (can be null)STRING
HIGH…nels/ops/quantization/nvfp4_gemm_swiglu_nvfp4_quant.py2556 :param norm_const_ptr: Pointer to normalization constant for SFC generation (can be null)STRING
HIGH…tion_unittest/runner_modes/cuda_graph_decode_runner.py412 # capture, which makes the capture-time output undefined; onlyCOMMENT
HIGHpython/sglang/srt/managers/scheduler.py3870 f"dspark_force_budget_frac must be in (0, 1] or null, got {v}."CODE
HIGHpython/sglang/srt/function_call/utils.py297 return "string" # If only null, default to stringCODE
HIGHpython/sglang/srt/function_call/mimo_detector.py144 <parameter=command>pwd && ls</parameter>STRING
HIGHpython/sglang/srt/utils/field_validators.py66 raise ValueError(f"must be list or null; got {type(v).__name__}")CODE
HIGHpython/sglang/srt/utils/hf_transformers/tokenizer.py367 # When the config omits the key or has null, use the v4 default so thatCOMMENT
HIGHpython/sglang/srt/entrypoints/http_server.py483 {"error": {"message": "...", "type": "...", "param": null, "code": <status>}}STRING
HIGH…en/test/unit/realtime/test_realtime_control_signals.py16 queue.push("camera_actions", [["w"], ["d"]])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py28 queue.push(CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py205 queue.push("camera_actions", [])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py265 queue.push(ControlStateTransition(payload=["w"], seq_id=7))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py266 queue.push(ControlStateTransition(payload=[], seq_id=8))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py277 queue.push(ControlStateTransition(payload=["w"], seq_id=7))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py287 queue.push(ControlStateTransition(payload=["w"], seq_id=7))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py288 queue.push(ControlStateTransition(payload=["w", "d"], seq_id=8))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py289 queue.push(ControlStateTransition(payload=["d"], seq_id=9))CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py46 queue.push(CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py70 queue.push("camera_actions", [["w"], ["a"], ["s"]])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py87 queue.push("camera_actions", [["w"]])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py104 queue.push("camera_actions", [["w"]])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py122 queue.push("camera_actions", [[]])CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py139 queue.push(CODE
HIGH…en/test/unit/realtime/test_realtime_control_signals.py174 queue.push("camera_actions", [["w"], ["w"], ["w"], ["w"]])CODE
HIGH…ang/multimodal_gen/runtime/realtime/control_signals.py190 self.push(CODE
HIGH…ang/multimodal_gen/runtime/realtime/control_signals.py351 self._signals.push(self.kind, script, event_id=event_id)CODE
HIGH…ang/multimodal_gen/runtime/realtime/control_signals.py411 self.push(transition)CODE
HIGH…ai/realtime/adapters/lingbot_world_realtime_adapter.py57 self.prompt_queue.push("prompt", prompt, event_id=event_id)CODE
HIGH…rify/scripts/mechanical_refactor_reproduction_utils.py48 exec_command(f"git add -A && git commit -m {shlex.quote(message)}", cwd=cwd)CODE
HIGH…scripts/tests/reproduction_utils/test_infra_helpers.py69 "shell $HOME && rm -rf / ; metacharacters",CODE
HIGHscripts/ci/test_list_stage_models.py193 f.write('{"deny": null, "by_file": null}')CODE
HIGHscripts/ci/utils/runner_utilization_report.py188 equal to `created_at` (not null). The previous code required both aSTRING
AI Slop Vocabulary72 hits · 181 pts
SeverityFileLineSnippetContext
MEDIUMdocker/k8s-sglang-distributed-sts.yaml58 privileged: true # to leverage RDMA/InfiniBand device, co-work with HostNetwork=trueCODE
MEDIUM…t/manual/layers/attention/dsa/test_act_quant_triton.py269 # Run comprehensive benchmarkCOMMENT
MEDIUMtest/manual/layers/moe/bench_mxfp4_sm90_kernels.py277# Timing harnessCOMMENT
MEDIUMtest/manual/4-gpu-models/test_qwen35_models_archived.py17# This eval harness applies the chat_template, which is critical for qwen3.5COMMENT
MEDIUMtest/manual/4-gpu-models/test_qwen35_fp4_triton.py5# This eval harness applies the chat_template, which is critical for qwen3.5COMMENT
MEDIUMtest/manual/eval/validate_longbench_v2_standalone.py212 """Generate comprehensive validation report."""STRING
MEDIUM…tered/attention/unittests/dense/test_flex_attention.py65 # from logical positions, so it's robust to all non-tidy layouts.COMMENT
MEDIUMtest/registered/attention/unittests/dense/test_fa3.py48 # FlashAttention kernels are most stable in this harness with FA-friendly dims.COMMENT
MEDIUMtest/registered/attention/unittests/dense/test_fa4.py43 # FlashAttention kernels are most stable in this harness with FA-friendly dims.COMMENT
MEDIUM…egistered/attention/unittests/swa/test_torch_native.py105 # arithmetic, so it's robust to all non-tidy layouts.COMMENT
MEDIUMtest/registered/unit/test_runtime_context.py299 # raise under the strict harness; override() stays the entry point.COMMENT
MEDIUM…/registered/chunked_prefill/test_scripted_core_1gpu.py82 # output_ids are no longer observable through the harness. That case'sCOMMENT
MEDIUMtest/registered/hicache/test_qwen35_hicache.py15# This eval harness applies the chat_template, which is critical for qwen3.5COMMENT
MEDIUM…t/registered/page_major/test_page_major_qwen_hybrid.py33 # Measured in this harness: baseline (no page-major) and page-major bothCOMMENT
LOWtest/registered/debug_utils/test_dumper.py3345 # code can simply call `from sglang.srt.debug_utils.dumper import dumper`COMMENT
MEDIUMtest/registered/jit/kv_canary/test_verify_fuzz.py110 # harness exercises the chain-check-skip branch (added for SWA-evicted ancestor handling).COMMENT
MEDIUMtest/registered/jit/minimax/test_minimax_decode_topk.py38 """Per-row sorted-desc multiset of the scores the kernel selected (tie-robust)."""STRING
MEDIUMtest/registered/jit/minimax/test_minimax_decode_topk.py111 # tie-robust: the multiset of selected scores must match torch.topk'sCOMMENT
MEDIUM…tion_unittest/runner_modes/speculative_draft_runner.py181 # in EagleDraftWorker.__init__, which the harness skips), so build themCOMMENT
MEDIUM…tion_unittest/runner_modes/speculative_draft_runner.py199 # canary_manager); for the harness that's the fixture runner.COMMENT
MEDIUM…attention_unittest/attention_methods/dsv4_attention.py1291 # In runner-harness flows the reference is called BEFORECOMMENT
MEDIUMpython/sglang/jit_kernel/tests/utils.py47 # single test exceeds half the harness budget, so a hung collectiveCOMMENT
MEDIUMpython/sglang/srt/server_args.py6911 # under the strict test harness, a bare assignment outsideCOMMENT
MEDIUMpython/sglang/srt/environ.py203 # must go through ServerArgs.override() (enabled by the test harness).COMMENT
LOWpython/sglang/srt/disaggregation/nixl/conn.py183 ), # hacky just add it into the message that will be sentCODE
MEDIUMpython/sglang/srt/disaggregation/common/conn.py1200 # Enable higher PP ranks to be bootstrapped earlier to make PP PD requests bootstrap more robustCOMMENT
LOW…/sglang/srt/layers/attention/flashattention_backend.py3291 # then we can simply use a cdiv for the rest.COMMENT
LOW…ang/srt/layers/attention/mamba/causal_conv1d_triton.py154 # first chunk and does not have prior-token, so just set to 0COMMENT
MEDIUM…hon/sglang/srt/layers/attention/dsa/tilelang_kernel.py1086 # to better utilize FP8 dynamic range, then apply the inverse scale after GEMM.COMMENT
MEDIUMpython/sglang/srt/layers/quantization/fpgemm_fp8.py47 # For GPUs that lack FP8 hardware suspport, we can leverage the MarlinCOMMENT
MEDIUMpython/sglang/srt/layers/quantization/fp8.py311 # Keep both "model." and non-"model." variants for robust prefix matching.COMMENT
MEDIUMpython/sglang/srt/layers/quantization/fp8.py439 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUMpython/sglang/srt/layers/quantization/fp8_utils.py754 # TODO: add more robust shape check hereCOMMENT
MEDIUM…hon/sglang/srt/layers/quantization/marlin_utils_fp8.py69 # For GPUs that lack FP8 hardware support, we can leverage theCOMMENT
LOW…srt/layers/quantization/mxfp4_flashinfer_trtllm_moe.py374 # in-place. Otherwise `routed` is already scale-final and we just addCOMMENT
MEDIUMpython/sglang/srt/layers/moe/moe_runner/humming.py218 # Neighboring nodes are required to utilize distinct workspaces.COMMENT
LOWpython/sglang/srt/managers/io_struct.py826 lora_id: Optional[str] = None # None means just use the base modelCODE
LOWpython/sglang/srt/managers/io_struct.py1154 lora_id: Optional[str] = None # None means just use the base modelCODE
LOWpython/sglang/srt/managers/scheduler_pp_mixin.py457 # otherwise, just pass along previous consensusCOMMENT
LOWpython/sglang/srt/managers/scheduler.py4070 # In-place pause: just set the flag and return immediately.COMMENT
LOWpython/sglang/srt/function_call/qwen3_coder_detector.py41 # Base class already initializes _buffer, we just use it directlyCOMMENT
LOWpython/sglang/srt/parser/harmony_parser.py492 # If no emit, just return the held contentCOMMENT
LOWpython/sglang/srt/mem_cache/hiradix_cache.py1461 # unknown prefetch stop policy, just return TrueCOMMENT
MEDIUMpython/sglang/multimodal_gen/test/test_utils.py1241 """Probe whether a remote GT file exists, robust to transient failures."""STRING
MEDIUM…ultimodal_gen/test/unit/sana_wm/test_realtime_chain.py186 # Tick 2: horizon exhausted -> seamless continuation, uniform chunk fromCOMMENT
MEDIUM…/sglang/multimodal_gen/test/server/testcase_configs.py254 # Realtime video consistency harness. When set, server tests useCOMMENT
LOWpython/sglang/multimodal_gen/test/server/gpu_cases.py70# To test different models, simply add more DiffusionCase entriesCOMMENT
MEDIUM…_gen/test/single_test_file/component_accuracy/hooks.py26# These are harness defaults for synthetic accuracy inputs.COMMENT
MEDIUM…gen/test/single_test_file/component_accuracy/config.py57# of real divergence or unsupported reference loading in the harness.COMMENT
MEDIUM…lang/multimodal_gen/runtime/layers/quantization/fp8.py191 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…n/sglang/multimodal_gen/runtime/models/dits/sana_wm.py849 # parity harness (env-gated, no-op in prod): on the FIRST sink-path callCOMMENT
MEDIUM…imodal_gen/runtime/pipelines_core/stages/validators.py503 """Get a comprehensive summary of all validation failures."""STRING
MEDIUM…stages/model_specific_stages/sana_wm/realtime_chain.py257 parity_probe.dump_tensor( # parity harness (no-op in prod)CODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py17# --- debug parity harness (gated by env; no-op in production) ---COMMENT
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py288 if _dump_dir and state.chunk_idx == 0: # parity harnessCODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py333 if _dump_dir: # parity harnessCODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py379 if _dump_dir and chunk_idx == 0: # parity harnessCODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py419 parity_probe.dump_tensor( # parity harnessCODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py567 ): # parity harness: run the OFFICIAL's exact stage-1 inputsCODE
MEDIUM…core/stages/model_specific_stages/sana_wm/streaming.py576 ) # parity harness: seeded pre-noise (cond @ frame 0)CODE
12 more matches not shown…
Docstring Block Structure32 hits · 160 pts
SeverityFileLineSnippetContext
HIGHpython/sglang/kernels/ops/quantization/fp8_kernel.py1902 Quantize input tensor to FP8 (8-bit floating point) format. Args: input (torch.Tensor): Input tensor to be quantizSTRING
HIGHpython/sglang/test/ascend/test_ascend_utils.py549Start the service and obtain the inference results. Parameters: model: Model name num_prompts: TotaSTRING
HIGHpython/sglang/srt/server_args_config_parser.py53 Merge configuration file arguments with command-line arguments. Configuration arguments are inserted aSTRING
HIGHpython/sglang/srt/server_args_config_parser.py102 Parse YAML configuration file and convert to argument list. Args: file_path: Path to the YSTRING
HIGHpython/sglang/srt/layers/model_parallel.py32 Locally shards a full tensor based on indicated sharding arrangement, and returns a DTensor containing the locaSTRING
HIGH…thon/sglang/srt/layers/attention/flashinfer_backend.py517Process multi-item scoring tensors for FlashInfer attention. This method handles sequences containing multiple STRING
HIGHpython/sglang/srt/layers/attention/fla/chunk.py146 Args: q (torch.Tensor): queries of shape `[B, T, H, K]` if `head_first=False` else `[B, H, T, KSTRING
HIGH…hon/sglang/srt/layers/attention/fla/fused_recurrent.py718 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHpython/sglang/srt/layers/moe/cutlass_moe.py50Performs Fused MoE computation using CUTLASS-like kernels with FP8 weights and activations. This function implementSTRING
HIGHpython/sglang/srt/function_call/utils.py223 Get consolidated $defs from all tools, validating for conflicts. Args: tools: List of tools to processSTRING
HIGHpython/sglang/srt/utils/network.py130Bind a TCP socket on the first available address family (IPv4/IPv6). Iterates over address families returned by _geSTRING
HIGHpython/sglang/srt/utils/network.py320 Automatically detect the local IP address using multiple fallback strategies. This function attempts to obtainSTRING
HIGHpython/sglang/srt/utils/nvtx_pytorch_hooks.py46Descends iterators that contains Tensors and prints the Tensor Recursive function that descends iterator type aSTRING
HIGHpython/sglang/srt/utils/nvtx_pytorch_hooks.py74Extract the static parameters from LLM and VLM relevant layer types Args: module_obj(class): ModuleSTRING
HIGHpython/sglang/srt/utils/nvtx_pytorch_hooks.py198Callback function that ends the NVTX marker Records the module name and tensor information Called afterSTRING
HIGHpython/sglang/srt/utils/nvtx_pytorch_hooks.py218Creates an NVTX marker with the module name in it. This function is called before the module executes STRING
HIGHpython/sglang/srt/utils/nvtx_pytorch_hooks.py256User level function that activates all the hooks The user needs to call this method from the network source codSTRING
HIGHpython/sglang/srt/models/minicpmo.py137 In streaming audio generation, determine which `text` positions the TTS model can attend to when generating each chSTRING
HIGHpython/sglang/srt/models/minicpmo.py616Merge `input_ids` and `lm_spk_emb_last_hidden_states` to `inputs_embeds`. Args: input_ids (torch.TeSTRING
HIGHpython/sglang/srt/multimodal/processors/qwen_vl.py133calculate the number of frames for video used for model inputs. Args: ele (dict): a dict contains the confiSTRING
HIGHpython/sglang/srt/multimodal/processors/ernie45_vl.py133calculate the number of frames for video used for model inputs. Args: ele (dict): a dict contains the confiSTRING
HIGHpython/sglang/srt/mem_cache/storage/backend_factory.py73Create a storage backend instance. Args: backend_name: Name of the backend to create stoSTRING
HIGHpython/sglang/srt/model_loader/ci_weight_validation.py1840 CI-specific download with validation and automatic retry on corruption. This function handles the download of STRING
HIGHpython/sglang/srt/speculative/dflash_utils.py259Select target layer indices used to build DFlash context features. Args: num_target_layers: Number of transSTRING
HIGHpython/sglang/srt/speculative/dflash_utils.py552Compute DFlash accept lengths and bonus tokens (greedy verify rule). Args: candidates: Token ids proposed bSTRING
HIGH…/runtime/managers/memory_managers/layerwise_offload.py424Update consolidated CPU buffers with new weights. When layerwise offload (--dit-layerwise-offload) is enabled, STRING
HIGH…ang/multimodal_gen/runtime/utils/nvtx_pytorch_hooks.py97Walk ``model`` and attach forward pre/post hooks to every module. Args: model: Root module to instrSTRING
HIGH…ng/multimodal_gen/runtime/models/encoders/qwen2_5vl.py648 Calculate the 3D rope index based on image and video's temporal, height and width in LLM. Explanation:STRING
HIGH…imodal_gen/runtime/pipelines_core/stages/validators.py345 Add a validation check for a field. Args: field_name: Name of the field being checked STRING
HIGHsgl-model-gateway/e2e_test/infra/run_eval.py64Run an evaluation and return metrics. Args: args: Configuration object with attributes: - base_STRING
HIGHsgl-model-gateway/e2e_test/infra/model_pool.py727Get a model instance by model_id, mode, and worker_type. If the model is not running, it will be launched on-deSTRING
HIGHsgl-model-gateway/e2e_test/responses/test_basic_crud.py24Wait for background task to complete. Args: client: OpenAI client response_id: Response ID to poll STRING
Modern AI Meta-Vocabulary29 hits · 92 pts
SeverityFileLineSnippetContext
MEDIUMbenchmark/dspy/bench_dspy_intro.py113 # Print the input, the chain of thought, and the prediction.COMMENT
MEDIUMbenchmark/dspy/bench_dspy_intro.py141 # Set up a basic teleprompter, which will compile our RAG program.COMMENT
MEDIUMbenchmark/dspy/bench_dspy_intro.py147 # Ask any question you like to this simple RAG program.COMMENT
MEDIUMbenchmark/line_retrieval/gen_data.py89 # Append few-shot examplesCOMMENT
MEDIUM…t/manual/prefill_only/test_encoder_embedding_models.py12# Encoder embedding model tests (CUDA only)COMMENT
MEDIUMtest/registered/pp/test_pp_single_node.py184 # Gemma4 is instruction-tuned and doesn't follow few-shot completionCOMMENT
MEDIUMtest/registered/jit/kv_canary/test_verify_hand.py64# Shared per-test scaffolding helpers.COMMENT
MEDIUMtest/registered/eval/test_text_models_gsm8k_eval.py29 # sgl-eval (zero-shot chat, \boxed{}, math_verify grading). Thresholds areCOMMENT
MEDIUMpython/pyproject.toml153 # Pin sgl-eval to a git SHA: upgrading changes zero-shot \boxed{} grading, soCOMMENT
MEDIUMpython/sglang/benchmark/datasets/agentic_trace.py13# ~220-token average assistant reply of OpenHands-style agentic traces.COMMENT
MEDIUMpython/sglang/test/run_eval.py302 # Only the nightly correctness eval opts into sgl-eval (zero-shotCOMMENT
MEDIUMpython/sglang/test/simple_eval_mixed_prefix_gsm8k.py64 # The evaluation data should not include the few-shot examples to prevent data leakage.COMMENT
MEDIUMpython/sglang/jit_kernel/flash_attention.py31 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMpython/sglang/jit_kernel/flash_attention_v3.py124 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMpython/sglang/srt/managers/multi_tokenizer_mixin.py446 # read SHM only. Drain it event-driven via the socket's fd instead ofCOMMENT
MEDIUMpython/sglang/srt/managers/detokenizer_manager.py204 # If it is embedding model, no detokenization is needed.COMMENT
MEDIUMpython/sglang/srt/models/locate_anything.py358 # <box>: a closed <box>...</box> in a few-shot / multi-turn prompt isCOMMENT
MEDIUMpython/sglang/srt/parser/conversation.py87 # The number of few shot examplesCOMMENT
MEDIUMsgl-kernel/python/sgl_kernel/flash_attn.py58 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUM.claude/skills/large-class-style/SKILL.md29### 1.3 Allowed: orchestrationCOMMENT
MEDIUM.claude/skills/large-class-style/SKILL.md41# model_runner.py — orchestration only.COMMENT
MEDIUM…-verify/scripts/mechanical_refactor_proof_generator.py514 # are exactly the relocated symbols (the prep commit inlined them, scaffolding included, asCOMMENT
MEDIUM…-verify/scripts/mechanical_refactor_proof_generator.py680 # A move source the commit deletes (its defs all relocated, leaving only scaffolding) isCOMMENT
MEDIUMdocs_new/src/snippets/configs/poolside/laguna-m1.jsx158 // agentic coding, repeated long contexts. "Enable" emits --enable-hierarchical-cache (+host L2);COMMENT
MEDIUM…les/frontend_language/usage/openai_chat_speculative.py150 # expect answer with same format as in the few shotCOMMENT
MEDIUMexamples/runtime/chain_of_verification.py98 # `content` and the chain-of-thought in `reasoning_content`. In someCOMMENT
MEDIUMscripts/ci_monitor/ci_auto_bisect.py1060# Main orchestrationCOMMENT
MEDIUMscripts/ci/utils/ci_coverage_report.py287 # adding scaffolding for an unused backend would widen every row with aCOMMENT
MEDIUM…-model-gateway/e2e_test/embeddings/test_correctness.py151 # Get model path from MODEL_SPECS for the embedding modelCOMMENT
Hallucination Indicators8 hits · 80 pts
SeverityFileLineSnippetContext
CRITICAL…tention_unittest/attention_methods/mamba2_attention.py543 self.mixer.norm.weight.data = self.mixer.norm.weight.data.float()CODE
CRITICAL…ng/test/scripted_runtime/context/lock_ref_exhauster.py43 stack = list(self.scheduler.tree_cache.root_node.children.values())CODE
CRITICALpython/sglang/test/scripted_runtime/context/radix.py32 stack = list(ctx.scheduler.tree_cache.root_node.children.values())CODE
CRITICALpython/sglang/srt/layers/attention/fla/utils.py231 return triton.runtime.driver.active.utils.get_device_properties(tensor_idx)[CODE
CRITICALpython/sglang/srt/layers/attention/fla/utils.py286 triton.runtime.driver.active.utils.get_device_properties(i)[CODE
CRITICALpython/sglang/srt/models/glm4_moe.py487 ) and self.shared_experts.gate_up_proj.quant_method.quant_config.get_name() in {CODE
CRITICALpython/sglang/srt/models/deepseek_v2.py761 ) and self.shared_experts.gate_up_proj.quant_method.quant_config.get_name() in {CODE
CRITICAL…l_gen/runtime/pipelines_core/composed_pipeline_base.py128 task_name = self.server_args.pipeline_config.task_type.name.lower()CODE
Dead Code25 hits · 50 pts
SeverityFileLineSnippetContext
MEDIUM…ed/unit/managers/test_tokenizer_manager_rid_cleanup.py509CODE
MEDIUM…egistered/unit/scripted_runtime/test_scheduler_hook.py20CODE
MEDIUM…egistered/unit/scripted_runtime/test_scheduler_hook.py25CODE
MEDIUM…/registered/unit/entrypoints/anthropic/test_serving.py1087CODE
MEDIUM…egistered/unit/entrypoints/openai/test_serving_chat.py1543CODE
MEDIUMpython/sglang/srt/entrypoints/openai/serving_base.py146CODE
MEDIUMpython/sglang/srt/entrypoints/openai/serving_base.py149CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py814CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py815CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py816CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py819CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py820CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py822CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py824CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py827CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py828CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py830CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py840CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py855CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py865CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py866CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py867CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py895CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py896CODE
MEDIUM…ang/multimodal_gen/runtime/models/dits/hunyuanvideo.py898CODE
Slop Phrases18 hits · 42 pts
SeverityFileLineSnippetContext
MEDIUM…manual/openai_server/function_call/test_tool_choice.py845# # Start the local OpenAI Server. If necessary, you can add other parameters such as --enable-tools.COMMENT
MEDIUM…d/ascend/interface/test_npu_openai_function_calling.py53 # Start the local OpenAI Server. If necessary, you can add other parameters such as --enable-tools.COMMENT
MEDIUM…i_server/function_call/test_openai_function_calling.py43 # Start the local OpenAI Server. If necessary, you can add other parameters such as --enable-tools.COMMENT
MEDIUM…i_server/function_call/test_openai_function_calling.py926# # Start the local OpenAI Server. If necessary, you can add other parameters such as --enable-tools.COMMENT
LOWpython/sglang/test/runners.py488 # make sure to disable compileCOMMENT
MEDIUMpython/sglang/jit_kernel/flash_attention_v3.py92 # That means if you use A100/A*0/L20/L40/L40s/4090 you can use fa3.COMMENT
LOWpython/sglang/srt/models/hunyuan.py776 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOWpython/sglang/srt/models/apertus.py378 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOWpython/sglang/srt/models/mimo_v2.py958 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOWpython/sglang/srt/models/llama.py431 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOWpython/sglang/srt/models/glm4.py393 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOWpython/sglang/srt/models/qwen2.py405 # make sure to leave KV cache scale factors in a known good (dummy) stateCOMMENT
LOW…glang/multimodal_gen/runtime/models/vaes/hunyuanvae.py273 # If you are encountering an error here, make sure to try running encoding/decoding withCOMMENT
MEDIUMsgl-kernel/python/sgl_kernel/flash_attn.py24 # That means if you use A100/A*0/L20/L40/L40s/4090 you can use fa3.COMMENT
MEDIUMsgl-kernel/tests/test_flash_attention.py28 # That means if you use A100/A*0/L20/L40/L40s/4090 you can use fa3.COMMENT
MEDIUM…ntend_language/quick_start/local_example_llava_next.py55 # Or you can use the 72B modelCOMMENT
MEDIUM…ntend_language/quick_start/local_example_llava_next.py62 # Or you can use API modelsCOMMENT
MEDIUM…-gateway/examples/wasm/wasm-guest-ratelimit/src/lib.rs37// This is a simplified example for demonstration purposesCOMMENT
Overly Generic Function Names12 hits · 15 pts
SeverityFileLineSnippetContext
LOWbenchmark/hicache/bench_mix.py417 async def handle_request(self, user_data):CODE
LOWbenchmark/hicache/bench_multiturn.py388 async def handle_request(self, item):CODE
LOWpython/sglang/srt/debug_utils/dumper.py1370 def handle_request(self, *, method: str, body: dict[str, Any]) -> list[dict]:CODE
LOWpython/sglang/srt/entrypoints/openai/serving_base.py73 async def handle_request(CODE
LOW…ipts/tests/reproduction_utils/test_extract_function.py180 signature=" def helper(self):",CODE
LOW…ipts/tests/reproduction_utils/test_extract_function.py190 assert " def helper(self):\n val = compute_thing()\n" in outCODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py84 "class Old:\n @staticmethod\n def helper(x):\n return x * 2\n"CODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py91 assert "def helper(x):\n return x * 2\n" in (tmp_path / "dst.py").read_text()CODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py292 " def helper(y):\n"CODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py302 assert " @staticmethod\n def helper(y):\n" in dst_outCODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py351 (tmp_path / "src.py").write_text("def helper(x):\n return x\n")CODE
LOW…y/scripts/tests/reproduction_utils/test_move_symbol.py357 assert " def helper(x):\n return x\n" in (tmp_path / "dst.py").read_text()CODE
Synthetic Comment Markers2 hits · 15 pts
SeverityFileLineSnippetContext
HIGHtest/manual/attention/test_trtllm_mla_backend.py1236 # Reshape as requestedCOMMENT
HIGH…ang/multimodal_gen/runtime/utils/hf_diffusers_utils.py501 # Special handling for stop token <|eom_id|> generated by llama 3 tool use.COMMENT
Fake / Example Data14 hits · 14 pts
SeverityFileLineSnippetContext
LOW…l/sgl-router/tests/scripts/generate_parity_fixtures.py41 "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod "CODE
LOW…l/sgl-router/tests/scripts/generate_parity_fixtures.py41 "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod "CODE
LOWpython/sglang/test/kits/ebnf_constrained_kit.py62 self.__class__.ebnf_grammar = 'root ::= "user@example.com"'CODE
LOWpython/sglang/srt/compilation/backend.py233 if node.op in ("output", "placeholder"):CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs174 let claims = create_claims("admin@example.com", vec!["admin"]);CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs187 assert_eq!(validated.subject, "admin@example.com");CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs213 let claims = create_claims("user@example.com", vec!["user", "viewer"]);CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs221 assert_eq!(validated.subject, "user@example.com");CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs252 sub: "user@example.com".to_string(),CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs301 sub: "user@example.com".to_string(),CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs338 let claims = create_claims("user@example.com", vec!["admin"]);CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs590 let claims = create_claims("user@example.com", vec!["admin"]);CODE
LOW…-model-gateway/tests/security/auth_integration_test.rs713 let claims = create_claims("user@example.com", vec!["admin"]);CODE
LOWsgl-model-gateway/e2e_test/benchmarks/conftest.py38 "dummy-token",CODE
TODO Padding5 hits · 8 pts
SeverityFileLineSnippetContext
LOWtest/manual/test_expert_distribution.py20 # TODO: Add tests for DeepEP gatherer (currently our CI cannot run that)COMMENT
LOWpython/sglang/srt/layers/torchao_utils.py21# TODO: implement a more general filter functionCOMMENT
LOWpython/sglang/srt/layers/moe/fused_moe_triton/layer.py1289 # TODO: consider using symmetric memoryCOMMENT
LOWsgl-kernel/csrc/cpu/common.h369 // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb]COMMENT
LOWsgl-kernel/python/sgl_kernel/top_k.py12 # TODO: implement faster cuda kernels for large vocab sizesCOMMENT
Example Usage Blocks5 hits · 6 pts
SeverityFileLineSnippetContext
LOW…rimental/sgl-router/tests/e2e/k8s_integration/setup.sh6# Usage:COMMENT
LOWscripts/killall_sglang.sh8# Usage:COMMENT
LOWscripts/ci/musa/rename_wheels_musa.sh10# Usage:COMMENT
LOWsgl-model-gateway/e2e_test/k8s_integration/setup.sh8# Usage:COMMENT
LOW…ngs/golang/examples/oai_server/scripts/analyze_tpot.sh6# Usage:COMMENT