Repository Analysis

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

16.3 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of vllm-project/vllm, a Python project with 86,188 GitHub stars. SynthScan v2.0 examined 1,589,286 lines of code across 5492 source files, recording 18907 pattern matches distributed across 27 syntactic categories. The overall adjusted score of 16.3 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

16.3
Adjusted Score
16.3
Raw Score
100%
Time Factor
2026-07-14
Last Push
86.2K
Stars
Python
Language
1.6M
Lines of Code
5.5K
Files
18.9K
Pattern Hits
2026-07-14
Scan Date
0.09
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 11HIGH 483MEDIUM 2172LOW 16241

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 18907 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers10712 hits · 10466 pts
SeverityFileLineSnippetContext
LOWsetup.py57def should_require_rust_frontend() -> bool:CODE
LOWsetup.py62def get_precompiled_rust_extension_paths() -> list[Path]:CODE
LOWsetup.py66def get_missing_precompiled_rust_extension_modules() -> list[str]:CODE
LOWsetup.py77def has_precompiled_rust_extensions() -> bool:CODE
LOWsetup.py494 def fetch_metadata_for_variant(CODE
LOWsetup.py528 def detect_system_cuda_variant() -> str:CODE
LOWsetup.py582 def fetch_wheel_from_pypi_index(index_url: str, package: str = "vllm") -> str:CODE
LOWsetup.py737 def extract_precompiled_and_patch_package(CODE
LOWsetup.py860 def get_base_commit_in_main_branch() -> str:CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py92def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str:CODE
LOWcsrc/libtorch_stable/quantization/machete/generate.py334def generate_type_option_name(kernel_types: TypeConfig):STRING
LOWcsrc/libtorch_stable/quantization/machete/generate.py370def unsigned_type_with_bitwidth(num_bits):STRING
LOWtools/generate_versions_json.py86def generate_bake_native_json(args: dict[str, str]) -> dict:CODE
LOWtools/install_nixl_from_source_ubuntu.py65def install_system_dependencies():CODE
LOWtools/install_nixl_from_source_ubuntu.py105def build_and_install_prerequisites(args):CODE
LOWtools/build_rust.py39def rust_py_extension_module_names() -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1119def _expand_flash_attn_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1242def parse_cuda_priority_lists() -> dict[str, list[str]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py264def _find_exact_cc_in_function(tree: ast.AST, func_name: str) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py320def parse_mla_prefill_registry() -> dict[str, str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py340def parse_mla_prefill_priorities() -> dict[str, list[str]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py406def parse_mla_dimensions_call(node: ast.AST) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py436def parse_supported_mla_dimensions(node: ast.AST | None) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py449def parse_mla_prefill_backend_file(class_path: str) -> dict[str, Any] | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py529def parse_mla_prefill_backends() -> list[dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py932def parse_flash_attn_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1069def parse_flashinfer_trtllm_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1171def _expand_flashinfer_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1295def _get_backends_from_return(stmts: list) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1582def generate_priority_section(priorities: dict[str, list[str]]) -> str:CODE
LOW…s/gumbel_precision/prove_exponential_race_precision.py31def measure_exponential_lower_tail(CODE
LOWtools/profiler/visualize_layerwise_profile.py75def shorten_plot_legend_strings(legend, max_char_len: int):CODE
LOWtools/profiler/visualize_layerwise_profile.py94def attempt_to_make_names_unique(entries_and_traces):CODE
LOWtools/profiler/visualize_layerwise_profile.py144def group_trace_by_operations(trace_df: "pd.DataFrame") -> "pd.DataFrame":CODE
LOWtools/profiler/nsys_profile_tools/gputrc2graph.py45 def gen_nonoverlapped_sum_from_gputrace(self, in_file, out_file):CODE
LOWtools/profiler/nsys_profile_tools/gputrc2graph.py66 def sum_non_overlapping_intervals(self, df):CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py20def extract_version_from_wheel(wheel_name: str) -> str:CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py40def get_custom_wheel_versions(install_dir: str) -> dict[str, str]:CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py94def pin_dependencies_in_requirements(requirements_path: str, versions: dict[str, str]):CODE
LOWtests/test_sequence.py9def test_sequence_intermediate_tensors_equal():CODE
LOWtests/test_zen_cpu_platform_detection.py35def test_is_amd_zen_cpu_returns_false_when_cpuinfo_missing():CODE
LOWtests/test_version.py36def test_prev_minor_version_was(version_tuple, version_str, expected):CODE
LOWtests/test_ray_env_utils.py36 def test_arbitrary_var_propagated(self):CODE
LOWtests/test_ray_env_utils.py42 def test_worker_specific_excluded(self):CODE
LOWtests/test_ray_env_utils.py50 def test_non_carry_over_blacklist(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py20 def test_valueerror_converted_to_bypass(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py30 def test_original_valueerror_chained(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py44 def test_non_valueerror_propagates(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py54 def test_normal_return_preserved(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py76 def test_sentinel_attribute_set(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py90def test_patch_applied_in_current_environment():CODE
LOWtests/conftest.py219def init_test_http_connection():CODE
LOWtests/conftest.py266def should_do_global_cleanup_after_test(request) -> bool:CODE
LOWtests/conftest.py740 def _hidden_states_to_seq_logprobs(CODE
LOWtests/conftest.py763 def _hidden_states_to_logprobs(CODE
LOWtests/conftest.py790 def generate_greedy_logprobs_limit(CODE
LOWtests/conftest.py1070 def _final_steps_generate_w_logprobs(CODE
LOWtests/conftest.py1180 def generate_prompt_perplexity(CODE
LOWtests/conftest.py1289 def _wait_for_rocm_memory_release(self, gpu_memory_utilization: float) -> None:CODE
LOWtests/conftest.py1331def temporary_enable_log_propagate():CODE
10652 more matches not shown…
Decorative Section Separators1685 hits · 5814 pts
SeverityFileLineSnippetContext
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1114# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1116# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1237# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1239# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1747# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1749# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py76# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py78# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py283# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py285# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py600# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py602# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py888# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py890# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1375# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1381# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1474# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1476# ---------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh106# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh108# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh117# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh121# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh135# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh138# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh151# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh157# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh65# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh67# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh78# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh81# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh93# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh95# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh175# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh179# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh192# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh199# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh214# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh217# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh240# -----------------------------------------------------------------------------COMMENT
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh243# -----------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py11# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py13# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py48# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py99# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py133# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py135# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py147# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py149# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py34# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py36# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py121# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py123# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py434# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py436# ------------------------------------------------------------------COMMENT
1625 more matches not shown…
Cross-File Repetition385 hits · 1925 pts
SeverityFileLineSnippetContext
HIGHtests/v1/attention/test_mla_prefill_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_mha_attn.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_rocm_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/v1/logits_processors/utils.py0fake logit processor to support unit testing and examplesSTRING
HIGHdocs/features/custom_logitsprocs.md0fake logit processor to support unit testing and examplesSTRING
HIGHexamples/features/logits_processor/custom.py0fake logit processor to support unit testing and examplesSTRING
HIGHtests/v1/logits_processors/utils.py0the request-level logits processor masks out all logits except the token id identified by `target_token`STRING
HIGHdocs/features/custom_logitsprocs.md0the request-level logits processor masks out all logits except the token id identified by `target_token`STRING
HIGHexamples/features/logits_processor/custom_req.py0the request-level logits processor masks out all logits except the token id identified by `target_token`STRING
HIGHexamples/features/logits_processor/custom_req_init.py0the request-level logits processor masks out all logits except the token id identified by `target_token`STRING
HIGHtests/v1/logits_processors/utils.py0example of wrapping a fake request-level logit processor to create a batch-level logits processorSTRING
HIGHdocs/features/custom_logitsprocs.md0example of wrapping a fake request-level logit processor to create a batch-level logits processorSTRING
HIGHexamples/features/logits_processor/custom_req.py0example of wrapping a fake request-level logit processor to create a batch-level logits processorSTRING
HIGHtests/v1/logits_processors/utils.py0this method returns a new request-level logits processor, customized to the `target_token` value associated with a partiSTRING
HIGHdocs/features/custom_logitsprocs.md0this method returns a new request-level logits processor, customized to the `target_token` value associated with a partiSTRING
HIGHexamples/features/logits_processor/custom_req.py0this method returns a new request-level logits processor, customized to the `target_token` value associated with a partiSTRING
HIGHexamples/features/logits_processor/custom_req_init.py0this method returns a new request-level logits processor, customized to the `target_token` value associated with a partiSTRING
HIGH…s/v1/kv_connector/nixl_integration/toy_proxy_server.py0lifespan context manager to handle startup and shutdown events.STRING
HIGH…cache/disagg_prefill_lmcache_v1/disagg_proxy_server.py0lifespan context manager to handle startup and shutdown events.STRING
HIGH…regated/mooncake_connector/mooncake_connector_proxy.py0lifespan context manager to handle startup and shutdown events.STRING
HIGHtests/tool_parsers/test_granite_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_longcat_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/kernels/quantization/test_block_int8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/quantization/test_int8_kernel.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/moe/test_block_int8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/moe/test_triton_moe_ptpc_fp8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/distributed/test_pipeline_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/distributed/test_context_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/compile/correctness_e2e/test_sequence_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/models/multimodal/pooling/test_colpali.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/entrypoints/pooling/scoring/util.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/entrypoints/pooling/scoring/util.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/generation/test_phi4siglip.py0sanitize vllm output [phi3v] to be comparable with hf output.STRING
HIGHtests/models/multimodal/generation/test_phi4mm.py0sanitize vllm output [phi3v] to be comparable with hf output.STRING
HIGH…/models/multimodal/generation/vlm_utils/model_utils.py0sanitize vllm output [phi3v] to be comparable with hf output.STRING
HIGH…ts/models/multimodal/generation/test_granite_speech.py0sanitize vllm output [phi3v] to be comparable with hf output.STRING
HIGHtests/entrypoints/openai/completion/test_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…ypoints/openai/chat_completion/test_chat_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHdocs/features/structured_outputs.md0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…atures/structured_outputs/structured_outputs_client.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…tures/structured_outputs/structured_outputs_offline.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHbenchmarks/benchmark_serving_structured_output.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHtests/lora/test_qwen3moe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_llama_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_olmoe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHvllm/sampling_params.py0whether to include the stop strings in output text.STRING
HIGH…m/entrypoints/speech_to_text/transcription/protocol.py0whether to include the stop strings in output text.STRING
HIGHvllm/entrypoints/speech_to_text/translation/protocol.py0whether to include the stop strings in output text.STRING
325 more matches not shown…
Unused Imports1388 hits · 1287 pts
SeverityFileLineSnippetContext
LOW…c/cutlass_extensions/vllm_cutlass_library_extension.py6CODE
LOWtools/build_rust.py6CODE
LOW…s/gumbel_precision/prove_exponential_race_precision.py18CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py78CODE
LOWtests/utils.py63CODE
LOWtests/utils.py2176CODE
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py13CODE
LOWtests/v1/kv_offload/tiering/p2p/test_zmq_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_data_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py9CODE
LOWtests/v1/attention/test_mla_backends.py75CODE
LOWtests/v1/attention/test_attention_backends.py50CODE
LOWtests/v1/logits_processors/utils.py13CODE
LOWtests/v1/cudagraph/test_cudagraph_mode.py38CODE
LOWtests/v1/cudagraph/test_breakable_cudagraph.py7CODE
LOWtests/v1/kv_connector/unit/test_tp_mapping.py10CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py21CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py3CODE
LOWtests/v1/spec_decode/test_backup_token_async_spec.py9CODE
LOWtests/v1/sample/test_topk_topp_sampler.py33CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/simple_kv_offload/test_scheduler.py5CODE
LOWtests/v1/simple_kv_offload/test_worker.py10CODE
LOWtests/tool_use/test_gemma4_responses_adjust_request.py32CODE
LOWtests/tool_parsers/test_poolside_v1_tool_parser.py21CODE
LOWtests/renderers/test_chat_utils_prompt_embeds.py6CODE
LOWtests/kernels/core/test_vit_fp8_attn.py20CODE
LOWtests/kernels/core/test_fused_q_kv_rmsnorm.py11CODE
LOWtests/kernels/ir/test_ir_ops.py11CODE
LOWtests/kernels/ir/test_layernorm.py7CODE
LOWtests/kernels/mamba/test_precopy_mamba_align.py20CODE
LOWtests/kernels/mamba/test_gdn_forward_core_split.py30CODE
LOWtests/kernels/mamba/test_ssu_dispatch.py24CODE
LOWtests/kernels/moe/test_moe.py18CODE
LOWtests/distributed/test_eplb_spec_decode.py3CODE
LOW…add_dummy_platform/vllm_add_dummy_platform/__init__.py10CODE
LOWtests/cuda/scripts/check_device_count_respects_env.py14CODE
LOWtests/model_executor/test_oink_integration.py37CODE
LOWtests/models/language/pooling/embed_utils.py8CODE
LOWtests/models/language/pooling/test_reward.py18CODE
LOWtests/models/multimodal/generation/test_pixtral.py24CODE
LOWtests/vllm_test_utils/vllm_test_utils/__init__.py8CODE
LOWtests/vllm_test_utils/vllm_test_utils/__init__.py8CODE
LOWtests/vllm_test_utils/vllm_test_utils/__init__.py9CODE
LOWtests/vllm_test_utils/vllm_test_utils/__init__.py9CODE
LOWtests/parser/engine/test_replay.py13CODE
LOWtests/parser/engine/trace_builder.py14CODE
LOWtests/parser/engine/test_delegating_replay.py14CODE
LOWtests/parser/engine/streaming_helpers.py5CODE
LOWtests/parser/engine/replay_harness.py10CODE
LOWtests/parser/engine/test_parser_engine.py8CODE
LOWtests/parser/engine/test_ufffd_reasoning_transition.py14CODE
1328 more matches not shown…
Deep Nesting1124 hits · 1014 pts
SeverityFileLineSnippetContext
LOWuse_existing_torch.py21CODE
LOWsetup.py1004CODE
LOWsetup.py1048CODE
LOWsetup.py197CODE
LOWsetup.py638CODE
LOWsetup.py737CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py92CODE
LOW…ibtorch_stable/quantization/marlin/generate_kernels.py173CODE
LOW…btorch_stable/moe/marlin_moe_wna16/generate_kernels.py173CODE
LOWtools/report_build_time_ninja.py151CODE
LOWtools/pre_commit/generate_attention_backend_docs.py116CODE
LOWtools/pre_commit/generate_attention_backend_docs.py141CODE
LOWtools/pre_commit/generate_attention_backend_docs.py162CODE
LOWtools/pre_commit/generate_attention_backend_docs.py207CODE
LOWtools/pre_commit/generate_attention_backend_docs.py340CODE
LOWtools/pre_commit/generate_attention_backend_docs.py449CODE
LOWtools/pre_commit/generate_attention_backend_docs.py614CODE
LOWtools/pre_commit/generate_attention_backend_docs.py658CODE
LOWtools/pre_commit/generate_attention_backend_docs.py932CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1242CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1295CODE
LOWtools/pre_commit/validate_config.py73CODE
LOWtools/pre_commit/check_boolean_context_manager.py21CODE
LOWtools/pre_commit/check_spdx_header.py60CODE
LOWtools/pre_commit/check_spdx_header.py94CODE
LOWtools/pre_commit/check_spdx_header.py139CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py40CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py94CODE
LOWtests/conftest.py527CODE
LOWtests/conftest.py984CODE
LOWtests/utils.py1212CODE
LOWtests/utils.py1545CODE
LOWtests/utils.py1709CODE
LOWtests/utils.py1835CODE
LOWtests/utils.py576CODE
LOWtests/utils.py1715CODE
LOWtests/utils.py1858CODE
LOWtests/v1/utils.py12CODE
LOWtests/v1/kv_offload/cpu/test_gpu_worker.py223CODE
LOWtests/v1/tracing/test_tracing.py22CODE
LOWtests/v1/attention/test_mla_backends.py1039CODE
LOWtests/v1/attention/test_sparse_mla_backends.py551CODE
LOWtests/v1/logits_processors/test_correctness.py304CODE
LOWtests/v1/logits_processors/test_correctness.py456CODE
LOWtests/v1/core/test_scheduler.py2313CODE
LOWtests/v1/core/utils.py200CODE
LOWtests/v1/kv_connector/unit/test_nixl_connector.py2924CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py306CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py358CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py374CODE
LOWtests/v1/kv_connector/unit/utils.py318CODE
LOWtests/v1/kv_connector/unit/test_mooncake_connector.py1214CODE
LOW…kv_connector/unit/offloading_connector/test_metrics.py219CODE
LOWtests/v1/determinism/test_batch_invariance.py28CODE
LOWtests/v1/determinism/test_batch_invariance.py155CODE
LOWtests/v1/determinism/test_batch_invariance.py646CODE
LOWtests/v1/determinism/test_nvfp4_batch_invariant.py45CODE
LOWtests/v1/spec_decode/test_eagle.py48CODE
LOWtests/v1/spec_decode/test_acceptance_length.py181CODE
LOWtests/v1/spec_decode/test_acceptance_length.py231CODE
1064 more matches not shown…
Self-Referential Comments317 hits · 1010 pts
SeverityFileLineSnippetContext
MEDIUMtools/install_deepgemm.sh84# Create a temporary directory for the buildCOMMENT
MEDIUMtools/report_build_time_ninja.py201 # Create a list that is in order by time stamp and has entries for theCOMMENT
MEDIUMtools/pre_commit/update-dockerfile-graph.sh26 # Define the target file pathCOMMENT
MEDIUMtests/conftest.py553 # Create a copy to avoid modifying the original dictCOMMENT
MEDIUMtests/utils.py787 # Create a dedicated process group so we can killCOMMENT
MEDIUMtests/utils.py1718 # Create a unique temporary file to store exception info from childCOMMENT
MEDIUMtests/test_access_log_filter.py259 # Create a logger with our filter (simulating uvicorn.access)COMMENT
MEDIUMtests/test_access_log_filter.py266 # Create a custom handler that tracks messagesCOMMENT
MEDIUMtests/test_config.py841 # Create a new mock and run the method with the same S3 URLCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py193 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py511 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py642 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py905 # Create a tensor queueCOMMENT
MEDIUMtests/v1/test_serial_utils.py189 # Create a sample Python objectCOMMENT
MEDIUMtests/v1/test_serial_utils.py207 # Create a sample tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py227 # Create a sample numpy arrayCOMMENT
MEDIUMtests/v1/test_serial_utils.py313 # Create a request with a non-multimodal tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py354 # Create a request with None for the tensor fieldCOMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py51 # Create a copy of the mock config to avoid modifying the global oneCOMMENT
MEDIUMtests/v1/metrics/test_ray_metrics.py71 # Create the actor and call the async methodCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py285 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py1524 # Create a summary for the single-line failure messageCOMMENT
MEDIUMtests/v1/attention/test_attention_backends.py186 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/logits_processors/test_correctness.py807 # Define a shuffled batch of requests which individually use a differentCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py63 # Create a vLLM instance and load custom logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py70 # Create a reference vLLM instance without custom logitprocCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py258 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py261 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py463 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py466 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py304 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py352 # Create an empty FreeKVCacheBlockQueueCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py406 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1358 # Create a VllmConfigCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1394 # Create a VllmConfigCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3034 # Create a request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3061 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3831 # Create a request and schedule it (and to be preempted)COMMENT
MEDIUMtests/v1/core/test_scheduler.py3881 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py4751 # Create a text-only request (no mm_features).COMMENT
MEDIUMtests/v1/cudagraph/test_cudagraph_dispatch.py56 # Create a real LoRAConfig with specialize_active_lora enabledCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector.py2270 # Create a request that triggers do_remote_decode so thatCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_lmcache_connector.py216 # Create a mock object that is not LMCacheKVEventsCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_moriio_connector.py219 # Define a fake remote engine id for testingCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py145 # Create a request with multiple blocks worth of tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py189 # Create a requestCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py211 # Create a request with just 1 tokenCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py229 # Create a request with 2 tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py255 # Create a request with many blocksCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py338 # Create a request that doesn't align to block boundariesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector_hma.py77 # Create a mock worker with just the required attributesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_example_connector.py146 # Create the LLM instanceCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py45 # Create a minimal Llama config with small dimensionsCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py60 # Create a simple tokenizerCOMMENT
MEDIUMtests/v1/determinism/test_batch_invariance.py103 # Create a batch of size `max_batch_size` and insert the needle atCOMMENT
MEDIUMtests/v1/distributed/test_external_lb_dp.py154 # Create a client for each serverCOMMENT
MEDIUMtests/v1/distributed/test_hybrid_lb_dp.py182 # Create a client for each node (each node has its own API endpoint)COMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py20 # Create a minimal mock without initializing the full engineCOMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py50 # Create a mock queue with outputsCOMMENT
257 more matches not shown…
Over-Commented Block963 hits · 850 pts
SeverityFileLineSnippetContext
LOWCMakeLists.txt1cmake_minimum_required(VERSION 3.26)COMMENT
LOWCMakeLists.txt61#COMMENT
LOWCMakeLists.txt101find_program(NVCC_EXECUTABLE nvcc)COMMENT
LOWCMakeLists.txt241#COMMENT
LOWcsrc/torch_utils.h1#pragma onceCOMMENT
LOWcsrc/torch_bindings.cpp1// Provides torch::Tensor for ops.h (previously included transitively viaCOMMENT
LOWcsrc/cumem_allocator_compat.h101} // extern "C"COMMENT
LOWcsrc/cumem_allocator.cpp1// A CUDAPluggableAllocator based on cumem* APIs.COMMENT
LOWcsrc/cuda_compat.h41 #define VLLM_LDG(arg) __ldg(arg)COMMENT
LOWcsrc/cuda_compat.h61#endifCOMMENT
LOWcsrc/cuda_utils.h1#pragma onceCOMMENT
LOWcsrc/spinloop.cpp1#include <Python.h>COMMENT
LOWcsrc/attention/attention_dtypes.h1#pragma onceCOMMENT
LOWcsrc/core/scalar_type.hpp1#pragma onceCOMMENT
LOWcsrc/core/registration.h1#pragma onceCOMMENT
LOWcsrc/cpu/cpu_attn_neon.hpp1#ifndef CPU_ATTN_NEON_HPPCOMMENT
LOWcsrc/cpu/utils.cpp1#ifndef VLLM_NUMA_DISABLEDCOMMENT
LOWcsrc/cpu/cpu_wna16.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_fused_moe.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types.hpp1#ifndef CPU_TYPES_HPPCOMMENT
LOWcsrc/cpu/cpu_types.hpp21 #include "cpu_types_scalar.hpp"COMMENT
LOWcsrc/cpu/cpu_types_riscv.hpp1#ifndef CPU_TYPES_RISCV_HPPCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp981 // - q_heads_buffer: [MaxQHeadNumPerIteration, head_dim]COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1001 // - q_heads_per_kvCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1121 // print_logits("masked logits", logits_buffer, q_head_num,COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1821COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1841COMMENT
LOWcsrc/cpu/cpu_attn_vxe.hpp381} // namespace cpu_attentionCOMMENT
LOWcsrc/cpu/generate_cpu_attn_dispatch.py141#ifdef CPU_CAPABILITY_AMXBF16COMMENT
LOWcsrc/cpu/cpu_arch_macros.h61#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h161 #include <riscv_vector.h>COMMENT
LOWcsrc/cpu/cpu_attn_rvv.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_attn_fp8.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp1COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp21#define vec_sr(a, b) ((a) >> (b)) // Vector Shift Right AlgebraicCOMMENT
LOWcsrc/cpu/cpu_types_x86.hpp1COMMENT
LOWcsrc/cpu/shm.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types_riscv_impl.hpp1#ifndef CPU_TYPES_RISCV_IMPL_HPPCOMMENT
LOWcsrc/cpu/cpu_types_riscv_impl.hpp1001 #define CPU_KERNEL_GUARD_IN(NAME)COMMENT
LOWcsrc/cpu/cpu_types_riscv_defs.hpp1#ifndef CPU_TYPES_RISCV_DEFS_HPPCOMMENT
LOWcsrc/cpu/cpu_types_riscv_defs.hpp21 #define BOOL_256 b16COMMENT
LOWcsrc/cpu/cpu_attn_vsx.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_attn_vsx.hpp361COMMENT
LOWcsrc/cpu/sgl-kernels/gemm.cpp81 constexpr int BLOCK_N = block_size_n();COMMENT
LOWcsrc/cpu/sgl-kernels/fla.cpp1// Adapted fromCOMMENT
LOWcsrc/cpu/sgl-kernels/gemm.h1// Adapted fromCOMMENT
LOWcsrc/cpu/sgl-kernels/vec.h1// Adapted fromCOMMENT
LOWcsrc/cpu/sgl-kernels/moe.cpp1// Adapted fromCOMMENT
LOWcsrc/cpu/sgl-kernels/moe.cpp21// allocates 2 intermediate_caches instead of 3COMMENT
LOWcsrc/cpu/sgl-kernels/moe.cpp1261 // unlike triton kernel, we fuse silu with gemm1 so only need 2 intermediate_caches:COMMENT
LOWcsrc/cpu/sgl-kernels/moe_int4.cpp61 // num_threads * BLOCK_M * K +COMMENT
LOWcsrc/cpu/sgl-kernels/common.h1// Adapted fromCOMMENT
LOWcsrc/cpu/sgl-kernels/common.h201}COMMENT
LOWcsrc/cpu/sgl-kernels/common.h281 return std::max(1, (actual_nth >> 1) * 2);COMMENT
LOWcsrc/cpu/sgl-kernels/conv.cpp141 Unroll<ROWS * COLS>{}(loadb);COMMENT
LOWcsrc/cpu/sgl-kernels/conv.cpp541//COMMENT
LOWcsrc/libtorch_stable/torch_utils.h1#pragma onceCOMMENT
LOWcsrc/libtorch_stable/torch_bindings.cpp1#include "ops.h"COMMENT
LOWcsrc/libtorch_stable/cub_helpers.h1#pragma onceCOMMENT
LOWcsrc/libtorch_stable/launch_bounds_utils.h1#pragma onceCOMMENT
903 more matches not shown…
Excessive Try-Catch Wrapping688 hits · 741 pts
SeverityFileLineSnippetContext
MEDIUMsetup.py134def find_tcmalloc() -> Path | None:CODE
MEDIUMsetup.py860def get_base_commit_in_main_branch() -> str:CODE
LOWsetup.py142 except Exception:CODE
LOWsetup.py231 except Exception as e:CODE
LOWsetup.py546 except Exception:CODE
LOWsetup.py557 except Exception:CODE
LOWsetup.py684 except Exception as e:CODE
LOWsetup.py914 except Exception as err:CODE
LOWsetup.py985 except Exception:CODE
MEDIUMtools/generate_cmake_presets.py168 print(f"Error writing file: {e}")CODE
LOWtools/install_nixl_from_source_ubuntu.py30 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py331 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py352 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py464 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py809 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py823 except Exception as e:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py906 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py943 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1081 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1263 except Exception:CODE
LOWtools/profiler/nsys_profile_tools/gputrc2graph.py239 except Exception:CODE
LOWtools/vllm-rocm/pin_rocm_dependencies.py79 except Exception as e:CODE
LOWtests/conftest.py1316 except Exception:CODE
LOWtests/conftest.py1579 except Exception as e:CODE
MEDIUMtests/utils.py117def _nvml():CODE
LOWtests/utils.py81 except Exception as e:CODE
LOWtests/utils.py315 except Exception:CODE
LOWtests/utils.py614 except Exception as e:CODE
LOWtests/utils.py700 except Exception:CODE
LOWtests/utils.py1747 except Exception as e:CODE
LOWtests/utils.py1770 except Exception:CODE
LOWtests/utils.py1964 except Exception as e:CODE
LOWtests/utils.py2179 except Exception:CODE
LOWtests/v1/test_tensor_ipc_queue.py83 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py120 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py308 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py409 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py443 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py532 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py570 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py721 except Exception as e:CODE
LOWtests/v1/utils.py64 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py156 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py117 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py220 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py261 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py272 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py292 except Exception as e:CODE
MEDIUMtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py255def _run_decode():CODE
LOWtests/v1/shutdown/test_forward_error.py82 except Exception as e:CODE
LOWtests/v1/shutdown/test_processor_error.py39 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py28except Exception:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py390 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/utils.py353 except Exception as e:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py700 except Exception:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py737 except Exception:CODE
LOWtests/v1/kv_connector/unit/test_rixl_gpu_mem_diag.py36 except Exception:CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py253 except Exception as e:CODE
MEDIUM…s/v1/kv_connector/nixl_integration/toy_proxy_server.py258 print(f"Error occurred in disagg prefill proxy server - {api} endpoint")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py159 print(f"Error writing to file: {e}")CODE
628 more matches not shown…
Redundant / Tautological Comments273 hits · 415 pts
SeverityFileLineSnippetContext
LOWsetup.py882 # Check if the upstream_main_commit exists in the local repoCOMMENT
LOWtools/install_torchcodec_rocm.sh19# Check if torchcodec is already installed and workingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py368 # Check if it's a capability.major == 10 check (Blackwell)COMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py832 # Check if this is an MLA backend by parent class or namingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py1280 # Check if this is the "if use_mla:" branchCOMMENT
LOWtools/pre_commit/check_forbidden_imports.py99 # Check if it's allowedCOMMENT
LOWtools/pre_commit/update-dockerfile-graph.sh10# Check if docker/Dockerfile is among the provided filesCOMMENT
LOWtools/pre_commit/update-dockerfile-graph.sh14 # Check if Docker is installed and runningCOMMENT
LOWtools/pre_commit/update-dockerfile-graph.sh71 # Check if the graph has changedCOMMENT
LOWtools/vllm-rocm/pin_rocm_dependencies.py148 # Check if this line is for one of our custom packagesCOMMENT
LOWtests/conftest.py387 # Set this to avoid hanging issueCOMMENT
LOWtests/conftest.py926 # Set this to avoid hanging issueCOMMENT
LOWtests/utils.py544 os.kill(spid, 0) # Check if still aliveCODE
LOWtests/test_config.py601 # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_configCOMMENT
LOWtests/v1/attention/test_mla_backends.py1158 # Set num_speculative_tokens to query_len - 1COMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py631 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py635 # Set some to out of boundsCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py691 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py695 # Set some to out of boundsCOMMENT
LOWtests/v1/core/test_scheduler.py2377 # Verify if position length is identicalCOMMENT
LOWtests/v1/core/test_scheduler.py3290 # Check if scheduled_encoder_inputs is empty as expectedCOMMENT
LOWtests/v1/core/test_scheduler.py3642 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/test_scheduler.py3972 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/utils.py255 # Verify if position length is identicalCOMMENT
LOW…extract_hidden_states_integration/predictable_llama.py81 # Check if we need auxiliary hidden statesCOMMENT
LOW…nnector/nixl_integration/config_sweep_accuracy_test.sh97# Check if cross-layers is enabled (non-empty)COMMENT
LOWtests/v1/determinism/test_batch_invariance.py280 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py559 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py788 # Check if tokens matchCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py806 # Check if logprobs match bitwiseCOMMENT
LOWtests/v1/spec_decode/test_acceptance_length.py108 # Check if get_valid_backends is actually defined in the platform classCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh25# Set 1 to use multimodal prompts; else to use text-onlyCOMMENT
LOW…ts/v1/ec_connector/integration/test_epd_correctness.py218 # Check if server is readyCOMMENT
LOWtests/v1/e2e/spec_decode/test_async_spec_decode.py34 # Increment counterCOMMENT
LOWtests/v1/engine/test_engine_core_client.py311 # Check if all request IDs in outputs have finishedCOMMENT
LOWtests/v1/engine/utils.py131 # Check if the sampled_token_id occurs in choice_tensor[1:]COMMENT
LOWtests/utils_/test_network_utils.py79 # Check if IPv6 is supported by trying to create an IPv6 socketCOMMENT
LOWtests/tool_parsers/test_mistral_tool_parser.py129 # Check if the slice from the current position matches the target sequenceCOMMENT
LOWtests/kernels/mamba/test_cpu_short_conv.py111 # Check if KV cache was updatedCOMMENT
LOWtests/kernels/mamba/test_cpu_short_conv.py169 # Check if KV cache was updatedCOMMENT
LOWtests/kernels/moe/test_moe_layer.py1819 # Check if enough GPUs availableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py26# Check if aiter package is installedCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py35 # Check if the op exists in torch.ops.vllmCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py38 # Check if the op is callableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py44 # Check if the op exists in torch.ops.vllmCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py47 # Check if the op is callableCOMMENT
LOWtests/evals/gsm8k/gsm8k_eval.py352 # Print results to terminalCOMMENT
LOWtests/distributed/test_eplb_execute.py150 # Check if the weights are correctCOMMENT
LOWtests/model_executor/test_qwen3_omni.py29 # Check if it's a special token that should be compressedCOMMENT
LOW…model_loader/runai_streamer_loader/test_runai_utils.py56 # Read the file in chunks to handle large files efficientlyCOMMENT
LOWtests/models/multimodal/generation/test_maverick.py59 # Print the outputsCOMMENT
LOWtests/quantization/test_gptq_v2.py43 # Check if gptq_v2 format is correctly loadedCOMMENT
LOWtests/quantization/test_gptq_v2.py105 # Print the output sequences if failedCOMMENT
LOWtests/compile/test_config.py50 # Check if get_raw_stream exists in builtinsCOMMENT
LOWtests/compile/fusions_e2e/conftest.py44 # Print the outputs.COMMENT
LOWtests/compile/fullgraph/test_full_graph.py245 # Print the outputs.COMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py71 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py140 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/serve/utils/test_request_logger.py95 # Set max_log_len to 10COMMENT
LOW…rve/sagemaker/test_sagemaker_middleware_integration.py326 # Check if environment variable middleware was appliedCOMMENT
213 more matches not shown…
Modern Structural Boilerplate342 hits · 344 pts
SeverityFileLineSnippetContext
LOWsetup.py35logger = logging.getLogger(__name__)CODE
LOWtools/profiler/nsys_profile_tools/gputrc2graph.py15logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py32logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py118 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py88 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py7__all__ = ["request_runner"]CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWtests/v1/worker/test_gpu_worker_weight_transfer.py28 def update_weights(self, update_info: dict) -> None:CODE
LOWtests/v1/engine/test_core_engine_actor_manager.py45 def _set_visible_devices(self, vllm_config: Any, local_dp_rank: int) -> None:CODE
LOWtests/kernels/moe/test_marlin_vs_trtllm_mxint4.py77__all__ = [CODE
LOWtests/distributed/eplb_utils.py73def set_env_vars_and_device(env: dict[str, str]) -> None:CODE
LOWtests/models/language/generation/test_hybrid.py68def _set_conv_state_layout(monkeypatch, layout: str) -> None:CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py37logger = logging.getLogger(__name__)CODE
LOWtests/vllm_test_utils/vllm_test_utils/__init__.py11__all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"]CODE
LOWtests/parser/engine/replay_harness.py82 def set_vocab(self, vocab: dict[str, int]) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py501async def _set_healthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py511async def _set_unhealthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/responses/conftest.py15logger = logging.getLogger(__name__)CODE
LOW…/entrypoints/openai/responses/test_parsable_context.py21logger = logging.getLogger(__name__)CODE
LOWtests/entrypoints/openai/responses/test_harmony.py30logger = logging.getLogger(__name__)CODE
LOWvllm/envs.py533logger = logging.getLogger(__name__)CODE
LOWvllm/env_override.py443def _update_scheduler_patched(self) -> None:CODE
LOWvllm/sampling_params.py659 def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None:CODE
LOWvllm/__init__.py76__all__ = [CODE
LOWvllm/v1/request.py257 def update_block_hashes(self) -> None:CODE
LOWvllm/v1/kv_offload/tiering/example/manager.py30logger = logging.getLogger(__name__)CODE
LOWvllm/v1/kv_offload/tiering/p2p/data/__init__.py6__all__ = [CODE
LOWvllm/v1/kv_offload/tiering/p2p/control/__init__.py12__all__ = [CODE
LOWvllm/v1/kv_offload/tiering/p2p/session/__init__.py10__all__ = [CODE
LOWvllm/v1/kv_offload/tiering/fs/io.py9logger = logging.getLogger(__name__)CODE
LOWvllm/v1/metrics/stats.py304 def update_from_output(self, prefill_stats: PrefillStats) -> None:CODE
LOWvllm/v1/attention/backends/flash_attn_diffkv.py41 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWvllm/v1/attention/backends/triton_attn_diffkv.py81 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWvllm/v1/attention/backends/mla/prefill/__init__.py10__all__ = [CODE
LOWvllm/v1/attention/ops/triton_decode_attention.py42logger = logging.getLogger(__name__)CODE
LOWvllm/v1/core/sched/async_scheduler.py19 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWvllm/v1/core/sched/interface.py111 def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None:CODE
LOWvllm/v1/core/sched/interface.py204 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWvllm/v1/core/sched/scheduler.py2474 def _update_waiting_for_remote_kv(self, request: Request) -> None:CODE
LOWvllm/v1/core/sched/scheduler.py1197 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWvllm/v1/core/sched/scheduler.py1987 def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None:CODE
LOWvllm/v1/core/sched/scheduler.py2176 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWvllm/v1/spec_decode/extract_hidden_states.py89 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWvllm/v1/spec_decode/gemma4.py61 def set_per_group_block_table(self, gid: int, block_table: torch.Tensor) -> None:CODE
LOWvllm/v1/spec_decode/gemma4.py115 def _setup_centroids_cuda_graphs(self) -> None:CODE
LOWvllm/v1/spec_decode/llm_base_proposer.py343 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWvllm/v1/sample/thinking_budget_state.py236 def _update_think_state(self, state: dict[str, Any]) -> None:CODE
LOWvllm/v1/sample/logits_processor/__init__.py344__all__ = [CODE
LOWvllm/v1/executor/vllm_net_devices.py139def set_worker_gpu_nic_mapping(local_rank: int) -> None:CODE
LOWvllm/v1/executor/vllm_net_devices.py220def set_worker_net_device(local_rank: int, vllm_config: VllmConfig) -> None:CODE
LOWvllm/v1/executor/__init__.py6__all__ = ["Executor", "UniProcExecutor"]CODE
LOWvllm/v1/worker/gpu_worker.py441 def update_config(self, overrides: dict[str, Any]) -> None:CODE
LOWvllm/v1/worker/gpu_worker.py702 def update_max_model_len(self, max_model_len: int) -> None:CODE
LOWvllm/v1/worker/gpu_worker.py933 def _set_draft_weight_update_target(self) -> None:CODE
LOWvllm/v1/worker/gpu_worker.py1251 def update_weights(self, update_info: dict) -> None:CODE
LOWvllm/v1/worker/gpu_input_batch.py1021 def update_async_output_token_ids(self) -> None:CODE
LOWvllm/v1/worker/gpu_input_batch.py1068 def update_async_spec_token_ids(self, draft_token_ids: list[list[int]]) -> None:CODE
LOWvllm/v1/worker/gpu_model_runner.py944 def update_max_model_len(self, max_model_len: int) -> None:CODE
LOWvllm/v1/worker/gpu_model_runner.py5219 def update_config(self, overrides: dict[str, Any]) -> None:CODE
LOWvllm/v1/worker/gpu_model_runner.py5410 def _setup_eagle3_aux_hidden_state_outputs(self) -> None:CODE
282 more matches not shown…
Structural Annotation Overuse178 hits · 323 pts
SeverityFileLineSnippetContext
LOWtests/v1/kv_offload/tiering/test_async_lookup.py136 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py142 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1180 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5221 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5231 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5240 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py567 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py576 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py582 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py433 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py450 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py460 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py468 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py477 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py551 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py560 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py568 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py577 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py584 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py493 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py701 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py720 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py373 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py447 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py514 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py388 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py421 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py459 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py495 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py526 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py544 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py557 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py84 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py100 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py116 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py155 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py175 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py192 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py59 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py77 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py96 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py181 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py15 # Step 1: entry was added, committed to slot. Deque fills to maxlen=1,COMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py20 # Step 2: deque is full, oldest slot (containing h1) expires.COMMENT
LOW…s/v1/ec_connector/unit/cpu/scheduler/test_scheduler.py276 # Step 3: unpin fires, now eviction works.COMMENT
LOWtests/v1/ec_connector/integration/README.md61### Step 1: BaselineCOMMENT
LOWtests/v1/ec_connector/integration/README.md68### Step 2: EPD (1E + 1PD)COMMENT
LOWtests/v1/ec_connector/integration/README.md76### Step 3: EPD (1E + 1P + 1D)COMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh459# Step 1: Run baselineCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh462# Step 2: Test 1E + 1PDCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh465# Step 3: Test baseline 1P + 1DCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh468# Step 4: Test 1E + 1P + 1DCOMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py683 # Step 1: In-place CUDA RoPE (same as production)COMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py695 # Step 2: Reshape + quant + reshape (same as production)COMMENT
118 more matches not shown…
AI Structural Patterns343 hits · 322 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py373CODE
LOWtests/conftest.py411CODE
LOWtests/conftest.py910CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py388CODE
LOWtests/v1/attention/utils.py184CODE
LOWtests/v1/attention/test_attention_backends.py312CODE
LOWtests/v1/core/test_kv_cache_utils.py113CODE
LOWtests/v1/core/test_scheduler.py2190CODE
LOWtests/v1/core/test_scheduler.py2313CODE
LOWtests/v1/core/utils.py45CODE
LOWtests/v1/core/utils.py200CODE
LOWtests/v1/kv_connector/unit/test_moriio_connector.py237CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py353CODE
LOWtests/v1/kv_connector/unit/utils.py91CODE
LOWtests/v1/kv_connector/unit/utils.py193CODE
LOWtests/v1/sample/test_rejection_sampler.py71CODE
LOWtests/v1/e2e/general/test_mamba_prefix_cache.py178CODE
LOWtests/kernels/utils.py278CODE
LOWtests/kernels/utils.py855CODE
LOWtests/kernels/attention/test_mha_attn.py117CODE
LOWtests/kernels/attention/test_attention.py54CODE
LOW…sts/kernels/attention/test_triton_prefill_attention.py75CODE
LOWtests/kernels/mamba/test_mamba_ssm.py112CODE
LOWtests/kernels/quantization/test_nvfp4_quant.py81CODE
LOWtests/kernels/moe/test_deepep_v2_moe.py194CODE
LOWtests/kernels/moe/test_moe_permute_unpermute.py114CODE
LOWtests/kernels/moe/test_moe.py1540CODE
LOWtests/kernels/moe/utils.py50CODE
LOWtests/kernels/moe/test_moe_layer.py975CODE
LOWtests/kernels/moe/test_moe_layer.py1078CODE
LOWtests/evals/mrcr/mrcr_eval.py161CODE
LOWtests/evals/gsm8k/gsm8k_eval.py208CODE
LOWtests/distributed/test_multiproc_executor.py23CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py588CODE
LOWtests/models/transformers/fusers/test_moe.py148CODE
LOWtests/quantization/reference_mxfp4.py88CODE
LOWtests/quantization/reference_mxfp4.py235CODE
LOWtests/compile/test_graph_partition.py103CODE
LOWtests/compile/fullgraph/test_toy_llama.py155CODE
LOWtests/compile/passes/test_silu_mul_quant_fusion.py132CODE
LOWtests/compile/passes/test_fusion.py502CODE
LOWtests/benchmarks/test_random_dataset.py177CODE
LOWtests/entrypoints/openai/utils.py138CODE
LOWvllm/sampling_params.py356CODE
LOWvllm/_custom_ops.py2534CODE
LOWvllm/_custom_ops.py3194CODE
LOWvllm/_xpu_ops.py758CODE
LOWvllm/_xpu_ops.py837CODE
LOWvllm/forward_context.py212CODE
LOWvllm/forward_context.py260CODE
LOWvllm/_aiter_ops.py113CODE
LOWvllm/_aiter_ops.py173CODE
LOWvllm/_aiter_ops.py202CODE
LOWvllm/_aiter_ops.py239CODE
LOWvllm/_aiter_ops.py473CODE
LOWvllm/_aiter_ops.py541CODE
LOWvllm/_aiter_ops.py2192CODE
LOWvllm/_aiter_ops.py2242CODE
LOWvllm/_aiter_ops.py2363CODE
LOWvllm/_aiter_ops.py2719CODE
283 more matches not shown…
Cross-Language Confusion56 hits · 282 pts
SeverityFileLineSnippetContext
HIGHsetup.py705 "build_tag": null,STRING
HIGHsetup.py709 "variant": null,STRING
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py156 (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)CODE
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py228 "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)",CODE
HIGHcsrc/libtorch_stable/quantization/machete/generate.py512 "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py515 "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py516 "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py519 "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py520 "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py521 "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py524 "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py525 "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py528 "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)),STRING
HIGHtests/v1/attention/test_trtllm_attention_integration.py149 # Randomly permute blocks (starting from block 1; block 0 is null).COMMENT
HIGHtests/v1/attention/test_mla_backends.py262 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/attention/test_attention_backends.py163 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/core/test_scheduler.py3025 num_blocks=5, # Can hold 64 tokens (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py3819 num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py4060 num_blocks=11, # Can hold 160 tokens (first block is null)CODE
HIGHtests/v1/cudagraph/test_cudagraph_mode.py67 # when above code raises, `llm` may be undefined, so we need to catch thatCOMMENT
HIGHtests/v1/cudagraph/test_cudagraph_mode.py123 # when above code raises, `llm` may be undefined, so we need to catch thatCOMMENT
HIGH…_connector/unit/offloading_connector/test_scheduler.py2609 # 4 GPU blocks: block 0 is null, blocks 1-3 are usable.COMMENT
HIGHtests/tool_parsers/test_granite_tool_parser.py44 "null_field": null,CODE
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py36 "null_field": null,CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py34 "role=null, "CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py43 '"role": null, 'CODE
HIGHtests/tool_parsers/test_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_deepseekv3_tool_parser.py43 """"bool_field": true, "null_field": null, """STRING
HIGHtests/tool_parsers/test_internlm2_tool_parser.py54 "null_field": null,CODE
HIGHtests/tool_parsers/test_llama4_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py51 "null_field": null,CODE
HIGHtests/tool_parsers/test_lfm2_tool_parser.py38 '"role": null, 'CODE
HIGHtests/tool_parsers/test_longcat_tool_parser.py54 "null_field": null,CODE
HIGHtests/tool_parsers/test_hunyuan_a13b_tool_parser.py45 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
HIGHtests/tool_parsers/test_qwen3coder_tool_parser.py594 # Multi non-null: anyOf[string, integer, null] → first non-null is stringCOMMENT
HIGHtests/parser/engine/test_qwen3.py263 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py274 ' "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_qwen3.py1143 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py1164 ' "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_parser_engine.py604 result = engine._fix_arg_types('{"val": null}', "f")CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1202 text = "<|tool_call>call:configure{value:null}<tool_call|>"CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1210 text = "<|tool_call>call:configure{label:null}<tool_call|>"CODE
HIGH…e_out/token_in_token_out/test_return_routed_experts.py36 '{"sliding_window": null}',CODE
HIGHtests/entrypoints/openai/test_return_routed_experts.py33 '{"sliding_window": null}',CODE
HIGHvllm/_custom_ops.py1690 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHvllm/_custom_ops.py1799 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHvllm/_custom_ops.py1670 input_tensor: The input tensor with gate || up layout [m_topk, k*2]STRING
HIGHvllm/v1/core/single_type_kv_cache_manager.py1148 # result [null] [null] ... [null] [hit block 1 (1st block containCOMMENT
HIGHvllm/v1/core/single_type_kv_cache_manager.py462 every (non-null) block — the default for full attention.STRING
HIGHvllm/v1/core/single_type_kv_cache_manager.py1095 [null, null, block 3], otherwise, we return [null, null]STRING
HIGHvllm/v1/core/single_type_kv_cache_manager.py1100 we return 4 blocks[null, null, null, null]STRING
HIGHvllm/tool_parsers/utils.py447 (null, true, false) that some models produce instead of PythonSTRING
HIGH…ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py47 cd FlexKV && bash build.shSTRING
HIGHvllm/benchmarks/datasets/datasets.py4171 # undefined), language (en), transcription directive (en), punctuationSTRING
HIGH…isaggregated/flexkv_connector/prefix_caching_flexkv.py12 2. cd FlexKV && bash build.shSTRING
HIGH.buildkite/scripts/generate-nightly-index.py209 "build_tag": null,CODE
AI Slop Vocabulary113 hits · 277 pts
SeverityFileLineSnippetContext
LOWcsrc/libtorch_stable/quantization/machete/generate.py435 # For now, we can just use the first accumulator type seen sinceSTRING
MEDIUMdocker/entrypoints/test_vllm_nonroot_entrypoint.sh145# More robust: count lines matching our UID.COMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
LOWtests/v1/cudagraph/test_breakable_cudagraph.py235 # Outside capture: decorator should just call through.COMMENT
LOWtests/tool_parsers/test_mistral_tool_parser.py135 # Otherwise, just add the current token and move to the next oneCOMMENT
MEDIUMtests/renderers/test_sparse_tensor_validation.py58 # explicitly so this fixture is robust to process-wide invariant-check stateCOMMENT
MEDIUMtests/kernels/mamba/test_mamba_mixer2.py106 # - utilize mock patching to disable TP whenCOMMENT
MEDIUMtests/distributed/test_pynccl.py442 # Essentially this is an all-gather operation.COMMENT
MEDIUMtests/distributed/test_context_parallel.py46 # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yamlCOMMENT
MEDIUMtests/distributed/test_context_parallel.py48 # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yamlCOMMENT
LOWtests/model_executor/test_qwen3_omni.py41 # Regular token, just add itCOMMENT
MEDIUMtests/models/registry.py1056 # Keep the init/schema harness eager (these tests never run forward).COMMENT
MEDIUM…s/compile/passes/distributed/test_fusion_all_reduce.py754 # the call site). The patterns in this PR are robust to both Triton andCOMMENT
LOWtests/lora/test_gptoss_tp.py95# For now just use TRITON_UNFUSED kernelCOMMENT
LOWvllm/env_override.py356# functions just return True.COMMENT
LOWvllm/v1/attention/backends/flash_attn.py337 # but for now just set it to `UNIFORM_BATCH` to get use to drop downCOMMENT
LOWvllm/v1/attention/backends/utils.py293 # then we can simply use a cdiv for the rest.COMMENT
MEDIUMvllm/v1/attention/ops/triton_decode_attention.py383 # explicitly facilitate overlapping load/computeCOMMENT
LOWvllm/v1/core/kv_cache_coordinator.py485 # Single group; useless but just set ``use_eagle`` for consistency regardless.COMMENT
MEDIUMvllm/v1/core/encoder_cache_manager.py321# utilize the cache and this class will fold into EncoderCacheManager, asCOMMENT
LOWvllm/v1/spec_decode/llm_base_proposer.py609 # KV cache in sync, so just return an empty tensor.COMMENT
LOWvllm/v1/spec_decode/llm_base_proposer.py1825 # Therefore, we can just return the logits.COMMENT
MEDIUMvllm/v1/worker/gpu_worker.py807 # CUDAGraph memory size and may not utilize all gpu memory.COMMENT
MEDIUMvllm/v1/worker/gpu_worker.py1104 # Generate the trace name by combining prefix with comprehensive rank suffixCOMMENT
LOWvllm/v1/worker/gpu/model_runner.py1314 # For piecewise and eager mode, just call model().COMMENT
LOWvllm/v1/engine/parallel_sampling.py116 # If streaming, just return the current outputCOMMENT
MEDIUMvllm/tool_parsers/llama_tool_parser.py263 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMvllm/tool_parsers/jamba_tool_parser.py218 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMvllm/tool_parsers/granite_tool_parser.py188 # re-set stuff pertaining to progress in the current toolCOMMENT
LOWvllm/tool_parsers/xlam_tool_parser.py560 # If we encounter an error, just return the delta text as regular contentCOMMENT
MEDIUMvllm/tool_parsers/granite_20b_fc_tool_parser.py203 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMvllm/tool_parsers/step3_tool_parser.py51 # Explicit state flags for robust streamingCOMMENT
LOWvllm/tokenizers/mistral.py554 # if underlying tokenizer is sentencepiece, we just add "�".COMMENT
LOWvllm/platforms/cuda.py692 # users can just use IR op priority directlyCOMMENT
MEDIUMvllm/distributed/utils.py334 """A robust barrier to synchronize all ranks.STRING
MEDIUM…ibuted/kv_transfer/kv_connector/v1/nixl/base_worker.py730 # we can leverage host_buffer for permute.COMMENT
MEDIUM…ransfer/kv_connector/v1/mooncake/mooncake_connector.py925 # Tasks can await async events, so a surplus (2x is a robust heuristic)COMMENT
MEDIUMvllm/config/model.py311 """Enable the custom cumem allocator to leverage advanced GPU memorySTRING
MEDIUMvllm/config/parallel.py598 # To make the initialization more robust we retry a few timesCOMMENT
LOWvllm/model_executor/layers/mamba/ops/causal_conv1d.py185 # first chunk and does not have prior-token, so just set to 0COMMENT
MEDIUMvllm/model_executor/layers/fused_moe/modular_kernel.py48# The goal is to be able to utilize different communication mechanisms withCOMMENT
MEDIUM…xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py40 # TODO (varun) : Optimize leverage num_tokens_per_expert countsCOMMENT
MEDIUM…executor/layers/fused_moe/experts/fused_humming_moe.py312 # Neighboring nodes are required to utilize distinct workspaces.COMMENT
MEDIUMvllm/model_executor/layers/quantization/fp8.py287 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUMvllm/model_executor/layers/quantization/modelopt.py323 # Normalize quant_algo for robust matching (ModelOpt may emit lowercase).COMMENT
MEDIUMvllm/model_executor/layers/quantization/fbgemm_fp8.py53 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py109 # to fully utilize the E4M3 dynamic range (e.g., global_scale=1).COMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py169 # For GPUs that lack FP4 hardware support, we can leverage theCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp8.py60 # For GPUs that lack FP8 hardware support, we can leverage theCOMMENT
LOW…odel_executor/layers/quantization/utils/quant_utils.py422 # Unquantized layer: just return base weightsCOMMENT
MEDIUM…rs/quantization/compressed_tensors/transform/module.py85 # do not fold into weight in order to utilize FWHTCOMMENT
MEDIUMvllm/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
MEDIUMvllm/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
LOWvllm/model_executor/models/qwen3_asr.py538 # No audio features, just return linear positionsCOMMENT
LOWvllm/model_executor/models/transformers/multimodal.py199 # NOTE: we can't just set caching=False because base class methodCOMMENT
LOWvllm/models/deepseek_v4/xpu/xpu_sparse.py62 # Profile run: no-op, just return q (no padding needed on XPU).COMMENT
MEDIUM…dels/deepseek_v4/nvidia/ops/fused_indexer_q_cutedsl.py167 # all threads in a warp to be active since we utilize warp shuffle later.COMMENT
LOWvllm/reasoning/granite_reasoning_parser.py195 # corrected; just return the delta text as normal content.COMMENT
LOWvllm/reasoning/hunyuan_a13b_reasoning_parser.py88 # this id is not part of content, so just return [] here.COMMENT
LOWvllm/reasoning/olmo3_reasoning_parser.py268 # this id is not part of content, so just return [] here.COMMENT
53 more matches not shown…
Verbosity Indicators149 hits · 277 pts
SeverityFileLineSnippetContext
LOWtests/v1/kv_offload/tiering/test_async_lookup.py136 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py142 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1180 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5221 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5231 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5240 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py567 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py576 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py582 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py433 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py450 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py460 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py468 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py477 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py551 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py560 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py568 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py577 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py584 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py493 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py701 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py720 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py373 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py447 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py514 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py388 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py421 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py459 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py495 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py526 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py544 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py557 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py84 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py100 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py116 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py155 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py175 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py192 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py59 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py77 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py96 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py181 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py15 # Step 1: entry was added, committed to slot. Deque fills to maxlen=1,COMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py20 # Step 2: deque is full, oldest slot (containing h1) expires.COMMENT
LOW…s/v1/ec_connector/unit/cpu/scheduler/test_scheduler.py276 # Step 3: unpin fires, now eviction works.COMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh459# Step 1: Run baselineCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh462# Step 2: Test 1E + 1PDCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh465# Step 3: Test baseline 1P + 1DCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh468# Step 4: Test 1E + 1P + 1DCOMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py683 # Step 1: In-place CUDA RoPE (same as production)COMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py695 # Step 2: Reshape + quant + reshape (same as production)COMMENT
LOW…nts/multimodal/llm/test_mm_cache_external_injection.py92 # Step 1: Normal requests to populate the cacheCOMMENT
LOW…nts/multimodal/llm/test_mm_cache_external_injection.py100 # Step 2: Use a second image to get valid expanded tokens andCOMMENT
LOW…ntrypoints/weight_transfer/test_weight_transfer_llm.py262 # Step 1: Initialize weight transfer engineCOMMENT
89 more matches not shown…
Docstring Block Structure35 hits · 175 pts
SeverityFileLineSnippetContext
HIGHvllm/v1/attention/backends/registry.py238Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register STRING
HIGHvllm/v1/attention/backends/mla/prefill/registry.py106Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum memberSTRING
HIGHvllm/v1/core/single_type_kv_cache_manager.py1082 For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lonSTRING
HIGHvllm/v1/structured_output/utils.py329 Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: STRING
HIGHvllm/v1/structured_output/utils.py361 Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/STRING
HIGHvllm/v1/worker/utils.py286 Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_manaSTRING
HIGHvllm/tool_parsers/apertus_tool_parser.py137 Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunkSTRING
HIGHvllm/tool_parsers/apertus_tool_parser.py181 Extracts tool calls from a completely generated model response (Non-Streaming). Args: modeSTRING
HIGHvllm/tool_parsers/apertus_tool_parser.py283 Handles streaming chunks Args: previous_text: The complete model text generated prior to tSTRING
HIGHvllm/tool_parsers/apertus_tool_parser.py494 Calculates the exact string difference to safely append new tool parameters. This ensures characters lSTRING
HIGH…ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py738 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGHvllm/distributed/kv_transfer/kv_connector/v1/base.py459 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py284Get remote allocation info for a request. Args: transfer_id:TransferId The request ID RetuSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py198 Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and hSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py601 Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engineSTRING
HIGHvllm/distributed/weight_transfer/factory.py83Create a weight transfer engine instance. Args: config: Weight transfer configuration containing thSTRING
HIGHvllm/distributed/weight_transfer/base.py118 Construct typed init info from dict with validation. Args: init_dict: Dictionary containinSTRING
HIGHvllm/distributed/weight_transfer/base.py138 Construct typed update info from dict with validation. Args: update_dict: Dictionary contaSTRING
HIGHvllm/logging_utils/formatter.py22 Shortens a file path for logging display: - Removes leading 'vllm' folder if present. STRING
HIGHvllm/model_executor/kernels/linear/__init__.py514 Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the STRING
HIGHvllm/model_executor/kernels/linear/__init__.py692 Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to choSTRING
HIGH…/model_executor/layers/fused_moe/expert_map_manager.py337 Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nuSTRING
HIGHvllm/model_executor/layers/fla/ops/chunk.py153 Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHvllm/model_executor/layers/fla/ops/fused_recurrent.py530 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHvllm/model_executor/models/keye_vl1_5.py79 Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wiSTRING
HIGHvllm/model_executor/models/isaac.py243Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): STRING
HIGHvllm/multimodal/audio.py95Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppoSTRING
HIGHvllm/benchmarks/lib/ready_checker.py25 Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async reqSTRING
HIGHvllm/entrypoints/chat_utils.py1466 Parses a given multi-modal content part based on its type. Args: part: A dict containing the content pSTRING
HIGHvllm/entrypoints/speech_to_text/base/utils.py18Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the ConteSTRING
HIGHvllm/transformers_utils/processors/isaac.py197Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): TensoSTRING
HIGHvllm/lora/resolver.py72Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. STRING
HIGH…ications/chatbot/streamlit_openai_chatbot_webserver.py111Generate and stream LLM response with optional reasoning process. Args: messages (list): List of conversatiSTRING
HIGHbenchmarks/benchmark_long_document_qa_throughput.py68 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGHbenchmarks/attention_benchmarks/batch_spec.py74 Parse batch specification string into list of BatchRequest objects. Grammar: (<count>?) q<q_len>(k?) (s<seq_leSTRING
Hallucination Indicators11 hits · 115 pts
SeverityFileLineSnippetContext
CRITICALrust/src/cmd/src/cli/unsupported.rs141/// - `vllm.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)`COMMENT
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py886 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py1138 engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py1163 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/distributed/test_torchrun_example_moe.py81 llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters()CODE
CRITICALtests/distributed/test_torchrun_example.py72 llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters()CODE
CRITICALtests/models/language/generation/test_gemma.py19 lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501CODE
CRITICALtests/models/language/generation/test_gemma.py24 lambda self: self.model_runner.model.model.normalizer.cpu().item()CODE
CRITICALvllm/v1/spec_decode/llm_base_proposer.py1449 self.model.model.embed_tokens.weight.cpu(),CODE
CRITICALvllm/model_executor/layers/fla/ops/utils.py170 triton.runtime.driver.active.utils.get_device_properties(i)[CODE
CRITICALdocs/training/layerwise.md124model = llm.llm_engine.engine_core.engine_core.model_executor.driver_worker.worker.get_model()CODE
Fake / Example Data71 hits · 80 pts
SeverityFileLineSnippetContext
LOWtests/v1/attention/test_mla_backends.py1466 ["placeholder"],CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py320 vllm_config.compilation_config.static_forward_context["placeholder"] = (CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py325 kv_cache_spec, ["placeholder"], vllm_config, deviceCODE
LOWtests/v1/attention/test_sparse_mla_backends.py458 vllm_config.compilation_config.static_forward_context["placeholder"] = (CODE
LOWtests/v1/attention/test_sparse_mla_backends.py463 builder = builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py924 vllm_config.compilation_config.static_forward_context["placeholder"] = (CODE
LOWtests/v1/attention/test_sparse_mla_backends.py929 builder = builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device)CODE
LOWtests/v1/attention/test_attention_backends.py514 ["placeholder"],CODE
LOWtests/v1/attention/test_attention_backends.py666 "placeholder": PerLayerParameters(CODE
LOWtests/v1/attention/test_attention_backends.py714 kv_cache_spec, ["placeholder"], vllm_config, deviceCODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py698 payload = _registration_data("placeholder")CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py85 '{"to": "user@example.com", "subject": "Daily Update"}',CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py92 {"to": "user@example.com", "subject": "Daily Update"},CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py308 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py698 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py1061 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py301 """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_mistral_tool_parser.py691 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_mistral_tool_parser.py1054 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_olmo3_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py31 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py40 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py32 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py26 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py35 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py339 "deliveryAddress='123 Main St')]"CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py45 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py53 "name": "John Doe",CODE
LOWtests/kernels/helion/test_pattern_matching.py125 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOWtests/kernels/helion/test_pattern_matching.py200 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOW…rnels/attention/test_rocm_aiter_mla_decode_metadata.py114 layer_name = "placeholder"CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py130 dummy_data = builder.get_dummy_mm_data(100, mm_counts, {})CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py132 assert "audio" in dummy_dataCODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py133 assert len(dummy_data["audio"]) == 2CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py136 assert len(dummy_data["audio"][0]) == expected_lenCODE
LOWtests/compile/test_graph_partition.py64 and node.args[0].op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py125 and node.args[0].op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py193 assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * [CODE
LOWtests/compile/test_graph_partition.py440 if node.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py506 if n.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py512 if n.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py621 if n.op != "placeholder":CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py225 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py237 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py255 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py274 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py292 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py311 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOWtests/entrypoints/openai/test_run_batch.py761def _make_aiohttp_mocks(response_data: bytes = b"fake-data", status: int = 200):CODE
LOWvllm/model_executor/models/transformers/fx_utils.py52 if node.op == "placeholder" and node.target == "hidden_states":CODE
LOWvllm/model_executor/models/transformers/fusers/qkv.py62 and node.args[0].op == "placeholder"CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py134 x = find_node(graph, lambda n: n.op == "placeholder")CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py176 if (x := find_node(graph, lambda n: n.op == "placeholder")) is None:CODE
LOWvllm/compilation/piecewise_backend.py30 if node.op == "placeholder":CODE
LOWvllm/compilation/piecewise_backend.py59 if node.op != "placeholder":CODE
LOWvllm/compilation/backends.py468 input_node.op == "placeholder"CODE
LOWvllm/compilation/backends.py558 if node.op in ("output", "placeholder"):CODE
11 more matches not shown…
Modern AI Meta-Vocabulary26 hits · 72 pts
SeverityFileLineSnippetContext
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1748# Top-level orchestrationCOMMENT
MEDIUMtests/v1/kv_offload/tiering/p2p/test_manager.py1038# _poll_once orchestrationCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_offloading_connector.py153 # Use a long prompt that fits within the model's context window.COMMENT
MEDIUMtests/v1/engine/test_async_llm.py893 # Wait for generation to start (event-driven)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py935 # Wait for some tokens (event-driven, handles slow token generation)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py999 # Wait for at least one token across any request (event-driven)COMMENT
MEDIUMtests/evals/mrcr/mrcr_eval.py32# Skip chain-of-thought on reasoning models; ignored by non-reasoning templates.COMMENT
MEDIUMtests/compile/fullgraph/test_basic_correctness.py57 # embedding modelCOMMENT
MEDIUMtests/entrypoints/openai/responses/test_harmony.py599 # NOTE: chain-of-thought should be removed.COMMENT
MEDIUM…ntrypoints/openai/chat_completion/test_serving_chat.py1141 # adding max_tokens should exceed the model context window.COMMENT
MEDIUMvllm/_xpu_ops.py853 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMvllm/v1/attention/ops/vit_attn_wrappers.py224 # Without it, hallucinations occur with the backendCOMMENT
MEDIUMvllm/v1/executor/abstract.py44 uses_ray: bool = False # whether the executor uses Ray for orchestration.CODE
MEDIUM…ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py245 # progress is event-driven (see module docstring).COMMENT
MEDIUM…d/kv_transfer/kv_connector/v1/mooncake/store/worker.py4# The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread,COMMENT
MEDIUMvllm/model_executor/models/granite_speech.py79# work pretty well with zero shot.COMMENT
MEDIUMvllm/model_executor/models/phi3v.py603 # initialized as an embedding modelCOMMENT
MEDIUMvllm/models/minimax_m3/amd/model.py1336# NVIDIA copy — it only orchestrates the shared vision tower + the per-platformCOMMENT
MEDIUMvllm/reasoning/gemma4_utils.py27 print(result["thinking"]) # chain-of-thought or NoneSTRING
MEDIUMvllm/reasoning/gemma4_utils.py76 >>> print(result["thinking"]) # chain-of-thought reasoning or NoneSTRING
MEDIUMvllm/entrypoints/speech_to_text/base/serving.py402 # which is a strong sign of hallucination in outputs.COMMENT
MEDIUMvllm/vllm_flash_attn/flash_attn_interface.py138 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMdocs/serving/integrations/claude_code.md3[Claude Code](https://code.claude.com/docs/en/quickstart) is Anthropic's official agentic coding tool that lives in yourCODE
MEDIUMdocs/serving/integrations/codex.md3[Codex](https://github.com/openai/codex) is OpenAI's official agentic coding tool that lives in your terminal. It can unCODE
MEDIUMdocs/features/tool_calling.md221The tool calling that is supported is the [JSON-based tool calling](https://llama.meta.com/docs/model-cards-and-prompt-fCODE
MEDIUMdocs/deployment/frameworks/dify.md3[Dify](https://github.com/langgenius/dify) is an open-source LLM app development platform. Its intuitive interface combiCODE
Example Usage Blocks21 hits · 31 pts
SeverityFileLineSnippetContext
LOWtools/setup_deepgemm_pythons.sh6# Usage:COMMENT
LOWtools/vllm-rocm/generate-rocm-wheels-root-index.sh11# Usage:COMMENT
LOWdocker/docker-bake.hcl5# Usage:COMMENT
LOWdocker/docker-bake-rocm.hcl6# Usage:COMMENT
LOWdocker/docker-bake-rocm.hcl127# Usage:COMMENT
LOWdocker/entrypoints/test_vllm_nonroot_entrypoint.sh9# Usage:COMMENT
LOW…/nixl_integration/run_multi_connector_accuracy_test.sh15# Usage:COMMENT
LOW…nector/nixl_integration/spec_decode_acceptance_test.sh13# Usage:COMMENT
LOW…nixl_integration/run_multi_connector_edge_case_test.sh15# Usage:COMMENT
LOWexamples/tool_calling/chat_with_tools_offline.py44# Usage:COMMENT
LOWexamples/ray_serving/run_cluster.sh8# Usage:COMMENT
LOWexamples/ray_serving/multi-node-serving.sh11# Example usage:COMMENT
LOWexamples/generate/multimodal/mistral-small_offline.py51# Usage:COMMENT
LOWbenchmarks/kv_cache_watermark.sh29# Usage:COMMENT
LOW…ttention_benchmarks/configs/mla_sparse_mha_vs_mqa.yaml3# Usage:COMMENT
LOW…s/attention_benchmarks/configs/mla_fa4_fp8_output.yaml6# Usage:COMMENT
LOW…nchmarks/attention_benchmarks/configs/mla_prefill.yaml14# Usage:COMMENT
LOW.buildkite/scripts/cache-rocm-base-wheels.sh10# Usage:COMMENT
LOW.buildkite/scripts/ci-bake-rocm.sh9# Usage:COMMENT
LOW.buildkite/scripts/ci-fetch-log.sh4# Usage:COMMENT
LOW.buildkite/scripts/tool_call/run-bfcl-eval.sh5# Usage:COMMENT
Magic Placeholder Names5 hits · 20 pts
SeverityFileLineSnippetContext
HIGH…les/pooling/embed/openai_embedding_long_text/client.py22 --api-key your-api-keySTRING
HIGH…les/pooling/embed/openai_embedding_long_text/client.py32 --api-key your-api-keySTRING
HIGH…les/pooling/embed/openai_embedding_long_text/client.py44API_KEY = "your-api-key" # Replace with your actual API keyCODE
HIGH…es/pooling/embed/openai_embedding_long_text/service.sh19API_KEY=${API_KEY:-"your-api-key"}CODE
HIGH.github/ISSUE_TEMPLATE/400-bug-report.yml20 Consider redacting or replacing sensitive values with placeholders like `<YOUR_TOKEN_HERE>` when sharing configuraCODE
TODO Padding11 hits · 16 pts
SeverityFileLineSnippetContext
LOWcsrc/cpu/sgl-kernels/common.h365 // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb]COMMENT
LOW…nector/v1/lmcache_integration/multi_process_adapter.py632 # TODO: add error handling hereCOMMENT
LOW…m/model_executor/kernels/linear/mixed_precision/xpu.py191 # TODO: implement asym caseCOMMENT
LOWvllm/entrypoints/openai/responses/protocol.py739 # TODO: implement the other reason for incomplete_details,COMMENT
LOWvllm/lora/punica_wrapper/punica_base.py324 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py357 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py381 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py418 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py448 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py467 # TODO: implement it based on torch opsCOMMENT
LOWvllm/lora/punica_wrapper/punica_base.py494 # TODO: implement it based on torch opsCOMMENT
Slop Phrases7 hits · 16 pts
SeverityFileLineSnippetContext
MEDIUMtests/models/multimodal/generation/test_common.py64# model arch happens to be a substring of another one, you can add aCOMMENT
MEDIUMtests/models/multimodal/generation/test_common.py85# NOTE you can add --collect-only to any of the above commands to seeCOMMENT
LOW…ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py81 # while processing the next batch, we make sure to only set anCOMMENT
MEDIUMvllm/model_executor/models/interfaces.py230 as a language model component.STRING
MEDIUM…ache/disagg_prefill_lmcache_v1/disagg_vllm_launcher.sh24# secure random value. This is set to a fixed value for demonstration purposes only.COMMENT
MEDIUMexamples/rl/rlhf_ipc.py17 for demonstration purposes we simply zero out the weights.STRING
MEDIUM.buildkite/test-amd.yaml1# In this file, you can add more tests to run either by adding a new step orCOMMENT
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHtests/v1/sample/test_logprobs.py914 # Based on user's example: "In this example,"COMMENT
Synthetic Comment Markers1 hit · 8 pts
SeverityFileLineSnippetContext
HIGH…tic_prefix_caching/automatic_prefix_caching_offline.py26# A prompt containing a large markdown table. The table is randomly generated by GPT-4.COMMENT
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/e2e/general/test_streaming_input.py502CODE
Overly Generic Function Names1 hit · 2 pts
SeverityFileLineSnippetContext
LOW…gated/disaggregated_serving/moriio_toy_proxy_server.py227async def handle_request(api: str, request: Request):CODE