A high-throughput and memory-efficient inference and serving engine for LLMs
This report presents the forensic synthetic code analysis of vllm-project/vllm, a Python project with 90,313 GitHub stars. SynthScan v2.0 examined 1,883,162 lines of code across 6237 source files, recording 23484 pattern matches distributed across 27 syntactic categories. The overall adjusted score of 16.6 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 23484 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | setup.py | 57 | def should_require_rust_frontend() -> bool: | CODE |
| LOW⚡ | setup.py | 62 | def get_precompiled_rust_extension_paths() -> list[Path]: | CODE |
| LOW⚡ | setup.py | 66 | def get_missing_precompiled_rust_extension_modules() -> list[str]: | CODE |
| LOW⚡ | setup.py | 640 | def detect_system_rocm_variant() -> str | None: | CODE |
| LOW⚡ | setup.py | 657 | def fetch_available_rocm_variants(commit: str) -> list[str]: | CODE |
| LOW⚡ | setup.py | 676 | def resolve_rocm_wheel_variant( | CODE |
| LOW | setup.py | 77 | def has_precompiled_rust_extensions() -> bool: | CODE |
| LOW | setup.py | 509 | def fetch_metadata_for_variant( | CODE |
| LOW | setup.py | 592 | def detect_system_cuda_variant() -> str: | CODE |
| LOW | setup.py | 725 | def warn_if_rocm_torch_version_mismatch( | CODE |
| LOW | setup.py | 781 | def fetch_wheel_from_pypi_index(index_url: str, package: str = "vllm") -> str: | CODE |
| LOW | setup.py | 978 | def extract_precompiled_and_patch_package( | CODE |
| LOW | setup.py | 1104 | def get_base_commit_in_main_branch() -> str: | CODE |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 92 | def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str: | CODE |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 334 | def generate_type_option_name(kernel_types: TypeConfig): | STRING |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 370 | def unsigned_type_with_bitwidth(num_bits): | STRING |
| LOW | tools/generate_versions_json.py | 86 | def generate_bake_native_json(args: dict[str, str]) -> dict: | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 65 | def install_system_dependencies(): | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 105 | def build_and_install_prerequisites(args): | CODE |
| LOW | tools/build_rust.py | 20 | def prepare_build_environment() -> str | None: | CODE |
| LOW | tools/build_rust.py | 54 | def rust_py_extension_module_names() -> list[str]: | CODE |
| LOW | …s/gumbel_precision/prove_exponential_race_precision.py | 31 | def measure_exponential_lower_tail( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 69 | def _get_active_sequence_count( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 88 | def _estimate_prefills_per_step( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 116 | def _resolve_tensor_parallel_size( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 138 | def _resolve_gpu_memory_utilization( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 196 | def _resolve_max_num_batched_tokens( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 248 | def _resolve_data_parallel_size( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 281 | def get_runtime_tuning_policies( | CODE |
| LOW | tools/recipes/sweep_generation.py | 24 | def _strict_lower_power_of_two(value: int) -> int: | CODE |
| LOW | tools/recipes/sweep_generation.py | 30 | def _strict_upper_power_of_two(value: int) -> int: | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 75 | def shorten_plot_legend_strings(legend, max_char_len: int): | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 94 | def attempt_to_make_names_unique(entries_and_traces): | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 144 | def group_trace_by_operations(trace_df: "pd.DataFrame") -> "pd.DataFrame": | CODE |
| LOW | tools/profiler/nsys_profile_tools/gputrc2graph.py | 45 | def gen_nonoverlapped_sum_from_gputrace(self, in_file, out_file): | CODE |
| LOW | tools/profiler/nsys_profile_tools/gputrc2graph.py | 66 | def sum_non_overlapping_intervals(self, df): | CODE |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 20 | def extract_version_from_wheel(wheel_name: str) -> str: | CODE |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 40 | def get_custom_wheel_versions(install_dir: str) -> dict[str, str]: | CODE |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 94 | def pin_dependencies_in_requirements(requirements_path: str, versions: dict[str, str]): | CODE |
| LOW | tests/test_sequence.py | 9 | def test_sequence_intermediate_tensors_equal(): | CODE |
| LOW | tests/test_request_input_bounds.py | 74 | def test_public_requests_accept_four_stop_strings( | CODE |
| LOW | tests/test_request_input_bounds.py | 85 | def test_public_requests_reject_more_than_four_stop_strings( | CODE |
| LOW | tests/test_request_input_bounds.py | 92 | def test_stop_string_limit_can_be_overridden(): | CODE |
| LOW | tests/test_request_input_bounds.py | 117 | def test_duplicate_stop_token_ids_are_deduplicated_in_order(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 138 | def test_duplicate_bad_words_are_deduplicated_in_order(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 144 | def test_bad_word_tokenization_stops_at_worker_limit(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 154 | def test_bad_word_tokenization_limit_can_be_overridden(monkeypatch): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 174 | def test_direct_beam_width_rejects_values_over_sequence_cap( | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 183 | def test_chat_beam_conversion_rejects_n_before_stream_state_allocation( | STRING |
| LOW | tests/test_request_input_bounds.py | 200 | def test_chat_beam_conversion_accepts_n_at_sequence_cap( | STRING |
| LOW | tests/test_request_input_bounds.py | 229 | def test_encode_messages_scans_last_user_once_per_conversation( | STRING |
| LOW | tests/test_request_input_bounds.py | 236 | def counted_find_last_user_index(messages): | STRING |
| LOW | tests/test_request_input_bounds.py | 260 | def test_encode_messages_preserves_small_chat_prompt(encoding_module): | STRING |
| LOW | tests/test_request_input_bounds.py | 281 | def test_encode_messages_unknown_role_raises_value_error(encoding_module): | STRING |
| LOW | tests/test_zen_cpu_platform_detection.py | 37 | def test_is_amd_zen_cpu_returns_false_when_cpuinfo_missing(): | CODE |
| LOW | tests/test_zen_cpu_platform_detection.py | 42 | def test_cpu_target_selects_cpu_platform_from_non_cpu_wheel( | CODE |
| LOW | tests/test_version.py | 36 | def test_prev_minor_version_was(version_tuple, version_str, expected): | CODE |
| LOW⚡ | tests/test_ray_env_utils.py | 36 | def test_arbitrary_var_propagated(self): | CODE |
| LOW⚡ | tests/test_ray_env_utils.py | 42 | def test_worker_specific_excluded(self): | CODE |
| LOW⚡ | tests/test_ray_env_utils.py | 50 | def test_non_carry_over_blacklist(self): | CODE |
| 13976 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 107 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 109 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 118 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 122 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 136 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 139 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 151 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 157 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 66 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 68 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 79 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 82 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 94 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 96 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 175 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 179 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 192 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 199 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 214 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 217 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 240 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 243 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 11 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 13 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 48 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 61 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 63 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 97 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 99 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 135 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 147 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 149 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 19 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 70 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 72 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 152 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 155 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 225 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 227 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 192 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 194 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 232 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 234 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 257 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 259 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 289 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 291 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 405 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 407 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 568 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 570 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 671 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 673 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 732 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 734 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 776 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 778 | # --------------------------------------------------------------------------- | COMMENT |
| 2051 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/attention/test_mla_prefill_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/kernels/attention/test_attention_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/kernels/attention/test_rocm_attention_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/v1/logits_processors/utils.py | 0 | fake logit processor to support unit testing and examples | STRING |
| HIGH | docs/features/custom_logitsprocs.md | 0 | fake logit processor to support unit testing and examples | STRING |
| HIGH | examples/features/logits_processor/custom.py | 0 | fake logit processor to support unit testing and examples | STRING |
| HIGH | tests/v1/logits_processors/utils.py | 0 | the request-level logits processor masks out all logits except the token id identified by `target_token` | STRING |
| HIGH | docs/features/custom_logitsprocs.md | 0 | the request-level logits processor masks out all logits except the token id identified by `target_token` | STRING |
| HIGH | examples/features/logits_processor/custom_req.py | 0 | the request-level logits processor masks out all logits except the token id identified by `target_token` | STRING |
| HIGH | examples/features/logits_processor/custom_req_init.py | 0 | the request-level logits processor masks out all logits except the token id identified by `target_token` | STRING |
| HIGH | tests/v1/logits_processors/utils.py | 0 | example of wrapping a fake request-level logit processor to create a batch-level logits processor | STRING |
| HIGH | docs/features/custom_logitsprocs.md | 0 | example of wrapping a fake request-level logit processor to create a batch-level logits processor | STRING |
| HIGH | examples/features/logits_processor/custom_req.py | 0 | example of wrapping a fake request-level logit processor to create a batch-level logits processor | STRING |
| HIGH | tests/v1/logits_processors/utils.py | 0 | this method returns a new request-level logits processor, customized to the `target_token` value associated with a parti | STRING |
| HIGH | docs/features/custom_logitsprocs.md | 0 | this method returns a new request-level logits processor, customized to the `target_token` value associated with a parti | STRING |
| HIGH | examples/features/logits_processor/custom_req.py | 0 | this method returns a new request-level logits processor, customized to the `target_token` value associated with a parti | STRING |
| HIGH | examples/features/logits_processor/custom_req_init.py | 0 | this method returns a new request-level logits processor, customized to the `target_token` value associated with a parti | STRING |
| HIGH | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 0 | lifespan context manager to handle startup and shutdown events. | STRING |
| HIGH | …cache/disagg_prefill_lmcache_v1/disagg_proxy_server.py | 0 | lifespan context manager to handle startup and shutdown events. | STRING |
| HIGH | …regated/mooncake_connector/mooncake_connector_proxy.py | 0 | lifespan context manager to handle startup and shutdown events. | STRING |
| HIGH | tests/tool_parsers/test_granite_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_granite_20b_fc_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_phi4mini_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_longcat_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/distributed/test_pipeline_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/distributed/test_context_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/compile/correctness_e2e/test_sequence_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/entrypoints/pooling/scoring/util.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/entrypoints/pooling/scoring/util.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3_5.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3_5.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/generation/test_phi4siglip.py | 0 | sanitize vllm output [phi3v] to be comparable with hf output. | STRING |
| HIGH | tests/models/multimodal/generation/test_phi4mm.py | 0 | sanitize vllm output [phi3v] to be comparable with hf output. | STRING |
| HIGH | …/models/multimodal/generation/vlm_utils/model_utils.py | 0 | sanitize vllm output [phi3v] to be comparable with hf output. | STRING |
| HIGH | …ts/models/multimodal/generation/test_granite_speech.py | 0 | sanitize vllm output [phi3v] to be comparable with hf output. | STRING |
| HIGH | tests/entrypoints/openai/completion/test_completion.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | …ypoints/openai/chat_completion/test_chat_completion.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | docs/features/structured_outputs.md | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | …atures/structured_outputs/structured_outputs_client.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | …tures/structured_outputs/structured_outputs_offline.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | benchmarks/benchmark_serving_structured_output.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | tests/lora/test_qwen3moe_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | tests/lora/test_llama_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | tests/lora/test_olmoe_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | vllm/sampling_params.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | …m/entrypoints/speech_to_text/transcription/protocol.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | vllm/entrypoints/speech_to_text/translation/protocol.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | vllm/v1/attention/backends/flash_attn.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | vllm/v1/attention/backends/flash_attn_diffkv.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | vllm/v1/attention/backends/rocm_aiter_fa.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | vllm/v1/attention/backends/flash_attn.py | 0 | forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] key | STRING |
| HIGH | vllm/v1/attention/backends/triton_attn.py | 0 | forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] key | STRING |
| 323 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …c/cutlass_extensions/vllm_cutlass_library_extension.py | 6 | CODE | |
| LOW | tools/build_rust.py | 6 | CODE | |
| LOW | …s/gumbel_precision/prove_exponential_race_precision.py | 18 | CODE | |
| LOW | tools/recipes/sweep_recommendation.py | 7 | CODE | |
| LOW | tools/recipes/hardware_detection.py | 10 | CODE | |
| LOW | tools/recipes/recipe_json_to_vllm_config.py | 43 | CODE | |
| LOW | tools/recipes/runtime_tuning.py | 14 | CODE | |
| LOW | tools/recipes/sweep_generation.py | 6 | CODE | |
| LOW | tests/conftest.py | 78 | CODE | |
| LOW | tests/conftest.py | 78 | CODE | |
| LOW | tests/conftest.py | 79 | CODE | |
| LOW | tests/utils.py | 63 | CODE | |
| LOW | tests/utils.py | 2206 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 13 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_zmq_transport.py | 5 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_data_transport.py | 5 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_manager.py | 9 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 278 | CODE | |
| LOW | tests/v1/attention/test_attention_backends.py | 66 | CODE | |
| LOW | tests/v1/logits_processors/utils.py | 13 | CODE | |
| LOW | tests/v1/cudagraph/test_cudagraph_mode.py | 38 | CODE | |
| LOW | tests/v1/cudagraph/test_breakable_cudagraph.py | 7 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_tp_mapping.py | 10 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 21 | CODE | |
| LOW | …/v1/kv_connector/unit/offloading_connector/conftest.py | 3 | CODE | |
| LOW | …onnector/mooncake_integration/test_mooncake_imports.py | 22 | CODE | |
| LOW | tests/v1/spec_decode/test_backup_token_async_spec.py | 9 | CODE | |
| LOW | tests/v1/sample/test_topk_topp_sampler.py | 33 | CODE | |
| LOW | tests/v1/engine/conftest.py | 20 | CODE | |
| LOW | tests/v1/engine/conftest.py | 20 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_scheduler.py | 5 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_worker.py | 10 | CODE | |
| LOW | tests/tool_use/test_gemma4_responses_adjust_request.py | 32 | CODE | |
| LOW | tests/tool_parsers/test_poolside_v1_tool_parser.py | 21 | CODE | |
| LOW | tests/tool_parsers/test_cohere_command_tool_parser.py | 4 | CODE | |
| LOW | tests/renderers/test_chat_utils_prompt_embeds.py | 6 | CODE | |
| LOW | …rnels/attention/test_rocm_aiter_mla_op_registration.py | 49 | CODE | |
| LOW | tests/kernels/core/test_vit_fp8_attn.py | 20 | CODE | |
| LOW | tests/kernels/core/test_fused_q_kv_rmsnorm.py | 11 | CODE | |
| LOW | tests/kernels/ir/test_ir_ops.py | 11 | CODE | |
| LOW | tests/kernels/ir/test_layernorm.py | 7 | CODE | |
| LOW | tests/kernels/mamba/test_memcpy_u64_tiled.py | 28 | CODE | |
| LOW | tests/kernels/mamba/test_precopy_mamba_align.py | 22 | CODE | |
| LOW | tests/kernels/mamba/test_gdn_forward_core_split.py | 30 | CODE | |
| LOW | tests/kernels/mamba/test_gdn_fused_mtp.py | 5 | CODE | |
| LOW | tests/kernels/scripts/check_no_tilelang_hijack.py | 15 | CODE | |
| LOW | tests/kernels/scripts/check_no_tilelang_hijack.py | 16 | CODE | |
| LOW | tests/kernels/moe/test_rocm_aiter_moe.py | 438 | CODE | |
| LOW | tests/kernels/moe/test_rocm_aiter_moe.py | 448 | CODE | |
| LOW | …/kernels/moe/test_routed_experts_capture_monolithic.py | 16 | CODE | |
| LOW | tests/kernels/moe/test_moe.py | 18 | CODE | |
| LOW | tests/kernels/moe/test_modular_oai_triton_moe.py | 7 | CODE | |
| LOW | tests/distributed/test_eplb_spec_decode.py | 3 | CODE | |
| LOW | …mmy_platform/vllm_add_dummy_platform/dummy_platform.py | 9 | CODE | |
| LOW | …mmy_platform/vllm_add_dummy_platform/dummy_platform.py | 10 | CODE | |
| 1603 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | use_existing_torch.py | 21 | CODE | |
| LOW | setup.py | 1248 | CODE | |
| LOW | setup.py | 1292 | CODE | |
| LOW | setup.py | 201 | CODE | |
| LOW | setup.py | 818 | CODE | |
| LOW | setup.py | 888 | CODE | |
| LOW | setup.py | 978 | CODE | |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 92 | CODE | |
| LOW | …ibtorch_stable/quantization/marlin/generate_kernels.py | 173 | CODE | |
| LOW | …btorch_stable/moe/marlin_moe_wna16/generate_kernels.py | 173 | CODE | |
| LOW | tools/report_build_time_ninja.py | 151 | CODE | |
| LOW | tools/pre_commit/check_label_rules.py | 43 | CODE | |
| LOW | tools/pre_commit/validate_config.py | 73 | CODE | |
| LOW | tools/pre_commit/check_boolean_context_manager.py | 21 | CODE | |
| LOW | tools/pre_commit/check_spdx_header.py | 60 | CODE | |
| LOW | tools/pre_commit/check_spdx_header.py | 94 | CODE | |
| LOW | tools/pre_commit/check_spdx_header.py | 139 | CODE | |
| LOW | tools/recipes/recipe_json_to_vllm_config.py | 251 | CODE | |
| LOW | tools/recipes/recipe_json_to_vllm_config.py | 565 | CODE | |
| LOW | tools/recipes/recipe_json_to_vllm_config.py | 793 | CODE | |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 40 | CODE | |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 94 | CODE | |
| LOW | tests/conftest.py | 425 | CODE | |
| LOW | tests/conftest.py | 560 | CODE | |
| LOW | tests/conftest.py | 1041 | CODE | |
| LOW | tests/utils.py | 1220 | CODE | |
| LOW | tests/utils.py | 1572 | CODE | |
| LOW | tests/utils.py | 1736 | CODE | |
| LOW | tests/utils.py | 1862 | CODE | |
| LOW | tests/utils.py | 576 | CODE | |
| LOW | tests/utils.py | 1742 | CODE | |
| LOW | tests/utils.py | 1885 | CODE | |
| LOW | tests/v1/utils.py | 12 | CODE | |
| LOW | tests/v1/kv_offload/cpu/test_gpu_worker.py | 417 | CODE | |
| LOW | tests/v1/kv_offload/cpu/test_gpu_worker.py | 623 | CODE | |
| LOW | tests/v1/tracing/test_tracing.py | 22 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 345 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 1390 | CODE | |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 563 | CODE | |
| LOW | tests/v1/logits_processors/test_correctness.py | 304 | CODE | |
| LOW | tests/v1/logits_processors/test_correctness.py | 456 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2683 | CODE | |
| LOW | tests/v1/core/utils.py | 221 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_connector.py | 1875 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_connector.py | 3188 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_offloading_connector.py | 301 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_offloading_connector.py | 353 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_offloading_connector.py | 369 | CODE | |
| LOW | tests/v1/kv_connector/unit/utils.py | 320 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_mooncake_connector.py | 1109 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_mooncake_connector.py | 1254 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_desc_geometry.py | 372 | CODE | |
| LOW | …kv_connector/unit/offloading_connector/test_metrics.py | 225 | CODE | |
| LOW | tests/v1/determinism/test_batch_invariance.py | 31 | CODE | |
| LOW | tests/v1/determinism/test_batch_invariance.py | 175 | CODE | |
| LOW | tests/v1/determinism/test_batch_invariance.py | 671 | CODE | |
| LOW | tests/v1/determinism/test_nvfp4_batch_invariant.py | 45 | CODE | |
| LOW | tests/v1/spec_decode/test_eagle.py | 48 | CODE | |
| LOW | tests/v1/spec_decode/test_acceptance_length.py | 181 | CODE | |
| LOW | tests/v1/spec_decode/test_acceptance_length.py | 231 | CODE | |
| 1176 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tools/install_deepgemm.sh | 84 | # Create a temporary directory for the build | COMMENT |
| MEDIUM | tools/report_build_time_ninja.py | 201 | # Create a list that is in order by time stamp and has entries for the | COMMENT |
| MEDIUM | tools/pre_commit/update-dockerfile-graph.sh | 26 | # Define the target file path | COMMENT |
| MEDIUM | tests/conftest.py | 586 | # Create a copy to avoid modifying the original dict | COMMENT |
| MEDIUM | tests/utils.py | 795 | # Create a dedicated process group so we can kill | COMMENT |
| MEDIUM | tests/utils.py | 1745 | # Create a unique temporary file to store exception info from child | COMMENT |
| MEDIUM⚡ | tests/test_access_log_filter.py | 259 | # Create a logger with our filter (simulating uvicorn.access) | COMMENT |
| MEDIUM⚡ | tests/test_access_log_filter.py | 266 | # Create a custom handler that tracks messages | COMMENT |
| MEDIUM | tests/test_config.py | 1356 | # Create a new mock and run the method with the same S3 URL | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 262 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 589 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 738 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 1000 | # Create a tensor queue | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 189 | # Create a sample Python object | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 207 | # Create a sample tensor | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 227 | # Create a sample numpy array | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 313 | # Create a request with a non-multimodal tensor | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 354 | # Create a request with None for the tensor field | COMMENT |
| MEDIUM | tests/v1/metrics/test_ray_metrics.py | 71 | # Create the actor and call the async method | COMMENT |
| MEDIUM | tests/v1/attention/test_mla_backends.py | 592 | # Create a realistic slot mapping that corresponds to the block table | COMMENT |
| MEDIUM | tests/v1/attention/test_mla_backends.py | 1846 | # Create a summary for the single-line failure message | COMMENT |
| MEDIUM | tests/v1/attention/test_attention_backends.py | 224 | # Create a realistic slot mapping that corresponds to the block table | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_correctness.py | 807 | # Define a shuffled batch of requests which individually use a different | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 30 | # Create a mixture of requests which do and don't utilize the dummy logitproc | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 91 | # Create a vLLM instance and load custom logitproc | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 98 | # Create a reference vLLM instance without custom logitproc | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 346 | # Create a list of KVCacheBlock objects | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 349 | # Create a FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 551 | # Create a list of KVCacheBlock objects | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 554 | # Create a FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 392 | # Create an empty FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 440 | # Create an empty FreeKVCacheBlockQueue | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 494 | # Create an empty FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 1453 | # Create a VllmConfig | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 1489 | # Create a VllmConfig | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_scheduler.py | 3460 | # Create a request and schedule it | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 3487 | # Create a high priority request and schedule it | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 4341 | # Create a request and schedule it (and to be preempted) | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 4391 | # Create a high priority request and schedule it | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 5296 | # Create a text-only request (no mm_features). | COMMENT |
| MEDIUM | tests/v1/cudagraph/test_cudagraph_dispatch.py | 56 | # Create a real LoRAConfig with specialize_active_lora enabled | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_nixl_connector.py | 2390 | # Create a request that triggers do_remote_decode so that | COMMENT |
| MEDIUM⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 216 | # Create a mock object that is not LMCacheKVEvents | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_moriio_connector.py | 225 | # Define a fake remote engine id for testing | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 145 | # Create a request with multiple blocks worth of tokens | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 189 | # Create a request | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 211 | # Create a request with just 1 token | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 229 | # Create a request with 2 tokens | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 255 | # Create a request with many blocks | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 338 | # Create a request that doesn't align to block boundaries | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_nixl_connector_hma.py | 77 | # Create a mock worker with just the required attributes | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_example_connector.py | 146 | # Create the LLM instance | COMMENT |
| MEDIUM | …r/extract_hidden_states_integration/test_extraction.py | 45 | # Create a minimal Llama config with small dimensions | COMMENT |
| MEDIUM | …r/extract_hidden_states_integration/test_extraction.py | 60 | # Create a simple tokenizer | COMMENT |
| MEDIUM | tests/v1/determinism/test_batch_invariance.py | 123 | # Create a batch of size `max_batch_size` and insert the needle at | COMMENT |
| MEDIUM | tests/v1/distributed/test_external_lb_dp.py | 154 | # Create a client for each server | COMMENT |
| MEDIUM | tests/v1/distributed/test_hybrid_lb_dp.py | 182 | # Create a client for each node (each node has its own API endpoint) | COMMENT |
| MEDIUM | tests/v1/streaming_input/test_async_llm_streaming.py | 20 | # Create a minimal mock without initializing the full engine | COMMENT |
| MEDIUM | tests/v1/streaming_input/test_async_llm_streaming.py | 50 | # Create a mock queue with outputs | COMMENT |
| MEDIUM | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 34 | # Create a real InputBatch for e2e testing | COMMENT |
| 262 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | CMakeLists.txt | 1 | cmake_minimum_required(VERSION 3.26) | COMMENT |
| LOW | CMakeLists.txt | 61 | # | COMMENT |
| LOW | CMakeLists.txt | 241 | else() | COMMENT |
| LOW | CMakeLists.txt | 1461 | # Needed to use cuda/hip APIs from C-shim | COMMENT |
| LOW | csrc/torch_utils.h | 1 | #pragma once | COMMENT |
| LOW | csrc/torch_bindings.cpp | 1 | // Provides torch::Tensor for ops.h (previously included transitively via | COMMENT |
| LOW | csrc/cumem_allocator_compat.h | 101 | } // extern "C" | COMMENT |
| LOW | csrc/cumem_allocator.cpp | 1 | // A CUDAPluggableAllocator based on cumem* APIs. | COMMENT |
| LOW | csrc/cumem_allocator.cpp | 221 | // sleep that discarded a tag) can still contain stale data from a previously | COMMENT |
| LOW | csrc/fs_io.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda_compat.h | 41 | #define VLLM_LDG(arg) __ldg(arg) | COMMENT |
| LOW | csrc/cuda_compat.h | 61 | #endif | COMMENT |
| LOW | csrc/cuda_utils.h | 1 | #pragma once | COMMENT |
| LOW | csrc/spinloop.cpp | 1 | #include <Python.h> | COMMENT |
| LOW | csrc/attention/attention_dtypes.h | 1 | #pragma once | COMMENT |
| LOW | csrc/core/scalar_type.hpp | 1 | #pragma once | COMMENT |
| LOW | csrc/core/registration.h | 1 | #pragma once | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 21 | // state_ptr may point to a NON-CONTIGUOUS paged KV cache tensor. | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 81 | } | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 261 | // | COMMENT |
| LOW | csrc/cpu/cpu_attn_neon.hpp | 1 | #ifndef CPU_ATTN_NEON_HPP | COMMENT |
| LOW | csrc/cpu/utils.cpp | 1 | #ifndef VLLM_NUMA_DISABLED | COMMENT |
| LOW | csrc/cpu/cpu_wna16.cpp | 1 | #include "cpu/cpu_types.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_fused_moe.cpp | 1 | #include "cpu/cpu_types.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_types.hpp | 1 | #ifndef CPU_TYPES_HPP | COMMENT |
| LOW | csrc/cpu/cpu_types.hpp | 21 | #include "cpu_types_scalar.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_types_riscv.hpp | 1 | #ifndef CPU_TYPES_RISCV_HPP | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 981 | // - q_heads_buffer: [MaxQHeadNumPerIteration, head_dim] | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1001 | // - q_heads_per_kv | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1121 | // print_logits("masked logits", logits_buffer, q_head_num, | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1821 | COMMENT | |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1841 | COMMENT | |
| LOW | csrc/cpu/mamba_cpu.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/mamba_cpu.cpp | 121 | if (z.has_value() && z.value().defined()) z_in = ensure_input(z.value()); | COMMENT |
| LOW | csrc/cpu/cpu_attn_vxe.hpp | 381 | } // namespace cpu_attention | COMMENT |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 141 | #ifdef CPU_CAPABILITY_AMXBF16 | COMMENT |
| LOW | csrc/cpu/cpu_arch_macros.h | 61 | #endif | COMMENT |
| LOW | csrc/cpu/cpu_arch_macros.h | 161 | #include <riscv_vector.h> | COMMENT |
| LOW | csrc/cpu/cpu_attn_rvv.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_attn_fp8.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_types_vxe.hpp | 1 | COMMENT | |
| LOW | csrc/cpu/cpu_types_vxe.hpp | 21 | #define vec_mul(a, b) ((a) * (b)) | COMMENT |
| LOW | csrc/cpu/cpu_types_x86.hpp | 1 | COMMENT | |
| LOW | csrc/cpu/shm.cpp | 1 | #include "cpu/cpu_types.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_types_riscv_impl.hpp | 1 | #ifndef CPU_TYPES_RISCV_IMPL_HPP | COMMENT |
| LOW | csrc/cpu/cpu_fused_moe_activations.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_types_riscv_defs.hpp | 1 | #ifndef CPU_TYPES_RISCV_DEFS_HPP | COMMENT |
| LOW | csrc/cpu/cpu_types_riscv_defs.hpp | 21 | #define BOOL_256 b16 | COMMENT |
| LOW | csrc/cpu/cpu_fused_moe_int8.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_attn_vsx.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_attn_vsx.hpp | 361 | COMMENT | |
| LOW | csrc/cpu/sgl-kernels/gemm.cpp | 81 | constexpr int BLOCK_N = block_size_n(); | COMMENT |
| LOW | csrc/cpu/sgl-kernels/fla.cpp | 1 | // Adapted from | COMMENT |
| LOW | csrc/cpu/sgl-kernels/fla.cpp | 1001 | data_index_step(nt, NT, hb, HB); | COMMENT |
| LOW | csrc/cpu/sgl-kernels/fla.cpp | 1241 | data_index_step(nt, NT, h, H); | COMMENT |
| LOW | csrc/cpu/sgl-kernels/fla.cpp | 2161 | }); | COMMENT |
| LOW | csrc/cpu/sgl-kernels/gemm.h | 1 | // Adapted from | COMMENT |
| LOW | csrc/cpu/sgl-kernels/vec.h | 1 | // Adapted from | COMMENT |
| LOW | csrc/cpu/sgl-kernels/vec.h | 561 | COMMENT | |
| 1089 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | setup.py | 138 | def find_tcmalloc() -> Path | None: | CODE |
| MEDIUM | setup.py | 1104 | def get_base_commit_in_main_branch() -> str: | CODE |
| LOW⚡ | setup.py | 648 | except Exception: | CODE |
| LOW⚡ | setup.py | 666 | except Exception as e: | CODE |
| LOW | setup.py | 146 | except Exception: | CODE |
| LOW | setup.py | 235 | except Exception as e: | CODE |
| LOW | setup.py | 610 | except Exception: | CODE |
| LOW | setup.py | 621 | except Exception: | CODE |
| LOW | setup.py | 732 | except Exception: | CODE |
| LOW | setup.py | 849 | except Exception as e: | CODE |
| LOW | setup.py | 931 | except Exception as e: | CODE |
| LOW | setup.py | 1158 | except Exception as err: | CODE |
| LOW | setup.py | 1229 | except Exception: | CODE |
| MEDIUM | tools/generate_cmake_presets.py | 168 | print(f"Error writing file: {e}") | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 30 | except Exception: | CODE |
| LOW | tools/recipes/recipe_json_to_vllm_config.py | 900 | except Exception as exc: | CODE |
| LOW | tools/profiler/nsys_profile_tools/gputrc2graph.py | 239 | except Exception: | CODE |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 79 | except Exception as e: | CODE |
| LOW | tests/conftest.py | 1373 | except Exception: | CODE |
| LOW | tests/conftest.py | 1636 | except Exception as e: | CODE |
| MEDIUM | tests/utils.py | 119 | def _nvml(): | CODE |
| LOW | tests/utils.py | 82 | except Exception as e: | CODE |
| LOW | tests/utils.py | 315 | except Exception: | CODE |
| LOW | tests/utils.py | 614 | except Exception as e: | CODE |
| LOW | tests/utils.py | 700 | except Exception: | CODE |
| LOW | tests/utils.py | 1774 | except Exception as e: | CODE |
| LOW | tests/utils.py | 1797 | except Exception: | CODE |
| LOW | tests/utils.py | 1991 | except Exception as e: | CODE |
| LOW | tests/utils.py | 2209 | except Exception: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 133 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 176 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 377 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 470 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 510 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 611 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 655 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 817 | except Exception as e: | CODE |
| LOW | tests/v1/utils.py | 64 | except Exception as e: | CODE |
| LOW⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 182 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 143 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 301 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 347 | except Exception as exc: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 360 | except Exception as exc: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 380 | except Exception as e: | CODE |
| MEDIUM | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 341 | def _run_decode(): | CODE |
| LOW | tests/v1/shutdown/test_forward_error.py | 82 | except Exception as e: | CODE |
| LOW | tests/v1/shutdown/test_processor_error.py | 44 | except Exception as e: | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_hf3fs_client.py | 28 | except Exception: | CODE |
| LOW | …ts/v1/kv_connector/unit/test_nixl_rocm_gpu_mem_diag.py | 36 | except Exception: | CODE |
| LOW | tests/v1/kv_connector/unit/test_multi_connector.py | 428 | except Exception as e: | CODE |
| LOW | tests/v1/kv_connector/unit/utils.py | 355 | except Exception as e: | CODE |
| LOW | …/v1/kv_connector/unit/test_mooncake_store_connector.py | 649 | except Exception: | CODE |
| LOW | …/v1/kv_connector/unit/test_mooncake_store_connector.py | 686 | except Exception: | CODE |
| LOW | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 253 | except Exception as e: | CODE |
| MEDIUM | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 258 | print(f"Error occurred in disagg prefill proxy server - {api} endpoint") | CODE |
| MEDIUM | …/kv_connector/nixl_integration/test_disagg_accuracy.py | 159 | print(f"Error writing to file: {e}") | CODE |
| MEDIUM | …/kv_connector/nixl_integration/test_disagg_accuracy.py | 168 | print(f"Error writing to file: {e}") | CODE |
| LOW | tests/v1/determinism/test_online_batch_invariance.py | 42 | except Exception as e: # pragma: no cover | CODE |
| LOW | tests/v1/distributed/test_external_lb_dp.py | 91 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_external_lb_dp.py | 118 | except Exception as e: | CODE |
| 721 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | setup.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | tools/profiler/nsys_profile_tools/gputrc2graph.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | tests/test_request_input_bounds.py | 168 | def _set_max_n(monkeypatch: pytest.MonkeyPatch, value: int) -> None: | STRING |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_multi_connector.py | 128 | def update_state_after_alloc(self, request, blocks, num_tokens) -> None: | CODE |
| LOW | tests/v1/kv_connector/unit/test_multi_connector.py | 93 | def update_state_after_alloc(self, request, blocks, num_tokens) -> None: | CODE |
| LOW | …/v1/kv_connector/unit/offloading_connector/conftest.py | 7 | __all__ = ["request_runner"] | CODE |
| LOW | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/v1/worker/test_gpu_worker_weight_transfer.py | 39 | def update_weights(self, update_info: dict) -> None: | CODE |
| LOW | tests/v1/worker/test_gpu_trace_replay.py | 63 | def _set_lens(state: TraceReplayState, total_len, prompt_len) -> None: | CODE |
| LOW | tests/v1/engine/test_core_engine_actor_manager.py | 45 | def _set_visible_devices(self, vllm_config: Any, local_dp_rank: int) -> None: | CODE |
| LOW | tests/kernels/moe/test_marlin_vs_trtllm_mxint4.py | 77 | __all__ = [ | CODE |
| LOW | tests/distributed/test_weight_transfer.py | 1159 | def update_weights(self, update_info: dict) -> None: | CODE |
| LOW⚡ | tests/distributed/eplb_utils.py | 73 | def set_env_vars_and_device(env: dict[str, str]) -> None: | CODE |
| LOW | tests/models/language/generation/test_hybrid.py | 62 | def _set_conv_state_layout(monkeypatch, layout: str) -> None: | CODE |
| LOW | tests/vllm_test_utils/vllm_test_utils/__init__.py | 11 | __all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"] | CODE |
| LOW | tests/parser/engine/replay_harness.py | 82 | def set_vocab(self, vocab: dict[str, int]) -> None: | CODE |
| LOW | tests/quantization/test_gfx950_moe.py | 38 | def set_rocm_aiter(monkeypatch: pytest.MonkeyPatch, enabled: bool) -> None: | CODE |
| LOW | tests/entrypoints/launchers/test_dp_supervisor.py | 648 | async def _set_healthy(port: int, use_ssl: bool = False) -> None: | CODE |
| LOW | tests/entrypoints/launchers/test_dp_supervisor.py | 658 | async def _set_unhealthy(port: int, use_ssl: bool = False) -> None: | CODE |
| LOW | tests/entrypoints/openai/responses/conftest.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | …/entrypoints/openai/responses/test_parsable_context.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/entrypoints/openai/responses/test_harmony.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | vllm/envs.py | 561 | logger = logging.getLogger(__name__) | CODE |
| LOW | vllm/env_override.py | 443 | def _update_scheduler_patched(self) -> None: | CODE |
| LOW | vllm/sampling_params.py | 694 | def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None: | CODE |
| LOW | vllm/__init__.py | 76 | __all__ = [ | CODE |
| LOW | vllm/v1/request.py | 278 | def update_block_hashes(self) -> None: | CODE |
| LOW | vllm/v1/kv_offload/base.py | 100 | def set_state(self, val: Any) -> None: | CODE |
| LOW | vllm/v1/kv_offload/tiering/example/manager.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | vllm/v1/kv_offload/tiering/p2p/data/__init__.py | 6 | __all__ = [ | CODE |
| LOW | vllm/v1/kv_offload/tiering/p2p/control/__init__.py | 12 | __all__ = [ | CODE |
| LOW | vllm/v1/kv_offload/tiering/p2p/session/__init__.py | 11 | __all__ = [ | CODE |
| LOW | vllm/v1/kv_offload/tiering/fs/io.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | vllm/v1/metrics/stats.py | 404 | def update_from_output(self, prefill_stats: PrefillStats) -> None: | CODE |
| LOW | vllm/v1/attention/backend.py | 724 | def update_draft_decode_metadata(self, metadata: M) -> None: | CODE |
| LOW | vllm/v1/attention/backends/flash_attn.py | 804 | def update_draft_decode_metadata(self, metadata: FlashAttentionMetadata) -> None: | CODE |
| LOW | vllm/v1/attention/backends/triton_attn.py | 270 | def update_draft_decode_metadata(self, _metadata: TritonAttentionMetadata) -> None: | CODE |
| LOW | vllm/v1/attention/backends/flash_attn_diffkv.py | 40 | def set_head_size_v(cls, head_size_v: int) -> None: | CODE |
| LOW | vllm/v1/attention/backends/triton_attn_diffkv.py | 80 | def set_head_size_v(cls, head_size_v: int) -> None: | CODE |
| LOW⚡ | vllm/v1/attention/backends/mla/triton_mla.py | 69 | def update_draft_decode_metadata(self, _metadata: MLACommonMetadata) -> None: | CODE |
| LOW | vllm/v1/attention/backends/mla/prefill/__init__.py | 10 | __all__ = [ | CODE |
| LOW | vllm/v1/attention/ops/triton_decode_attention.py | 42 | logger = logging.getLogger(__name__) | CODE |
| LOW | vllm/v1/core/sched/async_scheduler.py | 19 | def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None: | CODE |
| LOW | vllm/v1/core/sched/interface.py | 112 | def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None: | CODE |
| LOW | vllm/v1/core/sched/interface.py | 205 | def set_pause_state(self, pause_state: PauseState) -> None: | CODE |
| LOW⚡ | vllm/v1/core/sched/scheduler.py | 2781 | def _update_waiting_for_remote_kv(self, request: Request) -> None: | CODE |
| LOW | vllm/v1/core/sched/scheduler.py | 1413 | def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None: | CODE |
| LOW | vllm/v1/core/sched/scheduler.py | 2287 | def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None: | CODE |
| LOW | vllm/v1/core/sched/scheduler.py | 2483 | def set_pause_state(self, pause_state: PauseState) -> None: | CODE |
| LOW | vllm/v1/spec_decode/extract_hidden_states.py | 84 | def set_eplb_state(self, eplb_state: EplbState) -> None: | CODE |
| LOW⚡ | vllm/v1/spec_decode/gemma4.py | 63 | def set_per_group_block_table(self, gid: int, block_table: torch.Tensor) -> None: | CODE |
| LOW | vllm/v1/spec_decode/gemma4.py | 117 | def _setup_centroids_cuda_graphs(self) -> None: | CODE |
| LOW | vllm/v1/spec_decode/llm_base_proposer.py | 346 | def set_eplb_state(self, eplb_state: EplbState) -> None: | CODE |
| LOW | vllm/v1/fault_tolerance/__init__.py | 5 | __all__ = [ | CODE |
| LOW | vllm/v1/sample/thinking_budget_state.py | 230 | def _update_think_state(self, state: dict[str, Any]) -> None: | CODE |
| LOW | vllm/v1/sample/logits_processor/__init__.py | 350 | __all__ = [ | CODE |
| LOW⚡ | vllm/v1/executor/abstract.py | 158 | def set_kv_cache_layout(self, layout_name: str) -> None: | CODE |
| LOW | vllm/v1/executor/vllm_net_devices.py | 139 | def set_worker_gpu_nic_mapping(local_rank: int) -> None: | CODE |
| LOW | vllm/v1/executor/vllm_net_devices.py | 220 | def set_worker_net_device(local_rank: int, vllm_config: VllmConfig) -> None: | CODE |
| 360 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | setup.py | 1126 | # Check if the upstream_main_commit exists in the local repo | COMMENT |
| LOW | tools/install_torchcodec_rocm.sh | 19 | # Check if torchcodec is already installed and working | COMMENT |
| LOW | tools/pre_commit/check_forbidden_imports.py | 138 | # Check if it's allowed | COMMENT |
| LOW | tools/pre_commit/update-dockerfile-graph.sh | 10 | # Check if docker/Dockerfile is among the provided files | COMMENT |
| LOW | tools/pre_commit/update-dockerfile-graph.sh | 14 | # Check if Docker is installed and running | COMMENT |
| LOW | tools/pre_commit/update-dockerfile-graph.sh | 72 | # Check if the graph has changed | COMMENT |
| LOW | tools/vllm-rocm/pin_rocm_dependencies.py | 148 | # Check if this line is for one of our custom packages | COMMENT |
| LOW | tests/conftest.py | 401 | # Set this to avoid hanging issue | COMMENT |
| LOW | tests/conftest.py | 968 | # Set this to avoid hanging issue | COMMENT |
| LOW | tests/utils.py | 544 | os.kill(spid, 0) # Check if still alive | CODE |
| LOW | tests/test_config.py | 1116 | # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_config | COMMENT |
| LOW | tests/v1/attention/test_mla_backends.py | 1484 | # Set num_speculative_tokens to query_len - 1 | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 643 | # Set some to -1 to test masking | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 647 | # Set some to out of bounds | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 703 | # Set some to -1 to test masking | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 707 | # Set some to out of bounds | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 2747 | # Verify if position length is identical | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 3716 | # Check if scheduled_encoder_inputs is empty as expected | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 4152 | # Set up to test different encoder cache existence scenario after preemption | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 4482 | # Set up to test different encoder cache existence scenario after preemption | COMMENT |
| LOW | tests/v1/core/utils.py | 276 | # Verify if position length is identical | COMMENT |
| LOW | …extract_hidden_states_integration/predictable_llama.py | 81 | # Check if we need auxiliary hidden states | COMMENT |
| LOW | …nnector/nixl_integration/config_sweep_accuracy_test.sh | 98 | # Check if cross-layers is enabled (non-empty) | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 305 | # Check if tokens match first | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 584 | # Check if tokens match first | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 813 | # Check if tokens match | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 831 | # Check if logprobs match bitwise | COMMENT |
| LOW | tests/v1/spec_decode/test_acceptance_length.py | 108 | # Check if get_valid_backends is actually defined in the platform class | COMMENT |
| LOW | …1/ec_connector/integration/run_epd_correctness_test.sh | 28 | # Set 1 to use multimodal prompts; else to use text-only | COMMENT |
| LOW | …ts/v1/ec_connector/integration/test_epd_correctness.py | 224 | # Check if server is ready | COMMENT |
| LOW | tests/v1/e2e/spec_decode/draft_model/test_async.py | 34 | # Increment counter | COMMENT |
| LOW | tests/v1/engine/test_engine_core_client.py | 427 | # Check if all request IDs in outputs have finished | COMMENT |
| LOW | tests/v1/engine/utils.py | 131 | # Check if the sampled_token_id occurs in choice_tensor[1:] | COMMENT |
| LOW | tests/utils_/test_network_utils.py | 184 | # Check if IPv6 is supported by trying to create an IPv6 socket | COMMENT |
| LOW | tests/kernels/mamba/test_cpu_short_conv.py | 111 | # Check if KV cache was updated | COMMENT |
| LOW | tests/kernels/mamba/test_cpu_short_conv.py | 169 | # Check if KV cache was updated | COMMENT |
| LOW | …/kernels/quantization/test_rocm_aiter_grouped_quant.py | 21 | # Check if aiter package is installed | COMMENT |
| LOW | tests/kernels/moe/test_moe_layer.py | 2009 | # Check if enough GPUs available | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 26 | # Check if aiter package is installed | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 35 | # Check if the op exists in torch.ops.vllm | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 38 | # Check if the op is callable | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 44 | # Check if the op exists in torch.ops.vllm | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 47 | # Check if the op is callable | COMMENT |
| LOW | tests/evals/gsm8k/gsm8k_eval.py | 382 | # Print results to terminal | COMMENT |
| LOW | tests/distributed/test_eplb_execute.py | 150 | # Check if the weights are correct | COMMENT |
| LOW | tests/model_executor/test_qwen3_omni.py | 33 | # Check if it's a special token that should be compressed | COMMENT |
| LOW | …model_loader/runai_streamer_loader/test_runai_utils.py | 56 | # Read the file in chunks to handle large files efficiently | COMMENT |
| LOW⚡ | tests/models/multimodal/generation/test_maverick.py | 59 | # Print the outputs | COMMENT |
| LOW | tests/quantization/test_gptq_v2.py | 43 | # Check if gptq_v2 format is correctly loaded | COMMENT |
| LOW | tests/quantization/test_gptq_v2.py | 105 | # Print the output sequences if failed | COMMENT |
| LOW⚡ | tests/multimodal/media/test_audio.py | 134 | # Set limit to 1 MiB — should reject | COMMENT |
| LOW | tests/compile/test_config.py | 50 | # Check if get_raw_stream exists in builtins | COMMENT |
| LOW | tests/compile/fusions_e2e/conftest.py | 46 | # Print the outputs. | COMMENT |
| LOW | tests/compile/fullgraph/test_full_graph.py | 183 | # Print the outputs. | COMMENT |
| LOW | tests/entrypoints/llm/offline_mode/test_offline_mode.py | 75 | # Set HF to offline mode and ensure we can still construct an LLM | COMMENT |
| LOW | tests/entrypoints/llm/offline_mode/test_offline_mode.py | 145 | # Set HF to offline mode and ensure we can still construct an LLM | COMMENT |
| LOW | tests/entrypoints/launchers/test_shutdown.py | 100 | # Check if any choice has finish_reason='abort' | COMMENT |
| LOW | tests/entrypoints/serve/utils/test_request_logger.py | 94 | # Set max_log_len to 10 | COMMENT |
| LOW | …rve/sagemaker/test_sagemaker_middleware_integration.py | 326 | # Check if environment variable middleware was applied | COMMENT |
| LOW | tests/lora/test_transformers_model.py | 39 | # Print the outputs. | COMMENT |
| 207 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/conftest.py | 387 | CODE | |
| LOW | tests/conftest.py | 425 | CODE | |
| LOW | tests/conftest.py | 952 | CODE | |
| LOW | tests/v1/kv_offload/test_factory.py | 37 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_manager.py | 575 | CODE | |
| LOW | tests/v1/attention/utils.py | 191 | CODE | |
| LOW | tests/v1/attention/test_attention_backends.py | 374 | CODE | |
| LOW | tests/v1/attention/test_attention_backends.py | 377 | CODE | |
| LOW | tests/v1/core/test_kv_cache_utils.py | 121 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2560 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2683 | CODE | |
| LOW | tests/v1/core/utils.py | 51 | CODE | |
| LOW | tests/v1/core/utils.py | 221 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_connector.py | 2875 | CODE | |
| LOW | …sts/v1/kv_connector/unit/test_mooncake_store_worker.py | 79 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_moriio_connector.py | 243 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 381 | CODE | |
| LOW | tests/v1/kv_connector/unit/utils.py | 91 | CODE | |
| LOW | tests/v1/kv_connector/unit/utils.py | 195 | CODE | |
| LOW | …/kv_connector/unit/offloading_connector/test_config.py | 262 | CODE | |
| LOW | tests/v1/sample/test_rejection_sampler.py | 71 | CODE | |
| LOW | tests/v1/e2e/general/test_mamba_prefix_cache.py | 180 | CODE | |
| LOW | tests/kernels/utils.py | 335 | CODE | |
| LOW | tests/kernels/utils.py | 912 | CODE | |
| LOW | tests/kernels/attention/test_mha_attn.py | 125 | CODE | |
| LOW | tests/kernels/attention/test_attention.py | 56 | CODE | |
| LOW | …sts/kernels/attention/test_triton_prefill_attention.py | 75 | CODE | |
| LOW | tests/kernels/mamba/test_mamba_ssm.py | 116 | CODE | |
| LOW | tests/kernels/mamba/utils.py | 81 | CODE | |
| LOW | tests/kernels/quantization/test_nvfp4_quant.py | 81 | CODE | |
| LOW | tests/kernels/moe/test_deepep_v2_moe.py | 214 | CODE | |
| LOW | tests/kernels/moe/test_moe_permute_unpermute.py | 114 | CODE | |
| LOW | tests/kernels/moe/test_moe.py | 1832 | CODE | |
| LOW | tests/kernels/moe/utils.py | 56 | CODE | |
| LOW | tests/kernels/moe/test_moe_layer.py | 1065 | CODE | |
| LOW | tests/kernels/moe/test_moe_layer.py | 1168 | CODE | |
| LOW | tests/evals/mrcr/mrcr_eval.py | 161 | CODE | |
| LOW | tests/evals/gsm8k/gsm8k_eval.py | 210 | CODE | |
| LOW | tests/distributed/test_multiproc_executor.py | 70 | CODE | |
| LOW | …/models/multimodal/generation/vlm_utils/model_utils.py | 558 | CODE | |
| LOW | tests/models/transformers/fusers/test_moe.py | 188 | CODE | |
| LOW | tests/quantization/reference_mxfp4.py | 88 | CODE | |
| LOW | tests/quantization/reference_mxfp4.py | 235 | CODE | |
| LOW | tests/compile/test_graph_partition.py | 103 | CODE | |
| LOW | tests/compile/fullgraph/test_toy_llama.py | 155 | CODE | |
| LOW | tests/compile/passes/test_silu_mul_quant_fusion.py | 132 | CODE | |
| LOW | tests/compile/passes/test_fusion.py | 504 | CODE | |
| LOW | tests/benchmarks/test_random_dataset.py | 177 | CODE | |
| LOW | tests/entrypoints/cohere/test_serving_streaming.py | 76 | CODE | |
| LOW | tests/entrypoints/cohere/test_serving_conversion.py | 122 | CODE | |
| LOW | tests/entrypoints/openai/utils.py | 138 | CODE | |
| LOW | vllm/sampling_params.py | 382 | CODE | |
| LOW | vllm/_custom_ops.py | 2678 | CODE | |
| LOW | vllm/_custom_ops.py | 3532 | CODE | |
| LOW | vllm/_xpu_ops.py | 943 | CODE | |
| LOW | vllm/_xpu_ops.py | 1022 | CODE | |
| LOW | vllm/forward_context.py | 212 | CODE | |
| LOW | vllm/forward_context.py | 260 | CODE | |
| LOW | vllm/_aiter_ops.py | 210 | CODE | |
| LOW | vllm/_aiter_ops.py | 278 | CODE | |
| 319 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 340 | // Step 1: pairwise sum of the two 4-wide halves | COMMENT |
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 342 | // Step 2: rotate by 8 bytes (2 floats) and add | COMMENT |
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 344 | // Step 3: rotate by 4 bytes (1 float) and add => all lanes hold total | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 138 | # Step 1: lookup key 1, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 144 | # Step 2: lookup keys 2 and 3, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 798 | # Step 1: probe hA, hB. | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 808 | # Step 2: a new key is discovered for the same request. The | COMMENT |
| LOW | tests/v1/logits_processors/test_correctness.py | 1180 | # Step 1: think-start token appears. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5767 | # Step 1: A's load is admitted; B's is held back by the reservation (B never | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5777 | # Step 2: nothing changes until A's recv lands. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5786 | # Step 3: A makes forward progress straight to RUNNING - no preemption was | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 567 | # Step 1: Get events from lmcache engine | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 576 | # Step 2: Update connector output (simulate receiving from worker) | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 582 | # Step 3: Take events | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 433 | # Step 2: 5 blocks are in use (2 new for remote blocks). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 441 | # Step 3: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 450 | # Step 4: try to schedule, remote request is put to running list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 460 | # Step 5: Remote request will be put back to waiting list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 468 | # Step 6: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 477 | # Step 7: now we can schedule (with 2 blocks computed), | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 551 | # Step 3: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 560 | # Step 4: now we can initiate KV transfer (with 2 blocks computed). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 568 | # Step 5: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 577 | # Step 6: schedule remote request | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 584 | # Step 7: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 493 | # Step 8: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 540 | # Step 2: 3 blocks are in use, | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 726 | # Step 1: Run decode and collect logprobs | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 745 | # Step 2: For each token position, run prefill and compare | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 375 | # Step 2: Schedule creates NewRequestData | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 449 | # Step 7: Schedule again - now request uses cached state | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 518 | # Step 12: Add new streaming request with seq_id=1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 390 | # Step 3: Simulate model runner caching the prompt_token_ids | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 423 | # Step 6: Verify request state after Cycle 1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 461 | # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 does | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 497 | # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQ | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 530 | # Step 13: Scheduler schedules the updated session | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 548 | # Step 14: Model runner caches NEW prompt_token_ids reference | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 561 | # Step 15: FINAL CRITICAL VERIFICATION | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 86 | # Step 1: Add initial request with 3 prompt tokens, all computed | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 102 | # Step 2: Create streaming update with extended prompt | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 118 | # Step 3: Verify no free_indices leak (old slot recycled) | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 157 | # Step 1: Add initial request with one audio feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 177 | # Step 2: Create streaming update with additional multimodal feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 194 | # Step 3: Verify no free_indices leak | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 61 | # Step 1: Create initial request state with some computed tokens | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 79 | # Step 2: Create new request data with extended prompt | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 98 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 103 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 133 | # Step 1: Create initial request state with one multimodal feature | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 158 | # Step 2: Create new request data with additional multimodal feature | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 178 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 183 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW⚡ | tests/v1/ec_connector/integration/README.md | 61 | ### Step 1: Baseline | COMMENT |
| LOW⚡ | tests/v1/ec_connector/integration/README.md | 68 | ### Step 2: EPD (1E + 1PD) | COMMENT |
| LOW⚡ | tests/v1/ec_connector/integration/README.md | 76 | ### Step 3: EPD (1E + 1P + 1D) | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 487 | # Step 1: Run baseline | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 490 | # Step 2: Test 1E + 1PD | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 493 | # Step 3: Test baseline 1P + 1D | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 496 | # # Step 4: Test 1E + 1P + 1D | COMMENT |
| 127 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | setup.py | 946 | "build_tag": null, | STRING |
| HIGH | setup.py | 950 | "variant": null, | STRING |
| HIGH | csrc/cpu/generate_cpu_attn_dispatch.py | 156 | (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256) | CODE |
| HIGH | csrc/cpu/generate_cpu_attn_dispatch.py | 228 | "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)", | CODE |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 512 | "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 515 | "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 516 | "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 519 | "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 520 | "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 521 | "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 524 | "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 525 | "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 528 | "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)), | STRING |
| HIGH | tests/v1/attention/test_mm_prefix.py | 425 | # null, so is_mm_prefix_lm is False out of the box. Tests that exercise the | COMMENT |
| HIGH | tests/v1/attention/test_mla_backends.py | 569 | # Permute the context blocks (excluding block 0 which is null) | COMMENT |
| HIGH | tests/v1/attention/test_attention_backends.py | 201 | # Permute the context blocks (excluding block 0 which is null) | COMMENT |
| HIGH⚡ | tests/v1/core/test_scheduler.py | 3451 | num_blocks=5, # Can hold 64 tokens (first block is null) | CODE |
| HIGH | tests/v1/core/test_scheduler.py | 4329 | num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null) | CODE |
| HIGH | tests/v1/core/test_scheduler.py | 4570 | num_blocks=11, # Can hold 160 tokens (first block is null) | CODE |
| HIGH | …_connector/unit/offloading_connector/test_scheduler.py | 3199 | # 4 GPU blocks: block 0 is null, blocks 1-3 are usable. | COMMENT |
| HIGH | tests/tool_parsers/test_granite_tool_parser.py | 44 | "null_field": null, | CODE |
| HIGH | tests/tool_parsers/test_granite_20b_fc_tool_parser.py | 36 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 34 | "role=null, " | CODE |
| HIGH⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 43 | '"role": null, ' | CODE |
| HIGH⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 35 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_deepseekv3_tool_parser.py | 43 | """"bool_field": true, "null_field": null, """ | STRING |
| HIGH | tests/tool_parsers/test_internlm2_tool_parser.py | 56 | "null_field": null, | CODE |
| HIGH | tests/tool_parsers/test_llama4_pythonic_tool_parser.py | 35 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_phi4mini_tool_parser.py | 51 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 38 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_lfm2_tool_parser.py | 75 | "bash(command='cd /testbed && python3 -c \"from sympy import latex\n" | CODE |
| HIGH | tests/tool_parsers/test_lfm2_tool_parser.py | 81 | '{"command": "cd /testbed && python3 -c \\"from sympy import latex\\n' | CODE |
| HIGH | tests/tool_parsers/test_longcat_tool_parser.py | 54 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 45 | '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name": | CODE |
| HIGH | tests/tool_parsers/test_qwen3coder_tool_parser.py | 594 | # Multi non-null: anyOf[string, integer, null] → first non-null is string | COMMENT |
| HIGH | tests/parser/engine/test_qwen3.py | 263 | ' "multiSelect": false, "answer": null}]' | CODE |
| HIGH | tests/parser/engine/test_qwen3.py | 274 | ' "multiSelect": false, "answer": null}]', | CODE |
| HIGH | tests/parser/engine/test_qwen3.py | 1143 | ' "multiSelect": false, "answer": null}]' | CODE |
| HIGH | tests/parser/engine/test_qwen3.py | 1164 | ' "multiSelect": false, "answer": null}]', | CODE |
| HIGH⚡ | tests/parser/engine/test_parser_engine.py | 605 | result = engine._fix_arg_types('{"val": null}', "f") | CODE |
| HIGH⚡ | tests/parser/engine/test_gemma4_streaming_reasoning.py | 1282 | text = "<|tool_call>call:configure{value:null}<tool_call|>" | CODE |
| HIGH⚡ | tests/parser/engine/test_gemma4_streaming_reasoning.py | 1290 | text = "<|tool_call>call:configure{label:null}<tool_call|>" | CODE |
| HIGH⚡ | tests/parser/mistral/test_tool_calls.py | 2640 | _REAL_LEAK_CONTENT = 'bash[TOOL_CALLS]{"command": "cd /testbed && git diff xarray/core/weighted.py"}ometracediff --git a | CODE |
| HIGH⚡ | tests/parser/mistral/test_tool_calls.py | 2653 | {"command": "cd /testbed && git diff xarray/core/weighted.py"} | CODE |
| HIGH⚡ | tests/entrypoints/unit_tests/test_chat_utils.py | 2878 | bad = '{"cmd": "mkdir -p /tmp/mmadtest && cat > /tmp/mmadtest' | CODE |
| HIGH | …e_out/token_in_token_out/test_return_routed_experts.py | 36 | '{"sliding_window": null}', | CODE |
| HIGH | tests/entrypoints/openai/test_return_routed_experts.py | 45 | '{"sliding_window": null}', | CODE |
| HIGH | vllm/_custom_ops.py | 1719 | assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)" | CODE |
| HIGH | vllm/_custom_ops.py | 1828 | assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)" | CODE |
| HIGH | vllm/_custom_ops.py | 1699 | input_tensor: The input tensor with gate || up layout [m_topk, k*2] | STRING |
| HIGH | vllm/v1/core/single_type_kv_cache_manager.py | 1195 | # result [null] [null] ... [null] [hit block 1 (1st block contain | COMMENT |
| HIGH | vllm/v1/core/single_type_kv_cache_manager.py | 489 | every (non-null) block — the default for full attention. | STRING |
| HIGH | vllm/v1/core/single_type_kv_cache_manager.py | 1142 | [null, null, block 3], otherwise, we return [null, null] | STRING |
| HIGH | vllm/v1/core/single_type_kv_cache_manager.py | 1147 | we return 4 blocks[null, null, null, null] | STRING |
| HIGH | vllm/tool_parsers/utils.py | 448 | (null, true, false) that some models produce instead of Python | STRING |
| HIGH | …ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py | 47 | cd FlexKV && bash build.sh | STRING |
| HIGH | …d/kv_transfer/kv_connector/v1/mooncake/store/worker.py | 187 | f"tenant_id must be a string or null, got {type(value).__name__}: {value!r}" | CODE |
| HIGH | vllm/benchmarks/datasets/datasets.py | 4197 | # undefined), language (en), transcription directive (en), punctuation | STRING |
| HIGH | …isaggregated/flexkv_connector/prefix_caching_flexkv.py | 12 | 2. cd FlexKV && bash build.sh | STRING |
| HIGH | .buildkite/scripts/generate-nightly-index.py | 209 | "build_tag": null, | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 340 | // Step 1: pairwise sum of the two 4-wide halves | COMMENT |
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 342 | // Step 2: rotate by 8 bytes (2 floats) and add | COMMENT |
| LOW⚡ | csrc/cpu/cpu_types_vsx.hpp | 344 | // Step 3: rotate by 4 bytes (1 float) and add => all lanes hold total | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 138 | # Step 1: lookup key 1, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 144 | # Step 2: lookup keys 2 and 3, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 798 | # Step 1: probe hA, hB. | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 808 | # Step 2: a new key is discovered for the same request. The | COMMENT |
| LOW | tests/v1/logits_processors/test_correctness.py | 1180 | # Step 1: think-start token appears. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5767 | # Step 1: A's load is admitted; B's is held back by the reservation (B never | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5777 | # Step 2: nothing changes until A's recv lands. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5786 | # Step 3: A makes forward progress straight to RUNNING - no preemption was | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 567 | # Step 1: Get events from lmcache engine | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 576 | # Step 2: Update connector output (simulate receiving from worker) | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 582 | # Step 3: Take events | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 433 | # Step 2: 5 blocks are in use (2 new for remote blocks). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 441 | # Step 3: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 450 | # Step 4: try to schedule, remote request is put to running list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 460 | # Step 5: Remote request will be put back to waiting list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 468 | # Step 6: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 477 | # Step 7: now we can schedule (with 2 blocks computed), | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 551 | # Step 3: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 560 | # Step 4: now we can initiate KV transfer (with 2 blocks computed). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 568 | # Step 5: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 577 | # Step 6: schedule remote request | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 584 | # Step 7: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 493 | # Step 8: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 540 | # Step 2: 3 blocks are in use, | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 726 | # Step 1: Run decode and collect logprobs | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 745 | # Step 2: For each token position, run prefill and compare | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 375 | # Step 2: Schedule creates NewRequestData | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 449 | # Step 7: Schedule again - now request uses cached state | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 518 | # Step 12: Add new streaming request with seq_id=1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 390 | # Step 3: Simulate model runner caching the prompt_token_ids | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 423 | # Step 6: Verify request state after Cycle 1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 461 | # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 does | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 497 | # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQ | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 530 | # Step 13: Scheduler schedules the updated session | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 548 | # Step 14: Model runner caches NEW prompt_token_ids reference | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 561 | # Step 15: FINAL CRITICAL VERIFICATION | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 86 | # Step 1: Add initial request with 3 prompt tokens, all computed | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 102 | # Step 2: Create streaming update with extended prompt | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 118 | # Step 3: Verify no free_indices leak (old slot recycled) | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 157 | # Step 1: Add initial request with one audio feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 177 | # Step 2: Create streaming update with additional multimodal feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 194 | # Step 3: Verify no free_indices leak | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 61 | # Step 1: Create initial request state with some computed tokens | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 79 | # Step 2: Create new request data with extended prompt | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 98 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 103 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 133 | # Step 1: Create initial request state with one multimodal feature | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 158 | # Step 2: Create new request data with additional multimodal feature | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 178 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 183 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 487 | # Step 1: Run baseline | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 490 | # Step 2: Test 1E + 1PD | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 493 | # Step 3: Test baseline 1P + 1D | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 496 | # # Step 4: Test 1E + 1P + 1D | COMMENT |
| LOW⚡ | tests/renderers/test_cohere.py | 1159 | # Step 1: v2 -> ChatCompletionRequest. Citations must land in | COMMENT |
| LOW⚡ | tests/renderers/test_cohere.py | 1165 | # Step 2: build the melody render config. The renderer helper | COMMENT |
| LOW | tests/renderers/test_cohere.py | 1177 | # Step 3: hand the config to melody and check the rendered | COMMENT |
| 99 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | csrc/cpu/sgl-kernels/decode.cpp | 1434 | // use smaller BLOCK_H when batches is small to utilize all cores | COMMENT |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 435 | # For now, we can just use the first accumulator type seen since | STRING |
| MEDIUM⚡ | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 145 | # matching our UID instead for a robust check. | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 30 | # Create a mixture of requests which do and don't utilize the dummy logitproc | COMMENT |
| LOW | tests/v1/cudagraph/test_breakable_cudagraph.py | 307 | # Outside capture: decorator should just call through. | COMMENT |
| MEDIUM⚡ | tests/renderers/test_sparse_tensor_validation.py | 58 | # explicitly so this fixture is robust to process-wide invariant-check state | COMMENT |
| MEDIUM | tests/kernels/attention/test_attention_selector.py | 557 | # binding, so patch is_xpu there (not on flash_attn's) to stay robust to | COMMENT |
| MEDIUM | tests/kernels/mamba/test_mamba_mixer2.py | 106 | # - utilize mock patching to disable TP when | COMMENT |
| MEDIUM | tests/distributed/test_pynccl.py | 442 | # Essentially this is an all-gather operation. | COMMENT |
| MEDIUM | tests/distributed/test_context_parallel.py | 46 | # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yaml | COMMENT |
| MEDIUM | tests/distributed/test_context_parallel.py | 48 | # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yaml | COMMENT |
| MEDIUM | tests/distributed/test_sharded_rdt_trainer.py | 400 | assert server.live_count == 1 # num_consumers=1 in the harness | CODE |
| LOW | tests/model_executor/test_qwen3_omni.py | 45 | # Regular token, just add it | COMMENT |
| MEDIUM | tests/models/registry.py | 1075 | # Keep the init/schema harness eager (these tests never run forward). | COMMENT |
| MEDIUM | tests/parser/engine/test_replay.py | 70 | # token, so it does not fit this TOOL_END-based replay harness. | COMMENT |
| MEDIUM | tests/parser/engine/test_delegating_replay.py | 90 | # token, so it does not fit this TOOL_END-based replay harness. | COMMENT |
| MEDIUM⚡ | tests/entrypoints/serve/dev/rlhf/conftest.py | 67 | # Server harness | COMMENT |
| LOW | vllm/env_override.py | 356 | # functions just return True. | COMMENT |
| LOW | vllm/v1/attention/backends/flash_attn.py | 352 | # but for now just set it to `UNIFORM_BATCH` to get use to drop down | COMMENT |
| LOW | vllm/v1/attention/backends/utils.py | 491 | # then we can simply use a cdiv for the rest. | COMMENT |
| MEDIUM | vllm/v1/attention/ops/triton_decode_attention.py | 383 | # explicitly facilitate overlapping load/compute | COMMENT |
| LOW | vllm/v1/core/kv_cache_coordinator.py | 522 | # Single group; useless but just set ``use_eagle`` for consistency regardless. | COMMENT |
| MEDIUM | vllm/v1/core/encoder_cache_manager.py | 334 | # utilize the cache and this class will fold into EncoderCacheManager, as | COMMENT |
| LOW | vllm/v1/spec_decode/llm_base_proposer.py | 617 | # KV cache in sync, so just return an empty tensor. | COMMENT |
| LOW | vllm/v1/spec_decode/llm_base_proposer.py | 1869 | # Therefore, we can just return the logits. | COMMENT |
| MEDIUM | vllm/v1/worker/gpu_worker.py | 812 | # CUDAGraph memory size and may not utilize all gpu memory. | COMMENT |
| MEDIUM | vllm/v1/worker/gpu_worker.py | 1213 | # Generate the trace name by combining prefix with comprehensive rank suffix | COMMENT |
| LOW | vllm/v1/worker/gpu/model_runner.py | 1727 | # For piecewise and eager mode, just call model(). | COMMENT |
| LOW | vllm/v1/engine/parallel_sampling.py | 116 | # If streaming, just return the current output | COMMENT |
| MEDIUM | vllm/tool_parsers/llama_tool_parser.py | 263 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | vllm/tool_parsers/jamba_tool_parser.py | 218 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | vllm/tool_parsers/granite_tool_parser.py | 188 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| LOW | vllm/tool_parsers/xlam_tool_parser.py | 560 | # If we encounter an error, just return the delta text as regular content | COMMENT |
| MEDIUM | vllm/tool_parsers/granite_20b_fc_tool_parser.py | 203 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | vllm/tool_parsers/step3_tool_parser.py | 51 | # Explicit state flags for robust streaming | COMMENT |
| LOW | vllm/tokenizers/mistral.py | 549 | # if underlying tokenizer is sentencepiece, we just add "�". | COMMENT |
| LOW | vllm/platforms/cuda.py | 708 | # users can just use IR op priority directly | COMMENT |
| MEDIUM | vllm/distributed/utils.py | 334 | """A robust barrier to synchronize all ranks. | STRING |
| MEDIUM | …ibuted/kv_transfer/kv_connector/v1/nixl/base_worker.py | 812 | # we can leverage host_buffer for permute. | COMMENT |
| MEDIUM | …ransfer/kv_connector/v1/mooncake/mooncake_connector.py | 909 | # Tasks can await async events, so a surplus (2x is a robust heuristic) | COMMENT |
| MEDIUM | vllm/config/model.py | 347 | """Enable the custom cumem allocator to leverage advanced GPU memory | STRING |
| MEDIUM | vllm/config/parallel.py | 660 | # To make the initialization more robust we retry a few times | COMMENT |
| LOW | vllm/model_executor/layers/mamba/ops/causal_conv1d.py | 194 | # first chunk and does not have prior-token, so just set to 0 | COMMENT |
| MEDIUM | vllm/model_executor/layers/fused_moe/modular_kernel.py | 49 | # The goal is to be able to utilize different communication mechanisms with | COMMENT |
| MEDIUM | …xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py | 40 | # TODO (varun) : Optimize leverage num_tokens_per_expert counts | COMMENT |
| MEDIUM | …executor/layers/fused_moe/experts/fused_humming_moe.py | 463 | # Neighboring nodes are required to utilize distinct workspaces. | COMMENT |
| MEDIUM | vllm/model_executor/layers/quantization/fp8.py | 257 | # For GPUs that lack FP8 hardware support, we can leverage the Marlin | COMMENT |
| MEDIUM | vllm/model_executor/layers/quantization/modelopt.py | 317 | # Normalize quant_algo for robust matching (ModelOpt may emit lowercase). | COMMENT |
| MEDIUM | vllm/model_executor/layers/quantization/fbgemm_fp8.py | 53 | # For GPUs that lack FP8 hardware support, we can leverage the Marlin | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp4.py | 109 | # to fully utilize the E4M3 dynamic range (e.g., global_scale=1). | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp4.py | 169 | # For GPUs that lack FP4 hardware support, we can leverage the | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp8.py | 60 | # For GPUs that lack FP8 hardware support, we can leverage the | COMMENT |
| LOW | …odel_executor/layers/quantization/utils/quant_utils.py | 516 | # Unquantized layer: just return base weights | COMMENT |
| MEDIUM | vllm/model_executor/models/deepseek_ocr.py | 142 | """Example of overriding the wrapper class `__init__()` in order to utilize | STRING |
| MEDIUM | vllm/model_executor/models/deepseek_ocr.py | 142 | """Example of overriding the wrapper class `__init__()` in order to utilize | STRING |
| LOW | vllm/model_executor/models/qwen3_asr.py | 565 | # No audio features, just return linear positions | COMMENT |
| LOW | vllm/model_executor/models/transformers/multimodal.py | 589 | # NOTE: we can't just set caching=False because base class method | COMMENT |
| LOW | vllm/models/deepseek_v4/xpu/xpu_sparse.py | 62 | # Profile run: no-op, just return q (no padding needed on XPU). | COMMENT |
| MEDIUM | …dels/deepseek_v4/nvidia/ops/fused_indexer_q_cutedsl.py | 167 | # all threads in a warp to be active since we utilize warp shuffle later. | COMMENT |
| LOW | vllm/reasoning/granite_reasoning_parser.py | 195 | # corrected; just return the delta text as normal content. | COMMENT |
| 55 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | vllm/_xpu_ops.py | 249 | XPU FP8 batched GEMM implementation for ``torch.ops.vllm.xpu_fp8_bmm``. Computes batched matrix multiplication over | STRING |
| HIGH | vllm/v1/kv_offload/tiering/factory.py | 59 | Get a secondary tier class by type. Args: tier_config: Tier configuration dict. Must contain 'type' | STRING |
| HIGH | vllm/v1/attention/backends/registry.py | 248 | Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register | STRING |
| HIGH | vllm/v1/attention/backends/mla/prefill/registry.py | 107 | Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum member | STRING |
| HIGH | vllm/v1/core/single_type_kv_cache_manager.py | 1129 | For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lon | STRING |
| HIGH | vllm/v1/structured_output/utils.py | 405 | Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: | STRING |
| HIGH | vllm/v1/structured_output/utils.py | 437 | Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/ | STRING |
| HIGH | vllm/v1/worker/utils.py | 313 | Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_mana | STRING |
| HIGH | vllm/tool_parsers/apertus_tool_parser.py | 137 | Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunk | STRING |
| HIGH | vllm/tool_parsers/apertus_tool_parser.py | 181 | Extracts tool calls from a completely generated model response (Non-Streaming). Args: mode | STRING |
| HIGH | vllm/tool_parsers/apertus_tool_parser.py | 283 | Handles streaming chunks Args: previous_text: The complete model text generated prior to t | STRING |
| HIGH | vllm/tool_parsers/apertus_tool_parser.py | 494 | Calculates the exact string difference to safely append new tool parameters. This ensures characters l | STRING |
| HIGH | …ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py | 738 | Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. | STRING |
| HIGH | vllm/distributed/kv_transfer/kv_connector/v1/base.py | 455 | Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. | STRING |
| HIGH | …ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py | 284 | Get remote allocation info for a request. Args: transfer_id:TransferId The request ID Retu | STRING |
| HIGH | …nector/v1/lmcache_integration/multi_process_adapter.py | 198 | Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and h | STRING |
| HIGH | …nector/v1/lmcache_integration/multi_process_adapter.py | 601 | Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engine | STRING |
| HIGH | vllm/distributed/weight_transfer/factory.py | 91 | Create a weight transfer engine instance. Args: config: Weight transfer configuration containing th | STRING |
| HIGH | vllm/distributed/weight_transfer/base.py | 422 | Construct typed init info from dict with validation. Args: init_dict: Dictionary containin | STRING |
| HIGH | vllm/distributed/weight_transfer/base.py | 442 | Construct typed update info from dict with validation. Args: update_dict: Dictionary conta | STRING |
| HIGH | vllm/logging_utils/formatter.py | 22 | Shortens a file path for logging display: - Removes leading 'vllm' folder if present. | STRING |
| HIGH | vllm/model_executor/kernels/linear/__init__.py | 613 | Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the | STRING |
| HIGH | vllm/model_executor/kernels/linear/__init__.py | 783 | Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to cho | STRING |
| HIGH | vllm/model_executor/layers/fused_moe/utils.py | 60 | Resolve whether AITER fused shared-expert execution is enabled. Args: quant_config: Model quantization conf | STRING |
| HIGH | vllm/model_executor/layers/fused_moe/moe_output.py | 44 | Normalize the two FlashInfer TRTLLM MoE return layouts. Args: flashinfer_output: Tensor returned by the Fla | STRING |
| HIGH | …/model_executor/layers/fused_moe/expert_map_manager.py | 337 | Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nu | STRING |
| HIGH | …cutor/layers/fused_moe/experts/ocp_mx_emulation_moe.py | 41 | Activation dtype `moe_kernel_quantize_input` should fake-quantize to. Args: ocp_mx_scheme: The OCP MX schem | STRING |
| HIGH | vllm/model_executor/models/keye_vl1_5.py | 79 | Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wi | STRING |
| HIGH | vllm/model_executor/models/isaac.py | 244 | Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): | STRING |
| HIGH | vllm/model_executor/models/transformers/utils.py | 232 | Replace the `nn.Embedding` in `embedding` with `VocabParallelEmbedding`. Args: embedding: The module return | STRING |
| HIGH | vllm/multimodal/gpu_ipc_memory.py | 160 | Return KV-cache memory remaining after frontend multimodal reservations. The reservation covers: * The total ` | STRING |
| HIGH | vllm/multimodal/audio.py | 95 | Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppo | STRING |
| HIGH | vllm/multimodal/audio.py | 332 | Split audio into chunks with intelligent split points. Splits long audio into smaller chunks at low-energy regions | STRING |
| HIGH | vllm/third_party/flash_linear_attention/ops/chunk.py | 153 | Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | …rd_party/flash_linear_attention/ops/fused_recurrent.py | 537 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | vllm/benchmarks/lib/ready_checker.py | 25 | Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async req | STRING |
| HIGH | vllm/entrypoints/chat_utils.py | 1544 | Parses a given multi-modal content part based on its type. Args: part: A dict containing the content p | STRING |
| HIGH | vllm/entrypoints/speech_to_text/base/utils.py | 18 | Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the Conte | STRING |
| HIGH | vllm/transformers_utils/processors/isaac.py | 197 | Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): Tenso | STRING |
| HIGH | vllm/lora/resolver.py | 72 | Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. | STRING |
| HIGH | …ications/chatbot/streamlit_openai_chatbot_webserver.py | 111 | Generate and stream LLM response with optional reasoning process. Args: messages (list): List of conversati | STRING |
| HIGH | benchmarks/benchmark_long_document_qa_throughput.py | 68 | Repeat each prompt in the list for a specified number of times. The order of prompts in the output list depends | STRING |
| HIGH | benchmarks/attention_benchmarks/batch_spec.py | 74 | Parse batch specification string into list of BatchRequest objects. Grammar: (<count>?) q<q_len>(k?) (s<seq_le | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | rust/src/cmd/src/cli/unsupported.rs | 141 | /// - `vllm.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)` | COMMENT |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 924 | assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 1185 | engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 1210 | assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/distributed/test_torchrun_example_moe.py | 81 | llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters() | CODE |
| CRITICAL | tests/distributed/test_torchrun_example.py | 72 | llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters() | CODE |
| CRITICAL | tests/models/language/generation/test_gemma.py | 64 | lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501 | CODE |
| CRITICAL | tests/models/language/generation/test_gemma.py | 69 | lambda self: self.model_runner.model.model.normalizer.cpu().item() | CODE |
| CRITICAL | vllm/v1/spec_decode/llm_base_proposer.py | 1475 | self.model.model.embed_tokens.weight.cpu(), | CODE |
| CRITICAL | vllm/third_party/flash_linear_attention/ops/utils.py | 170 | triton.runtime.driver.active.utils.get_device_properties(i)[ | CODE |
| CRITICAL | vllm/entrypoints/cli/main.py | 57 | vllm.entrypoints.cli.benchmark.main.maybe_exec_rust_bench() | CODE |
| CRITICAL | docs/training/layerwise.md | 124 | model = llm.llm_engine.engine_core.engine_core.model_executor.driver_worker.worker.get_model() | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tests/v1/kv_offload/tiering/p2p/test_manager.py | 1262 | # _poll_once orchestration | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_offloading_connector.py | 153 | # Use a long prompt that fits within the model's context window. | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 894 | # Wait for generation to start (event-driven) | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 936 | # Wait for some tokens (event-driven, handles slow token generation) | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 1000 | # Wait for at least one token across any request (event-driven) | COMMENT |
| MEDIUM | tests/tool_parsers/test_lfm2_tool_parser.py | 281 | # Messy agentic shell commands: literal bracket inside a string argument | COMMENT |
| MEDIUM | tests/renderers/test_cohere.py | 438 | # chain-of-thought across the rendered prompt. | COMMENT |
| MEDIUM | tests/evals/mrcr/mrcr_eval.py | 32 | # Skip chain-of-thought on reasoning models; ignored by non-reasoning templates. | COMMENT |
| MEDIUM | tests/compile/fullgraph/test_basic_correctness.py | 39 | # embedding model | COMMENT |
| MEDIUM | tests/entrypoints/cohere/test_serving_conversion.py | 410 | # Cohere's ``tool_plan`` is the older chain-of-thought field; it | COMMENT |
| MEDIUM | tests/entrypoints/openai/responses/test_harmony.py | 606 | # NOTE: chain-of-thought should be removed. | COMMENT |
| MEDIUM | …ntrypoints/openai/chat_completion/test_serving_chat.py | 1213 | # adding max_tokens should exceed the model context window. | COMMENT |
| MEDIUM | vllm/_xpu_ops.py | 1038 | window_size=(-1, -1), # -1 means infinite context window | CODE |
| MEDIUM | vllm/v1/attention/ops/vit_attn_wrappers.py | 264 | # Without it, hallucinations occur with the backend | COMMENT |
| MEDIUM | vllm/v1/executor/abstract.py | 45 | uses_ray: bool = False # whether the executor uses Ray for orchestration. | CODE |
| MEDIUM | vllm/platforms/cpu.py | 108 | # the shared MLA scaffolding so that DeepSeek-style models can | COMMENT |
| MEDIUM⚡ | …ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py | 273 | # progress is event-driven (see module docstring). | COMMENT |
| MEDIUM | …d/kv_transfer/kv_connector/v1/mooncake/store/worker.py | 4 | # The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread, | COMMENT |
| MEDIUM | vllm/model_executor/models/granite_speech.py | 81 | # work pretty well with zero shot. | COMMENT |
| MEDIUM | vllm/model_executor/models/phi3v.py | 611 | # initialized as an embedding model | COMMENT |
| MEDIUM | vllm/models/minimax_m3/amd/model.py | 1377 | # NVIDIA copy — it only orchestrates the shared vision tower + the per-platform | COMMENT |
| MEDIUM | vllm/reasoning/gemma4_utils.py | 27 | print(result["thinking"]) # chain-of-thought or None | STRING |
| MEDIUM | vllm/reasoning/gemma4_utils.py | 76 | >>> print(result["thinking"]) # chain-of-thought reasoning or None | STRING |
| MEDIUM | vllm/entrypoints/cohere/serving.py | 273 | # Controls how the assistant's chain-of-thought is surfaced on | COMMENT |
| MEDIUM | vllm/entrypoints/cohere/serving.py | 459 | # ``tool_plan`` is Cohere's chain-of-thought emitted alongside tool | COMMENT |
| MEDIUM | vllm/entrypoints/speech_to_text/base/serving.py | 408 | # which is a strong sign of hallucination in outputs. | COMMENT |
| MEDIUM | vllm/vllm_flash_attn/flash_attn_interface.py | 138 | window_size=(-1, -1), # -1 means infinite context window | CODE |
| MEDIUM | docs/serving/integrations/claude_code.md | 3 | [Claude Code](https://code.claude.com/docs/en/quickstart) is Anthropic's official agentic coding tool that lives in your | CODE |
| MEDIUM | docs/serving/integrations/codex.md | 3 | [Codex](https://github.com/openai/codex) is OpenAI's official agentic coding tool that lives in your terminal. It can un | CODE |
| MEDIUM | docs/features/tool_calling.md | 221 | The tool calling that is supported is the [JSON-based tool calling](https://llama.meta.com/docs/model-cards-and-prompt-f | CODE |
| MEDIUM | docs/deployment/frameworks/dify.md | 3 | [Dify](https://github.com/langgenius/dify) is an open-source LLM app development platform. Its intuitive interface combi | CODE |
| MEDIUM | .buildkite/scripts/hardware_ci/run-amd-test.sh | 1429 | # Keep AMD CI orchestration variables out of vLLM's runtime environment. | COMMENT |
| MEDIUM | .buildkite/amd-disagg/vllm_disagg.sh | 88 | # node-mode orchestration knobs | COMMENT |
| MEDIUM⚡ | .buildkite/amd-disagg/vllm_disagg.sh | 414 | # node mode — SLURM-native rank-based self-select + rank-0 orchestration | COMMENT |
| MEDIUM | .buildkite/amd-disagg/vllm_disagg.sh | 600 | # shell's stdout stays free for orchestration logs the srun/CI captures). | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/attention/test_mla_backends.py | 1791 | ["placeholder"], | CODE |
| LOW | tests/v1/attention/test_dspark_noncausal_sparse_mla.py | 332 | vllm_config.compilation_config.static_forward_context["placeholder"] = ( | CODE |
| LOW | tests/v1/attention/test_dspark_noncausal_sparse_mla.py | 337 | kv_cache_spec, ["placeholder"], vllm_config, device | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 470 | vllm_config.compilation_config.static_forward_context["placeholder"] = ( | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 475 | builder = builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1133 | vllm_config.compilation_config.static_forward_context["placeholder"] = ( | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1138 | builder = builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1609 | vllm_config.compilation_config.static_forward_context["placeholder"] = ( | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1640 | builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1642 | builder = builder_cls(kv_cache_spec, ["placeholder"], vllm_config, device) | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 629 | ["placeholder"], | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 964 | "placeholder": PerLayerParameters( | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 1012 | kv_cache_spec, ["placeholder"], vllm_config, device | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 904 | payload = _registration_data("placeholder") | CODE |
| LOW | tests/tool_parsers/test_kimi_k2_tool_parser.py | 85 | '{"to": "user@example.com", "subject": "Daily Update"}', | CODE |
| LOW | tests/tool_parsers/test_kimi_k2_tool_parser.py | 92 | {"to": "user@example.com", "subject": "Daily Update"}, | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 23 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 31 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 40 | arguments='{"name": "John Doe", ' | CODE |
| LOW⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 23 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 32 | arguments='{"name": "John Doe", ' | CODE |
| LOW⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 26 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 35 | arguments='{"name": "John Doe", ' | CODE |
| LOW | tests/tool_parsers/test_lfm2_tool_parser.py | 537 | "deliveryAddress='123 Main St')]" | CODE |
| LOW⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 45 | '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name": | CODE |
| LOW⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 53 | "name": "John Doe", | CODE |
| LOW | tests/kernels/helion/test_pattern_matching.py | 125 | input_node = next(n for n in gm.graph.nodes if n.op == "placeholder") | CODE |
| LOW | tests/kernels/helion/test_pattern_matching.py | 200 | input_node = next(n for n in gm.graph.nodes if n.op == "placeholder") | CODE |
| LOW | …ls/attention/test_rocm_aiter_mla_causal_verify_mask.py | 128 | layer_name = "placeholder" | CODE |
| LOW | …rnels/attention/test_rocm_aiter_mla_decode_metadata.py | 118 | layer_name = "placeholder" | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 130 | dummy_data = builder.get_dummy_mm_data(100, mm_counts, {}) | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 132 | assert "audio" in dummy_data | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 133 | assert len(dummy_data["audio"]) == 2 | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 136 | assert len(dummy_data["audio"][0]) == expected_len | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 406 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 997 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 1459 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 399 | """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW | tests/parser/mistral/test_tool_calls.py | 990 | """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW | tests/parser/mistral/test_tool_calls.py | 1452 | """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW | tests/compile/test_graph_partition.py | 64 | and node.args[0].op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 125 | and node.args[0].op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 193 | assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * [ | CODE |
| LOW | tests/compile/test_graph_partition.py | 440 | if node.op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 506 | if n.op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 512 | if n.op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 621 | if n.op != "placeholder": | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 225 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 237 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW | tests/compile/passes/ir/test_clone_cleanup.py | 255 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 274 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 292 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 311 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/benchmarks/test_txt_slices_dataset.py | 20 | Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor | CODE |
| LOW⚡ | tests/benchmarks/test_txt_slices_dataset.py | 20 | Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor | CODE |
| LOW⚡ | tests/entrypoints/launchers/test_run_batch.py | 840 | def _make_aiohttp_mocks(response_data: bytes = b"fake-data", status: int = 200): | CODE |
| LOW | vllm/model_executor/models/transformers/fx_utils.py | 117 | if kind == "placeholder": | CODE |
| LOW | vllm/model_executor/models/transformers/fx_utils.py | 168 | and node.op == "placeholder" | CODE |
| LOW | vllm/model_executor/models/transformers/fusers/qkv.py | 66 | and node.args[0].op == "placeholder" | CODE |
| LOW | vllm/model_executor/models/transformers/fusers/mla.py | 48 | and node.args[0].op == "placeholder" | CODE |
| 17 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/setup_deepgemm_pythons.sh | 6 | # Usage: | COMMENT |
| LOW | tools/vllm-rocm/generate-rocm-wheels-root-index.sh | 11 | # Usage: | COMMENT |
| LOW | docker/docker-bake.hcl | 5 | # Usage: | COMMENT |
| LOW | docker/docker-bake-rocm.hcl | 6 | # Usage: | COMMENT |
| LOW | docker/docker-bake-rocm.hcl | 127 | # Usage: | COMMENT |
| LOW | docker/entrypoints/test_vllm_nonroot_entrypoint.sh | 9 | # Usage: | COMMENT |
| LOW | …/nixl_integration/run_multi_connector_accuracy_test.sh | 15 | # Usage: | COMMENT |
| LOW | …nector/nixl_integration/spec_decode_acceptance_test.sh | 13 | # Usage: | COMMENT |
| LOW | …nixl_integration/run_multi_connector_edge_case_test.sh | 15 | # Usage: | COMMENT |
| LOW | examples/tool_calling/chat_with_tools_offline.py | 44 | # Usage: | COMMENT |
| LOW | examples/ray_serving/run_cluster.sh | 8 | # Usage: | COMMENT |
| LOW | examples/ray_serving/multi-node-serving.sh | 11 | # Example usage: | COMMENT |
| LOW | examples/generate/multimodal/mistral-small_offline.py | 51 | # Usage: | COMMENT |
| LOW | benchmarks/kv_cache_watermark.sh | 29 | # Usage: | COMMENT |
| LOW | …n_benchmarks/configs/mla_sparse_masked_mha_vs_mqa.yaml | 9 | # Usage: | COMMENT |
| LOW | …ttention_benchmarks/configs/mla_sparse_mha_vs_mqa.yaml | 3 | # Usage: | COMMENT |
| LOW | …s/attention_benchmarks/configs/mla_fa4_fp8_output.yaml | 6 | # Usage: | COMMENT |
| LOW | …nchmarks/attention_benchmarks/configs/mla_prefill.yaml | 14 | # Usage: | COMMENT |
| LOW | .buildkite/scripts/cache-rocm-base-wheels.sh | 10 | # Usage: | COMMENT |
| LOW | .buildkite/scripts/ci-bake-rocm.sh | 9 | # Usage: | COMMENT |
| LOW | .buildkite/scripts/ci-fetch-log.sh | 4 | # Usage: | COMMENT |
| LOW | .buildkite/scripts/tool_call/run-bfcl-eval.sh | 5 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | docs/deployment/frameworks/crusoe.md | 13 | export CRUSOE_API_KEY="your-api-key" | CODE |
| HIGH | …les/pooling/embed/openai_embedding_long_text/client.py | 22 | --api-key your-api-key | STRING |
| HIGH | …les/pooling/embed/openai_embedding_long_text/client.py | 32 | --api-key your-api-key | STRING |
| HIGH | …les/pooling/embed/openai_embedding_long_text/client.py | 44 | API_KEY = "your-api-key" # Replace with your actual API key | CODE |
| HIGH | …es/pooling/embed/openai_embedding_long_text/service.sh | 19 | API_KEY=${API_KEY:-"your-api-key"} | CODE |
| HIGH | .github/ISSUE_TEMPLATE/400-bug-report.yml | 20 | Consider redacting or replacing sensitive values with placeholders like `<YOUR_TOKEN_HERE>` when sharing configura | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | csrc/cpu/sgl-kernels/common.h | 378 | // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb] | COMMENT |
| LOW | …nector/v1/lmcache_integration/multi_process_adapter.py | 632 | # TODO: add error handling here | COMMENT |
| LOW | …m/model_executor/kernels/linear/mixed_precision/xpu.py | 191 | # TODO: implement asym case | COMMENT |
| LOW | vllm/entrypoints/openai/responses/protocol.py | 754 | # TODO: implement the other reason for incomplete_details, | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 310 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 343 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 367 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 404 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 434 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 453 | # TODO: implement it based on torch ops | COMMENT |
| LOW | vllm/lora/punica_wrapper/punica_base.py | 480 | # TODO: implement it based on torch ops | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/models/multimodal/generation/test_common.py | 63 | # model arch happens to be a substring of another one, you can add a | COMMENT |
| MEDIUM | tests/models/multimodal/generation/test_common.py | 84 | # NOTE you can add --collect-only to any of the above commands to see | COMMENT |
| LOW | …ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py | 86 | # while processing the next batch, we make sure to only set an | COMMENT |
| MEDIUM | vllm/model_executor/models/interfaces.py | 282 | as a language model component. | STRING |
| MEDIUM | …ache/disagg_prefill_lmcache_v1/disagg_vllm_launcher.sh | 24 | # secure random value. This is set to a fixed value for demonstration purposes only. | COMMENT |
| MEDIUM | .buildkite/test-amd.yaml | 1 | # In this file, you can add more tests to run either by adding a new step or | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/sample/test_logprobs.py | 953 | # Based on user's example: "In this example," | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …tic_prefix_caching/automatic_prefix_caching_offline.py | 26 | # A prompt containing a large markdown table. The table is randomly generated by GPT-4. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/v1/e2e/general/test_streaming_input.py | 503 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …gated/disaggregated_serving/moriio_toy_proxy_server.py | 277 | async def handle_request(api: str, request: Request): | CODE |