Large-scale LLM inference engine
This report summarizes scanner evidence for dphnAI/sonar, a Python project with 1,871 GitHub stars. SynthScan examined 2,405,065 lines of code across 6278 source files, recording 25284 pattern matches distributed across 26 syntactic categories. The legacy adjusted pattern signal is 13.8 (Moderate pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 19401 finding(s).
Are imports declared and package/API names verified? 1958 finding(s).
Are wrappers, guards, and repeated structures necessary? 19776 finding(s).
Which changes need focused human review? 25284 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 25284 distinct pattern matches across 26 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | env.py | 113 | def run_and_parse_first_match(run_lambda, command, regex): | CODE |
| LOW | env.py | 124 | def run_and_return_first_line(run_lambda, command): | CODE |
| LOW | env.py | 157 | def get_nvidia_driver_version(run_lambda): | CODE |
| LOW | env.py | 269 | def summarize_aphrodite_build_flags(): | CODE |
| LOW | env.py | 473 | def get_cachingallocator_config(): | CODE |
| LOW | env.py | 478 | def get_cuda_module_loading_config(): | CODE |
| LOW⚡ | setup.py | 52 | def should_require_rust_frontend() -> bool: | CODE |
| LOW⚡ | setup.py | 57 | def should_use_precompiled_rust() -> bool: | CODE |
| LOW⚡ | setup.py | 62 | def get_precompiled_rust_extension_paths() -> list[Path]: | CODE |
| LOW | setup.py | 733 | def add_aphrodite_package_data(filename: str) -> None: | CODE |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 91 | def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str: | CODE |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 318 | def generate_type_option_name(kernel_types: TypeConfig): | STRING |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 350 | def unsigned_type_with_bitwidth(num_bits): | STRING |
| LOW | tools/generate_versions_json.py | 84 | def generate_bake_native_json(args: dict[str, str]) -> dict: | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 65 | def install_system_dependencies(): | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 104 | def build_and_install_prerequisites(args): | CODE |
| LOW | tools/build_rust.py | 20 | def prepare_build_environment() -> str | None: | CODE |
| LOW | tools/build_rust.py | 54 | def rust_py_extension_module_names() -> list[str]: | CODE |
| LOW⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1070 | def _expand_flash_attn_variants( | CODE |
| LOW⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1180 | def parse_cuda_priority_lists() -> dict[str, list[str]]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 250 | def _find_exact_cc_in_function(tree: ast.AST, func_name: str) -> str | None: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 608 | def parse_flash_attn_features() -> dict[str, dict[str, Any]]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 753 | def parse_flashinfer_trtllm_features() -> dict[str, dict[str, Any]]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 792 | def parse_mla_dimensions_call(node: ast.AST | None) -> str | None: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 816 | def parse_supported_mla_dimensions(node: ast.ClassDef) -> list[str]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 831 | def _parse_mla_dimension_reference( | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 840 | def _parse_mla_dimensions_return( | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 870 | def _parse_fa_version_condition(node: ast.AST) -> int | None: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 891 | def parse_supports_mla_dimensions( | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 944 | def parse_mla_prefill_registry() -> dict[str, str]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 955 | def parse_mla_prefill_backend_file(class_path: str) -> dict[str, Any] | None: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1013 | def _format_mla_dimension_notes(backend_info: dict[str, Any]) -> str: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1035 | def parse_mla_prefill_backends() -> list[dict[str, Any]]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1122 | def _expand_flashinfer_variants( | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1231 | def _get_backends_from_return(stmts: list) -> list[str]: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1503 | def generate_priority_section(priorities: dict[str, list[str]]) -> str: | CODE |
| LOW | tools/docs/generate_user_reference.py | 147 | def quantization_config_classes() -> dict[str, str]: | CODE |
| LOW | tools/recipes/runtime_tuning.py | 69 | def _get_active_sequence_count( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 84 | def _estimate_prefills_per_step( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 112 | def _resolve_tensor_parallel_size( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 134 | def _resolve_gpu_memory_utilization( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 192 | def _resolve_max_num_batched_tokens( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 240 | def _resolve_data_parallel_size( | CODE |
| LOW | tools/recipes/runtime_tuning.py | 272 | def get_runtime_tuning_policies( | CODE |
| LOW | tools/recipes/sweep_generation.py | 24 | def _strict_lower_power_of_two(value: int) -> int: | CODE |
| LOW | tools/recipes/sweep_generation.py | 30 | def _strict_upper_power_of_two(value: int) -> int: | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 66 | def shorten_plot_legend_strings(legend, max_char_len: int): | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 85 | def attempt_to_make_names_unique(entries_and_traces): | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 124 | def group_trace_by_operations(trace_df: pd.DataFrame) -> pd.DataFrame: | CODE |
| LOW | tools/profiler/visualize_layerwise_profile.py | 179 | def is_custom_ar_all_reduce_unreg(op_name: str): | CODE |
| LOW | tests/test_sequence.py | 9 | def test_sequence_intermediate_tensors_equal(): | CODE |
| LOW | tests/test_request_input_bounds.py | 74 | def test_public_requests_accept_four_stop_strings( | CODE |
| LOW | tests/test_request_input_bounds.py | 85 | def test_public_requests_reject_more_than_four_stop_strings( | CODE |
| LOW | tests/test_request_input_bounds.py | 92 | def test_stop_string_limit_can_be_overridden(): | CODE |
| LOW | tests/test_request_input_bounds.py | 117 | def test_duplicate_stop_token_ids_are_deduplicated_in_order(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 138 | def test_duplicate_bad_words_are_deduplicated_in_order(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 144 | def test_bad_word_tokenization_stops_at_worker_limit(): | STRING |
| LOW⚡ | tests/test_request_input_bounds.py | 154 | def test_bad_word_tokenization_limit_can_be_overridden(monkeypatch): | STRING |
| LOW | tests/test_request_input_bounds.py | 172 | def test_bad_word_rejects_empty_base_tokenization(): | STRING |
| LOW | tests/test_request_input_bounds.py | 191 | def test_bad_word_skips_empty_optional_prefixed_tokenization(): | STRING |
| 15394 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1065 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1067 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1175 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1177 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1620 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1622 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 24 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 26 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 70 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 72 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 269 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 271 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 306 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 308 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 568 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 570 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 1303 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 1309 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 1395 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tools/pre_commit/generate_attention_backend_docs.py | 1397 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 11 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 13 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 48 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 61 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 63 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 97 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/test_ray_env.py | 99 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 135 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 147 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/test_ray_env.py | 149 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 57 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 59 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 97 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 99 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 151 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 153 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 265 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/test_file_mapper.py | 267 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/kv_offload/test_file_mapper.py | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/kv_offload/test_file_mapper.py | 24 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 228 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 230 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 268 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 270 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 293 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 295 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 325 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 327 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 439 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 441 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 598 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 600 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 698 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 700 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 759 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 761 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 803 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 805 | # --------------------------------------------------------------------------- | COMMENT |
| 2095 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/attention/test_mla_prefill_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/kernels/attention/test_attention_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/kernels/attention/test_rocm_attention_selector.py | 0 | clear lru cache to ensure each test case runs without caching. | STRING |
| HIGH | tests/tool_parsers/test_granite_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_granite_20b_fc_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_phi4mini_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/tool_parsers/test_longcat_tool_parser.py | 0 | <longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3. | STRING |
| HIGH | tests/distributed/test_pipeline_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/distributed/test_context_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/compile/correctness_e2e/test_sequence_parallel.py | 0 | warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only us | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/entrypoints/pooling/scoring/util.py | 0 | create a small solid-color png image and return its base64 data uri. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/entrypoints/pooling/scoring/util.py | 0 | build a scoremultimodalparam containing an image (and optional text). | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3_5.py | 0 | verify per-token embedding shape and l2 normalization. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colpali.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/pooling/test_colqwen3_5.py | 0 | verify that relevant documents score higher than irrelevant ones. | STRING |
| HIGH | tests/models/multimodal/generation/test_phi4siglip.py | 0 | sanitize aphrodite output [phi3v] to be comparable with hf output. | STRING |
| HIGH | tests/models/multimodal/generation/test_phi4mm.py | 0 | sanitize aphrodite output [phi3v] to be comparable with hf output. | STRING |
| HIGH | …/models/multimodal/generation/vlm_utils/model_utils.py | 0 | sanitize aphrodite output [phi3v] to be comparable with hf output. | STRING |
| HIGH | …ts/models/multimodal/generation/test_granite_speech.py | 0 | sanitize aphrodite output [phi3v] to be comparable with hf output. | STRING |
| HIGH | tests/entrypoints/openai/completion/test_completion.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | …ypoints/openai/chat_completion/test_chat_completion.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | benchmarks/benchmark_serving_structured_output.py | 0 | root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " | | STRING |
| HIGH | tests/lora/test_qwen3moe_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | tests/lora/test_llama_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | tests/lora/test_olmoe_tp.py | 0 | i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do n | STRING |
| HIGH | examples/offline_inference/vision_language_embedding.py | 0 | this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language m | STRING |
| HIGH | examples/vision/vision_example.py | 0 | this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language m | STRING |
| HIGH | examples/audio/audio_example.py | 0 | this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language m | STRING |
| HIGH | benchmarks/benchmark_throughput.py | 0 | deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench r | STRING |
| HIGH | benchmarks/benchmark_latency.py | 0 | deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench r | STRING |
| HIGH | benchmarks/benchmark_serving.py | 0 | deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench r | STRING |
| HIGH | benchmarks/kernels/benchmark_machete.py | 0 | benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sq | STRING |
| HIGH | benchmarks/cutlass_benchmarks/w8a8_benchmarks.py | 0 | benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sq | STRING |
| HIGH | benchmarks/cutlass_benchmarks/sparse_benchmarks.py | 0 | benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sq | STRING |
| HIGH | aphrodite/sampling_params.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | …e/entrypoints/speech_to_text/transcription/protocol.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | …ite/entrypoints/speech_to_text/translation/protocol.py | 0 | whether to include the stop strings in output text. | STRING |
| HIGH | aphrodite/v1/attention/backends/flash_attn.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | aphrodite/v1/attention/backends/flash_attn_diffkv.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | aphrodite/v1/attention/backends/rocm_aiter_fa.py | 0 | forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, | STRING |
| HIGH | aphrodite/v1/attention/backends/flash_attn.py | 0 | forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] key | STRING |
| HIGH | aphrodite/v1/attention/backends/triton_attn.py | 0 | forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] key | STRING |
| HIGH | aphrodite/v1/attention/backends/rocm_attn.py | 0 | forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] key | STRING |
| HIGH | aphrodite/v1/attention/backends/mamba_attn.py | 0 | this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs with | STRING |
| HIGH | aphrodite/v1/attention/backends/gdn_attn.py | 0 | this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs with | STRING |
| HIGH | …odite/model_executor/layers/attention/mla_attention.py | 0 | this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs with | STRING |
| HIGH | …odite/v1/attention/backends/rocm_aiter_unified_attn.py | 0 | forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_k | STRING |
| HIGH | aphrodite/v1/attention/backends/flashinfer.py | 0 | forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_k | STRING |
| HIGH | aphrodite/v1/attention/backends/flex_attention.py | 0 | forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_k | STRING |
| HIGH | aphrodite/v1/core/sched/interface.py | 0 | reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated t | STRING |
| HIGH | aphrodite/v1/core/sched/scheduler.py | 0 | reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated t | STRING |
| HIGH | aphrodite/v1/engine/llm_engine.py | 0 | reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated t | STRING |
| HIGH | aphrodite/v1/engine/async_llm.py | 0 | load a new lora adapter into the engine for future requests. | STRING |
| 305 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …lass_extensions/aphrodite_cutlass_library_extension.py | 6 | CODE | |
| LOW | tools/build_rust.py | 6 | CODE | |
| LOW | tools/docs/generate_user_reference.py | 7 | CODE | |
| LOW | tools/recipes/sweep_recommendation.py | 7 | CODE | |
| LOW | tools/recipes/hardware_detection.py | 10 | CODE | |
| LOW | tools/recipes/runtime_tuning.py | 14 | CODE | |
| LOW | tools/recipes/recipe_json_to_aphrodite_config.py | 43 | CODE | |
| LOW | tools/recipes/sweep_generation.py | 6 | CODE | |
| LOW | tests/conftest.py | 77 | CODE | |
| LOW | tests/conftest.py | 77 | CODE | |
| LOW | tests/conftest.py | 78 | CODE | |
| LOW | tests/utils.py | 58 | CODE | |
| LOW | tests/utils.py | 65 | CODE | |
| LOW | tests/utils.py | 2100 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 13 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_zmq_transport.py | 5 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_data_transport.py | 5 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_manager.py | 9 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 268 | CODE | |
| LOW | …ts/v1/attention/test_sparse_indexer_decode_seq_lens.py | 28 | CODE | |
| LOW | tests/v1/attention/test_attention_backends.py | 68 | CODE | |
| LOW | tests/v1/logits_processors/utils.py | 12 | CODE | |
| LOW | tests/v1/cudagraph/test_cudagraph_mode.py | 38 | CODE | |
| LOW | tests/v1/cudagraph/test_breakable_cudagraph.py | 7 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_tp_mapping.py | 10 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_hf3fs_client.py | 17 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 21 | CODE | |
| LOW | …kv_connector/unit/test_simple_cpu_offload_connector.py | 5 | CODE | |
| LOW | …/v1/kv_connector/unit/offloading_connector/conftest.py | 3 | CODE | |
| LOW | …onnector/mooncake_integration/test_mooncake_imports.py | 22 | CODE | |
| LOW | tests/v1/spec_decode/test_backup_token_async_spec.py | 9 | CODE | |
| LOW | tests/v1/sample/test_topk_topp_sampler.py | 33 | CODE | |
| LOW | tests/v1/ec_connector/unit/cpu/test_connector.py | 59 | CODE | |
| LOW | tests/v1/engine/conftest.py | 20 | CODE | |
| LOW | tests/v1/engine/conftest.py | 20 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_scheduler.py | 5 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_kv_events.py | 11 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_worker.py | 10 | CODE | |
| LOW | tests/tool_use/test_gemma4_responses_adjust_request.py | 32 | CODE | |
| LOW | tests/tool_parsers/test_poolside_v1_tool_parser.py | 21 | CODE | |
| LOW | tests/tool_parsers/test_cohere_command_tool_parser.py | 4 | CODE | |
| LOW | tests/renderers/test_chat_utils_prompt_embeds.py | 6 | CODE | |
| LOW | …rnels/attention/test_rocm_aiter_mla_op_registration.py | 49 | CODE | |
| LOW | tests/kernels/core/test_vit_fp8_attn.py | 20 | CODE | |
| LOW | tests/kernels/core/test_rocm_misc_ops.py | 46 | CODE | |
| LOW | tests/kernels/core/test_rocm_misc_ops.py | 56 | CODE | |
| LOW | tests/kernels/core/test_rocm_misc_ops.py | 65 | CODE | |
| LOW | tests/kernels/core/test_fused_q_kv_rmsnorm.py | 11 | CODE | |
| LOW | tests/kernels/ir/test_ir_ops.py | 11 | CODE | |
| LOW | tests/kernels/ir/test_layernorm.py | 7 | CODE | |
| LOW | tests/kernels/mamba/test_memcpy_u64_tiled.py | 28 | CODE | |
| LOW | tests/kernels/mamba/test_precopy_mamba_align.py | 22 | CODE | |
| LOW | tests/kernels/mamba/test_gdn_forward_core_split.py | 30 | CODE | |
| LOW | tests/kernels/mamba/test_gdn_fused_mtp.py | 5 | CODE | |
| LOW | tests/kernels/scripts/check_no_tilelang_hijack.py | 15 | CODE | |
| LOW | tests/kernels/scripts/check_no_tilelang_hijack.py | 16 | CODE | |
| 1754 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | env.py | 165 | CODE | |
| LOW | env.py | 379 | CODE | |
| LOW | use_existing_torch.py | 24 | CODE | |
| LOW | setup.py | 537 | CODE | |
| LOW | setup.py | 584 | CODE | |
| LOW | setup.py | 204 | CODE | |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 91 | CODE | |
| LOW | …ibtorch_stable/quantization/marlin/generate_kernels.py | 173 | CODE | |
| LOW | …btorch_stable/moe/marlin_moe_wna16/generate_kernels.py | 173 | CODE | |
| LOW | tools/report_build_time_ninja.py | 149 | CODE | |
| LOW | tools/pre_commit/check_label_rules.py | 41 | CODE | |
| LOW | tools/pre_commit/check_triton_import.py | 32 | CODE | |
| LOW | tools/pre_commit/enforce_regex_import.py | 34 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 106 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 131 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 152 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 195 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 320 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 362 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 608 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 891 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1180 | CODE | |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1231 | CODE | |
| LOW | tools/pre_commit/validate_config.py | 73 | CODE | |
| LOW | tools/pre_commit/check_boolean_context_manager.py | 8 | CODE | |
| LOW | tools/pre_commit/check_spdx_header.py | 58 | CODE | |
| LOW | tools/pre_commit/check_spdx_header.py | 83 | CODE | |
| LOW | tools/docs/generate_user_reference.py | 164 | CODE | |
| LOW | tools/docs/generate_user_reference.py | 175 | CODE | |
| LOW | tools/recipes/recipe_json_to_aphrodite_config.py | 242 | CODE | |
| LOW | tools/recipes/recipe_json_to_aphrodite_config.py | 527 | CODE | |
| LOW | tools/recipes/recipe_json_to_aphrodite_config.py | 752 | CODE | |
| LOW | tests/conftest.py | 420 | CODE | |
| LOW | tests/conftest.py | 551 | CODE | |
| LOW | tests/conftest.py | 1014 | CODE | |
| LOW | tests/utils.py | 143 | CODE | |
| LOW | tests/utils.py | 1173 | CODE | |
| LOW | tests/utils.py | 1512 | CODE | |
| LOW | tests/utils.py | 1639 | CODE | |
| LOW | tests/utils.py | 1763 | CODE | |
| LOW | tests/utils.py | 561 | CODE | |
| LOW | tests/utils.py | 1645 | CODE | |
| LOW | tests/utils.py | 1786 | CODE | |
| LOW | tests/v1/test_glm5next_dflash2.py | 232 | CODE | |
| LOW | tests/v1/utils.py | 12 | CODE | |
| LOW | tests/v1/kv_offload/cpu/test_gpu_worker.py | 392 | CODE | |
| LOW | tests/v1/kv_offload/cpu/test_gpu_worker.py | 576 | CODE | |
| LOW | tests/v1/tracing/test_tracing.py | 22 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 331 | CODE | |
| LOW | tests/v1/attention/test_mla_backends.py | 1309 | CODE | |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 664 | CODE | |
| LOW | tests/v1/attention/test_deepseek_v4_swa_visible.py | 37 | CODE | |
| LOW | tests/v1/attention/test_kpool_tail_slot_mapping.py | 299 | CODE | |
| LOW | tests/v1/logits_processors/test_correctness.py | 293 | CODE | |
| LOW | tests/v1/logits_processors/test_correctness.py | 540 | CODE | |
| LOW | tests/v1/core/test_phrase_scheduler.py | 103 | CODE | |
| LOW | tests/v1/core/test_phrase_scheduler.py | 224 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2797 | CODE | |
| LOW | tests/v1/core/utils.py | 218 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_connector.py | 1767 | CODE | |
| 1235 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | CMakeLists.txt | 1 | cmake_minimum_required(VERSION 3.26) | COMMENT |
| LOW | CMakeLists.txt | 61 | # | COMMENT |
| LOW | CMakeLists.txt | 301 | # setup.py will override FETCHCONTENT_BASE_DIR to play nicely with sccache. | COMMENT |
| LOW | env.py | 281 | return None | COMMENT |
| LOW | env.py | 301 | # Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr | COMMENT |
| LOW | env.py | 321 | # NUMA node1 CPU(s): 32-63,96-127 | COMMENT |
| LOW | env.py | 341 | # Manufacturer=GenuineIntel | COMMENT |
| LOW | config.yaml | 1 | # Sample configuration file for Aphrodite Engine | COMMENT |
| LOW | config.yaml | 21 | COMMENT | |
| LOW | config.yaml | 41 | # at high contexts, but it mutually exclusive with kv_cache_dtype=fp8 | COMMENT |
| LOW | config.yaml | 81 | # The data type to use for the model. Can be `auto`, `float16`, `bfloat16`, | COMMENT |
| LOW | config.yaml | 101 | # Otherwise, KV cache scaling factors default to 1.0, which | COMMENT |
| LOW | config.yaml | 121 | COMMENT | |
| LOW | config.yaml | 141 | speculative_args: | COMMENT |
| LOW | config.yaml | 161 | COMMENT | |
| LOW | config.yaml | 181 | # of draft tokens. Less accurate but faster. | COMMENT |
| LOW | config.yaml | 241 | - max_cpu_loras: | COMMENT |
| LOW | config.yaml | 301 | COMMENT | |
| LOW | config.yaml | 321 | # to the chosen load_format. This should be a JSON string that | COMMENT |
| LOW | formatting.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | csrc/torch_utils.h | 1 | #pragma once | COMMENT |
| LOW | csrc/torch_bindings.cpp | 1 | // Provides torch::Tensor for ops.h (previously included transitively via | COMMENT |
| LOW | csrc/cumem_allocator_compat.h | 101 | } // extern "C" | COMMENT |
| LOW | csrc/cumem_allocator.cpp | 1 | // A CUDAPluggableAllocator based on cumem* APIs. | COMMENT |
| LOW | csrc/cumem_allocator.cpp | 221 | // sleep that discarded a tag) can still contain stale data from a previously | COMMENT |
| LOW | csrc/fs_io.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda_compat.h | 41 | #define APHRODITE_LDG(arg) __ldg(arg) | COMMENT |
| LOW | csrc/cuda_compat.h | 61 | #define APHRODITE_SHFL_SYNC(var, src_lane) __shfl(var, src_lane) | COMMENT |
| LOW | csrc/cuda_utils.h | 1 | #pragma once | COMMENT |
| LOW | csrc/spinloop.cpp | 1 | #include <Python.h> | COMMENT |
| LOW | csrc/attention/attention_dtypes.h | 1 | #pragma once | COMMENT |
| LOW | csrc/hadamard/static_switch.h | 1 | // Inspired by | COMMENT |
| LOW | csrc/core/scalar_type.hpp | 1 | #pragma once | COMMENT |
| LOW | csrc/core/registration.h | 1 | #pragma once | COMMENT |
| LOW | csrc/metal/paged_ops.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/metal/paged_ops.cpp | 741 | // Replaces the Python turbo_quant_encode() + 5 MLX scatters on the hot path. | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 21 | // state_ptr may point to a NON-CONTIGUOUS paged KV cache tensor. | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 81 | } | COMMENT |
| LOW | csrc/cpu/mamba_kernels.hpp | 261 | // | COMMENT |
| LOW | csrc/cpu/cpu_attn_neon.hpp | 1 | #ifndef CPU_ATTN_NEON_HPP | COMMENT |
| LOW | csrc/cpu/utils.cpp | 1 | #ifndef APHRODITE_NUMA_DISABLED | COMMENT |
| LOW | csrc/cpu/cpu_wna16.cpp | 1 | #include "cpu/cpu_types.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_fused_moe.cpp | 1 | #include "cpu/cpu_types.hpp" | COMMENT |
| LOW | csrc/cpu/cpu_types.hpp | 1 | #ifndef CPU_TYPES_HPP | COMMENT |
| LOW | csrc/cpu/cpu_types_riscv.hpp | 1 | #ifndef CPU_TYPES_RISCV_HPP | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 981 | COMMENT | |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1001 | // - kv_cache_num_blocks_stride | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1841 | aligned_actual_kv_tile_pos_right] = | COMMENT |
| LOW | csrc/cpu/cpu_attn_impl.hpp | 1861 | // Move buffers | COMMENT |
| LOW | csrc/cpu/mamba_cpu.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/mamba_cpu.cpp | 121 | if (z.has_value() && z.value().defined()) z_in = ensure_input(z.value()); | COMMENT |
| LOW | csrc/cpu/cpu_attn_vxe.hpp | 381 | } // namespace cpu_attention | COMMENT |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 141 | COMMENT | |
| LOW | csrc/cpu/generate_cpu_attn_dispatch.py | 161 | (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256) | COMMENT |
| LOW | csrc/cpu/cpu_arch_macros.h | 61 | #endif | COMMENT |
| LOW | csrc/cpu/cpu_arch_macros.h | 161 | #include <riscv_vector.h> | COMMENT |
| LOW | csrc/cpu/cpu_attn_amx_fp8.hpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cpu/cpu_attn_amx_fp8.hpp | 21 | // Scale bookkeeping for PV: | COMMENT |
| LOW | csrc/cpu/cpu_attn_amx_fp8.hpp | 41 | // --------------------------------------------------------------------------- | COMMENT |
| 1149 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | build_and_upload_docker.sh | 31 | # Create a temporary container to extract the wheel | COMMENT |
| MEDIUM | tools/install_deepgemm.sh | 84 | # Create a temporary directory for the build | COMMENT |
| MEDIUM | tools/report_build_time_ninja.py | 199 | # Create a list that is in order by time stamp and has entries for the | COMMENT |
| MEDIUM | tests/conftest.py | 577 | # Create a copy to avoid modifying the original dict | COMMENT |
| MEDIUM | tests/utils.py | 764 | # Create a dedicated process group so we can kill | COMMENT |
| MEDIUM | tests/utils.py | 1648 | # Create a unique temporary file to store exception info from child | COMMENT |
| MEDIUM⚡ | tests/test_access_log_filter.py | 257 | # Create a logger with our filter (simulating uvicorn.access) | COMMENT |
| MEDIUM⚡ | tests/test_access_log_filter.py | 264 | # Create a custom handler that tracks messages | COMMENT |
| MEDIUM | tests/test_config.py | 1527 | # Create a new mock and run the method with the same S3 URL | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 247 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 563 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 707 | # Create a CPU tensor | COMMENT |
| MEDIUM | tests/v1/test_tensor_ipc_queue.py | 947 | # Create a tensor queue | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 185 | # Create a sample Python object | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 203 | # Create a sample tensor | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 221 | # Create a sample numpy array | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 305 | # Create a request with a non-multimodal tensor | COMMENT |
| MEDIUM | tests/v1/test_serial_utils.py | 344 | # Create a request with None for the tensor field | COMMENT |
| MEDIUM | tests/v1/metrics/test_ray_metrics.py | 67 | # Create the actor and call the async method | COMMENT |
| MEDIUM | tests/v1/attention/test_mla_backends.py | 555 | # Create a realistic slot mapping that corresponds to the block table | COMMENT |
| MEDIUM | tests/v1/attention/test_mla_backends.py | 1714 | # Create a summary for the single-line failure message | COMMENT |
| MEDIUM | tests/v1/attention/test_attention_backends.py | 213 | # Create a realistic slot mapping that corresponds to the block table | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_correctness.py | 850 | # Define a shuffled batch of requests which individually use a different | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 30 | # Create a mixture of requests which do and don't utilize the dummy logitproc | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 82 | # Create a Aphrodite instance and load custom logitproc | COMMENT |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 89 | # Create a reference Aphrodite instance without custom logitproc | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 356 | # Create a list of KVCacheBlock objects | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 359 | # Create a FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 556 | # Create a list of KVCacheBlock objects | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_kv_cache_utils.py | 559 | # Create a FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 402 | # Create an empty FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 450 | # Create an empty FreeKVCacheBlockQueue | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 501 | # Create an empty FreeKVCacheBlockQueue with these blocks | COMMENT |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 1471 | # Create a AphroditeConfig | STRING |
| MEDIUM | tests/v1/core/test_kv_cache_utils.py | 1505 | # Create a AphroditeConfig | STRING |
| MEDIUM⚡ | tests/v1/core/test_scheduler.py | 3543 | # Create a request and schedule it | COMMENT |
| MEDIUM⚡ | tests/v1/core/test_scheduler.py | 4383 | # Create a request and schedule it (and to be preempted) | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 3570 | # Create a high priority request and schedule it | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 4431 | # Create a high priority request and schedule it | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 5287 | # Create a text-only request (no mm_features). | COMMENT |
| MEDIUM | tests/v1/cudagraph/test_cudagraph_dispatch.py | 56 | # Create a real LoRAConfig with specialize_active_lora enabled | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_nixl_connector.py | 2253 | # Create a request that triggers do_remote_decode so that | COMMENT |
| MEDIUM⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 202 | # Create a mock object that is not LMCacheKVEvents | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_moriio_connector.py | 215 | # Define a fake remote engine id for testing | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 155 | # Create a request with multiple blocks worth of tokens | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 543 | # Create a request | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 565 | # Create a request with just 1 token | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 583 | # Create a request with 2 tokens | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 609 | # Create a request with many blocks | COMMENT |
| MEDIUM | …ts/v1/kv_connector/unit/test_decode_bench_connector.py | 692 | # Create a request that doesn't align to block boundaries | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_nixl_connector_hma.py | 245 | # Create a mock worker with just the required attributes | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_example_connector.py | 144 | # Create the LLM instance | COMMENT |
| MEDIUM | …r/extract_hidden_states_integration/test_extraction.py | 45 | # Create a minimal Llama config with small dimensions | COMMENT |
| MEDIUM | …r/extract_hidden_states_integration/test_extraction.py | 60 | # Create a simple tokenizer | COMMENT |
| MEDIUM | tests/v1/determinism/test_batch_invariance.py | 117 | # Create a batch of size `max_batch_size` and insert the needle at | COMMENT |
| MEDIUM | tests/v1/distributed/test_external_lb_dp.py | 157 | # Create a client for each server | COMMENT |
| MEDIUM | tests/v1/distributed/test_hybrid_lb_dp.py | 182 | # Create a client for each node (each node has its own API endpoint) | COMMENT |
| MEDIUM | tests/v1/streaming_input/test_async_llm_streaming.py | 20 | # Create a minimal mock without initializing the full engine | COMMENT |
| MEDIUM | tests/v1/streaming_input/test_async_llm_streaming.py | 50 | # Create a mock queue with outputs | COMMENT |
| MEDIUM | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 34 | # Create a real InputBatch for e2e testing | COMMENT |
| 246 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | env.py | 256 | except Exception: | CODE |
| LOW | setup.py | 129 | except Exception: | CODE |
| LOW | setup.py | 238 | except Exception as e: | CODE |
| LOW | setup.py | 520 | except Exception: | CODE |
| MEDIUM | setup.py | 121 | def find_tcmalloc() -> Path | None: | CODE |
| MEDIUM | tools/generate_cmake_presets.py | 156 | print(f"Error writing file: {e}") | CODE |
| LOW | tools/install_nixl_from_source_ubuntu.py | 30 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 502 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 516 | except Exception as e: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 584 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 619 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 765 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 963 | except Exception: | CODE |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1201 | except Exception: | CODE |
| LOW | tools/recipes/recipe_json_to_aphrodite_config.py | 856 | except Exception as exc: | CODE |
| LOW | tests/conftest.py | 1329 | except Exception: | CODE |
| LOW | tests/conftest.py | 1592 | except Exception as e: | CODE |
| MEDIUM | tests/utils.py | 118 | def _nvml(): | CODE |
| LOW | tests/utils.py | 81 | except Exception as e: | CODE |
| LOW | tests/utils.py | 315 | except Exception: | CODE |
| LOW | tests/utils.py | 597 | except Exception as e: | CODE |
| LOW | tests/utils.py | 677 | except Exception: | CODE |
| LOW | tests/utils.py | 1677 | except Exception as e: | CODE |
| LOW | tests/utils.py | 1700 | except Exception: | CODE |
| LOW | tests/utils.py | 1891 | except Exception as e: | CODE |
| LOW | tests/utils.py | 2103 | except Exception: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 123 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 166 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 362 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 451 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 491 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 585 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 629 | except Exception as e: | CODE |
| LOW | tests/v1/test_tensor_ipc_queue.py | 782 | except Exception as e: | CODE |
| LOW | tests/v1/utils.py | 62 | except Exception as e: | CODE |
| LOW⚡ | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 218 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 145 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/cpu/test_shared_offload_region.py | 184 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 289 | except Exception as e: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 333 | except Exception as exc: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 344 | except Exception as exc: | CODE |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 364 | except Exception as e: | CODE |
| MEDIUM | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 329 | def _run_decode(): | CODE |
| LOW | tests/v1/shutdown/test_forward_error.py | 73 | except Exception as e: | CODE |
| LOW | tests/v1/shutdown/test_processor_error.py | 42 | except Exception as e: | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_hf3fs_client.py | 28 | except Exception: | CODE |
| LOW | …ts/v1/kv_connector/unit/test_nixl_rocm_gpu_mem_diag.py | 36 | except Exception: | CODE |
| LOW | tests/v1/kv_connector/unit/test_multi_connector.py | 408 | except Exception as e: | CODE |
| LOW | tests/v1/kv_connector/unit/utils.py | 336 | except Exception as e: | CODE |
| LOW | …/v1/kv_connector/unit/test_mooncake_store_connector.py | 831 | except Exception: | CODE |
| LOW | …/v1/kv_connector/unit/test_mooncake_store_connector.py | 868 | except Exception: | CODE |
| LOW | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 233 | except Exception as e: | CODE |
| MEDIUM | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 238 | print(f"Error occurred in disagg prefill proxy server - {api} endpoint") | CODE |
| MEDIUM | …/kv_connector/nixl_integration/test_disagg_accuracy.py | 151 | print(f"Error writing to file: {e}") | CODE |
| MEDIUM | …/kv_connector/nixl_integration/test_disagg_accuracy.py | 160 | print(f"Error writing to file: {e}") | CODE |
| LOW | tests/v1/determinism/test_online_batch_invariance.py | 42 | except Exception as e: # pragma: no cover | CODE |
| LOW | tests/v1/distributed/test_external_lb_dp.py | 88 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_external_lb_dp.py | 115 | except Exception as e: | CODE |
| MEDIUM | tests/v1/distributed/test_external_lb_dp.py | 116 | print(f"Error stopping servers: {e}") | CODE |
| LOW | tests/v1/distributed/test_internal_lb_dp.py | 184 | except Exception as e: | CODE |
| 716 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | setup.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | tests/test_request_input_bounds.py | 202 | def _set_max_n(monkeypatch: pytest.MonkeyPatch, value: int) -> None: | STRING |
| LOW | tests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_multi_connector.py | 123 | def update_state_after_alloc(self, request, blocks, num_tokens) -> None: | CODE |
| LOW | tests/v1/kv_connector/unit/test_multi_connector.py | 90 | def update_state_after_alloc(self, request, blocks, num_tokens) -> None: | CODE |
| LOW⚡ | …/v1/kv_connector/unit/test_handshake_pp_aggregation.py | 137 | def update_state_after_alloc(self, request: Any, blocks: Any, num_external_tokens: int) -> None: | CODE |
| LOW⚡ | …/v1/kv_connector/unit/test_handshake_pp_aggregation.py | 143 | def set_xfer_handshake_metadata(self, metadata: dict[int, KVConnectorHandshakeMetadata]) -> None: | CODE |
| LOW | …/v1/kv_connector/unit/offloading_connector/conftest.py | 7 | __all__ = ["request_runner"] | CODE |
| LOW | …s/v1/kv_connector/nixl_integration/toy_proxy_server.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/v1/worker/test_gpu_worker_weight_transfer.py | 40 | def update_weights(self, update_info: dict) -> None: | CODE |
| LOW | tests/v1/worker/test_gpu_trace_replay.py | 59 | def _set_lens(state: TraceReplayState, total_len, prompt_len) -> None: | CODE |
| LOW | tests/v1/engine/test_core_engine_actor_manager.py | 43 | def _set_visible_devices(self, aphrodite_config: Any, local_dp_rank: int) -> None: | CODE |
| LOW | tests/kernels/moe/test_marlin_vs_trtllm_mxint4.py | 71 | __all__ = [ | CODE |
| LOW | tests/distributed/test_weight_transfer.py | 1144 | def update_weights(self, update_info: dict) -> None: | CODE |
| LOW⚡ | tests/distributed/eplb_utils.py | 73 | def set_env_vars_and_device(env: dict[str, str]) -> None: | CODE |
| LOW | …/aphrodite_test_utils/aphrodite_test_utils/__init__.py | 11 | __all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"] | CODE |
| LOW | tests/models/language/generation/test_hybrid.py | 62 | def _set_conv_state_layout(monkeypatch, layout: str) -> None: | CODE |
| LOW | tests/models/qwen4_exp/test_ple.py | 57 | def _set_test_embedding_weight_loader(embedding) -> None: | CODE |
| LOW | tests/parser/engine/replay_harness.py | 82 | def set_vocab(self, vocab: dict[str, int]) -> None: | CODE |
| LOW | tests/quantization/test_gfx950_moe.py | 39 | def set_rocm_aiter(monkeypatch: pytest.MonkeyPatch, enabled: bool) -> None: | CODE |
| LOW | tests/entrypoints/launchers/test_dp_supervisor.py | 630 | async def _set_healthy(port: int, use_ssl: bool = False) -> None: | CODE |
| LOW | tests/entrypoints/launchers/test_dp_supervisor.py | 640 | async def _set_unhealthy(port: int, use_ssl: bool = False) -> None: | CODE |
| LOW | tests/entrypoints/openai/responses/conftest.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | …/entrypoints/openai/responses/test_parsable_context.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/entrypoints/openai/responses/test_harmony.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/rocm/test_moe_weight_replay.py | 64 | def _set_backend_env(monkeypatch: pytest.MonkeyPatch, backend: str) -> None: | CODE |
| LOW | benchmarks/disagg_benchmarks/nixl_proxy_server.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | …marks/disagg_benchmarks/disagg_prefill_proxy_server.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarks/multi_turn/bench_utils.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | aphrodite/envs.py | 562 | logger = logging.getLogger(__name__) | CODE |
| LOW | aphrodite/env_override.py | 393 | def _update_scheduler_patched(self) -> None: | CODE |
| LOW | aphrodite/sampling_params.py | 829 | def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None: | CODE |
| LOW | aphrodite/__init__.py | 76 | __all__ = [ | CODE |
| LOW | aphrodite/v1/request.py | 263 | def update_block_hashes(self) -> None: | CODE |
| LOW | aphrodite/v1/kv_offload/base.py | 98 | def set_state(self, val: Any) -> None: | CODE |
| LOW | aphrodite/v1/kv_offload/tiering/example/manager.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | aphrodite/v1/kv_offload/tiering/p2p/data/__init__.py | 6 | __all__ = [ | CODE |
| LOW | aphrodite/v1/kv_offload/tiering/p2p/control/__init__.py | 12 | __all__ = [ | CODE |
| LOW | aphrodite/v1/kv_offload/tiering/p2p/session/__init__.py | 11 | __all__ = [ | CODE |
| LOW | aphrodite/v1/kv_offload/tiering/fs/io.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | aphrodite/v1/metrics/stats.py | 402 | def update_from_output(self, prefill_stats: PrefillStats) -> None: | CODE |
| LOW | aphrodite/v1/attention/backend.py | 600 | def set_kernel_block_size(self, kernel_block_size: int) -> None: | CODE |
| LOW | aphrodite/v1/attention/backend.py | 701 | def update_draft_decode_metadata(self, metadata: M) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/flash_attn.py | 772 | def update_draft_decode_metadata(self, metadata: FlashAttentionMetadata) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/triton_attn.py | 260 | def update_draft_decode_metadata(self, _metadata: TritonAttentionMetadata) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/flash_attn_diffkv.py | 40 | def set_head_size_v(cls, head_size_v: int) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/triton_attn_diffkv.py | 80 | def set_head_size_v(cls, head_size_v: int) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/cpu_attn.py | 166 | def _set_isa_to_layers(self, layer_names: list[str]) -> None: | CODE |
| LOW⚡ | aphrodite/v1/attention/backends/mla/triton_mla.py | 97 | def update_draft_decode_metadata(self, _metadata: MLACommonMetadata) -> None: | CODE |
| LOW | aphrodite/v1/attention/backends/mla/prefill/__init__.py | 10 | __all__ = [ | CODE |
| LOW | aphrodite/v1/attention/ops/triton_decode_attention.py | 42 | logger = logging.getLogger(__name__) | CODE |
| LOW | aphrodite/v1/core/kv_cache_utils.py | 2156 | def update_kv_cache_capacity(aphrodite_config: AphroditeConfig, kv_cache_config: KVCacheConfig) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/async_scheduler.py | 19 | def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/interface.py | 110 | def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None: | CODE |
| LOW | aphrodite/v1/core/sched/interface.py | 203 | def set_pause_state(self, pause_state: PauseState) -> None: | CODE |
| LOW⚡ | aphrodite/v1/core/sched/scheduler.py | 2583 | def _update_waiting_for_remote_kv(self, request: Request) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/scheduler.py | 1335 | def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/scheduler.py | 1382 | def _update_request_as_session(self, session: Request, update: StreamingUpdate) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/scheduler.py | 2113 | def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None: | CODE |
| LOW | aphrodite/v1/core/sched/scheduler.py | 2305 | def set_pause_state(self, pause_state: PauseState) -> None: | CODE |
| 466 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tools/pre_commit/enforce_regex_import.py | 41 | except (OSError, UnicodeDecodeError): | CODE |
| HIGH | tools/pre_commit/generate_attention_backend_docs.py | 502 | except Exception: | CODE |
| HIGH | tests/utils.py | 433 | except subprocess.TimeoutExpired: | CODE |
| HIGH | tests/utils.py | 531 | except (ProcessLookupError, OSError): | CODE |
| HIGH | …1/kv_connector/unit/test_invalid_blocks_correctness.py | 251 | except KeyError: | CODE |
| HIGH | …_connector/nixl_integration/nixl_side_channel_probe.py | 28 | except ValueError: | CODE |
| HIGH | …worker/test_gpu_model_runner_v2_cudagraph_profiling.py | 182 | except RuntimeError: | CODE |
| HIGH | tests/v1/engine/test_abort_final_step.py | 80 | except Exception: | CODE |
| HIGH | tests/kernels/moe/modular_kernel_tools/common.py | 324 | except NotImplementedError: | CODE |
| HIGH | tests/kernels/moe/modular_kernel_tools/common.py | 191 | except NotImplementedError: | CODE |
| HIGH | tests/distributed/test_mnnvl_alltoall.py | 39 | except Exception: | CODE |
| HIGH | tests/distributed/test_multiproc_executor.py | 471 | except Exception: | CODE |
| HIGH | …s/aphrodite_test_utils/aphrodite_test_utils/monitor.py | 61 | except NameError: | CODE |
| HIGH | …sts/aphrodite_test_utils/aphrodite_test_utils/blame.py | 47 | except NameError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 86 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 125 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 313 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 353 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 448 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 512 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 591 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 660 | except ValueError: | CODE |
| HIGH | tests/models/language/generation/test_hybrid.py | 739 | except ValueError: | CODE |
| HIGH | tests/compile/fusions_e2e/common.py | 67 | except ImportError: | CODE |
| HIGH | tests/compile/fusions_e2e/common.py | 78 | except ImportError: | CODE |
| HIGH | …transcription/test_transcription_validation_whisper.py | 48 | except Exception: | CODE |
| HIGH | tests/entrypoints/launchers/test_shutdown.py | 239 | except asyncio.TimeoutError: | CODE |
| HIGH | tests/entrypoints/launchers/test_shutdown.py | 408 | except asyncio.TimeoutError: | CODE |
| HIGH | tests/entrypoints/launchers/test_shutdown.py | 525 | except asyncio.TimeoutError: | CODE |
| HIGH | tests/entrypoints/launchers/test_shutdown.py | 57 | except psutil.NoSuchProcess: | CODE |
| HIGH | tests/entrypoints/serve/dev/rlhf/conftest.py | 159 | except Exception: | CODE |
| HIGH | …ts/serve/sagemaker/test_sagemaker_handler_overrides.py | 112 | except ImportError: | CODE |
| HIGH | tests/lora/test_layers.py | 122 | except Exception: | CODE |
| HIGH | tests/basic_correctness/test_basic_correctness.py | 65 | except Exception: | CODE |
| HIGH | examples/fp8/extract_scales.py | 225 | except KeyError: | CODE |
| HIGH | examples/fp8/extract_scales.py | 231 | except ValueError: | CODE |
| HIGH | examples/rl/rdt_aphrodite_serve.py | 109 | except requests.RequestException: | CODE |
| HIGH | aphrodite/env_override.py | 794 | except ImportError: | CODE |
| HIGH | aphrodite/env_override.py | 520 | except Exception: | CODE |
| HIGH | aphrodite/logger.py | 284 | except NameError: | CODE |
| HIGH | aphrodite/v1/attention/backends/turboquant_attn.py | 473 | except Exception: # noqa: BLE001 | CODE |
| HIGH | aphrodite/v1/attention/backends/cpu_attn.py | 452 | except Exception: | CODE |
| HIGH | aphrodite/v1/attention/backends/fa_utils.py | 298 | except (ImportError, AssertionError): | CODE |
| HIGH | aphrodite/v1/attention/ops/flydsl_turboquant_decode.py | 163 | except Exception: # noqa: BLE001 | CODE |
| HIGH | aphrodite/v1/spec_decode/vocab_mapping.py | 29 | except Exception: | CODE |
| HIGH | aphrodite/v1/engine/async_llm.py | 190 | except RuntimeError: | CODE |
| HIGH | aphrodite/v1/engine/core_client.py | 1032 | except RuntimeError: | CODE |
| HIGH | aphrodite/v1/engine/core_client.py | 1287 | except RuntimeError: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v4_tool_parser.py | 284 | except Exception: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v4_tool_parser.py | 288 | except Exception: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v4_tool_parser.py | 329 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | aphrodite/tool_parsers/hunyuan_a13b_tool_parser.py | 197 | except json.JSONDecodeError: | CODE |
| HIGH | aphrodite/tool_parsers/apertus_tool_parser.py | 342 | except Exception: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v3_tool_parser.py | 195 | except Exception: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v3_tool_parser.py | 199 | except Exception: | CODE |
| HIGH | aphrodite/tool_parsers/hy_v3_tool_parser.py | 242 | except (json.JSONDecodeError, ValueError): | CODE |
| HIGH | aphrodite/tool_parsers/poolside_v1_tool_parser.py | 102 | except json.JSONDecodeError: | CODE |
| HIGH | aphrodite/tool_parsers/poolside_v1_tool_parser.py | 107 | except (ValueError, SyntaxError): | CODE |
| HIGH | aphrodite/tool_parsers/xlam_tool_parser.py | 233 | except json.JSONDecodeError: | CODE |
| HIGH | aphrodite/tool_parsers/xlam_tool_parser.py | 427 | except (json.JSONDecodeError, KeyError, IndexError): | CODE |
| 42 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/conftest.py | 382 | CODE | |
| LOW | tests/conftest.py | 420 | CODE | |
| LOW | tests/conftest.py | 927 | CODE | |
| LOW | tests/v1/kv_offload/test_factory.py | 41 | CODE | |
| LOW | tests/v1/kv_offload/tiering/p2p/test_manager.py | 596 | CODE | |
| LOW | tests/v1/attention/utils.py | 174 | CODE | |
| LOW | tests/v1/attention/test_attention_backends.py | 370 | CODE | |
| LOW | tests/v1/core/test_kv_cache_utils.py | 131 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2676 | CODE | |
| LOW | tests/v1/core/test_scheduler.py | 2797 | CODE | |
| LOW | tests/v1/core/utils.py | 51 | CODE | |
| LOW | tests/v1/core/utils.py | 218 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_tp_mapping.py | 32 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_connector.py | 2788 | CODE | |
| LOW | …sts/v1/kv_connector/unit/test_mooncake_store_worker.py | 133 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_moriio_connector.py | 231 | CODE | |
| LOW | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 368 | CODE | |
| LOW | tests/v1/kv_connector/unit/utils.py | 77 | CODE | |
| LOW | tests/v1/kv_connector/unit/utils.py | 179 | CODE | |
| LOW | …/kv_connector/unit/offloading_connector/test_config.py | 288 | CODE | |
| LOW | tests/v1/sample/test_rejection_sampler.py | 65 | CODE | |
| LOW | tests/v1/e2e/general/test_mamba_prefix_cache.py | 163 | CODE | |
| LOW | tests/v1/simple_kv_offload/test_kv_events.py | 140 | CODE | |
| LOW | tests/kernels/test_gate_linear_rocm_dispatch.py | 21 | CODE | |
| LOW | tests/kernels/utils.py | 327 | CODE | |
| LOW | tests/kernels/utils.py | 870 | CODE | |
| LOW | tests/kernels/attention/test_mha_attn.py | 125 | CODE | |
| LOW | tests/kernels/attention/test_attention.py | 54 | CODE | |
| LOW | …sts/kernels/attention/test_triton_prefill_attention.py | 71 | CODE | |
| LOW | tests/kernels/mamba/test_mamba_ssm.py | 112 | CODE | |
| LOW | tests/kernels/mamba/utils.py | 73 | CODE | |
| LOW | tests/kernels/quantization/test_nvfp4_quant.py | 81 | CODE | |
| LOW | tests/kernels/moe/test_deepep_v2_moe.py | 190 | CODE | |
| LOW | tests/kernels/moe/test_moe_permute_unpermute.py | 104 | CODE | |
| LOW | tests/kernels/moe/test_moe.py | 2036 | CODE | |
| LOW | tests/kernels/moe/utils.py | 56 | CODE | |
| LOW | tests/kernels/moe/utils.py | 116 | CODE | |
| LOW | tests/kernels/moe/test_moe_layer.py | 1009 | CODE | |
| LOW | tests/kernels/moe/test_moe_layer.py | 1108 | CODE | |
| LOW | tests/evals/mrcr/mrcr_eval.py | 159 | CODE | |
| LOW | tests/evals/gsm8k/gsm8k_eval.py | 204 | CODE | |
| LOW | tests/distributed/test_multiproc_executor.py | 70 | CODE | |
| LOW | tests/models/kimi_k3/test_kda_metadata.py | 83 | CODE | |
| LOW | …/models/multimodal/generation/vlm_utils/model_utils.py | 522 | CODE | |
| LOW | tests/models/transformers/fusers/test_moe.py | 186 | CODE | |
| LOW | tests/quantization/reference_mxfp4.py | 76 | CODE | |
| LOW | tests/quantization/reference_mxfp4.py | 211 | CODE | |
| LOW | tests/compile/test_graph_partition.py | 96 | CODE | |
| LOW | tests/compile/fullgraph/test_toy_llama.py | 151 | CODE | |
| LOW | tests/compile/passes/test_silu_mul_quant_fusion.py | 128 | CODE | |
| LOW | tests/compile/passes/test_fusion.py | 466 | CODE | |
| LOW | tests/benchmarks/test_random_dataset.py | 171 | CODE | |
| LOW | tests/entrypoints/cohere/test_serving_streaming.py | 76 | CODE | |
| LOW | tests/entrypoints/cohere/test_serving_conversion.py | 120 | CODE | |
| LOW | tests/entrypoints/openai/utils.py | 135 | CODE | |
| LOW | examples/pooling/token_embed/jina_reranker_v3_online.py | 22 | CODE | |
| LOW | benchmarks/attention_benchmarks/mla_runner.py | 109 | CODE | |
| LOW | benchmarks/kernels/benchmark_mrope.py | 78 | CODE | |
| LOW | aphrodite/sampling_params.py | 460 | CODE | |
| LOW | aphrodite/_custom_ops.py | 3045 | CODE | |
| 337 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/install_torchcodec_rocm.sh | 19 | # Check if torchcodec is already installed and working | COMMENT |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 525 | # Check if this is an MLA backend by parent class or naming | COMMENT |
| LOW | tools/pre_commit/generate_attention_backend_docs.py | 1218 | # Check if this is the "if use_mla:" branch | COMMENT |
| LOW | tests/conftest.py | 396 | # Set this to avoid hanging issue | COMMENT |
| LOW | tests/conftest.py | 943 | # Set this to avoid hanging issue | COMMENT |
| LOW | tests/utils.py | 529 | os.kill(spid, 0) # Check if still alive | CODE |
| LOW | tests/test_config.py | 1304 | # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_config | COMMENT |
| LOW | tests/v1/attention/test_mla_backends.py | 1390 | # Set num_speculative_tokens to query_len - 1 | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 736 | # Set some to -1 to test masking | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 740 | # Set some to out of bounds | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 792 | # Set some to -1 to test masking | COMMENT |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 796 | # Set some to out of bounds | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 2857 | # Verify if position length is identical | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 3792 | # Check if scheduled_encoder_inputs is empty as expected | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 4210 | # Set up to test different encoder cache existence scenario after preemption | COMMENT |
| LOW | tests/v1/core/test_scheduler.py | 4518 | # Set up to test different encoder cache existence scenario after preemption | COMMENT |
| LOW | tests/v1/core/utils.py | 269 | # Verify if position length is identical | COMMENT |
| LOW | …extract_hidden_states_integration/predictable_llama.py | 81 | # Check if we need auxiliary hidden states | COMMENT |
| LOW | …nnector/nixl_integration/config_sweep_accuracy_test.sh | 99 | # Check if cross-layers is enabled (non-empty) | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 284 | # Check if tokens match first | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 540 | # Check if tokens match first | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 752 | # Check if tokens match | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 770 | # Check if logprobs match bitwise | COMMENT |
| LOW | tests/v1/spec_decode/test_acceptance_length.py | 108 | # Check if get_valid_backends is actually defined in the platform class | COMMENT |
| LOW | …1/ec_connector/integration/run_epd_correctness_test.sh | 28 | # Set 1 to use multimodal prompts; else to use text-only | COMMENT |
| LOW | …ts/v1/ec_connector/integration/test_epd_correctness.py | 217 | # Check if server is ready | COMMENT |
| LOW | tests/v1/e2e/spec_decode/draft_model/test_async.py | 34 | # Increment counter | COMMENT |
| LOW | tests/v1/engine/test_engine_core_client.py | 422 | # Check if all request IDs in outputs have finished | COMMENT |
| LOW | tests/v1/engine/utils.py | 131 | # Check if the sampled_token_id occurs in choice_tensor[1:] | COMMENT |
| LOW | tests/utils_/test_network_utils.py | 182 | # Check if IPv6 is supported by trying to create an IPv6 socket | COMMENT |
| LOW | …/kernels/quantization/test_rocm_aiter_grouped_quant.py | 21 | # Check if aiter package is installed | COMMENT |
| LOW | tests/kernels/moe/test_moe_layer.py | 1924 | # Check if enough GPUs available | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 26 | # Check if aiter package is installed | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 35 | # Check if the op exists in torch.ops.aphrodite | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 38 | # Check if the op is callable | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 44 | # Check if the op exists in torch.ops.aphrodite | COMMENT |
| LOW⚡ | tests/kernels/moe/test_rocm_aiter_topk.py | 47 | # Check if the op is callable | COMMENT |
| LOW | tests/evals/gsm8k/gsm8k_eval.py | 359 | # Print results to terminal | COMMENT |
| LOW | tests/distributed/test_eplb_execute.py | 146 | # Check if the weights are correct | COMMENT |
| LOW | tests/model_executor/test_qwen3_omni.py | 33 | # Check if it's a special token that should be compressed | COMMENT |
| LOW | …model_loader/runai_streamer_loader/test_runai_utils.py | 56 | # Read the file in chunks to handle large files efficiently | COMMENT |
| LOW⚡ | tests/models/multimodal/generation/test_maverick.py | 59 | # Print the outputs | COMMENT |
| LOW | tests/quantization/test_gptq_v2.py | 43 | # Check if gptq_v2 format is correctly loaded | COMMENT |
| LOW | tests/quantization/test_gptq_v2.py | 105 | # Print the output sequences if failed | COMMENT |
| LOW⚡ | tests/multimodal/media/test_audio.py | 139 | # Set limit to 1 MiB — should reject | COMMENT |
| LOW | tests/compile/test_config.py | 54 | # Check if get_raw_stream exists in builtins | COMMENT |
| LOW | tests/compile/fusions_e2e/conftest.py | 42 | # Print the outputs. | COMMENT |
| LOW | tests/compile/fullgraph/test_full_graph.py | 173 | # Print the outputs. | COMMENT |
| LOW | tests/entrypoints/llm/offline_mode/test_offline_mode.py | 75 | # Set HF to offline mode and ensure we can still construct an LLM | COMMENT |
| LOW | tests/entrypoints/llm/offline_mode/test_offline_mode.py | 143 | # Set HF to offline mode and ensure we can still construct an LLM | COMMENT |
| LOW | tests/entrypoints/launchers/test_shutdown.py | 99 | # Check if any choice has finish_reason='abort' | COMMENT |
| LOW | tests/entrypoints/serve/utils/test_request_logger.py | 94 | # Set max_log_len to 10 | COMMENT |
| LOW | …rve/sagemaker/test_sagemaker_middleware_integration.py | 314 | # Check if environment variable middleware was applied | COMMENT |
| LOW | tests/lora/test_transformers_model.py | 39 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_gptoss_tp.py | 80 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_qwen3moe_tp.py | 55 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_chatglm3_tp.py | 38 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_deepseekv2_tp.py | 28 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_minicpmv_tp.py | 51 | # Print the outputs. | COMMENT |
| LOW | tests/lora/test_mixtral.py | 21 | # Print the outputs. | COMMENT |
| 165 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | csrc/cpu/generate_cpu_attn_dispatch.py | 161 | (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256) | CODE |
| HIGH | csrc/cpu/generate_cpu_attn_dispatch.py | 235 | "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)", | CODE |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 490 | "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 493 | "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 494 | "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 497 | "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 498 | "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 499 | "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 502 | "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 503 | "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)), | STRING |
| HIGH⚡ | csrc/libtorch_stable/quantization/machete/generate.py | 506 | "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)), | STRING |
| HIGH | tests/v1/attention/test_mm_prefix.py | 409 | # null, so is_mm_prefix_lm is False out of the box. Tests that exercise the | COMMENT |
| HIGH | tests/v1/attention/test_mla_backends.py | 534 | # Permute the context blocks (excluding block 0 which is null) | COMMENT |
| HIGH | tests/v1/attention/test_attention_backends.py | 190 | # Permute the context blocks (excluding block 0 which is null) | COMMENT |
| HIGH⚡ | tests/v1/core/test_scheduler.py | 3534 | num_blocks=5, # Can hold 64 tokens (first block is null) | CODE |
| HIGH⚡ | tests/v1/core/test_scheduler.py | 4373 | num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null) | CODE |
| HIGH | tests/v1/core/test_scheduler.py | 4600 | num_blocks=11, # Can hold 160 tokens (first block is null) | CODE |
| HIGH | …_connector/unit/offloading_connector/test_scheduler.py | 3286 | # 4 GPU blocks: block 0 is null, blocks 1-3 are usable. | COMMENT |
| HIGH | …_connector/unit/offloading_connector/test_scheduler.py | 269 | are similar -- neither is required to retain the whole prefix, so a non-null, | STRING |
| HIGH | tests/tool_parsers/test_granite_tool_parser.py | 41 | "null_field": null, | CODE |
| HIGH | tests/tool_parsers/test_granite_20b_fc_tool_parser.py | 33 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 34 | "role=null, " | CODE |
| HIGH⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 43 | '"role": null, ' | CODE |
| HIGH⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 35 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_deepseekv3_tool_parser.py | 41 | """"bool_field": true, "null_field": null, """ | STRING |
| HIGH | tests/tool_parsers/test_internlm2_tool_parser.py | 54 | "null_field": null, | CODE |
| HIGH | tests/tool_parsers/test_llama4_pythonic_tool_parser.py | 35 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_phi4mini_tool_parser.py | 49 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 38 | '"role": null, ' | CODE |
| HIGH | tests/tool_parsers/test_lfm2_tool_parser.py | 73 | "bash(command='cd /testbed && python3 -c \"from sympy import latex\nprint(latex(3*x, mul_symbol='\\,'))\"')" | CODE |
| HIGH | tests/tool_parsers/test_lfm2_tool_parser.py | 78 | '{"command": "cd /testbed && python3 -c \\"from sympy import latex\\n' | CODE |
| HIGH | tests/tool_parsers/test_longcat_tool_parser.py | 53 | "null_field": null, | CODE |
| HIGH⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 41 | '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name": | CODE |
| HIGH | tests/tool_parsers/test_qwen3coder_tool_parser.py | 570 | # Multi non-null: anyOf[string, integer, null] → first non-null is string | COMMENT |
| HIGH⚡ | tests/parser/engine/test_qwen3.py | 257 | ' "multiSelect": false, "answer": null}]' | CODE |
| HIGH⚡ | tests/parser/engine/test_qwen3.py | 267 | "questions": '[{"question": "Pick a color", "multiSelect": false, "answer": null}]', | CODE |
| HIGH⚡ | tests/parser/engine/test_qwen3.py | 1042 | ' "multiSelect": false, "answer": null}]' | CODE |
| HIGH | tests/parser/engine/test_qwen3.py | 1061 | ' "multiSelect": false, "answer": null}]', | CODE |
| HIGH⚡ | tests/parser/engine/test_parser_engine.py | 599 | result = engine._fix_arg_types('{"val": null}', "f") | CODE |
| HIGH⚡ | tests/parser/engine/test_gemma4_streaming_reasoning.py | 1202 | text = "<|tool_call>call:configure{value:null}<tool_call|>" | CODE |
| HIGH⚡ | tests/parser/engine/test_gemma4_streaming_reasoning.py | 1208 | text = "<|tool_call>call:configure{label:null}<tool_call|>" | CODE |
| HIGH⚡ | tests/parser/mistral/test_tool_calls.py | 2402 | _REAL_LEAK_CONTENT = 'bash[TOOL_CALLS]{"command": "cd /testbed && git diff xarray/core/weighted.py"}ometracediff --git a | CODE |
| HIGH⚡ | tests/parser/mistral/test_tool_calls.py | 2415 | {"command": "cd /testbed && git diff xarray/core/weighted.py"} | CODE |
| HIGH⚡ | tests/entrypoints/unit_tests/test_chat_utils.py | 3015 | bad = '{"cmd": "mkdir -p /tmp/mmadtest && cat > /tmp/mmadtest' | CODE |
| HIGH | …e_out/token_in_token_out/test_return_routed_experts.py | 36 | '{"sliding_window": null}', | CODE |
| HIGH | tests/entrypoints/openai/test_return_routed_experts.py | 45 | '{"sliding_window": null}', | CODE |
| HIGH | aphrodite/_custom_ops.py | 2221 | assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)" | CODE |
| HIGH | aphrodite/_custom_ops.py | 2326 | assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)" | CODE |
| HIGH | aphrodite/_custom_ops.py | 2203 | input_tensor: The input tensor with gate || up layout [m_topk, k*2] | STRING |
| HIGH | aphrodite/v1/core/single_type_kv_cache_manager.py | 1231 | # result [null] [null] ... [null] [hit block 1 (1st block contain | COMMENT |
| HIGH | aphrodite/v1/core/single_type_kv_cache_manager.py | 470 | every (non-null) block — the default for full attention. | STRING |
| HIGH | aphrodite/v1/core/single_type_kv_cache_manager.py | 1184 | [null, null, block 3], otherwise, we return [null, null] | STRING |
| HIGH | aphrodite/v1/core/single_type_kv_cache_manager.py | 1189 | we return 4 blocks[null, null, null, null] | STRING |
| HIGH | aphrodite/tool_parsers/utils.py | 433 | (null, true, false) that some models produce instead of Python | STRING |
| HIGH | aphrodite/metal/mlx_backend/mla_cache.py | 11 | Each token's cache entry is a combined latent vector [kv_norm || k_pe]: | STRING |
| HIGH | aphrodite/metal/paged_attention_backend/mla.py | 29 | latent = [kv_norm || k_pe_roped] # kv_lora_rank + qk_rope_head_dim dims | STRING |
| HIGH | …ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py | 47 | cd FlexKV && bash build.sh | STRING |
| HIGH | …d/kv_transfer/kv_connector/v1/mooncake/store/worker.py | 204 | raise TypeError(f"tenant_id must be a string or null, got {type(value).__name__}: {value!r}") | CODE |
| HIGH | …transfer/kv_connector/v1/mooncake/store/coordinator.py | 211 | blocks in place), so a positional read may hit a null, freed, or live | STRING |
| HIGH | aphrodite/benchmarks/datasets/datasets.py | 3971 | # undefined), language (en), transcription directive (en), punctuation | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | build_and_upload_docker.sh | 23 | # Step 1: Build the wheel | COMMENT |
| LOW⚡ | build_and_upload_docker.sh | 39 | # Step 2: Build the final Docker image using the wheel | COMMENT |
| LOW⚡ | build_and_upload_docker.sh | 47 | # Step 3: Tag and push the Docker image | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 183 | # Step 1: lookup key 1, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 189 | # Step 2: lookup keys 2 and 3, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 836 | # Step 1: probe hA, hB. | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 846 | # Step 2: a new key is discovered for the same request. The | COMMENT |
| LOW | tests/v1/logits_processors/test_correctness.py | 1221 | # Step 1: think-start token appears. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5742 | # Step 1: A's load is admitted; B's is held back by the reservation (B never | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5752 | # Step 2: nothing changes until A's recv lands. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5761 | # Step 3: A makes forward progress straight to RUNNING - no preemption was | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 551 | # Step 1: Get events from lmcache engine | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 558 | # Step 2: Update connector output (simulate receiving from worker) | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 564 | # Step 3: Take events | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 401 | # Step 2: 5 blocks are in use (2 new for remote blocks). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 409 | # Step 3: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 418 | # Step 4: try to schedule, remote request is put to running list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 426 | # Step 5: Remote request will be put back to waiting list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 434 | # Step 6: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 441 | # Step 7: now we can schedule (with 2 blocks computed), | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 511 | # Step 3: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 518 | # Step 4: now we can initiate KV transfer (with 2 blocks computed). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 526 | # Step 5: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 533 | # Step 6: schedule remote request | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 540 | # Step 7: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 457 | # Step 8: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 500 | # Step 2: 3 blocks are in use, | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 679 | # Step 1: Run decode and collect logprobs | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 695 | # Step 2: For each token position, run prefill and compare | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 371 | # Step 2: Schedule creates NewRequestData | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 381 | # Step 3: Simulate model runner caching the prompt_token_ids | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 434 | # Step 7: Schedule again - now request uses cached state | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 442 | # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 does | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 495 | # Step 12: Add new streaming request with seq_id=1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 410 | # Step 6: Verify request state after Cycle 1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 474 | # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQ | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 507 | # Step 13: Scheduler schedules the updated session | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 520 | # Step 14: Model runner caches NEW prompt_token_ids reference | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 531 | # Step 15: FINAL CRITICAL VERIFICATION | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 86 | # Step 1: Add initial request with 3 prompt tokens, all computed | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 102 | # Step 2: Create streaming update with extended prompt | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 118 | # Step 3: Verify no free_indices leak (old slot recycled) | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 155 | # Step 1: Add initial request with one audio feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 175 | # Step 2: Create streaming update with additional multimodal feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 192 | # Step 3: Verify no free_indices leak | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 61 | # Step 1: Create initial request state with some computed tokens | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 79 | # Step 2: Create new request data with extended prompt | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 98 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 101 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 131 | # Step 1: Create initial request state with one multimodal feature | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 156 | # Step 2: Create new request data with additional multimodal feature | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 176 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 179 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 123 | # Step 1: unseen remote item -> read started, request deferred. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 133 | # Step 2: poll drains completion -> entry marked ready, request admitted. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 170 | # Step 1: start the read. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 178 | # Step 2: poll discards the entry and records a tombstone; the tombstone | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 185 | # Step 3: tombstone was consumed, so a fresh transfer starts again. | COMMENT |
| LOW | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 146 | # Step 3: still cached -> admitted directly, no new transfer. | COMMENT |
| LOW⚡ | tests/v1/ec_connector/integration/README.md | 61 | ### Step 1: Baseline | COMMENT |
| 108 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | build_and_upload_docker.sh | 23 | # Step 1: Build the wheel | COMMENT |
| LOW⚡ | build_and_upload_docker.sh | 39 | # Step 2: Build the final Docker image using the wheel | COMMENT |
| LOW⚡ | build_and_upload_docker.sh | 47 | # Step 3: Tag and push the Docker image | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 183 | # Step 1: lookup key 1, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/test_async_lookup.py | 189 | # Step 2: lookup keys 2 and 3, flush | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 836 | # Step 1: probe hA, hB. | COMMENT |
| LOW⚡ | tests/v1/kv_offload/tiering/p2p/test_sessions.py | 846 | # Step 2: a new key is discovered for the same request. The | COMMENT |
| LOW | tests/v1/logits_processors/test_correctness.py | 1221 | # Step 1: think-start token appears. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5742 | # Step 1: A's load is admitted; B's is held back by the reservation (B never | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5752 | # Step 2: nothing changes until A's recv lands. | COMMENT |
| LOW⚡ | tests/v1/core/test_scheduler.py | 5761 | # Step 3: A makes forward progress straight to RUNNING - no preemption was | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 551 | # Step 1: Get events from lmcache engine | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 558 | # Step 2: Update connector output (simulate receiving from worker) | COMMENT |
| LOW⚡ | tests/v1/kv_connector/unit/test_lmcache_connector.py | 564 | # Step 3: Take events | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 401 | # Step 2: 5 blocks are in use (2 new for remote blocks). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 409 | # Step 3: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 418 | # Step 4: try to schedule, remote request is put to running list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 426 | # Step 5: Remote request will be put back to waiting list | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 434 | # Step 6: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 441 | # Step 7: now we can schedule (with 2 blocks computed), | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 511 | # Step 3: finish the request, free it. | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 518 | # Step 4: now we can initiate KV transfer (with 2 blocks computed). | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 526 | # Step 5: finish recving (5 blocks in use) | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 533 | # Step 6: schedule remote request | COMMENT |
| LOW⚡ | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 540 | # Step 7: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 457 | # Step 8: free everything. | COMMENT |
| LOW | …/v1/kv_connector/unit/test_remote_prefill_lifecycle.py | 500 | # Step 2: 3 blocks are in use, | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 679 | # Step 1: Run decode and collect logprobs | COMMENT |
| LOW | tests/v1/determinism/test_batch_invariance.py | 695 | # Step 2: For each token position, run prefill and compare | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 371 | # Step 2: Schedule creates NewRequestData | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 381 | # Step 3: Simulate model runner caching the prompt_token_ids | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 434 | # Step 7: Schedule again - now request uses cached state | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 442 | # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 does | COMMENT |
| LOW⚡ | tests/v1/streaming_input/test_scheduler_streaming.py | 495 | # Step 12: Add new streaming request with seq_id=1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 410 | # Step 6: Verify request state after Cycle 1 | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 474 | # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQ | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 507 | # Step 13: Scheduler schedules the updated session | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 520 | # Step 14: Model runner caches NEW prompt_token_ids reference | COMMENT |
| LOW | tests/v1/streaming_input/test_scheduler_streaming.py | 531 | # Step 15: FINAL CRITICAL VERIFICATION | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 86 | # Step 1: Add initial request with 3 prompt tokens, all computed | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 102 | # Step 2: Create streaming update with extended prompt | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 118 | # Step 3: Verify no free_indices leak (old slot recycled) | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 155 | # Step 1: Add initial request with one audio feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 175 | # Step 2: Create streaming update with additional multimodal feature | COMMENT |
| LOW | …/streaming_input/test_gpu_model_runner_v2_streaming.py | 192 | # Step 3: Verify no free_indices leak | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 61 | # Step 1: Create initial request state with some computed tokens | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 79 | # Step 2: Create new request data with extended prompt | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 98 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 101 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 131 | # Step 1: Create initial request state with one multimodal feature | COMMENT |
| LOW | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 156 | # Step 2: Create new request data with additional multimodal feature | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 176 | # Step 3: Update the request | COMMENT |
| LOW⚡ | …/v1/streaming_input/test_gpu_model_runner_streaming.py | 179 | # Step 4: Verify the request state was updated correctly | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 123 | # Step 1: unseen remote item -> read started, request deferred. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 133 | # Step 2: poll drains completion -> entry marked ready, request admitted. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 170 | # Step 1: start the read. | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 178 | # Step 2: poll discards the entry and records a tombstone; the tombstone | COMMENT |
| LOW⚡ | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 185 | # Step 3: tombstone was consumed, so a fresh transfer starts again. | COMMENT |
| LOW | …s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py | 146 | # Step 3: still cached -> admitted directly, no new transfer. | COMMENT |
| LOW⚡ | …1/ec_connector/integration/run_epd_correctness_test.sh | 487 | # Step 1: Run baseline | COMMENT |
| 92 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | benchmarks/benchmark_long_document_qa_throughput.py | 70 | Repeat each prompt in the list for a specified number of times. The order of prompts in the output list depends | STRING |
| HIGH | aphrodite/_xpu_ops.py | 284 | XPU FP8 batched GEMM implementation for ``torch.ops.aphrodite.xpu_fp8_bmm``. Computes batched matrix multiplication | STRING |
| HIGH | aphrodite/v1/kv_offload/tiering/factory.py | 59 | Get a secondary tier class by type. Args: tier_config: Tier configuration dict. Must contain 'type' | STRING |
| HIGH | aphrodite/v1/attention/backends/registry.py | 212 | Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register | STRING |
| HIGH | aphrodite/v1/attention/backends/mla/prefill/registry.py | 91 | Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum member | STRING |
| HIGH | aphrodite/v1/core/single_type_kv_cache_manager.py | 1171 | For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lon | STRING |
| HIGH | aphrodite/v1/structured_output/utils.py | 387 | Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: | STRING |
| HIGH | aphrodite/v1/structured_output/utils.py | 419 | Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/ | STRING |
| HIGH | aphrodite/v1/worker/utils.py | 314 | Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_mana | STRING |
| HIGH | aphrodite/tool_parsers/hy_v4_tool_parser.py | 91 | Detect the per-checkpoint suffix used by Hunyuan structural tokens. Args: tokenizer: Tokenizer of the serve | STRING |
| HIGH | aphrodite/tool_parsers/apertus_tool_parser.py | 134 | Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunk | STRING |
| HIGH | aphrodite/tool_parsers/apertus_tool_parser.py | 178 | Extracts tool calls from a completely generated model response (Non-Streaming). Args: mode | STRING |
| HIGH | aphrodite/tool_parsers/apertus_tool_parser.py | 274 | Handles streaming chunks Args: previous_text: The complete model text generated prior to t | STRING |
| HIGH | aphrodite/tool_parsers/apertus_tool_parser.py | 467 | Calculates the exact string difference to safely append new tool parameters. This ensures characters l | STRING |
| HIGH | aphrodite/metal/metal_kernel_backend/attention_sdpa.py | 166 | Project ``x`` into Q/K/V with norms, RoPE and Gemma4 variants. Handles three Gemma4-specific branches: - **YOC | STRING |
| HIGH | aphrodite/metal/metal_kernel_backend/attention_sdpa.py | 308 | Zero-pad Q/K/V on the last axis up to ``cache_head_dim``. Variable head_dim models (e.g. Gemma4 sliding=256, full=5 | STRING |
| HIGH | aphrodite/metal/v1/model_adapter.py | 231 | Return per-layer ``(kv_heads, head_dim)`` lists for Gemma4, else None. Gemma4 26B/31B mix sliding attention (`` | STRING |
| HIGH | aphrodite/metal/stt/audio.py | 57 | Load an audio file and return mono samples at *sample_rate* Hz. Tries ``librosa`` first (handles WAV natively witho | STRING |
| HIGH | aphrodite/metal/stt/audio.py | 90 | Load audio via ffmpeg subprocess. Args: file_path: Path to the audio file. sample_rate: Target samp | STRING |
| HIGH | …ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py | 709 | Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. | STRING |
| HIGH | …rodite/distributed/kv_transfer/kv_connector/v1/base.py | 451 | Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. | STRING |
| HIGH | …ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py | 276 | Get remote allocation info for a request. Args: transfer_id:TransferId The request ID Retu | STRING |
| HIGH | …nector/v1/lmcache_integration/multi_process_adapter.py | 194 | Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and h | STRING |
| HIGH | …nector/v1/lmcache_integration/multi_process_adapter.py | 544 | Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engine | STRING |
| HIGH | aphrodite/distributed/weight_transfer/factory.py | 89 | Create a weight transfer engine instance. Args: config: Weight transfer configuration containing th | STRING |
| HIGH | aphrodite/distributed/weight_transfer/base.py | 419 | Construct typed init info from dict with validation. Args: init_dict: Dictionary containin | STRING |
| HIGH | aphrodite/distributed/weight_transfer/base.py | 437 | Construct typed update info from dict with validation. Args: update_dict: Dictionary conta | STRING |
| HIGH | aphrodite/model_executor/kernels/linear/__init__.py | 624 | Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the | STRING |
| HIGH | aphrodite/model_executor/kernels/linear/__init__.py | 790 | Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to cho | STRING |
| HIGH | aphrodite/model_executor/layers/fused_moe/utils.py | 60 | Resolve whether AITER fused shared-expert execution is enabled. Args: quant_config: Model quantization conf | STRING |
| HIGH | aphrodite/model_executor/layers/fused_moe/moe_output.py | 44 | Normalize the two FlashInfer TRTLLM MoE return layouts. Args: flashinfer_output: Tensor returned by the Fla | STRING |
| HIGH | …/model_executor/layers/fused_moe/expert_map_manager.py | 322 | Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nu | STRING |
| HIGH | …cutor/layers/fused_moe/experts/ocp_mx_emulation_moe.py | 41 | Activation dtype `moe_kernel_quantize_input` should fake-quantize to. Args: ocp_mx_scheme: The OCP MX schem | STRING |
| HIGH | aphrodite/model_executor/models/keye_vl1_5.py | 77 | Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wi | STRING |
| HIGH | aphrodite/model_executor/models/isaac.py | 230 | Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): | STRING |
| HIGH | aphrodite/models/hy_v4/nvidia/attention.py | 55 | Return the backbone layers that reuse a previous layer's top-k indices. A "shared" indexer layer performs sparse at | STRING |
| HIGH | aphrodite/models/hy_v4/nvidia/flashmla_sparse.py | 120 | Return the sink laid out for the kernel's query head count. Args: q: Query tensor, before any head | STRING |
| HIGH | …ls/glm5next/amd/ops/third_party/kda/fused_recurrent.py | 544 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | …glm5next/nvidia/ops/third_party/kda/fused_recurrent.py | 544 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | aphrodite/reasoning/hy_v4_reasoning_parser.py | 36 | Detect the per-checkpoint suffix used by Hunyuan structural tokens. Args: tokenizer: Tokenizer of the serve | STRING |
| HIGH | aphrodite/multimodal/gpu_ipc_memory.py | 160 | Return KV-cache memory remaining after frontend multimodal reservations. The reservation covers: * The total ` | STRING |
| HIGH | aphrodite/multimodal/audio.py | 92 | Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppo | STRING |
| HIGH | aphrodite/multimodal/audio.py | 316 | Split audio into chunks with intelligent split points. Splits long audio into smaller chunks at low-energy regions | STRING |
| HIGH | …rodite/third_party/flash_linear_attention/ops/chunk.py | 147 | Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | …rd_party/flash_linear_attention/ops/fused_recurrent.py | 516 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | aphrodite/benchmarks/lib/ready_checker.py | 25 | Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async req | STRING |
| HIGH | aphrodite/entrypoints/chat_utils.py | 1536 | Parses a given multi-modal content part based on its type. Args: part: A dict containing the content p | STRING |
| HIGH | aphrodite/entrypoints/speech_to_text/base/utils.py | 18 | Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the Conte | STRING |
| HIGH | aphrodite/transformers_utils/processors/isaac.py | 174 | Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): Tenso | STRING |
| HIGH | aphrodite/lora/resolver.py | 69 | Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | csrc/cpu/sgl-kernels/decode.cpp | 1434 | // use smaller BLOCK_H when batches is small to utilize all cores | COMMENT |
| LOW | csrc/libtorch_stable/quantization/machete/generate.py | 413 | # For now, we can just use the first accumulator type seen since | STRING |
| MEDIUM | tests/v1/logits_processors/test_custom_offline.py | 30 | # Create a mixture of requests which do and don't utilize the dummy logitproc | COMMENT |
| LOW | tests/v1/cudagraph/test_breakable_cudagraph.py | 307 | # Outside capture: decorator should just call through. | COMMENT |
| MEDIUM⚡ | tests/renderers/test_sparse_tensor_validation.py | 67 | # explicitly so this fixture is robust to process-wide invariant-check state | COMMENT |
| MEDIUM | tests/kernels/attention/test_attention_selector.py | 520 | # binding, so patch is_xpu there (not on flash_attn's) to stay robust to | COMMENT |
| MEDIUM | tests/kernels/mamba/test_mamba_mixer2.py | 106 | # - utilize mock patching to disable TP when | COMMENT |
| MEDIUM | tests/distributed/test_pynccl.py | 373 | # Essentially this is an all-gather operation. | COMMENT |
| MEDIUM | tests/distributed/test_context_parallel.py | 46 | # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yaml | COMMENT |
| MEDIUM | tests/distributed/test_context_parallel.py | 48 | # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yaml | COMMENT |
| MEDIUM | tests/distributed/test_sharded_rdt_trainer.py | 393 | assert server.live_count == 1 # num_consumers=1 in the harness | CODE |
| LOW | tests/model_executor/test_qwen3_omni.py | 45 | # Regular token, just add it | COMMENT |
| MEDIUM | tests/models/registry.py | 950 | # Keep the init/schema harness eager (these tests never run forward). | COMMENT |
| MEDIUM | tests/parser/engine/test_replay.py | 66 | # token, so it does not fit this TOOL_END-based replay harness. | COMMENT |
| MEDIUM | tests/parser/engine/test_delegating_replay.py | 82 | # token, so it does not fit this TOOL_END-based replay harness. | COMMENT |
| MEDIUM⚡ | tests/entrypoints/serve/dev/rlhf/conftest.py | 67 | # Server harness | COMMENT |
| LOW | examples/offline_inference/ray_distributed_inference.py | 71 | # For tensor_parallel_size == 1, we simply set num_gpus=1. | COMMENT |
| LOW | benchmarks/attention_benchmarks/benchmark.py | 435 | # No parameters, just use template as-is | COMMENT |
| MEDIUM | benchmarks/kernels/benchmark_silu_mul_fp8_quant.py | 678 | # Create comprehensive 3-way comparison plots | COMMENT |
| LOW | aphrodite/env_override.py | 312 | # functions just return True. | COMMENT |
| LOW | aphrodite/v1/attention/backends/flash_attn.py | 352 | # but for now just set it to `UNIFORM_BATCH` to get use to drop down | COMMENT |
| LOW | aphrodite/v1/attention/backends/utils.py | 464 | # then we can simply use a cdiv for the rest. | COMMENT |
| MEDIUM | aphrodite/v1/attention/ops/triton_decode_attention.py | 358 | # explicitly facilitate overlapping load/compute | COMMENT |
| LOW | aphrodite/v1/core/kv_cache_coordinator.py | 498 | # Single group; useless but just set ``use_eagle`` for consistency regardless. | COMMENT |
| MEDIUM | aphrodite/v1/core/encoder_cache_manager.py | 335 | # utilize the cache and this class will fold into EncoderCacheManager, as | COMMENT |
| LOW | aphrodite/v1/spec_decode/llm_base_proposer.py | 568 | # KV cache in sync, so just return an empty tensor. | COMMENT |
| LOW | aphrodite/v1/spec_decode/llm_base_proposer.py | 1726 | # Therefore, we can just return the logits. | COMMENT |
| MEDIUM | aphrodite/v1/worker/gpu_worker.py | 778 | # CUDAGraph memory size and may not utilize all gpu memory. | COMMENT |
| MEDIUM | aphrodite/v1/worker/gpu_worker.py | 1115 | # Generate the trace name by combining prefix with comprehensive rank suffix | COMMENT |
| LOW | aphrodite/v1/worker/gpu/model_runner.py | 1693 | # For piecewise and eager mode, just call model(). | COMMENT |
| LOW | aphrodite/v1/engine/parallel_sampling.py | 116 | # If streaming, just return the current output | COMMENT |
| MEDIUM | aphrodite/tool_parsers/llama_tool_parser.py | 219 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | aphrodite/tool_parsers/jamba_tool_parser.py | 182 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | aphrodite/tool_parsers/granite_tool_parser.py | 163 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| LOW | aphrodite/tool_parsers/xlam_tool_parser.py | 492 | # If we encounter an error, just return the delta text as regular content | COMMENT |
| MEDIUM | aphrodite/tool_parsers/granite_20b_fc_tool_parser.py | 177 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | aphrodite/tool_parsers/step3_tool_parser.py | 51 | # Explicit state flags for robust streaming | COMMENT |
| LOW | aphrodite/tokenizers/mistral.py | 499 | # if underlying tokenizer is sentencepiece, we just add "�". | COMMENT |
| LOW | aphrodite/platforms/cuda.py | 762 | # users can just use IR op priority directly | COMMENT |
| MEDIUM | aphrodite/distributed/utils.py | 321 | """A robust barrier to synchronize all ranks. | STRING |
| MEDIUM | …ibuted/kv_transfer/kv_connector/v1/nixl/base_worker.py | 854 | # we can leverage host_buffer for permute. | COMMENT |
| MEDIUM | …ransfer/kv_connector/v1/mooncake/mooncake_connector.py | 844 | # Tasks can await async events, so a surplus (2x is a robust heuristic) | COMMENT |
| MEDIUM | aphrodite/config/model.py | 352 | """Enable the custom cumem allocator to leverage advanced GPU memory | STRING |
| MEDIUM | aphrodite/config/parallel.py | 630 | # To make the initialization more robust we retry a few times | COMMENT |
| LOW | …odite/model_executor/layers/mamba/ops/causal_conv1d.py | 188 | # first chunk and does not have prior-token, so just set to 0 | COMMENT |
| MEDIUM | …dite/model_executor/layers/fused_moe/modular_kernel.py | 50 | # The goal is to be able to utilize different communication mechanisms with | COMMENT |
| MEDIUM | …xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py | 38 | # TODO (varun) : Optimize leverage num_tokens_per_expert counts | COMMENT |
| MEDIUM | …executor/layers/fused_moe/experts/fused_humming_moe.py | 449 | # Neighboring nodes are required to utilize distinct workspaces. | COMMENT |
| MEDIUM | aphrodite/model_executor/layers/quantization/fp8.py | 254 | # For GPUs that lack FP8 hardware support, we can leverage the Marlin | COMMENT |
| MEDIUM | …hrodite/model_executor/layers/quantization/modelopt.py | 328 | # Normalize quant_algo for robust matching (ModelOpt may emit lowercase). | COMMENT |
| MEDIUM | …odite/model_executor/layers/quantization/fbgemm_fp8.py | 53 | # For GPUs that lack FP8 hardware support, we can leverage the Marlin | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp4.py | 107 | # to fully utilize the E4M3 dynamic range (e.g., global_scale=1). | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp4.py | 165 | # For GPUs that lack FP4 hardware support, we can leverage the | COMMENT |
| MEDIUM | …executor/layers/quantization/utils/marlin_utils_fp8.py | 60 | # For GPUs that lack FP8 hardware support, we can leverage the | COMMENT |
| LOW | …odel_executor/layers/quantization/utils/quant_utils.py | 503 | # Unquantized layer: just return base weights | COMMENT |
| MEDIUM | aphrodite/model_executor/models/deepseek_ocr.py | 142 | """Example of overriding the wrapper class `__init__()` in order to utilize | STRING |
| MEDIUM | aphrodite/model_executor/models/deepseek_ocr.py | 142 | """Example of overriding the wrapper class `__init__()` in order to utilize | STRING |
| LOW | aphrodite/model_executor/models/qwen3_asr.py | 528 | # No audio features, just return linear positions | COMMENT |
| LOW | …odite/model_executor/models/transformers/multimodal.py | 560 | # NOTE: we can't just set caching=False because base class method | COMMENT |
| MEDIUM | aphrodite/models/hy_v4/nvidia/hc.py | 159 | # present; getattr keeps this robust if that ever changes. | COMMENT |
| 22 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | rust/src/cmd/src/cli/unsupported.rs | 141 | /// - `aphrodite.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)` | COMMENT |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 753 | assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 984 | assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/v1/e2e/general/test_mamba_prefix_cache.py | 1003 | assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache() | CODE |
| CRITICAL | tests/distributed/test_torchrun_example_moe.py | 80 | params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters()) | CODE |
| CRITICAL | tests/distributed/test_torchrun_example.py | 71 | params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters()) | CODE |
| CRITICAL | tests/models/language/generation/test_gemma.py | 64 | lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501 | CODE |
| CRITICAL | tests/models/language/generation/test_gemma.py | 68 | normalizers = llm.llm.collective_rpc(lambda self: self.model_runner.model.model.normalizer.cpu().item()) | CODE |
| CRITICAL | aphrodite/v1/spec_decode/llm_base_proposer.py | 1377 | self.model.model.embed_tokens.weight.cpu(), | CODE |
| CRITICAL | …rodite/third_party/flash_linear_attention/ops/utils.py | 158 | triton.runtime.driver.active.utils.get_device_properties(i)["max_shared_mem"] | CODE |
| CRITICAL | aphrodite/entrypoints/cli/main.py | 42 | aphrodite.entrypoints.cli.benchmark.main.maybe_exec_rust_bench() | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | config.yaml | 22 | # The maximum sequence length/context window for the model | COMMENT |
| MEDIUM⚡ | tools/pre_commit/generate_attention_backend_docs.py | 1621 | # Top-level orchestration | COMMENT |
| MEDIUM⚡ | tests/v1/kv_offload/tiering/p2p/test_manager.py | 1277 | # _poll_once orchestration | COMMENT |
| MEDIUM | tests/v1/core/test_scheduler.py | 1005 | # happen when max_tokens is clamped to the context window after | COMMENT |
| MEDIUM | tests/v1/kv_connector/unit/test_offloading_connector.py | 151 | # Use a long prompt that fits within the model's context window. | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 830 | # Wait for generation to start (event-driven) | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 872 | # Wait for some tokens (event-driven, handles slow token generation) | COMMENT |
| MEDIUM | tests/v1/engine/test_async_llm.py | 929 | # Wait for at least one token across any request (event-driven) | COMMENT |
| MEDIUM | tests/tool_parsers/test_lfm2_tool_parser.py | 272 | # Messy agentic shell commands: literal bracket inside a string argument | COMMENT |
| MEDIUM | tests/renderers/test_cohere.py | 425 | # chain-of-thought across the rendered prompt. | COMMENT |
| MEDIUM | tests/evals/mrcr/mrcr_eval.py | 32 | # Skip chain-of-thought on reasoning models; ignored by non-reasoning templates. | COMMENT |
| MEDIUM | tests/compile/fullgraph/test_basic_correctness.py | 39 | # embedding model | COMMENT |
| MEDIUM | tests/entrypoints/cohere/test_serving_conversion.py | 404 | # Cohere's ``tool_plan`` is the older chain-of-thought field; it | COMMENT |
| MEDIUM | tests/entrypoints/openai/responses/test_harmony.py | 591 | # NOTE: chain-of-thought should be removed. | COMMENT |
| MEDIUM | …ntrypoints/openai/chat_completion/test_serving_chat.py | 1216 | # adding max_tokens should exceed the model context window. | COMMENT |
| MEDIUM | aphrodite/_xpu_ops.py | 1037 | window_size=(-1, -1), # -1 means infinite context window | CODE |
| MEDIUM | aphrodite/v1/attention/ops/vit_attn_wrappers.py | 258 | # Without it, hallucinations occur with the backend | COMMENT |
| MEDIUM | aphrodite/v1/executor/abstract.py | 45 | uses_ray: bool = False # whether the executor uses Ray for orchestration. | CODE |
| MEDIUM | aphrodite/platforms/cpu.py | 156 | # the shared MLA scaffolding so that DeepSeek-style models can | COMMENT |
| MEDIUM | aphrodite/metal/stt/whisper/config.py | 13 | # Maximum decode tokens for Whisper models (matches Whisper context window). | COMMENT |
| MEDIUM⚡ | …ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py | 273 | # progress is event-driven (see module docstring). | COMMENT |
| MEDIUM | …d/kv_transfer/kv_connector/v1/mooncake/store/worker.py | 4 | # The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread, | COMMENT |
| MEDIUM | aphrodite/model_executor/models/granite_speech.py | 81 | # work pretty well with zero shot. | COMMENT |
| MEDIUM | aphrodite/model_executor/models/phi3v.py | 567 | # initialized as an embedding model | COMMENT |
| MEDIUM | aphrodite/models/minimax_m3/amd/model.py | 1363 | # NVIDIA copy — it only orchestrates the shared vision tower + the per-platform | COMMENT |
| MEDIUM | aphrodite/reasoning/hy_v4_reasoning_parser.py | 252 | # chain-of-thought (and a stray ``</think:SUF>``) as content. | COMMENT |
| MEDIUM | aphrodite/reasoning/gemma4_utils.py | 27 | print(result["thinking"]) # chain-of-thought or None | STRING |
| MEDIUM | aphrodite/reasoning/gemma4_utils.py | 76 | >>> print(result["thinking"]) # chain-of-thought reasoning or None | STRING |
| MEDIUM | aphrodite/entrypoints/cohere/serving.py | 271 | # Controls how the assistant's chain-of-thought is surfaced on | COMMENT |
| MEDIUM | aphrodite/entrypoints/cohere/serving.py | 445 | # ``tool_plan`` is Cohere's chain-of-thought emitted alongside tool | COMMENT |
| MEDIUM | aphrodite/entrypoints/speech_to_text/base/serving.py | 383 | # which is a strong sign of hallucination in outputs. | COMMENT |
| MEDIUM | aphrodite/vllm_flash_attn/flash_attn_interface.py | 138 | window_size=(-1, -1), # -1 means infinite context window | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/attention/test_mla_backends.py | 1667 | ["placeholder"], | CODE |
| LOW | tests/v1/attention/test_dspark_noncausal_sparse_mla.py | 318 | aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace( | CODE |
| LOW | tests/v1/attention/test_dspark_noncausal_sparse_mla.py | 322 | builder = backend_cls.get_builder_cls()(kv_cache_spec, ["placeholder"], aphrodite_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 579 | aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace( | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 584 | builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1190 | aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace( | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1195 | builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1641 | aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(prefill_backend=None) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1670 | builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device) | CODE |
| LOW | tests/v1/attention/test_sparse_mla_backends.py | 1672 | builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device) | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 619 | ["placeholder"], | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 973 | "placeholder": PerLayerParameters( | CODE |
| LOW | tests/v1/attention/test_attention_backends.py | 1017 | kv_cache_spec, ["placeholder"], aphrodite_config, device | CODE |
| LOW⚡ | tests/v1/kv_connector/unit/test_nixl_push_connector.py | 871 | payload = _registration_data("placeholder") | CODE |
| LOW | tests/tool_parsers/test_kimi_k2_tool_parser.py | 82 | '{"to": "user@example.com", "subject": "Daily Update"}', | CODE |
| LOW | tests/tool_parsers/test_kimi_k2_tool_parser.py | 89 | {"to": "user@example.com", "subject": "Daily Update"}, | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 23 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 31 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_olmo3_tool_parser.py | 40 | arguments='{"name": "John Doe", ' | CODE |
| LOW⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 23 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_pythonic_tool_parser.py | 32 | arguments='{"name": "John Doe", ' | CODE |
| LOW⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 26 | "register_user(name='John Doe', " | CODE |
| LOW⚡ | tests/tool_parsers/test_lfm2_tool_parser.py | 35 | arguments='{"name": "John Doe", ' | CODE |
| LOW | tests/tool_parsers/test_lfm2_tool_parser.py | 509 | "[grocery.orderIngredients(ingredientList=[{'name': 'apple', 'quantity': '2'}], deliveryAddress='123 Main St')]" | CODE |
| LOW⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 41 | '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name": | CODE |
| LOW⚡ | tests/tool_parsers/test_hunyuan_a13b_tool_parser.py | 47 | "name": "John Doe", | CODE |
| LOW | tests/kernels/helion/test_pattern_matching.py | 121 | input_node = next(n for n in gm.graph.nodes if n.op == "placeholder") | CODE |
| LOW | tests/kernels/helion/test_pattern_matching.py | 186 | input_node = next(n for n in gm.graph.nodes if n.op == "placeholder") | CODE |
| LOW | …ls/attention/test_rocm_aiter_mla_causal_verify_mask.py | 124 | layer_name = "placeholder" | CODE |
| LOW | …rnels/attention/test_rocm_aiter_mla_decode_metadata.py | 118 | layer_name = "placeholder" | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 126 | dummy_data = builder.get_dummy_mm_data(100, mm_counts, {}) | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 128 | assert "audio" in dummy_data | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 129 | assert len(dummy_data["audio"]) == 2 | CODE |
| LOW⚡ | …ts/models/multimodal/processing/test_audioflamingo3.py | 132 | assert len(dummy_data["audio"][0]) == expected_len | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 381 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 874 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 1277 | "name": "John Doe", | CODE |
| LOW | tests/parser/mistral/test_tool_calls.py | 374 | """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW | tests/parser/mistral/test_tool_calls.py | 867 | """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW | tests/parser/mistral/test_tool_calls.py | 1270 | """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501 | STRING |
| LOW⚡ | tests/compile/test_graph_partition.py | 175 | assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * ["call_function"] + ["output"] | CODE |
| LOW | tests/compile/test_graph_partition.py | 58 | if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder": | CODE |
| LOW | tests/compile/test_graph_partition.py | 112 | if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder": | CODE |
| LOW | tests/compile/test_graph_partition.py | 397 | if node.op == "placeholder" and isinstance(node.meta.get("example_value"), torch.SymInt) | CODE |
| LOW | tests/compile/test_graph_partition.py | 456 | if n.op == "placeholder" and isinstance(n.meta.get("example_value"), torch.SymInt) | CODE |
| LOW | tests/compile/test_graph_partition.py | 461 | if n.op == "placeholder" | CODE |
| LOW | tests/compile/test_graph_partition.py | 564 | if n.op != "placeholder": | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 225 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 237 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW | tests/compile/passes/ir/test_clone_cleanup.py | 253 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 268 | placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 282 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/compile/passes/ir/test_clone_cleanup.py | 299 | x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0] | CODE |
| LOW⚡ | tests/benchmarks/test_txt_slices_dataset.py | 20 | Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor | CODE |
| LOW⚡ | tests/benchmarks/test_txt_slices_dataset.py | 20 | Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor | CODE |
| LOW⚡ | tests/entrypoints/launchers/test_run_batch.py | 838 | def _make_aiohttp_mocks(response_data: bytes = b"fake-data", status: int = 200): | CODE |
| LOW⚡ | benchmarks/attention_benchmarks/mla_runner.py | 677 | aphrodite_config.compilation_config.static_forward_context = {"placeholder": layer} | CODE |
| LOW⚡ | benchmarks/attention_benchmarks/mla_runner.py | 681 | layer_names=["placeholder"], | CODE |
| LOW | …hrodite/model_executor/models/transformers/fx_utils.py | 106 | if kind == "placeholder": | CODE |
| LOW | …hrodite/model_executor/models/transformers/fx_utils.py | 151 | return isinstance(node, fx.Node) and node.op == "placeholder" and str(node.target).lstrip("*") == self.varkw | CODE |
| 13 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | csrc/cpu/sgl-kernels/common.h | 378 | // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb] | COMMENT |
| LOW | …nector/v1/lmcache_integration/multi_process_adapter.py | 575 | # TODO: add error handling here | COMMENT |
| LOW | …e/model_executor/kernels/linear/mixed_precision/xpu.py | 181 | # TODO: implement asym case | COMMENT |
| LOW | aphrodite/entrypoints/openai/responses/protocol.py | 719 | # TODO: implement the other reason for incomplete_details, | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 294 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 327 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 351 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 388 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 418 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 437 | # TODO: implement it based on torch ops | COMMENT |
| LOW | aphrodite/lora/punica_wrapper/punica_base.py | 464 | # TODO: implement it based on torch ops | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/sample/test_logprobs.py | 920 | # Based on user's example: "In this example," | COMMENT |
| HIGH | examples/vision/vision_example.py | 116 | # In this example, we override max_num_seqs to 5 while | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | formatting.sh | 4 | # Usage: | COMMENT |
| LOW | tools/setup_deepgemm_pythons.sh | 8 | # Usage: | COMMENT |
| LOW | docker/docker-bake.hcl | 5 | # Usage: | COMMENT |
| LOW | docker/export_wheels.sh | 6 | # Usage: | COMMENT |
| LOW | …/nixl_integration/run_multi_connector_accuracy_test.sh | 15 | # Usage: | COMMENT |
| LOW | …nector/nixl_integration/spec_decode_acceptance_test.sh | 13 | # Usage: | COMMENT |
| LOW | …nixl_integration/run_multi_connector_edge_case_test.sh | 15 | # Usage: | COMMENT |
| LOW | examples/run_cluster.sh | 8 | # Usage: | COMMENT |
| LOW | examples/multi_node.sh | 11 | # Example usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/models/multimodal/generation/test_common.py | 63 | # model arch happens to be a substring of another one, you can add a | COMMENT |
| MEDIUM | tests/models/multimodal/generation/test_common.py | 84 | # NOTE you can add --collect-only to any of the above commands to see | COMMENT |
| MEDIUM | …disagg_prefill_lmcache_v1/disagg_aphrodite_launcher.sh | 24 | # secure random value. This is set to a fixed value for demonstration purposes only. | COMMENT |
| LOW | …ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py | 88 | # while processing the next batch, we make sure to only set an | COMMENT |
| MEDIUM | aphrodite/model_executor/models/interfaces.py | 301 | as a language model component. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | examples/disaggregated_prefill/p2p_nccl/proxy_server.py | 122 | async def handle_request(): | CODE |
| LOW | benchmarks/disagg_benchmarks/nixl_proxy_server.py | 180 | async def handle_request(): | CODE |
| LOW | …marks/disagg_benchmarks/disagg_prefill_proxy_server.py | 134 | async def handle_request(): | CODE |
| LOW | benchmarks/disagg_benchmarks/round_robin_proxy.py | 15 | async def handle_request(self, request): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/v1/e2e/general/test_streaming_input.py | 473 | CODE |