AI Slop Code RIsk Monitor

dphnAI/sonar

Large-scale LLM inference engine

13.8 Moderate pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for dphnAI/sonar, a Python project with 1,871 GitHub stars. SynthScan examined 2,405,065 lines of code across 6278 source files, recording 25284 pattern matches distributed across 26 syntactic categories. The legacy adjusted pattern signal is 13.8 (Moderate pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

13.8
Adjusted Signal
13.8
Raw Pattern Score
100%
Time Factor
2026-09-11
Last Push
1.9K
Stars
Python
Language
2.4M
Lines of Code
6.3K
Files
25.3K
Pattern Hits
2026-10-12
Scan Date
0.09
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 34.0/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 19401 finding(s).

Hallucinated Dependency & Supply Chain Risk 4.5/100 · LOW

Are imports declared and package/API names verified? 1958 finding(s).

Agent Over-Engineering Ratio 42.2/100 · MEDIUM

Are wrappers, guards, and repeated structures necessary? 19776 finding(s).

PR Review Velocity Impact 50.1/100 · HIGH

Which changes need focused human review? 25284 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 11HIGH 579MEDIUM 2606LOW 22088

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 25284 distinct pattern matches across 26 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers15454 hits · 14886 pts
SeverityFileLineSnippetContext
LOWenv.py113def run_and_parse_first_match(run_lambda, command, regex):CODE
LOWenv.py124def run_and_return_first_line(run_lambda, command):CODE
LOWenv.py157def get_nvidia_driver_version(run_lambda):CODE
LOWenv.py269def summarize_aphrodite_build_flags():CODE
LOWenv.py473def get_cachingallocator_config():CODE
LOWenv.py478def get_cuda_module_loading_config():CODE
LOW⚡setup.py52def should_require_rust_frontend() -> bool:CODE
LOW⚡setup.py57def should_use_precompiled_rust() -> bool:CODE
LOW⚡setup.py62def get_precompiled_rust_extension_paths() -> list[Path]:CODE
LOWsetup.py733def add_aphrodite_package_data(filename: str) -> None:CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py91def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str:CODE
LOWcsrc/libtorch_stable/quantization/machete/generate.py318def generate_type_option_name(kernel_types: TypeConfig):STRING
LOWcsrc/libtorch_stable/quantization/machete/generate.py350def unsigned_type_with_bitwidth(num_bits):STRING
LOWtools/generate_versions_json.py84def generate_bake_native_json(args: dict[str, str]) -> dict:CODE
LOWtools/install_nixl_from_source_ubuntu.py65def install_system_dependencies():CODE
LOWtools/install_nixl_from_source_ubuntu.py104def build_and_install_prerequisites(args):CODE
LOWtools/build_rust.py20def prepare_build_environment() -> str | None:CODE
LOWtools/build_rust.py54def rust_py_extension_module_names() -> list[str]:CODE
LOW⚡tools/pre_commit/generate_attention_backend_docs.py1070def _expand_flash_attn_variants(CODE
LOW⚡tools/pre_commit/generate_attention_backend_docs.py1180def parse_cuda_priority_lists() -> dict[str, list[str]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py250def _find_exact_cc_in_function(tree: ast.AST, func_name: str) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py608def parse_flash_attn_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py753def parse_flashinfer_trtllm_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py792def parse_mla_dimensions_call(node: ast.AST | None) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py816def parse_supported_mla_dimensions(node: ast.ClassDef) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py831def _parse_mla_dimension_reference(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py840def _parse_mla_dimensions_return(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py870def _parse_fa_version_condition(node: ast.AST) -> int | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py891def parse_supports_mla_dimensions(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py944def parse_mla_prefill_registry() -> dict[str, str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py955def parse_mla_prefill_backend_file(class_path: str) -> dict[str, Any] | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1013def _format_mla_dimension_notes(backend_info: dict[str, Any]) -> str:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1035def parse_mla_prefill_backends() -> list[dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1122def _expand_flashinfer_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1231def _get_backends_from_return(stmts: list) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1503def generate_priority_section(priorities: dict[str, list[str]]) -> str:CODE
LOWtools/docs/generate_user_reference.py147def quantization_config_classes() -> dict[str, str]:CODE
LOWtools/recipes/runtime_tuning.py69def _get_active_sequence_count(CODE
LOWtools/recipes/runtime_tuning.py84def _estimate_prefills_per_step(CODE
LOWtools/recipes/runtime_tuning.py112def _resolve_tensor_parallel_size(CODE
LOWtools/recipes/runtime_tuning.py134def _resolve_gpu_memory_utilization(CODE
LOWtools/recipes/runtime_tuning.py192def _resolve_max_num_batched_tokens(CODE
LOWtools/recipes/runtime_tuning.py240def _resolve_data_parallel_size(CODE
LOWtools/recipes/runtime_tuning.py272def get_runtime_tuning_policies(CODE
LOWtools/recipes/sweep_generation.py24def _strict_lower_power_of_two(value: int) -> int:CODE
LOWtools/recipes/sweep_generation.py30def _strict_upper_power_of_two(value: int) -> int:CODE
LOWtools/profiler/visualize_layerwise_profile.py66def shorten_plot_legend_strings(legend, max_char_len: int):CODE
LOWtools/profiler/visualize_layerwise_profile.py85def attempt_to_make_names_unique(entries_and_traces):CODE
LOWtools/profiler/visualize_layerwise_profile.py124def group_trace_by_operations(trace_df: pd.DataFrame) -> pd.DataFrame:CODE
LOWtools/profiler/visualize_layerwise_profile.py179 def is_custom_ar_all_reduce_unreg(op_name: str):CODE
LOWtests/test_sequence.py9def test_sequence_intermediate_tensors_equal():CODE
LOWtests/test_request_input_bounds.py74def test_public_requests_accept_four_stop_strings(CODE
LOWtests/test_request_input_bounds.py85def test_public_requests_reject_more_than_four_stop_strings(CODE
LOWtests/test_request_input_bounds.py92def test_stop_string_limit_can_be_overridden():CODE
LOWtests/test_request_input_bounds.py117def test_duplicate_stop_token_ids_are_deduplicated_in_order():STRING
LOW⚡tests/test_request_input_bounds.py138def test_duplicate_bad_words_are_deduplicated_in_order():STRING
LOW⚡tests/test_request_input_bounds.py144def test_bad_word_tokenization_stops_at_worker_limit():STRING
LOW⚡tests/test_request_input_bounds.py154def test_bad_word_tokenization_limit_can_be_overridden(monkeypatch):STRING
LOWtests/test_request_input_bounds.py172def test_bad_word_rejects_empty_base_tokenization():STRING
LOWtests/test_request_input_bounds.py191def test_bad_word_skips_empty_optional_prefixed_tokenization():STRING
15394 more matches not shown…
Decorative Section Separators2155 hits · 7417 pts
SeverityFileLineSnippetContext
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1065# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1067# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1175# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1177# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1620# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1622# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py70# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py72# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py269# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py271# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py306# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py308# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py568# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py570# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1303# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1309# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1395# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1397# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py11# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py13# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py46# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py48# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py61# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py99# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py133# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py135# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py147# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/test_ray_env.py149# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py57# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py59# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py97# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py99# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py151# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py153# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py265# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/test_file_mapper.py267# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py24# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py228# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py230# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py268# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py270# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py293# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py295# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py325# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py327# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py439# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py441# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py598# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py600# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py698# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py700# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py759# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py761# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py803# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py805# ---------------------------------------------------------------------------COMMENT
2095 more matches not shown…
Cross-File Repetition365 hits · 1825 pts
SeverityFileLineSnippetContext
HIGHtests/v1/attention/test_mla_prefill_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_rocm_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/tool_parsers/test_granite_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_longcat_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/distributed/test_pipeline_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/distributed/test_context_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/compile/correctness_e2e/test_sequence_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/models/multimodal/pooling/test_colpali.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/entrypoints/pooling/scoring/util.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/entrypoints/pooling/scoring/util.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/generation/test_phi4siglip.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/models/multimodal/generation/test_phi4mm.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…/models/multimodal/generation/vlm_utils/model_utils.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…ts/models/multimodal/generation/test_granite_speech.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/entrypoints/openai/completion/test_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…ypoints/openai/chat_completion/test_chat_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHbenchmarks/benchmark_serving_structured_output.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHtests/lora/test_qwen3moe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_llama_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_olmoe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHexamples/offline_inference/vision_language_embedding.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/vision/vision_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/audio/audio_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHbenchmarks/benchmark_throughput.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_latency.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_serving.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/kernels/benchmark_machete.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/w8a8_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/sparse_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHaphrodite/sampling_params.py0whether to include the stop strings in output text.STRING
HIGH…e/entrypoints/speech_to_text/transcription/protocol.py0whether to include the stop strings in output text.STRING
HIGH…ite/entrypoints/speech_to_text/translation/protocol.py0whether to include the stop strings in output text.STRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn_diffkv.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/rocm_aiter_fa.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/triton_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/rocm_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/mamba_attn.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
HIGHaphrodite/v1/attention/backends/gdn_attn.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
HIGH…odite/model_executor/layers/attention/mla_attention.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
HIGH…odite/v1/attention/backends/rocm_aiter_unified_attn.py0forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_kSTRING
HIGHaphrodite/v1/attention/backends/flashinfer.py0forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_kSTRING
HIGHaphrodite/v1/attention/backends/flex_attention.py0forward pass with flexattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens, num_kSTRING
HIGHaphrodite/v1/core/sched/interface.py0reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated tSTRING
HIGHaphrodite/v1/core/sched/scheduler.py0reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated tSTRING
HIGHaphrodite/v1/engine/llm_engine.py0reset the encoder cache to invalidate all cached encoder outputs. this should be called when model weights are updated tSTRING
HIGHaphrodite/v1/engine/async_llm.py0load a new lora adapter into the engine for future requests.STRING
305 more matches not shown…
Unused Imports1814 hits · 1699 pts
SeverityFileLineSnippetContext
LOW…lass_extensions/aphrodite_cutlass_library_extension.py6CODE
LOWtools/build_rust.py6CODE
LOWtools/docs/generate_user_reference.py7CODE
LOWtools/recipes/sweep_recommendation.py7CODE
LOWtools/recipes/hardware_detection.py10CODE
LOWtools/recipes/runtime_tuning.py14CODE
LOWtools/recipes/recipe_json_to_aphrodite_config.py43CODE
LOWtools/recipes/sweep_generation.py6CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py78CODE
LOWtests/utils.py58CODE
LOWtests/utils.py65CODE
LOWtests/utils.py2100CODE
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py13CODE
LOWtests/v1/kv_offload/tiering/p2p/test_zmq_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_data_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py9CODE
LOWtests/v1/attention/test_mla_backends.py268CODE
LOW…ts/v1/attention/test_sparse_indexer_decode_seq_lens.py28CODE
LOWtests/v1/attention/test_attention_backends.py68CODE
LOWtests/v1/logits_processors/utils.py12CODE
LOWtests/v1/cudagraph/test_cudagraph_mode.py38CODE
LOWtests/v1/cudagraph/test_breakable_cudagraph.py7CODE
LOWtests/v1/kv_connector/unit/test_tp_mapping.py10CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py21CODE
LOW…kv_connector/unit/test_simple_cpu_offload_connector.py5CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py3CODE
LOW…onnector/mooncake_integration/test_mooncake_imports.py22CODE
LOWtests/v1/spec_decode/test_backup_token_async_spec.py9CODE
LOWtests/v1/sample/test_topk_topp_sampler.py33CODE
LOWtests/v1/ec_connector/unit/cpu/test_connector.py59CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/simple_kv_offload/test_scheduler.py5CODE
LOWtests/v1/simple_kv_offload/test_kv_events.py11CODE
LOWtests/v1/simple_kv_offload/test_worker.py10CODE
LOWtests/tool_use/test_gemma4_responses_adjust_request.py32CODE
LOWtests/tool_parsers/test_poolside_v1_tool_parser.py21CODE
LOWtests/tool_parsers/test_cohere_command_tool_parser.py4CODE
LOWtests/renderers/test_chat_utils_prompt_embeds.py6CODE
LOW…rnels/attention/test_rocm_aiter_mla_op_registration.py49CODE
LOWtests/kernels/core/test_vit_fp8_attn.py20CODE
LOWtests/kernels/core/test_rocm_misc_ops.py46CODE
LOWtests/kernels/core/test_rocm_misc_ops.py56CODE
LOWtests/kernels/core/test_rocm_misc_ops.py65CODE
LOWtests/kernels/core/test_fused_q_kv_rmsnorm.py11CODE
LOWtests/kernels/ir/test_ir_ops.py11CODE
LOWtests/kernels/ir/test_layernorm.py7CODE
LOWtests/kernels/mamba/test_memcpy_u64_tiled.py28CODE
LOWtests/kernels/mamba/test_precopy_mamba_align.py22CODE
LOWtests/kernels/mamba/test_gdn_forward_core_split.py30CODE
LOWtests/kernels/mamba/test_gdn_fused_mtp.py5CODE
LOWtests/kernels/scripts/check_no_tilelang_hijack.py15CODE
LOWtests/kernels/scripts/check_no_tilelang_hijack.py16CODE
1754 more matches not shown…
Deep Nesting1295 hits · 1160 pts
SeverityFileLineSnippetContext
LOWenv.py165CODE
LOWenv.py379CODE
LOWuse_existing_torch.py24CODE
LOWsetup.py537CODE
LOWsetup.py584CODE
LOWsetup.py204CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py91CODE
LOW…ibtorch_stable/quantization/marlin/generate_kernels.py173CODE
LOW…btorch_stable/moe/marlin_moe_wna16/generate_kernels.py173CODE
LOWtools/report_build_time_ninja.py149CODE
LOWtools/pre_commit/check_label_rules.py41CODE
LOWtools/pre_commit/check_triton_import.py32CODE
LOWtools/pre_commit/enforce_regex_import.py34CODE
LOWtools/pre_commit/generate_attention_backend_docs.py106CODE
LOWtools/pre_commit/generate_attention_backend_docs.py131CODE
LOWtools/pre_commit/generate_attention_backend_docs.py152CODE
LOWtools/pre_commit/generate_attention_backend_docs.py195CODE
LOWtools/pre_commit/generate_attention_backend_docs.py320CODE
LOWtools/pre_commit/generate_attention_backend_docs.py362CODE
LOWtools/pre_commit/generate_attention_backend_docs.py608CODE
LOWtools/pre_commit/generate_attention_backend_docs.py891CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1180CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1231CODE
LOWtools/pre_commit/validate_config.py73CODE
LOWtools/pre_commit/check_boolean_context_manager.py8CODE
LOWtools/pre_commit/check_spdx_header.py58CODE
LOWtools/pre_commit/check_spdx_header.py83CODE
LOWtools/docs/generate_user_reference.py164CODE
LOWtools/docs/generate_user_reference.py175CODE
LOWtools/recipes/recipe_json_to_aphrodite_config.py242CODE
LOWtools/recipes/recipe_json_to_aphrodite_config.py527CODE
LOWtools/recipes/recipe_json_to_aphrodite_config.py752CODE
LOWtests/conftest.py420CODE
LOWtests/conftest.py551CODE
LOWtests/conftest.py1014CODE
LOWtests/utils.py143CODE
LOWtests/utils.py1173CODE
LOWtests/utils.py1512CODE
LOWtests/utils.py1639CODE
LOWtests/utils.py1763CODE
LOWtests/utils.py561CODE
LOWtests/utils.py1645CODE
LOWtests/utils.py1786CODE
LOWtests/v1/test_glm5next_dflash2.py232CODE
LOWtests/v1/utils.py12CODE
LOWtests/v1/kv_offload/cpu/test_gpu_worker.py392CODE
LOWtests/v1/kv_offload/cpu/test_gpu_worker.py576CODE
LOWtests/v1/tracing/test_tracing.py22CODE
LOWtests/v1/attention/test_mla_backends.py331CODE
LOWtests/v1/attention/test_mla_backends.py1309CODE
LOWtests/v1/attention/test_sparse_mla_backends.py664CODE
LOWtests/v1/attention/test_deepseek_v4_swa_visible.py37CODE
LOWtests/v1/attention/test_kpool_tail_slot_mapping.py299CODE
LOWtests/v1/logits_processors/test_correctness.py293CODE
LOWtests/v1/logits_processors/test_correctness.py540CODE
LOWtests/v1/core/test_phrase_scheduler.py103CODE
LOWtests/v1/core/test_phrase_scheduler.py224CODE
LOWtests/v1/core/test_scheduler.py2797CODE
LOWtests/v1/core/utils.py218CODE
LOWtests/v1/kv_connector/unit/test_nixl_connector.py1767CODE
1235 more matches not shown…
Over-Commented Block1209 hits · 1066 pts
SeverityFileLineSnippetContext
LOWCMakeLists.txt1cmake_minimum_required(VERSION 3.26)COMMENT
LOWCMakeLists.txt61#COMMENT
LOWCMakeLists.txt301# setup.py will override FETCHCONTENT_BASE_DIR to play nicely with sccache.COMMENT
LOWenv.py281 return NoneCOMMENT
LOWenv.py301# Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsrCOMMENT
LOWenv.py321# NUMA node1 CPU(s): 32-63,96-127COMMENT
LOWenv.py341# Manufacturer=GenuineIntelCOMMENT
LOWconfig.yaml1# Sample configuration file for Aphrodite EngineCOMMENT
LOWconfig.yaml21COMMENT
LOWconfig.yaml41 # at high contexts, but it mutually exclusive with kv_cache_dtype=fp8COMMENT
LOWconfig.yaml81 # The data type to use for the model. Can be `auto`, `float16`, `bfloat16`,COMMENT
LOWconfig.yaml101 # Otherwise, KV cache scaling factors default to 1.0, whichCOMMENT
LOWconfig.yaml121COMMENT
LOWconfig.yaml141speculative_args:COMMENT
LOWconfig.yaml161COMMENT
LOWconfig.yaml181 # of draft tokens. Less accurate but faster.COMMENT
LOWconfig.yaml241 - max_cpu_loras:COMMENT
LOWconfig.yaml301COMMENT
LOWconfig.yaml321 # to the chosen load_format. This should be a JSON string thatCOMMENT
LOWformatting.sh1#!/usr/bin/env bashCOMMENT
LOWcsrc/torch_utils.h1#pragma onceCOMMENT
LOWcsrc/torch_bindings.cpp1// Provides torch::Tensor for ops.h (previously included transitively viaCOMMENT
LOWcsrc/cumem_allocator_compat.h101} // extern "C"COMMENT
LOWcsrc/cumem_allocator.cpp1// A CUDAPluggableAllocator based on cumem* APIs.COMMENT
LOWcsrc/cumem_allocator.cpp221 // sleep that discarded a tag) can still contain stale data from a previouslyCOMMENT
LOWcsrc/fs_io.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda_compat.h41 #define APHRODITE_LDG(arg) __ldg(arg)COMMENT
LOWcsrc/cuda_compat.h61 #define APHRODITE_SHFL_SYNC(var, src_lane) __shfl(var, src_lane)COMMENT
LOWcsrc/cuda_utils.h1#pragma onceCOMMENT
LOWcsrc/spinloop.cpp1#include <Python.h>COMMENT
LOWcsrc/attention/attention_dtypes.h1#pragma onceCOMMENT
LOWcsrc/hadamard/static_switch.h1// Inspired byCOMMENT
LOWcsrc/core/scalar_type.hpp1#pragma onceCOMMENT
LOWcsrc/core/registration.h1#pragma onceCOMMENT
LOWcsrc/metal/paged_ops.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/metal/paged_ops.cpp741// Replaces the Python turbo_quant_encode() + 5 MLX scatters on the hot path.COMMENT
LOWcsrc/cpu/mamba_kernels.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/mamba_kernels.hpp21// state_ptr may point to a NON-CONTIGUOUS paged KV cache tensor.COMMENT
LOWcsrc/cpu/mamba_kernels.hpp81 }COMMENT
LOWcsrc/cpu/mamba_kernels.hpp261//COMMENT
LOWcsrc/cpu/cpu_attn_neon.hpp1#ifndef CPU_ATTN_NEON_HPPCOMMENT
LOWcsrc/cpu/utils.cpp1#ifndef APHRODITE_NUMA_DISABLEDCOMMENT
LOWcsrc/cpu/cpu_wna16.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_fused_moe.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types.hpp1#ifndef CPU_TYPES_HPPCOMMENT
LOWcsrc/cpu/cpu_types_riscv.hpp1#ifndef CPU_TYPES_RISCV_HPPCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp981COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1001 // - kv_cache_num_blocks_strideCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1841 aligned_actual_kv_tile_pos_right] =COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1861 // Move buffersCOMMENT
LOWcsrc/cpu/mamba_cpu.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/mamba_cpu.cpp121 if (z.has_value() && z.value().defined()) z_in = ensure_input(z.value());COMMENT
LOWcsrc/cpu/cpu_attn_vxe.hpp381} // namespace cpu_attentionCOMMENT
LOWcsrc/cpu/generate_cpu_attn_dispatch.py141COMMENT
LOWcsrc/cpu/generate_cpu_attn_dispatch.py161 (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)COMMENT
LOWcsrc/cpu/cpu_arch_macros.h61#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h161 #include <riscv_vector.h>COMMENT
LOWcsrc/cpu/cpu_attn_amx_fp8.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_attn_amx_fp8.hpp21// Scale bookkeeping for PV:COMMENT
LOWcsrc/cpu/cpu_attn_amx_fp8.hpp41// ---------------------------------------------------------------------------COMMENT
1149 more matches not shown…
Self-Referential Comments306 hits · 970 pts
SeverityFileLineSnippetContext
MEDIUM⚡build_and_upload_docker.sh31# Create a temporary container to extract the wheelCOMMENT
MEDIUMtools/install_deepgemm.sh84# Create a temporary directory for the buildCOMMENT
MEDIUMtools/report_build_time_ninja.py199 # Create a list that is in order by time stamp and has entries for theCOMMENT
MEDIUMtests/conftest.py577 # Create a copy to avoid modifying the original dictCOMMENT
MEDIUMtests/utils.py764 # Create a dedicated process group so we can killCOMMENT
MEDIUMtests/utils.py1648 # Create a unique temporary file to store exception info from childCOMMENT
MEDIUM⚡tests/test_access_log_filter.py257 # Create a logger with our filter (simulating uvicorn.access)COMMENT
MEDIUM⚡tests/test_access_log_filter.py264 # Create a custom handler that tracks messagesCOMMENT
MEDIUMtests/test_config.py1527 # Create a new mock and run the method with the same S3 URLCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py247 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py563 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py707 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py947 # Create a tensor queueCOMMENT
MEDIUMtests/v1/test_serial_utils.py185 # Create a sample Python objectCOMMENT
MEDIUMtests/v1/test_serial_utils.py203 # Create a sample tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py221 # Create a sample numpy arrayCOMMENT
MEDIUMtests/v1/test_serial_utils.py305 # Create a request with a non-multimodal tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py344 # Create a request with None for the tensor fieldCOMMENT
MEDIUMtests/v1/metrics/test_ray_metrics.py67 # Create the actor and call the async methodCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py555 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py1714 # Create a summary for the single-line failure messageCOMMENT
MEDIUMtests/v1/attention/test_attention_backends.py213 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/logits_processors/test_correctness.py850 # Define a shuffled batch of requests which individually use a differentCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py30# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py82 # Create a Aphrodite instance and load custom logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py89 # Create a reference Aphrodite instance without custom logitprocCOMMENT
MEDIUM⚡tests/v1/core/test_kv_cache_utils.py356 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUM⚡tests/v1/core/test_kv_cache_utils.py359 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUM⚡tests/v1/core/test_kv_cache_utils.py556 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUM⚡tests/v1/core/test_kv_cache_utils.py559 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py402 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py450 # Create an empty FreeKVCacheBlockQueueCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py501 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1471 # Create a AphroditeConfigSTRING
MEDIUMtests/v1/core/test_kv_cache_utils.py1505 # Create a AphroditeConfigSTRING
MEDIUM⚡tests/v1/core/test_scheduler.py3543 # Create a request and schedule itCOMMENT
MEDIUM⚡tests/v1/core/test_scheduler.py4383 # Create a request and schedule it (and to be preempted)COMMENT
MEDIUMtests/v1/core/test_scheduler.py3570 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py4431 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py5287 # Create a text-only request (no mm_features).COMMENT
MEDIUMtests/v1/cudagraph/test_cudagraph_dispatch.py56 # Create a real LoRAConfig with specialize_active_lora enabledCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector.py2253 # Create a request that triggers do_remote_decode so thatCOMMENT
MEDIUM⚡tests/v1/kv_connector/unit/test_lmcache_connector.py202 # Create a mock object that is not LMCacheKVEventsCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_moriio_connector.py215 # Define a fake remote engine id for testingCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py155 # Create a request with multiple blocks worth of tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py543 # Create a requestCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py565 # Create a request with just 1 tokenCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py583 # Create a request with 2 tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py609 # Create a request with many blocksCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py692 # Create a request that doesn't align to block boundariesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector_hma.py245 # Create a mock worker with just the required attributesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_example_connector.py144 # Create the LLM instanceCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py45 # Create a minimal Llama config with small dimensionsCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py60 # Create a simple tokenizerCOMMENT
MEDIUMtests/v1/determinism/test_batch_invariance.py117 # Create a batch of size `max_batch_size` and insert the needle atCOMMENT
MEDIUMtests/v1/distributed/test_external_lb_dp.py157 # Create a client for each serverCOMMENT
MEDIUMtests/v1/distributed/test_hybrid_lb_dp.py182 # Create a client for each node (each node has its own API endpoint)COMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py20 # Create a minimal mock without initializing the full engineCOMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py50 # Create a mock queue with outputsCOMMENT
MEDIUM…/v1/streaming_input/test_gpu_model_runner_streaming.py34 # Create a real InputBatch for e2e testingCOMMENT
246 more matches not shown…
Excessive Try-Catch Wrapping776 hits · 822 pts
SeverityFileLineSnippetContext
LOWenv.py256 except Exception:CODE
LOWsetup.py129 except Exception:CODE
LOWsetup.py238 except Exception as e:CODE
LOWsetup.py520 except Exception:CODE
MEDIUMsetup.py121def find_tcmalloc() -> Path | None:CODE
MEDIUMtools/generate_cmake_presets.py156 print(f"Error writing file: {e}")CODE
LOWtools/install_nixl_from_source_ubuntu.py30 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py502 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py516 except Exception as e:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py584 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py619 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py765 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py963 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1201 except Exception:CODE
LOWtools/recipes/recipe_json_to_aphrodite_config.py856 except Exception as exc:CODE
LOWtests/conftest.py1329 except Exception:CODE
LOWtests/conftest.py1592 except Exception as e:CODE
MEDIUMtests/utils.py118def _nvml():CODE
LOWtests/utils.py81 except Exception as e:CODE
LOWtests/utils.py315 except Exception:CODE
LOWtests/utils.py597 except Exception as e:CODE
LOWtests/utils.py677 except Exception:CODE
LOWtests/utils.py1677 except Exception as e:CODE
LOWtests/utils.py1700 except Exception:CODE
LOWtests/utils.py1891 except Exception as e:CODE
LOWtests/utils.py2103 except Exception:CODE
LOWtests/v1/test_tensor_ipc_queue.py123 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py166 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py362 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py451 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py491 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py585 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py629 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py782 except Exception as e:CODE
LOWtests/v1/utils.py62 except Exception as e:CODE
LOW⚡tests/v1/kv_offload/cpu/test_shared_offload_region.py218 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py145 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py184 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py289 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py333 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py344 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py364 except Exception as e:CODE
MEDIUMtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py329def _run_decode():CODE
LOWtests/v1/shutdown/test_forward_error.py73 except Exception as e:CODE
LOWtests/v1/shutdown/test_processor_error.py42 except Exception as e:CODE
LOW⚡tests/v1/kv_connector/unit/test_hf3fs_client.py28except Exception:CODE
LOW…ts/v1/kv_connector/unit/test_nixl_rocm_gpu_mem_diag.py36 except Exception:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py408 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/utils.py336 except Exception as e:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py831 except Exception:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py868 except Exception:CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py233 except Exception as e:CODE
MEDIUM…s/v1/kv_connector/nixl_integration/toy_proxy_server.py238 print(f"Error occurred in disagg prefill proxy server - {api} endpoint")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py151 print(f"Error writing to file: {e}")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py160 print(f"Error writing to file: {e}")CODE
LOWtests/v1/determinism/test_online_batch_invariance.py42 except Exception as e: # pragma: no coverCODE
LOWtests/v1/distributed/test_external_lb_dp.py88 except Exception as e:CODE
LOWtests/v1/distributed/test_external_lb_dp.py115 except Exception as e:CODE
MEDIUMtests/v1/distributed/test_external_lb_dp.py116 print(f"Error stopping servers: {e}")CODE
LOWtests/v1/distributed/test_internal_lb_dp.py184 except Exception as e:CODE
716 more matches not shown…
Modern Structural Boilerplate526 hits · 531 pts
SeverityFileLineSnippetContext
LOWsetup.py34logger = logging.getLogger(__name__)CODE
LOW⚡tests/test_request_input_bounds.py202def _set_max_n(monkeypatch: pytest.MonkeyPatch, value: int) -> None:STRING
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py32logger = logging.getLogger(__name__)CODE
LOW⚡tests/v1/kv_connector/unit/test_multi_connector.py123 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py90 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOW⚡…/v1/kv_connector/unit/test_handshake_pp_aggregation.py137 def update_state_after_alloc(self, request: Any, blocks: Any, num_external_tokens: int) -> None:CODE
LOW⚡…/v1/kv_connector/unit/test_handshake_pp_aggregation.py143 def set_xfer_handshake_metadata(self, metadata: dict[int, KVConnectorHandshakeMetadata]) -> None:CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py7__all__ = ["request_runner"]CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWtests/v1/worker/test_gpu_worker_weight_transfer.py40 def update_weights(self, update_info: dict) -> None:CODE
LOWtests/v1/worker/test_gpu_trace_replay.py59def _set_lens(state: TraceReplayState, total_len, prompt_len) -> None:CODE
LOWtests/v1/engine/test_core_engine_actor_manager.py43 def _set_visible_devices(self, aphrodite_config: Any, local_dp_rank: int) -> None:CODE
LOWtests/kernels/moe/test_marlin_vs_trtllm_mxint4.py71__all__ = [CODE
LOWtests/distributed/test_weight_transfer.py1144 def update_weights(self, update_info: dict) -> None:CODE
LOW⚡tests/distributed/eplb_utils.py73def set_env_vars_and_device(env: dict[str, str]) -> None:CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py11__all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"]CODE
LOWtests/models/language/generation/test_hybrid.py62def _set_conv_state_layout(monkeypatch, layout: str) -> None:CODE
LOWtests/models/qwen4_exp/test_ple.py57def _set_test_embedding_weight_loader(embedding) -> None:CODE
LOWtests/parser/engine/replay_harness.py82 def set_vocab(self, vocab: dict[str, int]) -> None:CODE
LOWtests/quantization/test_gfx950_moe.py39def set_rocm_aiter(monkeypatch: pytest.MonkeyPatch, enabled: bool) -> None:CODE
LOWtests/entrypoints/launchers/test_dp_supervisor.py630async def _set_healthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/launchers/test_dp_supervisor.py640async def _set_unhealthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/responses/conftest.py15logger = logging.getLogger(__name__)CODE
LOW…/entrypoints/openai/responses/test_parsable_context.py21logger = logging.getLogger(__name__)CODE
LOWtests/entrypoints/openai/responses/test_harmony.py30logger = logging.getLogger(__name__)CODE
LOWtests/rocm/test_moe_weight_replay.py64def _set_backend_env(monkeypatch: pytest.MonkeyPatch, backend: str) -> None:CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWbenchmarks/multi_turn/bench_utils.py28logger = logging.getLogger(__name__)CODE
LOWaphrodite/envs.py562logger = logging.getLogger(__name__)CODE
LOWaphrodite/env_override.py393def _update_scheduler_patched(self) -> None:CODE
LOWaphrodite/sampling_params.py829 def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None:CODE
LOWaphrodite/__init__.py76__all__ = [CODE
LOWaphrodite/v1/request.py263 def update_block_hashes(self) -> None:CODE
LOWaphrodite/v1/kv_offload/base.py98 def set_state(self, val: Any) -> None:CODE
LOWaphrodite/v1/kv_offload/tiering/example/manager.py31logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/data/__init__.py6__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/control/__init__.py12__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/session/__init__.py11__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/fs/io.py23logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/metrics/stats.py402 def update_from_output(self, prefill_stats: PrefillStats) -> None:CODE
LOWaphrodite/v1/attention/backend.py600 def set_kernel_block_size(self, kernel_block_size: int) -> None:CODE
LOWaphrodite/v1/attention/backend.py701 def update_draft_decode_metadata(self, metadata: M) -> None:CODE
LOWaphrodite/v1/attention/backends/flash_attn.py772 def update_draft_decode_metadata(self, metadata: FlashAttentionMetadata) -> None:CODE
LOWaphrodite/v1/attention/backends/triton_attn.py260 def update_draft_decode_metadata(self, _metadata: TritonAttentionMetadata) -> None:CODE
LOWaphrodite/v1/attention/backends/flash_attn_diffkv.py40 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/triton_attn_diffkv.py80 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/cpu_attn.py166 def _set_isa_to_layers(self, layer_names: list[str]) -> None:CODE
LOW⚡aphrodite/v1/attention/backends/mla/triton_mla.py97 def update_draft_decode_metadata(self, _metadata: MLACommonMetadata) -> None:CODE
LOWaphrodite/v1/attention/backends/mla/prefill/__init__.py10__all__ = [CODE
LOWaphrodite/v1/attention/ops/triton_decode_attention.py42logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/core/kv_cache_utils.py2156def update_kv_cache_capacity(aphrodite_config: AphroditeConfig, kv_cache_config: KVCacheConfig) -> None:CODE
LOWaphrodite/v1/core/sched/async_scheduler.py19 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/interface.py110 def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None:CODE
LOWaphrodite/v1/core/sched/interface.py203 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOW⚡aphrodite/v1/core/sched/scheduler.py2583 def _update_waiting_for_remote_kv(self, request: Request) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1335 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1382 def _update_request_as_session(self, session: Request, update: StreamingUpdate) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py2113 def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py2305 def set_pause_state(self, pause_state: PauseState) -> None:CODE
466 more matches not shown…
Empty Error Handlers102 hits · 510 pts
SeverityFileLineSnippetContext
HIGHtools/pre_commit/enforce_regex_import.py41except (OSError, UnicodeDecodeError):CODE
HIGHtools/pre_commit/generate_attention_backend_docs.py502except Exception:CODE
HIGHtests/utils.py433except subprocess.TimeoutExpired:CODE
HIGHtests/utils.py531except (ProcessLookupError, OSError):CODE
HIGH…1/kv_connector/unit/test_invalid_blocks_correctness.py251except KeyError:CODE
HIGH…_connector/nixl_integration/nixl_side_channel_probe.py28except ValueError:CODE
HIGH…worker/test_gpu_model_runner_v2_cudagraph_profiling.py182except RuntimeError:CODE
HIGHtests/v1/engine/test_abort_final_step.py80except Exception:CODE
HIGHtests/kernels/moe/modular_kernel_tools/common.py324except NotImplementedError:CODE
HIGHtests/kernels/moe/modular_kernel_tools/common.py191except NotImplementedError:CODE
HIGHtests/distributed/test_mnnvl_alltoall.py39except Exception:CODE
HIGHtests/distributed/test_multiproc_executor.py471except Exception:CODE
HIGH…s/aphrodite_test_utils/aphrodite_test_utils/monitor.py61except NameError:CODE
HIGH…sts/aphrodite_test_utils/aphrodite_test_utils/blame.py47except NameError:CODE
HIGHtests/models/language/generation/test_hybrid.py86except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py125except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py313except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py353except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py448except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py512except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py591except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py660except ValueError:CODE
HIGHtests/models/language/generation/test_hybrid.py739except ValueError:CODE
HIGHtests/compile/fusions_e2e/common.py67except ImportError:CODE
HIGHtests/compile/fusions_e2e/common.py78except ImportError:CODE
HIGH…transcription/test_transcription_validation_whisper.py48except Exception:CODE
HIGHtests/entrypoints/launchers/test_shutdown.py239except asyncio.TimeoutError:CODE
HIGHtests/entrypoints/launchers/test_shutdown.py408except asyncio.TimeoutError:CODE
HIGHtests/entrypoints/launchers/test_shutdown.py525except asyncio.TimeoutError:CODE
HIGHtests/entrypoints/launchers/test_shutdown.py57except psutil.NoSuchProcess:CODE
HIGHtests/entrypoints/serve/dev/rlhf/conftest.py159except Exception:CODE
HIGH…ts/serve/sagemaker/test_sagemaker_handler_overrides.py112except ImportError:CODE
HIGHtests/lora/test_layers.py122except Exception:CODE
HIGHtests/basic_correctness/test_basic_correctness.py65except Exception:CODE
HIGHexamples/fp8/extract_scales.py225except KeyError:CODE
HIGHexamples/fp8/extract_scales.py231except ValueError:CODE
HIGHexamples/rl/rdt_aphrodite_serve.py109except requests.RequestException:CODE
HIGHaphrodite/env_override.py794except ImportError:CODE
HIGHaphrodite/env_override.py520except Exception:CODE
HIGHaphrodite/logger.py284except NameError:CODE
HIGHaphrodite/v1/attention/backends/turboquant_attn.py473except Exception: # noqa: BLE001CODE
HIGHaphrodite/v1/attention/backends/cpu_attn.py452except Exception:CODE
HIGHaphrodite/v1/attention/backends/fa_utils.py298except (ImportError, AssertionError):CODE
HIGHaphrodite/v1/attention/ops/flydsl_turboquant_decode.py163except Exception: # noqa: BLE001CODE
HIGHaphrodite/v1/spec_decode/vocab_mapping.py29except Exception:CODE
HIGHaphrodite/v1/engine/async_llm.py190except RuntimeError:CODE
HIGHaphrodite/v1/engine/core_client.py1032except RuntimeError:CODE
HIGHaphrodite/v1/engine/core_client.py1287except RuntimeError:CODE
HIGHaphrodite/tool_parsers/hy_v4_tool_parser.py284except Exception:CODE
HIGHaphrodite/tool_parsers/hy_v4_tool_parser.py288except Exception:CODE
HIGHaphrodite/tool_parsers/hy_v4_tool_parser.py329except (json.JSONDecodeError, ValueError):CODE
HIGHaphrodite/tool_parsers/hunyuan_a13b_tool_parser.py197except json.JSONDecodeError:CODE
HIGHaphrodite/tool_parsers/apertus_tool_parser.py342except Exception:CODE
HIGHaphrodite/tool_parsers/hy_v3_tool_parser.py195except Exception:CODE
HIGHaphrodite/tool_parsers/hy_v3_tool_parser.py199except Exception:CODE
HIGHaphrodite/tool_parsers/hy_v3_tool_parser.py242except (json.JSONDecodeError, ValueError):CODE
HIGHaphrodite/tool_parsers/poolside_v1_tool_parser.py102except json.JSONDecodeError:CODE
HIGHaphrodite/tool_parsers/poolside_v1_tool_parser.py107except (ValueError, SyntaxError):CODE
HIGHaphrodite/tool_parsers/xlam_tool_parser.py233except json.JSONDecodeError:CODE
HIGHaphrodite/tool_parsers/xlam_tool_parser.py427except (json.JSONDecodeError, KeyError, IndexError):CODE
42 more matches not shown…
AI Structural Patterns397 hits · 362 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py382CODE
LOWtests/conftest.py420CODE
LOWtests/conftest.py927CODE
LOWtests/v1/kv_offload/test_factory.py41CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py596CODE
LOWtests/v1/attention/utils.py174CODE
LOWtests/v1/attention/test_attention_backends.py370CODE
LOWtests/v1/core/test_kv_cache_utils.py131CODE
LOWtests/v1/core/test_scheduler.py2676CODE
LOWtests/v1/core/test_scheduler.py2797CODE
LOWtests/v1/core/utils.py51CODE
LOWtests/v1/core/utils.py218CODE
LOWtests/v1/kv_connector/unit/test_tp_mapping.py32CODE
LOWtests/v1/kv_connector/unit/test_nixl_connector.py2788CODE
LOW…sts/v1/kv_connector/unit/test_mooncake_store_worker.py133CODE
LOWtests/v1/kv_connector/unit/test_moriio_connector.py231CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py368CODE
LOWtests/v1/kv_connector/unit/utils.py77CODE
LOWtests/v1/kv_connector/unit/utils.py179CODE
LOW…/kv_connector/unit/offloading_connector/test_config.py288CODE
LOWtests/v1/sample/test_rejection_sampler.py65CODE
LOWtests/v1/e2e/general/test_mamba_prefix_cache.py163CODE
LOWtests/v1/simple_kv_offload/test_kv_events.py140CODE
LOWtests/kernels/test_gate_linear_rocm_dispatch.py21CODE
LOWtests/kernels/utils.py327CODE
LOWtests/kernels/utils.py870CODE
LOWtests/kernels/attention/test_mha_attn.py125CODE
LOWtests/kernels/attention/test_attention.py54CODE
LOW…sts/kernels/attention/test_triton_prefill_attention.py71CODE
LOWtests/kernels/mamba/test_mamba_ssm.py112CODE
LOWtests/kernels/mamba/utils.py73CODE
LOWtests/kernels/quantization/test_nvfp4_quant.py81CODE
LOWtests/kernels/moe/test_deepep_v2_moe.py190CODE
LOWtests/kernels/moe/test_moe_permute_unpermute.py104CODE
LOWtests/kernels/moe/test_moe.py2036CODE
LOWtests/kernels/moe/utils.py56CODE
LOWtests/kernels/moe/utils.py116CODE
LOWtests/kernels/moe/test_moe_layer.py1009CODE
LOWtests/kernels/moe/test_moe_layer.py1108CODE
LOWtests/evals/mrcr/mrcr_eval.py159CODE
LOWtests/evals/gsm8k/gsm8k_eval.py204CODE
LOWtests/distributed/test_multiproc_executor.py70CODE
LOWtests/models/kimi_k3/test_kda_metadata.py83CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py522CODE
LOWtests/models/transformers/fusers/test_moe.py186CODE
LOWtests/quantization/reference_mxfp4.py76CODE
LOWtests/quantization/reference_mxfp4.py211CODE
LOWtests/compile/test_graph_partition.py96CODE
LOWtests/compile/fullgraph/test_toy_llama.py151CODE
LOWtests/compile/passes/test_silu_mul_quant_fusion.py128CODE
LOWtests/compile/passes/test_fusion.py466CODE
LOWtests/benchmarks/test_random_dataset.py171CODE
LOWtests/entrypoints/cohere/test_serving_streaming.py76CODE
LOWtests/entrypoints/cohere/test_serving_conversion.py120CODE
LOWtests/entrypoints/openai/utils.py135CODE
LOWexamples/pooling/token_embed/jina_reranker_v3_online.py22CODE
LOWbenchmarks/attention_benchmarks/mla_runner.py109CODE
LOWbenchmarks/kernels/benchmark_mrope.py78CODE
LOWaphrodite/sampling_params.py460CODE
LOWaphrodite/_custom_ops.py3045CODE
337 more matches not shown…
Redundant / Tautological Comments225 hits · 342 pts
SeverityFileLineSnippetContext
LOWtools/install_torchcodec_rocm.sh19# Check if torchcodec is already installed and workingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py525 # Check if this is an MLA backend by parent class or namingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py1218 # Check if this is the "if use_mla:" branchCOMMENT
LOWtests/conftest.py396 # Set this to avoid hanging issueCOMMENT
LOWtests/conftest.py943 # Set this to avoid hanging issueCOMMENT
LOWtests/utils.py529 os.kill(spid, 0) # Check if still aliveCODE
LOWtests/test_config.py1304 # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_configCOMMENT
LOWtests/v1/attention/test_mla_backends.py1390 # Set num_speculative_tokens to query_len - 1COMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py736 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py740 # Set some to out of boundsCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py792 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py796 # Set some to out of boundsCOMMENT
LOWtests/v1/core/test_scheduler.py2857 # Verify if position length is identicalCOMMENT
LOWtests/v1/core/test_scheduler.py3792 # Check if scheduled_encoder_inputs is empty as expectedCOMMENT
LOWtests/v1/core/test_scheduler.py4210 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/test_scheduler.py4518 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/utils.py269 # Verify if position length is identicalCOMMENT
LOW…extract_hidden_states_integration/predictable_llama.py81 # Check if we need auxiliary hidden statesCOMMENT
LOW…nnector/nixl_integration/config_sweep_accuracy_test.sh99# Check if cross-layers is enabled (non-empty)COMMENT
LOWtests/v1/determinism/test_batch_invariance.py284 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py540 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py752 # Check if tokens matchCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py770 # Check if logprobs match bitwiseCOMMENT
LOWtests/v1/spec_decode/test_acceptance_length.py108 # Check if get_valid_backends is actually defined in the platform classCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh28# Set 1 to use multimodal prompts; else to use text-onlyCOMMENT
LOW…ts/v1/ec_connector/integration/test_epd_correctness.py217 # Check if server is readyCOMMENT
LOWtests/v1/e2e/spec_decode/draft_model/test_async.py34 # Increment counterCOMMENT
LOWtests/v1/engine/test_engine_core_client.py422 # Check if all request IDs in outputs have finishedCOMMENT
LOWtests/v1/engine/utils.py131 # Check if the sampled_token_id occurs in choice_tensor[1:]COMMENT
LOWtests/utils_/test_network_utils.py182 # Check if IPv6 is supported by trying to create an IPv6 socketCOMMENT
LOW…/kernels/quantization/test_rocm_aiter_grouped_quant.py21# Check if aiter package is installedCOMMENT
LOWtests/kernels/moe/test_moe_layer.py1924 # Check if enough GPUs availableCOMMENT
LOW⚡tests/kernels/moe/test_rocm_aiter_topk.py26# Check if aiter package is installedCOMMENT
LOW⚡tests/kernels/moe/test_rocm_aiter_topk.py35 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOW⚡tests/kernels/moe/test_rocm_aiter_topk.py38 # Check if the op is callableCOMMENT
LOW⚡tests/kernels/moe/test_rocm_aiter_topk.py44 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOW⚡tests/kernels/moe/test_rocm_aiter_topk.py47 # Check if the op is callableCOMMENT
LOWtests/evals/gsm8k/gsm8k_eval.py359 # Print results to terminalCOMMENT
LOWtests/distributed/test_eplb_execute.py146 # Check if the weights are correctCOMMENT
LOWtests/model_executor/test_qwen3_omni.py33 # Check if it's a special token that should be compressedCOMMENT
LOW…model_loader/runai_streamer_loader/test_runai_utils.py56 # Read the file in chunks to handle large files efficientlyCOMMENT
LOW⚡tests/models/multimodal/generation/test_maverick.py59 # Print the outputsCOMMENT
LOWtests/quantization/test_gptq_v2.py43 # Check if gptq_v2 format is correctly loadedCOMMENT
LOWtests/quantization/test_gptq_v2.py105 # Print the output sequences if failedCOMMENT
LOW⚡tests/multimodal/media/test_audio.py139 # Set limit to 1 MiB — should rejectCOMMENT
LOWtests/compile/test_config.py54 # Check if get_raw_stream exists in builtinsCOMMENT
LOWtests/compile/fusions_e2e/conftest.py42 # Print the outputs.COMMENT
LOWtests/compile/fullgraph/test_full_graph.py173 # Print the outputs.COMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py75 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py143 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/launchers/test_shutdown.py99 # Check if any choice has finish_reason='abort'COMMENT
LOWtests/entrypoints/serve/utils/test_request_logger.py94 # Set max_log_len to 10COMMENT
LOW…rve/sagemaker/test_sagemaker_middleware_integration.py314 # Check if environment variable middleware was appliedCOMMENT
LOWtests/lora/test_transformers_model.py39 # Print the outputs.COMMENT
LOWtests/lora/test_gptoss_tp.py80 # Print the outputs.COMMENT
LOWtests/lora/test_qwen3moe_tp.py55 # Print the outputs.COMMENT
LOWtests/lora/test_chatglm3_tp.py38 # Print the outputs.COMMENT
LOWtests/lora/test_deepseekv2_tp.py28 # Print the outputs.COMMENT
LOWtests/lora/test_minicpmv_tp.py51 # Print the outputs.COMMENT
LOWtests/lora/test_mixtral.py21 # Print the outputs.COMMENT
165 more matches not shown…
Cross-Language Confusion60 hits · 312 pts
SeverityFileLineSnippetContext
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py161 (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)CODE
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py235 "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)",CODE
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py490 "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py493 "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py494 "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py497 "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py498 "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py499 "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py502 "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py503 "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)),STRING
HIGH⚡csrc/libtorch_stable/quantization/machete/generate.py506 "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)),STRING
HIGHtests/v1/attention/test_mm_prefix.py409# null, so is_mm_prefix_lm is False out of the box. Tests that exercise theCOMMENT
HIGHtests/v1/attention/test_mla_backends.py534 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/attention/test_attention_backends.py190 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGH⚡tests/v1/core/test_scheduler.py3534 num_blocks=5, # Can hold 64 tokens (first block is null)CODE
HIGH⚡tests/v1/core/test_scheduler.py4373 num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py4600 num_blocks=11, # Can hold 160 tokens (first block is null)CODE
HIGH…_connector/unit/offloading_connector/test_scheduler.py3286 # 4 GPU blocks: block 0 is null, blocks 1-3 are usable.COMMENT
HIGH…_connector/unit/offloading_connector/test_scheduler.py269 are similar -- neither is required to retain the whole prefix, so a non-null,STRING
HIGHtests/tool_parsers/test_granite_tool_parser.py41 "null_field": null,CODE
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py33 "null_field": null,CODE
HIGH⚡tests/tool_parsers/test_olmo3_tool_parser.py34 "role=null, "CODE
HIGH⚡tests/tool_parsers/test_olmo3_tool_parser.py43 '"role": null, 'CODE
HIGH⚡tests/tool_parsers/test_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_deepseekv3_tool_parser.py41 """"bool_field": true, "null_field": null, """STRING
HIGHtests/tool_parsers/test_internlm2_tool_parser.py54 "null_field": null,CODE
HIGHtests/tool_parsers/test_llama4_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py49 "null_field": null,CODE
HIGH⚡tests/tool_parsers/test_lfm2_tool_parser.py38 '"role": null, 'CODE
HIGHtests/tool_parsers/test_lfm2_tool_parser.py73 "bash(command='cd /testbed && python3 -c \"from sympy import latex\nprint(latex(3*x, mul_symbol='\\,'))\"')"CODE
HIGHtests/tool_parsers/test_lfm2_tool_parser.py78 '{"command": "cd /testbed && python3 -c \\"from sympy import latex\\n'CODE
HIGHtests/tool_parsers/test_longcat_tool_parser.py53 "null_field": null,CODE
HIGH⚡tests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
HIGHtests/tool_parsers/test_qwen3coder_tool_parser.py570 # Multi non-null: anyOf[string, integer, null] → first non-null is stringCOMMENT
HIGH⚡tests/parser/engine/test_qwen3.py257 ' "multiSelect": false, "answer": null}]'CODE
HIGH⚡tests/parser/engine/test_qwen3.py267 "questions": '[{"question": "Pick a color", "multiSelect": false, "answer": null}]',CODE
HIGH⚡tests/parser/engine/test_qwen3.py1042 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py1061 ' "multiSelect": false, "answer": null}]',CODE
HIGH⚡tests/parser/engine/test_parser_engine.py599 result = engine._fix_arg_types('{"val": null}', "f")CODE
HIGH⚡tests/parser/engine/test_gemma4_streaming_reasoning.py1202 text = "<|tool_call>call:configure{value:null}<tool_call|>"CODE
HIGH⚡tests/parser/engine/test_gemma4_streaming_reasoning.py1208 text = "<|tool_call>call:configure{label:null}<tool_call|>"CODE
HIGH⚡tests/parser/mistral/test_tool_calls.py2402_REAL_LEAK_CONTENT = 'bash[TOOL_CALLS]{"command": "cd /testbed && git diff xarray/core/weighted.py"}ometracediff --git aCODE
HIGH⚡tests/parser/mistral/test_tool_calls.py2415 {"command": "cd /testbed && git diff xarray/core/weighted.py"}CODE
HIGH⚡tests/entrypoints/unit_tests/test_chat_utils.py3015 bad = '{"cmd": "mkdir -p /tmp/mmadtest && cat > /tmp/mmadtest'CODE
HIGH…e_out/token_in_token_out/test_return_routed_experts.py36 '{"sliding_window": null}',CODE
HIGHtests/entrypoints/openai/test_return_routed_experts.py45 '{"sliding_window": null}',CODE
HIGHaphrodite/_custom_ops.py2221 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2326 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2203 input_tensor: The input tensor with gate || up layout [m_topk, k*2]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1231 # result [null] [null] ... [null] [hit block 1 (1st block containCOMMENT
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py470 every (non-null) block — the default for full attention.STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1184 [null, null, block 3], otherwise, we return [null, null]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1189 we return 4 blocks[null, null, null, null]STRING
HIGHaphrodite/tool_parsers/utils.py433 (null, true, false) that some models produce instead of PythonSTRING
HIGHaphrodite/metal/mlx_backend/mla_cache.py11 Each token's cache entry is a combined latent vector [kv_norm || k_pe]:STRING
HIGHaphrodite/metal/paged_attention_backend/mla.py29 latent = [kv_norm || k_pe_roped] # kv_lora_rank + qk_rope_head_dim dimsSTRING
HIGH…ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py47 cd FlexKV && bash build.shSTRING
HIGH…d/kv_transfer/kv_connector/v1/mooncake/store/worker.py204 raise TypeError(f"tenant_id must be a string or null, got {type(value).__name__}: {value!r}")CODE
HIGH…transfer/kv_connector/v1/mooncake/store/coordinator.py211 blocks in place), so a positional read may hit a null, freed, or liveSTRING
HIGHaphrodite/benchmarks/datasets/datasets.py3971 # undefined), language (en), transcription directive (en), punctuationSTRING
Structural Annotation Overuse168 hits · 310 pts
SeverityFileLineSnippetContext
LOW⚡build_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOW⚡build_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOW⚡build_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOW⚡tests/v1/kv_offload/tiering/test_async_lookup.py183 # Step 1: lookup key 1, flushCOMMENT
LOW⚡tests/v1/kv_offload/tiering/test_async_lookup.py189 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOW⚡tests/v1/kv_offload/tiering/p2p/test_sessions.py836 # Step 1: probe hA, hB.COMMENT
LOW⚡tests/v1/kv_offload/tiering/p2p/test_sessions.py846 # Step 2: a new key is discovered for the same request. TheCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1221 # Step 1: think-start token appears.COMMENT
LOW⚡tests/v1/core/test_scheduler.py5742 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOW⚡tests/v1/core/test_scheduler.py5752 # Step 2: nothing changes until A's recv lands.COMMENT
LOW⚡tests/v1/core/test_scheduler.py5761 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py679 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py695 # Step 2: For each token position, run prefill and compareCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py371 # Step 2: Schedule creates NewRequestDataCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py381 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py434 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py442 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py495 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py410 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py474 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py507 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py520 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py531 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py86 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py102 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py118 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py155 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py175 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py192 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py61 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py79 # Step 2: Create new request data with extended promptCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py98 # Step 3: Update the requestCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py179 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py123 # Step 1: unseen remote item -> read started, request deferred.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py133 # Step 2: poll drains completion -> entry marked ready, request admitted.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py170 # Step 1: start the read.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py178 # Step 2: poll discards the entry and records a tombstone; the tombstoneCOMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py185 # Step 3: tombstone was consumed, so a fresh transfer starts again.COMMENT
LOW…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py146 # Step 3: still cached -> admitted directly, no new transfer.COMMENT
LOW⚡tests/v1/ec_connector/integration/README.md61### Step 1: BaselineCOMMENT
108 more matches not shown…
Verbosity Indicators152 hits · 284 pts
SeverityFileLineSnippetContext
LOW⚡build_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOW⚡build_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOW⚡build_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOW⚡tests/v1/kv_offload/tiering/test_async_lookup.py183 # Step 1: lookup key 1, flushCOMMENT
LOW⚡tests/v1/kv_offload/tiering/test_async_lookup.py189 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOW⚡tests/v1/kv_offload/tiering/p2p/test_sessions.py836 # Step 1: probe hA, hB.COMMENT
LOW⚡tests/v1/kv_offload/tiering/p2p/test_sessions.py846 # Step 2: a new key is discovered for the same request. TheCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1221 # Step 1: think-start token appears.COMMENT
LOW⚡tests/v1/core/test_scheduler.py5742 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOW⚡tests/v1/core/test_scheduler.py5752 # Step 2: nothing changes until A's recv lands.COMMENT
LOW⚡tests/v1/core/test_scheduler.py5761 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOW⚡tests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW⚡…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py679 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py695 # Step 2: For each token position, run prefill and compareCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py371 # Step 2: Schedule creates NewRequestDataCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py381 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py434 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py442 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOW⚡tests/v1/streaming_input/test_scheduler_streaming.py495 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py410 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py474 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py507 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py520 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py531 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py86 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py102 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py118 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py155 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py175 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py192 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py61 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py79 # Step 2: Create new request data with extended promptCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py98 # Step 3: Update the requestCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW⚡…/v1/streaming_input/test_gpu_model_runner_streaming.py179 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py123 # Step 1: unseen remote item -> read started, request deferred.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py133 # Step 2: poll drains completion -> entry marked ready, request admitted.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py170 # Step 1: start the read.COMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py178 # Step 2: poll discards the entry and records a tombstone; the tombstoneCOMMENT
LOW⚡…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py185 # Step 3: tombstone was consumed, so a fresh transfer starts again.COMMENT
LOW…s/v1/ec_connector/unit/test_scheduler_nixl_consumer.py146 # Step 3: still cached -> admitted directly, no new transfer.COMMENT
LOW⚡…1/ec_connector/integration/run_epd_correctness_test.sh487# Step 1: Run baselineCOMMENT
92 more matches not shown…
Docstring Block Structure50 hits · 250 pts
SeverityFileLineSnippetContext
HIGHbenchmarks/benchmark_long_document_qa_throughput.py70 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGHaphrodite/_xpu_ops.py284XPU FP8 batched GEMM implementation for ``torch.ops.aphrodite.xpu_fp8_bmm``. Computes batched matrix multiplicationSTRING
HIGHaphrodite/v1/kv_offload/tiering/factory.py59Get a secondary tier class by type. Args: tier_config: Tier configuration dict. Must contain 'type'STRING
HIGHaphrodite/v1/attention/backends/registry.py212Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register STRING
HIGHaphrodite/v1/attention/backends/mla/prefill/registry.py91Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum memberSTRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1171 For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lonSTRING
HIGHaphrodite/v1/structured_output/utils.py387 Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: STRING
HIGHaphrodite/v1/structured_output/utils.py419 Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/STRING
HIGHaphrodite/v1/worker/utils.py314 Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_manaSTRING
HIGHaphrodite/tool_parsers/hy_v4_tool_parser.py91Detect the per-checkpoint suffix used by Hunyuan structural tokens. Args: tokenizer: Tokenizer of the serveSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py134 Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunkSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py178 Extracts tool calls from a completely generated model response (Non-Streaming). Args: modeSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py274 Handles streaming chunks Args: previous_text: The complete model text generated prior to tSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py467 Calculates the exact string difference to safely append new tool parameters. This ensures characters lSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py166Project ``x`` into Q/K/V with norms, RoPE and Gemma4 variants. Handles three Gemma4-specific branches: - **YOCSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py308Zero-pad Q/K/V on the last axis up to ``cache_head_dim``. Variable head_dim models (e.g. Gemma4 sliding=256, full=5STRING
HIGHaphrodite/metal/v1/model_adapter.py231Return per-layer ``(kv_heads, head_dim)`` lists for Gemma4, else None. Gemma4 26B/31B mix sliding attention (``STRING
HIGHaphrodite/metal/stt/audio.py57Load an audio file and return mono samples at *sample_rate* Hz. Tries ``librosa`` first (handles WAV natively withoSTRING
HIGHaphrodite/metal/stt/audio.py90Load audio via ffmpeg subprocess. Args: file_path: Path to the audio file. sample_rate: Target sampSTRING
HIGH…ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py709 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…rodite/distributed/kv_transfer/kv_connector/v1/base.py451 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py276Get remote allocation info for a request. Args: transfer_id:TransferId The request ID RetuSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py194 Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and hSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py544 Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engineSTRING
HIGHaphrodite/distributed/weight_transfer/factory.py89Create a weight transfer engine instance. Args: config: Weight transfer configuration containing thSTRING
HIGHaphrodite/distributed/weight_transfer/base.py419 Construct typed init info from dict with validation. Args: init_dict: Dictionary containinSTRING
HIGHaphrodite/distributed/weight_transfer/base.py437 Construct typed update info from dict with validation. Args: update_dict: Dictionary contaSTRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py624 Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the STRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py790 Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to choSTRING
HIGHaphrodite/model_executor/layers/fused_moe/utils.py60Resolve whether AITER fused shared-expert execution is enabled. Args: quant_config: Model quantization confSTRING
HIGHaphrodite/model_executor/layers/fused_moe/moe_output.py44Normalize the two FlashInfer TRTLLM MoE return layouts. Args: flashinfer_output: Tensor returned by the FlaSTRING
HIGH…/model_executor/layers/fused_moe/expert_map_manager.py322 Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nuSTRING
HIGH…cutor/layers/fused_moe/experts/ocp_mx_emulation_moe.py41Activation dtype `moe_kernel_quantize_input` should fake-quantize to. Args: ocp_mx_scheme: The OCP MX schemSTRING
HIGHaphrodite/model_executor/models/keye_vl1_5.py77 Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wiSTRING
HIGHaphrodite/model_executor/models/isaac.py230Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): STRING
HIGHaphrodite/models/hy_v4/nvidia/attention.py55Return the backbone layers that reuse a previous layer's top-k indices. A "shared" indexer layer performs sparse atSTRING
HIGHaphrodite/models/hy_v4/nvidia/flashmla_sparse.py120Return the sink laid out for the kernel's query head count. Args: q: Query tensor, before any head STRING
HIGH…ls/glm5next/amd/ops/third_party/kda/fused_recurrent.py544 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGH…glm5next/nvidia/ops/third_party/kda/fused_recurrent.py544 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHaphrodite/reasoning/hy_v4_reasoning_parser.py36Detect the per-checkpoint suffix used by Hunyuan structural tokens. Args: tokenizer: Tokenizer of the serveSTRING
HIGHaphrodite/multimodal/gpu_ipc_memory.py160Return KV-cache memory remaining after frontend multimodal reservations. The reservation covers: * The total `STRING
HIGHaphrodite/multimodal/audio.py92Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppoSTRING
HIGHaphrodite/multimodal/audio.py316Split audio into chunks with intelligent split points. Splits long audio into smaller chunks at low-energy regions STRING
HIGH…rodite/third_party/flash_linear_attention/ops/chunk.py147 Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGH…rd_party/flash_linear_attention/ops/fused_recurrent.py516 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHaphrodite/benchmarks/lib/ready_checker.py25 Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async reqSTRING
HIGHaphrodite/entrypoints/chat_utils.py1536 Parses a given multi-modal content part based on its type. Args: part: A dict containing the content pSTRING
HIGHaphrodite/entrypoints/speech_to_text/base/utils.py18Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the ConteSTRING
HIGHaphrodite/transformers_utils/processors/isaac.py174Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): TensoSTRING
HIGHaphrodite/lora/resolver.py69Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. STRING
AI Slop Vocabulary82 hits · 183 pts
SeverityFileLineSnippetContext
MEDIUMcsrc/cpu/sgl-kernels/decode.cpp1434 // use smaller BLOCK_H when batches is small to utilize all coresCOMMENT
LOWcsrc/libtorch_stable/quantization/machete/generate.py413 # For now, we can just use the first accumulator type seen sinceSTRING
MEDIUMtests/v1/logits_processors/test_custom_offline.py30# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
LOWtests/v1/cudagraph/test_breakable_cudagraph.py307 # Outside capture: decorator should just call through.COMMENT
MEDIUM⚡tests/renderers/test_sparse_tensor_validation.py67 # explicitly so this fixture is robust to process-wide invariant-check stateCOMMENT
MEDIUMtests/kernels/attention/test_attention_selector.py520 # binding, so patch is_xpu there (not on flash_attn's) to stay robust toCOMMENT
MEDIUMtests/kernels/mamba/test_mamba_mixer2.py106 # - utilize mock patching to disable TP whenCOMMENT
MEDIUMtests/distributed/test_pynccl.py373 # Essentially this is an all-gather operation.COMMENT
MEDIUMtests/distributed/test_context_parallel.py46 # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yamlCOMMENT
MEDIUMtests/distributed/test_context_parallel.py48 # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yamlCOMMENT
MEDIUMtests/distributed/test_sharded_rdt_trainer.py393 assert server.live_count == 1 # num_consumers=1 in the harnessCODE
LOWtests/model_executor/test_qwen3_omni.py45 # Regular token, just add itCOMMENT
MEDIUMtests/models/registry.py950 # Keep the init/schema harness eager (these tests never run forward).COMMENT
MEDIUMtests/parser/engine/test_replay.py66 # token, so it does not fit this TOOL_END-based replay harness.COMMENT
MEDIUMtests/parser/engine/test_delegating_replay.py82 # token, so it does not fit this TOOL_END-based replay harness.COMMENT
MEDIUM⚡tests/entrypoints/serve/dev/rlhf/conftest.py67# Server harnessCOMMENT
LOWexamples/offline_inference/ray_distributed_inference.py71 # For tensor_parallel_size == 1, we simply set num_gpus=1.COMMENT
LOWbenchmarks/attention_benchmarks/benchmark.py435 # No parameters, just use template as-isCOMMENT
MEDIUMbenchmarks/kernels/benchmark_silu_mul_fp8_quant.py678# Create comprehensive 3-way comparison plotsCOMMENT
LOWaphrodite/env_override.py312# functions just return True.COMMENT
LOWaphrodite/v1/attention/backends/flash_attn.py352 # but for now just set it to `UNIFORM_BATCH` to get use to drop downCOMMENT
LOWaphrodite/v1/attention/backends/utils.py464 # then we can simply use a cdiv for the rest.COMMENT
MEDIUMaphrodite/v1/attention/ops/triton_decode_attention.py358 # explicitly facilitate overlapping load/computeCOMMENT
LOWaphrodite/v1/core/kv_cache_coordinator.py498 # Single group; useless but just set ``use_eagle`` for consistency regardless.COMMENT
MEDIUMaphrodite/v1/core/encoder_cache_manager.py335# utilize the cache and this class will fold into EncoderCacheManager, asCOMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py568 # KV cache in sync, so just return an empty tensor.COMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py1726 # Therefore, we can just return the logits.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py778 # CUDAGraph memory size and may not utilize all gpu memory.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py1115 # Generate the trace name by combining prefix with comprehensive rank suffixCOMMENT
LOWaphrodite/v1/worker/gpu/model_runner.py1693 # For piecewise and eager mode, just call model().COMMENT
LOWaphrodite/v1/engine/parallel_sampling.py116 # If streaming, just return the current outputCOMMENT
MEDIUMaphrodite/tool_parsers/llama_tool_parser.py219 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/jamba_tool_parser.py182 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/granite_tool_parser.py163 # re-set stuff pertaining to progress in the current toolCOMMENT
LOWaphrodite/tool_parsers/xlam_tool_parser.py492 # If we encounter an error, just return the delta text as regular contentCOMMENT
MEDIUMaphrodite/tool_parsers/granite_20b_fc_tool_parser.py177 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/step3_tool_parser.py51 # Explicit state flags for robust streamingCOMMENT
LOWaphrodite/tokenizers/mistral.py499 # if underlying tokenizer is sentencepiece, we just add "�".COMMENT
LOWaphrodite/platforms/cuda.py762 # users can just use IR op priority directlyCOMMENT
MEDIUMaphrodite/distributed/utils.py321 """A robust barrier to synchronize all ranks.STRING
MEDIUM…ibuted/kv_transfer/kv_connector/v1/nixl/base_worker.py854 # we can leverage host_buffer for permute.COMMENT
MEDIUM…ransfer/kv_connector/v1/mooncake/mooncake_connector.py844 # Tasks can await async events, so a surplus (2x is a robust heuristic)COMMENT
MEDIUMaphrodite/config/model.py352 """Enable the custom cumem allocator to leverage advanced GPU memorySTRING
MEDIUMaphrodite/config/parallel.py630 # To make the initialization more robust we retry a few timesCOMMENT
LOW…odite/model_executor/layers/mamba/ops/causal_conv1d.py188 # first chunk and does not have prior-token, so just set to 0COMMENT
MEDIUM…dite/model_executor/layers/fused_moe/modular_kernel.py50# The goal is to be able to utilize different communication mechanisms withCOMMENT
MEDIUM…xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py38 # TODO (varun) : Optimize leverage num_tokens_per_expert countsCOMMENT
MEDIUM…executor/layers/fused_moe/experts/fused_humming_moe.py449 # Neighboring nodes are required to utilize distinct workspaces.COMMENT
MEDIUMaphrodite/model_executor/layers/quantization/fp8.py254 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…hrodite/model_executor/layers/quantization/modelopt.py328 # Normalize quant_algo for robust matching (ModelOpt may emit lowercase).COMMENT
MEDIUM…odite/model_executor/layers/quantization/fbgemm_fp8.py53 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py107 # to fully utilize the E4M3 dynamic range (e.g., global_scale=1).COMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py165 # For GPUs that lack FP4 hardware support, we can leverage theCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp8.py60 # For GPUs that lack FP8 hardware support, we can leverage theCOMMENT
LOW…odel_executor/layers/quantization/utils/quant_utils.py503 # Unquantized layer: just return base weightsCOMMENT
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py142 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py142 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
LOWaphrodite/model_executor/models/qwen3_asr.py528 # No audio features, just return linear positionsCOMMENT
LOW…odite/model_executor/models/transformers/multimodal.py560 # NOTE: we can't just set caching=False because base class methodCOMMENT
MEDIUMaphrodite/models/hy_v4/nvidia/hc.py159 # present; getattr keeps this robust if that ever changes.COMMENT
22 more matches not shown…
Hallucination Indicators11 hits · 115 pts
SeverityFileLineSnippetContext
CRITICALrust/src/cmd/src/cli/unsupported.rs141/// - `aphrodite.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)`COMMENT
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py753 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py984 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py1003 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/distributed/test_torchrun_example_moe.py80params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/distributed/test_torchrun_example.py71params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/models/language/generation/test_gemma.py64 lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501CODE
CRITICALtests/models/language/generation/test_gemma.py68 normalizers = llm.llm.collective_rpc(lambda self: self.model_runner.model.model.normalizer.cpu().item())CODE
CRITICALaphrodite/v1/spec_decode/llm_base_proposer.py1377 self.model.model.embed_tokens.weight.cpu(),CODE
CRITICAL…rodite/third_party/flash_linear_attention/ops/utils.py158 triton.runtime.driver.active.utils.get_device_properties(i)["max_shared_mem"]CODE
CRITICALaphrodite/entrypoints/cli/main.py42 aphrodite.entrypoints.cli.benchmark.main.maybe_exec_rust_bench()CODE
Modern AI Meta-Vocabulary32 hits · 90 pts
SeverityFileLineSnippetContext
MEDIUMconfig.yaml22 # The maximum sequence length/context window for the modelCOMMENT
MEDIUM⚡tools/pre_commit/generate_attention_backend_docs.py1621# Top-level orchestrationCOMMENT
MEDIUM⚡tests/v1/kv_offload/tiering/p2p/test_manager.py1277# _poll_once orchestrationCOMMENT
MEDIUMtests/v1/core/test_scheduler.py1005 # happen when max_tokens is clamped to the context window afterCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_offloading_connector.py151 # Use a long prompt that fits within the model's context window.COMMENT
MEDIUMtests/v1/engine/test_async_llm.py830 # Wait for generation to start (event-driven)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py872 # Wait for some tokens (event-driven, handles slow token generation)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py929 # Wait for at least one token across any request (event-driven)COMMENT
MEDIUMtests/tool_parsers/test_lfm2_tool_parser.py272 # Messy agentic shell commands: literal bracket inside a string argumentCOMMENT
MEDIUMtests/renderers/test_cohere.py425 # chain-of-thought across the rendered prompt.COMMENT
MEDIUMtests/evals/mrcr/mrcr_eval.py32# Skip chain-of-thought on reasoning models; ignored by non-reasoning templates.COMMENT
MEDIUMtests/compile/fullgraph/test_basic_correctness.py39 # embedding modelCOMMENT
MEDIUMtests/entrypoints/cohere/test_serving_conversion.py404 # Cohere's ``tool_plan`` is the older chain-of-thought field; itCOMMENT
MEDIUMtests/entrypoints/openai/responses/test_harmony.py591 # NOTE: chain-of-thought should be removed.COMMENT
MEDIUM…ntrypoints/openai/chat_completion/test_serving_chat.py1216 # adding max_tokens should exceed the model context window.COMMENT
MEDIUMaphrodite/_xpu_ops.py1037 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMaphrodite/v1/attention/ops/vit_attn_wrappers.py258 # Without it, hallucinations occur with the backendCOMMENT
MEDIUMaphrodite/v1/executor/abstract.py45 uses_ray: bool = False # whether the executor uses Ray for orchestration.CODE
MEDIUMaphrodite/platforms/cpu.py156 # the shared MLA scaffolding so that DeepSeek-style models canCOMMENT
MEDIUMaphrodite/metal/stt/whisper/config.py13# Maximum decode tokens for Whisper models (matches Whisper context window).COMMENT
MEDIUM⚡…ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py273 # progress is event-driven (see module docstring).COMMENT
MEDIUM…d/kv_transfer/kv_connector/v1/mooncake/store/worker.py4# The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread,COMMENT
MEDIUMaphrodite/model_executor/models/granite_speech.py81# work pretty well with zero shot.COMMENT
MEDIUMaphrodite/model_executor/models/phi3v.py567 # initialized as an embedding modelCOMMENT
MEDIUMaphrodite/models/minimax_m3/amd/model.py1363# NVIDIA copy — it only orchestrates the shared vision tower + the per-platformCOMMENT
MEDIUMaphrodite/reasoning/hy_v4_reasoning_parser.py252 # chain-of-thought (and a stray ``</think:SUF>``) as content.COMMENT
MEDIUMaphrodite/reasoning/gemma4_utils.py27 print(result["thinking"]) # chain-of-thought or NoneSTRING
MEDIUMaphrodite/reasoning/gemma4_utils.py76 >>> print(result["thinking"]) # chain-of-thought reasoning or NoneSTRING
MEDIUMaphrodite/entrypoints/cohere/serving.py271 # Controls how the assistant's chain-of-thought is surfaced onCOMMENT
MEDIUMaphrodite/entrypoints/cohere/serving.py445 # ``tool_plan`` is Cohere's chain-of-thought emitted alongside toolCOMMENT
MEDIUMaphrodite/entrypoints/speech_to_text/base/serving.py383 # which is a strong sign of hallucination in outputs.COMMENT
MEDIUMaphrodite/vllm_flash_attn/flash_attn_interface.py138 window_size=(-1, -1), # -1 means infinite context windowCODE
Fake / Example Data73 hits · 81 pts
SeverityFileLineSnippetContext
LOWtests/v1/attention/test_mla_backends.py1667 ["placeholder"],CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py318 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py322 builder = backend_cls.get_builder_cls()(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py579 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_sparse_mla_backends.py584 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1190 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1195 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1641 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(prefill_backend=None)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1670 builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1672 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_attention_backends.py619 ["placeholder"],CODE
LOWtests/v1/attention/test_attention_backends.py973 "placeholder": PerLayerParameters(CODE
LOWtests/v1/attention/test_attention_backends.py1017 kv_cache_spec, ["placeholder"], aphrodite_config, deviceCODE
LOW⚡tests/v1/kv_connector/unit/test_nixl_push_connector.py871 payload = _registration_data("placeholder")CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py82 '{"to": "user@example.com", "subject": "Daily Update"}',CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py89 {"to": "user@example.com", "subject": "Daily Update"},CODE
LOW⚡tests/tool_parsers/test_olmo3_tool_parser.py23 "register_user(name='John Doe', "CODE
LOW⚡tests/tool_parsers/test_olmo3_tool_parser.py31 "register_user(name='John Doe', "CODE
LOW⚡tests/tool_parsers/test_olmo3_tool_parser.py40 arguments='{"name": "John Doe", 'CODE
LOW⚡tests/tool_parsers/test_pythonic_tool_parser.py23 "register_user(name='John Doe', "CODE
LOW⚡tests/tool_parsers/test_pythonic_tool_parser.py32 arguments='{"name": "John Doe", 'CODE
LOW⚡tests/tool_parsers/test_lfm2_tool_parser.py26 "register_user(name='John Doe', "CODE
LOW⚡tests/tool_parsers/test_lfm2_tool_parser.py35 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py509 "[grocery.orderIngredients(ingredientList=[{'name': 'apple', 'quantity': '2'}], deliveryAddress='123 Main St')]"CODE
LOW⚡tests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
LOW⚡tests/tool_parsers/test_hunyuan_a13b_tool_parser.py47 "name": "John Doe",CODE
LOWtests/kernels/helion/test_pattern_matching.py121 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOWtests/kernels/helion/test_pattern_matching.py186 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOW…ls/attention/test_rocm_aiter_mla_causal_verify_mask.py124 layer_name = "placeholder"CODE
LOW…rnels/attention/test_rocm_aiter_mla_decode_metadata.py118 layer_name = "placeholder"CODE
LOW⚡…ts/models/multimodal/processing/test_audioflamingo3.py126 dummy_data = builder.get_dummy_mm_data(100, mm_counts, {})CODE
LOW⚡…ts/models/multimodal/processing/test_audioflamingo3.py128 assert "audio" in dummy_dataCODE
LOW⚡…ts/models/multimodal/processing/test_audioflamingo3.py129 assert len(dummy_data["audio"]) == 2CODE
LOW⚡…ts/models/multimodal/processing/test_audioflamingo3.py132 assert len(dummy_data["audio"][0]) == expected_lenCODE
LOWtests/parser/mistral/test_tool_calls.py381 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py874 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py1277 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py374 """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/parser/mistral/test_tool_calls.py867 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/parser/mistral/test_tool_calls.py1270 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOW⚡tests/compile/test_graph_partition.py175 assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * ["call_function"] + ["output"]CODE
LOWtests/compile/test_graph_partition.py58 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py112 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py397 if node.op == "placeholder" and isinstance(node.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py456 if n.op == "placeholder" and isinstance(n.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py461 if n.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py564 if n.op != "placeholder":CODE
LOW⚡tests/compile/passes/ir/test_clone_cleanup.py225 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOW⚡tests/compile/passes/ir/test_clone_cleanup.py237 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py253 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOW⚡tests/compile/passes/ir/test_clone_cleanup.py268 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOW⚡tests/compile/passes/ir/test_clone_cleanup.py282 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOW⚡tests/compile/passes/ir/test_clone_cleanup.py299 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOW⚡tests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOW⚡tests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOW⚡tests/entrypoints/launchers/test_run_batch.py838def _make_aiohttp_mocks(response_data: bytes = b"fake-data", status: int = 200):CODE
LOW⚡benchmarks/attention_benchmarks/mla_runner.py677 aphrodite_config.compilation_config.static_forward_context = {"placeholder": layer}CODE
LOW⚡benchmarks/attention_benchmarks/mla_runner.py681 layer_names=["placeholder"],CODE
LOW…hrodite/model_executor/models/transformers/fx_utils.py106 if kind == "placeholder":CODE
LOW…hrodite/model_executor/models/transformers/fx_utils.py151 return isinstance(node, fx.Node) and node.op == "placeholder" and str(node.target).lstrip("*") == self.varkwCODE
13 more matches not shown…
TODO Padding11 hits · 16 pts
SeverityFileLineSnippetContext
LOWcsrc/cpu/sgl-kernels/common.h378 // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb]COMMENT
LOW…nector/v1/lmcache_integration/multi_process_adapter.py575 # TODO: add error handling hereCOMMENT
LOW…e/model_executor/kernels/linear/mixed_precision/xpu.py181 # TODO: implement asym caseCOMMENT
LOWaphrodite/entrypoints/openai/responses/protocol.py719 # TODO: implement the other reason for incomplete_details,COMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py294 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py327 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py351 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py388 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py418 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py437 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py464 # TODO: implement it based on torch opsCOMMENT
AI Response Leakage2 hits · 15 pts
SeverityFileLineSnippetContext
HIGHtests/v1/sample/test_logprobs.py920 # Based on user's example: "In this example,"COMMENT
HIGHexamples/vision/vision_example.py116 # In this example, we override max_num_seqs to 5 whileCOMMENT
Example Usage Blocks9 hits · 14 pts
SeverityFileLineSnippetContext
LOWformatting.sh4# Usage:COMMENT
LOWtools/setup_deepgemm_pythons.sh8# Usage:COMMENT
LOWdocker/docker-bake.hcl5# Usage:COMMENT
LOWdocker/export_wheels.sh6# Usage:COMMENT
LOW…/nixl_integration/run_multi_connector_accuracy_test.sh15# Usage:COMMENT
LOW…nector/nixl_integration/spec_decode_acceptance_test.sh13# Usage:COMMENT
LOW…nixl_integration/run_multi_connector_edge_case_test.sh15# Usage:COMMENT
LOWexamples/run_cluster.sh8# Usage:COMMENT
LOWexamples/multi_node.sh11# Example usage:COMMENT
Slop Phrases5 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMtests/models/multimodal/generation/test_common.py63# model arch happens to be a substring of another one, you can add aCOMMENT
MEDIUMtests/models/multimodal/generation/test_common.py84# NOTE you can add --collect-only to any of the above commands to seeCOMMENT
MEDIUM…disagg_prefill_lmcache_v1/disagg_aphrodite_launcher.sh24# secure random value. This is set to a fixed value for demonstration purposes only.COMMENT
LOW…ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py88 # while processing the next batch, we make sure to only set anCOMMENT
MEDIUMaphrodite/model_executor/models/interfaces.py301 as a language model component.STRING
Overly Generic Function Names4 hits · 4 pts
SeverityFileLineSnippetContext
LOWexamples/disaggregated_prefill/p2p_nccl/proxy_server.py122async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py180 async def handle_request():CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py134 async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/round_robin_proxy.py15 async def handle_request(self, request):CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/e2e/general/test_streaming_input.py473CODE