Repository Analysis

dphnAI/sonar

Large-scale LLM inference engine

12.6 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of dphnAI/sonar, a C++ project with 1,795 GitHub stars. SynthScan v2.0 examined 1,971,547 lines of code across 5227 source files, recording 18512 pattern matches distributed across 26 syntactic categories. The overall adjusted score of 12.6 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

12.6
Adjusted Score
12.6
Raw Score
100%
Time Factor
2026-07-12
Last Push
1.8K
Stars
C++
Language
2.0M
Lines of Code
5.2K
Files
18.5K
Pattern Hits
2026-07-14
Scan Date
0.09
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 10HIGH 452MEDIUM 1951LOW 16099

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 18512 distinct pattern matches across 26 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers10648 hits · 10465 pts
SeverityFileLineSnippetContext
LOWenv.py113def run_and_parse_first_match(run_lambda, command, regex):CODE
LOWenv.py124def run_and_return_first_line(run_lambda, command):CODE
LOWenv.py157def get_nvidia_driver_version(run_lambda):CODE
LOWenv.py269def summarize_aphrodite_build_flags():CODE
LOWenv.py473def get_cachingallocator_config():CODE
LOWenv.py478def get_cuda_module_loading_config():CODE
LOWsetup.py47def should_require_rust_frontend() -> bool:CODE
LOWsetup.py52def get_precompiled_rust_extension_paths() -> list[Path]:CODE
LOWsetup.py673def add_aphrodite_package_data(filename: str) -> None:CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py90def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str:CODE
LOWcsrc/libtorch_stable/quantization/machete/generate.py318def generate_type_option_name(kernel_types: TypeConfig):STRING
LOWcsrc/libtorch_stable/quantization/machete/generate.py350def unsigned_type_with_bitwidth(num_bits):STRING
LOWtools/generate_versions_json.py84def generate_bake_native_json(args: dict[str, str]) -> dict:CODE
LOWtools/install_nixl_from_source_ubuntu.py65def install_system_dependencies():CODE
LOWtools/install_nixl_from_source_ubuntu.py104def build_and_install_prerequisites(args):CODE
LOWtools/build_rust.py39def rust_py_extension_module_names() -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py876def _expand_flash_attn_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py986def parse_cuda_priority_lists() -> dict[str, list[str]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py249def _find_exact_cc_in_function(tree: ast.AST, func_name: str) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py607def parse_flash_attn_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py752def parse_flashinfer_trtllm_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py791def parse_mla_prefill_backends() -> list[dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py928def _expand_flashinfer_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1037def _get_backends_from_return(stmts: list) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1307def generate_priority_section(priorities: dict[str, list[str]]) -> str:CODE
LOWtools/profiler/visualize_layerwise_profile.py66def shorten_plot_legend_strings(legend, max_char_len: int):CODE
LOWtools/profiler/visualize_layerwise_profile.py85def attempt_to_make_names_unique(entries_and_traces):CODE
LOWtools/profiler/visualize_layerwise_profile.py124def group_trace_by_operations(trace_df: pd.DataFrame) -> pd.DataFrame:CODE
LOWtools/profiler/visualize_layerwise_profile.py179 def is_custom_ar_all_reduce_unreg(op_name: str):CODE
LOWtests/test_sequence.py9def test_sequence_intermediate_tensors_equal():CODE
LOWtests/test_zen_cpu_platform_detection.py35def test_is_amd_zen_cpu_returns_false_when_cpuinfo_missing():CODE
LOWtests/test_version.py36def test_prev_minor_version_was(version_tuple, version_str, expected):CODE
LOWtests/test_ray_env_utils.py36 def test_arbitrary_var_propagated(self):CODE
LOWtests/test_ray_env_utils.py42 def test_worker_specific_excluded(self):CODE
LOWtests/test_ray_env_utils.py50 def test_non_carry_over_blacklist(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py20 def test_valueerror_converted_to_bypass(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py30 def test_original_valueerror_chained(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py44 def test_non_valueerror_propagates(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py54 def test_normal_return_preserved(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py76 def test_sentinel_attribute_set(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py90def test_patch_applied_in_current_environment():CODE
LOWtests/conftest.py219def init_test_http_connection():CODE
LOWtests/conftest.py266def should_do_global_cleanup_after_test(request) -> bool:CODE
LOWtests/conftest.py720 def _hidden_states_to_seq_logprobs(CODE
LOWtests/conftest.py743 def _hidden_states_to_logprobs(CODE
LOWtests/conftest.py770 def generate_greedy_logprobs_limit(CODE
LOWtests/conftest.py1031 def _final_steps_generate_w_logprobs(CODE
LOWtests/conftest.py1139 def generate_prompt_perplexity(self, prompts: list[str], mask: Optional[list[str]] = None) -> list[float]:CODE
LOWtests/conftest.py1244 def _wait_for_rocm_memory_release(self, gpu_memory_utilization: float) -> None:CODE
LOWtests/conftest.py1284def temporary_enable_log_propagate():CODE
LOWtests/conftest.py1486def pytest_collection_modifyitems(config, items):CODE
LOWtests/conftest.py1503def cli_config_file_with_model():CODE
LOWtests/conftest.py1643def clean_gpu_memory_between_tests():CODE
LOWtests/test_inputs.py21def test_preprocessor_always_mm_code_path(model_id, prompt):CODE
LOWtests/test_ray_env.py54 def test_pythonhashseed_in_result(self):CODE
LOWtests/test_ray_env.py118 def test_worker_specific_host_vars_are_excluded(self):CODE
LOWtests/test_ray_env.py128 def test_non_carry_over_blacklist(self):CODE
LOWtests/test_ray_env.py142 def test_additional_vars_passthrough(self):CODE
LOWtests/test_ray_env.py156 def test_prefix_no_partial_match(self):CODE
LOWtests/test_ray_env.py168 def test_csv_whitespace_handling(self):CODE
10588 more matches not shown…
Decorative Section Separators1542 hits · 5328 pts
SeverityFileLineSnippetContext
MEDIUMtools/pre_commit/generate_attention_backend_docs.py871# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py873# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py981# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py983# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1424# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1426# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py71# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py268# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py270# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py305# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py307# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py567# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py569# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1107# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1113# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1199# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1201# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py11# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py13# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py48# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py99# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py133# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py135# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py147# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py149# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py34# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py36# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py121# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py123# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py434# ------------------------------------------------------------------COMMENT
MEDIUMtests/test_jit_monitor.py436# ------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py123# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py125# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py147# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py149# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py167# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py169# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py187# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py189# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py208# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py210# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py240# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py242# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py29# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py31# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py21# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py23# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py44# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py79# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py81# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py132# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py134# ---------------------------------------------------------------------------COMMENT
1482 more matches not shown…
Cross-File Repetition358 hits · 1790 pts
SeverityFileLineSnippetContext
HIGHtests/v1/attention/test_mla_prefill_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_mha_attn.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_rocm_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/tool_parsers/test_granite_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_longcat_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/kernels/quantization/test_block_int8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/quantization/test_int8_kernel.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/moe/test_block_int8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/kernels/moe/test_triton_moe_ptpc_fp8.py0sets the default cuda device for all tests in this module.STRING
HIGHtests/distributed/test_pipeline_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/distributed/test_context_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/compile/correctness_e2e/test_sequence_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/models/multimodal/pooling/test_colpali.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/entrypoints/pooling/scoring/util.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/entrypoints/pooling/scoring/util.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/generation/test_phi4siglip.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/models/multimodal/generation/test_phi4mm.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…/models/multimodal/generation/vlm_utils/model_utils.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…ts/models/multimodal/generation/test_granite_speech.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/entrypoints/openai/completion/test_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…ypoints/openai/chat_completion/test_chat_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHbenchmarks/benchmark_serving_structured_output.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHtests/lora/test_qwen3moe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_llama_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_olmoe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHexamples/offline_inference/vision_language_embedding.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/vision/vision_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/audio/audio_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHbenchmarks/benchmark_throughput.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_latency.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_serving.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/kernels/benchmark_machete.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/w8a8_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/sparse_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/kernels/benchmark_w8a8_block_fp8.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGH…model_executor/layers/quantization/utils/int8_utils.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGH…/model_executor/layers/quantization/utils/fp8_utils.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGHaphrodite/sampling_params.py0whether to include the stop strings in output text.STRING
HIGH…e/entrypoints/speech_to_text/transcription/protocol.py0whether to include the stop strings in output text.STRING
HIGH…ite/entrypoints/speech_to_text/translation/protocol.py0whether to include the stop strings in output text.STRING
HIGHaphrodite/_aiter_ops.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/model_executor/kernels/mhc/aiter.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/model_executor/kernels/mhc/torch.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn_diffkv.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/rocm_aiter_fa.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/triton_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
298 more matches not shown…
Unused Imports1436 hits · 1334 pts
SeverityFileLineSnippetContext
LOW…lass_extensions/aphrodite_cutlass_library_extension.py6CODE
LOWtools/build_rust.py6CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py78CODE
LOWtests/utils.py62CODE
LOWtests/utils.py2049CODE
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py13CODE
LOWtests/v1/kv_offload/tiering/p2p/test_zmq_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_data_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py9CODE
LOWtests/v1/attention/test_mla_backends.py71CODE
LOWtests/v1/attention/test_attention_backends.py51CODE
LOWtests/v1/logits_processors/utils.py12CODE
LOWtests/v1/cudagraph/test_cudagraph_mode.py38CODE
LOWtests/v1/cudagraph/test_breakable_cudagraph.py7CODE
LOWtests/v1/kv_connector/unit/test_tp_mapping.py10CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py21CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py3CODE
LOWtests/v1/spec_decode/test_backup_token_async_spec.py9CODE
LOWtests/v1/sample/test_topk_topp_sampler.py33CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/simple_kv_offload/test_scheduler.py5CODE
LOWtests/v1/simple_kv_offload/test_worker.py10CODE
LOWtests/tool_use/test_gemma4_responses_adjust_request.py32CODE
LOWtests/tool_parsers/test_poolside_v1_tool_parser.py21CODE
LOWtests/renderers/test_chat_utils_prompt_embeds.py6CODE
LOWtests/kernels/core/test_vit_fp8_attn.py20CODE
LOWtests/kernels/core/test_fused_q_kv_rmsnorm.py11CODE
LOWtests/kernels/ir/test_ir_ops.py11CODE
LOWtests/kernels/ir/test_layernorm.py7CODE
LOWtests/kernels/mamba/test_precopy_mamba_align.py20CODE
LOWtests/kernels/mamba/test_gdn_forward_core_split.py30CODE
LOWtests/kernels/mamba/test_ssu_dispatch.py24CODE
LOWtests/kernels/moe/test_moe.py18CODE
LOWtests/distributed/test_eplb_spec_decode.py3CODE
LOW…ummy_platform/aphrodite_add_dummy_platform/__init__.py10CODE
LOWtests/cuda/scripts/check_device_count_respects_env.py14CODE
LOWtests/model_executor/test_oink_integration.py37CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py8CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py8CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py9CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py9CODE
LOWtests/models/language/pooling/embed_utils.py8CODE
LOWtests/models/language/pooling/test_reward.py18CODE
LOWtests/models/multimodal/generation/test_pixtral.py24CODE
LOWtests/parser/engine/test_replay.py13CODE
LOWtests/parser/engine/trace_builder.py14CODE
LOWtests/parser/engine/test_delegating_replay.py14CODE
LOWtests/parser/engine/streaming_helpers.py5CODE
LOWtests/parser/engine/replay_harness.py10CODE
LOWtests/parser/engine/test_parser_engine.py8CODE
LOWtests/parser/engine/test_ufffd_reasoning_transition.py14CODE
LOWtests/reasoning/test_cohere_command_reasoning_parser.py4CODE
1376 more matches not shown…
Deep Nesting1110 hits · 1003 pts
SeverityFileLineSnippetContext
LOWenv.py165CODE
LOWenv.py379CODE
LOWsetup.py495CODE
LOWsetup.py538CODE
LOWsetup.py173CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py90CODE
LOW…ibtorch_stable/quantization/marlin/generate_kernels.py173CODE
LOW…btorch_stable/moe/marlin_moe_wna16/generate_kernels.py173CODE
LOWtools/report_build_time_ninja.py149CODE
LOWtools/pre_commit/check_triton_import.py32CODE
LOWtools/pre_commit/enforce_regex_import.py34CODE
LOWtools/pre_commit/generate_attention_backend_docs.py105CODE
LOWtools/pre_commit/generate_attention_backend_docs.py130CODE
LOWtools/pre_commit/generate_attention_backend_docs.py151CODE
LOWtools/pre_commit/generate_attention_backend_docs.py194CODE
LOWtools/pre_commit/generate_attention_backend_docs.py319CODE
LOWtools/pre_commit/generate_attention_backend_docs.py361CODE
LOWtools/pre_commit/generate_attention_backend_docs.py607CODE
LOWtools/pre_commit/generate_attention_backend_docs.py986CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1037CODE
LOWtools/pre_commit/validate_config.py73CODE
LOWtools/pre_commit/check_boolean_context_manager.py8CODE
LOWtools/pre_commit/check_spdx_header.py23CODE
LOWtools/pre_commit/check_spdx_header.py49CODE
LOWtests/conftest.py523CODE
LOWtests/conftest.py954CODE
LOWtests/utils.py1141CODE
LOWtests/utils.py1461CODE
LOWtests/utils.py1588CODE
LOWtests/utils.py1712CODE
LOWtests/utils.py538CODE
LOWtests/utils.py1594CODE
LOWtests/utils.py1735CODE
LOWtests/v1/utils.py12CODE
LOWtests/v1/kv_offload/cpu/test_gpu_worker.py216CODE
LOWtests/v1/tracing/test_tracing.py22CODE
LOWtests/v1/attention/test_mla_backends.py877CODE
LOWtests/v1/attention/test_sparse_mla_backends.py493CODE
LOWtests/v1/logits_processors/test_correctness.py289CODE
LOWtests/v1/logits_processors/test_correctness.py433CODE
LOWtests/v1/core/test_scheduler.py2234CODE
LOWtests/v1/core/utils.py196CODE
LOWtests/v1/kv_connector/unit/test_nixl_connector.py2742CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py301CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py353CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py365CODE
LOWtests/v1/kv_connector/unit/utils.py299CODE
LOWtests/v1/kv_connector/unit/test_mooncake_connector.py1162CODE
LOW…kv_connector/unit/offloading_connector/test_metrics.py217CODE
LOWtests/v1/determinism/test_batch_invariance.py28CODE
LOWtests/v1/determinism/test_batch_invariance.py154CODE
LOWtests/v1/determinism/test_batch_invariance.py610CODE
LOWtests/v1/determinism/test_nvfp4_batch_invariant.py41CODE
LOWtests/v1/spec_decode/test_eagle.py48CODE
LOWtests/v1/spec_decode/test_acceptance_length.py173CODE
LOWtests/v1/spec_decode/test_acceptance_length.py218CODE
LOWtests/v1/sample/test_logprobs.py139CODE
LOWtests/v1/sample/test_logprobs.py496CODE
LOWtests/v1/sample/test_logprobs.py868CODE
LOWtests/v1/sample/test_logprobs.py909CODE
1050 more matches not shown…
Self-Referential Comments289 hits · 926 pts
SeverityFileLineSnippetContext
MEDIUMbuild_and_upload_docker.sh31# Create a temporary container to extract the wheelCOMMENT
MEDIUMtools/install_deepgemm.sh84# Create a temporary directory for the buildCOMMENT
MEDIUMtools/report_build_time_ninja.py199 # Create a list that is in order by time stamp and has entries for theCOMMENT
MEDIUMtests/conftest.py549 # Create a copy to avoid modifying the original dictCOMMENT
MEDIUMtests/utils.py733 # Create a dedicated process group so we can killCOMMENT
MEDIUMtests/utils.py1597 # Create a unique temporary file to store exception info from childCOMMENT
MEDIUMtests/test_access_log_filter.py257 # Create a logger with our filter (simulating uvicorn.access)COMMENT
MEDIUMtests/test_access_log_filter.py264 # Create a custom handler that tracks messagesCOMMENT
MEDIUMtests/test_config.py812 # Create a new mock and run the method with the same S3 URLCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py185 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py491 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py616 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py859 # Create a tensor queueCOMMENT
MEDIUMtests/v1/test_serial_utils.py185 # Create a sample Python objectCOMMENT
MEDIUMtests/v1/test_serial_utils.py203 # Create a sample tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py221 # Create a sample numpy arrayCOMMENT
MEDIUMtests/v1/test_serial_utils.py305 # Create a request with a non-multimodal tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py344 # Create a request with None for the tensor fieldCOMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py51 # Create a copy of the mock config to avoid modifying the global oneCOMMENT
MEDIUMtests/v1/metrics/test_ray_metrics.py67 # Create the actor and call the async methodCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py258 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py1306 # Create a summary for the single-line failure messageCOMMENT
MEDIUMtests/v1/attention/test_attention_backends.py172 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/logits_processors/test_correctness.py743 # Define a shuffled batch of requests which individually use a differentCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py63 # Create a Aphrodite instance and load custom logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py70 # Create a reference Aphrodite instance without custom logitprocCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py257 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py260 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py457 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py460 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py303 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py351 # Create an empty FreeKVCacheBlockQueueCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py402 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1292 # Create a AphroditeConfigCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1326 # Create a AphroditeConfigCOMMENT
MEDIUMtests/v1/core/test_scheduler.py2927 # Create a request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3685 # Create a request and schedule it (and to be preempted)COMMENT
MEDIUMtests/v1/core/test_scheduler.py2954 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3733 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py4556 # Create a text-only request (no mm_features).COMMENT
MEDIUMtests/v1/cudagraph/test_cudagraph_dispatch.py56 # Create a real LoRAConfig with specialize_active_lora enabledCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector.py2124 # Create a request that triggers do_remote_decode so thatCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_lmcache_connector.py202 # Create a mock object that is not LMCacheKVEventsCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_moriio_connector.py209 # Define a fake remote engine id for testingCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py139 # Create a request with multiple blocks worth of tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py183 # Create a requestCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py205 # Create a request with just 1 tokenCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py223 # Create a request with 2 tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py249 # Create a request with many blocksCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py332 # Create a request that doesn't align to block boundariesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector_hma.py73 # Create a mock worker with just the required attributesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_example_connector.py144 # Create the LLM instanceCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py45 # Create a minimal Llama config with small dimensionsCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py60 # Create a simple tokenizerCOMMENT
MEDIUMtests/v1/determinism/test_batch_invariance.py103 # Create a batch of size `max_batch_size` and insert the needle atCOMMENT
MEDIUMtests/v1/distributed/test_external_lb_dp.py149 # Create a client for each serverCOMMENT
MEDIUMtests/v1/distributed/test_hybrid_lb_dp.py182 # Create a client for each node (each node has its own API endpoint)COMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py20 # Create a minimal mock without initializing the full engineCOMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py50 # Create a mock queue with outputsCOMMENT
229 more matches not shown…
Over-Commented Block969 hits · 847 pts
SeverityFileLineSnippetContext
LOWCMakeLists.txt1cmake_minimum_required(VERSION 3.26)COMMENT
LOWCMakeLists.txt61#COMMENT
LOWCMakeLists.txt101find_program(NVCC_EXECUTABLE nvcc)COMMENT
LOWCMakeLists.txt241endif()COMMENT
LOWenv.py281 return NoneCOMMENT
LOWenv.py301# Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsrCOMMENT
LOWenv.py321# NUMA node1 CPU(s): 32-63,96-127COMMENT
LOWenv.py341# Manufacturer=GenuineIntelCOMMENT
LOWconfig.yaml1# Sample configuration file for Aphrodite EngineCOMMENT
LOWconfig.yaml21COMMENT
LOWconfig.yaml41 # at high contexts, but it mutually exclusive with kv_cache_dtype=fp8COMMENT
LOWconfig.yaml81 # The data type to use for the model. Can be `auto`, `float16`, `bfloat16`,COMMENT
LOWconfig.yaml101 # Otherwise, KV cache scaling factors default to 1.0, whichCOMMENT
LOWconfig.yaml121COMMENT
LOWconfig.yaml141speculative_args:COMMENT
LOWconfig.yaml161COMMENT
LOWconfig.yaml181 # of draft tokens. Less accurate but faster.COMMENT
LOWconfig.yaml241 - max_cpu_loras:COMMENT
LOWconfig.yaml301COMMENT
LOWconfig.yaml321 # to the chosen load_format. This should be a JSON string thatCOMMENT
LOWformatting.sh1#!/usr/bin/env bashCOMMENT
LOWcsrc/fork_torch_bindings.cpp1// Fork-specific op registrations (extension: _C_fork).COMMENT
LOWcsrc/torch_utils.h1#pragma onceCOMMENT
LOWcsrc/torch_bindings.cpp1// Provides torch::Tensor for ops.h (previously included transitively viaCOMMENT
LOWcsrc/cumem_allocator_compat.h101} // extern "C"COMMENT
LOWcsrc/cumem_allocator.cpp1// A CUDAPluggableAllocator based on cumem* APIs.COMMENT
LOWcsrc/cuda_compat.h41 #define APHRODITE_LDG(arg) __ldg(arg)COMMENT
LOWcsrc/cuda_compat.h61 #define APHRODITE_SHFL_SYNC(var, src_lane) __shfl(var, src_lane)COMMENT
LOWcsrc/cuda_utils.h1#pragma onceCOMMENT
LOWcsrc/spinloop.cpp1#include <Python.h>COMMENT
LOWcsrc/attention/attention_dtypes.h1#pragma onceCOMMENT
LOWcsrc/hadamard/static_switch.h1// Inspired byCOMMENT
LOWcsrc/core/scalar_type.hpp1#pragma onceCOMMENT
LOWcsrc/core/registration.h1#pragma onceCOMMENT
LOWcsrc/metal/paged_ops.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/metal/paged_ops.cpp741// Replaces the Python turbo_quant_encode() + 5 MLX scatters on the hot path.COMMENT
LOWcsrc/cpu/cpu_attn_neon.hpp1#ifndef CPU_ATTN_NEON_HPPCOMMENT
LOWcsrc/cpu/utils.cpp1#ifndef APHRODITE_NUMA_DISABLEDCOMMENT
LOWcsrc/cpu/cpu_wna16.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_fused_moe.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types.hpp1#ifndef CPU_TYPES_HPPCOMMENT
LOWcsrc/cpu/cpu_types.hpp21 #include "cpu_types_scalar.hpp"COMMENT
LOWcsrc/cpu/cpu_types_riscv.hpp1#ifndef CPU_TYPES_RISCV_HPPCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp981 // - q_heads_buffer: [MaxQHeadNumPerIteration, head_dim]COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1001 // - q_heads_per_kvCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1121 // print_logits("masked logits", logits_buffer, q_head_num,COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1821COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1841COMMENT
LOWcsrc/cpu/cpu_attn_vxe.hpp381} // namespace cpu_attentionCOMMENT
LOWcsrc/cpu/generate_cpu_attn_dispatch.py141#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h61#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h161 #include <riscv_vector.h>COMMENT
LOWcsrc/cpu/cpu_attn_rvv.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_attn_fp8.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp1COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp21#define vec_sr(a, b) ((a) >> (b)) // Vector Shift Right AlgebraicCOMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp1201#endifCOMMENT
LOWcsrc/cpu/cpu_types_x86.hpp1COMMENT
LOWcsrc/cpu/shm.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types_riscv_impl.hpp1#ifndef CPU_TYPES_RISCV_IMPL_HPPCOMMENT
909 more matches not shown…
Excessive Try-Catch Wrapping629 hits · 669 pts
SeverityFileLineSnippetContext
LOWenv.py256 except Exception:CODE
LOWsetup.py115 except Exception:CODE
LOWsetup.py207 except Exception as e:CODE
LOWsetup.py478 except Exception:CODE
MEDIUMsetup.py107def find_tcmalloc() -> Path | None:CODE
MEDIUMtools/generate_cmake_presets.py156 print(f"Error writing file: {e}")CODE
LOWtools/install_nixl_from_source_ubuntu.py30 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py501 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py515 except Exception as e:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py583 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py618 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py764 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py805 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1007 except Exception:CODE
LOWtests/conftest.py1269 except Exception:CODE
LOWtests/conftest.py1530 except Exception as e:CODE
MEDIUMtests/utils.py117def _nvml():CODE
LOWtests/utils.py81 except Exception as e:CODE
LOWtests/utils.py292 except Exception:CODE
LOWtests/utils.py574 except Exception as e:CODE
LOWtests/utils.py654 except Exception:CODE
LOWtests/utils.py1626 except Exception as e:CODE
LOWtests/utils.py1649 except Exception:CODE
LOWtests/utils.py1840 except Exception as e:CODE
LOWtests/utils.py2052 except Exception:CODE
LOWtests/v1/test_tensor_ipc_queue.py81 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py116 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py300 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py397 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py429 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py512 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py548 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py691 except Exception as e:CODE
LOWtests/v1/utils.py62 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py156 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py117 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py214 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py253 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py264 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py284 except Exception as e:CODE
MEDIUMtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py249def _run_decode():CODE
LOWtests/v1/shutdown/test_forward_error.py73 except Exception as e:CODE
LOWtests/v1/shutdown/test_processor_error.py37 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py28except Exception:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py373 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/utils.py334 except Exception as e:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py664 except Exception:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py701 except Exception:CODE
LOWtests/v1/kv_connector/unit/test_rixl_gpu_mem_diag.py36 except Exception:CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py233 except Exception as e:CODE
MEDIUM…s/v1/kv_connector/nixl_integration/toy_proxy_server.py238 print(f"Error occurred in disagg prefill proxy server - {api} endpoint")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py151 print(f"Error writing to file: {e}")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py160 print(f"Error writing to file: {e}")CODE
LOWtests/v1/determinism/test_online_batch_invariance.py42 except Exception as e: # pragma: no coverCODE
LOWtests/v1/distributed/test_external_lb_dp.py88 except Exception as e:CODE
LOWtests/v1/distributed/test_external_lb_dp.py115 except Exception as e:CODE
MEDIUMtests/v1/distributed/test_external_lb_dp.py116 print(f"Error stopping servers: {e}")CODE
LOWtests/v1/distributed/test_internal_lb_dp.py184 except Exception as e:CODE
LOWtests/v1/distributed/test_internal_lb_dp.py212 except Exception as e:CODE
MEDIUMtests/v1/distributed/test_internal_lb_dp.py213 print(f"Error stopping servers: {e}")CODE
569 more matches not shown…
Modern Structural Boilerplate389 hits · 394 pts
SeverityFileLineSnippetContext
LOWsetup.py33logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py32logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py116 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py86 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOW…/v1/kv_connector/unit/test_handshake_pp_aggregation.py136 def update_state_after_alloc(self, request: Any, blocks: Any, num_external_tokens: int) -> None:CODE
LOW…/v1/kv_connector/unit/test_handshake_pp_aggregation.py142 def set_xfer_handshake_metadata(self, metadata: dict[int, KVConnectorHandshakeMetadata]) -> None:CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py7__all__ = ["request_runner"]CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWtests/v1/worker/test_gpu_worker_weight_transfer.py29 def update_weights(self, update_info: dict) -> None:CODE
LOWtests/v1/engine/test_core_engine_actor_manager.py43 def _set_visible_devices(self, aphrodite_config: Any, local_dp_rank: int) -> None:CODE
LOWtests/kernels/moe/test_marlin_vs_trtllm_mxint4.py71__all__ = [CODE
LOWtests/distributed/eplb_utils.py73def set_env_vars_and_device(env: dict[str, str]) -> None:CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py11__all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"]CODE
LOWtests/models/language/generation/test_hybrid.py68def _set_conv_state_layout(monkeypatch, layout: str) -> None:CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py37logger = logging.getLogger(__name__)CODE
LOWtests/parser/engine/replay_harness.py82 def set_vocab(self, vocab: dict[str, int]) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py487async def _set_healthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py497async def _set_unhealthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/responses/conftest.py15logger = logging.getLogger(__name__)CODE
LOW…/entrypoints/openai/responses/test_parsable_context.py21logger = logging.getLogger(__name__)CODE
LOWtests/entrypoints/openai/responses/test_harmony.py30logger = logging.getLogger(__name__)CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWbenchmarks/multi_turn/bench_utils.py28logger = logging.getLogger(__name__)CODE
LOWaphrodite/envs.py521logger = logging.getLogger(__name__)CODE
LOWaphrodite/env_override.py393def _update_scheduler_patched(self) -> None:CODE
LOWaphrodite/sampling_params.py796 def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None:CODE
LOWaphrodite/__init__.py76__all__ = [CODE
LOWaphrodite/v1/request.py237 def update_block_hashes(self) -> None:CODE
LOWaphrodite/v1/kv_offload/tiering/example/manager.py30logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/data/__init__.py6__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/control/__init__.py12__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/session/__init__.py10__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/fs/io.py9logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/metrics/stats.py301 def update_from_output(self, prefill_stats: PrefillStats) -> None:CODE
LOWaphrodite/v1/attention/backends/flash_attn_diffkv.py41 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/triton_attn_diffkv.py81 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/mla/prefill/__init__.py10__all__ = [CODE
LOWaphrodite/v1/attention/ops/triton_decode_attention.py42logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/core/sched/async_scheduler.py19 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/interface.py109 def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None:CODE
LOWaphrodite/v1/core/sched/interface.py202 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py2256 def _update_waiting_for_remote_kv(self, request: Request) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1094 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1141 def _update_request_as_session(self, session: Request, update: StreamingUpdate) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1802 def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1988 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWaphrodite/v1/spec_decode/extract_hidden_states.py80 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWaphrodite/v1/spec_decode/gemma4.py61 def set_per_group_block_table(self, gid: int, block_table: torch.Tensor) -> None:CODE
LOWaphrodite/v1/spec_decode/gemma4.py115 def _setup_centroids_cuda_graphs(self) -> None:CODE
LOWaphrodite/v1/spec_decode/llm_base_proposer.py312 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWaphrodite/v1/sample/thinking_budget_state.py224 def _update_think_state(self, state: dict[str, Any]) -> None:CODE
LOWaphrodite/v1/sample/logits_processor/__init__.py317__all__ = [CODE
LOWaphrodite/v1/executor/aphrodite_net_devices.py135def set_worker_gpu_nic_mapping(local_rank: int) -> None:CODE
LOWaphrodite/v1/executor/aphrodite_net_devices.py213def set_worker_net_device(local_rank: int, aphrodite_config: AphroditeConfig) -> None:CODE
LOWaphrodite/v1/executor/__init__.py6__all__ = ["Executor", "UniProcExecutor"]CODE
LOWaphrodite/v1/worker/gpu_worker.py417 def update_config(self, overrides: dict[str, Any]) -> None:CODE
LOWaphrodite/v1/worker/gpu_worker.py661 def update_max_model_len(self, max_model_len: int) -> None:CODE
LOWaphrodite/v1/worker/gpu_worker.py880 def _set_draft_weight_update_target(self) -> None:CODE
LOWaphrodite/v1/worker/gpu_worker.py1159 def update_weights(self, update_info: dict) -> None:CODE
329 more matches not shown…
Redundant / Tautological Comments223 hits · 340 pts
SeverityFileLineSnippetContext
LOWtools/pre_commit/generate_attention_backend_docs.py524 # Check if this is an MLA backend by parent class or namingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py1024 # Check if this is the "if use_mla:" branchCOMMENT
LOWtests/conftest.py387 # Set this to avoid hanging issueCOMMENT
LOWtests/conftest.py898 # Set this to avoid hanging issueCOMMENT
LOWtests/utils.py506 os.kill(spid, 0) # Check if still aliveCODE
LOWtests/test_config.py589 # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_configCOMMENT
LOWtests/v1/attention/test_mla_backends.py978 # Set num_speculative_tokens to query_len - 1COMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py565 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py569 # Set some to out of boundsCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py621 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py625 # Set some to out of boundsCOMMENT
LOWtests/v1/core/test_scheduler.py2294 # Verify if position length is identicalCOMMENT
LOWtests/v1/core/test_scheduler.py3176 # Check if scheduled_encoder_inputs is empty as expectedCOMMENT
LOWtests/v1/core/test_scheduler.py3512 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/test_scheduler.py3820 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/utils.py247 # Verify if position length is identicalCOMMENT
LOW…extract_hidden_states_integration/predictable_llama.py81 # Check if we need auxiliary hidden statesCOMMENT
LOW…nnector/nixl_integration/config_sweep_accuracy_test.sh98# Check if cross-layers is enabled (non-empty)COMMENT
LOWtests/v1/determinism/test_batch_invariance.py270 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py526 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py738 # Check if tokens matchCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py756 # Check if logprobs match bitwiseCOMMENT
LOWtests/v1/spec_decode/test_acceptance_length.py108 # Check if get_valid_backends is actually defined in the platform classCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh25# Set 1 to use multimodal prompts; else to use text-onlyCOMMENT
LOW…ts/v1/ec_connector/integration/test_epd_correctness.py211 # Check if server is readyCOMMENT
LOWtests/v1/e2e/spec_decode/test_async_spec_decode.py34 # Increment counterCOMMENT
LOWtests/v1/engine/test_engine_core_client.py303 # Check if all request IDs in outputs have finishedCOMMENT
LOWtests/v1/engine/utils.py131 # Check if the sampled_token_id occurs in choice_tensor[1:]COMMENT
LOWtests/utils_/test_network_utils.py79 # Check if IPv6 is supported by trying to create an IPv6 socketCOMMENT
LOWtests/tool_parsers/test_mistral_tool_parser.py127 # Check if the slice from the current position matches the target sequenceCOMMENT
LOWtests/kernels/moe/test_moe_layer.py1751 # Check if enough GPUs availableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py26# Check if aiter package is installedCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py35 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py38 # Check if the op is callableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py44 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py47 # Check if the op is callableCOMMENT
LOWtests/evals/gsm8k/gsm8k_eval.py336 # Print results to terminalCOMMENT
LOWtests/distributed/test_eplb_execute.py146 # Check if the weights are correctCOMMENT
LOWtests/model_executor/test_qwen3_omni.py29 # Check if it's a special token that should be compressedCOMMENT
LOW…model_loader/runai_streamer_loader/test_runai_utils.py56 # Read the file in chunks to handle large files efficientlyCOMMENT
LOWtests/models/multimodal/generation/test_maverick.py59 # Print the outputsCOMMENT
LOWtests/quantization/test_gptq_v2.py43 # Check if gptq_v2 format is correctly loadedCOMMENT
LOWtests/quantization/test_gptq_v2.py105 # Print the output sequences if failedCOMMENT
LOWtests/compile/test_config.py50 # Check if get_raw_stream exists in builtinsCOMMENT
LOWtests/compile/fusions_e2e/conftest.py42 # Print the outputs.COMMENT
LOWtests/compile/fullgraph/test_full_graph.py227 # Print the outputs.COMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py71 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py138 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/serve/utils/test_request_logger.py95 # Set max_log_len to 10COMMENT
LOW…rve/sagemaker/test_sagemaker_middleware_integration.py314 # Check if environment variable middleware was appliedCOMMENT
LOWtests/entrypoints/openai/completion/test_shutdown.py100 # Check if any choice has finish_reason='abort'COMMENT
LOWtests/rocm/aiter/test_grouped_quant.py21# Check if aiter package is installedCOMMENT
LOWtests/rocm/aiter/test_mla_fp8_support_check.py107 # Set cache to TrueCOMMENT
LOWtests/lora/test_transformers_model.py39 # Print the outputs.COMMENT
LOWtests/lora/test_gptoss_tp.py79 # Print the outputs.COMMENT
LOWtests/lora/test_qwen3moe_tp.py55 # Print the outputs.COMMENT
LOWtests/lora/test_chatglm3_tp.py38 # Print the outputs.COMMENT
LOWtests/lora/test_deepseekv2_tp.py28 # Print the outputs.COMMENT
LOWtests/lora/test_minicpmv_tp.py51 # Print the outputs.COMMENT
LOWtests/lora/test_mixtral.py21 # Print the outputs.COMMENT
163 more matches not shown…
AI Structural Patterns330 hits · 308 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py373CODE
LOWtests/conftest.py411CODE
LOWtests/conftest.py882CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py382CODE
LOWtests/v1/attention/utils.py169CODE
LOWtests/v1/attention/test_attention_backends.py288CODE
LOWtests/v1/core/test_kv_cache_utils.py112CODE
LOWtests/v1/core/test_scheduler.py2113CODE
LOWtests/v1/core/test_scheduler.py2234CODE
LOWtests/v1/core/utils.py45CODE
LOWtests/v1/core/utils.py196CODE
LOWtests/v1/kv_connector/unit/test_moriio_connector.py225CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py339CODE
LOWtests/v1/kv_connector/unit/utils.py77CODE
LOWtests/v1/kv_connector/unit/utils.py177CODE
LOWtests/v1/sample/test_rejection_sampler.py65CODE
LOWtests/v1/e2e/general/test_mamba_prefix_cache.py161CODE
LOWtests/kernels/utils.py274CODE
LOWtests/kernels/utils.py817CODE
LOWtests/kernels/attention/test_mha_attn.py117CODE
LOWtests/kernels/attention/test_attention.py52CODE
LOW…sts/kernels/attention/test_triton_prefill_attention.py71CODE
LOWtests/kernels/mamba/test_mamba_ssm.py112CODE
LOWtests/kernels/quantization/test_nvfp4_quant.py81CODE
LOWtests/kernels/moe/test_deepep_v2_moe.py187CODE
LOWtests/kernels/moe/test_moe_permute_unpermute.py104CODE
LOWtests/kernels/moe/test_moe.py1499CODE
LOWtests/kernels/moe/utils.py50CODE
LOWtests/kernels/moe/test_moe_layer.py928CODE
LOWtests/kernels/moe/test_moe_layer.py1027CODE
LOWtests/evals/mrcr/mrcr_eval.py159CODE
LOWtests/evals/gsm8k/gsm8k_eval.py202CODE
LOWtests/distributed/test_multiproc_executor.py23CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py552CODE
LOWtests/models/transformers/fusers/test_moe.py148CODE
LOWtests/quantization/reference_mxfp4.py76CODE
LOWtests/quantization/reference_mxfp4.py211CODE
LOWtests/compile/test_graph_partition.py96CODE
LOWtests/compile/fullgraph/test_toy_llama.py151CODE
LOWtests/compile/passes/test_silu_mul_quant_fusion.py128CODE
LOWtests/compile/passes/test_fusion.py466CODE
LOWtests/benchmarks/test_random_dataset.py171CODE
LOWtests/entrypoints/openai/utils.py135CODE
LOWexamples/pooling/token_embed/jina_reranker_v3_online.py22CODE
LOWbenchmarks/kernels/benchmark_mrope.py78CODE
LOWaphrodite/sampling_params.py436CODE
LOWaphrodite/_custom_ops.py3005CODE
LOWaphrodite/_custom_ops.py3711CODE
LOWaphrodite/_xpu_ops.py722CODE
LOWaphrodite/_xpu_ops.py797CODE
LOWaphrodite/forward_context.py198CODE
LOWaphrodite/forward_context.py246CODE
LOWaphrodite/_aiter_ops.py106CODE
LOWaphrodite/_aiter_ops.py166CODE
LOWaphrodite/_aiter_ops.py195CODE
LOWaphrodite/_aiter_ops.py232CODE
LOWaphrodite/_aiter_ops.py462CODE
LOWaphrodite/_aiter_ops.py520CODE
LOWaphrodite/_aiter_ops.py2154CODE
LOWaphrodite/_aiter_ops.py2204CODE
270 more matches not shown…
Structural Annotation Overuse158 hits · 291 pts
SeverityFileLineSnippetContext
LOWbuild_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOWbuild_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOWbuild_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py134 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py140 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1114 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5010 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5020 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5029 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py665 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py681 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py369 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py379 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py432 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py440 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py491 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py408 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py472 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py503 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py516 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py527 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py84 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py100 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py116 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py153 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py173 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py190 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py59 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py77 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py96 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py99 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py129 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py154 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py174 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py177 # Step 4: Verify the request state was updated correctlyCOMMENT
LOWtests/v1/ec_connector/integration/README.md61### Step 1: BaselineCOMMENT
LOWtests/v1/ec_connector/integration/README.md68### Step 2: EPD (1E + 1PD)COMMENT
LOWtests/v1/ec_connector/integration/README.md76### Step 3: EPD (1E + 1P + 1D)COMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh459# Step 1: Run baselineCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh462# Step 2: Test 1E + 1PDCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh465# Step 3: Test baseline 1P + 1DCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh468# Step 4: Test 1E + 1P + 1DCOMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py630 # Step 1: In-place CUDA RoPE (same as production)COMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py642 # Step 2: Reshape + quant + reshape (same as production)COMMENT
98 more matches not shown…
Cross-Language Confusion54 hits · 285 pts
SeverityFileLineSnippetContext
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py154 (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)CODE
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py223 "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)",CODE
HIGHcsrc/libtorch_stable/quantization/machete/generate.py490 "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py493 "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py494 "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py497 "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py498 "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py499 "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py502 "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py503 "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py506 "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)),STRING
HIGHtests/v1/attention/test_trtllm_attention_integration.py142 # Randomly permute blocks (starting from block 1; block 0 is null).COMMENT
HIGHtests/v1/attention/test_mla_backends.py237 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/attention/test_attention_backends.py149 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/core/test_scheduler.py2918 num_blocks=5, # Can hold 64 tokens (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py3675 num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py3902 num_blocks=11, # Can hold 160 tokens (first block is null)CODE
HIGHtests/v1/cudagraph/test_cudagraph_mode.py65 # when above code raises, `llm` may be undefined, so we need to catch thatCOMMENT
HIGHtests/v1/cudagraph/test_cudagraph_mode.py115 # when above code raises, `llm` may be undefined, so we need to catch thatCOMMENT
HIGH…_connector/unit/offloading_connector/test_scheduler.py2393 # 4 GPU blocks: block 0 is null, blocks 1-3 are usable.COMMENT
HIGHtests/tool_parsers/test_granite_tool_parser.py41 "null_field": null,CODE
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py33 "null_field": null,CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py34 "role=null, "CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py43 '"role": null, 'CODE
HIGHtests/tool_parsers/test_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_deepseekv3_tool_parser.py41 """"bool_field": true, "null_field": null, """STRING
HIGHtests/tool_parsers/test_internlm2_tool_parser.py52 "null_field": null,CODE
HIGHtests/tool_parsers/test_llama4_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py49 "null_field": null,CODE
HIGHtests/tool_parsers/test_lfm2_tool_parser.py38 '"role": null, 'CODE
HIGHtests/tool_parsers/test_longcat_tool_parser.py53 "null_field": null,CODE
HIGHtests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
HIGHtests/tool_parsers/test_qwen3coder_tool_parser.py570 # Multi non-null: anyOf[string, integer, null] → first non-null is stringCOMMENT
HIGHtests/parser/engine/test_qwen3.py257 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py267 "questions": '[{"question": "Pick a color", "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_qwen3.py1034 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py1053 ' "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_parser_engine.py598 result = engine._fix_arg_types('{"val": null}', "f")CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1138 text = "<|tool_call>call:configure{value:null}<tool_call|>"CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1144 text = "<|tool_call>call:configure{label:null}<tool_call|>"CODE
HIGH…e_out/token_in_token_out/test_return_routed_experts.py36 '{"sliding_window": null}',CODE
HIGHtests/entrypoints/openai/test_return_routed_experts.py33 '{"sliding_window": null}',CODE
HIGHaphrodite/_custom_ops.py2101 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2206 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2083 input_tensor: The input tensor with gate || up layout [m_topk, k*2]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1051 # result [null] [null] ... [null] [hit block 1 (1st block containCOMMENT
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py418 every (non-null) block — the default for full attention.STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1004 [null, null, block 3], otherwise, we return [null, null]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1009 we return 4 blocks[null, null, null, null]STRING
HIGHaphrodite/tool_parsers/utils.py432 (null, true, false) that some models produce instead of PythonSTRING
HIGHaphrodite/metal/mlx_backend/mla_cache.py11 Each token's cache entry is a combined latent vector [kv_norm || k_pe]:STRING
HIGHaphrodite/metal/paged_attention_backend/mla.py29 latent = [kv_norm || k_pe_roped] # kv_lora_rank + qk_rope_head_dim dimsSTRING
HIGH…ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py47 cd FlexKV && bash build.shSTRING
HIGHaphrodite/benchmarks/datasets/datasets.py3953 # undefined), language (en), transcription directive (en), punctuationSTRING
Verbosity Indicators137 hits · 257 pts
SeverityFileLineSnippetContext
LOWbuild_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOWbuild_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOWbuild_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py134 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py140 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1114 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5010 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5020 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5029 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py665 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py681 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py369 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py379 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py432 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py440 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py491 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py408 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py472 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py503 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py516 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py527 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py84 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py100 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py116 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py153 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py173 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py190 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py59 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py77 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py96 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py99 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py129 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py154 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py174 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py177 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh459# Step 1: Run baselineCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh462# Step 2: Test 1E + 1PDCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh465# Step 3: Test baseline 1P + 1DCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh468# Step 4: Test 1E + 1P + 1DCOMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py630 # Step 1: In-place CUDA RoPE (same as production)COMMENT
LOWtests/kernels/test_fused_inv_rope_fp8_quant.py642 # Step 2: Reshape + quant + reshape (same as production)COMMENT
LOW…nts/multimodal/llm/test_mm_cache_external_injection.py92 # Step 1: Normal requests to populate the cacheCOMMENT
LOW…nts/multimodal/llm/test_mm_cache_external_injection.py100 # Step 2: Use a second image to get valid expanded tokens andCOMMENT
LOW…ntrypoints/weight_transfer/test_weight_transfer_llm.py258 # Step 1: Initialize weight transfer engineCOMMENT
77 more matches not shown…
Docstring Block Structure37 hits · 185 pts
SeverityFileLineSnippetContext
HIGHbenchmarks/benchmark_long_document_qa_throughput.py70 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGHaphrodite/v1/attention/backends/registry.py204Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register STRING
HIGHaphrodite/v1/attention/backends/mla/prefill/registry.py90Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum memberSTRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py991 For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lonSTRING
HIGHaphrodite/v1/structured_output/utils.py314 Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: STRING
HIGHaphrodite/v1/structured_output/utils.py346 Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/STRING
HIGHaphrodite/v1/worker/utils.py275 Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_manaSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py134 Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunkSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py178 Extracts tool calls from a completely generated model response (Non-Streaming). Args: modeSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py274 Handles streaming chunks Args: previous_text: The complete model text generated prior to tSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py467 Calculates the exact string difference to safely append new tool parameters. This ensures characters lSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py166Project ``x`` into Q/K/V with norms, RoPE and Gemma4 variants. Handles three Gemma4-specific branches: - **YOCSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py308Zero-pad Q/K/V on the last axis up to ``cache_head_dim``. Variable head_dim models (e.g. Gemma4 sliding=256, full=5STRING
HIGHaphrodite/metal/v1/model_adapter.py231Return per-layer ``(kv_heads, head_dim)`` lists for Gemma4, else None. Gemma4 26B/31B mix sliding attention (``STRING
HIGHaphrodite/metal/stt/audio.py57Load an audio file and return mono samples at *sample_rate* Hz. Tries ``librosa`` first (handles WAV natively withoSTRING
HIGHaphrodite/metal/stt/audio.py90Load audio via ffmpeg subprocess. Args: file_path: Path to the audio file. sample_rate: Target sampSTRING
HIGH…ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py709 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…rodite/distributed/kv_transfer/kv_connector/v1/base.py453 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py276Get remote allocation info for a request. Args: transfer_id:TransferId The request ID RetuSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py194 Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and hSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py544 Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engineSTRING
HIGHaphrodite/distributed/weight_transfer/factory.py81Create a weight transfer engine instance. Args: config: Weight transfer configuration containing thSTRING
HIGHaphrodite/distributed/weight_transfer/base.py117 Construct typed init info from dict with validation. Args: init_dict: Dictionary containinSTRING
HIGHaphrodite/distributed/weight_transfer/base.py135 Construct typed update info from dict with validation. Args: update_dict: Dictionary contaSTRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py518 Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the STRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py692 Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to choSTRING
HIGH…/model_executor/layers/fused_moe/expert_map_manager.py322 Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nuSTRING
HIGHaphrodite/model_executor/layers/fla/ops/chunk.py147 Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGH…odite/model_executor/layers/fla/ops/fused_recurrent.py509 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHaphrodite/model_executor/models/keye_vl1_5.py77 Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wiSTRING
HIGHaphrodite/model_executor/models/isaac.py228Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): STRING
HIGHaphrodite/multimodal/audio.py92Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppoSTRING
HIGHaphrodite/benchmarks/lib/ready_checker.py25 Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async reqSTRING
HIGHaphrodite/entrypoints/chat_utils.py1338 Parses a given multi-modal content part based on its type. Args: part: A dict containing the content pSTRING
HIGHaphrodite/entrypoints/speech_to_text/base/utils.py18Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the ConteSTRING
HIGHaphrodite/transformers_utils/processors/isaac.py174Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): TensoSTRING
HIGHaphrodite/lora/resolver.py69Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. STRING
AI Slop Vocabulary76 hits · 164 pts
SeverityFileLineSnippetContext
LOWcsrc/libtorch_stable/quantization/machete/generate.py413 # For now, we can just use the first accumulator type seen sinceSTRING
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
LOWtests/v1/cudagraph/test_breakable_cudagraph.py235 # Outside capture: decorator should just call through.COMMENT
LOWtests/tool_parsers/test_mistral_tool_parser.py133 # Otherwise, just add the current token and move to the next oneCOMMENT
MEDIUMtests/renderers/test_sparse_tensor_validation.py58 # explicitly so this fixture is robust to process-wide invariant-check stateCOMMENT
MEDIUMtests/kernels/mamba/test_mamba_mixer2.py106 # - utilize mock patching to disable TP whenCOMMENT
MEDIUMtests/distributed/test_pynccl.py373 # Essentially this is an all-gather operation.COMMENT
MEDIUMtests/distributed/test_context_parallel.py46 # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yamlCOMMENT
MEDIUMtests/distributed/test_context_parallel.py48 # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yamlCOMMENT
LOWtests/model_executor/test_qwen3_omni.py41 # Regular token, just add itCOMMENT
MEDIUMtests/models/registry.py921 # Keep the init/schema harness eager (these tests never run forward).COMMENT
MEDIUM…s/compile/passes/distributed/test_fusion_all_reduce.py717 # the call site). The patterns in this PR are robust to both Triton andCOMMENT
LOWtests/lora/test_gptoss_tp.py91# For now just use TRITON_UNFUSED kernelCOMMENT
LOWexamples/offline_inference/ray_distributed_inference.py71 # For tensor_parallel_size == 1, we simply set num_gpus=1.COMMENT
MEDIUMbenchmarks/kernels/benchmark_silu_mul_fp8_quant.py678# Create comprehensive 3-way comparison plotsCOMMENT
LOWaphrodite/env_override.py312# functions just return True.COMMENT
LOWaphrodite/v1/attention/backends/flash_attn.py316 # but for now just set it to `UNIFORM_BATCH` to get use to drop downCOMMENT
LOWaphrodite/v1/attention/backends/utils.py278 # then we can simply use a cdiv for the rest.COMMENT
MEDIUMaphrodite/v1/attention/ops/triton_decode_attention.py358 # explicitly facilitate overlapping load/computeCOMMENT
LOWaphrodite/v1/core/kv_cache_coordinator.py457 # Single group; useless but just set ``use_eagle`` for consistency regardless.COMMENT
MEDIUMaphrodite/v1/core/encoder_cache_manager.py314# utilize the cache and this class will fold into EncoderCacheManager, asCOMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py560 # KV cache in sync, so just return an empty tensor.COMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py1683 # Therefore, we can just return the logits.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py758 # CUDAGraph memory size and may not utilize all gpu memory.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py1019 # Generate the trace name by combining prefix with comprehensive rank suffixCOMMENT
LOWaphrodite/v1/worker/gpu/model_runner.py1240 # For piecewise and eager mode, just call model().COMMENT
LOWaphrodite/v1/engine/parallel_sampling.py116 # If streaming, just return the current outputCOMMENT
MEDIUMaphrodite/tool_parsers/llama_tool_parser.py219 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/jamba_tool_parser.py182 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/granite_tool_parser.py163 # re-set stuff pertaining to progress in the current toolCOMMENT
LOWaphrodite/tool_parsers/xlam_tool_parser.py492 # If we encounter an error, just return the delta text as regular contentCOMMENT
MEDIUMaphrodite/tool_parsers/granite_20b_fc_tool_parser.py177 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/step3_tool_parser.py51 # Explicit state flags for robust streamingCOMMENT
LOWaphrodite/tokenizers/mistral.py504 # if underlying tokenizer is sentencepiece, we just add "�".COMMENT
LOWaphrodite/platforms/cuda.py727 # users can just use IR op priority directlyCOMMENT
MEDIUMaphrodite/distributed/utils.py321 """A robust barrier to synchronize all ranks.STRING
MEDIUM…ransfer/kv_connector/v1/mooncake/mooncake_connector.py859 # Tasks can await async events, so a surplus (2x is a robust heuristic)COMMENT
MEDIUMaphrodite/config/model.py308 """Enable the custom cumem allocator to leverage advanced GPU memorySTRING
MEDIUMaphrodite/config/parallel.py574 # To make the initialization more robust we retry a few timesCOMMENT
LOW…odite/model_executor/layers/mamba/ops/causal_conv1d.py179 # first chunk and does not have prior-token, so just set to 0COMMENT
MEDIUM…dite/model_executor/layers/fused_moe/modular_kernel.py48# The goal is to be able to utilize different communication mechanisms withCOMMENT
MEDIUM…xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py38 # TODO (varun) : Optimize leverage num_tokens_per_expert countsCOMMENT
MEDIUM…executor/layers/fused_moe/experts/fused_humming_moe.py308 # Neighboring nodes are required to utilize distinct workspaces.COMMENT
MEDIUMaphrodite/model_executor/layers/quantization/fp8.py280 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…hrodite/model_executor/layers/quantization/modelopt.py307 # Normalize quant_algo for robust matching (ModelOpt may emit lowercase).COMMENT
MEDIUM…odite/model_executor/layers/quantization/fbgemm_fp8.py53 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py107 # to fully utilize the E4M3 dynamic range (e.g., global_scale=1).COMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py165 # For GPUs that lack FP4 hardware support, we can leverage theCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp8.py60 # For GPUs that lack FP8 hardware support, we can leverage theCOMMENT
LOW…odel_executor/layers/quantization/utils/quant_utils.py390 # Unquantized layer: just return base weightsCOMMENT
MEDIUM…rs/quantization/compressed_tensors/transform/module.py81 # do not fold into weight in order to utilize FWHTCOMMENT
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
LOWaphrodite/model_executor/models/qwen3_asr.py516 # No audio features, just return linear positionsCOMMENT
LOW…odite/model_executor/models/transformers/multimodal.py190 # NOTE: we can't just set caching=False because base class methodCOMMENT
LOWaphrodite/models/deepseek_v4/xpu/xpu_sparse.py51 # Profile run: no-op, just return q (no padding needed on XPU).COMMENT
MEDIUM…dels/deepseek_v4/nvidia/ops/fused_indexer_q_cutedsl.py163 # all threads in a warp to be active since we utilize warp shuffle later.COMMENT
LOWaphrodite/reasoning/granite_reasoning_parser.py182 # corrected; just return the delta text as normal content.COMMENT
LOWaphrodite/reasoning/hunyuan_a13b_reasoning_parser.py88 # this id is not part of content, so just return [] here.COMMENT
LOWaphrodite/reasoning/olmo3_reasoning_parser.py251 # this id is not part of content, so just return [] here.COMMENT
16 more matches not shown…
Hallucination Indicators10 hits · 105 pts
SeverityFileLineSnippetContext
CRITICALrust/src/cmd/src/cli/unsupported.rs138/// - `aphrodite.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)`COMMENT
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py726 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py938 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py957 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/distributed/test_torchrun_example_moe.py80params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/distributed/test_torchrun_example.py71params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/models/language/generation/test_gemma.py19 lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501CODE
CRITICALtests/models/language/generation/test_gemma.py23 normalizers = llm.llm.collective_rpc(lambda self: self.model_runner.model.model.normalizer.cpu().item())CODE
CRITICALaphrodite/v1/spec_decode/llm_base_proposer.py1343 self.model.model.embed_tokens.weight.cpu(),CODE
CRITICALaphrodite/model_executor/layers/fla/ops/utils.py158 triton.runtime.driver.active.utils.get_device_properties(i)["max_shared_mem"]CODE
Modern AI Meta-Vocabulary25 hits · 72 pts
SeverityFileLineSnippetContext
MEDIUMconfig.yaml22 # The maximum sequence length/context window for the modelCOMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1425# Top-level orchestrationCOMMENT
MEDIUMtests/v1/kv_offload/tiering/p2p/test_manager.py1026# _poll_once orchestrationCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_offloading_connector.py151 # Use a long prompt that fits within the model's context window.COMMENT
MEDIUMtests/v1/engine/test_async_llm.py830 # Wait for generation to start (event-driven)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py872 # Wait for some tokens (event-driven, handles slow token generation)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py929 # Wait for at least one token across any request (event-driven)COMMENT
MEDIUMtests/evals/mrcr/mrcr_eval.py32# Skip chain-of-thought on reasoning models; ignored by non-reasoning templates.COMMENT
MEDIUMtests/compile/fullgraph/test_basic_correctness.py57 # embedding modelCOMMENT
MEDIUMtests/entrypoints/openai/responses/test_harmony.py584 # NOTE: chain-of-thought should be removed.COMMENT
MEDIUM…ntrypoints/openai/chat_completion/test_serving_chat.py1113 # adding max_tokens should exceed the model context window.COMMENT
MEDIUMdocs/src/content/docs/usage/tool-call.md171The tool calling that is supported is the [JSON-based tool calling](https://llama.meta.com/docs/model-cards-and-prompt-fCODE
MEDIUMaphrodite/_xpu_ops.py813 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMaphrodite/v1/attention/ops/vit_attn_wrappers.py218 # Without it, hallucinations occur with the backendCOMMENT
MEDIUMaphrodite/v1/executor/abstract.py44 uses_ray: bool = False # whether the executor uses Ray for orchestration.CODE
MEDIUMaphrodite/metal/stt/whisper/config.py13# Maximum decode tokens for Whisper models (matches Whisper context window).COMMENT
MEDIUM…ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py243 # progress is event-driven (see module docstring).COMMENT
MEDIUM…d/kv_transfer/kv_connector/v1/mooncake/store/worker.py4# The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread,COMMENT
MEDIUMaphrodite/model_executor/models/granite_speech.py79# work pretty well with zero shot.COMMENT
MEDIUMaphrodite/model_executor/models/phi3v.py561 # initialized as an embedding modelCOMMENT
MEDIUMaphrodite/models/minimax_m3/amd/model.py1099# NVIDIA copy — it only orchestrates the shared vision tower + the per-platformCOMMENT
MEDIUMaphrodite/reasoning/gemma4_utils.py27 print(result["thinking"]) # chain-of-thought or NoneSTRING
MEDIUMaphrodite/reasoning/gemma4_utils.py76 >>> print(result["thinking"]) # chain-of-thought reasoning or NoneSTRING
MEDIUMaphrodite/entrypoints/speech_to_text/base/serving.py380 # which is a strong sign of hallucination in outputs.COMMENT
MEDIUMaphrodite/vllm_flash_attn/flash_attn_interface.py138 window_size=(-1, -1), # -1 means infinite context windowCODE
Fake / Example Data60 hits · 70 pts
SeverityFileLineSnippetContext
LOWtests/v1/attention/test_mla_backends.py1256 ["placeholder"],CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py295 builder = backend_cls.get_builder_cls()(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py413 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_attention_backends.py472 ["placeholder"],CODE
LOWtests/v1/attention/test_attention_backends.py608 "placeholder": PerLayerParameters(CODE
LOWtests/v1/attention/test_attention_backends.py652 kv_cache_spec, ["placeholder"], aphrodite_config, deviceCODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py674 payload = _registration_data("placeholder")CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py82 '{"to": "user@example.com", "subject": "Daily Update"}',CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py89 {"to": "user@example.com", "subject": "Daily Update"},CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py285 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py598 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py910 "name": "John Doe",CODE
LOWtests/tool_parsers/test_mistral_tool_parser.py278 """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_mistral_tool_parser.py591 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_mistral_tool_parser.py903 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/tool_parsers/test_olmo3_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py31 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py40 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py32 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py26 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py35 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py324 "[grocery.orderIngredients(ingredientList=[{'name': 'apple', 'quantity': '2'}], deliveryAddress='123 Main St')]"CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py47 "name": "John Doe",CODE
LOWtests/kernels/helion/test_pattern_matching.py121 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOWtests/kernels/helion/test_pattern_matching.py186 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOW…rnels/attention/test_rocm_aiter_mla_decode_metadata.py114 layer_name = "placeholder"CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py126 dummy_data = builder.get_dummy_mm_data(100, mm_counts, {})CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py128 assert "audio" in dummy_dataCODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py129 assert len(dummy_data["audio"]) == 2CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py132 assert len(dummy_data["audio"][0]) == expected_lenCODE
LOWtests/compile/test_graph_partition.py175 assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * ["call_function"] + ["output"]CODE
LOWtests/compile/test_graph_partition.py58 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py112 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py397 if node.op == "placeholder" and isinstance(node.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py456 if n.op == "placeholder" and isinstance(n.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py461 if n.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py564 if n.op != "placeholder":CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py225 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py237 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py253 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py268 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py282 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py299 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOW…hrodite/model_executor/models/transformers/fx_utils.py53 if node.op == "placeholder" and node.target == "hidden_states":CODE
LOW…odite/model_executor/models/transformers/fusers/qkv.py61 and node.args[0].op == "placeholder"CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py135 x = find_node(graph, lambda n: n.op == "placeholder")CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py175 if (x := find_node(graph, lambda n: n.op == "placeholder")) is None:CODE
LOWaphrodite/compilation/piecewise_backend.py30 if node.op == "placeholder":CODE
LOWaphrodite/compilation/piecewise_backend.py59 if node.op != "placeholder":CODE
LOWaphrodite/compilation/backends.py451 input_node.op == "placeholder" or node_to_subgraph_id[input_node] <= prev_non_splitting_subgraph_idCODE
LOWaphrodite/compilation/backends.py532 if node.op in ("output", "placeholder"):CODE
LOWaphrodite/compilation/backends.py542 if input_node.op != "placeholder":CODE
LOWaphrodite/compilation/backends.py1197 for i in graph.graph.find_nodes(op="placeholder"):CODE
LOWaphrodite/compilation/codegen.py61 if node.op == "placeholder":CODE
LOW…ite/compilation/passes/ir/inplace_functionalization.py82 if arg.op == "placeholder":CODE
LOWaphrodite/compilation/passes/ir/clone_elimination.py124 if original_node.op == "placeholder" and node_to_idx[original_node] not in donated_input_ids:CODE
TODO Padding11 hits · 16 pts
SeverityFileLineSnippetContext
LOWcsrc/cpu/sgl-kernels/common.h365 // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb]COMMENT
LOW…nector/v1/lmcache_integration/multi_process_adapter.py575 # TODO: add error handling hereCOMMENT
LOW…e/model_executor/kernels/linear/mixed_precision/xpu.py181 # TODO: implement asym caseCOMMENT
LOWaphrodite/entrypoints/openai/responses/protocol.py692 # TODO: implement the other reason for incomplete_details,COMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py308 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py341 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py365 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py402 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py432 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py451 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py478 # TODO: implement it based on torch opsCOMMENT
AI Response Leakage2 hits · 15 pts
SeverityFileLineSnippetContext
HIGHtests/v1/sample/test_logprobs.py883 # Based on user's example: "In this example,"COMMENT
HIGHexamples/vision/vision_example.py115 # In this example, we override max_num_seqs to 5 whileCOMMENT
Example Usage Blocks8 hits · 12 pts
SeverityFileLineSnippetContext
LOWformatting.sh4# Usage:COMMENT
LOWdocker/docker-bake.hcl5# Usage:COMMENT
LOWdocker/export_wheels.sh6# Usage:COMMENT
LOW…/nixl_integration/run_multi_connector_accuracy_test.sh15# Usage:COMMENT
LOW…nector/nixl_integration/spec_decode_acceptance_test.sh13# Usage:COMMENT
LOW…nixl_integration/run_multi_connector_edge_case_test.sh15# Usage:COMMENT
LOWexamples/run_cluster.sh8# Usage:COMMENT
LOWexamples/multi_node.sh11# Example usage:COMMENT
Slop Phrases5 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMtests/models/multimodal/generation/test_common.py64# model arch happens to be a substring of another one, you can add aCOMMENT
MEDIUMtests/models/multimodal/generation/test_common.py85# NOTE you can add --collect-only to any of the above commands to seeCOMMENT
MEDIUM…disagg_prefill_lmcache_v1/disagg_aphrodite_launcher.sh24# secure random value. This is set to a fixed value for demonstration purposes only.COMMENT
LOW…ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py79 # while processing the next batch, we make sure to only set anCOMMENT
MEDIUMaphrodite/model_executor/models/interfaces.py228 as a language model component.STRING
Synthetic Comment Markers1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHdocs/src/content/docs/prompt-caching/introduction.md22# A prompt containing a large markdown table. The table is randomly generated by GPT-4.COMMENT
Overly Generic Function Names4 hits · 4 pts
SeverityFileLineSnippetContext
LOWexamples/disaggregated_prefill/p2p_nccl/proxy_server.py122async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py180 async def handle_request():CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py134 async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/round_robin_proxy.py15 async def handle_request(self, request):CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/e2e/general/test_streaming_input.py473CODE