Repository Analysis

dphnAI/sonar

Large-scale LLM inference engine

12.9 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of dphnAI/sonar, a C++ project with 1,844 GitHub stars. SynthScan v2.0 examined 2,125,560 lines of code across 5652 source files, recording 20601 pattern matches distributed across 25 syntactic categories. The overall adjusted score of 12.9 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

12.9
Adjusted Score
12.9
Raw Score
100%
Time Factor
2026-08-13
Last Push
1.8K
Stars
C++
Language
2.1M
Lines of Code
5.7K
Files
20.6K
Pattern Hits
2026-08-29
Scan Date
0.08
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 11HIGH 460MEDIUM 2128LOW 18002

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 20601 distinct pattern matches across 25 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers12067 hits · 11809 pts
SeverityFileLineSnippetContext
LOWenv.py113def run_and_parse_first_match(run_lambda, command, regex):CODE
LOWenv.py124def run_and_return_first_line(run_lambda, command):CODE
LOWenv.py157def get_nvidia_driver_version(run_lambda):CODE
LOWenv.py269def summarize_aphrodite_build_flags():CODE
LOWenv.py473def get_cachingallocator_config():CODE
LOWenv.py478def get_cuda_module_loading_config():CODE
LOWsetup.py52def should_require_rust_frontend() -> bool:CODE
LOWsetup.py57def should_use_precompiled_rust() -> bool:CODE
LOWsetup.py62def get_precompiled_rust_extension_paths() -> list[Path]:CODE
LOWsetup.py725def add_aphrodite_package_data(filename: str) -> None:CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py90def generate_cases_for_isa_group(isa_list: list[str], include_fp8: bool = False) -> str:CODE
LOWcsrc/libtorch_stable/quantization/machete/generate.py318def generate_type_option_name(kernel_types: TypeConfig):STRING
LOWcsrc/libtorch_stable/quantization/machete/generate.py350def unsigned_type_with_bitwidth(num_bits):STRING
LOWtools/generate_versions_json.py84def generate_bake_native_json(args: dict[str, str]) -> dict:CODE
LOWtools/install_nixl_from_source_ubuntu.py65def install_system_dependencies():CODE
LOWtools/install_nixl_from_source_ubuntu.py104def build_and_install_prerequisites(args):CODE
LOWtools/build_rust.py39def rust_py_extension_module_names() -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1070def _expand_flash_attn_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1180def parse_cuda_priority_lists() -> dict[str, list[str]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py250def _find_exact_cc_in_function(tree: ast.AST, func_name: str) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py608def parse_flash_attn_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py753def parse_flashinfer_trtllm_features() -> dict[str, dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py792def parse_mla_dimensions_call(node: ast.AST | None) -> str | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py816def parse_supported_mla_dimensions(node: ast.ClassDef) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py831def _parse_mla_dimension_reference(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py840def _parse_mla_dimensions_return(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py870def _parse_fa_version_condition(node: ast.AST) -> int | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py891def parse_supports_mla_dimensions(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py944def parse_mla_prefill_registry() -> dict[str, str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py955def parse_mla_prefill_backend_file(class_path: str) -> dict[str, Any] | None:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1013def _format_mla_dimension_notes(backend_info: dict[str, Any]) -> str:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1035def parse_mla_prefill_backends() -> list[dict[str, Any]]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1122def _expand_flashinfer_variants(CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1231def _get_backends_from_return(stmts: list) -> list[str]:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1503def generate_priority_section(priorities: dict[str, list[str]]) -> str:CODE
LOWtools/docs/generate_user_reference.py147def quantization_config_classes() -> dict[str, str]:CODE
LOWtools/profiler/visualize_layerwise_profile.py66def shorten_plot_legend_strings(legend, max_char_len: int):CODE
LOWtools/profiler/visualize_layerwise_profile.py85def attempt_to_make_names_unique(entries_and_traces):CODE
LOWtools/profiler/visualize_layerwise_profile.py124def group_trace_by_operations(trace_df: pd.DataFrame) -> pd.DataFrame:CODE
LOWtools/profiler/visualize_layerwise_profile.py179 def is_custom_ar_all_reduce_unreg(op_name: str):CODE
LOWtests/test_sequence.py9def test_sequence_intermediate_tensors_equal():CODE
LOWtests/test_zen_cpu_platform_detection.py35def test_is_amd_zen_cpu_returns_false_when_cpuinfo_missing():CODE
LOWtests/test_version.py36def test_prev_minor_version_was(version_tuple, version_str, expected):CODE
LOWtests/test_ray_env_utils.py36 def test_arbitrary_var_propagated(self):CODE
LOWtests/test_ray_env_utils.py42 def test_worker_specific_excluded(self):CODE
LOWtests/test_ray_env_utils.py50 def test_non_carry_over_blacklist(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py20 def test_valueerror_converted_to_bypass(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py30 def test_original_valueerror_chained(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py44 def test_non_valueerror_propagates(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py54 def test_normal_return_preserved(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py76 def test_sentinel_attribute_set(self):CODE
LOWtests/test_fxgraphcache_pickle_patch.py90def test_patch_applied_in_current_environment():CODE
LOWtests/conftest.py219def init_test_http_connection():CODE
LOWtests/conftest.py266def should_do_global_cleanup_after_test(request) -> bool:CODE
LOWtests/conftest.py756 def _hidden_states_to_seq_logprobs(CODE
LOWtests/conftest.py779 def _hidden_states_to_logprobs(CODE
LOWtests/conftest.py806 def generate_greedy_logprobs_limit(CODE
LOWtests/conftest.py1069 def _final_steps_generate_w_logprobs(CODE
LOWtests/conftest.py1177 def generate_prompt_perplexity(self, prompts: list[str], mask: Optional[list[str]] = None) -> list[float]:CODE
LOWtests/conftest.py1282 def _wait_for_rocm_memory_release(self, gpu_memory_utilization: float) -> None:CODE
12007 more matches not shown…
Decorative Section Separators1702 hits · 5863 pts
SeverityFileLineSnippetContext
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1065# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1067# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1175# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1177# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1620# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1622# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py70# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py72# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py269# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py271# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py306# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py308# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py568# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py570# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1303# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1309# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1395# ---------------------------------------------------------------------------COMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1397# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py11# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py13# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py48# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py99# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py133# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py135# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py147# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_ray_env.py149# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py197# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py199# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py221# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py223# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py241# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py243# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py477# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py479# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py498# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py500# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py530# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py532# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py38# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_factory.py40# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py57# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py59# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py100# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py102# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py154# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py156# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/test_file_mapper.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py166# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py168# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py206# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py208# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py230# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/kv_offload/cpu/test_shared_offload_region.py232# ---------------------------------------------------------------------------COMMENT
1642 more matches not shown…
Cross-File Repetition364 hits · 1820 pts
SeverityFileLineSnippetContext
HIGHtests/v1/attention/test_mla_prefill_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_mha_attn.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/kernels/attention/test_rocm_attention_selector.py0clear lru cache to ensure each test case runs without caching.STRING
HIGHtests/tool_parsers/test_granite_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/tool_parsers/test_longcat_tool_parser.py0<longcat_tool_call>{ "name": "test_function", "arguments": { "string_field": "hello", "int_field": 42, "float_field": 3.STRING
HIGHtests/distributed/test_pipeline_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/distributed/test_context_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/compile/correctness_e2e/test_sequence_parallel.py0warning: this test runs in both single-node (4 gpus) and multi-node (2 node with 2 gpus each) modes. if the test only usSTRING
HIGHtests/models/multimodal/pooling/test_colpali.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/entrypoints/pooling/scoring/util.py0create a small solid-color png image and return its base64 data uri.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/entrypoints/pooling/scoring/util.py0build a scoremultimodalparam containing an image (and optional text).STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify per-token embedding shape and l2 normalization.STRING
HIGHtests/models/multimodal/pooling/test_colpali.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/pooling/test_colqwen3_5.py0verify that relevant documents score higher than irrelevant ones.STRING
HIGHtests/models/multimodal/generation/test_phi4siglip.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/models/multimodal/generation/test_phi4mm.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…/models/multimodal/generation/vlm_utils/model_utils.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGH…ts/models/multimodal/generation/test_granite_speech.py0sanitize aphrodite output [phi3v] to be comparable with hf output.STRING
HIGHtests/entrypoints/openai/completion/test_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGH…ypoints/openai/chat_completion/test_chat_completion.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHbenchmarks/benchmark_serving_structured_output.py0root ::= select_statement select_statement ::= "select " column " from " table " where " condition column ::= "col_1 " |STRING
HIGHtests/lora/test_qwen3moe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_llama_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHtests/lora/test_olmoe_tp.py0i want you to act as a sql terminal in front of an example database, you need only to return the sql command to me. do nSTRING
HIGHexamples/offline_inference/vision_language_embedding.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/vision/vision_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHexamples/audio/audio_example.py0this example shows how to use aphrodite for running offline inference with the correct prompt format on audio language mSTRING
HIGHbenchmarks/benchmark_throughput.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_latency.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/benchmark_serving.py0deprecated: this script has been moved to the aphrodite cli. please use the following command instead: aphrodite bench rSTRING
HIGHbenchmarks/kernels/benchmark_machete.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/w8a8_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/cutlass_benchmarks/sparse_benchmarks.py0benchmark cutlass gemm. to run square gemms: python3 ./benchmarks/cutlass_benchmarks/sparse_benchmarks.py --dtype fp8 sqSTRING
HIGHbenchmarks/kernels/benchmark_w8a8_block_fp8.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGH…model_executor/layers/quantization/utils/int8_utils.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGH…/model_executor/layers/quantization/utils/fp8_utils.py0this function performs matrix multiplication with block-wise quantization. it takes two input tensors `a` and `b` with sSTRING
HIGHaphrodite/sampling_params.py0whether to include the stop strings in output text.STRING
HIGH…e/entrypoints/speech_to_text/transcription/protocol.py0whether to include the stop strings in output text.STRING
HIGH…ite/entrypoints/speech_to_text/translation/protocol.py0whether to include the stop strings in output text.STRING
HIGHaphrodite/_aiter_ops.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/model_executor/kernels/mhc/aiter.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/model_executor/kernels/mhc/torch.py0forward pass for mhc pre block. args: residual: shape (..., hc_mult, hidden_size), dtype torch.bfloat16 fn: shape (hc_muSTRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn_diffkv.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/rocm_aiter_fa.py0forward pass with aiterflashattention. args: query: shape = [num_tokens, num_heads, head_size] key: shape = [num_tokens,STRING
HIGHaphrodite/v1/attention/backends/flash_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/triton_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/rocm_attn.py0forward pass for encoder attention without kv cache. args: query: shape = [num_encoder_tokens, num_heads, head_size] keySTRING
HIGHaphrodite/v1/attention/backends/mamba_attn.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
HIGHaphrodite/v1/attention/backends/gdn_attn.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
HIGH…odite/model_executor/layers/attention/mla_attention.py0this method builds the metadata for full cudagraph capture. currently, only decode is supported for full cudagraphs withSTRING
304 more matches not shown…
Unused Imports1612 hits · 1507 pts
SeverityFileLineSnippetContext
LOW…lass_extensions/aphrodite_cutlass_library_extension.py6CODE
LOWtools/build_rust.py6CODE
LOWtools/docs/generate_user_reference.py7CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py77CODE
LOWtests/conftest.py78CODE
LOWtests/utils.py62CODE
LOWtests/utils.py2062CODE
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py13CODE
LOWtests/v1/kv_offload/tiering/p2p/test_zmq_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_data_transport.py5CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py9CODE
LOWtests/v1/attention/test_mla_backends.py104CODE
LOWtests/v1/attention/test_attention_backends.py60CODE
LOWtests/v1/logits_processors/utils.py12CODE
LOWtests/v1/cudagraph/test_cudagraph_mode.py38CODE
LOWtests/v1/cudagraph/test_breakable_cudagraph.py7CODE
LOWtests/v1/kv_connector/unit/test_tp_mapping.py10CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py17CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py21CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py3CODE
LOWtests/v1/spec_decode/test_backup_token_async_spec.py9CODE
LOWtests/v1/sample/test_topk_topp_sampler.py33CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/engine/conftest.py20CODE
LOWtests/v1/simple_kv_offload/test_scheduler.py5CODE
LOWtests/v1/simple_kv_offload/test_worker.py10CODE
LOWtests/tool_use/test_gemma4_responses_adjust_request.py32CODE
LOWtests/tool_parsers/test_poolside_v1_tool_parser.py21CODE
LOWtests/renderers/test_chat_utils_prompt_embeds.py6CODE
LOWtests/kernels/core/test_vit_fp8_attn.py20CODE
LOWtests/kernels/core/test_fused_q_kv_rmsnorm.py11CODE
LOWtests/kernels/ir/test_ir_ops.py11CODE
LOWtests/kernels/ir/test_layernorm.py7CODE
LOWtests/kernels/mamba/test_precopy_mamba_align.py22CODE
LOWtests/kernels/mamba/test_gdn_forward_core_split.py30CODE
LOWtests/kernels/mamba/test_ssu_dispatch.py24CODE
LOWtests/kernels/moe/test_moe.py18CODE
LOWtests/kernels/moe/test_modular_oai_triton_moe.py7CODE
LOWtests/distributed/test_eplb_spec_decode.py3CODE
LOW…latform/aphrodite_add_dummy_platform/dummy_platform.py9CODE
LOW…latform/aphrodite_add_dummy_platform/dummy_platform.py10CODE
LOW…ummy_platform/aphrodite_add_dummy_platform/__init__.py10CODE
LOWtests/cuda/scripts/check_device_count_respects_env.py14CODE
LOWtests/model_executor/test_oink_integration.py37CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py8CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py8CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py9CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py9CODE
LOWtests/models/kimi_k3/test_kda.py677CODE
LOWtests/models/language/pooling/embed_utils.py8CODE
LOWtests/models/language/pooling/test_reward.py19CODE
LOWtests/models/multimodal/generation/test_pixtral.py24CODE
LOWtests/parser/engine/test_replay.py13CODE
LOWtests/parser/engine/trace_builder.py14CODE
LOWtests/parser/engine/test_delegating_replay.py14CODE
1552 more matches not shown…
Deep Nesting1178 hits · 1059 pts
SeverityFileLineSnippetContext
LOWenv.py165CODE
LOWenv.py379CODE
LOWsetup.py533CODE
LOWsetup.py580CODE
LOWsetup.py200CODE
LOWcsrc/cpu/generate_cpu_attn_dispatch.py90CODE
LOW…ibtorch_stable/quantization/marlin/generate_kernels.py173CODE
LOW…btorch_stable/moe/marlin_moe_wna16/generate_kernels.py173CODE
LOWtools/report_build_time_ninja.py149CODE
LOWtools/pre_commit/check_triton_import.py32CODE
LOWtools/pre_commit/enforce_regex_import.py34CODE
LOWtools/pre_commit/generate_attention_backend_docs.py106CODE
LOWtools/pre_commit/generate_attention_backend_docs.py131CODE
LOWtools/pre_commit/generate_attention_backend_docs.py152CODE
LOWtools/pre_commit/generate_attention_backend_docs.py195CODE
LOWtools/pre_commit/generate_attention_backend_docs.py320CODE
LOWtools/pre_commit/generate_attention_backend_docs.py362CODE
LOWtools/pre_commit/generate_attention_backend_docs.py608CODE
LOWtools/pre_commit/generate_attention_backend_docs.py891CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1180CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1231CODE
LOWtools/pre_commit/validate_config.py73CODE
LOWtools/pre_commit/check_boolean_context_manager.py8CODE
LOWtools/pre_commit/check_spdx_header.py58CODE
LOWtools/pre_commit/check_spdx_header.py83CODE
LOWtools/docs/generate_user_reference.py164CODE
LOWtools/docs/generate_user_reference.py175CODE
LOWtests/conftest.py421CODE
LOWtests/conftest.py555CODE
LOWtests/conftest.py992CODE
LOWtests/utils.py1142CODE
LOWtests/utils.py1474CODE
LOWtests/utils.py1601CODE
LOWtests/utils.py1725CODE
LOWtests/utils.py539CODE
LOWtests/utils.py1607CODE
LOWtests/utils.py1748CODE
LOWtests/v1/utils.py12CODE
LOWtests/v1/kv_offload/cpu/test_gpu_worker.py228CODE
LOWtests/v1/tracing/test_tracing.py22CODE
LOWtests/v1/attention/test_mla_backends.py160CODE
LOWtests/v1/attention/test_mla_backends.py1087CODE
LOWtests/v1/attention/test_sparse_mla_backends.py513CODE
LOWtests/v1/logits_processors/test_correctness.py289CODE
LOWtests/v1/logits_processors/test_correctness.py433CODE
LOWtests/v1/core/test_scheduler.py2466CODE
LOWtests/v1/core/utils.py202CODE
LOWtests/v1/kv_connector/unit/test_nixl_connector.py2797CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py296CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py348CODE
LOWtests/v1/kv_connector/unit/test_offloading_connector.py360CODE
LOWtests/v1/kv_connector/unit/utils.py299CODE
LOWtests/v1/kv_connector/unit/test_mooncake_connector.py1162CODE
LOWtests/v1/kv_connector/unit/test_nixl_desc_geometry.py353CODE
LOW…kv_connector/unit/offloading_connector/test_metrics.py217CODE
LOWtests/v1/determinism/test_batch_invariance.py31CODE
LOWtests/v1/determinism/test_batch_invariance.py174CODE
LOWtests/v1/determinism/test_batch_invariance.py635CODE
LOWtests/v1/determinism/test_nvfp4_batch_invariant.py41CODE
LOWtests/v1/spec_decode/test_eagle.py48CODE
1118 more matches not shown…
Self-Referential Comments300 hits · 955 pts
SeverityFileLineSnippetContext
MEDIUMbuild_and_upload_docker.sh31# Create a temporary container to extract the wheelCOMMENT
MEDIUMtools/install_deepgemm.sh84# Create a temporary directory for the buildCOMMENT
MEDIUMtools/report_build_time_ninja.py199 # Create a list that is in order by time stamp and has entries for theCOMMENT
MEDIUMtests/conftest.py581 # Create a copy to avoid modifying the original dictCOMMENT
MEDIUMtests/utils.py734 # Create a dedicated process group so we can killCOMMENT
MEDIUMtests/utils.py1610 # Create a unique temporary file to store exception info from childCOMMENT
MEDIUMtests/test_access_log_filter.py257 # Create a logger with our filter (simulating uvicorn.access)COMMENT
MEDIUMtests/test_access_log_filter.py264 # Create a custom handler that tracks messagesCOMMENT
MEDIUMtests/test_config.py847 # Create a new mock and run the method with the same S3 URLCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py185 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py491 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py616 # Create a CPU tensorCOMMENT
MEDIUMtests/v1/test_tensor_ipc_queue.py859 # Create a tensor queueCOMMENT
MEDIUMtests/v1/test_serial_utils.py185 # Create a sample Python objectCOMMENT
MEDIUMtests/v1/test_serial_utils.py203 # Create a sample tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py221 # Create a sample numpy arrayCOMMENT
MEDIUMtests/v1/test_serial_utils.py305 # Create a request with a non-multimodal tensorCOMMENT
MEDIUMtests/v1/test_serial_utils.py344 # Create a request with None for the tensor fieldCOMMENT
MEDIUMtests/v1/metrics/test_ray_metrics.py67 # Create the actor and call the async methodCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py373 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/attention/test_mla_backends.py1493 # Create a summary for the single-line failure messageCOMMENT
MEDIUMtests/v1/attention/test_attention_backends.py194 # Create a realistic slot mapping that corresponds to the block tableCOMMENT
MEDIUMtests/v1/logits_processors/test_correctness.py743 # Define a shuffled batch of requests which individually use a differentCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py63 # Create a Aphrodite instance and load custom logitprocCOMMENT
MEDIUMtests/v1/logits_processors/test_custom_offline.py70 # Create a reference Aphrodite instance without custom logitprocCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py264 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py267 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py464 # Create a list of KVCacheBlock objectsCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py467 # Create a FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py310 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py358 # Create an empty FreeKVCacheBlockQueueCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py409 # Create an empty FreeKVCacheBlockQueue with these blocksCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1299 # Create a AphroditeConfigCOMMENT
MEDIUMtests/v1/core/test_kv_cache_utils.py1333 # Create a AphroditeConfigCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3210 # Create a request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py3968 # Create a request and schedule it (and to be preempted)COMMENT
MEDIUMtests/v1/core/test_scheduler.py3237 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py4016 # Create a high priority request and schedule itCOMMENT
MEDIUMtests/v1/core/test_scheduler.py4839 # Create a text-only request (no mm_features).COMMENT
MEDIUMtests/v1/cudagraph/test_cudagraph_dispatch.py56 # Create a real LoRAConfig with specialize_active_lora enabledCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector.py2176 # Create a request that triggers do_remote_decode so thatCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_lmcache_connector.py202 # Create a mock object that is not LMCacheKVEventsCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_moriio_connector.py209 # Define a fake remote engine id for testingCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py139 # Create a request with multiple blocks worth of tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py183 # Create a requestCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py205 # Create a request with just 1 tokenCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py223 # Create a request with 2 tokensCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py249 # Create a request with many blocksCOMMENT
MEDIUM…ts/v1/kv_connector/unit/test_decode_bench_connector.py332 # Create a request that doesn't align to block boundariesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_nixl_connector_hma.py73 # Create a mock worker with just the required attributesCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_example_connector.py144 # Create the LLM instanceCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py45 # Create a minimal Llama config with small dimensionsCOMMENT
MEDIUM…r/extract_hidden_states_integration/test_extraction.py60 # Create a simple tokenizerCOMMENT
MEDIUMtests/v1/determinism/test_batch_invariance.py123 # Create a batch of size `max_batch_size` and insert the needle atCOMMENT
MEDIUMtests/v1/distributed/test_external_lb_dp.py149 # Create a client for each serverCOMMENT
MEDIUMtests/v1/distributed/test_hybrid_lb_dp.py182 # Create a client for each node (each node has its own API endpoint)COMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py20 # Create a minimal mock without initializing the full engineCOMMENT
MEDIUMtests/v1/streaming_input/test_async_llm_streaming.py50 # Create a mock queue with outputsCOMMENT
MEDIUM…/v1/streaming_input/test_gpu_model_runner_streaming.py34 # Create a real InputBatch for e2e testingCOMMENT
240 more matches not shown…
Over-Commented Block1074 hits · 948 pts
SeverityFileLineSnippetContext
LOWCMakeLists.txt1cmake_minimum_required(VERSION 3.26)COMMENT
LOWCMakeLists.txt61#COMMENT
LOWCMakeLists.txt241 endif()COMMENT
LOWenv.py281 return NoneCOMMENT
LOWenv.py301# Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsrCOMMENT
LOWenv.py321# NUMA node1 CPU(s): 32-63,96-127COMMENT
LOWenv.py341# Manufacturer=GenuineIntelCOMMENT
LOWconfig.yaml1# Sample configuration file for Aphrodite EngineCOMMENT
LOWconfig.yaml21COMMENT
LOWconfig.yaml41 # at high contexts, but it mutually exclusive with kv_cache_dtype=fp8COMMENT
LOWconfig.yaml81 # The data type to use for the model. Can be `auto`, `float16`, `bfloat16`,COMMENT
LOWconfig.yaml101 # Otherwise, KV cache scaling factors default to 1.0, whichCOMMENT
LOWconfig.yaml121COMMENT
LOWconfig.yaml141speculative_args:COMMENT
LOWconfig.yaml161COMMENT
LOWconfig.yaml181 # of draft tokens. Less accurate but faster.COMMENT
LOWconfig.yaml241 - max_cpu_loras:COMMENT
LOWconfig.yaml301COMMENT
LOWconfig.yaml321 # to the chosen load_format. This should be a JSON string thatCOMMENT
LOWformatting.sh1#!/usr/bin/env bashCOMMENT
LOWcsrc/torch_utils.h1#pragma onceCOMMENT
LOWcsrc/torch_bindings.cpp1// Provides torch::Tensor for ops.h (previously included transitively viaCOMMENT
LOWcsrc/cumem_allocator_compat.h101} // extern "C"COMMENT
LOWcsrc/cumem_allocator.cpp1// A CUDAPluggableAllocator based on cumem* APIs.COMMENT
LOWcsrc/fs_io.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda_compat.h41 #define APHRODITE_LDG(arg) __ldg(arg)COMMENT
LOWcsrc/cuda_compat.h61 #define APHRODITE_SHFL_SYNC(var, src_lane) __shfl(var, src_lane)COMMENT
LOWcsrc/cuda_utils.h1#pragma onceCOMMENT
LOWcsrc/spinloop.cpp1#include <Python.h>COMMENT
LOWcsrc/attention/attention_dtypes.h1#pragma onceCOMMENT
LOWcsrc/hadamard/static_switch.h1// Inspired byCOMMENT
LOWcsrc/core/scalar_type.hpp1#pragma onceCOMMENT
LOWcsrc/core/registration.h1#pragma onceCOMMENT
LOWcsrc/metal/paged_ops.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/metal/paged_ops.cpp741// Replaces the Python turbo_quant_encode() + 5 MLX scatters on the hot path.COMMENT
LOWcsrc/cpu/mamba_kernels.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/mamba_kernels.hpp21// state_ptr may point to a NON-CONTIGUOUS paged KV cache tensor.COMMENT
LOWcsrc/cpu/mamba_kernels.hpp81 }COMMENT
LOWcsrc/cpu/mamba_kernels.hpp261//COMMENT
LOWcsrc/cpu/cpu_attn_neon.hpp1#ifndef CPU_ATTN_NEON_HPPCOMMENT
LOWcsrc/cpu/utils.cpp1#ifndef APHRODITE_NUMA_DISABLEDCOMMENT
LOWcsrc/cpu/cpu_wna16.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_fused_moe.cpp1#include "cpu/cpu_types.hpp"COMMENT
LOWcsrc/cpu/cpu_types.hpp1#ifndef CPU_TYPES_HPPCOMMENT
LOWcsrc/cpu/cpu_types_riscv.hpp1#ifndef CPU_TYPES_RISCV_HPPCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp981 // - q_heads_buffer: [MaxQHeadNumPerIteration, head_dim]COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1001 // - q_heads_per_kvCOMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1121 // print_logits("masked logits", logits_buffer, q_head_num,COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1821COMMENT
LOWcsrc/cpu/cpu_attn_impl.hpp1841COMMENT
LOWcsrc/cpu/mamba_cpu.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/mamba_cpu.cpp121 if (z.has_value() && z.value().defined()) z_in = ensure_input(z.value());COMMENT
LOWcsrc/cpu/cpu_attn_vxe.hpp381} // namespace cpu_attentionCOMMENT
LOWcsrc/cpu/generate_cpu_attn_dispatch.py141#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h61#endifCOMMENT
LOWcsrc/cpu/cpu_arch_macros.h161 #include <riscv_vector.h>COMMENT
LOWcsrc/cpu/cpu_attn_rvv.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_attn_fp8.hpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp1COMMENT
LOWcsrc/cpu/cpu_types_vxe.hpp21#define vec_sr(a, b) ((a) >> (b)) // Vector Shift Right AlgebraicCOMMENT
1014 more matches not shown…
Excessive Try-Catch Wrapping679 hits · 719 pts
SeverityFileLineSnippetContext
LOWenv.py256 except Exception:CODE
LOWsetup.py125 except Exception:CODE
LOWsetup.py234 except Exception as e:CODE
LOWsetup.py516 except Exception:CODE
MEDIUMsetup.py117def find_tcmalloc() -> Path | None:CODE
MEDIUMtools/generate_cmake_presets.py156 print(f"Error writing file: {e}")CODE
LOWtools/install_nixl_from_source_ubuntu.py30 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py502 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py516 except Exception as e:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py584 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py619 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py765 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py963 except Exception:CODE
LOWtools/pre_commit/generate_attention_backend_docs.py1201 except Exception:CODE
LOWtests/conftest.py1307 except Exception:CODE
LOWtests/conftest.py1568 except Exception as e:CODE
MEDIUMtests/utils.py118def _nvml():CODE
LOWtests/utils.py81 except Exception as e:CODE
LOWtests/utils.py293 except Exception:CODE
LOWtests/utils.py575 except Exception as e:CODE
LOWtests/utils.py655 except Exception:CODE
LOWtests/utils.py1639 except Exception as e:CODE
LOWtests/utils.py1662 except Exception:CODE
LOWtests/utils.py1853 except Exception as e:CODE
LOWtests/utils.py2065 except Exception:CODE
LOWtests/v1/test_tensor_ipc_queue.py81 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py116 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py300 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py397 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py429 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py512 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py548 except Exception as e:CODE
LOWtests/v1/test_tensor_ipc_queue.py691 except Exception as e:CODE
LOWtests/v1/utils.py62 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py156 except Exception as e:CODE
LOWtests/v1/kv_offload/cpu/test_shared_offload_region.py117 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py289 except Exception as e:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py333 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py344 except Exception as exc:CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py364 except Exception as e:CODE
MEDIUMtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py329def _run_decode():CODE
LOWtests/v1/shutdown/test_forward_error.py73 except Exception as e:CODE
LOWtests/v1/shutdown/test_processor_error.py42 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/test_hf3fs_client.py28except Exception:CODE
LOW…ts/v1/kv_connector/unit/test_nixl_rocm_gpu_mem_diag.py36 except Exception:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py383 except Exception as e:CODE
LOWtests/v1/kv_connector/unit/utils.py334 except Exception as e:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py664 except Exception:CODE
LOW…/v1/kv_connector/unit/test_mooncake_store_connector.py701 except Exception:CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py233 except Exception as e:CODE
MEDIUM…s/v1/kv_connector/nixl_integration/toy_proxy_server.py238 print(f"Error occurred in disagg prefill proxy server - {api} endpoint")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py151 print(f"Error writing to file: {e}")CODE
MEDIUM…/kv_connector/nixl_integration/test_disagg_accuracy.py160 print(f"Error writing to file: {e}")CODE
LOWtests/v1/determinism/test_online_batch_invariance.py42 except Exception as e: # pragma: no coverCODE
LOWtests/v1/distributed/test_external_lb_dp.py88 except Exception as e:CODE
LOWtests/v1/distributed/test_external_lb_dp.py115 except Exception as e:CODE
MEDIUMtests/v1/distributed/test_external_lb_dp.py116 print(f"Error stopping servers: {e}")CODE
LOWtests/v1/distributed/test_internal_lb_dp.py184 except Exception as e:CODE
LOWtests/v1/distributed/test_internal_lb_dp.py212 except Exception as e:CODE
MEDIUMtests/v1/distributed/test_internal_lb_dp.py213 print(f"Error stopping servers: {e}")CODE
619 more matches not shown…
Modern Structural Boilerplate438 hits · 443 pts
SeverityFileLineSnippetContext
LOWsetup.py34logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_offload/tiering/p2p/p2p_connector_proxy.py32logger = logging.getLogger(__name__)CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py116 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOWtests/v1/kv_connector/unit/test_multi_connector.py86 def update_state_after_alloc(self, request, blocks, num_tokens) -> None:CODE
LOW…/v1/kv_connector/unit/test_handshake_pp_aggregation.py136 def update_state_after_alloc(self, request: Any, blocks: Any, num_external_tokens: int) -> None:CODE
LOW…/v1/kv_connector/unit/test_handshake_pp_aggregation.py142 def set_xfer_handshake_metadata(self, metadata: dict[int, KVConnectorHandshakeMetadata]) -> None:CODE
LOW…/v1/kv_connector/unit/offloading_connector/conftest.py7__all__ = ["request_runner"]CODE
LOW…s/v1/kv_connector/nixl_integration/toy_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWtests/v1/worker/test_gpu_worker_weight_transfer.py35 def update_weights(self, update_info: dict) -> None:CODE
LOWtests/v1/engine/test_core_engine_actor_manager.py43 def _set_visible_devices(self, aphrodite_config: Any, local_dp_rank: int) -> None:CODE
LOWtests/kernels/moe/test_marlin_vs_trtllm_mxint4.py71__all__ = [CODE
LOWtests/distributed/test_weight_transfer.py1220 def update_weights(self, update_info: dict) -> None:CODE
LOWtests/distributed/eplb_utils.py73def set_env_vars_and_device(env: dict[str, str]) -> None:CODE
LOW…/aphrodite_test_utils/aphrodite_test_utils/__init__.py11__all__ = ["blame", "BlameResult", "monitor", "MonitoredValues"]CODE
LOWtests/models/language/generation/test_hybrid.py66def _set_conv_state_layout(monkeypatch, layout: str) -> None:CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py37logger = logging.getLogger(__name__)CODE
LOWtests/parser/engine/replay_harness.py82 def set_vocab(self, vocab: dict[str, int]) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py488async def _set_healthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/test_dp_supervisor.py498async def _set_unhealthy(port: int, use_ssl: bool = False) -> None:CODE
LOWtests/entrypoints/openai/responses/conftest.py15logger = logging.getLogger(__name__)CODE
LOW…/entrypoints/openai/responses/test_parsable_context.py21logger = logging.getLogger(__name__)CODE
LOWtests/entrypoints/openai/responses/test_harmony.py30logger = logging.getLogger(__name__)CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py15logger = logging.getLogger(__name__)CODE
LOWbenchmarks/multi_turn/bench_utils.py28logger = logging.getLogger(__name__)CODE
LOWaphrodite/envs.py528logger = logging.getLogger(__name__)CODE
LOWaphrodite/env_override.py393def _update_scheduler_patched(self) -> None:CODE
LOWaphrodite/sampling_params.py811 def update_from_tokenizer(self, tokenizer: TokenizerLike) -> None:CODE
LOWaphrodite/__init__.py76__all__ = [CODE
LOWaphrodite/v1/request.py246 def update_block_hashes(self) -> None:CODE
LOWaphrodite/v1/kv_offload/base.py98 def set_state(self, val: Any) -> None:CODE
LOWaphrodite/v1/kv_offload/tiering/example/manager.py31logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/data/__init__.py6__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/control/__init__.py12__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/p2p/session/__init__.py11__all__ = [CODE
LOWaphrodite/v1/kv_offload/tiering/fs/io.py23logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/metrics/stats.py326 def update_from_output(self, prefill_stats: PrefillStats) -> None:CODE
LOWaphrodite/v1/attention/backends/flash_attn_diffkv.py41 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/triton_attn_diffkv.py81 def set_head_size_v(cls, head_size_v: int) -> None:CODE
LOWaphrodite/v1/attention/backends/mla/prefill/__init__.py10__all__ = [CODE
LOWaphrodite/v1/attention/ops/triton_decode_attention.py42logger = logging.getLogger(__name__)CODE
LOWaphrodite/v1/core/kv_cache_utils.py1755def update_kv_cache_capacity(aphrodite_config: AphroditeConfig, kv_cache_config: KVCacheConfig) -> None:CODE
LOWaphrodite/v1/core/sched/async_scheduler.py19 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/interface.py110 def update_draft_token_ids(self, draft_token_ids: "DraftTokenIds") -> None:CODE
LOWaphrodite/v1/core/sched/interface.py203 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py2377 def _update_waiting_for_remote_kv(self, request: Request) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1179 def _update_after_schedule(self, scheduler_output: SchedulerOutput) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1226 def _update_request_as_session(self, session: Request, update: StreamingUpdate) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py1923 def update_draft_token_ids(self, draft_token_ids: DraftTokenIds) -> None:CODE
LOWaphrodite/v1/core/sched/scheduler.py2113 def set_pause_state(self, pause_state: PauseState) -> None:CODE
LOWaphrodite/v1/spec_decode/extract_hidden_states.py80 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWaphrodite/v1/spec_decode/gemma4.py62 def set_per_group_block_table(self, gid: int, block_table: torch.Tensor) -> None:CODE
LOWaphrodite/v1/spec_decode/gemma4.py116 def _setup_centroids_cuda_graphs(self) -> None:CODE
LOWaphrodite/v1/spec_decode/llm_base_proposer.py312 def set_eplb_state(self, eplb_state: EplbState) -> None:CODE
LOWaphrodite/v1/fault_tolerance/__init__.py5__all__ = [CODE
LOWaphrodite/v1/sample/thinking_budget_state.py218 def _update_think_state(self, state: dict[str, Any]) -> None:CODE
LOWaphrodite/v1/sample/logits_processor/__init__.py326__all__ = [CODE
LOWaphrodite/v1/executor/aphrodite_net_devices.py135def set_worker_gpu_nic_mapping(local_rank: int) -> None:CODE
LOWaphrodite/v1/executor/aphrodite_net_devices.py213def set_worker_net_device(local_rank: int, aphrodite_config: AphroditeConfig) -> None:CODE
LOWaphrodite/v1/executor/__init__.py6__all__ = ["Executor", "UniProcExecutor"]CODE
378 more matches not shown…
AI Structural Patterns363 hits · 338 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py383CODE
LOWtests/conftest.py421CODE
LOWtests/conftest.py920CODE
LOWtests/v1/kv_offload/tiering/p2p/test_manager.py552CODE
LOWtests/v1/attention/utils.py169CODE
LOWtests/v1/attention/test_attention_backends.py319CODE
LOWtests/v1/core/test_kv_cache_utils.py117CODE
LOWtests/v1/core/test_scheduler.py2345CODE
LOWtests/v1/core/test_scheduler.py2466CODE
LOWtests/v1/core/utils.py49CODE
LOWtests/v1/core/utils.py202CODE
LOWtests/v1/kv_connector/unit/test_moriio_connector.py225CODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py346CODE
LOWtests/v1/kv_connector/unit/utils.py77CODE
LOWtests/v1/kv_connector/unit/utils.py177CODE
LOWtests/v1/sample/test_rejection_sampler.py65CODE
LOWtests/v1/e2e/general/test_mamba_prefix_cache.py161CODE
LOWtests/kernels/utils.py274CODE
LOWtests/kernels/utils.py817CODE
LOWtests/kernels/attention/test_mha_attn.py117CODE
LOWtests/kernels/attention/test_attention.py52CODE
LOW…sts/kernels/attention/test_triton_prefill_attention.py71CODE
LOWtests/kernels/mamba/test_mamba_ssm.py112CODE
LOWtests/kernels/mamba/utils.py73CODE
LOWtests/kernels/quantization/test_nvfp4_quant.py81CODE
LOWtests/kernels/moe/test_deepep_v2_moe.py187CODE
LOWtests/kernels/moe/test_moe_permute_unpermute.py104CODE
LOWtests/kernels/moe/test_moe.py1710CODE
LOWtests/kernels/moe/utils.py50CODE
LOWtests/kernels/moe/test_moe_layer.py928CODE
LOWtests/kernels/moe/test_moe_layer.py1027CODE
LOWtests/evals/mrcr/mrcr_eval.py159CODE
LOWtests/evals/gsm8k/gsm8k_eval.py202CODE
LOWtests/distributed/test_multiproc_executor.py23CODE
LOW…/models/multimodal/generation/vlm_utils/model_utils.py552CODE
LOWtests/models/transformers/fusers/test_moe.py186CODE
LOWtests/quantization/reference_mxfp4.py76CODE
LOWtests/quantization/reference_mxfp4.py211CODE
LOWtests/compile/test_graph_partition.py96CODE
LOWtests/compile/fullgraph/test_toy_llama.py151CODE
LOWtests/compile/passes/test_silu_mul_quant_fusion.py128CODE
LOWtests/compile/passes/test_fusion.py464CODE
LOWtests/benchmarks/test_random_dataset.py171CODE
LOWtests/entrypoints/openai/utils.py135CODE
LOWexamples/pooling/token_embed/jina_reranker_v3_online.py22CODE
LOWbenchmarks/kernels/benchmark_mrope.py78CODE
LOWaphrodite/sampling_params.py441CODE
LOWaphrodite/_custom_ops.py3188CODE
LOWaphrodite/_custom_ops.py4046CODE
LOWaphrodite/_xpu_ops.py888CODE
LOWaphrodite/_xpu_ops.py963CODE
LOWaphrodite/forward_context.py198CODE
LOWaphrodite/forward_context.py246CODE
LOWaphrodite/_aiter_ops.py106CODE
LOWaphrodite/_aiter_ops.py171CODE
LOWaphrodite/_aiter_ops.py202CODE
LOWaphrodite/_aiter_ops.py239CODE
LOWaphrodite/_aiter_ops.py438CODE
LOWaphrodite/_aiter_ops.py496CODE
LOWaphrodite/_aiter_ops.py2215CODE
303 more matches not shown…
Redundant / Tautological Comments221 hits · 336 pts
SeverityFileLineSnippetContext
LOWtools/pre_commit/generate_attention_backend_docs.py525 # Check if this is an MLA backend by parent class or namingCOMMENT
LOWtools/pre_commit/generate_attention_backend_docs.py1218 # Check if this is the "if use_mla:" branchCOMMENT
LOWtests/conftest.py397 # Set this to avoid hanging issueCOMMENT
LOWtests/conftest.py936 # Set this to avoid hanging issueCOMMENT
LOWtests/utils.py507 os.kill(spid, 0) # Check if still aliveCODE
LOWtests/test_config.py624 # Check if LONGCHAT_ROPE_PARAMETERS entries are in longchat_model_configCOMMENT
LOWtests/v1/attention/test_mla_backends.py1167 # Set num_speculative_tokens to query_len - 1COMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py585 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py589 # Set some to out of boundsCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py641 # Set some to -1 to test maskingCOMMENT
LOWtests/v1/attention/test_sparse_mla_backends.py645 # Set some to out of boundsCOMMENT
LOWtests/v1/core/test_scheduler.py2526 # Verify if position length is identicalCOMMENT
LOWtests/v1/core/test_scheduler.py3459 # Check if scheduled_encoder_inputs is empty as expectedCOMMENT
LOWtests/v1/core/test_scheduler.py3795 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/test_scheduler.py4103 # Set up to test different encoder cache existence scenario after preemptionCOMMENT
LOWtests/v1/core/utils.py253 # Verify if position length is identicalCOMMENT
LOW…extract_hidden_states_integration/predictable_llama.py81 # Check if we need auxiliary hidden statesCOMMENT
LOW…nnector/nixl_integration/config_sweep_accuracy_test.sh99# Check if cross-layers is enabled (non-empty)COMMENT
LOWtests/v1/determinism/test_batch_invariance.py295 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py551 # Check if tokens match firstCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py763 # Check if tokens matchCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py781 # Check if logprobs match bitwiseCOMMENT
LOWtests/v1/spec_decode/test_acceptance_length.py108 # Check if get_valid_backends is actually defined in the platform classCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh28# Set 1 to use multimodal prompts; else to use text-onlyCOMMENT
LOW…ts/v1/ec_connector/integration/test_epd_correctness.py217 # Check if server is readyCOMMENT
LOWtests/v1/e2e/spec_decode/test_async_spec_decode.py34 # Increment counterCOMMENT
LOWtests/v1/engine/test_engine_core_client.py375 # Check if all request IDs in outputs have finishedCOMMENT
LOWtests/v1/engine/utils.py131 # Check if the sampled_token_id occurs in choice_tensor[1:]COMMENT
LOWtests/utils_/test_network_utils.py79 # Check if IPv6 is supported by trying to create an IPv6 socketCOMMENT
LOWtests/kernels/moe/test_moe_layer.py1751 # Check if enough GPUs availableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py26# Check if aiter package is installedCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py35 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py38 # Check if the op is callableCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py44 # Check if the op exists in torch.ops.aphroditeCOMMENT
LOWtests/kernels/moe/test_rocm_aiter_topk.py47 # Check if the op is callableCOMMENT
LOWtests/evals/gsm8k/gsm8k_eval.py351 # Print results to terminalCOMMENT
LOWtests/distributed/test_eplb_execute.py146 # Check if the weights are correctCOMMENT
LOWtests/model_executor/test_qwen3_omni.py29 # Check if it's a special token that should be compressedCOMMENT
LOW…model_loader/runai_streamer_loader/test_runai_utils.py56 # Read the file in chunks to handle large files efficientlyCOMMENT
LOWtests/models/multimodal/generation/test_maverick.py59 # Print the outputsCOMMENT
LOWtests/quantization/test_gptq_v2.py43 # Check if gptq_v2 format is correctly loadedCOMMENT
LOWtests/quantization/test_gptq_v2.py105 # Print the output sequences if failedCOMMENT
LOWtests/compile/test_config.py50 # Check if get_raw_stream exists in builtinsCOMMENT
LOWtests/compile/fusions_e2e/conftest.py42 # Print the outputs.COMMENT
LOWtests/compile/fullgraph/test_full_graph.py227 # Print the outputs.COMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py71 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/llm/offline_mode/test_offline_mode.py138 # Set HF to offline mode and ensure we can still construct an LLMCOMMENT
LOWtests/entrypoints/serve/utils/test_request_logger.py95 # Set max_log_len to 10COMMENT
LOW…rve/sagemaker/test_sagemaker_middleware_integration.py314 # Check if environment variable middleware was appliedCOMMENT
LOWtests/entrypoints/openai/completion/test_shutdown.py100 # Check if any choice has finish_reason='abort'COMMENT
LOWtests/rocm/aiter/test_grouped_quant.py21# Check if aiter package is installedCOMMENT
LOWtests/rocm/aiter/test_mla_fp8_support_check.py107 # Set cache to TrueCOMMENT
LOWtests/lora/test_transformers_model.py39 # Print the outputs.COMMENT
LOWtests/lora/test_gptoss_tp.py66 # Print the outputs.COMMENT
LOWtests/lora/test_qwen3moe_tp.py55 # Print the outputs.COMMENT
LOWtests/lora/test_chatglm3_tp.py38 # Print the outputs.COMMENT
LOWtests/lora/test_deepseekv2_tp.py28 # Print the outputs.COMMENT
LOWtests/lora/test_minicpmv_tp.py51 # Print the outputs.COMMENT
LOWtests/lora/test_mixtral.py21 # Print the outputs.COMMENT
LOWtests/lora/test_quant_model.py52 # Print the outputs.COMMENT
161 more matches not shown…
Structural Annotation Overuse159 hits · 294 pts
SeverityFileLineSnippetContext
LOWbuild_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOWbuild_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOWbuild_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py134 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py140 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py760 # Step 1: probe hA, hB.COMMENT
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py770 # Step 2: a new key is discovered for the same request. TheCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1114 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5293 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5303 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5312 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py690 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py706 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py371 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py381 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py434 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py442 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py495 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py410 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py474 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py507 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py520 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py531 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py85 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py101 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py117 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py154 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py174 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py191 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py61 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py79 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py98 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py179 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py15 # Step 1: entry was added, committed to slot. Deque fills to maxlen=1,COMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py20 # Step 2: deque is full, oldest slot (containing h1) expires.COMMENT
LOW…s/v1/ec_connector/unit/cpu/scheduler/test_scheduler.py276 # Step 3: unpin fires, now eviction works.COMMENT
LOWtests/v1/ec_connector/integration/README.md61### Step 1: BaselineCOMMENT
LOWtests/v1/ec_connector/integration/README.md68### Step 2: EPD (1E + 1PD)COMMENT
LOWtests/v1/ec_connector/integration/README.md76### Step 3: EPD (1E + 1P + 1D)COMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh484# Step 1: Run baselineCOMMENT
99 more matches not shown…
Cross-Language Confusion54 hits · 285 pts
SeverityFileLineSnippetContext
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py154 (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)CODE
HIGHcsrc/cpu/generate_cpu_attn_dispatch.py223 "&& (__riscv_v_min_vlen == 128 || __riscv_v_min_vlen == 256)",CODE
HIGHcsrc/libtorch_stable/quantization/machete/generate.py490 "M > 256 && K <= 16384 && N <= 4096": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py493 "M > 128 && K <= 4096 && N <= 4096": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py494 "M > 128 && K <= 8192 && N <= 8192": ((128, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py497 "M > 64 && K <= 4069 && N <= 4069": ((128, 32), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py498 "M > 64 && K <= 4069 && N <= 8192": ((128, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py499 "M > 64 && K >= 8192 && N >= 12288": ((256, 128), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py502 "M > 32 && K <= 6144 && N <= 6144": ((128, 16), (1, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py503 "M > 32 && K >= 16384 && N >= 12288": ((256, 64), (2, 1, 1)),STRING
HIGHcsrc/libtorch_stable/quantization/machete/generate.py506 "M > 16 && K <= 12288 && N <= 8192": ((128, 32), (2, 1, 1)),STRING
HIGHtests/v1/attention/test_trtllm_attention_integration.py142 # Randomly permute blocks (starting from block 1; block 0 is null).COMMENT
HIGHtests/v1/attention/test_mla_backends.py352 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/attention/test_attention_backends.py171 # Permute the context blocks (excluding block 0 which is null)COMMENT
HIGHtests/v1/core/test_scheduler.py3201 num_blocks=5, # Can hold 64 tokens (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py3958 num_blocks=15, # can hold 244 tokens with 14 blocks (first block is null)CODE
HIGHtests/v1/core/test_scheduler.py4185 num_blocks=11, # Can hold 160 tokens (first block is null)CODE
HIGH…_connector/unit/offloading_connector/test_scheduler.py2598 # 4 GPU blocks: block 0 is null, blocks 1-3 are usable.COMMENT
HIGHtests/tool_parsers/test_granite_tool_parser.py41 "null_field": null,CODE
HIGHtests/tool_parsers/test_granite_20b_fc_tool_parser.py33 "null_field": null,CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py34 "role=null, "CODE
HIGHtests/tool_parsers/test_olmo3_tool_parser.py43 '"role": null, 'CODE
HIGHtests/tool_parsers/test_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_deepseekv3_tool_parser.py41 """"bool_field": true, "null_field": null, """STRING
HIGHtests/tool_parsers/test_internlm2_tool_parser.py54 "null_field": null,CODE
HIGHtests/tool_parsers/test_llama4_pythonic_tool_parser.py35 '"role": null, 'CODE
HIGHtests/tool_parsers/test_phi4mini_tool_parser.py49 "null_field": null,CODE
HIGHtests/tool_parsers/test_lfm2_tool_parser.py38 '"role": null, 'CODE
HIGHtests/tool_parsers/test_longcat_tool_parser.py53 "null_field": null,CODE
HIGHtests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
HIGHtests/tool_parsers/test_qwen3coder_tool_parser.py570 # Multi non-null: anyOf[string, integer, null] → first non-null is stringCOMMENT
HIGHtests/parser/engine/test_qwen3.py257 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py267 "questions": '[{"question": "Pick a color", "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_qwen3.py1042 ' "multiSelect": false, "answer": null}]'CODE
HIGHtests/parser/engine/test_qwen3.py1061 ' "multiSelect": false, "answer": null}]',CODE
HIGHtests/parser/engine/test_parser_engine.py598 result = engine._fix_arg_types('{"val": null}', "f")CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1199 text = "<|tool_call>call:configure{value:null}<tool_call|>"CODE
HIGHtests/parser/engine/test_gemma4_streaming_reasoning.py1205 text = "<|tool_call>call:configure{label:null}<tool_call|>"CODE
HIGHtests/parser/mistral/test_tool_calls.py2402_REAL_LEAK_CONTENT = 'bash[TOOL_CALLS]{"command": "cd /testbed && git diff xarray/core/weighted.py"}ometracediff --git aCODE
HIGHtests/parser/mistral/test_tool_calls.py2415 {"command": "cd /testbed && git diff xarray/core/weighted.py"}CODE
HIGH…e_out/token_in_token_out/test_return_routed_experts.py36 '{"sliding_window": null}',CODE
HIGHtests/entrypoints/openai/test_return_routed_experts.py33 '{"sliding_window": null}',CODE
HIGHaphrodite/_custom_ops.py2157 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2262 assert k_times_2 % 2 == 0, "input width must be even (gate || up layout)"CODE
HIGHaphrodite/_custom_ops.py2139 input_tensor: The input tensor with gate || up layout [m_topk, k*2]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1081 # result [null] [null] ... [null] [hit block 1 (1st block containCOMMENT
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py449 every (non-null) block — the default for full attention.STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1034 [null, null, block 3], otherwise, we return [null, null]STRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1039 we return 4 blocks[null, null, null, null]STRING
HIGHaphrodite/tool_parsers/utils.py432 (null, true, false) that some models produce instead of PythonSTRING
HIGHaphrodite/metal/mlx_backend/mla_cache.py11 Each token's cache entry is a combined latent vector [kv_norm || k_pe]:STRING
HIGHaphrodite/metal/paged_attention_backend/mla.py29 latent = [kv_norm || k_pe_roped] # kv_lora_rank + qk_rope_head_dim dimsSTRING
HIGH…ibuted/kv_transfer/kv_connector/v1/flexkv_connector.py47 cd FlexKV && bash build.shSTRING
HIGHaphrodite/benchmarks/datasets/datasets.py3957 # undefined), language (en), transcription directive (en), punctuationSTRING
Verbosity Indicators143 hits · 267 pts
SeverityFileLineSnippetContext
LOWbuild_and_upload_docker.sh23# Step 1: Build the wheelCOMMENT
LOWbuild_and_upload_docker.sh39# Step 2: Build the final Docker image using the wheelCOMMENT
LOWbuild_and_upload_docker.sh47# Step 3: Tag and push the Docker imageCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py134 # Step 1: lookup key 1, flushCOMMENT
LOWtests/v1/kv_offload/tiering/test_async_lookup.py140 # Step 2: lookup keys 2 and 3, flushCOMMENT
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py760 # Step 1: probe hA, hB.COMMENT
LOWtests/v1/kv_offload/tiering/p2p/test_sessions.py770 # Step 2: a new key is discovered for the same request. TheCOMMENT
LOWtests/v1/logits_processors/test_correctness.py1114 # Step 1: think-start token appears.COMMENT
LOWtests/v1/core/test_scheduler.py5293 # Step 1: A's load is admitted; B's is held back by the reservation (B neverCOMMENT
LOWtests/v1/core/test_scheduler.py5303 # Step 2: nothing changes until A's recv lands.COMMENT
LOWtests/v1/core/test_scheduler.py5312 # Step 3: A makes forward progress straight to RUNNING - no preemption wasCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py551 # Step 1: Get events from lmcache engineCOMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py558 # Step 2: Update connector output (simulate receiving from worker)COMMENT
LOWtests/v1/kv_connector/unit/test_lmcache_connector.py564 # Step 3: Take eventsCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py401 # Step 2: 5 blocks are in use (2 new for remote blocks).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py409 # Step 3: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py418 # Step 4: try to schedule, remote request is put to running listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py426 # Step 5: Remote request will be put back to waiting listCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py434 # Step 6: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py441 # Step 7: now we can schedule (with 2 blocks computed),COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py511 # Step 3: finish the request, free it.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py518 # Step 4: now we can initiate KV transfer (with 2 blocks computed).COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py526 # Step 5: finish recving (5 blocks in use)COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py533 # Step 6: schedule remote requestCOMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py540 # Step 7: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py457 # Step 8: free everything.COMMENT
LOW…/v1/kv_connector/unit/test_remote_prefill_lifecycle.py500 # Step 2: 3 blocks are in use,COMMENT
LOWtests/v1/determinism/test_batch_invariance.py690 # Step 1: Run decode and collect logprobsCOMMENT
LOWtests/v1/determinism/test_batch_invariance.py706 # Step 2: For each token position, run prefill and compareCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py371 # Step 2: Schedule creates NewRequestDataCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py381 # Step 3: Simulate model runner caching the prompt_token_idsCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py434 # Step 7: Schedule again - now request uses cached stateCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py442 # Step 8: Calculate num_tokens like gpu_model_runner.py:1284 doesCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py495 # Step 12: Add new streaming request with seq_id=1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py410 # Step 6: Verify request state after Cycle 1COMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py474 # Step 11: Verify request transitioned to WAITING_FOR_STREAMING_REQCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py507 # Step 13: Scheduler schedules the updated sessionCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py520 # Step 14: Model runner caches NEW prompt_token_ids referenceCOMMENT
LOWtests/v1/streaming_input/test_scheduler_streaming.py531 # Step 15: FINAL CRITICAL VERIFICATIONCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py85 # Step 1: Add initial request with 3 prompt tokens, all computedCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py101 # Step 2: Create streaming update with extended promptCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py117 # Step 3: Verify no free_indices leak (old slot recycled)COMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py154 # Step 1: Add initial request with one audio featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py174 # Step 2: Create streaming update with additional multimodal featureCOMMENT
LOW…/streaming_input/test_gpu_model_runner_v2_streaming.py191 # Step 3: Verify no free_indices leakCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py61 # Step 1: Create initial request state with some computed tokensCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py79 # Step 2: Create new request data with extended promptCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py98 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py101 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py131 # Step 1: Create initial request state with one multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py156 # Step 2: Create new request data with additional multimodal featureCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py176 # Step 3: Update the requestCOMMENT
LOW…/v1/streaming_input/test_gpu_model_runner_streaming.py179 # Step 4: Verify the request state was updated correctlyCOMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py15 # Step 1: entry was added, committed to slot. Deque fills to maxlen=1,COMMENT
LOW…1/ec_connector/unit/cpu/scheduler/test_step_tracker.py20 # Step 2: deque is full, oldest slot (containing h1) expires.COMMENT
LOW…s/v1/ec_connector/unit/cpu/scheduler/test_scheduler.py276 # Step 3: unpin fires, now eviction works.COMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh484# Step 1: Run baselineCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh487# Step 2: Test 1E + 1PDCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh490# Step 3: Test baseline 1P + 1DCOMMENT
LOW…1/ec_connector/integration/run_epd_correctness_test.sh493# # Step 4: Test 1E + 1P + 1DCOMMENT
83 more matches not shown…
Docstring Block Structure40 hits · 200 pts
SeverityFileLineSnippetContext
HIGHbenchmarks/benchmark_long_document_qa_throughput.py70 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGHaphrodite/_xpu_ops.py226XPU FP8 batched GEMM implementation for ``torch.ops.aphrodite.xpu_fp8_bmm``. Computes batched matrix multiplicationSTRING
HIGHaphrodite/v1/attention/backends/registry.py204Register or override a backend implementation. Args: backend: The AttentionBackendEnum member to register STRING
HIGHaphrodite/v1/attention/backends/mla/prefill/registry.py90Register or override an MLA prefill backend implementation. Args: backend: The MLAPrefillBackendEnum memberSTRING
HIGHaphrodite/v1/core/single_type_kv_cache_manager.py1021 For chunked local attention, we need to find the longest cache hit prefix of the blocks that is not lonSTRING
HIGHaphrodite/v1/structured_output/utils.py374 Check if grammar appears to use Lark syntax. Args: grammar_str: Input grammar string Returns: STRING
HIGHaphrodite/v1/structured_output/utils.py406 Convert a Lark grammar string to EBNF format. EBNF reference: https://github.com/ggerganov/llama.cpp/blob/STRING
HIGHaphrodite/v1/worker/utils.py258 Select a block size that is supported by all backends and is a factor of kv_manager_block_size. If kv_manaSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py134 Buffers incoming delta chunks to prevent fragmentation of multi-token special tags. If a chunkSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py178 Extracts tool calls from a completely generated model response (Non-Streaming). Args: modeSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py274 Handles streaming chunks Args: previous_text: The complete model text generated prior to tSTRING
HIGHaphrodite/tool_parsers/apertus_tool_parser.py467 Calculates the exact string difference to safely append new tool parameters. This ensures characters lSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py166Project ``x`` into Q/K/V with norms, RoPE and Gemma4 variants. Handles three Gemma4-specific branches: - **YOCSTRING
HIGHaphrodite/metal/metal_kernel_backend/attention_sdpa.py308Zero-pad Q/K/V on the last axis up to ``cache_head_dim``. Variable head_dim models (e.g. Gemma4 sliding=256, full=5STRING
HIGHaphrodite/metal/v1/model_adapter.py231Return per-layer ``(kv_heads, head_dim)`` lists for Gemma4, else None. Gemma4 26B/31B mix sliding attention (``STRING
HIGHaphrodite/metal/stt/audio.py57Load an audio file and return mono samples at *sample_rate* Hz. Tries ``librosa`` first (handles WAV natively withoSTRING
HIGHaphrodite/metal/stt/audio.py90Load audio via ffmpeg subprocess. Args: file_path: Path to the audio file. sample_rate: Target sampSTRING
HIGH…ed/kv_transfer/kv_connector/v1/lmcache_mp_connector.py709 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…rodite/distributed/kv_transfer/kv_connector/v1/base.py465 Get number of new tokens that can be loaded from the external KV cache beyond the num_computed_tokens. STRING
HIGH…ed/kv_transfer/kv_connector/v1/moriio/moriio_engine.py276Get remote allocation info for a request. Args: transfer_id:TransferId The request ID RetuSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py194 Submit a new lookup request to LMCache if there is no ongoing request. Supports both token-based and hSTRING
HIGH…nector/v1/lmcache_integration/multi_process_adapter.py544 Check and get the finished store and retrieve requests. Args: finished_req_ids_from_engineSTRING
HIGHaphrodite/distributed/weight_transfer/factory.py89Create a weight transfer engine instance. Args: config: Weight transfer configuration containing thSTRING
HIGHaphrodite/distributed/weight_transfer/base.py238 Construct typed init info from dict with validation. Args: init_dict: Dictionary containinSTRING
HIGHaphrodite/distributed/weight_transfer/base.py256 Construct typed update info from dict with validation. Args: update_dict: Dictionary contaSTRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py529 Choose a _KernelT that can implement the given config for the given compute capability. Attempts to choose the STRING
HIGHaphrodite/model_executor/kernels/linear/__init__.py703 Choose an MPLinearKernel that can implement the given config for the given compute capability. Attempts to choSTRING
HIGH…/model_executor/layers/fused_moe/expert_map_manager.py322 Map global expert ID to local expert ID. Args: global_id: Global expert ID (0 to global_nuSTRING
HIGHaphrodite/model_executor/models/keye_vl1_5.py77 Return num_patches per video. Args: grid_thw: Tensor with shape [N, 3] containing temporal, height, wiSTRING
HIGHaphrodite/model_executor/models/isaac.py228Apply pixel shuffle to a packed vision sequence without unpacking per image. Args: x (`torch.Tensor`): STRING
HIGHaphrodite/multimodal/gpu_ipc_memory.py160Return KV-cache memory remaining after frontend multimodal reservations. The reservation covers: * The total `STRING
HIGHaphrodite/multimodal/audio.py92Normalize audio to the specified format. This function handles channel reduction for multi-channel audio, suppoSTRING
HIGHaphrodite/multimodal/audio.py316Split audio into chunks with intelligent split points. Splits long audio into smaller chunks at low-energy regions STRING
HIGH…rodite/third_party/flash_linear_attention/ops/chunk.py147 Args: q (torch.Tensor): Queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGH…rd_party/flash_linear_attention/ops/fused_recurrent.py509 Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): STRING
HIGHaphrodite/benchmarks/lib/ready_checker.py25 Wait for an endpoint to become available before starting benchmarks. Args: request_func: The async reqSTRING
HIGHaphrodite/entrypoints/chat_utils.py1420 Parses a given multi-modal content part based on its type. Args: part: A dict containing the content pSTRING
HIGHaphrodite/entrypoints/speech_to_text/base/utils.py18Read an uploaded file enforcing a size limit *before* full materialization. The function first checks the ConteSTRING
HIGHaphrodite/transformers_utils/processors/isaac.py174Convert normalized images into flattened ViT-style patches. Args: image (`torch.Tensor`): TensoSTRING
HIGHaphrodite/lora/resolver.py69Get a registered resolver instance by name. Args: resolver_name: Name of the resolver to get. STRING
AI Slop Vocabulary75 hits · 163 pts
SeverityFileLineSnippetContext
LOWcsrc/libtorch_stable/quantization/machete/generate.py413 # For now, we can just use the first accumulator type seen sinceSTRING
MEDIUMtests/v1/logits_processors/test_custom_offline.py28# Create a mixture of requests which do and don't utilize the dummy logitprocCOMMENT
LOWtests/v1/cudagraph/test_breakable_cudagraph.py307 # Outside capture: decorator should just call through.COMMENT
MEDIUMtests/renderers/test_sparse_tensor_validation.py58 # explicitly so this fixture is robust to process-wide invariant-check stateCOMMENT
MEDIUMtests/kernels/attention/test_attention_selector.py516 # binding, so patch is_xpu there (not on flash_attn's) to stay robust toCOMMENT
MEDIUMtests/kernels/mamba/test_mamba_mixer2.py106 # - utilize mock patching to disable TP whenCOMMENT
MEDIUMtests/distributed/test_pynccl.py373 # Essentially this is an all-gather operation.COMMENT
MEDIUMtests/distributed/test_context_parallel.py46 # .buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yamlCOMMENT
MEDIUMtests/distributed/test_context_parallel.py48 # .buildkite/lm-eval-harness/configs/Qwen2.5-1.5B-Instruct.yamlCOMMENT
LOWtests/model_executor/test_qwen3_omni.py41 # Regular token, just add itCOMMENT
MEDIUMtests/models/registry.py936 # Keep the init/schema harness eager (these tests never run forward).COMMENT
MEDIUMtests/parser/engine/test_replay.py66 # token, so it does not fit this TOOL_END-based replay harness.COMMENT
MEDIUMtests/parser/engine/test_delegating_replay.py82 # token, so it does not fit this TOOL_END-based replay harness.COMMENT
LOWexamples/offline_inference/ray_distributed_inference.py71 # For tensor_parallel_size == 1, we simply set num_gpus=1.COMMENT
MEDIUMbenchmarks/kernels/benchmark_silu_mul_fp8_quant.py678# Create comprehensive 3-way comparison plotsCOMMENT
LOWaphrodite/env_override.py312# functions just return True.COMMENT
LOWaphrodite/v1/attention/backends/flash_attn.py317 # but for now just set it to `UNIFORM_BATCH` to get use to drop downCOMMENT
LOWaphrodite/v1/attention/backends/utils.py278 # then we can simply use a cdiv for the rest.COMMENT
MEDIUMaphrodite/v1/attention/ops/triton_decode_attention.py358 # explicitly facilitate overlapping load/computeCOMMENT
LOWaphrodite/v1/core/kv_cache_coordinator.py460 # Single group; useless but just set ``use_eagle`` for consistency regardless.COMMENT
MEDIUMaphrodite/v1/core/encoder_cache_manager.py318# utilize the cache and this class will fold into EncoderCacheManager, asCOMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py560 # KV cache in sync, so just return an empty tensor.COMMENT
LOWaphrodite/v1/spec_decode/llm_base_proposer.py1708 # Therefore, we can just return the logits.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py704 # CUDAGraph memory size and may not utilize all gpu memory.COMMENT
MEDIUMaphrodite/v1/worker/gpu_worker.py1020 # Generate the trace name by combining prefix with comprehensive rank suffixCOMMENT
LOWaphrodite/v1/worker/gpu/model_runner.py1315 # For piecewise and eager mode, just call model().COMMENT
LOWaphrodite/v1/engine/parallel_sampling.py116 # If streaming, just return the current outputCOMMENT
MEDIUMaphrodite/tool_parsers/llama_tool_parser.py219 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/jamba_tool_parser.py182 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/granite_tool_parser.py163 # re-set stuff pertaining to progress in the current toolCOMMENT
LOWaphrodite/tool_parsers/xlam_tool_parser.py492 # If we encounter an error, just return the delta text as regular contentCOMMENT
MEDIUMaphrodite/tool_parsers/granite_20b_fc_tool_parser.py177 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMaphrodite/tool_parsers/step3_tool_parser.py51 # Explicit state flags for robust streamingCOMMENT
LOWaphrodite/tokenizers/mistral.py499 # if underlying tokenizer is sentencepiece, we just add "�".COMMENT
LOWaphrodite/platforms/cuda.py729 # users can just use IR op priority directlyCOMMENT
MEDIUMaphrodite/distributed/utils.py321 """A robust barrier to synchronize all ranks.STRING
MEDIUM…ransfer/kv_connector/v1/mooncake/mooncake_connector.py859 # Tasks can await async events, so a surplus (2x is a robust heuristic)COMMENT
MEDIUMaphrodite/config/model.py327 """Enable the custom cumem allocator to leverage advanced GPU memorySTRING
MEDIUMaphrodite/config/parallel.py595 # To make the initialization more robust we retry a few timesCOMMENT
LOW…odite/model_executor/layers/mamba/ops/causal_conv1d.py188 # first chunk and does not have prior-token, so just set to 0COMMENT
MEDIUM…dite/model_executor/layers/fused_moe/modular_kernel.py47# The goal is to be able to utilize different communication mechanisms withCOMMENT
MEDIUM…xecutor/layers/fused_moe/prepare_finalize/deepep_ll.py38 # TODO (varun) : Optimize leverage num_tokens_per_expert countsCOMMENT
MEDIUM…executor/layers/fused_moe/experts/fused_humming_moe.py315 # Neighboring nodes are required to utilize distinct workspaces.COMMENT
MEDIUMaphrodite/model_executor/layers/quantization/fp8.py270 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…hrodite/model_executor/layers/quantization/modelopt.py302 # Normalize quant_algo for robust matching (ModelOpt may emit lowercase).COMMENT
MEDIUM…odite/model_executor/layers/quantization/fbgemm_fp8.py53 # For GPUs that lack FP8 hardware support, we can leverage the MarlinCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py107 # to fully utilize the E4M3 dynamic range (e.g., global_scale=1).COMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp4.py165 # For GPUs that lack FP4 hardware support, we can leverage theCOMMENT
MEDIUM…executor/layers/quantization/utils/marlin_utils_fp8.py60 # For GPUs that lack FP8 hardware support, we can leverage theCOMMENT
LOW…odel_executor/layers/quantization/utils/quant_utils.py415 # Unquantized layer: just return base weightsCOMMENT
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
MEDIUMaphrodite/model_executor/models/deepseek_ocr.py140 """Example of overriding the wrapper class `__init__()` in order to utilizeSTRING
LOWaphrodite/model_executor/models/qwen3_asr.py516 # No audio features, just return linear positionsCOMMENT
LOW…odite/model_executor/models/transformers/multimodal.py372 # NOTE: we can't just set caching=False because base class methodCOMMENT
LOWaphrodite/models/deepseek_v4/xpu/xpu_sparse.py51 # Profile run: no-op, just return q (no padding needed on XPU).COMMENT
MEDIUM…dels/deepseek_v4/nvidia/ops/fused_indexer_q_cutedsl.py163 # all threads in a warp to be active since we utilize warp shuffle later.COMMENT
LOWaphrodite/reasoning/granite_reasoning_parser.py182 # corrected; just return the delta text as normal content.COMMENT
LOWaphrodite/reasoning/hunyuan_a13b_reasoning_parser.py88 # this id is not part of content, so just return [] here.COMMENT
LOWaphrodite/reasoning/olmo3_reasoning_parser.py251 # this id is not part of content, so just return [] here.COMMENT
MEDIUMaphrodite/multimodal/evs.py228 # exact timestamp count. This is robust even when earlyCOMMENT
15 more matches not shown…
Hallucination Indicators11 hits · 115 pts
SeverityFileLineSnippetContext
CRITICALrust/src/cmd/src/cli/unsupported.rs141/// - `aphrodite.entrypoints.cli.serve.ServeSubcommand.subparser_init(...)`COMMENT
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py746 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py958 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/v1/e2e/general/test_mamba_prefix_cache.py977 assert engine.llm_engine.engine_core.engine_core.scheduler.reset_prefix_cache()CODE
CRITICALtests/distributed/test_torchrun_example_moe.py80params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/distributed/test_torchrun_example.py71params = list(llm.llm_engine.model_executor.driver_worker.worker.model_runner.model.parameters())CODE
CRITICALtests/models/language/generation/test_gemma.py19 lambda self: self.model_runner.model.language_model.model.normalizer.cpu().item() # noqa: E501CODE
CRITICALtests/models/language/generation/test_gemma.py23 normalizers = llm.llm.collective_rpc(lambda self: self.model_runner.model.model.normalizer.cpu().item())CODE
CRITICALaphrodite/v1/spec_decode/llm_base_proposer.py1359 self.model.model.embed_tokens.weight.cpu(),CODE
CRITICAL…rodite/third_party/flash_linear_attention/ops/utils.py158 triton.runtime.driver.active.utils.get_device_properties(i)["max_shared_mem"]CODE
CRITICALaphrodite/entrypoints/cli/main.py42 aphrodite.entrypoints.cli.benchmark.main.maybe_exec_rust_bench()CODE
Fake / Example Data65 hits · 75 pts
SeverityFileLineSnippetContext
LOWtests/v1/attention/test_mla_backends.py1443 ["placeholder"],CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py308 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_dspark_noncausal_sparse_mla.py312 builder = backend_cls.get_builder_cls()(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py428 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_sparse_mla_backends.py433 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1300 aphrodite_config.compilation_config.static_forward_context["placeholder"] = SimpleNamespace(CODE
LOWtests/v1/attention/test_sparse_mla_backends.py1305 builder = builder_cls(kv_cache_spec, ["placeholder"], aphrodite_config, device)CODE
LOWtests/v1/attention/test_attention_backends.py525 ["placeholder"],CODE
LOWtests/v1/attention/test_attention_backends.py695 "placeholder": PerLayerParameters(CODE
LOWtests/v1/attention/test_attention_backends.py739 kv_cache_spec, ["placeholder"], aphrodite_config, deviceCODE
LOWtests/v1/kv_connector/unit/test_nixl_push_connector.py776 payload = _registration_data("placeholder")CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py82 '{"to": "user@example.com", "subject": "Daily Update"}',CODE
LOWtests/tool_parsers/test_kimi_k2_tool_parser.py89 {"to": "user@example.com", "subject": "Daily Update"},CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py31 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_olmo3_tool_parser.py40 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py23 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_pythonic_tool_parser.py32 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py26 "register_user(name='John Doe', "CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py35 arguments='{"name": "John Doe", 'CODE
LOWtests/tool_parsers/test_lfm2_tool_parser.py324 "[grocery.orderIngredients(ingredientList=[{'name': 'apple', 'quantity': '2'}], deliveryAddress='123 Main St')]"CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py41 '<tool_calls>[{"name": "get_weather", "arguments": {"city": "San Francisco", "metric": "celsius"}}, {"name":CODE
LOWtests/tool_parsers/test_hunyuan_a13b_tool_parser.py47 "name": "John Doe",CODE
LOWtests/kernels/helion/test_pattern_matching.py121 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOWtests/kernels/helion/test_pattern_matching.py186 input_node = next(n for n in gm.graph.nodes if n.op == "placeholder")CODE
LOW…rnels/attention/test_rocm_aiter_mla_decode_metadata.py115 layer_name = "placeholder"CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py126 dummy_data = builder.get_dummy_mm_data(100, mm_counts, {})CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py128 assert "audio" in dummy_dataCODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py129 assert len(dummy_data["audio"]) == 2CODE
LOW…ts/models/multimodal/processing/test_audioflamingo3.py132 assert len(dummy_data["audio"][0]) == expected_lenCODE
LOWtests/parser/mistral/test_tool_calls.py381 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py874 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py1277 "name": "John Doe",CODE
LOWtests/parser/mistral/test_tool_calls.py374 """[TOOL_CALLS] [{"arguments":{"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/parser/mistral/test_tool_calls.py867 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/parser/mistral/test_tool_calls.py1270 """[TOOL_CALLS] [{"arguments": {"name": "John Doe"}, "name": "get_age"}]""", # noqa: E501STRING
LOWtests/compile/test_graph_partition.py175 assert [node.op for node in splitting_gm.graph.nodes] == ["placeholder"] + 2 * ["call_function"] + ["output"]CODE
LOWtests/compile/test_graph_partition.py58 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py112 if node.op == "call_function" and node.target == operator.getitem and node.args[0].op == "placeholder":CODE
LOWtests/compile/test_graph_partition.py397 if node.op == "placeholder" and isinstance(node.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py456 if n.op == "placeholder" and isinstance(n.meta.get("example_value"), torch.SymInt)CODE
LOWtests/compile/test_graph_partition.py461 if n.op == "placeholder"CODE
LOWtests/compile/test_graph_partition.py564 if n.op != "placeholder":CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py225 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py237 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py253 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py268 placeholders = [n for n in graph_module.graph.nodes if n.op == "placeholder"]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py282 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/compile/passes/ir/test_clone_cleanup.py299 x_node = [n for n in graph_module.graph.nodes if n.op == "placeholder"][0]CODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOWtests/benchmarks/test_txt_slices_dataset.py20Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod temporCODE
LOW…hrodite/model_executor/models/transformers/fx_utils.py106 if kind == "placeholder":CODE
LOW…hrodite/model_executor/models/transformers/fx_utils.py151 return isinstance(node, fx.Node) and node.op == "placeholder" and str(node.target).lstrip("*") == self.varkwCODE
LOW…odite/model_executor/models/transformers/fusers/qkv.py64 and node.args[0].op == "placeholder"CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py133 x = find_node(graph, lambda n: n.op == "placeholder")CODE
LOW…/model_executor/models/transformers/fusers/rms_norm.py173 if (x := find_node(graph, lambda n: n.op == "placeholder")) is None:CODE
LOWaphrodite/compilation/piecewise_backend.py30 if node.op == "placeholder":CODE
LOWaphrodite/compilation/piecewise_backend.py59 if node.op != "placeholder":CODE
LOWaphrodite/compilation/backends.py451 input_node.op == "placeholder" or node_to_subgraph_id[input_node] <= prev_non_splitting_subgraph_idCODE
LOWaphrodite/compilation/backends.py537 if node.op in ("output", "placeholder"):CODE
5 more matches not shown…
Modern AI Meta-Vocabulary24 hits · 67 pts
SeverityFileLineSnippetContext
MEDIUMconfig.yaml22 # The maximum sequence length/context window for the modelCOMMENT
MEDIUMtools/pre_commit/generate_attention_backend_docs.py1621# Top-level orchestrationCOMMENT
MEDIUMtests/v1/kv_offload/tiering/p2p/test_manager.py1233# _poll_once orchestrationCOMMENT
MEDIUMtests/v1/kv_connector/unit/test_offloading_connector.py151 # Use a long prompt that fits within the model's context window.COMMENT
MEDIUMtests/v1/engine/test_async_llm.py830 # Wait for generation to start (event-driven)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py872 # Wait for some tokens (event-driven, handles slow token generation)COMMENT
MEDIUMtests/v1/engine/test_async_llm.py929 # Wait for at least one token across any request (event-driven)COMMENT
MEDIUMtests/evals/mrcr/mrcr_eval.py32# Skip chain-of-thought on reasoning models; ignored by non-reasoning templates.COMMENT
MEDIUMtests/compile/fullgraph/test_basic_correctness.py57 # embedding modelCOMMENT
MEDIUMtests/entrypoints/openai/responses/test_harmony.py584 # NOTE: chain-of-thought should be removed.COMMENT
MEDIUM…ntrypoints/openai/chat_completion/test_serving_chat.py1120 # adding max_tokens should exceed the model context window.COMMENT
MEDIUMaphrodite/_xpu_ops.py979 window_size=(-1, -1), # -1 means infinite context windowCODE
MEDIUMaphrodite/v1/attention/ops/vit_attn_wrappers.py247 # Without it, hallucinations occur with the backendCOMMENT
MEDIUMaphrodite/v1/executor/abstract.py44 uses_ray: bool = False # whether the executor uses Ray for orchestration.CODE
MEDIUMaphrodite/metal/stt/whisper/config.py13# Maximum decode tokens for Whisper models (matches Whisper context window).COMMENT
MEDIUM…ibuted/kv_transfer/kv_connector/v1/nixl/push_worker.py267 # progress is event-driven (see module docstring).COMMENT
MEDIUM…d/kv_transfer/kv_connector/v1/mooncake/store/worker.py4# The transfer-thread scaffolding (KVTransferThread, KVCacheStoreSendingThread,COMMENT
MEDIUMaphrodite/model_executor/models/granite_speech.py79# work pretty well with zero shot.COMMENT
MEDIUMaphrodite/model_executor/models/phi3v.py561 # initialized as an embedding modelCOMMENT
MEDIUMaphrodite/models/minimax_m3/amd/model.py1268# NVIDIA copy — it only orchestrates the shared vision tower + the per-platformCOMMENT
MEDIUMaphrodite/reasoning/gemma4_utils.py27 print(result["thinking"]) # chain-of-thought or NoneSTRING
MEDIUMaphrodite/reasoning/gemma4_utils.py76 >>> print(result["thinking"]) # chain-of-thought reasoning or NoneSTRING
MEDIUMaphrodite/entrypoints/speech_to_text/base/serving.py390 # which is a strong sign of hallucination in outputs.COMMENT
MEDIUMaphrodite/vllm_flash_attn/flash_attn_interface.py138 window_size=(-1, -1), # -1 means infinite context windowCODE
TODO Padding11 hits · 16 pts
SeverityFileLineSnippetContext
LOWcsrc/cpu/sgl-kernels/common.h378 // TODO: implement reverse order of [MB / cache_blocks_mb, NB, cache_blocks_mb]COMMENT
LOW…nector/v1/lmcache_integration/multi_process_adapter.py575 # TODO: add error handling hereCOMMENT
LOW…e/model_executor/kernels/linear/mixed_precision/xpu.py181 # TODO: implement asym caseCOMMENT
LOWaphrodite/entrypoints/openai/responses/protocol.py697 # TODO: implement the other reason for incomplete_details,COMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py308 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py341 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py365 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py402 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py432 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py451 # TODO: implement it based on torch opsCOMMENT
LOWaphrodite/lora/punica_wrapper/punica_base.py478 # TODO: implement it based on torch opsCOMMENT
AI Response Leakage2 hits · 15 pts
SeverityFileLineSnippetContext
HIGHtests/v1/sample/test_logprobs.py919 # Based on user's example: "In this example,"COMMENT
HIGHexamples/vision/vision_example.py116 # In this example, we override max_num_seqs to 5 whileCOMMENT
Example Usage Blocks9 hits · 14 pts
SeverityFileLineSnippetContext
LOWformatting.sh4# Usage:COMMENT
LOWtools/setup_deepgemm_pythons.sh8# Usage:COMMENT
LOWdocker/docker-bake.hcl5# Usage:COMMENT
LOWdocker/export_wheels.sh6# Usage:COMMENT
LOW…/nixl_integration/run_multi_connector_accuracy_test.sh15# Usage:COMMENT
LOW…nector/nixl_integration/spec_decode_acceptance_test.sh13# Usage:COMMENT
LOW…nixl_integration/run_multi_connector_edge_case_test.sh15# Usage:COMMENT
LOWexamples/run_cluster.sh8# Usage:COMMENT
LOWexamples/multi_node.sh11# Example usage:COMMENT
Slop Phrases5 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMtests/models/multimodal/generation/test_common.py64# model arch happens to be a substring of another one, you can add aCOMMENT
MEDIUMtests/models/multimodal/generation/test_common.py85# NOTE you can add --collect-only to any of the above commands to seeCOMMENT
MEDIUM…disagg_prefill_lmcache_v1/disagg_aphrodite_launcher.sh24# secure random value. This is set to a fixed value for demonstration purposes only.COMMENT
LOW…ibuted/kv_transfer/kv_connector/v1/nixl/pull_worker.py84 # while processing the next batch, we make sure to only set anCOMMENT
MEDIUMaphrodite/model_executor/models/interfaces.py239 as a language model component.STRING
Overly Generic Function Names4 hits · 4 pts
SeverityFileLineSnippetContext
LOWexamples/disaggregated_prefill/p2p_nccl/proxy_server.py122async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/nixl_proxy_server.py180 async def handle_request():CODE
LOW…marks/disagg_benchmarks/disagg_prefill_proxy_server.py134 async def handle_request():CODE
LOWbenchmarks/disagg_benchmarks/round_robin_proxy.py15 async def handle_request(self, request):CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/e2e/general/test_streaming_input.py473CODE