Repository Analysis

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

37.4 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of LMCache/LMCache, a Python project with 11,550 GitHub stars. SynthScan v2.0 examined 490,059 lines of code across 1934 source files, recording 10756 pattern matches distributed across 24 syntactic categories. The overall adjusted score of 37.4 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

37.4
Adjusted Score
37.4
Raw Score
100%
Time Factor
2026-08-28
Last Push
11.6K
Stars
Python
Language
490.1K
Lines of Code
1.9K
Files
10.8K
Pattern Hits
2026-08-29
Scan Date
0.24
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 2HIGH 457MEDIUM 2238LOW 8059

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 10756 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators2059 hits · 7550 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_utils.py496# ============================================================COMMENT
MEDIUMtests/test_utils.py498# ============================================================COMMENT
MEDIUMtests/test_utils.py27# ============================================================COMMENT
MEDIUMtests/test_utils.py29# ============================================================COMMENT
MEDIUMtests/test_utils.py61# ============================================================COMMENT
MEDIUMtests/test_utils.py63# ============================================================COMMENT
MEDIUMtests/test_utils.py188# ============================================================COMMENT
MEDIUMtests/test_utils.py190# ============================================================COMMENT
MEDIUMtests/test_utils.py211# ============================================================COMMENT
MEDIUMtests/test_utils.py213# ============================================================COMMENT
MEDIUMtests/test_utils.py234# ============================================================COMMENT
MEDIUMtests/test_utils.py236# ============================================================COMMENT
MEDIUMtests/test_utils.py394# ============================================================COMMENT
MEDIUMtests/test_utils.py396# ============================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py186# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py188# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py94# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py96# ==============================================================================COMMENT
MEDIUMtests/v1/test_torch_ops.py124# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py126# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py22# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py24# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py50# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py52# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py2891# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py2893# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py2922# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py2924# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3020# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3022# ==========================================COMMENT
MEDIUMtests/v1/test_musa_support.py38# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py40# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py89# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py91# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py169# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py171# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py303# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py305# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py27# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py29# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py73# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py75# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py167# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py169# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py226# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py228# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py25# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_lazy_offload_pending_store.py26# ===========================================================================COMMENT
MEDIUMtests/v1/test_lazy_offload_pending_store.py28# ===========================================================================COMMENT
MEDIUMtests/v1/test_lazy_offload_pending_store.py126# ===========================================================================COMMENT
MEDIUMtests/v1/test_lazy_offload_pending_store.py128# ===========================================================================COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py30# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py32# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py235# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py237# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py284# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py286# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py517# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py525# ---------------------------------------------------------------------------COMMENT
1999 more matches not shown…
Hyper-Verbose Identifiers5428 hits · 5317 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py257def clean_translation_response(text: str) -> str:CODE
LOWtests/test_utils.py156 def test_nested_brackets_error(self):CODE
LOWtests/test_utils.py162 def test_unmatched_closing_bracket(self):CODE
LOWtests/test_utils.py172 def test_invalid_range_start_gt_end(self):CODE
LOWtests/test_utils.py297 def test_from_string_roundtrip(self, basic_key):CODE
LOWtests/test_utils.py302 def test_from_string_with_tags_roundtrip(self, key_with_tags):CODE
LOWtests/test_utils.py311 def test_from_string_invalid_tag_format(self):CODE
LOWtests/test_utils.py315 def test_to_dict_and_from_dict(self, basic_key):CODE
LOWtests/test_utils.py325 def test_from_dict_invalid_tag(self):CODE
LOWtests/test_utils.py500 def test_parse_cache_engine_key(self):CODE
LOWtests/test_utils.py40 def test_numerator_smaller_than_denominator(self):CODE
LOWtests/test_utils.py75 def test_three_or_more_consecutive(self):CODE
LOWtests/test_utils.py83 def test_non_consecutive_order_preserved(self):CODE
LOWtests/test_utils.py109 def test_three_or_more_elements(self):CODE
LOWtests/test_utils.py273 def test_not_equal_different_hash(self, basic_key):CODE
LOWtests/test_utils.py283 def test_not_equal_different_type(self, basic_key):CODE
LOWtests/test_utils.py360 def test_chunk_hash_hex_bytes(self):CODE
LOWtests/test_utils.py372 def test_unsupported_dtype_raises(self):CODE
LOWtests/test_utils.py382 def test_no_tags_when_no_tag_prefix(self):CODE
LOWtests/test_utils.py409 def test_hash_includes_layer_id(self, layer_key):CODE
LOWtests/test_utils.py432 def test_eq_different_base_key(self, layer_key):CODE
LOWtests/test_utils.py462 def test_from_string_roundtrip(self, layer_key):CODE
LOWtests/test_utils.py467 def test_from_string_with_tags(self):CODE
LOWtests/test_utils.py485 def test_from_string_invalid_tag(self):CODE
LOWtests/test_utils.py516 def test_parse_layer_cache_engine_key(self):CODE
LOWtests/test_utils.py534 def test_parse_cache_key_without_tags(self):CODE
LOWtests/test_utils.py549 def test_parse_cache_key_with_tags(self):CODE
LOWtests/test_utils.py568 def test_parse_layer_cache_key_without_tags(self):CODE
LOWtests/test_utils.py583 def test_parse_layer_cache_key_with_tags(self):CODE
LOWtests/test_utils.py601 def test_roundtrip_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py621 def test_roundtrip_cache_engine_key_with_tags(self):CODE
LOWtests/test_utils.py644 def test_roundtrip_layer_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py665 def test_roundtrip_layer_cache_engine_key_with_tags(self):CODE
LOWtests/test_observability.py32def test_on_retrieve_finished(stats_monitor):CODE
LOWtests/test_observability.py44def test_on_store_request_and_finished(stats_monitor):CODE
LOWtests/test_observability.py52def test_update_local_cache_usage(stats_monitor):CODE
LOWtests/test_observability.py58def test_update_remote_cache_usage(stats_monitor):CODE
LOWtests/test_observability.py64def test_update_local_storage_usage(stats_monitor):CODE
LOWtests/test_observability.py104def test_remote_write_metrics(stats_monitor):CODE
LOWtests/test_observability.py143def test_retrieve_and_store_speed(stats_monitor):CODE
LOWtests/test_observability.py161def test_multiple_lookup_operations(stats_monitor):CODE
LOWtests/test_observability.py180def test_mixed_remote_operations(stats_monitor):CODE
LOWtests/test_observability.py273def test_zero_division_protection(stats_monitor):CODE
LOWtests/test_observability.py284def _cleanup_prometheus_logger():CODE
LOWtests/test_observability.py318def test_prometheus_logger_default_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py326def test_prometheus_logger_custom_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py346def test_prometheus_logger_partial_custom_buckets(CODE
LOWtests/test_observability.py373def test_prometheus_logger_get_or_create_with_config(CODE
LOWtests/test_observability.py393def test_prometheus_logger_get_or_create_allows_multiple_roles(CODE
LOWtests/test_observability.py408def test_prometheus_logger_label_view_rebinds_dynamic_metrics(CODE
LOWtests/test_observability.py438def test_prometheus_logger_reset_reinitializes_all_label_views(CODE
LOWtests/test_banner.py35def test_banner_contains_version_links_and_opt_out_hint():CODE
LOWtests/test_banner.py46def test_banner_is_plain_on_non_tty_stream():CODE
LOWtests/test_banner.py52def test_banner_is_colored_on_tty_stream():CODE
LOWtests/test_banner.py60def test_banner_prints_at_most_once_per_process():CODE
LOWtests/test_banner.py70def test_banner_disabled_by_env_var(monkeypatch, value):CODE
LOWtests/test_banner.py77def test_banner_not_disabled_by_falsy_env_var(monkeypatch):CODE
LOWtests/test_build_profiles_rocm.py64def test_hipify_wrapper_returns_paths_relative_to_project_root(CODE
LOWtests/test_build_profiles_rocm.py81def test_hipify_wrapper_copies_headers_into_the_output_tree(CODE
LOWtests/test_serde.py102def test_cachegen_unmatched_size():CODE
5368 more matches not shown…
Docstring Block Structure274 hits · 1370 pts
SeverityFileLineSnippetContext
HIGHtests/v1/distributed/test_memory_capacity.py122Build a config whose derived capacity equals ``capacities``. Args: capacities: The per-medium result the coSTRING
HIGHsetup_extensions/build_profiles/rocm.py28Hipify ``csrc/cuda`` and return paths for the requested source files. Args: source_names: Base names of theSTRING
HIGHexamples/token_dropping/utils.py163Move key cache RoPE from old positions to new positions. Args: kv_tensor: The KV cache tensor of shape [2, LSTRING
HIGHexamples/token_dropping/utils.py234Score generated responses against ground-truth choice letters. Args: ground_truth: list of ground-truth letSTRING
HIGHbenchmarks/long_doc_qa/long_doc_qa.py333 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGH…dkite/k3_tests/multiprocess/scripts/run-hma-lm-eval.sh184Return the gsm8k (exact_match, stderr) from an lm_eval results directory. Prefers the strict-match variant; falls bSTRING
HIGHlmcache/v1/memory_management.py1389 Allocate a block of memory from the virtual address space of a given size. The actual allocated size coSTRING
HIGHlmcache/v1/memory_management.py1438 Allocate blocks of memory from the virtual address space of a given size and batch size. The actual allSTRING
HIGHlmcache/v1/hidden_state_store.py123Store hidden_states chunked under the same keys as KV. Args: token_ids: 1-D int tensor or list of tSTRING
HIGHlmcache/v1/kv_layer_groups.py82Partition layer indices by :data:`LayerGroupIdentity`. Args: kv_caches: Registered KV cache structure, one STRING
HIGHlmcache/v1/kv_layer_groups.py644Calculate the number of blocks for a given number of tokens in a specified kernel group. Args: STRING
HIGHlmcache/v1/protocol.py104Pad a shape with fewer than 4 dimensions to 4D using trailing zeros. Shapes that are already 4D are returned asSTRING
HIGHlmcache/v1/config_base.py51Parse local disk path configuration. Accepts a single path or comma-separated paths, each optionally prefixed wSTRING
HIGHlmcache/v1/rpc_utils.py185Keep an IPC socket path within the ``sockaddr_un`` length limit. The descriptive path is preferred for readability/STRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py98Allocate one object from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shape or sSTRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py139Allocate multiple objects from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shapSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py99Allocate from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape or shapesSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py128Allocate a batch from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape oSTRING
HIGHlmcache/v1/memory_allocators/lazy_memory_allocator.py28 Get the NUMA ID for the current GPU Args: numa_mapping (NUMAMapping): The NUMA mapping object. ReSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py274Map one Device-DAX device and append it to the pool as ACTIVE. The caller must hold ``host_mem_lock`` (except dSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py709Map an additional Device-DAX device and add it to the pool. The new arena is immediately available as overflow;STRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py753Retire a Device-DAX arena from the pool. The arena stops accepting new allocations. If it has no live allocatioSTRING
HIGHlmcache/v1/mp_coordinator/discovery.py61Return the instance of ``member_type``, building it once. Args: member_type: The class to look up. STRING
HIGHlmcache/v1/mp_coordinator/schemas.py50Decode a base64 token string produced by :func:`encode_tokens`. Args: tokens_b64: Base64 of a little-endianSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py297Enforce encoding-level constraints on every entry. Args: value: The hydrated batches. RetuSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py361Reject undecodable keys at request validation (surfaced as 422). Args: value: The hydrated keys. STRING
HIGHlmcache/v1/mp_coordinator/schemas.py465Reject a malformed token buffer at request validation. Validating here returns 422 rather than the 500 a decodeSTRING
HIGHlmcache/v1/mp_coordinator/blend_client.py161Build a started client for ``url``; an empty URL returns ``None``. Args: url: Coordinator base URL;STRING
HIGHlmcache/v1/mp_coordinator/registrar.py45Register an MP server with the coordinator and return its id. Args: client: The HTTP client to send with. STRING
HIGHlmcache/v1/mp_coordinator/utils/encoding.py32Rebuild a key from :func:`encode_key`. Args: encoded: An :func:`encode_key` value, as read back from an STRING
HIGHlmcache/v1/mp_coordinator/http_apis/metrics_api.py16Return Prometheus metrics when the coordinator uses pull mode. Args: request: Incoming request carrying theSTRING
HIGH…che/v1/mp_coordinator/http_apis/instances_usage_api.py197Return one MP server's memory status. Args: instance_id: The server to report on. request: Carries STRING
HIGHlmcache/v1/mp_coordinator/http_apis/directory_api.py42Resolve keys — or a request's token sequence — to placements. The tokens form hashes ``token_ids`` with the fleet'sSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py50Submit a warm prefetch of a token sequence on one MP server. Resolves ``body.instance_id`` in the registry and proxSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py104Proxy a warm-prefetch status poll to the owning MP server. The warm holds no lock, so this poll only reports progreSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py151Pin a token sequence's keys in the L2 eviction plan. The coordinator resolves the token sequence to its object keysSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py190Unpin a token sequence's keys from the L2 eviction plan. Symmetric with pin: resolves the keys locally and releasesSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py231Delete a token sequence on one MP server, per ``body.tier`` (l1 / l2 / all). Args: body: Target instance, mSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py63Return the per-app :class:`CoordinatorContext`. Args: request: The FastAPI request whose ``app.state`` carrSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py82Return the lifespan-bound outbound client, or raise if unset. Args: request: The FastAPI request. RetuSTRING
HIGHlmcache/v1/mp_coordinator/persistence/metadata.py127Parse a document and check its shape. Args: raw: The stored bytes. Returns: ThSTRING
HIGHlmcache/v1/mp_coordinator/persistence/checkpoint.py151Decode a checkpoint written by :func:`_write_checkpoint`. Args: stream: Positioned at the start of the checSTRING
HIGHlmcache/v1/mp_coordinator/persistence/quiesce.py77Hold while capturing; no batch is applied for the duration. Args: timeout: Seconds to wait for in-fSTRING
HIGH…ache/v1/mp_coordinator/controllers/prefetch_manager.py45``POST /cache/prefetches`` to ``target`` and return its JSON reply. Args: target: The MP server to STRING
HIGH…ache/v1/mp_coordinator/controllers/prefetch_manager.py82Proxy ``GET /cache/prefetches/{request_id}`` on ``target``. Args: target: The MP server holding theSTRING
HIGHlmcache/v1/mp_coordinator/views/key_directory.py291List keys whose placements match the filters, one page at a time. A snapshot for inspection: iteration order isSTRING
HIGHlmcache/v1/multiprocess/server.py181Assemble the list of engine modules based on configuration. Args: ctx: The shared engine context. mSTRING
HIGHlmcache/v1/multiprocess/config.py698Convert parsed command line arguments to a CoordinatorConfig. For the registration settings a flag value takes precSTRING
HIGHlmcache/v1/multiprocess/engine_context.py162Look up the attention-window descriptor for a pair. Args: model_name: The model name. wSTRING
HIGHlmcache/v1/multiprocess/engine_context.py282Resolve per-object-group object keys from an IPC cache key. Uses the session manager to track token state and tSTRING
HIGHlmcache/v1/multiprocess/protocol.py33 Get the expected payload classes for a request type. Args: req_type: The request type to look up STRING
HIGHlmcache/v1/multiprocess/protocol.py52 Get the expected response class for a request type. Args: req_type: The request type to look up RSTRING
HIGHlmcache/v1/multiprocess/protocol.py71 Get the handler type for a request type. Args: req_type: The request type to look up Returns: STRING
HIGHlmcache/v1/multiprocess/session.py70Compute and return chunk hashes for the [start, end) token range. Internally computes rolling hashes up to end_STRING
HIGHlmcache/v1/multiprocess/futures.py44 Get the result of the future. Args: timeout (Optional[float]): Maximum time to wait in secSTRING
HIGHlmcache/v1/multiprocess/futures.py159 Wait for the future to be done, ordered through the device event. Args: timeout (Optional[STRING
HIGHlmcache/v1/multiprocess/futures.py191 Get the result of the future. Args: timeout (Optional[float]): Maximum time to wait for thSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py123Create a new shared-memory segment and return its mmap address. Mirrors the previous ``shm_open(O_CREAT|O_EXCL) + fSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py149Open an existing shared-memory segment and return its address. ``nbytes`` must match the segment's actual size; ``mSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py251Open an existing segment as an independent ``mmap.mmap`` object. Convenience helper for non-GPU SHM transports thatSTRING
214 more matches not shown…
Excessive Try-Catch Wrapping844 hits · 878 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py501 except Exception as e:CODE
LOWtests/conftest.py689 except Exception as e:CODE
LOWtests/conftest.py779 except Exception as e:CODE
MEDIUMtests/conftest.py781 print("Error during close obj:%s - %s", obj, e)CODE
LOWtests/conftest.py917 except Exception as e:CODE
LOWtests/v1/test_nixl_storage.py59 except Exception:CODE
LOWtests/v1/test_nixl_storage.py259 except Exception:CODE
MEDIUMtests/v1/test_address_manager.py821def alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py834def free_worker():CODE
MEDIUMtests/v1/test_address_manager.py991def batch_alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py1003def free_worker():CODE
LOWtests/v1/test_address_manager.py737 except Exception as e:CODE
LOWtests/v1/test_address_manager.py784 except Exception as e:CODE
LOWtests/v1/test_address_manager.py831 except Exception as e:CODE
LOWtests/v1/test_address_manager.py843 except Exception as e:CODE
LOWtests/v1/test_address_manager.py923 except Exception as e:CODE
LOWtests/v1/test_address_manager.py960 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1000 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1012 except Exception as e:CODE
MEDIUMtests/v1/utils.py197 print(f"Error during close pending tasks: - {e}")CODE
LOWtests/v1/utils.py47 except Exception:CODE
LOWtests/v1/utils.py70 except Exception:CODE
LOWtests/v1/utils.py103 except Exception:CODE
LOWtests/v1/utils.py123 except Exception:CODE
LOWtests/v1/utils.py196 except Exception as e:CODE
LOWtests/v1/test_fused_rerope.py22except Exception: # allow running as a plain script (bench) without pytestCODE
LOWtests/v1/test_fused_rerope.py36except Exception: # CPU-only / no built cuda_ops (e.g. the unit-test runner)CODE
LOWtests/v1/test_remote_mla_worker_id_as0.py181 except Exception as e:CODE
MEDIUMtests/v1/test_remote_mla_worker_id_as0.py182 print(f"Error during shutdown: {e}")CODE
MEDIUMtests/v1/test_atom_mp_adapter.py587def submit() -> None:CODE
LOWtests/v1/test_atom_mp_adapter.py743 except Exception as error:CODE
MEDIUMtests/v1/multiprocess/test_session.py231def writer() -> None:CODE
LOWtests/v1/multiprocess/test_session.py200 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py228 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py236 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_cache_server.py51 except Exception:CODE
LOWtests/v1/multiprocess/test_cache_server.py387 except Exception as e:CODE
MEDIUMtests/v1/multiprocess/test_cache_server.py388 print(f"Error during unregister: {e}")CODE
MEDIUMtests/v1/multiprocess/test_cache_server.py46def _has_working_new_shared_cuda() -> bool:CODE
LOWtests/v1/multiprocess/test_futures.py26 except Exception:CODE
LOWtests/v1/multiprocess/test_custom_types.py159 except Exception as e:CODE
LOWtests/v1/multiprocess/test_custom_types.py281 except Exception as e:CODE
LOWtests/v1/multiprocess/test_mq.py160 except Exception as e:CODE
LOW…1/lookup_client/test_chunk_statistics_lookup_client.py320 except Exception:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py72 except Exception as e:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py98 except Exception as e:CODE
LOW…s/v1/distributed/test_valkey_l2_adapter_integration.py129 except Exception:CODE
LOW…s/v1/distributed/test_valkey_l2_adapter_integration.py138 except Exception:CODE
LOW…v1/distributed/test_bigtable_l2_adapter_integration.py87 except Exception:CODE
LOW…v1/distributed/test_bigtable_l2_adapter_integration.py111 except Exception:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py205 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py240 except Exception:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py282 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py286 except Exception:CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py47 except Exception:CODE
MEDIUMtests/v1/distributed/test_l1_manager.py1768def worker(thread_id):CODE
LOWtests/v1/distributed/test_l1_manager.py1788 except Exception as e:CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py39 except Exception:CODE
MEDIUMtests/v1/distributed/test_raw_block_l2_adapter.py33def _has_ext() -> bool:CODE
MEDIUMtests/v1/distributed/test_l2_adapter_factory.py32def _has_raw_block_ext() -> bool:CODE
784 more matches not shown…
Cross-File Repetition175 hits · 875 pts
SeverityFileLineSnippetContext
HIGHtests/v1/test_gpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/test_xpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/test_vllm_mp_adapter.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/platform/test_cuda_ipc_wrapper.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/platform/test_event_ipc.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/distributed/test_mock_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_nixl_store_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGH…s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_l1_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/distributed/test_distributed_storage_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGHtests/v1/distributed/test_l1_memory_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/mp_observability/subscribers/metrics/test_l2.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…mp_observability/subscribers/metrics/test_cb_server.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…rvability/subscribers/metrics/test_l1_eviction_loop.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…v1/mp_observability/subscribers/metrics/test_lookup.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/multiprocess/engine_module.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/p2p_controller.py0return the shared engine context. exposed for testing only.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/lookup.py0return the shared engine context. exposed for testing only.STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/management.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0return the shared engine context. exposed for testing only.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGHlmcache/v1/multiprocess/modules/management.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return the number of currently registered instances.STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return the number of currently registered instances.STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0return the number of currently registered instances.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGHlmcache/v1/multiprocess/protocols/controller.py0returns protocol definitions for debug operations. returns: dictionary mapping request names to their protocol definitioSTRING
HIGHlmcache/v1/multiprocess/protocols/p2p.py0returns protocol definitions for debug operations. returns: dictionary mapping request names to their protocol definitioSTRING
HIGHlmcache/v1/multiprocess/protocols/observability.py0returns protocol definitions for debug operations. returns: dictionary mapping request names to their protocol definitioSTRING
HIGHlmcache/v1/multiprocess/protocols/engine.py0returns protocol definitions for debug operations. returns: dictionary mapping request names to their protocol definitioSTRING
HIGHlmcache/v1/multiprocess/protocols/debug.py0returns protocol definitions for debug operations. returns: dictionary mapping request names to their protocol definitioSTRING
HIGH…e/v1/mp_observability/subscribers/logging/mp_server.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/sm.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/l1.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/platform/cuda/pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if uSTRING
HIGHlmcache/v1/platform/base/pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if uSTRING
HIGHlmcache/v1/platform/base/device_spec.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if uSTRING
115 more matches not shown…
Unused Imports778 hits · 741 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py5CODE
LOWtests/v1/utils.py122CODE
LOWtests/v1/test_trtllm_integration.py33CODE
LOWtests/v1/mp_coordinator/test_instances_usage_api.py8CODE
LOWtests/v1/multiprocess/test_raw_block_l2_adapter.py4CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py384CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py644CODE
LOWtests/v1/distributed/conftest.py7CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py54CODE
LOWtests/v1/distributed/test_memory_capacity.py24CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py36CODE
LOWtests/v1/distributed/test_l2_adapter_factory.py35CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py20CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py21CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_v_only.py27CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_multi.py12CODE
LOWtests/v1/distributed/serde/test_multi.py25CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py13CODE
LOWtests/v1/platform/musa/test_musa_event_ordering.py52CODE
LOWtests/v1/platform/rbln/test_rbln_kv_layout.py26CODE
LOWtests/v1/platform/rbln/test_rbln_kv_layout.py26CODE
LOWtests/v1/storage_backend/test_storage_plugin.py28CODE
LOWtests/v1/storage_backend/test_raw_block_device.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py50CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py45CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py46CODE
LOWtests/v1/storage_backend/test_raw_block_core.py4CODE
LOWtests/v1/storage_backend/raw_block_test_utils.py4CODE
LOWtests/v1/storage_backend/test_raw_block_uring_cmd.py58CODE
LOWtests/cli/commands/trace/test_dispatch.py6CODE
LOWtests/cli/commands/trace/test_driver.py13CODE
LOWsetup_extensions/__init__.py14CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py16CODE
LOWsetup_extensions/common_cpp.py17CODE
LOWsetup_extensions/common_cpp.py20CODE
LOWsetup_extensions/storage_backend_profiles/aerospike.py16CODE
LOWsetup_extensions/storage_backend_profiles/__init__.py15CODE
LOWsetup_extensions/storage_backend_profiles/mooncake.py15CODE
LOWsetup_extensions/build_profiles/rocm.py16CODE
LOWsetup_extensions/build_profiles/__init__.py15CODE
LOWsetup_extensions/build_profiles/__init__.py18CODE
LOWsetup_extensions/build_profiles/musa.py13CODE
LOWsetup_extensions/build_profiles/sycl.py15CODE
LOWsetup_extensions/build_profiles/cuda.py16CODE
LOWsetup_extensions/build_profiles/ascend.py15CODE
LOW…amples/online_session/openai_chat_completion_client.py14CODE
LOWexamples/lmc_external_l2_adapter/tests/test_plugin.py44CODE
LOW…rnal_l2_adapter/src/lmc_external_l2_adapter/adapter.py19CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py12CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py12CODE
LOW…onnector/src/lmc_external_native_connector/__init__.py22CODE
LOW…nnector/src/lmc_external_native_connector/connector.py29CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py15CODE
LOWbenchmarks/multi_doc_qa/shuffle_doc_qa.py15CODE
LOW.github/scripts/assert_native_ops.py18CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
718 more matches not shown…
Over-Commented Block325 hits · 317 pts
SeverityFileLineSnippetContext
LOWpyproject_cli.toml61COMMENT
LOWpyproject_cli.toml101[tool.ruff.lint.isort]COMMENT
LOWpyproject.toml81 # "UP",COMMENT
LOWpyproject.toml121platform = "linux"COMMENT
LOWpyproject.toml161build = "cp3*-manylinux_x86_64 cp3*-manylinux_aarch64"COMMENT
LOWcsrc/engine_kv_format.h161 #define LMC_KV_FORMAT_HD __host__ __device__COMMENT
LOWcsrc/kv_transfer_plan_types.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/kv_transfer_plan_types.h21#endifCOMMENT
LOWcsrc/storage_backends/event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_base.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_types.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h61 // - model_name: 25-50 chars (e.g., "meta-llama/Llama-3-70b-instruct")COMMENT
LOWcsrc/storage_backends/aerospike/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/fs/connector.cpp21 size_t pos = 0;COMMENT
LOWcsrc/storage_backends/fs/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/mem_alloc.cpp1#include <cuda_runtime.h>COMMENT
LOWcsrc/cuda/pybind.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/event_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/completion_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/event_recorder.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/lmcache_native/pybind.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/lmcache_native/periodic_event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp21// work-group handles both K and V, halving dispatch count andCOMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp1021 offset += max_nbytes;COMMENT
LOWcsrc/sycl/pybind_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp21// (lid * BLOCK_SIZE + tx)COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp21//COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp21// - sub_group_size locked to 16 (native SIMD on Intel discrete GPUs).COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp21//COMMENT
LOWcsrc/sycl/cachegen_kernels_sycl.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs801struct UringNotify {COMMENT
LOWrust/raw_block/src/lib.rs821 /// eventfds into the epoll instance. Cleans up partially-built stateCOMMENT
LOWrust/raw_block/src/lib.rs861 // We use EPOLLIN: wake when the counter becomes non-zeroCOMMENT
LOWrust/raw_block/src/lib.rs961 }COMMENT
LOWrust/raw_block/src/lib.rs1041 // Background worker thread handleCOMMENT
LOWrust/raw_block/src/lib.rs1481 }COMMENT
LOWrust/raw_block/src/lib.rs1701 // - Check how much space is available in the ring (max 256 entries)COMMENT
LOWrust/raw_block/src/lib.rs2401 /// The method waits on a per-batch condition variable that gets signaledCOMMENT
LOWtests/v1/test_mem_kernels.py861COMMENT
LOWtests/v1/test_cache_interface.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/test_vllm_integration.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/distributed/conftest.py101 fallback_module_any.TTLLock = TTLLockCOMMENT
LOWtests/v1/distributed/test_bitmap_ops.py541 # might trip on. 300 chunks x 4 ranks x 5 groups.COMMENT
LOWtests/v1/distributed/test_valkey_l2_adapter.py21COMMENT
LOW…mp_observability/subscribers/metrics/test_cb_server.py221COMMENT
LOWtests/v1/lmcache_native/test_pattern_matcher.py621 end = [9]COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml1# LMCache ShmFile Connector - basic_check configurationCOMMENT
LOWtests/v1/shm_allocator/csrc/shm_file_worker.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/shm_allocator/csrc/shm_file_worker.cpp21#include <cstdint>COMMENT
LOW…1/internal_api_server/test_scripts/multiple_imports.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…/v1/internal_api_server/test_scripts/default_result.py1# SPDX-License-Identifier: Apache-2.0COMMENT
265 more matches not shown…
Deep Nesting337 hits · 272 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_torch_ops.py808CODE
LOWtests/v1/test_torch_ops.py1172CODE
LOWtests/v1/test_torch_ops.py1418CODE
LOWtests/v1/test_torch_ops.py2958CODE
LOWtests/v1/test_cuda_ops_parity.py130CODE
LOWtests/v1/test_mp_mem_kernels.py86CODE
LOWtests/v1/test_mp_mem_kernels.py130CODE
LOWtests/v1/test_mp_mem_kernels.py197CODE
LOWtests/v1/test_address_manager.py811CODE
LOWtests/v1/test_address_manager.py892CODE
LOWtests/v1/test_address_manager.py981CODE
LOWtests/v1/test_address_manager.py821CODE
LOWtests/v1/test_address_manager.py834CODE
LOWtests/v1/test_address_manager.py904CODE
LOWtests/v1/test_address_manager.py991CODE
LOWtests/v1/test_address_manager.py1003CODE
LOWtests/v1/utils.py34CODE
LOWtests/v1/utils.py187CODE
LOWtests/v1/utils.py263CODE
LOWtests/v1/utils.py419CODE
LOWtests/v1/utils.py652CODE
LOWtests/v1/test_freeze_mode_integration.py27CODE
LOWtests/v1/multiprocess/test_optimized_lookup.py538CODE
LOWtests/v1/multiprocess/test_optimized_lookup.py759CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py166CODE
LOWtests/v1/distributed/test_l1_manager.py1758CODE
LOWtests/v1/distributed/test_l1_manager.py1768CODE
LOWtests/v1/distributed/test_l1_l2_state_metrics.py136CODE
LOWtests/v1/distributed/test_bigtable_l2_adapter.py63CODE
LOWtests/v1/distributed/test_bigtable_l2_adapter.py88CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py44CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py69CODE
LOW…v1/mp_observability/subscribers/metrics/test_engine.py65CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py30CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py60CODE
LOW…observability/subscribers/metrics/test_sm_lifecycle.py73CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py34CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py55CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l1.py32CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py31CODE
LOWtests/v1/cache_controller/conftest.py218CODE
LOWtests/v1/cache_controller/conftest.py248CODE
LOWtests/v1/cache_controller/conftest.py323CODE
LOWtests/v1/cache_controller/test_registry_tree.py451CODE
LOWtests/v1/cache_controller/test_registry_tree.py519CODE
LOWtests/v1/cache_controller/test_registry_tree.py493CODE
LOWtests/v1/cache_controller/test_registry_tree.py541CODE
LOWtests/v1/lmcache_native/test_periodic_event_notifier.py49CODE
LOWtests/v1/lmcache_native/test_ttl_lock.py366CODE
LOWtests/v1/lmcache_native/test_ttl_lock.py373CODE
LOWtests/v1/storage_backend/test_local_cpu_backend.py339CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py134CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py231CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py440CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py561CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py608CODE
LOWtests/v1/storage_backend/test_dax_backend.py142CODE
LOWtests/v1/storage_backend/test_dax_backend.py1114CODE
LOWtests/v1/storage_backend/test_dax_backend.py1290CODE
LOWtests/v1/storage_backend/test_dax_backend.py1367CODE
277 more matches not shown…
Self-Referential Comments71 hits · 219 pts
SeverityFileLineSnippetContext
MEDIUMtests/conftest.py284 # Create a shared store but separate instances for master/slaveCOMMENT
MEDIUMtests/conftest.py646 # Create a fake hf3fs_fuse module if it doesn't existCOMMENT
MEDIUMtests/v1/test_basic_check.py48 # Create a fake check_mode_ moduleCOMMENT
MEDIUMtests/v1/test_memory_management.py564 # Create a simple allocator for testingCOMMENT
MEDIUMtests/v1/test_memory_management.py569 # Create a real TensorMemoryObjCOMMENT
MEDIUMtests/v1/test_memory_management.py427 # Create a memory objectCOMMENT
MEDIUMtests/v1/test_memory_management.py473 # Create a mock memory object for testingCOMMENT
MEDIUMtests/v1/test_memory_management.py502 # Create a mock memory objectCOMMENT
MEDIUMtests/v1/test_config.py809 # Create a config and update from envCOMMENT
MEDIUMtests/v1/test_cache_engine.py1424 # Create an engine instanceCOMMENT
MEDIUMtests/v1/test_cache_engine.py1877 # Create a mock engineCOMMENT
MEDIUMtests/v1/test_cache_engine.py1969 # Create a mock engineCOMMENT
MEDIUMtests/v1/multiprocess/test_futures.py263 # Create the raw future that will return (event_bytes, result_value)COMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py31 # Create a sample IPCCacheServerKeyCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py84 # Create a sample tensorCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py184 # Create a tensor with known valuesCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py204 # Create a queue for resultsCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py511 # Create a single test keyCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py535 # Create a different test keyCOMMENT
MEDIUMtests/v1/distributed/test_mock_l2_adapter.py625 # Create a larger object to see noticeable delayCOMMENT
MEDIUMtests/v1/cache_controller/conftest.py225 # Create a mock registry with all required methodsCOMMENT
MEDIUMtests/v1/cache_controller/test_config.py55 # Create a temporary YAML config fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py96 # Create a Python plugin fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py238 # Create a Python file with shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py258 # Create a Bash fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py278 # Create a Python file without shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py301 # Create an unsupported file typeCOMMENT
MEDIUMtests/v1/lmcache_native/test_ttl_lock.py115 # Create a lock with 1 second TTLCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py303 # Create a mock channelCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py418 # Create a query for 3 keys (2 cached, 1 not)COMMENT
MEDIUMtests/v1/storage_backend/test_storage_plugin.py300 # Create a test keyCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py238 # Create a path that doesn't existCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py289 # Create a dummy file so os.path.exists returns TrueCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py315 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py341 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_hf3fs_connector.py180 # Create the 3fs-virt directory structure that HF3FS expectsCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py189 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py233 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py285 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py332 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py369 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_bigtable_integration.py269 # Create a payload of ~8.38 MB (exceeds the 5.0 MB threshold)COMMENT
MEDIUMtests/v1/internal_api_server/test_cache_clear.py23 # Create a mock LMCache engineCOMMENT
MEDIUMtests/disagg/test_nixl_storage_backend.py81 "nixl_path": tempfile.mkdtemp(), # Create a temporary directory for testingCODE
MEDIUMtests/disagg/test_nixl_cache_engine.py191 # Create the VLLMPagedMemGPUConnectorV2COMMENT
MEDIUMtests/disagg/test_nixl_cache_engine.py202 # Create the LMCacheEngine (will be reused across rounds)COMMENT
MEDIUMtests/disagg/test_nixl_channel.py128 # Create the NixlChannelCOMMENT
MEDIUMexamples/blend_in_process/blend.py146 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…/kv_cache_reuse/local_backends/rust_backend_offload.py158 # Define the shared prompt and specific promptsCOMMENT
MEDIUMexamples/kv_cache_reuse/local_backends/offload.py131 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…rks/storage_backend_io/storage_backend_io_benchmark.py411 # Create the specific backendCOMMENT
MEDIUMbenchmarks/rag/rag.py308 # Create a dataframeCOMMENT
MEDIUMbenchmarks/multi_doc_qa/multi_doc_qa.py252 # Create the OpenAI clientCOMMENT
MEDIUMbenchmarks/long_doc_qa/long_doc_qa.py484 # Create the OpenAI clientCOMMENT
MEDIUM.github/scripts/download_gh_release_model.sh142# Create the refs/main pointer so snapshot_download(local_files_only=True)COMMENT
MEDIUM.buildkite/k3_harness/values.yaml3# This file is for documentation only.COMMENT
MEDIUM.buildkite/scripts/vllm-integration-tests.sh782# Create the container imageCOMMENT
MEDIUMlmcache/connections.py2# This file is copied from the vLLM project (https://github.com/vllm-project/vllm).COMMENT
MEDIUMlmcache/v1/memory_allocators/lazy_memory_allocator.py147 # Create the tensor memory allocatorCOMMENT
MEDIUMlmcache/v1/health_monitor/base.py167 # Create a health monitor with managerSTRING
11 more matches not shown…
Structural Annotation Overuse106 hits · 177 pts
SeverityFileLineSnippetContext
LOWcsrc/storage_backends/README.md83### Step 1: C++ connector — inherit from ConnectorBaseCOMMENT
LOWcsrc/storage_backends/README.md153### Step 2: Pybind moduleCOMMENT
LOWcsrc/storage_backends/README.md177### Step 3: Build system — register in setup.pyCOMMENT
LOWcsrc/storage_backends/README.md199### Step 4: Python client — non-MP mode integrationCOMMENT
LOWcsrc/storage_backends/README.md220### Step 5: MP mode integration — L2 adapter config + factoryCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py386 # Step 1: Both backends healthyCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py394 # Step 2: Backend A failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py401 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py412 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py424 # Step 5: Backend B recoversCOMMENT
LOWtests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOWtests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOWtests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOWtests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOWtests/v1/test_cache_engine.py1212 # NOTE: The default backend cache size is 2 GB.COMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py607 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py614 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py620 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py630 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py678 # Step 3: Scheduler lookup with interleaved keysCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py695 # Step 4: Verify hit countCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py703 # Step 5: Workers retrieve their chunksCOMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOWtests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md90### Step 1: Create the ModuleCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md116### Step 2: DoneCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh51# Step 0: Generate the master key (never checked in / logged)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh104# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh134# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh178# Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh224# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh234# Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decryptCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh254# Step 6: Show metrics / statusCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOWexamples/kv_cache_reuse/local_backends/README.md12 # WARNING: This will erase the content of target device.COMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md7## Step 1: Configure your S3 bucket and (optional) EC2 compute instanceCOMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md14## Step 2: Fill out `example.yaml`COMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md18## Step 3: Start an vLLM engine with LMCacheCOMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md24## Step 4: Sending requestsCOMMENT
LOW…amples/kv_cache_reuse/remote_backends/valkey/README.md11## Step 1: Start a local ValkeyCOMMENT
46 more matches not shown…
Verbosity Indicators81 hits · 138 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_health_monitor_fallback_recovery.py386 # Step 1: Both backends healthyCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py394 # Step 2: Backend A failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py401 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py412 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py424 # Step 5: Backend B recoversCOMMENT
LOWtests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOWtests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOWtests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOWtests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py607 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py614 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py620 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py630 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py678 # Step 3: Scheduler lookup with interleaved keysCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py695 # Step 4: Verify hit countCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py703 # Step 5: Workers retrieve their chunksCOMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOWtests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh51# Step 0: Generate the master key (never checked in / logged)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh104# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh134# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh178# Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt)COMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh224# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh234# Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decryptCOMMENT
LOWexamples/serde/aesgcm/run_serde_aesgcm_example.sh254# Step 6: Show metrics / statusCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh46# Step 1: Build docker imagesCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh57# Step 2: Launch containersCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh68# Step 3: Wait for vLLM to be readyCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh79# Step 4: Run lm_eval workload testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh90# Step 5: Run vllm bench serve testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh101# Step 6: Run long doc QA testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh112# Step 7: Run fault tolerance test (destructive — kills LMCache container)COMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh127# Step 8: Cleanup runs automatically via trapCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh79 # Step 1: Warmup bench (measure timing for kill calibration)COMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh93 # Step 2: Bench with mid-flight LMCache killCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh118 # Step 3: Quick curl health checkCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh72# Step 1: Kill existing LMCache + vLLM, relaunch both with L2 configCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh228# Step 2: Run benchmarksCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh256# Step 3: Verify thresholdsCOMMENT
21 more matches not shown…
Redundant / Tautological Comments75 hits · 112 pts
SeverityFileLineSnippetContext
LOWdocker/example_build.sh7# Set VLLM_VERSION to a specific version before running this script,COMMENT
LOWtests/conftest.py776 # Check if object has a close methodCOMMENT
LOWtests/v1/test_impl_completeness.py73 # Check if the method is actually implemented in the classCOMMENT
LOWtests/v1/utils.py667 # Check if it's callable (function, method, etc.)COMMENT
LOWtests/v1/multiprocess/test_custom_types.py217 # Check if process completed successfullyCOMMENT
LOWtests/v1/multiprocess/test_mq.py272 # Check if client completed successfullyCOMMENT
LOW…v1/storage_backend/test_p2p_backend_with_controller.py65 # Check if backend is properly initialized by checking its attributesCOMMENT
LOW…1/storage_backend/test_local_cpu_backend_nixl_paged.py241 # Set cpu_size_bytes to exactly 1 byte — smaller than one chunk.COMMENT
LOWtests/v1/internal_api_server/test_run_script.py41 # Check if we've closed all bracesCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py82 # Check if the mean is close to the pattern valueCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py293 # Check if all tokens were retrievedCOMMENT
LOWexamples/chunk_statistics/analyze_chunk_hashes.py393 # Print resultsCOMMENT
LOWexamples/kubernetes/health_probe.py65 # Check if server responded with successCOMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py474 # Check if this is a two-phase benchmark (write + read)COMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py1225 # Print resultsCOMMENT
LOWbenchmarks/multi_doc_qa/multi_doc_qa.py322 # Print resultsCOMMENT
LOWbenchmarks/multi_round_qa/multi-round-qa.py455 # Check if can join new user sessionCOMMENT
LOWbenchmarks/long_doc_qa/long_doc_qa.py561 # Print resultsCOMMENT
LOWbenchmarks/microbenchmark/ttl_lock_benchmark.py522 # Check if we can sustain 10K+ ops/sec with 4-8 threadsCOMMENT
LOW.buildkite/k3_harness/gpu-monitor.sh67 # Check if this PID is inside any cgroup containing "kubepods"COMMENT
LOW.buildkite/k3_harness/setup-cluster.sh66# Check if image already exists in K3s containerdCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh79 # Check if port is available using netstatCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh669 # Check if baseline exists, skip comparisons if notCOMMENT
LOW…ildkite/scripts/multiprocessing-test/run-vllm-bench.sh105 # Check if result files existCOMMENT
LOW.buildkite/scripts/multiprocessing-test/common.sh28 # Check if uv is availableCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh37 # Check if container is still runningCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh46 # Check if vLLM health endpoint is respondingCOMMENT
LOW…ldkite/scripts/multiprocessing-test/run-long-doc-qa.sh118 # Check if result files existCOMMENT
LOWlmcache/utils.py263 # Check if it's a range format [start,end]COMMENT
LOWlmcache/v1/memory_management.py1596 # Check if free blocks are properly coalescedCOMMENT
LOWlmcache/v1/memory_management.py1603 # Check if total size matchesCOMMENT
LOWlmcache/v1/cache_engine.py461 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/cache_engine.py647 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/config_base.py583 # Check if this configuration class has definitions with convertersCOMMENT
LOWlmcache/v1/pin_monitor.py134 # Check if object is still pinned and has exceeded timeoutCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py308 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py317 # Check if the blocks are coalescedCOMMENT
LOW…/v1/memory_allocators/paged_tensor_memory_allocator.py321 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/lookup_client/lmcache_async_lookup_client.py165 # Check if any aborted lookups are finished, send cleanup messagesCOMMENT
LOWlmcache/v1/lookup_client/factory.py60 # Check if external_lookup_client is configuredCOMMENT
LOWlmcache/v1/lookup_client/factory.py78 # Check if bypass lookup is enabled and lmcache_engine is providedCOMMENT
LOWlmcache/v1/distributed/l2_adapters/factory.py127 # Check if the name is now registeredCOMMENT
LOW…1/mp_observability/subscribers/metrics/l1_lifecycle.py119 # Check if this is a reuse of an evicted chunk.COMMENT
LOWlmcache/v1/cache_controller/config.py128 # Check if this field has an env_converter in the definitionsCOMMENT
LOWlmcache/v1/cache_controller/controller_manager.py333 # Check if POLLIN flag is set (indicates readable/pending messages)COMMENT
LOWlmcache/v1/cache_controller/commands/full_sync.py43 # Check if full sync is already in progressCOMMENT
LOW…ache_controller/controllers/registration_controller.py231 # Check if full sync is needed (e.g., controller restart)COMMENT
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py146 # Check if already syncing with different sync_idCOMMENT
LOW…cache/v1/cache_controller/controllers/kv_controller.py154 # Check if worker is currently in full syncCOMMENT
LOWlmcache/v1/health_monitor/base.py498 # Check if we have any health checks that need to runCOMMENT
LOWlmcache/v1/storage_backend/remote_backend.py349 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py401 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py555 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/gds_backend.py1103 # Check if file is large enough for the requested readCOMMENT
LOWlmcache/v1/storage_backend/batched_message_sender.py109 # Check if we have messages to process while holding the lockCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py461 # Check if io_uring is enabled for fixed buffer supportCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py475 # Check if lazy memory allocator should be enabledCOMMENT
LOWlmcache/v1/storage_backend/nixl_storage_backend.py1918 # Check if already in progressCOMMENT
LOWlmcache/v1/storage_backend/raw_block/core.py1129 # Check if the buffer pointer is alignedCOMMENT
LOWlmcache/v1/storage_backend/connector/audit_connector.py46 # Check if method is marked with @NotAuditCOMMENT
15 more matches not shown…
Modern Structural Boilerplate103 hits · 105 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_health_monitor_fallback_recovery.py41 def set_ping_error_code(self, error_code: int) -> None:CODE
LOWtests/v1/test_musa_support.py79 def set_device(self, _idx: int) -> None:CODE
LOWtests/v1/test_health_monitor.py45 def set_healthy(self, healthy: bool) -> None:CODE
LOWtests/v1/distributed/serde/test_async_processor.py176 def set_used_size(self, n: int) -> None:CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py17__all__ = ["InMemoryL2Adapter", "InMemoryL2AdapterConfig"]CODE
LOW…onnector/src/lmc_external_native_connector/__init__.py26__all__ = [CODE
LOWexamples/remote_config_server/config_server.py28logger = logging.getLogger(__name__)CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py359 def _setup_device(self) -> None:CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py755 def _setup_device(self) -> None:CODE
LOW.buildkite/correctness/async_request.py16logger = logging.getLogger(__name__)CODE
LOWlmcache/usage_context.py16__all__ = [CODE
LOWlmcache/__init__.py20__all__ = ["__version__", "torch_dev", "torch_device_type"]CODE
LOWlmcache/v1/memory_management.py297 def set_used_size(self, n: int) -> None: # noqa: B027CODE
LOWlmcache/v1/memory_management.py700 def set_used_size(self, n: int) -> None:CODE
LOWlmcache/v1/cache_engine.py248 def set_health_monitor(self, health_monitor: "HealthMonitor") -> None:CODE
LOWlmcache/v1/cache_engine.py362 def set_hot_cache(self, enabled: bool) -> None:CODE
LOWlmcache/v1/mp_coordinator/controllers/__init__.py53__all__ = ["Controller", "build_controllers"]CODE
LOWlmcache/v1/mp_coordinator/views/__init__.py48__all__ = ["View", "base", "build_views"]CODE
LOWlmcache/v1/multiprocess/session.py54 def set_tokens(self, full_token_ids: list[int]) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py62 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py235 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/posix_shm.py45logger = logging.getLogger(__name__)CODE
LOWlmcache/v1/multiprocess/transfer_context/__init__.py29__all__ = [CODE
LOWlmcache/v1/multiprocess/modules/p2p_controller.py580 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/modules/lookup.py622 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/protocols/__init__.py121__all__ = [CODE
LOWlmcache/v1/offload_server/__init__.py11__all__ = [CODE
LOW…che/v1/lookup_client/chunk_statistics_lookup_client.py197 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/lookup_client/__init__.py17__all__ = [CODE
LOWlmcache/v1/lookup_client/record_strategies/__init__.py56__all__ = [CODE
LOWlmcache/v1/distributed/quota_manager.py55 def set_quota(self, cache_salt: str, limit_bytes: int) -> None:CODE
LOWlmcache/v1/distributed/quota_manager.py91 def set_default_limit_bytes(self, limit_bytes: int | None) -> None:CODE
LOWlmcache/v1/distributed/memory_manager/__init__.py24__all__ = [CODE
LOWlmcache/v1/distributed/eviction_policy/__init__.py20__all__ = [CODE
LOWlmcache/v1/distributed/storage_controllers/__init__.py36__all__ = [CODE
LOWlmcache/v1/distributed/bitmap_ops/__init__.py21__all__ = [CODE
LOWlmcache/v1/distributed/transfer_channel/__init__.py30__all__ = [CODE
LOW…ache/v1/distributed/l2_adapters/hfbucket_l2_adapter.py874 def _set_cached_object_size_locked(self, object_path: str, size: int) -> None:CODE
LOWlmcache/v1/distributed/l2_adapters/__init__.py64__all__ = [CODE
LOWlmcache/v1/distributed/l2_adapters/base.py363 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOWlmcache/v1/distributed/l2_adapters/serde_wrapper.py333 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOW…/v1/distributed/l2_adapters/fault_inject_l2_adapter.py387 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOWlmcache/v1/distributed/serde/__init__.py47__all__ = [CODE
LOWlmcache/v1/distributed/serde/turboquant/__init__.py11__all__ = [CODE
LOWlmcache/v1/mp_observability/trace/decorator.py49def set_tracing_enabled(enabled: bool) -> None:CODE
LOWlmcache/v1/mp_observability/trace/__init__.py39__all__ = [CODE
LOWlmcache/v1/mp_observability/subscribers/__init__.py18__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/metrics/__init__.py49__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/tracing/__init__.py18__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/logging/__init__.py22__all__ = [CODE
LOWlmcache/v1/cache_controller/__init__.py6__all__ = [CODE
LOWlmcache/v1/cache_controller/utils.py187 def update_seq_num(self, location: str, seq_num: int) -> None:CODE
LOWlmcache/v1/cache_controller/commands/__init__.py12__all__ = [CODE
LOWlmcache/v1/cache_controller/controllers/__init__.py8__all__ = [CODE
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py71 def set_need_full_sync_all(self, need: bool) -> None:CODE
LOW…cache/v1/cache_controller/controllers/kv_controller.py74 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/platform/isolated_ipc.py18def set_isolated_ipc(enabled: bool) -> None:CODE
LOWlmcache/v1/platform/__init__.py25__all__ = [CODE
LOWlmcache/v1/platform/cpu/shm.py43__all__ = [CODE
LOWlmcache/v1/platform/cpu/stub_cpu_device.py282 def set_stream(self, stream: StubStream) -> None:CODE
43 more matches not shown…
Modern AI Meta-Vocabulary27 hits · 87 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md32- [2026/05] 🔥 Agentic workload benchmark on AMD MI300X ([blog](https://blog.lmcache.ai/en/2026/05/12/benchmarking-lmcachCODE
MEDIUMtests/v1/distributed/serde/test_asym_k16_v8_multi.py34# Test scaffolding (mirrors the _FakeMemoryObj in test_multi.py / test_fp8.py)COMMENT
MEDIUMtests/v1/distributed/serde/test_multi.py52# Test scaffolding: a minimal MemoryObj stand-in mirroring test_fp8.py.COMMENT
MEDIUMdocs/design/v1/gpu_connector/layout-invariant.md42├── detection.py # detect_format() orchestrationCODE
MEDIUM…design/cli/commands/bench/engine_bench/bench-engine.md42# RAG answer quality (real QA data, documents cached individually)COMMENT
MEDIUMbenchmarks/rag/README.md1# Benchmarking LLM Performance: RAG Use CaseCOMMENT
MEDIUMbenchmarks/rag/README.md16## Running the RAG BenchmarkCOMMENT
MEDIUMlmcache/cli/commands/bench/server_bench/command.py51# orchestration safe.COMMENT
MEDIUMoperator/AGENTS.md355Do NOT delete `// +kubebuilder:scaffold:*` comments. CLI injects code at these markers.CODE
MEDIUMoperator/AGENTS.md389### Deploy Image Plugin (scaffold to deploy/manage ANY container image)COMMENT
MEDIUMoperator/cmd/main.go44 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/cmd/main.go57 // +kubebuilder:scaffold:schemeCOMMENT
MEDIUMoperator/cmd/main.go175 // In the default scaffold provided, the program ends immediately afterCOMMENT
MEDIUMoperator/cmd/main.go221 // +kubebuilder:scaffold:builderCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go168 // +kubebuilder:scaffold:e2e-metrics-webhooks-readinessCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go208 // +kubebuilder:scaffold:e2e-webhooks-checksCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml8# +kubebuilder:scaffold:crdkustomizeresourceCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml13# +kubebuilder:scaffold:crdkustomizewebhookpatchCOMMENT
MEDIUMoperator/config/default/kustomization.yaml225# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUMoperator/config/default/kustomization.yaml226# +kubebuilder:scaffold:crdkustomizecainjectionnsCOMMENT
MEDIUMoperator/config/default/kustomization.yaml233# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUMoperator/config/default/kustomization.yaml234# +kubebuilder:scaffold:crdkustomizecainjectionnameCOMMENT
MEDIUMoperator/config/samples/vllm_cacheblend_deployment.yaml1# Sample vLLM Deployment that OPTS IN to CacheBlend dependency injection.COMMENT
MEDIUMoperator/config/samples/kustomization.yaml6# +kubebuilder:scaffold:manifestskustomizesamplesCOMMENT
MEDIUMoperator/config/samples/vllm_lmcache_deployment.yaml1# Sample vLLM Deployment that OPTS IN to LMCacheEngine dependency injection.COMMENT
MEDIUMoperator/internal/controller/suite_test.go38 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/internal/controller/suite_test.go70 // +kubebuilder:scaffold:schemeCOMMENT
AI Slop Vocabulary24 hits · 74 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/test_mp_mem_kernels.py31# Tensor factories (ported from kernel harness)COMMENT
MEDIUMtests/v1/multiprocess/test_cache_server.py193#: backend has no such requirement, but this keeps the harness valid forCOMMENT
MEDIUMtests/v1/multiprocess/test_engine_driven_transfer.py275 # real IPC-backed factories to be usable in the harness.COMMENT
MEDIUMtests/cli/commands/trace/test_driver.py272 # the test robust against future decorator additions.COMMENT
MEDIUM.github/workflows/operator_release.yml51 # so behavior is robust whether or not that box is ticked in the UI.COMMENT
MEDIUM.buildkite/pipelines/comprehensive-tests.yml9 - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Skip comprehensive tests for safe-path-only PRs.CODE
MEDIUM.buildkite/pipelines/multiprocessing-test.yml9 - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Reuse the trigger condition for comprehensive testsCODE
MEDIUM.buildkite/k3_harness/setup-env.sh287# harness. Re-probe the full chain here so broken envs fail fast with theCOMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh17# 2. Plugin-harness dep not in the LMCache/vLLM dependency closure.COMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh59# server-boot timeout inside the harness.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh4# Decide whether comprehensive tests should run for this build.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh6# 0 -> run comprehensive testsCOMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh7# 1 -> skip comprehensive tests (safe paths only)COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh9# If this isn't a PR build, always run comprehensive tests.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh70 # Non-safe file touched -> run comprehensive tests.COMMENT
MEDIUM…ite/k3_tests/multiprocess/scripts/run-dsv4-flash-tp.sh297# across 128 tokens), making the comparison robust.COMMENT
MEDIUM…kite/k3_tests/multiprocess/scripts/launch-processes.sh112# robust to default changes (the default flipped False in #3869/#4437).COMMENT
MEDIUM…kite/k3_tests/multiprocess/scripts/launch-processes.sh122# rather than relying on the server default so the test is robust to defaultCOMMENT
MEDIUM…dkite/k3_tests/multiprocess/scripts/run-single-test.sh9# This mirrors the comprehensive tests' run-single-config.sh pattern.COMMENT
MEDIUM…ite/k3_tests/comprehensive/scripts/upload-baselines.sh3# Runs AFTER all comprehensive config steps complete (via `wait`).COMMENT
LOWlmcache/v1/memory_management.py1047 # so just return None hereCOMMENT
LOW…cache/v1/memory_allocators/cu_file_memory_allocator.py21 # layer - for now just use the current device.COMMENT
MEDIUMlmcache/v1/gpu_connector/utils.py775 # Also accept [P,2,B,H,D] (or [NB,2,BS,NH,HS]) to be more robust.COMMENT
MEDIUMlmcache/cli/commands/bench/l2_adapter_bench/command.py457 # the one-time tensor allocation + fill (benchmark harness work,COMMENT
Cross-Language Confusion8 hits · 35 pts
SeverityFileLineSnippetContext
HIGH…s/v1/multiprocess/test_lmcache_driven_transfer_skip.py57 # chunk size = 2 blocks. Chunk 0 = [0, 0] (null), chunk 1 = [0, 9] (has aCOMMENT
HIGH…s/v1/multiprocess/test_lmcache_driven_transfer_skip.py89 # chunk 0: kg0=0 and kg1=0 -> null; chunk 1: kg0=0 but kg1=4 -> not null.COMMENT
HIGHtests/v1/shm_allocator/verify_shmfile_tcp.py15 mkdir -p tests/v1/shm_allocator/csrc/build && cd tests/v1/shm_allocator/csrc/buildSTRING
HIGHlmcache/v1/cache_controller/worker.py643 self.push(),CODE
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py1352 self.pool.push(metadata.index)CODE
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py346 # "locations": null, "request_configs": null}STRING
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py354 # "request_configs": null}STRING
HIGH…ommands/bench/engine_bench/workloads/rag_qa_quality.py527 An unparsed sample's ``f1`` is null, not zero, so a cross-run diff canSTRING
Hallucination Indicators2 hits · 20 pts
SeverityFileLineSnippetContext
CRITICALtests/v1/mp_coordinator/test_directory_api.py206 key_directory = client.app.state.ctx.views.get(KeyDirectory)CODE
CRITICALlmcache/v1/storage_backend/connector/azure_connector.py145 from azure.core.exceptions import ResourceNotFoundErrorCODE
AI Structural Patterns20 hits · 17 pts
SeverityFileLineSnippetContext
LOWtests/v1/mp_coordinator/test_key_directory.py26CODE
LOWtests/v1/mp_coordinator/test_event_gate.py37CODE
LOWtests/cli/commands/bench/engine_bench/test_stats.py25CODE
LOW…ds/bench/engine_bench/workloads/test_rag_qa_quality.py70CODE
LOW…che/v1/distributed/l2_adapters/aerospike_l2_adapter.py48CODE
LOW…che/v1/distributed/l2_adapters/raw_block_l2_adapter.py216CODE
LOW…1/distributed/l2_adapters/sagemaker_hyperpod_client.py159CODE
LOW…stributed/l2_adapters/sagemaker_hyperpod_l2_adapter.py60CODE
LOW…ache/v1/distributed/l2_adapters/bigtable_l2_adapter.py172CODE
LOWlmcache/v1/distributed/l2_adapters/valkey_l2_adapter.py165CODE
LOWlmcache/v1/storage_backend/valkey/worker_pool.py173CODE
LOW…/v1/storage_backend/native_clients/aerospike_client.py22CODE
LOWlmcache/v1/storage_backend/connector/eic_connector.py423CODE
LOW…cache/v1/storage_backend/connector/valkey_connector.py107CODE
LOWlmcache/v1/kv_codec/asym_k16_v8.py271CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py308CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py426CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py823CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py892CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py1069CODE
Example Usage Blocks8 hits · 13 pts
SeverityFileLineSnippetContext
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml3# Usage:COMMENT
LOW…es/lmc_external_l2_adapter/scripts/install_and_test.sh7# Usage:COMMENT
LOW.github/scripts/download_model.sh8# Usage:COMMENT
LOW.github/scripts/install_lmcache_cpu.sh9# Usage:COMMENT
LOW.github/scripts/install_vllm_cpu.sh16# Usage:COMMENT
LOW.buildkite/k3_harness/install-agent-stack.sh4# Usage:COMMENT
LOW.buildkite/k3_harness/resolve-pinned-vllm.sh25# Usage:COMMENT
LOW.buildkite/k3_tests/common_scripts/path-filter.sh5# Usage:COMMENT
TODO Padding4 hits · 6 pts
SeverityFileLineSnippetContext
LOWlmcache/v1/memory_management.py855 # TODO: consider using one of the alternativesCOMMENT
LOWlmcache/v1/multiprocess/mq.py489 # TODO: implement this in the future versions if neededCOMMENT
LOWlmcache/v1/storage_backend/gds_backend.py532 # TODO: implement pin() semanticsCOMMENT
LOWlmcache/cli/commands/query/kvcache_command.py24 # TODO: implement kvcache query logicCOMMENT
Fake / Example Data3 hits · 3 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_sglang_mp_adapter.py342 conn._create_key = lambda *args, **kwargs: "fake-key" # type: ignore[method-assign,assignment]CODE
LOWbenchmarks/multi_doc_qa/shuffle_doc_qa.py263 api_key="dummy-key",CODE
LOWbenchmarks/ttft-estimator/ttft-estimator.py37client = OpenAI(api_key="dummy-key", base_url="http://localhost:8000/v1")CODE
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUM.github/workflows/codeql.yml59 # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize howCOMMENT
Overly Generic Function Names2 hits · 2 pts
SeverityFileLineSnippetContext
LOWtests/v1/mp_coordinator/test_cache_events.py694 def handle_request(self, request: httpx.Request) -> httpx.Response:CODE
LOWlmcache/v1/cache_controller/worker.py529 async def handle_request(self):CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMlmcache/v1/mp_coordinator/persistence/store.py122CODE