Repository Analysis

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

37.5 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of LMCache/LMCache, a Python project with 10,544 GitHub stars. SynthScan v2.0 examined 410,748 lines of code across 1679 source files, recording 8729 pattern matches distributed across 23 syntactic categories. The overall adjusted score of 37.5 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

37.5
Adjusted Score
37.5
Raw Score
100%
Time Factor
2026-07-14
Last Push
10.5K
Stars
Python
Language
410.7K
Lines of Code
1.7K
Files
8.7K
Pattern Hits
2026-07-14
Scan Date
0.22
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 1HIGH 371MEDIUM 2038LOW 6319

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 8729 distinct pattern matches across 23 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators1870 hits · 6837 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_utils.py496# ============================================================COMMENT
MEDIUMtests/test_utils.py498# ============================================================COMMENT
MEDIUMtests/test_utils.py27# ============================================================COMMENT
MEDIUMtests/test_utils.py29# ============================================================COMMENT
MEDIUMtests/test_utils.py61# ============================================================COMMENT
MEDIUMtests/test_utils.py63# ============================================================COMMENT
MEDIUMtests/test_utils.py188# ============================================================COMMENT
MEDIUMtests/test_utils.py190# ============================================================COMMENT
MEDIUMtests/test_utils.py211# ============================================================COMMENT
MEDIUMtests/test_utils.py213# ============================================================COMMENT
MEDIUMtests/test_utils.py234# ============================================================COMMENT
MEDIUMtests/test_utils.py236# ============================================================COMMENT
MEDIUMtests/test_utils.py394# ============================================================COMMENT
MEDIUMtests/test_utils.py396# ============================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py186# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py188# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py94# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py96# ==============================================================================COMMENT
MEDIUMtests/v1/test_musa_support.py36# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py38# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py87# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py89# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py166# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py168# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py277# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py279# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py27# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py29# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py73# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py75# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py167# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py169# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py226# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py228# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py25# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py123# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py125# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py20# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py22# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py48# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py50# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2706# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2708# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2737# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2739# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2835# ==========================================COMMENT
MEDIUMtests/v1/test_python_ops_fallback.py2837# ==========================================COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py202# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py204# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py251# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py253# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py216# ===========================================================================COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py218# ===========================================================================COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py358# ===========================================================================COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py360# ===========================================================================COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py17# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_decode_save_and_preemption.py19# ---------------------------------------------------------------------------COMMENT
1810 more matches not shown…
Hyper-Verbose Identifiers4064 hits · 3902 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py255def clean_translation_response(text: str) -> str:CODE
LOWtests/test_utils.py156 def test_nested_brackets_error(self):CODE
LOWtests/test_utils.py162 def test_unmatched_closing_bracket(self):CODE
LOWtests/test_utils.py172 def test_invalid_range_start_gt_end(self):CODE
LOWtests/test_utils.py297 def test_from_string_roundtrip(self, basic_key):CODE
LOWtests/test_utils.py302 def test_from_string_with_tags_roundtrip(self, key_with_tags):CODE
LOWtests/test_utils.py311 def test_from_string_invalid_tag_format(self):CODE
LOWtests/test_utils.py315 def test_to_dict_and_from_dict(self, basic_key):CODE
LOWtests/test_utils.py325 def test_from_dict_invalid_tag(self):CODE
LOWtests/test_utils.py500 def test_parse_cache_engine_key(self):CODE
LOWtests/test_utils.py40 def test_numerator_smaller_than_denominator(self):CODE
LOWtests/test_utils.py75 def test_three_or_more_consecutive(self):CODE
LOWtests/test_utils.py83 def test_non_consecutive_order_preserved(self):CODE
LOWtests/test_utils.py109 def test_three_or_more_elements(self):CODE
LOWtests/test_utils.py273 def test_not_equal_different_hash(self, basic_key):CODE
LOWtests/test_utils.py283 def test_not_equal_different_type(self, basic_key):CODE
LOWtests/test_utils.py360 def test_chunk_hash_hex_bytes(self):CODE
LOWtests/test_utils.py372 def test_unsupported_dtype_raises(self):CODE
LOWtests/test_utils.py382 def test_no_tags_when_no_tag_prefix(self):CODE
LOWtests/test_utils.py409 def test_hash_includes_layer_id(self, layer_key):CODE
LOWtests/test_utils.py432 def test_eq_different_base_key(self, layer_key):CODE
LOWtests/test_utils.py462 def test_from_string_roundtrip(self, layer_key):CODE
LOWtests/test_utils.py467 def test_from_string_with_tags(self):CODE
LOWtests/test_utils.py485 def test_from_string_invalid_tag(self):CODE
LOWtests/test_utils.py516 def test_parse_layer_cache_engine_key(self):CODE
LOWtests/test_utils.py534 def test_parse_cache_key_without_tags(self):CODE
LOWtests/test_utils.py549 def test_parse_cache_key_with_tags(self):CODE
LOWtests/test_utils.py568 def test_parse_layer_cache_key_without_tags(self):CODE
LOWtests/test_utils.py583 def test_parse_layer_cache_key_with_tags(self):CODE
LOWtests/test_utils.py601 def test_roundtrip_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py621 def test_roundtrip_cache_engine_key_with_tags(self):CODE
LOWtests/test_utils.py644 def test_roundtrip_layer_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py665 def test_roundtrip_layer_cache_engine_key_with_tags(self):CODE
LOWtests/test_observability.py32def test_on_retrieve_finished(stats_monitor):CODE
LOWtests/test_observability.py44def test_on_store_request_and_finished(stats_monitor):CODE
LOWtests/test_observability.py52def test_update_local_cache_usage(stats_monitor):CODE
LOWtests/test_observability.py58def test_update_remote_cache_usage(stats_monitor):CODE
LOWtests/test_observability.py64def test_update_local_storage_usage(stats_monitor):CODE
LOWtests/test_observability.py104def test_remote_write_metrics(stats_monitor):CODE
LOWtests/test_observability.py143def test_retrieve_and_store_speed(stats_monitor):CODE
LOWtests/test_observability.py161def test_multiple_lookup_operations(stats_monitor):CODE
LOWtests/test_observability.py180def test_mixed_remote_operations(stats_monitor):CODE
LOWtests/test_observability.py273def test_zero_division_protection(stats_monitor):CODE
LOWtests/test_observability.py284def _cleanup_prometheus_logger():CODE
LOWtests/test_observability.py318def test_prometheus_logger_default_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py326def test_prometheus_logger_custom_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py346def test_prometheus_logger_partial_custom_buckets(CODE
LOWtests/test_observability.py373def test_prometheus_logger_get_or_create_with_config(CODE
LOWtests/test_observability.py393def test_prometheus_logger_get_or_create_allows_multiple_roles(CODE
LOWtests/test_observability.py408def test_prometheus_logger_label_view_rebinds_dynamic_metrics(CODE
LOWtests/test_observability.py438def test_prometheus_logger_reset_reinitializes_all_label_views(CODE
LOWtests/test_banner.py35def test_banner_contains_version_links_and_opt_out_hint():CODE
LOWtests/test_banner.py46def test_banner_is_plain_on_non_tty_stream():CODE
LOWtests/test_banner.py52def test_banner_is_colored_on_tty_stream():CODE
LOWtests/test_banner.py60def test_banner_prints_at_most_once_per_process():CODE
LOWtests/test_banner.py70def test_banner_disabled_by_env_var(monkeypatch, value):CODE
LOWtests/test_banner.py77def test_banner_not_disabled_by_falsy_env_var(monkeypatch):CODE
LOWtests/test_serde.py115def test_cachegen_unmatched_size():CODE
LOWtests/test_usage_telemetry.py150 def test_lmcache_track_usage_false(self, usage_env, monkeypatch):CODE
LOWtests/test_usage_telemetry.py159 def test_do_not_track_env_unset_values(self, usage_env, monkeypatch):CODE
4004 more matches not shown…
Docstring Block Structure195 hits · 975 pts
SeverityFileLineSnippetContext
HIGHexamples/token_dropping/utils.py140Move key cache RoPE from old positions to new positions. Args: kv_tensor: The KV cache tensor of shape [2, LSTRING
HIGHbenchmarks/long_doc_qa/long_doc_qa.py333 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGH…dkite/k3_tests/multiprocess/scripts/run-hma-lm-eval.sh179Return the gsm8k (exact_match, stderr) from an lm_eval results directory. Prefers the strict-match variant; falls bSTRING
HIGHlmcache/python_ops_fallback.py70 Create a tensor view over a raw pointer (zero-copy where possible). Supports both CPU (pinned or regular) and STRING
HIGHlmcache/python_ops_fallback.py1213Python fallback implementation of block-based multi-layer KV transfer. Signature intentionally mirrors the C++ bindSTRING
HIGHlmcache/v1/memory_management.py1391 Allocate a block of memory from the virtual address space of a given size. The actual allocated size coSTRING
HIGHlmcache/v1/memory_management.py1440 Allocate blocks of memory from the virtual address space of a given size and batch size. The actual allSTRING
HIGHlmcache/v1/hidden_state_store.py123Store hidden_states chunked under the same keys as KV. Args: token_ids: 1-D int tensor or list of tSTRING
HIGHlmcache/v1/kv_layer_groups.py81Partition layer indices by :data:`LayerGroupIdentity`. Args: kv_caches: Registered KV cache structure, one STRING
HIGHlmcache/v1/kv_layer_groups.py588Calculate the number of blocks for a given number of tokens in a specified kernel group. Args: STRING
HIGHlmcache/v1/protocol.py100Pad a shape with fewer than 4 dimensions to 4D using trailing zeros. Shapes that are already 4D are returned asSTRING
HIGHlmcache/v1/config_base.py51Parse local disk path configuration. Accepts a single path or comma-separated paths, each optionally prefixed wSTRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py98Allocate one object from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shape or sSTRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py139Allocate multiple objects from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shapSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py99Allocate from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape or shapesSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py128Allocate a batch from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape oSTRING
HIGHlmcache/v1/memory_allocators/lazy_memory_allocator.py29 Get the NUMA ID for the current GPU Args: numa_mapping (NUMAMapping): The NUMA mapping object. ReSTRING
HIGHlmcache/v1/memory_allocators/__init__.py24Lazily re-export allocator classes without eager package imports. Args: name: Exported allocator or helper STRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py261Allocate one object from local DRAM first, then Device-DAX. Args: shapes: Logical tensor shape or sSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py303Allocate multiple objects from local DRAM first, then Device-DAX. Args: shapes: Logical tensor shapSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py41Decode a base64 token string produced by :func:`encode_tokens`. Args: tokens_b64: Base64 of a little-endianSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py327Reject a malformed token buffer at request validation. Without this, ``decode_tokens`` would raise ``ValueErrorSTRING
HIGHlmcache/v1/mp_coordinator/registrar.py43Register an MP server with the coordinator and return its id. Args: client: The HTTP client to send with. STRING
HIGHlmcache/v1/mp_coordinator/utils/cache_utils.py28Resolve a token sequence to the object keys of its complete chunks. Args: token_hasher: Hasher configured tSTRING
HIGH…he/v1/mp_coordinator/cache_control/prefetch_manager.py41``POST /cache/prefetches`` to ``target`` and return its JSON reply. Args: target: The MP server to STRING
HIGH…he/v1/mp_coordinator/cache_control/prefetch_manager.py78Proxy ``GET /cache/prefetches/{request_id}`` on ``target``. Args: target: The MP server holding theSTRING
HIGH…che/v1/mp_coordinator/http_apis/blend_directory_api.py36Return the shared blend directory from app state. Args: request: The incoming request. Returns: STRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py40Submit a warm prefetch of a token sequence on one MP server. Resolves ``body.instance_id`` in the registry and proxSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py93Proxy a warm-prefetch status poll to the owning MP server. The warm holds no lock, so this poll only reports progreSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py139Pin a token sequence's keys in the L2 eviction plan. The coordinator resolves the token sequence to its object keysSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py176Unpin a token sequence's keys from the L2 eviction plan. Symmetric with pin: resolves the keys locally and releasesSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py54Return the per-app :class:`CoordinatorContext`. Args: request: The FastAPI request whose ``app.state`` carrSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py73Return the lifespan-bound outbound client, or raise if unset. Args: request: The FastAPI request. RetuSTRING
HIGHlmcache/v1/multiprocess/server.py168Assemble the list of engine modules based on configuration. Args: ctx: The shared engine context. mSTRING
HIGHlmcache/v1/multiprocess/config.py602Convert parsed command line arguments to a CoordinatorConfig. A flag value takes precedence over its environment vaSTRING
HIGHlmcache/v1/multiprocess/engine_context.py138Look up the attention-window descriptor for a pair. Args: model_name: The model name. wSTRING
HIGHlmcache/v1/multiprocess/engine_context.py257Resolve per-object-group object keys from an IPC cache key. Uses the session manager to track token state and tSTRING
HIGHlmcache/v1/multiprocess/protocol.py33 Get the expected payload classes for a request type. Args: req_type: The request type to look up STRING
HIGHlmcache/v1/multiprocess/protocol.py52 Get the expected response class for a request type. Args: req_type: The request type to look up RSTRING
HIGHlmcache/v1/multiprocess/protocol.py71 Get the handler type for a request type. Args: req_type: The request type to look up Returns: STRING
HIGHlmcache/v1/multiprocess/futures.py41 Get the result of the future. Args: timeout (Optional[float]): Maximum time to wait in secSTRING
HIGHlmcache/v1/multiprocess/futures.py118 Wait for the future to be done, with the CUDA stream. Args: timeout (Optional[float]): MaxSTRING
HIGHlmcache/v1/multiprocess/futures.py152 Get the result of the future. Args: timeout (Optional[float]): Maximum time to wait for thSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py123Create a new shared-memory segment and return its mmap address. Mirrors the previous ``shm_open(O_CREAT|O_EXCL) + fSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py149Open an existing shared-memory segment and return its address. ``nbytes`` must match the segment's actual size; ``mSTRING
HIGHlmcache/v1/multiprocess/posix_shm.py251Open an existing segment as an independent ``mmap.mmap`` object. Convenience helper for non-GPU SHM transports thatSTRING
HIGHlmcache/v1/multiprocess/group_view.py175Slice each engine group's block IDs for a token range. The range is given in tokens — the only unit shared by everySTRING
HIGHlmcache/v1/multiprocess/group_view.py225Return the engine group index for each registered KV tensor. Args: groups: The LMCache KV groups, in protocSTRING
HIGHlmcache/v1/multiprocess/transfer_context/shm.py61Parse a slot descriptor from the MQ context schema. Args: d: Mapping containing ``offset``, ``lengtSTRING
HIGH…he/v1/multiprocess/transfer_context/worker_transfer.py239Submit a store request and return a completion future. Args: request_id: External request identifieSTRING
HIGH…he/v1/multiprocess/transfer_context/worker_transfer.py269Submit a retrieve request and return a completion future. Args: request_id: External request identiSTRING
HIGH…he/v1/multiprocess/transfer_context/worker_transfer.py611Create a transfer context from KV cache device type. The device check is intentionally centralized here. Routing caSTRING
HIGH…1/multiprocess/transfer_context/async_engine_driven.py164Three-phase async store (prepare, gather and commit all in background). Performs only O(1) work on the forward STRING
HIGHlmcache/v1/multiprocess/transfer_context/base.py267Compute KV layout metadata from KV tensors. Args: kv_caches: Per-layer KV tensor mapping. layout_hiSTRING
HIGHlmcache/v1/multiprocess/transfer_context/base.py311Gather paged KV blocks into CPU chunk tensors. Args: kv_caches: Per-layer KV tensor mapping. block_STRING
HIGHlmcache/v1/multiprocess/cache_control/key_resolver.py44Resolve a token sequence to the per-rank object keys it maps to. Args: engine: The node's cache engine (itsSTRING
HIGHlmcache/v1/multiprocess/http_apis/config_api.py65Enumerate the live cache adapters. Listing which storage adapters the engine loaded is a configuration inspectiSTRING
HIGHlmcache/v1/multiprocess/http_apis/dependencies.py60Return the per-app :class:`MPHTTPContext`, or raise ``HTTPException``. Args: request: The FastAPI request wSTRING
HIGHlmcache/v1/multiprocess/modules/blend.py775Store the pre-computed chunks in the underlying storage for later retrieval. Args: key: IPCCacheSerSTRING
HIGHlmcache/v1/multiprocess/modules/blend.py903Retrieve pre-computed chunks from storage and copy them to the CB KV buffer. Args: key: IPCCacheSerSTRING
135 more matches not shown…
Cross-File Repetition171 hits · 855 pts
SeverityFileLineSnippetContext
HIGHtests/v1/test_gpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/test_xpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/distributed/test_mock_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_nixl_store_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGH…s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_l1_manager.py0determine if lazy allocation should be used based on cuda availability.STRING
HIGH…sts/v1/distributed/test_distributed_storage_manager.py0determine if lazy allocation should be used based on cuda availability.STRING
HIGHtests/v1/distributed/test_l1_memory_manager.py0determine if lazy allocation should be used based on cuda availability.STRING
HIGHtests/v1/distributed/test_store_controller.py0determine if lazy allocation should be used based on cuda availability.STRING
HIGHtests/v1/distributed/serde/test_serde_e2e.py0determine if lazy allocation should be used based on cuda availability.STRING
HIGHtests/v1/distributed/test_l1_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/distributed/test_distributed_storage_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGHtests/v1/distributed/test_l1_memory_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/mp_observability/subscribers/metrics/test_l2.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…mp_observability/subscribers/metrics/test_cb_server.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…rvability/subscribers/metrics/test_l1_eviction_loop.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…v1/mp_observability/subscribers/metrics/test_lookup.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/multiprocess/engine_module.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/blend.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/p2p_controller.py0return the shared engine context. exposed for testing only.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/lookup.py0return the shared engine context. exposed for testing only.STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/management.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/blend.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGHlmcache/v1/multiprocess/modules/management.py0return handler specs for all request types this module serves. returns: a list of handlerspec entries mapping request tySTRING
HIGHlmcache/v1/multiprocess/protocols/blend.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGHlmcache/v1/multiprocess/protocols/debug.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGHlmcache/v1/multiprocess/protocols/controller.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGHlmcache/v1/multiprocess/protocols/p2p.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGHlmcache/v1/multiprocess/protocols/observability.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGHlmcache/v1/multiprocess/protocols/engine.py0returns protocol definitions for engine operations. returns: dictionary mapping request names to their protocol definitiSTRING
HIGH…e/v1/mp_observability/subscribers/logging/mp_server.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/sm.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/l1.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/platform/base_pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/platform/base_device_spec.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/platform/cuda/pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/storage_backend/pd_backend_async.py0remove the key from the storage backend. :param key: the key to remove.STRING
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py0remove the key from the storage backend. :param key: the key to remove.STRING
HIGHlmcache/v1/storage_backend/pd_backend.py0remove the key from the storage backend. :param key: the key to remove.STRING
HIGHlmcache/v1/gpu_connector/mock_gpu_connector.py0initialize the kvcaches pointers if not already initialized.STRING
HIGHlmcache/v1/gpu_connector/hpu_connector.py0initialize the kvcaches pointers if not already initialized.STRING
HIGHlmcache/v1/gpu_connector/gpu_connectors.py0initialize the kvcaches pointers if not already initialized.STRING
111 more matches not shown…
Excessive Try-Catch Wrapping745 hits · 788 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py493 except Exception as e:CODE
LOWtests/conftest.py681 except Exception as e:CODE
LOWtests/conftest.py771 except Exception as e:CODE
MEDIUMtests/conftest.py773 print("Error during close obj:%s - %s", obj, e)CODE
LOWtests/conftest.py905 except Exception as e:CODE
LOWtests/v1/test_nixl_storage.py58 except Exception:CODE
LOWtests/v1/test_nixl_storage.py258 except Exception:CODE
MEDIUMtests/v1/test_address_manager.py821def alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py834def free_worker():CODE
MEDIUMtests/v1/test_address_manager.py991def batch_alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py1003def free_worker():CODE
LOWtests/v1/test_address_manager.py737 except Exception as e:CODE
LOWtests/v1/test_address_manager.py784 except Exception as e:CODE
LOWtests/v1/test_address_manager.py831 except Exception as e:CODE
LOWtests/v1/test_address_manager.py843 except Exception as e:CODE
LOWtests/v1/test_address_manager.py923 except Exception as e:CODE
LOWtests/v1/test_address_manager.py960 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1000 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1012 except Exception as e:CODE
MEDIUMtests/v1/utils.py225 print(f"Error during close pending tasks: - {e}")CODE
LOWtests/v1/utils.py75 except Exception:CODE
LOWtests/v1/utils.py98 except Exception:CODE
LOWtests/v1/utils.py131 except Exception:CODE
LOWtests/v1/utils.py151 except Exception:CODE
LOWtests/v1/utils.py224 except Exception as e:CODE
LOWtests/v1/test_remote_mla_worker_id_as0.py181 except Exception as e:CODE
MEDIUMtests/v1/test_remote_mla_worker_id_as0.py182 print(f"Error during shutdown: {e}")CODE
LOWtests/v1/mp_coordinator/test_blend_directory.py210 except Exception as e: # noqa: BLE001CODE
LOWtests/v1/mp_coordinator/test_blend_directory.py217 except Exception as e: # noqa: BLE001CODE
MEDIUMtests/v1/mp_coordinator/test_blend_directory.py206def publisher() -> None:CODE
MEDIUMtests/v1/mp_coordinator/test_blend_directory.py213def matcher() -> None:CODE
MEDIUMtests/v1/multiprocess/test_session.py231def writer() -> None:CODE
LOWtests/v1/multiprocess/test_session.py200 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py228 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py236 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_cache_server.py53 except Exception:CODE
LOWtests/v1/multiprocess/test_cache_server.py364 except Exception as e:CODE
MEDIUMtests/v1/multiprocess/test_cache_server.py365 print(f"Error during unregister: {e}")CODE
LOWtests/v1/multiprocess/test_custom_types.py147 except Exception as e:CODE
LOWtests/v1/multiprocess/test_custom_types.py263 except Exception as e:CODE
LOWtests/v1/multiprocess/test_mq.py160 except Exception as e:CODE
LOW…1/lookup_client/test_chunk_statistics_lookup_client.py320 except Exception:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py72 except Exception as e:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py98 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py205 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py240 except Exception:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py282 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py286 except Exception:CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py47 except Exception:CODE
MEDIUMtests/v1/distributed/test_l1_manager.py1736def worker(thread_id):CODE
LOWtests/v1/distributed/test_l1_manager.py1756 except Exception as e:CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py39 except Exception:CODE
MEDIUMtests/v1/distributed/test_raw_block_l2_adapter.py33def _has_ext() -> bool:CODE
MEDIUMtests/v1/distributed/test_l2_adapter_factory.py32def _has_raw_block_ext() -> bool:CODE
LOWtests/v1/distributed/test_l2_adapter_factory.py38 except Exception:CODE
LOW…sts/v1/distributed/test_resp_l2_adapter_integration.py43 except Exception:CODE
MEDIUMtests/v1/distributed/test_l1_memory_manager.py220def allocate_task():CODE
MEDIUMtests/v1/distributed/test_l1_memory_manager.py343def allocate_and_free_task():CODE
MEDIUMtests/v1/distributed/test_l1_memory_manager.py512def worker():CODE
LOWtests/v1/distributed/test_l1_memory_manager.py225 except Exception as e:CODE
685 more matches not shown…
Unused Imports616 hits · 588 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py5CODE
LOWtests/v1/utils.py150CODE
LOWtests/v1/test_trtllm_integration.py22CODE
LOWtests/v1/multiprocess/test_raw_block_l2_adapter.py4CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py341CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py602CODE
LOWtests/v1/distributed/conftest.py7CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py54CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py36CODE
LOWtests/v1/distributed/test_l2_adapter_factory.py35CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py20CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py21CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_v_only.py27CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_multi.py12CODE
LOWtests/v1/distributed/serde/test_multi.py25CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py13CODE
LOWtests/v1/storage_backend/test_storage_plugin.py28CODE
LOWtests/v1/storage_backend/test_raw_block_device.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py50CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py45CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py46CODE
LOWtests/v1/storage_backend/test_raw_block_core.py4CODE
LOWtests/v1/storage_backend/raw_block_test_utils.py4CODE
LOWtests/v1/storage_backend/test_raw_block_uring_cmd.py51CODE
LOWtests/cli/commands/trace/test_dispatch.py6CODE
LOWtests/cli/commands/trace/test_driver.py13CODE
LOWsetup_extensions/__init__.py14CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py16CODE
LOWsetup_extensions/common_cpp.py14CODE
LOWsetup_extensions/common_cpp.py17CODE
LOWsetup_extensions/storage_backend_profiles/aerospike.py16CODE
LOWsetup_extensions/storage_backend_profiles/__init__.py15CODE
LOWsetup_extensions/storage_backend_profiles/mooncake.py15CODE
LOWsetup_extensions/build_profiles/rocm.py15CODE
LOWsetup_extensions/build_profiles/__init__.py15CODE
LOWsetup_extensions/build_profiles/__init__.py18CODE
LOWsetup_extensions/build_profiles/musa.py13CODE
LOWsetup_extensions/build_profiles/sycl.py15CODE
LOWsetup_extensions/build_profiles/cuda.py15CODE
LOW…amples/online_session/openai_chat_completion_client.py14CODE
LOWexamples/lmc_external_l2_adapter/tests/test_plugin.py44CODE
LOW…rnal_l2_adapter/src/lmc_external_l2_adapter/adapter.py19CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py12CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py12CODE
LOW…onnector/src/lmc_external_native_connector/__init__.py22CODE
LOW…nnector/src/lmc_external_native_connector/connector.py29CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py15CODE
LOWbenchmarks/multi_doc_qa/shuffle_doc_qa.py15CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/usage_context.py6CODE
LOWlmcache/__init__.py13CODE
LOWlmcache/observability.py32CODE
556 more matches not shown…
Over-Commented Block264 hits · 260 pts
SeverityFileLineSnippetContext
LOWpyproject_cli.toml61COMMENT
LOWpyproject_cli.toml101[tool.ruff.lint.isort]COMMENT
LOWpyproject.toml81 # "UP",COMMENT
LOWpyproject.toml121platform = "linux"COMMENT
LOWcsrc/mem_alloc.cpp1#include <cuda_runtime.h>COMMENT
LOWcsrc/pybind.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/event_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/completion_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/event_recorder.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda_compat.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_base.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_types.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h61 // - model_name: 25-50 chars (e.g., "meta-llama/Llama-3-70b-instruct")COMMENT
LOWcsrc/storage_backends/aerospike/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/fs/connector.cpp21 while ((pos = result.find(from, pos)) != std::string::npos) {COMMENT
LOWcsrc/storage_backends/fs/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_manager/periodic_event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp21// work-group handles both K and V, halving dispatch count andCOMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp21// (lid * BLOCK_SIZE + tx)COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp21//COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp21// - sub_group_size locked to 16 (native SIMD on Intel discrete GPUs).COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp21//COMMENT
LOWcsrc/sycl/cachegen_kernels_sycl.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs661 /// submission queue. Replaces the `Condvar::notify_one` used in theCOMMENT
LOWrust/raw_block/src/lib.rs701 if epoll_fd < 0 {COMMENT
LOWrust/raw_block/src/lib.rs781 // n < 0 is usually EINTR (signal interruption); we just return andCOMMENT
LOWrust/raw_block/src/lib.rs821/// It contains all information needed to perform the I/O operation.COMMENT
LOWrust/raw_block/src/lib.rs901 // Flag indicating if fixed buffers have been registeredCOMMENT
LOWrust/raw_block/src/lib.rs1341 // On shutdown, we must process ALL pending requests to avoid deadlocks:COMMENT
LOWrust/raw_block/src/lib.rs1541 }COMMENT
LOWtests/test_serde.py61 # model_name="mistralai/Mistral-7B-Instruct-v0.2",COMMENT
LOWtests/v1/test_mem_kernels.py881COMMENT
LOWtests/v1/test_cache_interface.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/test_vllm_integration.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/distributed/test_bitmap_ops.py521 present_cells=[COMMENT
LOW…mp_observability/subscribers/metrics/test_cb_server.py241 )COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml1# LMCache ShmFile Connector - basic_check configurationCOMMENT
LOWtests/v1/shm_allocator/csrc/shm_file_worker.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/shm_allocator/csrc/shm_file_worker.cpp21#include <cstdint>COMMENT
LOW…1/internal_api_server/test_scripts/multiple_imports.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…/v1/internal_api_server/test_scripts/default_result.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/internal_api_server/test_scripts/exception.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/internal_api_server/test_scripts/os_module.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…sts/v1/internal_api_server/test_scripts/math_module.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…/v1/internal_api_server/test_scripts/invalid_module.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…/internal_api_server/test_scripts/builtin_functions.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…v1/internal_api_server/test_scripts/allowed_imports.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…nal_api_server/test_scripts/without_allowed_imports.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…ernal_api_server/test_scripts/empty_allowed_imports.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/native_storage_ops/test_pattern_matcher.py621 end = [9]COMMENT
204 more matches not shown…
Deep Nesting300 hits · 241 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_python_ops_fallback.py807CODE
LOWtests/v1/test_python_ops_fallback.py1159CODE
LOWtests/v1/test_python_ops_fallback.py1385CODE
LOWtests/v1/test_python_ops_fallback.py2773CODE
LOWtests/v1/test_mp_mem_kernels.py69CODE
LOWtests/v1/test_mp_mem_kernels.py107CODE
LOWtests/v1/test_mp_mem_kernels.py168CODE
LOWtests/v1/test_address_manager.py811CODE
LOWtests/v1/test_address_manager.py892CODE
LOWtests/v1/test_address_manager.py981CODE
LOWtests/v1/test_address_manager.py821CODE
LOWtests/v1/test_address_manager.py834CODE
LOWtests/v1/test_address_manager.py904CODE
LOWtests/v1/test_address_manager.py991CODE
LOWtests/v1/test_address_manager.py1003CODE
LOWtests/v1/utils.py62CODE
LOWtests/v1/utils.py215CODE
LOWtests/v1/utils.py291CODE
LOWtests/v1/utils.py447CODE
LOWtests/v1/utils.py656CODE
LOWtests/v1/test_c_ops_fallback_parity.py132CODE
LOWtests/v1/test_freeze_mode_integration.py27CODE
LOWtests/v1/multiprocess/test_optimized_lookup_v3.py537CODE
LOWtests/v1/multiprocess/test_optimized_lookup_v3.py750CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py166CODE
LOWtests/v1/distributed/test_l1_manager.py1726CODE
LOWtests/v1/distributed/test_l1_manager.py1736CODE
LOWtests/v1/distributed/test_l1_l2_state_metrics.py130CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py44CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py69CODE
LOW…v1/mp_observability/subscribers/metrics/test_engine.py64CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py30CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py60CODE
LOW…observability/subscribers/metrics/test_sm_lifecycle.py73CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py34CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py55CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l1.py32CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py31CODE
LOWtests/v1/cache_controller/conftest.py218CODE
LOWtests/v1/cache_controller/conftest.py248CODE
LOWtests/v1/cache_controller/conftest.py323CODE
LOWtests/v1/cache_controller/test_registry_tree.py451CODE
LOWtests/v1/cache_controller/test_registry_tree.py519CODE
LOWtests/v1/cache_controller/test_registry_tree.py493CODE
LOWtests/v1/cache_controller/test_registry_tree.py541CODE
LOWtests/v1/storage_backend/test_local_cpu_backend.py339CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py222CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py385CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py506CODE
LOW…v1/storage_backend/test_p2p_backend_with_controller.py553CODE
LOWtests/v1/storage_backend/test_dax_backend.py142CODE
LOWtests/v1/storage_backend/test_dax_backend.py1114CODE
LOWtests/v1/storage_backend/test_dax_backend.py1290CODE
LOWtests/v1/storage_backend/test_dax_backend.py1367CODE
LOWtests/v1/storage_backend/test_dax_backend.py1446CODE
LOWtests/v1/storage_backend/test_dax_backend.py1615CODE
LOWtests/v1/storage_backend/test_hfbucket_connector.py381CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py645CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py787CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py870CODE
240 more matches not shown…
Self-Referential Comments71 hits · 218 pts
SeverityFileLineSnippetContext
MEDIUMtests/conftest.py276 # Create a shared store but separate instances for master/slaveCOMMENT
MEDIUMtests/conftest.py638 # Create a fake hf3fs_fuse module if it doesn't existCOMMENT
MEDIUMtests/v1/test_basic_check.py48 # Create a fake check_mode_ moduleCOMMENT
MEDIUMtests/v1/test_memory_management.py563 # Create a simple allocator for testingCOMMENT
MEDIUMtests/v1/test_memory_management.py568 # Create a real TensorMemoryObjCOMMENT
MEDIUMtests/v1/test_memory_management.py426 # Create a memory objectCOMMENT
MEDIUMtests/v1/test_memory_management.py472 # Create a mock memory object for testingCOMMENT
MEDIUMtests/v1/test_memory_management.py501 # Create a mock memory objectCOMMENT
MEDIUMtests/v1/test_config.py808 # Create a config and update from envCOMMENT
MEDIUMtests/v1/test_cache_engine.py1467 # Create an engine instanceCOMMENT
MEDIUMtests/v1/test_cache_engine.py1928 # Create a mock engineCOMMENT
MEDIUMtests/v1/test_cache_engine.py2020 # Create a mock engineCOMMENT
MEDIUMtests/v1/multiprocess/test_futures.py199 # Create the raw future that will return (event_bytes, result_value)COMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py23 # Create a sample IPCCacheServerKeyCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py74 # Create a sample tensorCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py170 # Create a tensor with known valuesCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py187 # Create a queue for resultsCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py507 # Create a single test keyCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py531 # Create a different test keyCOMMENT
MEDIUMtests/v1/distributed/test_mock_l2_adapter.py625 # Create a larger object to see noticeable delayCOMMENT
MEDIUMtests/v1/cache_controller/conftest.py225 # Create a mock registry with all required methodsCOMMENT
MEDIUMtests/v1/cache_controller/test_config.py55 # Create a temporary YAML config fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py96 # Create a Python plugin fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py238 # Create a Python file with shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py258 # Create a Bash fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py278 # Create a Python file without shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py301 # Create an unsupported file typeCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py302 # Create a mock channelCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py417 # Create a query for 3 keys (2 cached, 1 not)COMMENT
MEDIUMtests/v1/storage_backend/test_storage_plugin.py300 # Create a test keyCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py227 # Create a path that doesn't existCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py278 # Create a dummy file so os.path.exists returns TrueCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py304 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py330 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_hf3fs_connector.py180 # Create the 3fs-virt directory structure that HF3FS expectsCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py129 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py173 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py225 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py272 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py309 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_bigtable_integration.py268 # Create a payload of ~8.38 MB (exceeds the 5.0 MB threshold)COMMENT
MEDIUMtests/v1/internal_api_server/test_cache_clear.py23 # Create a mock LMCache engineCOMMENT
MEDIUMtests/v1/native_storage_ops/test_ttl_lock.py115 # Create a lock with 1 second TTLCOMMENT
MEDIUMtests/disagg/test_nixl_storage_backend.py80 "nixl_path": tempfile.mkdtemp(), # Create a temporary directory for testingCODE
MEDIUMtests/disagg/test_nixl_cache_engine.py188 # Create the VLLMPagedMemGPUConnectorV2COMMENT
MEDIUMtests/disagg/test_nixl_cache_engine.py199 # Create the LMCacheEngine (will be reused across rounds)COMMENT
MEDIUMtests/disagg/test_nixl_channel.py106 # Create the NixlChannelCOMMENT
MEDIUMexamples/blend_kv_v1/blend.py146 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…/kv_cache_reuse/local_backends/rust_backend_offload.py158 # Define the shared prompt and specific promptsCOMMENT
MEDIUMexamples/kv_cache_reuse/local_backends/offload.py131 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…rks/storage_backend_io/storage_backend_io_benchmark.py411 # Create the specific backendCOMMENT
MEDIUMbenchmarks/rag/rag.py308 # Create a dataframeCOMMENT
MEDIUMbenchmarks/multi_doc_qa/multi_doc_qa.py252 # Create the OpenAI clientCOMMENT
MEDIUMbenchmarks/long_doc_qa/long_doc_qa.py484 # Create the OpenAI clientCOMMENT
MEDIUM.github/scripts/download_opt125m_github.sh52# Create the refs/main pointer so snapshot_download(local_files_only=True)COMMENT
MEDIUM.buildkite/k3_harness/values.yaml3# This file is for documentation only.COMMENT
MEDIUM.buildkite/scripts/vllm-integration-tests.sh782# Create the container imageCOMMENT
MEDIUMlmcache/python_ops_fallback.py3# This file contains Python non-CUDA fallback implementations forCOMMENT
MEDIUMlmcache/connections.py2# This file is copied from the vLLM project (https://github.com/vllm-project/vllm).COMMENT
MEDIUMlmcache/v1/memory_allocators/lazy_memory_allocator.py119 # Create the tensor memory allocatorCOMMENT
11 more matches not shown…
Structural Annotation Overuse107 hits · 178 pts
SeverityFileLineSnippetContext
LOWcsrc/storage_backends/README.md83### Step 1: C++ connector — inherit from ConnectorBaseCOMMENT
LOWcsrc/storage_backends/README.md153### Step 2: Pybind moduleCOMMENT
LOWcsrc/storage_backends/README.md177### Step 3: Build system — register in setup.pyCOMMENT
LOWcsrc/storage_backends/README.md199### Step 4: Python client — non-MP mode integrationCOMMENT
LOWcsrc/storage_backends/README.md220### Step 5: MP mode integration — L2 adapter config + factoryCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py386 # Step 1: Both backends healthyCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py394 # Step 2: Backend A failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py401 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py412 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py424 # Step 5: Backend B recoversCOMMENT
LOWtests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOWtests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOWtests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOWtests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOWtests/v1/test_cache_engine.py1247 # NOTE: The default backend cache size is 2 GB.COMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py591 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py598 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py604 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py614 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py652 # Step 3: Scheduler lookup with interleaved keysCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py667 # Step 4: Verify hit countCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py675 # Step 5: Workers retrieve their chunksCOMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOWtests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md90### Step 1: Create the ModuleCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md116### Step 2: DoneCOMMENT
LOW…design/cli/commands/bench/engine_bench/bench-engine.md560### Step 1: Create the workload moduleCOMMENT
LOW…design/cli/commands/bench/engine_bench/bench-engine.md606### Step 2: Register in the factoryCOMMENT
LOW…design/cli/commands/bench/engine_bench/bench-engine.md629### Step 3: Add CLI argsCOMMENT
LOW…design/cli/commands/bench/engine_bench/bench-engine.md644### Step 4: Add testsCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOWexamples/kv_cache_reuse/local_backends/README.md12 # WARNING: This will erase the content of target device.COMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md7## Step 1: Configure your S3 bucket and (optional) EC2 compute instanceCOMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md14## Step 2: Fill out `example.yaml`COMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md18## Step 3: Start an vLLM engine with LMCacheCOMMENT
LOWexamples/kv_cache_reuse/remote_backends/s3/README.md24## Step 4: Sending requestsCOMMENT
LOWbenchmarks/multi_doc_qa/README.md8### Step 1: Start the serving engineCOMMENT
LOWbenchmarks/multi_doc_qa/README.md27### Step 2: Send the requestsCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh46# Step 1: Build docker imagesCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh57# Step 2: Launch containersCOMMENT
47 more matches not shown…
Verbosity Indicators82 hits · 139 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_health_monitor_fallback_recovery.py386 # Step 1: Both backends healthyCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py394 # Step 2: Backend A failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py401 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py412 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py424 # Step 5: Backend B recoversCOMMENT
LOWtests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOWtests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOWtests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOWtests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOWtests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOWtests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py591 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py598 # Step 2: Lookup and lockCOMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py604 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py614 # Step 4: UnlockCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py652 # Step 3: Scheduler lookup with interleaved keysCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py667 # Step 4: Verify hit countCOMMENT
LOWtests/v1/distributed/test_object_key_parallel.py675 # Step 5: Workers retrieve their chunksCOMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOWtests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOWtests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOWtests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOWexamples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh46# Step 1: Build docker imagesCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh57# Step 2: Launch containersCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh68# Step 3: Wait for vLLM to be readyCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh79# Step 4: Run lm_eval workload testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh90# Step 5: Run vllm bench serve testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh101# Step 6: Run long doc QA testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh112# Step 7: Run fault tolerance test (destructive — kills LMCache container)COMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh127# Step 8: Cleanup runs automatically via trapCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh79 # Step 1: Warmup bench (measure timing for kill calibration)COMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh93 # Step 2: Bench with mid-flight LMCache killCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh118 # Step 3: Quick curl health checkCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh72# Step 1: Kill existing LMCache + vLLM, relaunch both with L2 configCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh228# Step 2: Run benchmarksCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh256# Step 3: Verify thresholdsCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh346# Step 4: Verify L2 data flow via Prometheus metricsCOMMENT
LOW…te/k3_tests/multiprocess/scripts/run-long-doc-qa-l2.sh457# Step 5: Verify the rest of the MP observability surfaceCOMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh43# Step 1: Launch native processes (replaces Docker containers)COMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh54# Step 2: Wait for vLLM to be readyCOMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh65# Step 3: Run lm_eval workload testCOMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh76# Step 4: Run vllm bench serve testCOMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh87# Step 5: Run long doc QA testCOMMENT
22 more matches not shown…
Redundant / Tautological Comments75 hits · 112 pts
SeverityFileLineSnippetContext
LOWdocker/example_build.sh7# Set VLLM_VERSION to a specific version before running this script,COMMENT
LOWtests/conftest.py768 # Check if object has a close methodCOMMENT
LOWtests/v1/test_impl_completeness.py73 # Check if the method is actually implemented in the classCOMMENT
LOWtests/v1/utils.py671 # Check if it's callable (function, method, etc.)COMMENT
LOWtests/v1/multiprocess/test_custom_types.py200 # Check if process completed successfullyCOMMENT
LOWtests/v1/multiprocess/test_mq.py272 # Check if client completed successfullyCOMMENT
LOW…v1/storage_backend/test_p2p_backend_with_controller.py64 # Check if backend is properly initialized by checking its attributesCOMMENT
LOW…1/storage_backend/test_local_cpu_backend_nixl_paged.py241 # Set cpu_size_bytes to exactly 1 byte — smaller than one chunk.COMMENT
LOWtests/v1/internal_api_server/test_run_script.py41 # Check if we've closed all bracesCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py79 # Check if the mean is close to the pattern valueCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py290 # Check if all tokens were retrievedCOMMENT
LOWexamples/chunk_statistics/analyze_chunk_hashes.py393 # Print resultsCOMMENT
LOWexamples/kubernetes/health_probe.py65 # Check if server responded with successCOMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py474 # Check if this is a two-phase benchmark (write + read)COMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py1225 # Print resultsCOMMENT
LOWbenchmarks/multi_doc_qa/multi_doc_qa.py322 # Print resultsCOMMENT
LOWbenchmarks/multi_round_qa/multi-round-qa.py455 # Check if can join new user sessionCOMMENT
LOWbenchmarks/long_doc_qa/long_doc_qa.py561 # Print resultsCOMMENT
LOWbenchmarks/microbenchmark/ttl_lock_benchmark.py522 # Check if we can sustain 10K+ ops/sec with 4-8 threadsCOMMENT
LOW.buildkite/k3_harness/gpu-monitor.sh67 # Check if this PID is inside any cgroup containing "kubepods"COMMENT
LOW.buildkite/k3_harness/setup-cluster.sh66# Check if image already exists in K3s containerdCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh79 # Check if port is available using netstatCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh669 # Check if baseline exists, skip comparisons if notCOMMENT
LOW…ildkite/scripts/multiprocessing-test/run-vllm-bench.sh98 # Check if result files existCOMMENT
LOW.buildkite/scripts/multiprocessing-test/common.sh28 # Check if uv is availableCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh37 # Check if container is still runningCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh46 # Check if vLLM health endpoint is respondingCOMMENT
LOW…ldkite/scripts/multiprocessing-test/run-long-doc-qa.sh118 # Check if result files existCOMMENT
LOWlmcache/utils.py248 # Check if it's a range format [start,end]COMMENT
LOWlmcache/v1/memory_management.py1598 # Check if free blocks are properly coalescedCOMMENT
LOWlmcache/v1/memory_management.py1605 # Check if total size matchesCOMMENT
LOWlmcache/v1/cache_engine.py461 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/cache_engine.py647 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/config_base.py583 # Check if this configuration class has definitions with convertersCOMMENT
LOWlmcache/v1/pin_monitor.py134 # Check if object is still pinned and has exceeded timeoutCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py309 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py318 # Check if the blocks are coalescedCOMMENT
LOW…/v1/memory_allocators/paged_tensor_memory_allocator.py322 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/lookup_client/lmcache_async_lookup_client.py165 # Check if any aborted lookups are finished, send cleanup messagesCOMMENT
LOWlmcache/v1/lookup_client/factory.py60 # Check if external_lookup_client is configuredCOMMENT
LOWlmcache/v1/lookup_client/factory.py78 # Check if bypass lookup is enabled and lmcache_engine is providedCOMMENT
LOWlmcache/v1/distributed/l2_adapters/factory.py127 # Check if the name is now registeredCOMMENT
LOW…1/mp_observability/subscribers/metrics/l1_lifecycle.py119 # Check if this is a reuse of an evicted chunk.COMMENT
LOWlmcache/v1/cache_controller/config.py128 # Check if this field has an env_converter in the definitionsCOMMENT
LOWlmcache/v1/cache_controller/controller_manager.py319 # Check if POLLIN flag is set (indicates readable/pending messages)COMMENT
LOWlmcache/v1/cache_controller/commands/full_sync.py43 # Check if full sync is already in progressCOMMENT
LOW…ache_controller/controllers/registration_controller.py231 # Check if full sync is needed (e.g., controller restart)COMMENT
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py146 # Check if already syncing with different sync_idCOMMENT
LOW…cache/v1/cache_controller/controllers/kv_controller.py154 # Check if worker is currently in full syncCOMMENT
LOWlmcache/v1/health_monitor/base.py498 # Check if we have any health checks that need to runCOMMENT
LOWlmcache/v1/storage_backend/remote_backend.py349 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py401 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py555 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/gds_backend.py1066 # Check if file is large enough for the requested readCOMMENT
LOWlmcache/v1/storage_backend/batched_message_sender.py109 # Check if we have messages to process while holding the lockCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py461 # Check if io_uring is enabled for fixed buffer supportCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py475 # Check if lazy memory allocator should be enabledCOMMENT
LOWlmcache/v1/storage_backend/nixl_storage_backend.py1918 # Check if already in progressCOMMENT
LOWlmcache/v1/storage_backend/raw_block/core.py1011 # Check if the buffer pointer is alignedCOMMENT
LOWlmcache/v1/storage_backend/connector/audit_connector.py46 # Check if method is marked with @NotAuditCOMMENT
15 more matches not shown…
Modern Structural Boilerplate91 hits · 93 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_health_monitor_fallback_recovery.py41 def set_ping_error_code(self, error_code: int) -> None:CODE
LOWtests/v1/test_musa_support.py77 def set_device(self, _idx: int) -> None:CODE
LOWtests/v1/test_health_monitor.py45 def set_healthy(self, healthy: bool) -> None:CODE
LOWtests/v1/distributed/serde/test_async_processor.py174 def set_used_size(self, n: int) -> None:CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py17__all__ = ["InMemoryL2Adapter", "InMemoryL2AdapterConfig"]CODE
LOW…onnector/src/lmc_external_native_connector/__init__.py26__all__ = [CODE
LOWexamples/remote_config_server/config_server.py28logger = logging.getLogger(__name__)CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py359 def _setup_device(self) -> None:CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py755 def _setup_device(self) -> None:CODE
LOW.buildkite/correctness/async_request.py16logger = logging.getLogger(__name__)CODE
LOWlmcache/python_ops_fallback.py384def set_shape_desc_dtype(shape_desc: Any, dtype: torch.dtype) -> None:CODE
LOWlmcache/usage_context.py16__all__ = [CODE
LOWlmcache/__init__.py24__all__ = ["__version__", "torch_dev", "torch_device_type"]CODE
LOWlmcache/v1/memory_management.py299 def set_used_size(self, n: int) -> None: # noqa: B027CODE
LOWlmcache/v1/memory_management.py702 def set_used_size(self, n: int) -> None:CODE
LOWlmcache/v1/cache_engine.py248 def set_health_monitor(self, health_monitor: "HealthMonitor") -> None:CODE
LOWlmcache/v1/cache_engine.py362 def set_hot_cache(self, enabled: bool) -> None:CODE
LOWlmcache/v1/multiprocess/session.py47 def set_tokens(self, full_token_ids: list[int]) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py59 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py193 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/posix_shm.py45logger = logging.getLogger(__name__)CODE
LOWlmcache/v1/multiprocess/transfer_context/__init__.py29__all__ = [CODE
LOWlmcache/v1/multiprocess/modules/p2p_controller.py566 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/modules/lookup.py598 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/protocols/__init__.py125__all__ = [CODE
LOWlmcache/v1/offload_server/__init__.py11__all__ = [CODE
LOW…che/v1/lookup_client/chunk_statistics_lookup_client.py195 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/lookup_client/__init__.py17__all__ = [CODE
LOWlmcache/v1/lookup_client/record_strategies/__init__.py56__all__ = [CODE
LOWlmcache/v1/distributed/quota_manager.py52 def set_quota(self, cache_salt: str, limit_bytes: int) -> None:CODE
LOWlmcache/v1/distributed/quota_manager.py88 def set_default_limit_bytes(self, limit_bytes: int | None) -> None:CODE
LOWlmcache/v1/distributed/memory_manager/__init__.py24__all__ = [CODE
LOWlmcache/v1/distributed/eviction_policy/__init__.py20__all__ = [CODE
LOWlmcache/v1/distributed/storage_controllers/__init__.py36__all__ = [CODE
LOWlmcache/v1/distributed/bitmap_ops/__init__.py21__all__ = [CODE
LOWlmcache/v1/distributed/transfer_channel/__init__.py30__all__ = [CODE
LOW…ache/v1/distributed/l2_adapters/hfbucket_l2_adapter.py874 def _set_cached_object_size_locked(self, object_path: str, size: int) -> None:CODE
LOWlmcache/v1/distributed/l2_adapters/__init__.py64__all__ = [CODE
LOWlmcache/v1/distributed/serde/__init__.py39__all__ = [CODE
LOWlmcache/v1/distributed/serde/turboquant/__init__.py11__all__ = [CODE
LOWlmcache/v1/mp_observability/trace/decorator.py49def set_tracing_enabled(enabled: bool) -> None:CODE
LOWlmcache/v1/mp_observability/trace/__init__.py39__all__ = [CODE
LOWlmcache/v1/mp_observability/subscribers/__init__.py18__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/metrics/__init__.py46__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/tracing/__init__.py18__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/logging/__init__.py19__all__ = [CODE
LOWlmcache/v1/cache_controller/__init__.py6__all__ = [CODE
LOWlmcache/v1/cache_controller/utils.py187 def update_seq_num(self, location: str, seq_num: int) -> None:CODE
LOWlmcache/v1/cache_controller/commands/__init__.py12__all__ = [CODE
LOWlmcache/v1/cache_controller/controllers/__init__.py8__all__ = [CODE
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py71 def set_need_full_sync_all(self, need: bool) -> None:CODE
LOW…cache/v1/cache_controller/controllers/kv_controller.py74 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/platform/cpu/shm.py43__all__ = [CODE
LOWlmcache/v1/platform/cpu/stub_cpu_device.py282 def set_stream(self, stream: StubStream) -> None:CODE
LOWlmcache/v1/platform/cpu/stub_cpu_device.py306 def set_device(self, device: Any) -> None:CODE
LOWlmcache/v1/health_monitor/base.py271 def _set_healthy(self, healthy: bool) -> None:CODE
LOWlmcache/v1/compute/attention/triton_kernels/__init__.py9__all__ = [CODE
LOWlmcache/v1/compute/blend/__init__.py5__all__ = [CODE
LOWlmcache/v1/storage_backend/remote_backend.py105 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/storage_backend/storage_manager.py292 def _setup_metrics(self) -> None:CODE
31 more matches not shown…
Modern AI Meta-Vocabulary26 hits · 84 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md29- [2026/05] 🔥 Agentic workload benchmark on AMD MI300X ([blog](https://blog.lmcache.ai/en/2026/05/12/benchmarking-lmcachCODE
MEDIUMtests/v1/distributed/serde/test_asym_k16_v8_multi.py32# Test scaffolding (mirrors the _FakeMemoryObj in test_multi.py / test_fp8.py)COMMENT
MEDIUMtests/v1/distributed/serde/test_multi.py50# Test scaffolding: a minimal MemoryObj stand-in mirroring test_fp8.py.COMMENT
MEDIUMdocs/design/v1/gpu_connector/layout-invariant.md42├── detection.py # detect_format() orchestrationCODE
MEDIUMbenchmarks/rag/README.md1# Benchmarking LLM Performance: RAG Use CaseCOMMENT
MEDIUMbenchmarks/rag/README.md16## Running the RAG BenchmarkCOMMENT
MEDIUMlmcache/cli/commands/bench/server_bench/command.py51# orchestration safe.COMMENT
MEDIUMoperator/AGENTS.md354Do NOT delete `// +kubebuilder:scaffold:*` comments. CLI injects code at these markers.CODE
MEDIUMoperator/AGENTS.md388### Deploy Image Plugin (scaffold to deploy/manage ANY container image)COMMENT
MEDIUMoperator/cmd/main.go44 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/cmd/main.go57 // +kubebuilder:scaffold:schemeCOMMENT
MEDIUMoperator/cmd/main.go175 // In the default scaffold provided, the program ends immediately afterCOMMENT
MEDIUMoperator/cmd/main.go221 // +kubebuilder:scaffold:builderCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go168 // +kubebuilder:scaffold:e2e-metrics-webhooks-readinessCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go208 // +kubebuilder:scaffold:e2e-webhooks-checksCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml8# +kubebuilder:scaffold:crdkustomizeresourceCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml13# +kubebuilder:scaffold:crdkustomizewebhookpatchCOMMENT
MEDIUMoperator/config/default/kustomization.yaml225# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUMoperator/config/default/kustomization.yaml226# +kubebuilder:scaffold:crdkustomizecainjectionnsCOMMENT
MEDIUMoperator/config/default/kustomization.yaml233# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUMoperator/config/default/kustomization.yaml234# +kubebuilder:scaffold:crdkustomizecainjectionnameCOMMENT
MEDIUMoperator/config/samples/vllm_cacheblend_deployment.yaml1# Sample vLLM Deployment that OPTS IN to CacheBlend dependency injection.COMMENT
MEDIUMoperator/config/samples/kustomization.yaml6# +kubebuilder:scaffold:manifestskustomizesamplesCOMMENT
MEDIUMoperator/config/samples/vllm_lmcache_deployment.yaml1# Sample vLLM Deployment that OPTS IN to LMCacheEngine dependency injection.COMMENT
MEDIUMoperator/internal/controller/suite_test.go38 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/internal/controller/suite_test.go70 // +kubebuilder:scaffold:schemeCOMMENT
AI Slop Vocabulary19 hits · 60 pts
SeverityFileLineSnippetContext
MEDIUMtests/v1/test_mp_mem_kernels.py25# Tensor factories (ported from kernel harness)COMMENT
MEDIUMtests/cli/commands/trace/test_driver.py267 # the test robust against future decorator additions.COMMENT
MEDIUM.github/workflows/operator_release.yml51 # so behavior is robust whether or not that box is ticked in the UI.COMMENT
MEDIUM.buildkite/pipelines/comprehensive-tests.yml9 - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Skip comprehensive tests for safe-path-only PRs.CODE
MEDIUM.buildkite/pipelines/multiprocessing-test.yml9 - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Reuse the trigger condition for comprehensive testsCODE
MEDIUM.buildkite/k3_harness/setup-env.sh284# harness. Re-probe the full chain here so broken envs fail fast with theCOMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh17# 2. Plugin-harness dep not in the LMCache/vLLM dependency closure.COMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh59# server-boot timeout inside the harness.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh4# Decide whether comprehensive tests should run for this build.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh6# 0 -> run comprehensive testsCOMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh7# 1 -> skip comprehensive tests (safe paths only)COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh9# If this isn't a PR build, always run comprehensive tests.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh70 # Non-safe file touched -> run comprehensive tests.COMMENT
MEDIUM…dkite/k3_tests/multiprocess/scripts/run-single-test.sh9# This mirrors the comprehensive tests' run-single-config.sh pattern.COMMENT
MEDIUM…ite/k3_tests/comprehensive/scripts/upload-baselines.sh3# Runs AFTER all comprehensive config steps complete (via `wait`).COMMENT
LOWlmcache/v1/memory_management.py1049 # so just return None hereCOMMENT
LOW…cache/v1/memory_allocators/cu_file_memory_allocator.py21 # layer - for now just use the current device.COMMENT
MEDIUMlmcache/v1/gpu_connector/utils.py749 # Also accept [P,2,B,H,D] (or [NB,2,BS,NH,HS]) to be more robust.COMMENT
MEDIUMlmcache/cli/commands/bench/l2_adapter_bench/command.py450 # the one-time tensor allocation + fill (benchmark harness work,COMMENT
Cross-Language Confusion5 hits · 18 pts
SeverityFileLineSnippetContext
HIGHtests/v1/shm_allocator/verify_shmfile_tcp.py15 mkdir -p tests/v1/shm_allocator/csrc/build && cd tests/v1/shm_allocator/csrc/buildSTRING
HIGHlmcache/v1/cache_controller/worker.py643 self.push(),CODE
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py1352 self.pool.push(metadata.index)CODE
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py346 # "locations": null, "request_configs": null}STRING
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py354 # "request_configs": null}STRING
Example Usage Blocks8 hits · 13 pts
SeverityFileLineSnippetContext
LOWtests/v1/shm_allocator/shmfile_basic_check.yaml3# Usage:COMMENT
LOW…es/lmc_external_l2_adapter/scripts/install_and_test.sh7# Usage:COMMENT
LOW.github/scripts/download_model.sh8# Usage:COMMENT
LOW.github/scripts/install_lmcache_cpu.sh9# Usage:COMMENT
LOW.github/scripts/install_vllm_cpu.sh16# Usage:COMMENT
LOW.buildkite/k3_harness/install-agent-stack.sh4# Usage:COMMENT
LOW.buildkite/k3_harness/resolve-pinned-vllm.sh25# Usage:COMMENT
LOW.buildkite/k3_tests/common_scripts/path-filter.sh5# Usage:COMMENT
AI Structural Patterns11 hits · 10 pts
SeverityFileLineSnippetContext
LOWtests/cli/commands/bench/engine_bench/test_stats.py25CODE
LOW…che/v1/distributed/l2_adapters/aerospike_l2_adapter.py48CODE
LOW…che/v1/distributed/l2_adapters/raw_block_l2_adapter.py69CODE
LOW…/v1/storage_backend/native_clients/aerospike_client.py22CODE
LOWlmcache/v1/storage_backend/connector/eic_connector.py423CODE
LOW…cache/v1/storage_backend/connector/valkey_connector.py385CODE
LOWlmcache/v1/kv_codec/asym_k16_v8.py271CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py199CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py317CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py674CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py907CODE
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICALlmcache/v1/storage_backend/connector/azure_connector.py145 from azure.core.exceptions import ResourceNotFoundErrorCODE
TODO Padding4 hits · 6 pts
SeverityFileLineSnippetContext
LOWlmcache/v1/memory_management.py857 # TODO: consider using one of the alternativesCOMMENT
LOWlmcache/v1/multiprocess/mq.py485 # TODO: implement this in the future versions if neededCOMMENT
LOWlmcache/v1/storage_backend/gds_backend.py528 # TODO: implement pin() semanticsCOMMENT
LOWlmcache/cli/commands/query/kvcache_command.py24 # TODO: implement kvcache query logicCOMMENT
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUM.github/workflows/codeql.yml59 # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize howCOMMENT
Fake / Example Data2 hits · 2 pts
SeverityFileLineSnippetContext
LOWbenchmarks/multi_doc_qa/shuffle_doc_qa.py263 api_key="dummy-key",CODE
LOWbenchmarks/ttft-estimator/ttft-estimator.py37client = OpenAI(api_key="dummy-key", base_url="http://localhost:8000/v1")CODE
Overly Generic Function Names1 hit · 1 pts
SeverityFileLineSnippetContext
LOWlmcache/v1/cache_controller/worker.py529 async def handle_request(self):CODE