AI Slop Code RIsk Monitor

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

36.6 High pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for LMCache/LMCache, a Python project with 11,998 GitHub stars. SynthScan examined 563,566 lines of code across 2210 source files, recording 12389 pattern matches distributed across 25 syntactic categories. The legacy adjusted pattern signal is 36.6 (High pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

36.6
Adjusted Signal
36.6
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
12.0K
Stars
Python
Language
563.6K
Lines of Code
2.2K
Files
12.4K
Pattern Hits
2026-10-12
Scan Date
0.29
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 57.5/100 · HIGH

Can maintainers explain intent, assumptions, and trade-offs? 8083 finding(s).

Hallucinated Dependency & Supply Chain Risk 7.7/100 · LOW

Are imports declared and package/API names verified? 878 finding(s).

Agent Over-Engineering Ratio 76.7/100 · CRITICAL

Are wrappers, guards, and repeated structures necessary? 10015 finding(s).

PR Review Velocity Impact 83.3/100 · CRITICAL

Which changes need focused human review? 12389 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 3HIGH 636MEDIUM 2301LOW 9449

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 12389 distinct pattern matches across 25 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Decorative Section Separators2112 hits · 7675 pts
SeverityFileLineSnippetContext
MEDIUM⚡tests/test_utils.py511# ============================================================COMMENT
MEDIUM⚡tests/test_utils.py513# ============================================================COMMENT
MEDIUMtests/test_utils.py28# ============================================================COMMENT
MEDIUMtests/test_utils.py30# ============================================================COMMENT
MEDIUMtests/test_utils.py76# ============================================================COMMENT
MEDIUMtests/test_utils.py78# ============================================================COMMENT
MEDIUMtests/test_utils.py203# ============================================================COMMENT
MEDIUMtests/test_utils.py205# ============================================================COMMENT
MEDIUMtests/test_utils.py226# ============================================================COMMENT
MEDIUMtests/test_utils.py228# ============================================================COMMENT
MEDIUMtests/test_utils.py249# ============================================================COMMENT
MEDIUMtests/test_utils.py251# ============================================================COMMENT
MEDIUMtests/test_utils.py409# ============================================================COMMENT
MEDIUMtests/test_utils.py411# ============================================================COMMENT
MEDIUM⚡tests/v1/test_health_monitor_fallback_recovery.py186# ==============================================================================COMMENT
MEDIUM⚡tests/v1/test_health_monitor_fallback_recovery.py188# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py94# ==============================================================================COMMENT
MEDIUMtests/v1/test_health_monitor_fallback_recovery.py96# ==============================================================================COMMENT
MEDIUM⚡tests/v1/test_torch_ops.py128# ==========================================COMMENT
MEDIUM⚡tests/v1/test_torch_ops.py130# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py26# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py28# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py54# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py56# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3034# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3036# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3065# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3067# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3163# ==========================================COMMENT
MEDIUMtests/v1/test_torch_ops.py3165# ==========================================COMMENT
MEDIUMtests/v1/test_musa_support.py38# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_musa_support.py40# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py89# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py91# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py169# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py171# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py303# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_musa_support.py305# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_nixl_batched_contains.py396# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_nixl_batched_contains.py398# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py29# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py31# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py75# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py77# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py169# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py171# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py228# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_nixl_batched_contains.py230# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_device_id_race.py25# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_mp_mem_kernels.py30# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_mp_mem_kernels.py32# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py249# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py251# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py298# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py300# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py533# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/v1/test_mp_mem_kernels.py541# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡tests/v1/test_decode_save_and_preemption.py216# ===========================================================================COMMENT
MEDIUM⚡tests/v1/test_decode_save_and_preemption.py218# ===========================================================================COMMENT
2052 more matches not shown…
Hyper-Verbose Identifiers6570 hits · 6319 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py257def clean_translation_response(text: str) -> str:CODE
LOW⚡tests/test_utils.py171 def test_nested_brackets_error(self):CODE
LOW⚡tests/test_utils.py177 def test_unmatched_closing_bracket(self):CODE
LOW⚡tests/test_utils.py187 def test_invalid_range_start_gt_end(self):CODE
LOW⚡tests/test_utils.py312 def test_from_string_roundtrip(self, basic_key):CODE
LOW⚡tests/test_utils.py317 def test_from_string_with_tags_roundtrip(self, key_with_tags):CODE
LOW⚡tests/test_utils.py326 def test_from_string_invalid_tag_format(self):CODE
LOW⚡tests/test_utils.py330 def test_to_dict_and_from_dict(self, basic_key):CODE
LOW⚡tests/test_utils.py340 def test_from_dict_invalid_tag(self):CODE
LOW⚡tests/test_utils.py515 def test_parse_cache_engine_key(self):CODE
LOWtests/test_utils.py41 def test_numerator_smaller_than_denominator(self):CODE
LOWtests/test_utils.py90 def test_three_or_more_consecutive(self):CODE
LOWtests/test_utils.py98 def test_non_consecutive_order_preserved(self):CODE
LOWtests/test_utils.py124 def test_three_or_more_elements(self):CODE
LOWtests/test_utils.py288 def test_not_equal_different_hash(self, basic_key):CODE
LOWtests/test_utils.py298 def test_not_equal_different_type(self, basic_key):CODE
LOWtests/test_utils.py375 def test_chunk_hash_hex_bytes(self):CODE
LOWtests/test_utils.py387 def test_unsupported_dtype_raises(self):CODE
LOWtests/test_utils.py397 def test_no_tags_when_no_tag_prefix(self):CODE
LOWtests/test_utils.py424 def test_hash_includes_layer_id(self, layer_key):CODE
LOWtests/test_utils.py447 def test_eq_different_base_key(self, layer_key):CODE
LOWtests/test_utils.py477 def test_from_string_roundtrip(self, layer_key):CODE
LOWtests/test_utils.py482 def test_from_string_with_tags(self):CODE
LOWtests/test_utils.py500 def test_from_string_invalid_tag(self):CODE
LOWtests/test_utils.py531 def test_parse_layer_cache_engine_key(self):CODE
LOWtests/test_utils.py549 def test_parse_cache_key_without_tags(self):CODE
LOWtests/test_utils.py564 def test_parse_cache_key_with_tags(self):CODE
LOWtests/test_utils.py583 def test_parse_layer_cache_key_without_tags(self):CODE
LOWtests/test_utils.py598 def test_parse_layer_cache_key_with_tags(self):CODE
LOWtests/test_utils.py616 def test_roundtrip_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py636 def test_roundtrip_cache_engine_key_with_tags(self):CODE
LOWtests/test_utils.py659 def test_roundtrip_layer_cache_engine_key_without_tags(self):CODE
LOWtests/test_utils.py680 def test_roundtrip_layer_cache_engine_key_with_tags(self):CODE
LOWtests/test_observability.py32def test_on_retrieve_finished(stats_monitor):CODE
LOW⚡tests/test_observability.py44def test_on_store_request_and_finished(stats_monitor):CODE
LOW⚡tests/test_observability.py52def test_update_local_cache_usage(stats_monitor):CODE
LOW⚡tests/test_observability.py58def test_update_remote_cache_usage(stats_monitor):CODE
LOW⚡tests/test_observability.py64def test_update_local_storage_usage(stats_monitor):CODE
LOWtests/test_observability.py104def test_remote_write_metrics(stats_monitor):CODE
LOWtests/test_observability.py143def test_retrieve_and_store_speed(stats_monitor):CODE
LOWtests/test_observability.py161def test_multiple_lookup_operations(stats_monitor):CODE
LOWtests/test_observability.py180def test_mixed_remote_operations(stats_monitor):CODE
LOWtests/test_observability.py273def test_zero_division_protection(stats_monitor):CODE
LOWtests/test_observability.py284def _cleanup_prometheus_logger():CODE
LOWtests/test_observability.py318def test_prometheus_logger_default_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py326def test_prometheus_logger_custom_buckets(_cleanup_prometheus_logger):CODE
LOWtests/test_observability.py346def test_prometheus_logger_partial_custom_buckets(CODE
LOWtests/test_observability.py373def test_prometheus_logger_get_or_create_with_config(CODE
LOWtests/test_observability.py393def test_prometheus_logger_get_or_create_allows_multiple_roles(CODE
LOWtests/test_observability.py408def test_prometheus_logger_label_view_rebinds_dynamic_metrics(CODE
LOWtests/test_observability.py438def test_prometheus_logger_reset_reinitializes_all_label_views(CODE
LOWtests/test_banner.py35def test_banner_contains_version_links_and_opt_out_hint():CODE
LOW⚡tests/test_banner.py46def test_banner_is_plain_on_non_tty_stream():CODE
LOW⚡tests/test_banner.py52def test_banner_is_colored_on_tty_stream():CODE
LOW⚡tests/test_banner.py60def test_banner_prints_at_most_once_per_process():CODE
LOW⚡tests/test_banner.py70def test_banner_disabled_by_env_var(monkeypatch, value):CODE
LOW⚡tests/test_banner.py77def test_banner_not_disabled_by_falsy_env_var(monkeypatch):CODE
LOWtests/test_build_profiles_rocm.py64def test_hipify_wrapper_returns_paths_relative_to_project_root(CODE
LOWtests/test_build_profiles_rocm.py81def test_hipify_wrapper_copies_headers_into_the_output_tree(CODE
LOWtests/test_build_profiles_rbln.py17def test_detects_an_importable_torch_rbln(CODE
6510 more matches not shown…
Docstring Block Structure357 hits · 1785 pts
SeverityFileLineSnippetContext
HIGHtests/v1/mp_coordinator/mp_server_harness.py159Serve a coordinator on a thread for the duration of the block. Args: config: Its configuration; :func:`coorSTRING
HIGHtests/v1/multiprocess/transport_test_utils.py38Build a request-server config from a loopback test URL. Args: transport: Request transport to exercise. STRING
HIGHtests/v1/distributed/test_memory_capacity.py170Build a config whose derived capacity equals ``capacities``. Args: capacities: The per-medium result the coSTRING
HIGHtests/v1/storage_backend/test_raw_block_core.py119Record and submit a batch through the wrapped Rust implementation. Args: offsets: Device byte offseSTRING
HIGHsetup_extensions/storage_backend_profiles/nixl.py29Build the isolated C++20 ``lmcache_nixl`` extension. Args: extra_cxx_flags: Platform-specific compiSTRING
HIGHsetup_extensions/build_profiles/rocm.py28Hipify ``csrc/cuda`` and return paths for the requested source files. Args: source_names: Base names of theSTRING
HIGHexamples/token_dropping/utils.py163Move key cache RoPE from old positions to new positions. Args: kv_tensor: The KV cache tensor of shape [2, LSTRING
HIGHexamples/token_dropping/utils.py234Score generated responses against ground-truth choice letters. Args: ground_truth: list of ground-truth letSTRING
HIGHbenchmarks/long_doc_qa/long_doc_qa.py333 Repeat each prompt in the list for a specified number of times. The order of prompts in the output list dependsSTRING
HIGH…sts/multiprocess/scripts/workloads/vllm/hma-lm-eval.sh184Return the gsm8k (exact_match, stderr) from an lm_eval results directory. Prefers the strict-match variant; falls bSTRING
HIGHlmcache/v1/memory_management.py1423 Allocate a block of memory from the virtual address space of a given size. The actual allocated size coSTRING
HIGHlmcache/v1/memory_management.py1479 Allocate blocks of memory from the virtual address space of a given size and batch size. The actual allSTRING
HIGHlmcache/v1/hidden_state_store.py123Store hidden_states chunked under the same keys as KV. Args: token_ids: 1-D int tensor or list of tSTRING
HIGHlmcache/v1/kv_layer_groups.py83Partition layer indices by :data:`LayerGroupIdentity`. Args: kv_caches: Registered KV cache structure, one STRING
HIGHlmcache/v1/kv_layer_groups.py644Calculate the number of blocks for a given number of tokens in a specified kernel group. Args: STRING
HIGHlmcache/v1/protocol.py104Pad a shape with fewer than 4 dimensions to 4D using trailing zeros. Shapes that are already 4D are returned asSTRING
HIGHlmcache/v1/config_base.py51Parse local disk path configuration. Accepts a single path or comma-separated paths, each optionally prefixed wSTRING
HIGHlmcache/v1/rpc_utils.py185Keep an IPC socket path within the ``sockaddr_un`` length limit. The descriptive path is preferred for readability/STRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py98Allocate one object from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shape or sSTRING
HIGHlmcache/v1/memory_allocators/mixed_memory_allocator.py139Allocate multiple objects from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shapSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py99Allocate from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape or shapesSTRING
HIGH…v1/memory_allocators/paged_cpu_gpu_memory_allocator.py128Allocate a batch from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape oSTRING
HIGHlmcache/v1/memory_allocators/lazy_memory_allocator.py28 Get the NUMA ID for the current GPU Args: numa_mapping (NUMAMapping): The NUMA mapping object. ReSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py280Map one Device-DAX device and append it to the pool as ACTIVE. The caller must hold ``host_mem_lock`` (except dSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py753Map an additional Device-DAX device and add it to the pool. The new arena is immediately available as overflow;STRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py804Retire a Device-DAX arena from the pool. The arena stops accepting new allocations. If it has no live allocatioSTRING
HIGHlmcache/v1/memory_allocators/devdax_memory_allocator.py841Return the status of the arena registered at ``device_path``. Args: device_path: The exact path useSTRING
HIGHlmcache/v1/mp_coordinator/discovery.py62Return the instance of ``member_type``, building it once. Args: member_type: The class to look up. STRING
HIGHlmcache/v1/mp_coordinator/discovery.py153Yield the ``base`` subclasses the named modules define. A name may address a package -- walked entire, subpackages STRING
HIGHlmcache/v1/mp_coordinator/schemas.py50Decode a base64 token string produced by :func:`encode_tokens`. Args: tokens_b64: Base64 of a little-endianSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py297Enforce encoding-level constraints on every entry. Args: value: The hydrated batches. RetuSTRING
HIGHlmcache/v1/mp_coordinator/schemas.py361Reject undecodable keys at request validation (surfaced as 422). Args: value: The hydrated keys. STRING
HIGHlmcache/v1/mp_coordinator/schemas.py481Reject a malformed token buffer at request validation. Validating here returns 422 rather than the 500 a decodeSTRING
HIGHlmcache/v1/mp_coordinator/blend_client.py166Build a started client for ``url``; an empty URL returns ``None``. Args: url: Coordinator base URL;STRING
HIGHlmcache/v1/mp_coordinator/cache_events.py753Create the configured MP-server cache-event transport. Args: config: Coordinator connection and event-sink STRING
HIGHlmcache/v1/mp_coordinator/registrar.py45Register an MP server with the coordinator and return its id. Args: client: The HTTP client to send with. STRING
HIGHlmcache/v1/mp_coordinator/events_replay.py132Read one or more ``events``-level files into one stream. Args: paths: The files, typically one per STRING
HIGHlmcache/v1/mp_coordinator/events_replay.py265``POST /events`` with one batch. Args: batch: The batch in wire form, one element of a STRING
HIGHlmcache/v1/mp_coordinator/events_replay.py380Deliver every record of ``trace`` to ``target``, in order, logging each one. Args: trace: The stream. STRING
HIGHlmcache/v1/mp_coordinator/ingest/event_gate.py140Offer ``batches`` to the gate in list order. Args: batches: Event batches ordered by their source. STRING
HIGHlmcache/v1/mp_coordinator/utils/encoding.py32Rebuild a key from :func:`encode_key`. Args: encoded: An :func:`encode_key` value, as read back from an STRING
HIGHlmcache/v1/mp_coordinator/http_apis/events_api.py28Offer a list of cache-event batches to the ingest gate. Batches are offered in list order; per instance they must bSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/metrics_api.py16Return Prometheus metrics when the coordinator uses pull mode. Args: request: Incoming request carrying theSTRING
HIGH…che/v1/mp_coordinator/http_apis/instances_usage_api.py201Return one MP server's memory status. Args: instance_id: The server to report on. request: Carries STRING
HIGHlmcache/v1/mp_coordinator/http_apis/directory_api.py43Resolve keys — or a request's token sequence — to placements. The tokens form hashes ``token_ids`` with the fleet'sSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py51Submit a warm prefetch of a token sequence on one MP server. Resolves ``body.instance_id`` in the registry and proxSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py105Proxy a warm-prefetch status poll to the owning MP server. The warm holds no lock, so this poll only reports progreSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/cache_api.py152Delete a token sequence on one MP server, per ``body.tier`` (l1 / l2 / all). Args: body: Target instance, mSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py69Return the per-app :class:`CoordinatorContext`. Args: request: The FastAPI request whose ``app.state`` carrSTRING
HIGHlmcache/v1/mp_coordinator/http_apis/dependencies.py88Return the lifespan-bound outbound client, or raise if unset. Args: request: The FastAPI request. RetuSTRING
HIGHlmcache/v1/mp_coordinator/persistence/metadata.py127Parse a document and check its shape. Args: raw: The stored bytes. Returns: ThSTRING
HIGHlmcache/v1/mp_coordinator/persistence/checkpoint.py151Decode a checkpoint written by :func:`_write_checkpoint`. Args: stream: Positioned at the start of the checSTRING
HIGHlmcache/v1/mp_coordinator/persistence/quiesce.py77Hold while capturing; no batch is applied for the duration. Args: timeout: Seconds to wait for in-fSTRING
HIGH…che/v1/mp_coordinator/controllers/eviction_http_api.py295Pin a token sequence's keys in the L2 eviction plan. The coordinator resolves the token sequence to its object STRING
HIGH…che/v1/mp_coordinator/controllers/eviction_http_api.py332Unpin a token sequence's keys from the L2 eviction plan. Symmetric with pin: resolves the keys locally and releSTRING
HIGHlmcache/v1/mp_coordinator/controllers/__init__.py39Discover and construct every controller available to the coordinator. Args: config: Passed to each ``from_cSTRING
HIGHlmcache/v1/mp_coordinator/controllers/__init__.py77Return the names an operator listed under ``key``, validated. Args: extra_config: The coordinator's untypedSTRING
HIGHlmcache/v1/mp_coordinator/controllers/__init__.py107Drop the controllers an operator asked not to be built. Naming a class here is how a built-in controller gets out oSTRING
HIGH…ache/v1/mp_coordinator/controllers/prefetch_manager.py45``POST /cache/prefetches`` to ``target`` and return its JSON reply. Args: target: The MP server to STRING
HIGH…ache/v1/mp_coordinator/controllers/prefetch_manager.py82Proxy ``GET /cache/prefetches/{request_id}`` on ``target``. Args: target: The MP server holding theSTRING
297 more matches not shown…
Excessive Try-Catch Wrapping936 hits · 952 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py501 except Exception as e:CODE
LOWtests/conftest.py689 except Exception as e:CODE
LOW⚡tests/conftest.py779 except Exception as e:CODE
MEDIUM⚡tests/conftest.py781 print("Error during close obj:%s - %s", obj, e)CODE
LOWtests/conftest.py917 except Exception as e:CODE
LOWtests/v1/test_nixl_storage.py59 except Exception as exc:CODE
LOWtests/v1/test_nixl_storage.py264 except Exception:CODE
MEDIUMtests/v1/test_address_manager.py901def alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py914def free_worker():CODE
MEDIUMtests/v1/test_address_manager.py1071def batch_alloc_worker():CODE
MEDIUMtests/v1/test_address_manager.py1083def free_worker():CODE
LOWtests/v1/test_address_manager.py817 except Exception as e:CODE
LOWtests/v1/test_address_manager.py864 except Exception as e:CODE
LOWtests/v1/test_address_manager.py911 except Exception as e:CODE
LOWtests/v1/test_address_manager.py923 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1003 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1040 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1080 except Exception as e:CODE
LOWtests/v1/test_address_manager.py1092 except Exception as e:CODE
MEDIUMtests/v1/utils.py197 print(f"Error during close pending tasks: - {e}")CODE
LOWtests/v1/utils.py47 except Exception:CODE
LOWtests/v1/utils.py70 except Exception:CODE
LOWtests/v1/utils.py103 except Exception:CODE
LOWtests/v1/utils.py123 except Exception:CODE
LOWtests/v1/utils.py196 except Exception as e:CODE
LOWtests/v1/test_fused_rerope.py22except Exception: # allow running as a plain script (bench) without pytestCODE
LOWtests/v1/test_fused_rerope.py36except Exception: # CPU-only / no built cuda_ops (e.g. the unit-test runner)CODE
LOWtests/v1/test_remote_mla_worker_id_as0.py181 except Exception as e:CODE
MEDIUMtests/v1/test_remote_mla_worker_id_as0.py182 print(f"Error during shutdown: {e}")CODE
MEDIUMtests/v1/test_atom_mp_adapter.py615def submit() -> None:CODE
LOWtests/v1/test_atom_mp_adapter.py771 except Exception as error:CODE
MEDIUMtests/v1/multiprocess/test_session.py231def writer() -> None:CODE
LOWtests/v1/multiprocess/test_session.py200 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py228 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_session.py236 except Exception as exc:CODE
LOWtests/v1/multiprocess/test_cache_server.py48 except Exception:CODE
LOW⚡tests/v1/multiprocess/test_cache_server.py385 except Exception as e:CODE
MEDIUM⚡tests/v1/multiprocess/test_cache_server.py386 print(f"Error during unregister: {e}")CODE
MEDIUMtests/v1/multiprocess/test_cache_server.py43def _has_working_new_shared_cuda() -> bool:CODE
LOWtests/v1/multiprocess/test_futures.py26 except Exception:CODE
LOWtests/v1/multiprocess/test_custom_types.py193 except Exception as e:CODE
LOWtests/v1/multiprocess/test_custom_types.py315 except Exception as e:CODE
LOWtests/v1/multiprocess/test_mq.py222 except Exception as e:CODE
LOW…1/lookup_client/test_chunk_statistics_lookup_client.py320 except Exception:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py77 except Exception as e:CODE
LOW…sts/v1/distributed/test_native_connector_l2_adapter.py103 except Exception as e:CODE
LOW…s/v1/distributed/test_valkey_l2_adapter_integration.py129 except Exception:CODE
LOW…s/v1/distributed/test_valkey_l2_adapter_integration.py138 except Exception:CODE
LOW…v1/distributed/test_bigtable_l2_adapter_integration.py87 except Exception:CODE
LOW…v1/distributed/test_bigtable_l2_adapter_integration.py111 except Exception:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py205 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py240 except Exception:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py282 except Exception as e:CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py286 except Exception:CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py47 except Exception:CODE
MEDIUMtests/v1/distributed/test_l1_manager.py1733def worker(thread_id):CODE
LOWtests/v1/distributed/test_l1_manager.py1753 except Exception as e:CODE
LOWtests/v1/distributed/test_l1_manager.py2436 except Exception as e:CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py39 except Exception:CODE
MEDIUMtests/v1/distributed/test_raw_block_l2_adapter.py33def _has_ext() -> bool:CODE
876 more matches not shown…
Empty Error Handlers166 hits · 830 pts
SeverityFileLineSnippetContext
HIGHtests/v1/test_health_monitor_fallback_recovery.py532except asyncio.CancelledError:CODE
HIGHtests/v1/test_torch_ops.py81except ImportError:CODE
HIGHtests/v1/test_torch_ops.py101except (ImportError, RuntimeError):CODE
HIGHtests/v1/test_cuda_ops_parity.py119except ValueError:CODE
HIGHtests/v1/test_cuda_ops_parity.py123except ValueError:CODE
HIGHtests/v1/test_cuda_ops_parity.py283except (ValueError, TypeError):CODE
HIGHtests/v1/test_address_manager.py908except RuntimeError:CODE
HIGHtests/v1/test_address_manager.py1078except RuntimeError:CODE
HIGHtests/v1/test_address_manager.py993except RuntimeError:CODE
HIGHtests/v1/utils.py87except OSError:CODE
HIGHtests/v1/utils.py692except AttributeError:CODE
HIGHtests/v1/utils.py740except (ValueError, TypeError):CODE
HIGHtests/v1/utils.py78except OSError:CODE
HIGHtests/v1/test_nixl_put_refcount.py46except ImportError:CODE
HIGHtests/v1/test_freeze_mode_integration.py108except requests.exceptions.RequestException:CODE
HIGHtests/v1/mp_coordinator/test_integration.py59except requests.RequestException:CODE
HIGH…1/lookup_client/test_chunk_statistics_lookup_client.py320except Exception:CODE
HIGH…sts/v1/distributed/test_native_connector_l2_adapter.py138except BlockingIOError:CODE
HIGH…sts/v1/distributed/test_native_connector_l2_adapter.py159except OSError:CODE
HIGH…sts/v1/distributed/test_native_connector_l2_adapter.py197except BlockingIOError:CODE
HIGHtests/v1/distributed/test_mock_l2_adapter.py94except BlockingIOError:CODE
HIGH…s/v1/distributed/test_valkey_l2_adapter_integration.py80except BlockingIOError:CODE
HIGH…v1/distributed/test_bigtable_l2_adapter_integration.py66except BlockingIOError:CODE
HIGH…v1/distributed/test_bigtable_l2_adapter_integration.py87except Exception:CODE
HIGH…v1/distributed/test_bigtable_l2_adapter_integration.py111except Exception:CODE
HIGHtests/v1/distributed/test_s3_l2_adapter.py360except BlockingIOError:CODE
HIGHtests/v1/distributed/test_s3_l2_adapter.py286except Exception:CODE
HIGHtests/v1/distributed/test_s3_l2_adapter.py240except Exception:CODE
HIGHtests/v1/distributed/test_nixl_store_l2_adapter.py144except BlockingIOError:CODE
HIGHtests/v1/distributed/test_aerospike_l2_integration.py81except BlockingIOError:CODE
HIGH…s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py188except BlockingIOError:CODE
HIGH…/distributed/test_devdax_l1_reconfigure_integration.py98except FileNotFoundError:CODE
HIGHtests/v1/distributed/test_nixl_native_integration.py455except FileNotFoundError:CODE
HIGHtests/v1/distributed/test_hfbucket_l2_adapter.py169except BlockingIOError:CODE
HIGHtests/v1/distributed/test_valkey_l2_adapter.py277except BlockingIOError:CODE
HIGHtests/v1/distributed/test_valkey_l2_adapter.py296except BlockingIOError:CODE
HIGHtests/v1/distributed/test_valkey_l2_adapter.py315except BlockingIOError:CODE
HIGHtests/v1/distributed/test_valkey_l2_adapter.py334except BlockingIOError:CODE
HIGHtests/v1/distributed/test_fault_inject_l2_adapter.py73except BlockingIOError:CODE
HIGHtests/v1/distributed/test_raw_block_l2_adapter.py128except BlockingIOError:CODE
HIGHtests/v1/distributed/test_l2_adapter_factory.py1065except RuntimeError:CODE
HIGHtests/v1/distributed/test_cache_salt_l2_eviction.py83except BlockingIOError:CODE
HIGH…sts/v1/distributed/test_resp_l2_adapter_integration.py97except BlockingIOError:CODE
HIGHtests/v1/distributed/test_mooncake_store_l2_adapter.py127except BlockingIOError:CODE
HIGHtests/v1/distributed/serde/test_async_processor.py67except OSError:CODE
HIGHtests/v1/lmcache_native/test_periodic_event_notifier.py53except BlockingIOError:CODE
HIGHtests/v1/storage_backend/test_hf3fs_connector.py278except Exception:CODE
HIGHtests/v1/storage_backend/test_hf3fs_connector.py282except Exception:CODE
HIGHtests/v1/storage_backend/test_resp_connector.py420except Exception:CODE
HIGHtests/v1/storage_backend/test_nixl_shared_pool.py49except ImportError:CODE
HIGHtests/v1/storage_backend/test_pd_backend_async.py252except Exception:CODE
HIGHtests/v1/storage_backend/test_pd_backend_async.py421except Exception:CODE
HIGHtests/v1/storage_backend/raw_block_test_utils.py189except BlockingIOError:CODE
HIGHtests/v1/storage_backend/raw_block_test_utils.py297except Exception:CODE
HIGHtests/v1/storage_backend/test_bigtable_integration.py98except Exception:CODE
HIGHtests/v1/storage_backend/test_bigtable_integration.py111except Exception:CODE
HIGHtests/v1/storage_backend/test_audit_connector.py74except Exception:CODE
HIGHtests/v1/shm_allocator/shmfile_connector.py302except Exception:CODE
HIGHtests/v1/shm_allocator/shmfile_connector.py307except Exception:CODE
HIGHtests/v1/shm_allocator/verify_shmfile_tcp.py82except FileNotFoundError:CODE
106 more matches not shown…
Unused Imports862 hits · 828 pts
SeverityFileLineSnippetContext
LOWtools/translate_docs_zh.py5CODE
LOWtests/v1/test_vllm_sync_load_pin_cleanup.py25CODE
LOWtests/v1/utils.py122CODE
LOWtests/v1/test_nixl_put_refcount.py42CODE
LOWtests/v1/test_nixl_put_refcount.py43CODE
LOWtests/v1/test_trtllm_integration.py33CODE
LOWtests/v1/mp_coordinator/test_instances_usage_api.py8CODE
LOWtests/v1/mp_coordinator/test_events_replay.py10CODE
LOWtests/v1/multiprocess/test_blend_store.py22CODE
LOWtests/v1/multiprocess/test_blend_store.py24CODE
LOWtests/v1/multiprocess/test_raw_block_l2_adapter.py4CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py393CODE
LOWtests/v1/multiprocess/test_engine_driven_transfer.py756CODE
LOWtests/v1/distributed/conftest.py7CODE
LOWtests/v1/distributed/test_aerospike_l2_integration.py54CODE
LOWtests/v1/distributed/test_memory_capacity.py27CODE
LOWtests/v1/distributed/test_raw_block_l2_adapter.py36CODE
LOWtests/v1/distributed/test_l2_adapter_factory.py35CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py20CODE
LOWtests/v1/distributed/test_storage_manager_l2_keys.py21CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_v_only.py27CODE
LOWtests/v1/distributed/serde/test_asym_k16_v8_multi.py12CODE
LOWtests/v1/distributed/serde/test_multi.py25CODE
LOWtests/v1/mp_observability/test_config.py79CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py13CODE
LOW…v1/platform/devices/npu/test_npu_torch_ops_fallback.py35CODE
LOWtests/v1/platform/devices/npu/test_npu_ipc_wrapper.py248CODE
LOW…sts/v1/platform/devices/npu/test_npu_event_ordering.py27CODE
LOW…s/v1/platform/devices/musa/test_musa_event_ordering.py52CODE
LOWtests/v1/platform/devices/rbln/test_rbln_kv_layout.py26CODE
LOWtests/v1/platform/devices/rbln/test_rbln_kv_layout.py26CODE
LOWtests/v1/storage_backend/test_storage_plugin.py28CODE
LOWtests/v1/storage_backend/test_raw_block_device.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py4CODE
LOWtests/v1/storage_backend/test_rust_raw_block_backend.py51CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py45CODE
LOWtests/v1/storage_backend/test_nixl_shared_pool.py46CODE
LOWtests/v1/storage_backend/test_raw_block_core.py4CODE
LOWtests/v1/storage_backend/raw_block_test_utils.py4CODE
LOWtests/v1/storage_backend/test_raw_block_uring_cmd.py58CODE
LOWtests/cli/commands/trace/test_dispatch.py6CODE
LOWtests/cli/commands/trace/test_driver.py13CODE
LOWtests/cli/commands/trace/test_replay_events_command.py5CODE
LOWsetup_extensions/__init__.py14CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py15CODE
LOWsetup_extensions/__init__.py16CODE
LOWsetup_extensions/common_cpp.py17CODE
LOWsetup_extensions/common_cpp.py20CODE
LOWsetup_extensions/storage_backend_profiles/aerospike.py16CODE
LOWsetup_extensions/storage_backend_profiles/hf3fs.py26CODE
LOWsetup_extensions/storage_backend_profiles/__init__.py15CODE
LOWsetup_extensions/storage_backend_profiles/mooncake.py15CODE
LOWsetup_extensions/storage_backend_profiles/nixl.py12CODE
LOWsetup_extensions/build_profiles/rocm.py16CODE
LOWsetup_extensions/build_profiles/rbln.py22CODE
LOWsetup_extensions/build_profiles/maca.py35CODE
LOWsetup_extensions/build_profiles/__init__.py15CODE
LOWsetup_extensions/build_profiles/__init__.py18CODE
LOWsetup_extensions/build_profiles/musa.py13CODE
802 more matches not shown…
Cross-File Repetition104 hits · 520 pts
SeverityFileLineSnippetContext
HIGHtests/v1/test_gpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/test_xpu_connector.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0:param int size: the size of the pinned memory in bytes.STRING
HIGHtests/v1/test_vllm_mp_adapter.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/platform/test_event_ipc.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/platform/devices/cuda/test_cuda_ipc_wrapper.py0restore the process-global isolated-ipc switch after the test.STRING
HIGHtests/v1/distributed/test_mock_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_nixl_store_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGH…s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py0listener that records all events for inspection in tests.STRING
HIGHtests/v1/distributed/test_l1_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/distributed/test_distributed_storage_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGHtests/v1/distributed/test_l1_memory_manager.py0create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes).STRING
HIGH…sts/v1/mp_observability/subscribers/metrics/test_l2.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…mp_observability/subscribers/metrics/test_cb_server.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…rvability/subscribers/metrics/test_l1_eviction_loop.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGH…v1/mp_observability/subscribers/metrics/test_lookup.py0capture counters before the test; yield a callable that returns deltas.STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor STRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: lSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type sSTRING
HIGHlmcache/v1/memory_allocators/pin_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/host_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/memory_allocators/gpu_memory_allocator.py0free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocatoSTRING
HIGHlmcache/v1/multiprocess/engine_module.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/p2p_controller.py0return the shared engine context. exposed for testing only.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/lookup.py0return the shared engine context. exposed for testing only.STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/management.py0return the shared engine context. exposed for testing only.STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0return the shared engine context. exposed for testing only.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0return the number of currently registered instances.STRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0return the number of currently registered instances.STRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0return the number of currently registered instances.STRING
HIGH…ache/v1/multiprocess/modules/engine_driven_transfer.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGH…che/v1/multiprocess/modules/lmcache_driven_transfer.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGHlmcache/v1/multiprocess/modules/experimental/qstore.py0reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that hSTRING
HIGHlmcache/v1/distributed/transfer_channel/abstract.py0discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer nSTRING
HIGH…/distributed/transfer_channel/impl/mooncake_te_impl.py0discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer nSTRING
HIGH…ache/v1/distributed/transfer_channel/impl/nixl_impl.py0discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer nSTRING
HIGH…che/v1/distributed/l2_adapters/aerospike_l2_adapter.py03fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapterSTRING
HIGH…che/v1/distributed/l2_adapters/fs_native_l2_adapter.py03fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapterSTRING
HIGHlmcache/v1/distributed/l2_adapters/hf3fs_l2_adapter.py03fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapterSTRING
HIGH…e/v1/mp_observability/subscribers/logging/mp_server.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/sm.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/mp_observability/subscribers/logging/l1.py0l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when opeSTRING
HIGHlmcache/v1/platform/base/pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/platform/base/device_spec.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/platform/devices/cuda/pin_memory.py0unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if `STRING
HIGHlmcache/v1/storage_backend/pd_backend_async.py0remove the key from the storage backend. :param key: the key to remove.STRING
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py0remove the key from the storage backend. :param key: the key to remove.STRING
HIGHlmcache/v1/storage_backend/pd_backend.py0remove the key from the storage backend. :param key: the key to remove.STRING
44 more matches not shown…
Over-Commented Block354 hits · 344 pts
SeverityFileLineSnippetContext
LOWpyproject_cli.toml61COMMENT
LOWpyproject_cli.toml101[tool.ruff.lint.isort]COMMENT
LOWpyproject.toml81 "F",COMMENT
LOWpyproject.toml101 "F405", "F403",COMMENT
LOWpyproject.toml161disable_error_code = [COMMENT
LOWpyproject.toml201[tool.cibuildwheel]COMMENT
LOWcsrc/engine_kv_format.h181 #define LMC_KV_FORMAT_HDCOMMENT
LOWcsrc/kv_transfer_plan_types.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/kv_transfer_plan_types.h21#endifCOMMENT
LOWcsrc/storage_backends/keys.h21 pos += to.size();COMMENT
LOWcsrc/storage_backends/event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_base.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/connector_types.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/nixl/storage.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/nixl/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/mooncake/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/redis/connector.h61 // - model_name: 25-50 chars (e.g., "meta-llama/Llama-3-70b-instruct")COMMENT
LOWcsrc/storage_backends/aerospike/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/hf3fs/hf3fs_absl_init.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/hf3fs/hf3fs_absl_init.cpp21#include "absl/container/internal/hashtablez_sampler.h"COMMENT
LOWcsrc/storage_backends/hf3fs/sharded_flat_hash_set.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/hf3fs/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/hf3fs/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/fs/connector.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/storage_backends/fs/connector.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/mem_alloc.cpp1#include <cuda_runtime.h>COMMENT
LOWcsrc/cuda/pybind.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/event_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/completion_recorder.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/cuda/event_recorder.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/lmcache_native/pybind.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/lmcache_native/periodic_event_notifier.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp21// work-group handles both K and V, halving dispatch count andCOMMENT
LOWcsrc/sycl/mem_kernels_sycl.cpp1021 offset += max_nbytes;COMMENT
LOWcsrc/sycl/pybind_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_enc_sycl.cpp21// (lid * BLOCK_SIZE + tx)COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/pos_kernels_sycl.cpp21//COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/cal_cdf_sycl.cpp21// - sub_group_size locked to 16 (native SIMD on Intel discrete GPUs).COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWcsrc/sycl/ac_dec_sycl.cpp21//COMMENT
LOWcsrc/sycl/cachegen_kernels_sycl.h1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWrust/raw_block/src/lib.rs1021 (results, errors)COMMENT
LOWrust/raw_block/src/lib.rs1041 /// CQE is posted, so the worker is woken without having to drain theCOMMENT
LOWrust/raw_block/src/lib.rs1081 }COMMENT
LOWrust/raw_block/src/lib.rs1181 fn drop(&mut self) {COMMENT
LOWrust/raw_block/src/lib.rs1461 // Sorted, non-overlapping fixed-buffer regions used for containment lookup.COMMENT
LOWrust/raw_block/src/lib.rs1901 Ok(())COMMENT
LOWrust/raw_block/src/lib.rs2481 } else {COMMENT
LOWrust/raw_block/src/lib.rs2561 /// in batches to maximize throughput.COMMENT
LOWtests/v1/test_mem_kernels.py861COMMENT
LOWtests/v1/test_cache_interface.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/test_vllm_integration.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWtests/v1/multiprocess/test_blend_retrieve.py581# stayed pinned in L1 for the server's lifetime, with counts stacking on everyCOMMENT
294 more matches not shown…
Deep Nesting370 hits · 306 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_torch_ops.py812CODE
LOWtests/v1/test_torch_ops.py1176CODE
LOWtests/v1/test_torch_ops.py1422CODE
LOWtests/v1/test_torch_ops.py1848CODE
LOWtests/v1/test_torch_ops.py3101CODE
LOWtests/v1/test_cuda_ops_parity.py130CODE
LOWtests/v1/test_mp_mem_kernels.py88CODE
LOWtests/v1/test_mp_mem_kernels.py136CODE
LOWtests/v1/test_mp_mem_kernels.py207CODE
LOWtests/v1/test_address_manager.py891CODE
LOWtests/v1/test_address_manager.py972CODE
LOWtests/v1/test_address_manager.py1061CODE
LOWtests/v1/test_address_manager.py901CODE
LOWtests/v1/test_address_manager.py914CODE
LOWtests/v1/test_address_manager.py984CODE
LOWtests/v1/test_address_manager.py1071CODE
LOWtests/v1/test_address_manager.py1083CODE
LOWtests/v1/utils.py34CODE
LOWtests/v1/utils.py187CODE
LOWtests/v1/utils.py263CODE
LOWtests/v1/utils.py419CODE
LOWtests/v1/utils.py652CODE
LOWtests/v1/test_freeze_mode_integration.py27CODE
LOWtests/v1/mp_coordinator/test_blend_index.py230CODE
LOWtests/v1/mp_coordinator/test_mp_server_e2e.py161CODE
LOWtests/v1/multiprocess/test_blend_matcher.py544CODE
LOWtests/v1/multiprocess/test_blend_matcher.py765CODE
LOWtests/v1/multiprocess/test_native_state_alias_gpu.py79CODE
LOWtests/v1/multiprocess/test_raw_block_l2_adapter.py400CODE
LOWtests/v1/multiprocess/test_client.py98CODE
LOWtests/v1/distributed/test_storage_controller_utils.py770CODE
LOWtests/v1/distributed/test_s3_l2_adapter.py166CODE
LOWtests/v1/distributed/test_bitmap_ops.py574CODE
LOWtests/v1/distributed/test_nixl_store_l2_adapter.py709CODE
LOWtests/v1/distributed/test_l1_manager.py1723CODE
LOWtests/v1/distributed/test_l1_manager.py1733CODE
LOWtests/v1/distributed/test_l1_l2_state_metrics.py154CODE
LOWtests/v1/distributed/test_bigtable_l2_adapter.py63CODE
LOWtests/v1/distributed/test_bigtable_l2_adapter.py88CODE
LOWtests/v1/distributed/test_multi_l1_serving.py73CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py44CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l2.py69CODE
LOW…v1/mp_observability/subscribers/metrics/test_engine.py65CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py30CODE
LOW…/v1/mp_observability/subscribers/metrics/otel_setup.py60CODE
LOW…observability/subscribers/metrics/test_sm_lifecycle.py73CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py34CODE
LOW…v1/mp_observability/subscribers/metrics/test_lookup.py55CODE
LOW…sts/v1/mp_observability/subscribers/metrics/test_l1.py32CODE
LOW…p_observability/subscribers/metrics/counter_helpers.py31CODE
LOWtests/v1/cache_controller/conftest.py218CODE
LOWtests/v1/cache_controller/conftest.py248CODE
LOWtests/v1/cache_controller/conftest.py323CODE
LOWtests/v1/cache_controller/test_registry_tree.py451CODE
LOWtests/v1/cache_controller/test_registry_tree.py519CODE
LOWtests/v1/cache_controller/test_registry_tree.py493CODE
LOWtests/v1/cache_controller/test_registry_tree.py541CODE
LOWtests/v1/lmcache_native/test_periodic_event_notifier.py49CODE
LOWtests/v1/lmcache_native/test_ttl_lock.py366CODE
LOWtests/v1/lmcache_native/test_ttl_lock.py373CODE
310 more matches not shown…
Self-Referential Comments72 hits · 222 pts
SeverityFileLineSnippetContext
MEDIUMtests/conftest.py284 # Create a shared store but separate instances for master/slaveCOMMENT
MEDIUMtests/conftest.py646 # Create a fake hf3fs_fuse module if it doesn't existCOMMENT
MEDIUM⚡tests/v1/test_basic_check.py48 # Create a fake check_mode_ moduleCOMMENT
MEDIUM⚡tests/v1/test_memory_management.py631 # Create a simple allocator for testingCOMMENT
MEDIUM⚡tests/v1/test_memory_management.py636 # Create a real TensorMemoryObjCOMMENT
MEDIUMtests/v1/test_memory_management.py494 # Create a memory objectCOMMENT
MEDIUMtests/v1/test_memory_management.py540 # Create a mock memory object for testingCOMMENT
MEDIUMtests/v1/test_memory_management.py569 # Create a mock memory objectCOMMENT
MEDIUMtests/v1/test_config.py809 # Create a config and update from envCOMMENT
MEDIUMtests/v1/test_cache_engine.py1424 # Create an engine instanceCOMMENT
MEDIUMtests/v1/test_cache_engine.py1877 # Create a mock engineCOMMENT
MEDIUMtests/v1/test_cache_engine.py1969 # Create a mock engineCOMMENT
MEDIUM⚡tests/v1/multiprocess/test_futures.py275 # Create the raw future that will return (event_bytes, result_value)COMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py31 # Create a sample IPCCacheServerKeyCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py118 # Create a sample tensorCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py218 # Create a tensor with known valuesCOMMENT
MEDIUMtests/v1/multiprocess/test_custom_types.py238 # Create a queue for resultsCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py571 # Create a single test keyCOMMENT
MEDIUMtests/v1/multiprocess/test_mq.py595 # Create a different test keyCOMMENT
MEDIUM⚡tests/v1/distributed/test_mock_l2_adapter.py625 # Create a larger object to see noticeable delayCOMMENT
MEDIUMtests/v1/distributed/test_hf3fs_l2_adapter.py1015 # Create a buffer for loadingCOMMENT
MEDIUMtests/v1/cache_controller/conftest.py225 # Create a mock registry with all required methodsCOMMENT
MEDIUMtests/v1/cache_controller/test_config.py55 # Create a temporary YAML config fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py96 # Create a Python plugin fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py238 # Create a Python file with shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py258 # Create a Bash fileCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py278 # Create a Python file without shebangCOMMENT
MEDIUMtests/v1/plugin/test_runtime_plugin_launcher.py301 # Create an unsupported file typeCOMMENT
MEDIUMtests/v1/lmcache_native/test_ttl_lock.py115 # Create a lock with 1 second TTLCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py303 # Create a mock channelCOMMENT
MEDIUM…ts/v1/storage_backend/test_pd_backend_bidirectional.py418 # Create a query for 3 keys (2 cached, 1 not)COMMENT
MEDIUMtests/v1/storage_backend/test_storage_plugin.py300 # Create a test keyCOMMENT
MEDIUM⚡tests/v1/storage_backend/test_gds_backend.py238 # Create a path that doesn't existCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py289 # Create a dummy file so os.path.exists returns TrueCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py315 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_gds_backend.py341 # Create a dummy fileCOMMENT
MEDIUMtests/v1/storage_backend/test_hf3fs_connector.py180 # Create the 3fs-virt directory structure that HF3FS expectsCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py189 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py233 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py285 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py332 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_storage_manager.py369 # Create a mock future that returns the resultCOMMENT
MEDIUMtests/v1/storage_backend/test_bigtable_integration.py269 # Create a payload of ~8.38 MB (exceeds the 5.0 MB threshold)COMMENT
MEDIUMtests/v1/internal_api_server/test_cache_clear.py23 # Create a mock LMCache engineCOMMENT
MEDIUMtests/disagg/test_nixl_storage_backend.py81 "nixl_path": tempfile.mkdtemp(), # Create a temporary directory for testingCODE
MEDIUMtests/disagg/test_nixl_cache_engine.py193 # Create the VLLMPagedMemGPUConnectorV2COMMENT
MEDIUMtests/disagg/test_nixl_cache_engine.py204 # Create the LMCacheEngine (will be reused across rounds)COMMENT
MEDIUMtests/disagg/test_nixl_channel.py128 # Create the NixlChannelCOMMENT
MEDIUMexamples/blend_in_process/blend.py146 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…/kv_cache_reuse/local_backends/rust_backend_offload.py158 # Define the shared prompt and specific promptsCOMMENT
MEDIUMexamples/kv_cache_reuse/local_backends/offload.py131 # Define the shared prompt and specific promptsCOMMENT
MEDIUM…rks/storage_backend_io/storage_backend_io_benchmark.py411 # Create the specific backendCOMMENT
MEDIUMbenchmarks/rag/rag.py308 # Create a dataframeCOMMENT
MEDIUMbenchmarks/multi_doc_qa/multi_doc_qa.py252 # Create the OpenAI clientCOMMENT
MEDIUMbenchmarks/long_doc_qa/long_doc_qa.py484 # Create the OpenAI clientCOMMENT
MEDIUM.github/scripts/download_gh_release_model.sh142# Create the refs/main pointer so snapshot_download(local_files_only=True)COMMENT
MEDIUM.buildkite/k3_harness/values.yaml3# This file is for documentation only.COMMENT
MEDIUM.buildkite/scripts/vllm-integration-tests.sh782# Create the container imageCOMMENT
MEDIUMlmcache/connections.py2# This file is copied from the vLLM project (https://github.com/vllm-project/vllm).COMMENT
MEDIUMlmcache/v1/memory_allocators/lazy_memory_allocator.py147 # Create the tensor memory allocatorCOMMENT
12 more matches not shown…
Structural Annotation Overuse109 hits · 179 pts
SeverityFileLineSnippetContext
LOWcsrc/storage_backends/README.md83### Step 1: C++ connector — inherit from ConnectorBaseCOMMENT
LOWcsrc/storage_backends/README.md153### Step 2: Pybind moduleCOMMENT
LOWcsrc/storage_backends/README.md177### Step 3: Build system — register in setup.pyCOMMENT
LOWcsrc/storage_backends/README.md199### Step 4: Python client — non-MP mode integrationCOMMENT
LOWcsrc/storage_backends/README.md220### Step 5: MP mode integration — L2 adapter config + factoryCOMMENT
LOW⚡csrc/storage_backends/hf3fs/connector.cpp266 // Step 1: Deregister FD from 3FS first (only if registration succeeded)COMMENT
LOW⚡csrc/storage_backends/hf3fs/connector.cpp271 // Step 2: Close Linux FDCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py452 # Step 1: Both backends healthyCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py460 # Step 2: Backend A failsCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py467 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py478 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py490 # Step 5: Backend B recoversCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOWtests/v1/test_cache_engine.py1212 # NOTE: The default backend cache size is 2 GB.COMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py838 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py845 # Step 2: Lookup and lockCOMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py851 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py861 # Step 4: UnlockCOMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py653 # Step 3: Scheduler lookup, one key row per workerCOMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py660 # Step 4: Verify hit count -- both workers have chunks 0-2.COMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py665 # Step 5: Workers retrieve their chunksCOMMENT
LOW⚡tests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOW⚡tests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md89### Step 1: Create the ModuleCOMMENT
LOWdocs/design/v1/multiprocess/http_api_extension.md115### Step 2: DoneCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh51# Step 0: Generate the master key (never checked in / logged)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh104# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh134# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh178# Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh224# Step 4: Clear L1 (CPU) cacheCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh234# Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decryptCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh254# Step 6: Show metrics / statusCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOWexamples/kv_cache_reuse/local_backends/README.md12 # WARNING: This will erase the content of target device.COMMENT
LOW⚡examples/kv_cache_reuse/remote_backends/s3/README.md7## Step 1: Configure your S3 bucket and (optional) EC2 compute instanceCOMMENT
LOW⚡examples/kv_cache_reuse/remote_backends/s3/README.md14## Step 2: Fill out `example.yaml`COMMENT
LOW⚡examples/kv_cache_reuse/remote_backends/s3/README.md18## Step 3: Start an vLLM engine with LMCacheCOMMENT
49 more matches not shown…
Verbosity Indicators84 hits · 141 pts
SeverityFileLineSnippetContext
LOW⚡csrc/storage_backends/hf3fs/connector.cpp266 // Step 1: Deregister FD from 3FS first (only if registration succeeded)COMMENT
LOW⚡csrc/storage_backends/hf3fs/connector.cpp271 // Step 2: Close Linux FDCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py452 # Step 1: Both backends healthyCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py460 # Step 2: Backend A failsCOMMENT
LOW⚡tests/v1/test_health_monitor_fallback_recovery.py467 # Step 3: Backend B also failsCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py478 # Step 4: Backend A recoversCOMMENT
LOWtests/v1/test_health_monitor_fallback_recovery.py490 # Step 5: Backend B recoversCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py115 # Step 1: Verify initial freeze mode is OFFCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py122 # Step 2: Normal mode - Store should workCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py155 # Step 3: Enable freeze mode via HTTP APICOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py169 # Step 4: Read-only mode - Store should be skippedCOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py196 # Step 5: Disable freeze mode via HTTP APICOMMENT
LOW⚡tests/v1/test_freeze_mode_integration.py205 # Step 6: Store should work again after disablingCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py519 # Step 1: StoreCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py525 # Step 2: Lookup and lockCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py531 # Step 3: LoadCOMMENT
LOW⚡tests/v1/distributed/test_mock_l2_adapter.py540 # Step 4: UnlockCOMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py838 # Step 1: Store from page 0 (filled with 123.0)COMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py845 # Step 2: Lookup and lockCOMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py851 # Step 3: Load into page 1 (initially 0.0)COMMENT
LOW⚡tests/v1/distributed/test_nixl_store_l2_adapter.py861 # Step 4: UnlockCOMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py653 # Step 3: Scheduler lookup, one key row per workerCOMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py660 # Step 4: Verify hit count -- both workers have chunks 0-2.COMMENT
LOW⚡tests/v1/distributed/test_object_key_parallel.py665 # Step 5: Workers retrieve their chunksCOMMENT
LOW⚡tests/v1/shm_allocator/shmfile_basic_check.yaml4# Step 1: Build shm_file_worker (PIPE mode, same machine)COMMENT
LOW⚡tests/v1/shm_allocator/shmfile_basic_check.yaml8# Step 2: Run basic_checkCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py288 # Step 1: Worker side - recreate serverCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py298 # Step 2: Scheduler side - recreate clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py314 # Step 1: Dryrun - check what would be createdCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py324 # Step 2: Close current clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_lookup_api.py329 # Step 3: Create new clientCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py232 # Step 1: close RemoteBackendCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py237 # Step 2: update config via /conf (uses conf_api)COMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py242 # Step 3: create new backendsCOMMENT
LOW⚡tests/v1/internal_api_server/test_backend_api.py252 # Step 4: list backendsCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh51# Step 0: Generate the master key (never checked in / logged)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh104# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh134# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh178# Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt)COMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh224# Step 4: Clear L1 (CPU) cacheCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh234# Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decryptCOMMENT
LOW⚡examples/serde/aesgcm/run_serde_aesgcm_example.sh254# Step 6: Show metrics / statusCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh85# Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde)COMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh115# Step 2: Launch vLLM with LMCacheMPConnectorCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh159# Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize)COMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh197# Step 4: Clear L1 (CPU) cacheCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh207# Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserializeCOMMENT
LOW⚡examples/serde/fp8/run_serde_fp8_example.sh226# Step 6: Show metrics / statusCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh58# Step 1: Build docker imagesCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh69# Step 2: Launch containersCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh80# Step 3: Wait for vLLM to be readyCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh91# Step 4: Run lm_eval workload testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh102# Step 5: Run vllm bench serve testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh113# Step 6: Run long doc QA testCOMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh124# Step 7: Run fault tolerance test (destructive — kills LMCache container)COMMENT
LOW.buildkite/scripts/multiprocessing-test/run-mp-test.sh139# Step 8: Cleanup runs automatically via trapCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh79 # Step 1: Warmup bench (measure timing for kill calibration)COMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh93 # Step 2: Bench with mid-flight LMCache killCOMMENT
LOW…te/scripts/multiprocessing-test/run-fault-tolerance.sh118 # Step 3: Quick curl health checkCOMMENT
LOW.buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh43# Step 1: Launch native processes (replaces Docker containers)COMMENT
24 more matches not shown…
Redundant / Tautological Comments75 hits · 112 pts
SeverityFileLineSnippetContext
LOWdocker/example_build.sh7# Set VLLM_VERSION to a specific version before running this script,COMMENT
LOW⚡tests/conftest.py776 # Check if object has a close methodCOMMENT
LOWtests/v1/test_impl_completeness.py73 # Check if the method is actually implemented in the classCOMMENT
LOWtests/v1/utils.py667 # Check if it's callable (function, method, etc.)COMMENT
LOWtests/v1/multiprocess/test_custom_types.py251 # Check if process completed successfullyCOMMENT
LOWtests/v1/multiprocess/test_mq.py334 # Check if client completed successfullyCOMMENT
LOW…v1/storage_backend/test_p2p_backend_with_controller.py66 # Check if backend is properly initialized by checking its attributesCOMMENT
LOW…1/storage_backend/test_local_cpu_backend_nixl_paged.py241 # Set cpu_size_bytes to exactly 1 byte — smaller than one chunk.COMMENT
LOWtests/v1/internal_api_server/test_run_script.py41 # Check if we've closed all bracesCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py82 # Check if the mean is close to the pattern valueCOMMENT
LOWtests/disagg/test_nixl_cache_engine.py298 # Check if all tokens were retrievedCOMMENT
LOWexamples/chunk_statistics/analyze_chunk_hashes.py393 # Print resultsCOMMENT
LOWexamples/kubernetes/health_probe.py65 # Check if server responded with successCOMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py474 # Check if this is a two-phase benchmark (write + read)COMMENT
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py1225 # Print resultsCOMMENT
LOWbenchmarks/multi_doc_qa/multi_doc_qa.py322 # Print resultsCOMMENT
LOWbenchmarks/multi_round_qa/multi-round-qa.py455 # Check if can join new user sessionCOMMENT
LOWbenchmarks/long_doc_qa/long_doc_qa.py561 # Print resultsCOMMENT
LOWbenchmarks/microbenchmark/ttl_lock_benchmark.py522 # Check if we can sustain 10K+ ops/sec with 4-8 threadsCOMMENT
LOW.buildkite/k3_harness/gpu-monitor.sh67 # Check if this PID is inside any cgroup containing "kubepods"COMMENT
LOW.buildkite/k3_harness/setup-cluster.sh66# Check if image already exists in K3s containerdCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh79 # Check if port is available using netstatCOMMENT
LOW.buildkite/scripts/vllm-integration-tests.sh669 # Check if baseline exists, skip comparisons if notCOMMENT
LOW…ildkite/scripts/multiprocessing-test/run-vllm-bench.sh105 # Check if result files existCOMMENT
LOW.buildkite/scripts/multiprocessing-test/common.sh28 # Check if uv is availableCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh37 # Check if container is still runningCOMMENT
LOW…uildkite/scripts/multiprocessing-test/wait-for-vllm.sh46 # Check if vLLM health endpoint is respondingCOMMENT
LOW…ldkite/scripts/multiprocessing-test/run-long-doc-qa.sh118 # Check if result files existCOMMENT
LOWlmcache/utils.py267 # Check if it's a range format [start,end]COMMENT
LOWlmcache/v1/memory_management.py1632 # Check if free blocks are properly coalescedCOMMENT
LOWlmcache/v1/memory_management.py1639 # Check if total size matchesCOMMENT
LOWlmcache/v1/cache_engine.py461 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/cache_engine.py658 # Check if freeze mode is enabledCOMMENT
LOWlmcache/v1/config_base.py584 # Check if this configuration class has definitions with convertersCOMMENT
LOWlmcache/v1/pin_monitor.py134 # Check if object is still pinned and has exceeded timeoutCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py308 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/memory_allocators/tensor_memory_allocator.py317 # Check if the blocks are coalescedCOMMENT
LOW…/v1/memory_allocators/paged_tensor_memory_allocator.py323 # Check if the numbers are consistentCOMMENT
LOWlmcache/v1/lookup_client/lmcache_async_lookup_client.py165 # Check if any aborted lookups are finished, send cleanup messagesCOMMENT
LOWlmcache/v1/lookup_client/factory.py60 # Check if external_lookup_client is configuredCOMMENT
LOWlmcache/v1/lookup_client/factory.py78 # Check if bypass lookup is enabled and lmcache_engine is providedCOMMENT
LOWlmcache/v1/distributed/l2_adapters/factory.py127 # Check if the name is now registeredCOMMENT
LOW…1/mp_observability/subscribers/metrics/l1_lifecycle.py158 # Check if this is a reuse of an evicted chunk.COMMENT
LOWlmcache/v1/cache_controller/config.py128 # Check if this field has an env_converter in the definitionsCOMMENT
LOW⚡lmcache/v1/cache_controller/controller_manager.py333 # Check if POLLIN flag is set (indicates readable/pending messages)COMMENT
LOWlmcache/v1/cache_controller/commands/full_sync.py43 # Check if full sync is already in progressCOMMENT
LOW…ache_controller/controllers/registration_controller.py231 # Check if full sync is needed (e.g., controller restart)COMMENT
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py146 # Check if already syncing with different sync_idCOMMENT
LOW…cache/v1/cache_controller/controllers/kv_controller.py154 # Check if worker is currently in full syncCOMMENT
LOWlmcache/v1/health_monitor/base.py505 # Check if we have any health checks that need to runCOMMENT
LOWlmcache/v1/storage_backend/remote_backend.py349 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py401 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/remote_backend.py555 # Check if local_cpu_backend is available (required for memory allocation)COMMENT
LOWlmcache/v1/storage_backend/gds_backend.py1103 # Check if file is large enough for the requested readCOMMENT
LOWlmcache/v1/storage_backend/batched_message_sender.py109 # Check if we have messages to process while holding the lockCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py480 # Check if io_uring is enabled for fixed buffer supportCOMMENT
LOWlmcache/v1/storage_backend/local_cpu_backend.py494 # Check if lazy memory allocator should be enabledCOMMENT
LOWlmcache/v1/storage_backend/nixl_storage_backend.py2120 # Check if already in progressCOMMENT
LOWlmcache/v1/storage_backend/raw_block/core.py1250 # Check if the buffer pointer is alignedCOMMENT
LOWlmcache/v1/storage_backend/connector/audit_connector.py46 # Check if method is marked with @NotAuditCOMMENT
15 more matches not shown…
Modern Structural Boilerplate109 hits · 110 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_health_monitor_fallback_recovery.py41 def set_ping_error_code(self, error_code: int) -> None:CODE
LOW⚡tests/v1/test_musa_support.py79 def set_device(self, _idx: int) -> None:CODE
LOWtests/v1/test_health_monitor.py45 def set_healthy(self, healthy: bool) -> None:CODE
LOWtests/v1/distributed/serde/test_async_processor.py176 def set_used_size(self, n: int) -> None:CODE
LOW…nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py17__all__ = ["InMemoryL2Adapter", "InMemoryL2AdapterConfig"]CODE
LOW…onnector/src/lmc_external_native_connector/__init__.py26__all__ = [CODE
LOWexamples/remote_config_server/config_server.py28logger = logging.getLogger(__name__)CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py359 def _setup_device(self) -> None:CODE
LOW…rks/storage_backend_io/storage_backend_io_benchmark.py755 def _setup_device(self) -> None:CODE
LOW.buildkite/correctness/async_request.py16logger = logging.getLogger(__name__)CODE
LOWlmcache/usage_context.py16__all__ = [CODE
LOWlmcache/__init__.py20__all__ = ["__version__", "torch_dev", "torch_device_type"]CODE
LOWlmcache/v1/memory_management.py234 def set_l1_manager(self, owner_tag: int) -> None:CODE
LOWlmcache/v1/memory_management.py323 def set_used_size(self, n: int) -> None: # noqa: B027CODE
LOWlmcache/v1/memory_management.py726 def set_used_size(self, n: int) -> None:CODE
LOWlmcache/v1/cache_engine.py248 def set_health_monitor(self, health_monitor: "HealthMonitor") -> None:CODE
LOWlmcache/v1/cache_engine.py362 def set_hot_cache(self, enabled: bool) -> None:CODE
LOWlmcache/v1/mp_coordinator/controllers/__init__.py141__all__ = ["Controller", "build_controllers"]CODE
LOWlmcache/v1/mp_coordinator/views/__init__.py48__all__ = ["View", "base", "build_views"]CODE
LOWlmcache/v1/multiprocess/session.py57 def set_tokens(self, full_token_ids: list[int]) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py68 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py80 def set_exception(self, exception: BaseException) -> None:CODE
LOWlmcache/v1/multiprocess/futures.py328 def set_result(self, result: T) -> None:CODE
LOWlmcache/v1/multiprocess/posix_shm.py45logger = logging.getLogger(__name__)CODE
LOWlmcache/v1/multiprocess/transport/zmq_impl/__init__.py60__all__ = ["ZmqMultiprocessClient", "create_request_client"]CODE
LOWlmcache/v1/multiprocess/transfer_context/__init__.py29__all__ = [CODE
LOWlmcache/v1/multiprocess/modules/p2p_controller.py635 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/modules/lookup.py604 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/multiprocess/modules/blend/__init__.py38__all__ = ["BlendModule"]CODE
LOWlmcache/v1/offload_server/__init__.py11__all__ = [CODE
LOW…che/v1/lookup_client/chunk_statistics_lookup_client.py197 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/lookup_client/__init__.py17__all__ = [CODE
LOWlmcache/v1/lookup_client/record_strategies/__init__.py56__all__ = [CODE
LOWlmcache/v1/distributed/quota_manager.py61 def set_quota(self, cache_salt: str, limit_bytes: int) -> None:CODE
LOWlmcache/v1/distributed/quota_manager.py97 def set_default_limit_bytes(self, limit_bytes: int | None) -> None:CODE
LOWlmcache/v1/distributed/memory_manager/__init__.py24__all__ = [CODE
LOWlmcache/v1/distributed/eviction_policy/__init__.py23__all__ = [CODE
LOWlmcache/v1/distributed/storage_controllers/__init__.py36__all__ = [CODE
LOWlmcache/v1/distributed/bitmap_ops/__init__.py21__all__ = [CODE
LOWlmcache/v1/distributed/transfer_channel/__init__.py30__all__ = [CODE
LOW⚡…ache/v1/distributed/l2_adapters/hfbucket_l2_adapter.py874 def _set_cached_object_size_locked(self, object_path: str, size: int) -> None:CODE
LOWlmcache/v1/distributed/l2_adapters/__init__.py64__all__ = [CODE
LOWlmcache/v1/distributed/l2_adapters/base.py363 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOW⚡lmcache/v1/distributed/l2_adapters/serde_wrapper.py340 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOW…/v1/distributed/l2_adapters/fault_inject_l2_adapter.py387 def set_backend_identity(self, name: str, shared: bool = False) -> None:CODE
LOWlmcache/v1/distributed/serde/__init__.py47__all__ = [CODE
LOWlmcache/v1/distributed/serde/turboquant/__init__.py11__all__ = [CODE
LOWlmcache/v1/mp_observability/trace/decorator.py49def set_tracing_enabled(enabled: bool) -> None:CODE
LOWlmcache/v1/mp_observability/trace/__init__.py39__all__ = [CODE
LOWlmcache/v1/mp_observability/subscribers/__init__.py18__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/metrics/__init__.py52__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/tracing/__init__.py21__all__ = [CODE
LOW…he/v1/mp_observability/subscribers/logging/__init__.py22__all__ = [CODE
LOWlmcache/v1/cache_controller/__init__.py6__all__ = [CODE
LOWlmcache/v1/cache_controller/utils.py187 def update_seq_num(self, location: str, seq_num: int) -> None:CODE
LOWlmcache/v1/cache_controller/commands/__init__.py12__all__ = [CODE
LOWlmcache/v1/cache_controller/controllers/__init__.py8__all__ = [CODE
LOW…e/v1/cache_controller/controllers/full_sync_tracker.py71 def set_need_full_sync_all(self, need: bool) -> None:CODE
LOW…cache/v1/cache_controller/controllers/kv_controller.py74 def _setup_metrics(self) -> None:CODE
LOWlmcache/v1/platform/__init__.py26__all__ = [CODE
49 more matches not shown…
AI Slop Vocabulary32 hits · 104 pts
SeverityFileLineSnippetContext
MEDIUM⚡tests/v1/test_mp_mem_kernels.py31# Tensor factories (ported from kernel harness)COMMENT
MEDIUMtests/v1/multiprocess/test_cache_server.py184#: backend has no such requirement, but this keeps the harness valid forCOMMENT
MEDIUMtests/v1/multiprocess/test_engine_driven_transfer.py279 # real IPC-backed factories to be usable in the harness.COMMENT
MEDIUMtests/cli/commands/trace/test_driver.py274 # the test robust against future decorator additions.COMMENT
MEDIUM.github/workflows/operator_release.yml51 # so behavior is robust whether or not that box is ticked in the UI.COMMENT
MEDIUM.buildkite/pipelines/comprehensive-tests.yml9 - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Skip comprehensive tests for safe-path-only PRs.CODE
MEDIUM.buildkite/k3_harness/setup-env.sh309# harness. Re-probe the full chain here so broken envs fail fast with theCOMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh17# 2. Plugin-harness dep not in the LMCache/vLLM dependency closure.COMMENT
MEDIUM.buildkite/k3_harness/setup-blend-env.sh59# server-boot timeout inside the harness.COMMENT
MEDIUM⚡.buildkite/scripts/should-run-comprehensive.sh4# Decide whether comprehensive tests should run for this build.COMMENT
MEDIUM⚡.buildkite/scripts/should-run-comprehensive.sh6# 0 -> run comprehensive testsCOMMENT
MEDIUM⚡.buildkite/scripts/should-run-comprehensive.sh7# 1 -> skip comprehensive tests (safe paths only)COMMENT
MEDIUM⚡.buildkite/scripts/should-run-comprehensive.sh9# If this isn't a PR build, always run comprehensive tests.COMMENT
MEDIUM.buildkite/scripts/should-run-comprehensive.sh70 # Non-safe file touched -> run comprehensive tests.COMMENT
MEDIUM…dkite/k3_tests/multiprocess/scripts/run-single-test.sh9# This mirrors the comprehensive tests' run-single-config.sh pattern.COMMENT
MEDIUM…s/multiprocess/scripts/workloads/vllm/dsv4-flash-tp.sh386# across 128 tokens), making the comparison robust.COMMENT
MEDIUM…tests/multiprocess/scripts/workloads/common/lm-eval.sh4# Engine setup and test dependencies are installed by the harness entrypoint.COMMENT
MEDIUM…ests/multiprocess/scripts/workloads/common/deadlock.sh4# The multiprocess harness launches the selected inference engine with theCOMMENT
MEDIUM…ldkite/k3_tests/multiprocess/scripts/engines/sglang.sh2# SGLang adapter for the LMCache multiprocess integration-test harness.COMMENT
MEDIUM…uildkite/k3_tests/multiprocess/scripts/engines/vllm.sh2# vLLM adapter for the LMCache multiprocess integration-test harness.COMMENT
MEDIUM…ite/k3_tests/comprehensive/scripts/upload-baselines.sh3# Runs AFTER all comprehensive config steps complete (via `wait`).COMMENT
MEDIUM.buildkite/k3_tests/xpu/multiprocess/run.sh4# Reuse multiprocess test harness, but switch to the XPU environment/bootstrap.COMMENT
MEDIUM.buildkite/k3_tests/xpu/multiprocess/run.sh17# The shared vLLM harness defaults to FLASH_ATTN when this is unset.COMMENT
MEDIUM.buildkite/k3_tests/amd/run-unit-tests.sh13# k3 harness behavior used by the other test suites.COMMENT
MEDIUM⚡.buildkite/k3_tests/common_scripts/path-filter.sh18# - Shared CI harness files fan out only to the tests that actually dependCOMMENT
MEDIUM⚡.buildkite/k3_tests/common_scripts/path-filter.sh20# to that suite, while shared harness changes under .buildkite/k3_harness/COMMENT
MEDIUM⚡.buildkite/k3_tests/common_scripts/path-filter.sh21# are classified by the harness file they touch.COMMENT
MEDIUM.buildkite/k3_tests/common_scripts/path-filter.sh162 # Keep other example changes out of the comprehensive pipeline.COMMENT
LOWlmcache/v1/memory_management.py1079 # so just return None hereCOMMENT
LOW…cache/v1/memory_allocators/cu_file_memory_allocator.py21 # layer - for now just use the current device.COMMENT
MEDIUMlmcache/v1/gpu_connector/utils.py818 # Also accept [P,2,B,H,D] (or [NB,2,BS,NH,HS]) to be more robust.COMMENT
MEDIUMlmcache/cli/commands/bench/l2_adapter_bench/command.py475 # the one-time tensor allocation + fill (benchmark harness work,COMMENT
Modern AI Meta-Vocabulary27 hits · 87 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md32- [2026/05] 🔥 Agentic workload benchmark on AMD MI300X ([blog](https://blog.lmcache.ai/en/2026/05/12/benchmarking-lmcachCODE
MEDIUM⚡tests/v1/distributed/serde/test_asym_k16_v8_multi.py34# Test scaffolding (mirrors the _FakeMemoryObj in test_multi.py / test_fp8.py)COMMENT
MEDIUM⚡tests/v1/distributed/serde/test_multi.py52# Test scaffolding: a minimal MemoryObj stand-in mirroring test_fp8.py.COMMENT
MEDIUMdocs/design/v1/gpu_connector/layout-invariant.md42├── detection.py # detect_format() orchestrationCODE
MEDIUM…design/cli/commands/bench/engine_bench/bench-engine.md42# RAG answer quality (real QA data, documents cached individually)COMMENT
MEDIUMbenchmarks/rag/README.md1# Benchmarking LLM Performance: RAG Use CaseCOMMENT
MEDIUMbenchmarks/rag/README.md16## Running the RAG BenchmarkCOMMENT
MEDIUMlmcache/cli/commands/bench/server_bench/command.py56# orchestration safe.COMMENT
MEDIUMoperator/AGENTS.md355Do NOT delete `// +kubebuilder:scaffold:*` comments. CLI injects code at these markers.CODE
MEDIUMoperator/AGENTS.md389### Deploy Image Plugin (scaffold to deploy/manage ANY container image)COMMENT
MEDIUMoperator/cmd/main.go44 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/cmd/main.go57 // +kubebuilder:scaffold:schemeCOMMENT
MEDIUMoperator/cmd/main.go175 // In the default scaffold provided, the program ends immediately afterCOMMENT
MEDIUMoperator/cmd/main.go221 // +kubebuilder:scaffold:builderCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go168 // +kubebuilder:scaffold:e2e-metrics-webhooks-readinessCOMMENT
MEDIUMoperator/test/e2e/e2e_test.go208 // +kubebuilder:scaffold:e2e-webhooks-checksCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml8# +kubebuilder:scaffold:crdkustomizeresourceCOMMENT
MEDIUMoperator/config/crd/kustomization.yaml13# +kubebuilder:scaffold:crdkustomizewebhookpatchCOMMENT
MEDIUM⚡operator/config/default/kustomization.yaml225# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUM⚡operator/config/default/kustomization.yaml226# +kubebuilder:scaffold:crdkustomizecainjectionnsCOMMENT
MEDIUM⚡operator/config/default/kustomization.yaml233# targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD.COMMENT
MEDIUM⚡operator/config/default/kustomization.yaml234# +kubebuilder:scaffold:crdkustomizecainjectionnameCOMMENT
MEDIUMoperator/config/samples/vllm_cacheblend_deployment.yaml1# Sample vLLM Deployment that OPTS IN to CacheBlend dependency injection.COMMENT
MEDIUMoperator/config/samples/kustomization.yaml6# +kubebuilder:scaffold:manifestskustomizesamplesCOMMENT
MEDIUMoperator/config/samples/vllm_lmcache_deployment.yaml1# Sample vLLM Deployment that OPTS IN to LMCacheEngine dependency injection.COMMENT
MEDIUMoperator/internal/controller/suite_test.go38 // +kubebuilder:scaffold:importsCOMMENT
MEDIUMoperator/internal/controller/suite_test.go70 // +kubebuilder:scaffold:schemeCOMMENT
Cross-Language Confusion9 hits · 44 pts
SeverityFileLineSnippetContext
HIGH…s/v1/multiprocess/test_lmcache_driven_transfer_skip.py63 # chunk size = 2 blocks. Chunk 0 = [0, 0] (null), chunk 1 = [0, 9] (has aCOMMENT
HIGH⚡…s/v1/multiprocess/test_lmcache_driven_transfer_skip.py95 # chunk 0: kg0=0 and kg1=0 -> null; chunk 1: kg0=0 but kg1=4 -> not null.COMMENT
HIGHtests/v1/shm_allocator/verify_shmfile_tcp.py15 mkdir -p tests/v1/shm_allocator/csrc/build && cd tests/v1/shm_allocator/csrc/buildSTRING
HIGHlmcache/v1/cache_controller/worker.py644 self.push(),CODE
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py1191 self.pool.push(index)CODE
HIGHlmcache/v1/storage_backend/nixl_storage_backend.py1491 self.pool.push(metadata.index)CODE
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py346 # "locations": null, "request_configs": null}STRING
HIGHlmcache/v1/internal_api_server/vllm/cache_api.py354 # "request_configs": null}STRING
HIGH…ommands/bench/engine_bench/workloads/rag_qa_quality.py423 An unparsed sample's ``f1`` is null, not zero, so a cross-run diff canSTRING
Hallucination Indicators3 hits · 30 pts
SeverityFileLineSnippetContext
CRITICALtests/v1/mp_coordinator/test_directory_api.py224 key_directory = client.app.state.ctx.views.get(KeyDirectory)CODE
CRITICALtests/v1/multiprocess/test_free_locks.py321 ctx.session_manager.get_or_create.return_value.record_prefetch_result.assert_not_called()CODE
CRITICALlmcache/v1/storage_backend/connector/azure_connector.py145 from azure.core.exceptions import ResourceNotFoundErrorCODE
AI Structural Patterns17 hits · 14 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_vllm_local_rank.py29CODE
LOWtests/v1/mp_coordinator/test_key_directory.py35CODE
LOWtests/v1/mp_coordinator/test_event_gate.py37CODE
LOWtests/cli/commands/bench/engine_bench/test_stats.py25CODE
LOW…ds/bench/engine_bench/workloads/test_rag_qa_quality.py82CODE
LOW…che/v1/distributed/l2_adapters/aerospike_l2_adapter.py48CODE
LOW…che/v1/distributed/l2_adapters/raw_block_l2_adapter.py219CODE
LOW…1/distributed/l2_adapters/sagemaker_hyperpod_client.py159CODE
LOW…stributed/l2_adapters/sagemaker_hyperpod_l2_adapter.py60CODE
LOW…ache/v1/distributed/l2_adapters/bigtable_l2_adapter.py172CODE
LOWlmcache/v1/distributed/l2_adapters/valkey_l2_adapter.py165CODE
LOWlmcache/v1/storage_backend/valkey/worker_pool.py173CODE
LOW…/v1/storage_backend/native_clients/aerospike_client.py22CODE
LOWlmcache/v1/storage_backend/connector/eic_connector.py432CODE
LOW…cache/v1/storage_backend/connector/valkey_connector.py107CODE
LOWlmcache/v1/kv_codec/asym_k16_v8.py271CODE
LOWlmcache/cli/commands/bench/server_bench/helpers.py237CODE
Example Usage Blocks8 hits · 13 pts
SeverityFileLineSnippetContext
LOW⚡tests/v1/shm_allocator/shmfile_basic_check.yaml3# Usage:COMMENT
LOW…es/lmc_external_l2_adapter/scripts/install_and_test.sh7# Usage:COMMENT
LOW.github/scripts/download_model.sh8# Usage:COMMENT
LOW.github/scripts/install_lmcache_cpu.sh9# Usage:COMMENT
LOW.github/scripts/install_vllm_cpu.sh16# Usage:COMMENT
LOW.buildkite/k3_harness/install-agent-stack.sh4# Usage:COMMENT
LOW.buildkite/k3_harness/resolve-pinned-vllm.sh25# Usage:COMMENT
LOW.buildkite/k3_tests/common_scripts/path-filter.sh5# Usage:COMMENT
TODO Padding5 hits · 7 pts
SeverityFileLineSnippetContext
LOWlmcache/v1/memory_management.py885 # TODO: consider using one of the alternativesCOMMENT
LOWlmcache/v1/multiprocess/transport/zmq_impl/mq.py517 # TODO: implement this in the future versions if neededCOMMENT
LOW⚡…distributed/storage_controllers/prefetch_controller.py1007 # TODO: implement the dynamic in flight request admissionCOMMENT
LOWlmcache/v1/storage_backend/gds_backend.py532 # TODO: implement pin() semanticsCOMMENT
LOWlmcache/cli/commands/query/kvcache_command.py24 # TODO: implement kvcache query logicCOMMENT
Fake / Example Data4 hits · 4 pts
SeverityFileLineSnippetContext
LOWtests/v1/test_sglang_mp_adapter.py363 conn._create_key = lambda *args, **kwargs: "fake-key" # type: ignore[method-assign,assignment]CODE
LOWtests/v1/test_sglang_mp_adapter.py393 conn._create_key = lambda *args, **kwargs: "fake-key" # type: ignore[method-assign,assignment]CODE
LOWbenchmarks/multi_doc_qa/shuffle_doc_qa.py263 api_key="dummy-key",CODE
LOWbenchmarks/ttft-estimator/ttft-estimator.py37client = OpenAI(api_key="dummy-key", base_url="http://localhost:8000/v1")CODE
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUM.github/workflows/codeql.yml59 # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize howCOMMENT
Overly Generic Function Names2 hits · 2 pts
SeverityFileLineSnippetContext
LOWtests/v1/mp_coordinator/test_cache_events.py710 def handle_request(self, request: httpx.Request) -> httpx.Response:CODE
LOWlmcache/v1/cache_controller/worker.py529 async def handle_request(self):CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMlmcache/v1/mp_coordinator/persistence/store.py122CODE