LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
This report summarizes scanner evidence for LMCache/LMCache, a Python project with 11,998 GitHub stars. SynthScan examined 563,566 lines of code across 2210 source files, recording 12389 pattern matches distributed across 25 syntactic categories. The legacy adjusted pattern signal is 36.6 (High pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 8083 finding(s).
Are imports declared and package/API names verified? 878 finding(s).
Are wrappers, guards, and repeated structures necessary? 10015 finding(s).
Which changes need focused human review? 12389 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 12389 distinct pattern matches across 25 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tests/test_utils.py | 511 | # ============================================================ | COMMENT |
| MEDIUM⚡ | tests/test_utils.py | 513 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 28 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 30 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 76 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 78 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 203 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 205 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 226 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 228 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 249 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 251 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 409 | # ============================================================ | COMMENT |
| MEDIUM | tests/test_utils.py | 411 | # ============================================================ | COMMENT |
| MEDIUM⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 186 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 188 | # ============================================================================== | COMMENT |
| MEDIUM | tests/v1/test_health_monitor_fallback_recovery.py | 94 | # ============================================================================== | COMMENT |
| MEDIUM | tests/v1/test_health_monitor_fallback_recovery.py | 96 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | tests/v1/test_torch_ops.py | 128 | # ========================================== | COMMENT |
| MEDIUM⚡ | tests/v1/test_torch_ops.py | 130 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 26 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 28 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 54 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 56 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3034 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3036 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3065 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3067 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3163 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_torch_ops.py | 3165 | # ========================================== | COMMENT |
| MEDIUM | tests/v1/test_musa_support.py | 38 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_musa_support.py | 40 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 89 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 91 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 169 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 171 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 303 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_musa_support.py | 305 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_nixl_batched_contains.py | 396 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_nixl_batched_contains.py | 398 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 29 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 31 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 75 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 77 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 169 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 171 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 228 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_nixl_batched_contains.py | 230 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_device_id_race.py | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_device_id_race.py | 25 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_mp_mem_kernels.py | 30 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_mp_mem_kernels.py | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 249 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 251 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 298 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 300 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 533 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/v1/test_mp_mem_kernels.py | 541 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/v1/test_decode_save_and_preemption.py | 216 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/v1/test_decode_save_and_preemption.py | 218 | # =========================================================================== | COMMENT |
| 2052 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/translate_docs_zh.py | 257 | def clean_translation_response(text: str) -> str: | CODE |
| LOW⚡ | tests/test_utils.py | 171 | def test_nested_brackets_error(self): | CODE |
| LOW⚡ | tests/test_utils.py | 177 | def test_unmatched_closing_bracket(self): | CODE |
| LOW⚡ | tests/test_utils.py | 187 | def test_invalid_range_start_gt_end(self): | CODE |
| LOW⚡ | tests/test_utils.py | 312 | def test_from_string_roundtrip(self, basic_key): | CODE |
| LOW⚡ | tests/test_utils.py | 317 | def test_from_string_with_tags_roundtrip(self, key_with_tags): | CODE |
| LOW⚡ | tests/test_utils.py | 326 | def test_from_string_invalid_tag_format(self): | CODE |
| LOW⚡ | tests/test_utils.py | 330 | def test_to_dict_and_from_dict(self, basic_key): | CODE |
| LOW⚡ | tests/test_utils.py | 340 | def test_from_dict_invalid_tag(self): | CODE |
| LOW⚡ | tests/test_utils.py | 515 | def test_parse_cache_engine_key(self): | CODE |
| LOW | tests/test_utils.py | 41 | def test_numerator_smaller_than_denominator(self): | CODE |
| LOW | tests/test_utils.py | 90 | def test_three_or_more_consecutive(self): | CODE |
| LOW | tests/test_utils.py | 98 | def test_non_consecutive_order_preserved(self): | CODE |
| LOW | tests/test_utils.py | 124 | def test_three_or_more_elements(self): | CODE |
| LOW | tests/test_utils.py | 288 | def test_not_equal_different_hash(self, basic_key): | CODE |
| LOW | tests/test_utils.py | 298 | def test_not_equal_different_type(self, basic_key): | CODE |
| LOW | tests/test_utils.py | 375 | def test_chunk_hash_hex_bytes(self): | CODE |
| LOW | tests/test_utils.py | 387 | def test_unsupported_dtype_raises(self): | CODE |
| LOW | tests/test_utils.py | 397 | def test_no_tags_when_no_tag_prefix(self): | CODE |
| LOW | tests/test_utils.py | 424 | def test_hash_includes_layer_id(self, layer_key): | CODE |
| LOW | tests/test_utils.py | 447 | def test_eq_different_base_key(self, layer_key): | CODE |
| LOW | tests/test_utils.py | 477 | def test_from_string_roundtrip(self, layer_key): | CODE |
| LOW | tests/test_utils.py | 482 | def test_from_string_with_tags(self): | CODE |
| LOW | tests/test_utils.py | 500 | def test_from_string_invalid_tag(self): | CODE |
| LOW | tests/test_utils.py | 531 | def test_parse_layer_cache_engine_key(self): | CODE |
| LOW | tests/test_utils.py | 549 | def test_parse_cache_key_without_tags(self): | CODE |
| LOW | tests/test_utils.py | 564 | def test_parse_cache_key_with_tags(self): | CODE |
| LOW | tests/test_utils.py | 583 | def test_parse_layer_cache_key_without_tags(self): | CODE |
| LOW | tests/test_utils.py | 598 | def test_parse_layer_cache_key_with_tags(self): | CODE |
| LOW | tests/test_utils.py | 616 | def test_roundtrip_cache_engine_key_without_tags(self): | CODE |
| LOW | tests/test_utils.py | 636 | def test_roundtrip_cache_engine_key_with_tags(self): | CODE |
| LOW | tests/test_utils.py | 659 | def test_roundtrip_layer_cache_engine_key_without_tags(self): | CODE |
| LOW | tests/test_utils.py | 680 | def test_roundtrip_layer_cache_engine_key_with_tags(self): | CODE |
| LOW | tests/test_observability.py | 32 | def test_on_retrieve_finished(stats_monitor): | CODE |
| LOW⚡ | tests/test_observability.py | 44 | def test_on_store_request_and_finished(stats_monitor): | CODE |
| LOW⚡ | tests/test_observability.py | 52 | def test_update_local_cache_usage(stats_monitor): | CODE |
| LOW⚡ | tests/test_observability.py | 58 | def test_update_remote_cache_usage(stats_monitor): | CODE |
| LOW⚡ | tests/test_observability.py | 64 | def test_update_local_storage_usage(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 104 | def test_remote_write_metrics(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 143 | def test_retrieve_and_store_speed(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 161 | def test_multiple_lookup_operations(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 180 | def test_mixed_remote_operations(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 273 | def test_zero_division_protection(stats_monitor): | CODE |
| LOW | tests/test_observability.py | 284 | def _cleanup_prometheus_logger(): | CODE |
| LOW | tests/test_observability.py | 318 | def test_prometheus_logger_default_buckets(_cleanup_prometheus_logger): | CODE |
| LOW | tests/test_observability.py | 326 | def test_prometheus_logger_custom_buckets(_cleanup_prometheus_logger): | CODE |
| LOW | tests/test_observability.py | 346 | def test_prometheus_logger_partial_custom_buckets( | CODE |
| LOW | tests/test_observability.py | 373 | def test_prometheus_logger_get_or_create_with_config( | CODE |
| LOW | tests/test_observability.py | 393 | def test_prometheus_logger_get_or_create_allows_multiple_roles( | CODE |
| LOW | tests/test_observability.py | 408 | def test_prometheus_logger_label_view_rebinds_dynamic_metrics( | CODE |
| LOW | tests/test_observability.py | 438 | def test_prometheus_logger_reset_reinitializes_all_label_views( | CODE |
| LOW | tests/test_banner.py | 35 | def test_banner_contains_version_links_and_opt_out_hint(): | CODE |
| LOW⚡ | tests/test_banner.py | 46 | def test_banner_is_plain_on_non_tty_stream(): | CODE |
| LOW⚡ | tests/test_banner.py | 52 | def test_banner_is_colored_on_tty_stream(): | CODE |
| LOW⚡ | tests/test_banner.py | 60 | def test_banner_prints_at_most_once_per_process(): | CODE |
| LOW⚡ | tests/test_banner.py | 70 | def test_banner_disabled_by_env_var(monkeypatch, value): | CODE |
| LOW⚡ | tests/test_banner.py | 77 | def test_banner_not_disabled_by_falsy_env_var(monkeypatch): | CODE |
| LOW | tests/test_build_profiles_rocm.py | 64 | def test_hipify_wrapper_returns_paths_relative_to_project_root( | CODE |
| LOW | tests/test_build_profiles_rocm.py | 81 | def test_hipify_wrapper_copies_headers_into_the_output_tree( | CODE |
| LOW | tests/test_build_profiles_rbln.py | 17 | def test_detects_an_importable_torch_rbln( | CODE |
| 6510 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/mp_coordinator/mp_server_harness.py | 159 | Serve a coordinator on a thread for the duration of the block. Args: config: Its configuration; :func:`coor | STRING |
| HIGH | tests/v1/multiprocess/transport_test_utils.py | 38 | Build a request-server config from a loopback test URL. Args: transport: Request transport to exercise. | STRING |
| HIGH | tests/v1/distributed/test_memory_capacity.py | 170 | Build a config whose derived capacity equals ``capacities``. Args: capacities: The per-medium result the co | STRING |
| HIGH | tests/v1/storage_backend/test_raw_block_core.py | 119 | Record and submit a batch through the wrapped Rust implementation. Args: offsets: Device byte offse | STRING |
| HIGH | setup_extensions/storage_backend_profiles/nixl.py | 29 | Build the isolated C++20 ``lmcache_nixl`` extension. Args: extra_cxx_flags: Platform-specific compi | STRING |
| HIGH | setup_extensions/build_profiles/rocm.py | 28 | Hipify ``csrc/cuda`` and return paths for the requested source files. Args: source_names: Base names of the | STRING |
| HIGH | examples/token_dropping/utils.py | 163 | Move key cache RoPE from old positions to new positions. Args: kv_tensor: The KV cache tensor of shape [2, L | STRING |
| HIGH | examples/token_dropping/utils.py | 234 | Score generated responses against ground-truth choice letters. Args: ground_truth: list of ground-truth let | STRING |
| HIGH | benchmarks/long_doc_qa/long_doc_qa.py | 333 | Repeat each prompt in the list for a specified number of times. The order of prompts in the output list depends | STRING |
| HIGH | …sts/multiprocess/scripts/workloads/vllm/hma-lm-eval.sh | 184 | Return the gsm8k (exact_match, stderr) from an lm_eval results directory. Prefers the strict-match variant; falls b | STRING |
| HIGH | lmcache/v1/memory_management.py | 1423 | Allocate a block of memory from the virtual address space of a given size. The actual allocated size co | STRING |
| HIGH | lmcache/v1/memory_management.py | 1479 | Allocate blocks of memory from the virtual address space of a given size and batch size. The actual all | STRING |
| HIGH | lmcache/v1/hidden_state_store.py | 123 | Store hidden_states chunked under the same keys as KV. Args: token_ids: 1-D int tensor or list of t | STRING |
| HIGH | lmcache/v1/kv_layer_groups.py | 83 | Partition layer indices by :data:`LayerGroupIdentity`. Args: kv_caches: Registered KV cache structure, one | STRING |
| HIGH | lmcache/v1/kv_layer_groups.py | 644 | Calculate the number of blocks for a given number of tokens in a specified kernel group. Args: | STRING |
| HIGH | lmcache/v1/protocol.py | 104 | Pad a shape with fewer than 4 dimensions to 4D using trailing zeros. Shapes that are already 4D are returned as | STRING |
| HIGH | lmcache/v1/config_base.py | 51 | Parse local disk path configuration. Accepts a single path or comma-separated paths, each optionally prefixed w | STRING |
| HIGH | lmcache/v1/rpc_utils.py | 185 | Keep an IPC socket path within the ``sockaddr_un`` length limit. The descriptive path is preferred for readability/ | STRING |
| HIGH | lmcache/v1/memory_allocators/mixed_memory_allocator.py | 98 | Allocate one object from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shape or s | STRING |
| HIGH | lmcache/v1/memory_allocators/mixed_memory_allocator.py | 139 | Allocate multiple objects from the mixed pinned/buffer allocator. Args: shapes: Logical tensor shap | STRING |
| HIGH | …v1/memory_allocators/paged_cpu_gpu_memory_allocator.py | 99 | Allocate from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape or shapes | STRING |
| HIGH | …v1/memory_allocators/paged_cpu_gpu_memory_allocator.py | 128 | Allocate a batch from the selected CPU or GPU paged allocator. Args: shapes: Logical tensor shape o | STRING |
| HIGH | lmcache/v1/memory_allocators/lazy_memory_allocator.py | 28 | Get the NUMA ID for the current GPU Args: numa_mapping (NUMAMapping): The NUMA mapping object. Re | STRING |
| HIGH | lmcache/v1/memory_allocators/devdax_memory_allocator.py | 280 | Map one Device-DAX device and append it to the pool as ACTIVE. The caller must hold ``host_mem_lock`` (except d | STRING |
| HIGH | lmcache/v1/memory_allocators/devdax_memory_allocator.py | 753 | Map an additional Device-DAX device and add it to the pool. The new arena is immediately available as overflow; | STRING |
| HIGH | lmcache/v1/memory_allocators/devdax_memory_allocator.py | 804 | Retire a Device-DAX arena from the pool. The arena stops accepting new allocations. If it has no live allocatio | STRING |
| HIGH | lmcache/v1/memory_allocators/devdax_memory_allocator.py | 841 | Return the status of the arena registered at ``device_path``. Args: device_path: The exact path use | STRING |
| HIGH | lmcache/v1/mp_coordinator/discovery.py | 62 | Return the instance of ``member_type``, building it once. Args: member_type: The class to look up. | STRING |
| HIGH | lmcache/v1/mp_coordinator/discovery.py | 153 | Yield the ``base`` subclasses the named modules define. A name may address a package -- walked entire, subpackages | STRING |
| HIGH | lmcache/v1/mp_coordinator/schemas.py | 50 | Decode a base64 token string produced by :func:`encode_tokens`. Args: tokens_b64: Base64 of a little-endian | STRING |
| HIGH | lmcache/v1/mp_coordinator/schemas.py | 297 | Enforce encoding-level constraints on every entry. Args: value: The hydrated batches. Retu | STRING |
| HIGH | lmcache/v1/mp_coordinator/schemas.py | 361 | Reject undecodable keys at request validation (surfaced as 422). Args: value: The hydrated keys. | STRING |
| HIGH | lmcache/v1/mp_coordinator/schemas.py | 481 | Reject a malformed token buffer at request validation. Validating here returns 422 rather than the 500 a decode | STRING |
| HIGH | lmcache/v1/mp_coordinator/blend_client.py | 166 | Build a started client for ``url``; an empty URL returns ``None``. Args: url: Coordinator base URL; | STRING |
| HIGH | lmcache/v1/mp_coordinator/cache_events.py | 753 | Create the configured MP-server cache-event transport. Args: config: Coordinator connection and event-sink | STRING |
| HIGH | lmcache/v1/mp_coordinator/registrar.py | 45 | Register an MP server with the coordinator and return its id. Args: client: The HTTP client to send with. | STRING |
| HIGH | lmcache/v1/mp_coordinator/events_replay.py | 132 | Read one or more ``events``-level files into one stream. Args: paths: The files, typically one per | STRING |
| HIGH | lmcache/v1/mp_coordinator/events_replay.py | 265 | ``POST /events`` with one batch. Args: batch: The batch in wire form, one element of a | STRING |
| HIGH | lmcache/v1/mp_coordinator/events_replay.py | 380 | Deliver every record of ``trace`` to ``target``, in order, logging each one. Args: trace: The stream. | STRING |
| HIGH | lmcache/v1/mp_coordinator/ingest/event_gate.py | 140 | Offer ``batches`` to the gate in list order. Args: batches: Event batches ordered by their source. | STRING |
| HIGH | lmcache/v1/mp_coordinator/utils/encoding.py | 32 | Rebuild a key from :func:`encode_key`. Args: encoded: An :func:`encode_key` value, as read back from an | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/events_api.py | 28 | Offer a list of cache-event batches to the ingest gate. Batches are offered in list order; per instance they must b | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/metrics_api.py | 16 | Return Prometheus metrics when the coordinator uses pull mode. Args: request: Incoming request carrying the | STRING |
| HIGH | …che/v1/mp_coordinator/http_apis/instances_usage_api.py | 201 | Return one MP server's memory status. Args: instance_id: The server to report on. request: Carries | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/directory_api.py | 43 | Resolve keys — or a request's token sequence — to placements. The tokens form hashes ``token_ids`` with the fleet's | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/cache_api.py | 51 | Submit a warm prefetch of a token sequence on one MP server. Resolves ``body.instance_id`` in the registry and prox | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/cache_api.py | 105 | Proxy a warm-prefetch status poll to the owning MP server. The warm holds no lock, so this poll only reports progre | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/cache_api.py | 152 | Delete a token sequence on one MP server, per ``body.tier`` (l1 / l2 / all). Args: body: Target instance, m | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/dependencies.py | 69 | Return the per-app :class:`CoordinatorContext`. Args: request: The FastAPI request whose ``app.state`` carr | STRING |
| HIGH | lmcache/v1/mp_coordinator/http_apis/dependencies.py | 88 | Return the lifespan-bound outbound client, or raise if unset. Args: request: The FastAPI request. Retu | STRING |
| HIGH | lmcache/v1/mp_coordinator/persistence/metadata.py | 127 | Parse a document and check its shape. Args: raw: The stored bytes. Returns: Th | STRING |
| HIGH | lmcache/v1/mp_coordinator/persistence/checkpoint.py | 151 | Decode a checkpoint written by :func:`_write_checkpoint`. Args: stream: Positioned at the start of the chec | STRING |
| HIGH | lmcache/v1/mp_coordinator/persistence/quiesce.py | 77 | Hold while capturing; no batch is applied for the duration. Args: timeout: Seconds to wait for in-f | STRING |
| HIGH | …che/v1/mp_coordinator/controllers/eviction_http_api.py | 295 | Pin a token sequence's keys in the L2 eviction plan. The coordinator resolves the token sequence to its object | STRING |
| HIGH | …che/v1/mp_coordinator/controllers/eviction_http_api.py | 332 | Unpin a token sequence's keys from the L2 eviction plan. Symmetric with pin: resolves the keys locally and rele | STRING |
| HIGH | lmcache/v1/mp_coordinator/controllers/__init__.py | 39 | Discover and construct every controller available to the coordinator. Args: config: Passed to each ``from_c | STRING |
| HIGH | lmcache/v1/mp_coordinator/controllers/__init__.py | 77 | Return the names an operator listed under ``key``, validated. Args: extra_config: The coordinator's untyped | STRING |
| HIGH | lmcache/v1/mp_coordinator/controllers/__init__.py | 107 | Drop the controllers an operator asked not to be built. Naming a class here is how a built-in controller gets out o | STRING |
| HIGH | …ache/v1/mp_coordinator/controllers/prefetch_manager.py | 45 | ``POST /cache/prefetches`` to ``target`` and return its JSON reply. Args: target: The MP server to | STRING |
| HIGH | …ache/v1/mp_coordinator/controllers/prefetch_manager.py | 82 | Proxy ``GET /cache/prefetches/{request_id}`` on ``target``. Args: target: The MP server holding the | STRING |
| 297 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/conftest.py | 501 | except Exception as e: | CODE |
| LOW | tests/conftest.py | 689 | except Exception as e: | CODE |
| LOW⚡ | tests/conftest.py | 779 | except Exception as e: | CODE |
| MEDIUM⚡ | tests/conftest.py | 781 | print("Error during close obj:%s - %s", obj, e) | CODE |
| LOW | tests/conftest.py | 917 | except Exception as e: | CODE |
| LOW | tests/v1/test_nixl_storage.py | 59 | except Exception as exc: | CODE |
| LOW | tests/v1/test_nixl_storage.py | 264 | except Exception: | CODE |
| MEDIUM | tests/v1/test_address_manager.py | 901 | def alloc_worker(): | CODE |
| MEDIUM | tests/v1/test_address_manager.py | 914 | def free_worker(): | CODE |
| MEDIUM | tests/v1/test_address_manager.py | 1071 | def batch_alloc_worker(): | CODE |
| MEDIUM | tests/v1/test_address_manager.py | 1083 | def free_worker(): | CODE |
| LOW | tests/v1/test_address_manager.py | 817 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 864 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 911 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 923 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 1003 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 1040 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 1080 | except Exception as e: | CODE |
| LOW | tests/v1/test_address_manager.py | 1092 | except Exception as e: | CODE |
| MEDIUM | tests/v1/utils.py | 197 | print(f"Error during close pending tasks: - {e}") | CODE |
| LOW | tests/v1/utils.py | 47 | except Exception: | CODE |
| LOW | tests/v1/utils.py | 70 | except Exception: | CODE |
| LOW | tests/v1/utils.py | 103 | except Exception: | CODE |
| LOW | tests/v1/utils.py | 123 | except Exception: | CODE |
| LOW | tests/v1/utils.py | 196 | except Exception as e: | CODE |
| LOW | tests/v1/test_fused_rerope.py | 22 | except Exception: # allow running as a plain script (bench) without pytest | CODE |
| LOW | tests/v1/test_fused_rerope.py | 36 | except Exception: # CPU-only / no built cuda_ops (e.g. the unit-test runner) | CODE |
| LOW | tests/v1/test_remote_mla_worker_id_as0.py | 181 | except Exception as e: | CODE |
| MEDIUM | tests/v1/test_remote_mla_worker_id_as0.py | 182 | print(f"Error during shutdown: {e}") | CODE |
| MEDIUM | tests/v1/test_atom_mp_adapter.py | 615 | def submit() -> None: | CODE |
| LOW | tests/v1/test_atom_mp_adapter.py | 771 | except Exception as error: | CODE |
| MEDIUM | tests/v1/multiprocess/test_session.py | 231 | def writer() -> None: | CODE |
| LOW | tests/v1/multiprocess/test_session.py | 200 | except Exception as exc: | CODE |
| LOW | tests/v1/multiprocess/test_session.py | 228 | except Exception as exc: | CODE |
| LOW | tests/v1/multiprocess/test_session.py | 236 | except Exception as exc: | CODE |
| LOW | tests/v1/multiprocess/test_cache_server.py | 48 | except Exception: | CODE |
| LOW⚡ | tests/v1/multiprocess/test_cache_server.py | 385 | except Exception as e: | CODE |
| MEDIUM⚡ | tests/v1/multiprocess/test_cache_server.py | 386 | print(f"Error during unregister: {e}") | CODE |
| MEDIUM | tests/v1/multiprocess/test_cache_server.py | 43 | def _has_working_new_shared_cuda() -> bool: | CODE |
| LOW | tests/v1/multiprocess/test_futures.py | 26 | except Exception: | CODE |
| LOW | tests/v1/multiprocess/test_custom_types.py | 193 | except Exception as e: | CODE |
| LOW | tests/v1/multiprocess/test_custom_types.py | 315 | except Exception as e: | CODE |
| LOW | tests/v1/multiprocess/test_mq.py | 222 | except Exception as e: | CODE |
| LOW | …1/lookup_client/test_chunk_statistics_lookup_client.py | 320 | except Exception: | CODE |
| LOW | …sts/v1/distributed/test_native_connector_l2_adapter.py | 77 | except Exception as e: | CODE |
| LOW | …sts/v1/distributed/test_native_connector_l2_adapter.py | 103 | except Exception as e: | CODE |
| LOW | …s/v1/distributed/test_valkey_l2_adapter_integration.py | 129 | except Exception: | CODE |
| LOW | …s/v1/distributed/test_valkey_l2_adapter_integration.py | 138 | except Exception: | CODE |
| LOW | …v1/distributed/test_bigtable_l2_adapter_integration.py | 87 | except Exception: | CODE |
| LOW | …v1/distributed/test_bigtable_l2_adapter_integration.py | 111 | except Exception: | CODE |
| LOW | tests/v1/distributed/test_s3_l2_adapter.py | 205 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_s3_l2_adapter.py | 240 | except Exception: | CODE |
| LOW | tests/v1/distributed/test_s3_l2_adapter.py | 282 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_s3_l2_adapter.py | 286 | except Exception: | CODE |
| LOW | tests/v1/distributed/test_aerospike_l2_integration.py | 47 | except Exception: | CODE |
| MEDIUM | tests/v1/distributed/test_l1_manager.py | 1733 | def worker(thread_id): | CODE |
| LOW | tests/v1/distributed/test_l1_manager.py | 1753 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_l1_manager.py | 2436 | except Exception as e: | CODE |
| LOW | tests/v1/distributed/test_raw_block_l2_adapter.py | 39 | except Exception: | CODE |
| MEDIUM | tests/v1/distributed/test_raw_block_l2_adapter.py | 33 | def _has_ext() -> bool: | CODE |
| 876 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/test_health_monitor_fallback_recovery.py | 532 | except asyncio.CancelledError: | CODE |
| HIGH | tests/v1/test_torch_ops.py | 81 | except ImportError: | CODE |
| HIGH | tests/v1/test_torch_ops.py | 101 | except (ImportError, RuntimeError): | CODE |
| HIGH | tests/v1/test_cuda_ops_parity.py | 119 | except ValueError: | CODE |
| HIGH | tests/v1/test_cuda_ops_parity.py | 123 | except ValueError: | CODE |
| HIGH | tests/v1/test_cuda_ops_parity.py | 283 | except (ValueError, TypeError): | CODE |
| HIGH | tests/v1/test_address_manager.py | 908 | except RuntimeError: | CODE |
| HIGH | tests/v1/test_address_manager.py | 1078 | except RuntimeError: | CODE |
| HIGH | tests/v1/test_address_manager.py | 993 | except RuntimeError: | CODE |
| HIGH | tests/v1/utils.py | 87 | except OSError: | CODE |
| HIGH | tests/v1/utils.py | 692 | except AttributeError: | CODE |
| HIGH | tests/v1/utils.py | 740 | except (ValueError, TypeError): | CODE |
| HIGH | tests/v1/utils.py | 78 | except OSError: | CODE |
| HIGH | tests/v1/test_nixl_put_refcount.py | 46 | except ImportError: | CODE |
| HIGH | tests/v1/test_freeze_mode_integration.py | 108 | except requests.exceptions.RequestException: | CODE |
| HIGH | tests/v1/mp_coordinator/test_integration.py | 59 | except requests.RequestException: | CODE |
| HIGH | …1/lookup_client/test_chunk_statistics_lookup_client.py | 320 | except Exception: | CODE |
| HIGH | …sts/v1/distributed/test_native_connector_l2_adapter.py | 138 | except BlockingIOError: | CODE |
| HIGH | …sts/v1/distributed/test_native_connector_l2_adapter.py | 159 | except OSError: | CODE |
| HIGH | …sts/v1/distributed/test_native_connector_l2_adapter.py | 197 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_mock_l2_adapter.py | 94 | except BlockingIOError: | CODE |
| HIGH | …s/v1/distributed/test_valkey_l2_adapter_integration.py | 80 | except BlockingIOError: | CODE |
| HIGH | …v1/distributed/test_bigtable_l2_adapter_integration.py | 66 | except BlockingIOError: | CODE |
| HIGH | …v1/distributed/test_bigtable_l2_adapter_integration.py | 87 | except Exception: | CODE |
| HIGH | …v1/distributed/test_bigtable_l2_adapter_integration.py | 111 | except Exception: | CODE |
| HIGH | tests/v1/distributed/test_s3_l2_adapter.py | 360 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_s3_l2_adapter.py | 286 | except Exception: | CODE |
| HIGH | tests/v1/distributed/test_s3_l2_adapter.py | 240 | except Exception: | CODE |
| HIGH | tests/v1/distributed/test_nixl_store_l2_adapter.py | 144 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_aerospike_l2_integration.py | 81 | except BlockingIOError: | CODE |
| HIGH | …s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py | 188 | except BlockingIOError: | CODE |
| HIGH | …/distributed/test_devdax_l1_reconfigure_integration.py | 98 | except FileNotFoundError: | CODE |
| HIGH | tests/v1/distributed/test_nixl_native_integration.py | 455 | except FileNotFoundError: | CODE |
| HIGH | tests/v1/distributed/test_hfbucket_l2_adapter.py | 169 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_valkey_l2_adapter.py | 277 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_valkey_l2_adapter.py | 296 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_valkey_l2_adapter.py | 315 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_valkey_l2_adapter.py | 334 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_fault_inject_l2_adapter.py | 73 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_raw_block_l2_adapter.py | 128 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_l2_adapter_factory.py | 1065 | except RuntimeError: | CODE |
| HIGH | tests/v1/distributed/test_cache_salt_l2_eviction.py | 83 | except BlockingIOError: | CODE |
| HIGH | …sts/v1/distributed/test_resp_l2_adapter_integration.py | 97 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/test_mooncake_store_l2_adapter.py | 127 | except BlockingIOError: | CODE |
| HIGH | tests/v1/distributed/serde/test_async_processor.py | 67 | except OSError: | CODE |
| HIGH | tests/v1/lmcache_native/test_periodic_event_notifier.py | 53 | except BlockingIOError: | CODE |
| HIGH | tests/v1/storage_backend/test_hf3fs_connector.py | 278 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_hf3fs_connector.py | 282 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_resp_connector.py | 420 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_nixl_shared_pool.py | 49 | except ImportError: | CODE |
| HIGH | tests/v1/storage_backend/test_pd_backend_async.py | 252 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_pd_backend_async.py | 421 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/raw_block_test_utils.py | 189 | except BlockingIOError: | CODE |
| HIGH | tests/v1/storage_backend/raw_block_test_utils.py | 297 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_bigtable_integration.py | 98 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_bigtable_integration.py | 111 | except Exception: | CODE |
| HIGH | tests/v1/storage_backend/test_audit_connector.py | 74 | except Exception: | CODE |
| HIGH | tests/v1/shm_allocator/shmfile_connector.py | 302 | except Exception: | CODE |
| HIGH | tests/v1/shm_allocator/shmfile_connector.py | 307 | except Exception: | CODE |
| HIGH | tests/v1/shm_allocator/verify_shmfile_tcp.py | 82 | except FileNotFoundError: | CODE |
| 106 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/translate_docs_zh.py | 5 | CODE | |
| LOW | tests/v1/test_vllm_sync_load_pin_cleanup.py | 25 | CODE | |
| LOW | tests/v1/utils.py | 122 | CODE | |
| LOW | tests/v1/test_nixl_put_refcount.py | 42 | CODE | |
| LOW | tests/v1/test_nixl_put_refcount.py | 43 | CODE | |
| LOW | tests/v1/test_trtllm_integration.py | 33 | CODE | |
| LOW | tests/v1/mp_coordinator/test_instances_usage_api.py | 8 | CODE | |
| LOW | tests/v1/mp_coordinator/test_events_replay.py | 10 | CODE | |
| LOW | tests/v1/multiprocess/test_blend_store.py | 22 | CODE | |
| LOW | tests/v1/multiprocess/test_blend_store.py | 24 | CODE | |
| LOW | tests/v1/multiprocess/test_raw_block_l2_adapter.py | 4 | CODE | |
| LOW | tests/v1/multiprocess/test_engine_driven_transfer.py | 393 | CODE | |
| LOW | tests/v1/multiprocess/test_engine_driven_transfer.py | 756 | CODE | |
| LOW | tests/v1/distributed/conftest.py | 7 | CODE | |
| LOW | tests/v1/distributed/test_aerospike_l2_integration.py | 54 | CODE | |
| LOW | tests/v1/distributed/test_memory_capacity.py | 27 | CODE | |
| LOW | tests/v1/distributed/test_raw_block_l2_adapter.py | 36 | CODE | |
| LOW | tests/v1/distributed/test_l2_adapter_factory.py | 35 | CODE | |
| LOW | tests/v1/distributed/test_storage_manager_l2_keys.py | 20 | CODE | |
| LOW | tests/v1/distributed/test_storage_manager_l2_keys.py | 21 | CODE | |
| LOW | tests/v1/distributed/serde/test_asym_k16_v8_v_only.py | 27 | CODE | |
| LOW | tests/v1/distributed/serde/test_asym_k16_v8_multi.py | 12 | CODE | |
| LOW | tests/v1/distributed/serde/test_multi.py | 25 | CODE | |
| LOW | tests/v1/mp_observability/test_config.py | 79 | CODE | |
| LOW | …p_observability/subscribers/metrics/counter_helpers.py | 13 | CODE | |
| LOW | …v1/platform/devices/npu/test_npu_torch_ops_fallback.py | 35 | CODE | |
| LOW | tests/v1/platform/devices/npu/test_npu_ipc_wrapper.py | 248 | CODE | |
| LOW | …sts/v1/platform/devices/npu/test_npu_event_ordering.py | 27 | CODE | |
| LOW | …s/v1/platform/devices/musa/test_musa_event_ordering.py | 52 | CODE | |
| LOW | tests/v1/platform/devices/rbln/test_rbln_kv_layout.py | 26 | CODE | |
| LOW | tests/v1/platform/devices/rbln/test_rbln_kv_layout.py | 26 | CODE | |
| LOW | tests/v1/storage_backend/test_storage_plugin.py | 28 | CODE | |
| LOW | tests/v1/storage_backend/test_raw_block_device.py | 4 | CODE | |
| LOW | tests/v1/storage_backend/test_rust_raw_block_backend.py | 4 | CODE | |
| LOW | tests/v1/storage_backend/test_rust_raw_block_backend.py | 51 | CODE | |
| LOW | tests/v1/storage_backend/test_nixl_shared_pool.py | 45 | CODE | |
| LOW | tests/v1/storage_backend/test_nixl_shared_pool.py | 46 | CODE | |
| LOW | tests/v1/storage_backend/test_raw_block_core.py | 4 | CODE | |
| LOW | tests/v1/storage_backend/raw_block_test_utils.py | 4 | CODE | |
| LOW | tests/v1/storage_backend/test_raw_block_uring_cmd.py | 58 | CODE | |
| LOW | tests/cli/commands/trace/test_dispatch.py | 6 | CODE | |
| LOW | tests/cli/commands/trace/test_driver.py | 13 | CODE | |
| LOW | tests/cli/commands/trace/test_replay_events_command.py | 5 | CODE | |
| LOW | setup_extensions/__init__.py | 14 | CODE | |
| LOW | setup_extensions/__init__.py | 15 | CODE | |
| LOW | setup_extensions/__init__.py | 15 | CODE | |
| LOW | setup_extensions/__init__.py | 16 | CODE | |
| LOW | setup_extensions/common_cpp.py | 17 | CODE | |
| LOW | setup_extensions/common_cpp.py | 20 | CODE | |
| LOW | setup_extensions/storage_backend_profiles/aerospike.py | 16 | CODE | |
| LOW | setup_extensions/storage_backend_profiles/hf3fs.py | 26 | CODE | |
| LOW | setup_extensions/storage_backend_profiles/__init__.py | 15 | CODE | |
| LOW | setup_extensions/storage_backend_profiles/mooncake.py | 15 | CODE | |
| LOW | setup_extensions/storage_backend_profiles/nixl.py | 12 | CODE | |
| LOW | setup_extensions/build_profiles/rocm.py | 16 | CODE | |
| LOW | setup_extensions/build_profiles/rbln.py | 22 | CODE | |
| LOW | setup_extensions/build_profiles/maca.py | 35 | CODE | |
| LOW | setup_extensions/build_profiles/__init__.py | 15 | CODE | |
| LOW | setup_extensions/build_profiles/__init__.py | 18 | CODE | |
| LOW | setup_extensions/build_profiles/musa.py | 13 | CODE | |
| 802 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/v1/test_gpu_connector.py | 0 | :param int size: the size of the pinned memory in bytes. | STRING |
| HIGH | tests/v1/test_xpu_connector.py | 0 | :param int size: the size of the pinned memory in bytes. | STRING |
| HIGH | lmcache/v1/memory_allocators/pin_memory_allocator.py | 0 | :param int size: the size of the pinned memory in bytes. | STRING |
| HIGH | lmcache/v1/memory_allocators/host_memory_allocator.py | 0 | :param int size: the size of the pinned memory in bytes. | STRING |
| HIGH | tests/v1/test_vllm_mp_adapter.py | 0 | restore the process-global isolated-ipc switch after the test. | STRING |
| HIGH | tests/v1/platform/test_event_ipc.py | 0 | restore the process-global isolated-ipc switch after the test. | STRING |
| HIGH | tests/v1/platform/devices/cuda/test_cuda_ipc_wrapper.py | 0 | restore the process-global isolated-ipc switch after the test. | STRING |
| HIGH | tests/v1/distributed/test_mock_l2_adapter.py | 0 | listener that records all events for inspection in tests. | STRING |
| HIGH | tests/v1/distributed/test_nixl_store_l2_adapter.py | 0 | listener that records all events for inspection in tests. | STRING |
| HIGH | …s/v1/distributed/test_nixl_store_dynamic_l2_adapter.py | 0 | listener that records all events for inspection in tests. | STRING |
| HIGH | tests/v1/distributed/test_l1_manager.py | 0 | create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes). | STRING |
| HIGH | …sts/v1/distributed/test_distributed_storage_manager.py | 0 | create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes). | STRING |
| HIGH | tests/v1/distributed/test_l1_memory_manager.py | 0 | create a large memorylayoutdesc that will exhaust small memory. each allocation is 8mb (2m elements * 4 bytes). | STRING |
| HIGH | …sts/v1/mp_observability/subscribers/metrics/test_l2.py | 0 | capture counters before the test; yield a callable that returns deltas. | STRING |
| HIGH | …mp_observability/subscribers/metrics/test_cb_server.py | 0 | capture counters before the test; yield a callable that returns deltas. | STRING |
| HIGH | …rvability/subscribers/metrics/test_l1_eviction_loop.py | 0 | capture counters before the test; yield a callable that returns deltas. | STRING |
| HIGH | …v1/mp_observability/subscribers/metrics/test_lookup.py | 0 | capture counters before the test; yield a callable that returns deltas. | STRING |
| HIGH | lmcache/v1/memory_allocators/pin_memory_allocator.py | 0 | allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor | STRING |
| HIGH | lmcache/v1/memory_allocators/host_memory_allocator.py | 0 | allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor | STRING |
| HIGH | lmcache/v1/memory_allocators/gpu_memory_allocator.py | 0 | allocate one gpu-backed memory object. args: shapes: logical tensor shape or shapes to allocate. dtypes: logical tensor | STRING |
| HIGH | lmcache/v1/memory_allocators/pin_memory_allocator.py | 0 | allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: l | STRING |
| HIGH | lmcache/v1/memory_allocators/host_memory_allocator.py | 0 | allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: l | STRING |
| HIGH | lmcache/v1/memory_allocators/gpu_memory_allocator.py | 0 | allocate multiple gpu-backed memory objects. args: shapes: logical tensor shape or shapes for each allocation. dtypes: l | STRING |
| HIGH | lmcache/v1/memory_allocators/pin_memory_allocator.py | 0 | free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type s | STRING |
| HIGH | lmcache/v1/memory_allocators/host_memory_allocator.py | 0 | free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type s | STRING |
| HIGH | lmcache/v1/memory_allocators/gpu_memory_allocator.py | 0 | free one gpu-backed memory object. args: memory_obj: memory object to release. allocator_type: optional allocator type s | STRING |
| HIGH | lmcache/v1/memory_allocators/pin_memory_allocator.py | 0 | free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocato | STRING |
| HIGH | lmcache/v1/memory_allocators/host_memory_allocator.py | 0 | free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocato | STRING |
| HIGH | lmcache/v1/memory_allocators/gpu_memory_allocator.py | 0 | free multiple gpu-backed memory objects. args: memory_objs: memory objects to release. allocator_type: optional allocato | STRING |
| HIGH | lmcache/v1/multiprocess/engine_module.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | lmcache/v1/multiprocess/modules/p2p_controller.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | …ache/v1/multiprocess/modules/engine_driven_transfer.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | lmcache/v1/multiprocess/modules/lookup.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | …che/v1/multiprocess/modules/lmcache_driven_transfer.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | lmcache/v1/multiprocess/modules/management.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | lmcache/v1/multiprocess/modules/experimental/qstore.py | 0 | return the shared engine context. exposed for testing only. | STRING |
| HIGH | …ache/v1/multiprocess/modules/engine_driven_transfer.py | 0 | refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: | STRING |
| HIGH | …che/v1/multiprocess/modules/lmcache_driven_transfer.py | 0 | refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: | STRING |
| HIGH | lmcache/v1/multiprocess/modules/experimental/qstore.py | 0 | refresh the worker's last-seen time and mark it ping-proven. a no-op if the instance is not tracked. args: instance_id: | STRING |
| HIGH | …ache/v1/multiprocess/modules/engine_driven_transfer.py | 0 | return the number of currently registered instances. | STRING |
| HIGH | …che/v1/multiprocess/modules/lmcache_driven_transfer.py | 0 | return the number of currently registered instances. | STRING |
| HIGH | lmcache/v1/multiprocess/modules/experimental/qstore.py | 0 | return the number of currently registered instances. | STRING |
| HIGH | …ache/v1/multiprocess/modules/engine_driven_transfer.py | 0 | reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that h | STRING |
| HIGH | …che/v1/multiprocess/modules/lmcache_driven_transfer.py | 0 | reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that h | STRING |
| HIGH | lmcache/v1/multiprocess/modules/experimental/qstore.py | 0 | reap q ring registrations that have gone silent. a ping-proven instance is judged against ``reap_timeout_s``; one that h | STRING |
| HIGH | lmcache/v1/distributed/transfer_channel/abstract.py | 0 | discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer n | STRING |
| HIGH | …/distributed/transfer_channel/impl/mooncake_te_impl.py | 0 | discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer n | STRING |
| HIGH | …ache/v1/distributed/transfer_channel/impl/nixl_impl.py | 0 | discard the client for ``peer_advertise_url`` and free its resources. call this when reads from the peer are no longer n | STRING |
| HIGH | …che/v1/distributed/l2_adapters/aerospike_l2_adapter.py | 0 | 3fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapter | STRING |
| HIGH | …che/v1/distributed/l2_adapters/fs_native_l2_adapter.py | 0 | 3fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapter | STRING |
| HIGH | lmcache/v1/distributed/l2_adapters/hf3fs_l2_adapter.py | 0 | 3fs native l2 adapter config and factory. backed by the native c++ 3fs connector wrapped with ``nativeconnectorl2adapter | STRING |
| HIGH | …e/v1/mp_observability/subscribers/logging/mp_server.py | 0 | l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when ope | STRING |
| HIGH | lmcache/v1/mp_observability/subscribers/logging/sm.py | 0 | l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when ope | STRING |
| HIGH | lmcache/v1/mp_observability/subscribers/logging/l1.py | 0 | l1 logging subscriber — debug logs for l1manager events. logs are emitted via python's standard logging module. when ope | STRING |
| HIGH | lmcache/v1/platform/base/pin_memory.py | 0 | unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if ` | STRING |
| HIGH | lmcache/v1/platform/base/device_spec.py | 0 | unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if ` | STRING |
| HIGH | lmcache/v1/platform/devices/cuda/pin_memory.py | 0 | unpin a previously pinned host memory region. args: ptr: raw pointer (data_ptr) to the memory region. returns: true if ` | STRING |
| HIGH | lmcache/v1/storage_backend/pd_backend_async.py | 0 | remove the key from the storage backend. :param key: the key to remove. | STRING |
| HIGH | lmcache/v1/storage_backend/nixl_storage_backend.py | 0 | remove the key from the storage backend. :param key: the key to remove. | STRING |
| HIGH | lmcache/v1/storage_backend/pd_backend.py | 0 | remove the key from the storage backend. :param key: the key to remove. | STRING |
| 44 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | pyproject_cli.toml | 61 | COMMENT | |
| LOW | pyproject_cli.toml | 101 | [tool.ruff.lint.isort] | COMMENT |
| LOW | pyproject.toml | 81 | "F", | COMMENT |
| LOW | pyproject.toml | 101 | "F405", "F403", | COMMENT |
| LOW | pyproject.toml | 161 | disable_error_code = [ | COMMENT |
| LOW | pyproject.toml | 201 | [tool.cibuildwheel] | COMMENT |
| LOW | csrc/engine_kv_format.h | 181 | #define LMC_KV_FORMAT_HD | COMMENT |
| LOW | csrc/kv_transfer_plan_types.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/kv_transfer_plan_types.h | 21 | #endif | COMMENT |
| LOW | csrc/storage_backends/keys.h | 21 | pos += to.size(); | COMMENT |
| LOW | csrc/storage_backends/event_notifier.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/connector_base.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/connector_types.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/nixl/storage.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/nixl/connector.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/mooncake/connector.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/mooncake/connector.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/redis/connector.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/redis/connector.h | 61 | // - model_name: 25-50 chars (e.g., "meta-llama/Llama-3-70b-instruct") | COMMENT |
| LOW | csrc/storage_backends/aerospike/connector.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/hf3fs/hf3fs_absl_init.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/hf3fs/hf3fs_absl_init.cpp | 21 | #include "absl/container/internal/hashtablez_sampler.h" | COMMENT |
| LOW | csrc/storage_backends/hf3fs/sharded_flat_hash_set.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/hf3fs/connector.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/hf3fs/connector.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/fs/connector.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/storage_backends/fs/connector.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda/mem_alloc.cpp | 1 | #include <cuda_runtime.h> | COMMENT |
| LOW | csrc/cuda/pybind.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda/event_recorder.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda/completion_recorder.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/cuda/event_recorder.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/lmcache_native/pybind.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/lmcache_native/periodic_event_notifier.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/mem_kernels_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/mem_kernels_sycl.cpp | 21 | // work-group handles both K and V, halving dispatch count and | COMMENT |
| LOW | csrc/sycl/mem_kernels_sycl.cpp | 1021 | offset += max_nbytes; | COMMENT |
| LOW | csrc/sycl/pybind_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/ac_enc_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/ac_enc_sycl.cpp | 21 | // (lid * BLOCK_SIZE + tx) | COMMENT |
| LOW | csrc/sycl/pos_kernels_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/pos_kernels_sycl.cpp | 21 | // | COMMENT |
| LOW | csrc/sycl/cal_cdf_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/cal_cdf_sycl.cpp | 21 | // - sub_group_size locked to 16 (native SIMD on Intel discrete GPUs). | COMMENT |
| LOW | csrc/sycl/ac_dec_sycl.cpp | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | csrc/sycl/ac_dec_sycl.cpp | 21 | // | COMMENT |
| LOW | csrc/sycl/cachegen_kernels_sycl.h | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1 | // SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1021 | (results, errors) | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1041 | /// CQE is posted, so the worker is woken without having to drain the | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1081 | } | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1181 | fn drop(&mut self) { | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1461 | // Sorted, non-overlapping fixed-buffer regions used for containment lookup. | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 1901 | Ok(()) | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 2481 | } else { | COMMENT |
| LOW | rust/raw_block/src/lib.rs | 2561 | /// in batches to maximize throughput. | COMMENT |
| LOW | tests/v1/test_mem_kernels.py | 861 | COMMENT | |
| LOW | tests/v1/test_cache_interface.py | 1 | # SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | tests/v1/test_vllm_integration.py | 1 | # SPDX-License-Identifier: Apache-2.0 | COMMENT |
| LOW | tests/v1/multiprocess/test_blend_retrieve.py | 581 | # stayed pinned in L1 for the server's lifetime, with counts stacking on every | COMMENT |
| 294 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/test_torch_ops.py | 812 | CODE | |
| LOW | tests/v1/test_torch_ops.py | 1176 | CODE | |
| LOW | tests/v1/test_torch_ops.py | 1422 | CODE | |
| LOW | tests/v1/test_torch_ops.py | 1848 | CODE | |
| LOW | tests/v1/test_torch_ops.py | 3101 | CODE | |
| LOW | tests/v1/test_cuda_ops_parity.py | 130 | CODE | |
| LOW | tests/v1/test_mp_mem_kernels.py | 88 | CODE | |
| LOW | tests/v1/test_mp_mem_kernels.py | 136 | CODE | |
| LOW | tests/v1/test_mp_mem_kernels.py | 207 | CODE | |
| LOW | tests/v1/test_address_manager.py | 891 | CODE | |
| LOW | tests/v1/test_address_manager.py | 972 | CODE | |
| LOW | tests/v1/test_address_manager.py | 1061 | CODE | |
| LOW | tests/v1/test_address_manager.py | 901 | CODE | |
| LOW | tests/v1/test_address_manager.py | 914 | CODE | |
| LOW | tests/v1/test_address_manager.py | 984 | CODE | |
| LOW | tests/v1/test_address_manager.py | 1071 | CODE | |
| LOW | tests/v1/test_address_manager.py | 1083 | CODE | |
| LOW | tests/v1/utils.py | 34 | CODE | |
| LOW | tests/v1/utils.py | 187 | CODE | |
| LOW | tests/v1/utils.py | 263 | CODE | |
| LOW | tests/v1/utils.py | 419 | CODE | |
| LOW | tests/v1/utils.py | 652 | CODE | |
| LOW | tests/v1/test_freeze_mode_integration.py | 27 | CODE | |
| LOW | tests/v1/mp_coordinator/test_blend_index.py | 230 | CODE | |
| LOW | tests/v1/mp_coordinator/test_mp_server_e2e.py | 161 | CODE | |
| LOW | tests/v1/multiprocess/test_blend_matcher.py | 544 | CODE | |
| LOW | tests/v1/multiprocess/test_blend_matcher.py | 765 | CODE | |
| LOW | tests/v1/multiprocess/test_native_state_alias_gpu.py | 79 | CODE | |
| LOW | tests/v1/multiprocess/test_raw_block_l2_adapter.py | 400 | CODE | |
| LOW | tests/v1/multiprocess/test_client.py | 98 | CODE | |
| LOW | tests/v1/distributed/test_storage_controller_utils.py | 770 | CODE | |
| LOW | tests/v1/distributed/test_s3_l2_adapter.py | 166 | CODE | |
| LOW | tests/v1/distributed/test_bitmap_ops.py | 574 | CODE | |
| LOW | tests/v1/distributed/test_nixl_store_l2_adapter.py | 709 | CODE | |
| LOW | tests/v1/distributed/test_l1_manager.py | 1723 | CODE | |
| LOW | tests/v1/distributed/test_l1_manager.py | 1733 | CODE | |
| LOW | tests/v1/distributed/test_l1_l2_state_metrics.py | 154 | CODE | |
| LOW | tests/v1/distributed/test_bigtable_l2_adapter.py | 63 | CODE | |
| LOW | tests/v1/distributed/test_bigtable_l2_adapter.py | 88 | CODE | |
| LOW | tests/v1/distributed/test_multi_l1_serving.py | 73 | CODE | |
| LOW | …sts/v1/mp_observability/subscribers/metrics/test_l2.py | 44 | CODE | |
| LOW | …sts/v1/mp_observability/subscribers/metrics/test_l2.py | 69 | CODE | |
| LOW | …v1/mp_observability/subscribers/metrics/test_engine.py | 65 | CODE | |
| LOW | …/v1/mp_observability/subscribers/metrics/otel_setup.py | 30 | CODE | |
| LOW | …/v1/mp_observability/subscribers/metrics/otel_setup.py | 60 | CODE | |
| LOW | …observability/subscribers/metrics/test_sm_lifecycle.py | 73 | CODE | |
| LOW | …v1/mp_observability/subscribers/metrics/test_lookup.py | 34 | CODE | |
| LOW | …v1/mp_observability/subscribers/metrics/test_lookup.py | 55 | CODE | |
| LOW | …sts/v1/mp_observability/subscribers/metrics/test_l1.py | 32 | CODE | |
| LOW | …p_observability/subscribers/metrics/counter_helpers.py | 31 | CODE | |
| LOW | tests/v1/cache_controller/conftest.py | 218 | CODE | |
| LOW | tests/v1/cache_controller/conftest.py | 248 | CODE | |
| LOW | tests/v1/cache_controller/conftest.py | 323 | CODE | |
| LOW | tests/v1/cache_controller/test_registry_tree.py | 451 | CODE | |
| LOW | tests/v1/cache_controller/test_registry_tree.py | 519 | CODE | |
| LOW | tests/v1/cache_controller/test_registry_tree.py | 493 | CODE | |
| LOW | tests/v1/cache_controller/test_registry_tree.py | 541 | CODE | |
| LOW | tests/v1/lmcache_native/test_periodic_event_notifier.py | 49 | CODE | |
| LOW | tests/v1/lmcache_native/test_ttl_lock.py | 366 | CODE | |
| LOW | tests/v1/lmcache_native/test_ttl_lock.py | 373 | CODE | |
| 310 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/conftest.py | 284 | # Create a shared store but separate instances for master/slave | COMMENT |
| MEDIUM | tests/conftest.py | 646 | # Create a fake hf3fs_fuse module if it doesn't exist | COMMENT |
| MEDIUM⚡ | tests/v1/test_basic_check.py | 48 | # Create a fake check_mode_ module | COMMENT |
| MEDIUM⚡ | tests/v1/test_memory_management.py | 631 | # Create a simple allocator for testing | COMMENT |
| MEDIUM⚡ | tests/v1/test_memory_management.py | 636 | # Create a real TensorMemoryObj | COMMENT |
| MEDIUM | tests/v1/test_memory_management.py | 494 | # Create a memory object | COMMENT |
| MEDIUM | tests/v1/test_memory_management.py | 540 | # Create a mock memory object for testing | COMMENT |
| MEDIUM | tests/v1/test_memory_management.py | 569 | # Create a mock memory object | COMMENT |
| MEDIUM | tests/v1/test_config.py | 809 | # Create a config and update from env | COMMENT |
| MEDIUM | tests/v1/test_cache_engine.py | 1424 | # Create an engine instance | COMMENT |
| MEDIUM | tests/v1/test_cache_engine.py | 1877 | # Create a mock engine | COMMENT |
| MEDIUM | tests/v1/test_cache_engine.py | 1969 | # Create a mock engine | COMMENT |
| MEDIUM⚡ | tests/v1/multiprocess/test_futures.py | 275 | # Create the raw future that will return (event_bytes, result_value) | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_custom_types.py | 31 | # Create a sample IPCCacheServerKey | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_custom_types.py | 118 | # Create a sample tensor | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_custom_types.py | 218 | # Create a tensor with known values | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_custom_types.py | 238 | # Create a queue for results | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_mq.py | 571 | # Create a single test key | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_mq.py | 595 | # Create a different test key | COMMENT |
| MEDIUM⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 625 | # Create a larger object to see noticeable delay | COMMENT |
| MEDIUM | tests/v1/distributed/test_hf3fs_l2_adapter.py | 1015 | # Create a buffer for loading | COMMENT |
| MEDIUM | tests/v1/cache_controller/conftest.py | 225 | # Create a mock registry with all required methods | COMMENT |
| MEDIUM | tests/v1/cache_controller/test_config.py | 55 | # Create a temporary YAML config file | COMMENT |
| MEDIUM | tests/v1/plugin/test_runtime_plugin_launcher.py | 96 | # Create a Python plugin file | COMMENT |
| MEDIUM | tests/v1/plugin/test_runtime_plugin_launcher.py | 238 | # Create a Python file with shebang | COMMENT |
| MEDIUM | tests/v1/plugin/test_runtime_plugin_launcher.py | 258 | # Create a Bash file | COMMENT |
| MEDIUM | tests/v1/plugin/test_runtime_plugin_launcher.py | 278 | # Create a Python file without shebang | COMMENT |
| MEDIUM | tests/v1/plugin/test_runtime_plugin_launcher.py | 301 | # Create an unsupported file type | COMMENT |
| MEDIUM | tests/v1/lmcache_native/test_ttl_lock.py | 115 | # Create a lock with 1 second TTL | COMMENT |
| MEDIUM | …ts/v1/storage_backend/test_pd_backend_bidirectional.py | 303 | # Create a mock channel | COMMENT |
| MEDIUM | …ts/v1/storage_backend/test_pd_backend_bidirectional.py | 418 | # Create a query for 3 keys (2 cached, 1 not) | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_plugin.py | 300 | # Create a test key | COMMENT |
| MEDIUM⚡ | tests/v1/storage_backend/test_gds_backend.py | 238 | # Create a path that doesn't exist | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_gds_backend.py | 289 | # Create a dummy file so os.path.exists returns True | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_gds_backend.py | 315 | # Create a dummy file | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_gds_backend.py | 341 | # Create a dummy file | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_hf3fs_connector.py | 180 | # Create the 3fs-virt directory structure that HF3FS expects | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_manager.py | 189 | # Create a mock future that returns the result | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_manager.py | 233 | # Create a mock future that returns the result | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_manager.py | 285 | # Create a mock future that returns the result | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_manager.py | 332 | # Create a mock future that returns the result | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_storage_manager.py | 369 | # Create a mock future that returns the result | COMMENT |
| MEDIUM | tests/v1/storage_backend/test_bigtable_integration.py | 269 | # Create a payload of ~8.38 MB (exceeds the 5.0 MB threshold) | COMMENT |
| MEDIUM | tests/v1/internal_api_server/test_cache_clear.py | 23 | # Create a mock LMCache engine | COMMENT |
| MEDIUM | tests/disagg/test_nixl_storage_backend.py | 81 | "nixl_path": tempfile.mkdtemp(), # Create a temporary directory for testing | CODE |
| MEDIUM | tests/disagg/test_nixl_cache_engine.py | 193 | # Create the VLLMPagedMemGPUConnectorV2 | COMMENT |
| MEDIUM | tests/disagg/test_nixl_cache_engine.py | 204 | # Create the LMCacheEngine (will be reused across rounds) | COMMENT |
| MEDIUM | tests/disagg/test_nixl_channel.py | 128 | # Create the NixlChannel | COMMENT |
| MEDIUM | examples/blend_in_process/blend.py | 146 | # Define the shared prompt and specific prompts | COMMENT |
| MEDIUM | …/kv_cache_reuse/local_backends/rust_backend_offload.py | 158 | # Define the shared prompt and specific prompts | COMMENT |
| MEDIUM | examples/kv_cache_reuse/local_backends/offload.py | 131 | # Define the shared prompt and specific prompts | COMMENT |
| MEDIUM | …rks/storage_backend_io/storage_backend_io_benchmark.py | 411 | # Create the specific backend | COMMENT |
| MEDIUM | benchmarks/rag/rag.py | 308 | # Create a dataframe | COMMENT |
| MEDIUM | benchmarks/multi_doc_qa/multi_doc_qa.py | 252 | # Create the OpenAI client | COMMENT |
| MEDIUM | benchmarks/long_doc_qa/long_doc_qa.py | 484 | # Create the OpenAI client | COMMENT |
| MEDIUM | .github/scripts/download_gh_release_model.sh | 142 | # Create the refs/main pointer so snapshot_download(local_files_only=True) | COMMENT |
| MEDIUM | .buildkite/k3_harness/values.yaml | 3 | # This file is for documentation only. | COMMENT |
| MEDIUM | .buildkite/scripts/vllm-integration-tests.sh | 782 | # Create the container image | COMMENT |
| MEDIUM | lmcache/connections.py | 2 | # This file is copied from the vLLM project (https://github.com/vllm-project/vllm). | COMMENT |
| MEDIUM | lmcache/v1/memory_allocators/lazy_memory_allocator.py | 147 | # Create the tensor memory allocator | COMMENT |
| 12 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | csrc/storage_backends/README.md | 83 | ### Step 1: C++ connector — inherit from ConnectorBase | COMMENT |
| LOW | csrc/storage_backends/README.md | 153 | ### Step 2: Pybind module | COMMENT |
| LOW | csrc/storage_backends/README.md | 177 | ### Step 3: Build system — register in setup.py | COMMENT |
| LOW | csrc/storage_backends/README.md | 199 | ### Step 4: Python client — non-MP mode integration | COMMENT |
| LOW | csrc/storage_backends/README.md | 220 | ### Step 5: MP mode integration — L2 adapter config + factory | COMMENT |
| LOW⚡ | csrc/storage_backends/hf3fs/connector.cpp | 266 | // Step 1: Deregister FD from 3FS first (only if registration succeeded) | COMMENT |
| LOW⚡ | csrc/storage_backends/hf3fs/connector.cpp | 271 | // Step 2: Close Linux FD | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 452 | # Step 1: Both backends healthy | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 460 | # Step 2: Backend A fails | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 467 | # Step 3: Backend B also fails | COMMENT |
| LOW | tests/v1/test_health_monitor_fallback_recovery.py | 478 | # Step 4: Backend A recovers | COMMENT |
| LOW | tests/v1/test_health_monitor_fallback_recovery.py | 490 | # Step 5: Backend B recovers | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 115 | # Step 1: Verify initial freeze mode is OFF | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 122 | # Step 2: Normal mode - Store should work | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 155 | # Step 3: Enable freeze mode via HTTP API | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 169 | # Step 4: Read-only mode - Store should be skipped | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 196 | # Step 5: Disable freeze mode via HTTP API | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 205 | # Step 6: Store should work again after disabling | COMMENT |
| LOW | tests/v1/test_cache_engine.py | 1212 | # NOTE: The default backend cache size is 2 GB. | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 519 | # Step 1: Store | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 525 | # Step 2: Lookup and lock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 531 | # Step 3: Load | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 540 | # Step 4: Unlock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 838 | # Step 1: Store from page 0 (filled with 123.0) | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 845 | # Step 2: Lookup and lock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 851 | # Step 3: Load into page 1 (initially 0.0) | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 861 | # Step 4: Unlock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 653 | # Step 3: Scheduler lookup, one key row per worker | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 660 | # Step 4: Verify hit count -- both workers have chunks 0-2. | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 665 | # Step 5: Workers retrieve their chunks | COMMENT |
| LOW⚡ | tests/v1/shm_allocator/shmfile_basic_check.yaml | 4 | # Step 1: Build shm_file_worker (PIPE mode, same machine) | COMMENT |
| LOW⚡ | tests/v1/shm_allocator/shmfile_basic_check.yaml | 8 | # Step 2: Run basic_check | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 288 | # Step 1: Worker side - recreate server | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 298 | # Step 2: Scheduler side - recreate client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 314 | # Step 1: Dryrun - check what would be created | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 324 | # Step 2: Close current client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 329 | # Step 3: Create new client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 232 | # Step 1: close RemoteBackend | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 237 | # Step 2: update config via /conf (uses conf_api) | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 242 | # Step 3: create new backends | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 252 | # Step 4: list backends | COMMENT |
| LOW | docs/design/v1/multiprocess/http_api_extension.md | 89 | ### Step 1: Create the Module | COMMENT |
| LOW | docs/design/v1/multiprocess/http_api_extension.md | 115 | ### Step 2: Done | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 51 | # Step 0: Generate the master key (never checked in / logged) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 104 | # Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 134 | # Step 2: Launch vLLM with LMCacheMPConnector | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 178 | # Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 224 | # Step 4: Clear L1 (CPU) cache | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 234 | # Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decrypt | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 254 | # Step 6: Show metrics / status | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 85 | # Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde) | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 115 | # Step 2: Launch vLLM with LMCacheMPConnector | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 159 | # Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize) | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 197 | # Step 4: Clear L1 (CPU) cache | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 207 | # Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserialize | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 226 | # Step 6: Show metrics / status | COMMENT |
| LOW | examples/kv_cache_reuse/local_backends/README.md | 12 | # WARNING: This will erase the content of target device. | COMMENT |
| LOW⚡ | examples/kv_cache_reuse/remote_backends/s3/README.md | 7 | ## Step 1: Configure your S3 bucket and (optional) EC2 compute instance | COMMENT |
| LOW⚡ | examples/kv_cache_reuse/remote_backends/s3/README.md | 14 | ## Step 2: Fill out `example.yaml` | COMMENT |
| LOW⚡ | examples/kv_cache_reuse/remote_backends/s3/README.md | 18 | ## Step 3: Start an vLLM engine with LMCache | COMMENT |
| 49 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | csrc/storage_backends/hf3fs/connector.cpp | 266 | // Step 1: Deregister FD from 3FS first (only if registration succeeded) | COMMENT |
| LOW⚡ | csrc/storage_backends/hf3fs/connector.cpp | 271 | // Step 2: Close Linux FD | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 452 | # Step 1: Both backends healthy | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 460 | # Step 2: Backend A fails | COMMENT |
| LOW⚡ | tests/v1/test_health_monitor_fallback_recovery.py | 467 | # Step 3: Backend B also fails | COMMENT |
| LOW | tests/v1/test_health_monitor_fallback_recovery.py | 478 | # Step 4: Backend A recovers | COMMENT |
| LOW | tests/v1/test_health_monitor_fallback_recovery.py | 490 | # Step 5: Backend B recovers | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 115 | # Step 1: Verify initial freeze mode is OFF | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 122 | # Step 2: Normal mode - Store should work | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 155 | # Step 3: Enable freeze mode via HTTP API | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 169 | # Step 4: Read-only mode - Store should be skipped | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 196 | # Step 5: Disable freeze mode via HTTP API | COMMENT |
| LOW⚡ | tests/v1/test_freeze_mode_integration.py | 205 | # Step 6: Store should work again after disabling | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 519 | # Step 1: Store | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 525 | # Step 2: Lookup and lock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 531 | # Step 3: Load | COMMENT |
| LOW⚡ | tests/v1/distributed/test_mock_l2_adapter.py | 540 | # Step 4: Unlock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 838 | # Step 1: Store from page 0 (filled with 123.0) | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 845 | # Step 2: Lookup and lock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 851 | # Step 3: Load into page 1 (initially 0.0) | COMMENT |
| LOW⚡ | tests/v1/distributed/test_nixl_store_l2_adapter.py | 861 | # Step 4: Unlock | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 653 | # Step 3: Scheduler lookup, one key row per worker | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 660 | # Step 4: Verify hit count -- both workers have chunks 0-2. | COMMENT |
| LOW⚡ | tests/v1/distributed/test_object_key_parallel.py | 665 | # Step 5: Workers retrieve their chunks | COMMENT |
| LOW⚡ | tests/v1/shm_allocator/shmfile_basic_check.yaml | 4 | # Step 1: Build shm_file_worker (PIPE mode, same machine) | COMMENT |
| LOW⚡ | tests/v1/shm_allocator/shmfile_basic_check.yaml | 8 | # Step 2: Run basic_check | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 288 | # Step 1: Worker side - recreate server | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 298 | # Step 2: Scheduler side - recreate client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 314 | # Step 1: Dryrun - check what would be created | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 324 | # Step 2: Close current client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_lookup_api.py | 329 | # Step 3: Create new client | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 232 | # Step 1: close RemoteBackend | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 237 | # Step 2: update config via /conf (uses conf_api) | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 242 | # Step 3: create new backends | COMMENT |
| LOW⚡ | tests/v1/internal_api_server/test_backend_api.py | 252 | # Step 4: list backends | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 51 | # Step 0: Generate the master key (never checked in / logged) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 104 | # Step 1: Launch lmcache MP server (CPU L1 + disk L2 with encrypt serde) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 134 | # Step 2: Launch vLLM with LMCacheMPConnector | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 178 | # Step 3: First inference — cold path (L1 -> L2 store with AES-GCM encrypt) | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 224 | # Step 4: Clear L1 (CPU) cache | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 234 | # Step 5: Re-run the same request — triggers L2 prefetch + AES-GCM decrypt | COMMENT |
| LOW⚡ | examples/serde/aesgcm/run_serde_aesgcm_example.sh | 254 | # Step 6: Show metrics / status | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 85 | # Step 1: Launch lmcache MP server (CPU L1 + disk L2 with fp8 serde) | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 115 | # Step 2: Launch vLLM with LMCacheMPConnector | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 159 | # Step 3: First inference — cold path (L1 -> L2 store with fp8 serialize) | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 197 | # Step 4: Clear L1 (CPU) cache | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 207 | # Step 5: Re-run the same request — triggers L2 prefetch + fp8 deserialize | COMMENT |
| LOW⚡ | examples/serde/fp8/run_serde_fp8_example.sh | 226 | # Step 6: Show metrics / status | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 58 | # Step 1: Build docker images | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 69 | # Step 2: Launch containers | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 80 | # Step 3: Wait for vLLM to be ready | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 91 | # Step 4: Run lm_eval workload test | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 102 | # Step 5: Run vllm bench serve test | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 113 | # Step 6: Run long doc QA test | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 124 | # Step 7: Run fault tolerance test (destructive — kills LMCache container) | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/run-mp-test.sh | 139 | # Step 8: Cleanup runs automatically via trap | COMMENT |
| LOW | …te/scripts/multiprocessing-test/run-fault-tolerance.sh | 79 | # Step 1: Warmup bench (measure timing for kill calibration) | COMMENT |
| LOW | …te/scripts/multiprocessing-test/run-fault-tolerance.sh | 93 | # Step 2: Bench with mid-flight LMCache kill | COMMENT |
| LOW | …te/scripts/multiprocessing-test/run-fault-tolerance.sh | 118 | # Step 3: Quick curl health check | COMMENT |
| LOW | .buildkite/k3_tests/multiprocess/scripts/run-mp-test.sh | 43 | # Step 1: Launch native processes (replaces Docker containers) | COMMENT |
| 24 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/example_build.sh | 7 | # Set VLLM_VERSION to a specific version before running this script, | COMMENT |
| LOW⚡ | tests/conftest.py | 776 | # Check if object has a close method | COMMENT |
| LOW | tests/v1/test_impl_completeness.py | 73 | # Check if the method is actually implemented in the class | COMMENT |
| LOW | tests/v1/utils.py | 667 | # Check if it's callable (function, method, etc.) | COMMENT |
| LOW | tests/v1/multiprocess/test_custom_types.py | 251 | # Check if process completed successfully | COMMENT |
| LOW | tests/v1/multiprocess/test_mq.py | 334 | # Check if client completed successfully | COMMENT |
| LOW | …v1/storage_backend/test_p2p_backend_with_controller.py | 66 | # Check if backend is properly initialized by checking its attributes | COMMENT |
| LOW | …1/storage_backend/test_local_cpu_backend_nixl_paged.py | 241 | # Set cpu_size_bytes to exactly 1 byte — smaller than one chunk. | COMMENT |
| LOW | tests/v1/internal_api_server/test_run_script.py | 41 | # Check if we've closed all braces | COMMENT |
| LOW | tests/disagg/test_nixl_cache_engine.py | 82 | # Check if the mean is close to the pattern value | COMMENT |
| LOW | tests/disagg/test_nixl_cache_engine.py | 298 | # Check if all tokens were retrieved | COMMENT |
| LOW | examples/chunk_statistics/analyze_chunk_hashes.py | 393 | # Print results | COMMENT |
| LOW | examples/kubernetes/health_probe.py | 65 | # Check if server responded with success | COMMENT |
| LOW | …rks/storage_backend_io/storage_backend_io_benchmark.py | 474 | # Check if this is a two-phase benchmark (write + read) | COMMENT |
| LOW | …rks/storage_backend_io/storage_backend_io_benchmark.py | 1225 | # Print results | COMMENT |
| LOW | benchmarks/multi_doc_qa/multi_doc_qa.py | 322 | # Print results | COMMENT |
| LOW | benchmarks/multi_round_qa/multi-round-qa.py | 455 | # Check if can join new user session | COMMENT |
| LOW | benchmarks/long_doc_qa/long_doc_qa.py | 561 | # Print results | COMMENT |
| LOW | benchmarks/microbenchmark/ttl_lock_benchmark.py | 522 | # Check if we can sustain 10K+ ops/sec with 4-8 threads | COMMENT |
| LOW | .buildkite/k3_harness/gpu-monitor.sh | 67 | # Check if this PID is inside any cgroup containing "kubepods" | COMMENT |
| LOW | .buildkite/k3_harness/setup-cluster.sh | 66 | # Check if image already exists in K3s containerd | COMMENT |
| LOW | .buildkite/scripts/vllm-integration-tests.sh | 79 | # Check if port is available using netstat | COMMENT |
| LOW | .buildkite/scripts/vllm-integration-tests.sh | 669 | # Check if baseline exists, skip comparisons if not | COMMENT |
| LOW | …ildkite/scripts/multiprocessing-test/run-vllm-bench.sh | 105 | # Check if result files exist | COMMENT |
| LOW | .buildkite/scripts/multiprocessing-test/common.sh | 28 | # Check if uv is available | COMMENT |
| LOW | …uildkite/scripts/multiprocessing-test/wait-for-vllm.sh | 37 | # Check if container is still running | COMMENT |
| LOW | …uildkite/scripts/multiprocessing-test/wait-for-vllm.sh | 46 | # Check if vLLM health endpoint is responding | COMMENT |
| LOW | …ldkite/scripts/multiprocessing-test/run-long-doc-qa.sh | 118 | # Check if result files exist | COMMENT |
| LOW | lmcache/utils.py | 267 | # Check if it's a range format [start,end] | COMMENT |
| LOW | lmcache/v1/memory_management.py | 1632 | # Check if free blocks are properly coalesced | COMMENT |
| LOW | lmcache/v1/memory_management.py | 1639 | # Check if total size matches | COMMENT |
| LOW | lmcache/v1/cache_engine.py | 461 | # Check if freeze mode is enabled | COMMENT |
| LOW | lmcache/v1/cache_engine.py | 658 | # Check if freeze mode is enabled | COMMENT |
| LOW | lmcache/v1/config_base.py | 584 | # Check if this configuration class has definitions with converters | COMMENT |
| LOW | lmcache/v1/pin_monitor.py | 134 | # Check if object is still pinned and has exceeded timeout | COMMENT |
| LOW | lmcache/v1/memory_allocators/tensor_memory_allocator.py | 308 | # Check if the numbers are consistent | COMMENT |
| LOW | lmcache/v1/memory_allocators/tensor_memory_allocator.py | 317 | # Check if the blocks are coalesced | COMMENT |
| LOW | …/v1/memory_allocators/paged_tensor_memory_allocator.py | 323 | # Check if the numbers are consistent | COMMENT |
| LOW | lmcache/v1/lookup_client/lmcache_async_lookup_client.py | 165 | # Check if any aborted lookups are finished, send cleanup messages | COMMENT |
| LOW | lmcache/v1/lookup_client/factory.py | 60 | # Check if external_lookup_client is configured | COMMENT |
| LOW | lmcache/v1/lookup_client/factory.py | 78 | # Check if bypass lookup is enabled and lmcache_engine is provided | COMMENT |
| LOW | lmcache/v1/distributed/l2_adapters/factory.py | 127 | # Check if the name is now registered | COMMENT |
| LOW | …1/mp_observability/subscribers/metrics/l1_lifecycle.py | 158 | # Check if this is a reuse of an evicted chunk. | COMMENT |
| LOW | lmcache/v1/cache_controller/config.py | 128 | # Check if this field has an env_converter in the definitions | COMMENT |
| LOW⚡ | lmcache/v1/cache_controller/controller_manager.py | 333 | # Check if POLLIN flag is set (indicates readable/pending messages) | COMMENT |
| LOW | lmcache/v1/cache_controller/commands/full_sync.py | 43 | # Check if full sync is already in progress | COMMENT |
| LOW | …ache_controller/controllers/registration_controller.py | 231 | # Check if full sync is needed (e.g., controller restart) | COMMENT |
| LOW | …e/v1/cache_controller/controllers/full_sync_tracker.py | 146 | # Check if already syncing with different sync_id | COMMENT |
| LOW | …cache/v1/cache_controller/controllers/kv_controller.py | 154 | # Check if worker is currently in full sync | COMMENT |
| LOW | lmcache/v1/health_monitor/base.py | 505 | # Check if we have any health checks that need to run | COMMENT |
| LOW | lmcache/v1/storage_backend/remote_backend.py | 349 | # Check if local_cpu_backend is available (required for memory allocation) | COMMENT |
| LOW | lmcache/v1/storage_backend/remote_backend.py | 401 | # Check if local_cpu_backend is available (required for memory allocation) | COMMENT |
| LOW | lmcache/v1/storage_backend/remote_backend.py | 555 | # Check if local_cpu_backend is available (required for memory allocation) | COMMENT |
| LOW | lmcache/v1/storage_backend/gds_backend.py | 1103 | # Check if file is large enough for the requested read | COMMENT |
| LOW | lmcache/v1/storage_backend/batched_message_sender.py | 109 | # Check if we have messages to process while holding the lock | COMMENT |
| LOW | lmcache/v1/storage_backend/local_cpu_backend.py | 480 | # Check if io_uring is enabled for fixed buffer support | COMMENT |
| LOW | lmcache/v1/storage_backend/local_cpu_backend.py | 494 | # Check if lazy memory allocator should be enabled | COMMENT |
| LOW | lmcache/v1/storage_backend/nixl_storage_backend.py | 2120 | # Check if already in progress | COMMENT |
| LOW | lmcache/v1/storage_backend/raw_block/core.py | 1250 | # Check if the buffer pointer is aligned | COMMENT |
| LOW | lmcache/v1/storage_backend/connector/audit_connector.py | 46 | # Check if method is marked with @NotAudit | COMMENT |
| 15 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/test_health_monitor_fallback_recovery.py | 41 | def set_ping_error_code(self, error_code: int) -> None: | CODE |
| LOW⚡ | tests/v1/test_musa_support.py | 79 | def set_device(self, _idx: int) -> None: | CODE |
| LOW | tests/v1/test_health_monitor.py | 45 | def set_healthy(self, healthy: bool) -> None: | CODE |
| LOW | tests/v1/distributed/serde/test_async_processor.py | 176 | def set_used_size(self, n: int) -> None: | CODE |
| LOW | …nal_l2_adapter/src/lmc_external_l2_adapter/__init__.py | 17 | __all__ = ["InMemoryL2Adapter", "InMemoryL2AdapterConfig"] | CODE |
| LOW | …onnector/src/lmc_external_native_connector/__init__.py | 26 | __all__ = [ | CODE |
| LOW | examples/remote_config_server/config_server.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | …rks/storage_backend_io/storage_backend_io_benchmark.py | 359 | def _setup_device(self) -> None: | CODE |
| LOW | …rks/storage_backend_io/storage_backend_io_benchmark.py | 755 | def _setup_device(self) -> None: | CODE |
| LOW | .buildkite/correctness/async_request.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW | lmcache/usage_context.py | 16 | __all__ = [ | CODE |
| LOW | lmcache/__init__.py | 20 | __all__ = ["__version__", "torch_dev", "torch_device_type"] | CODE |
| LOW | lmcache/v1/memory_management.py | 234 | def set_l1_manager(self, owner_tag: int) -> None: | CODE |
| LOW | lmcache/v1/memory_management.py | 323 | def set_used_size(self, n: int) -> None: # noqa: B027 | CODE |
| LOW | lmcache/v1/memory_management.py | 726 | def set_used_size(self, n: int) -> None: | CODE |
| LOW | lmcache/v1/cache_engine.py | 248 | def set_health_monitor(self, health_monitor: "HealthMonitor") -> None: | CODE |
| LOW | lmcache/v1/cache_engine.py | 362 | def set_hot_cache(self, enabled: bool) -> None: | CODE |
| LOW | lmcache/v1/mp_coordinator/controllers/__init__.py | 141 | __all__ = ["Controller", "build_controllers"] | CODE |
| LOW | lmcache/v1/mp_coordinator/views/__init__.py | 48 | __all__ = ["View", "base", "build_views"] | CODE |
| LOW | lmcache/v1/multiprocess/session.py | 57 | def set_tokens(self, full_token_ids: list[int]) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/futures.py | 68 | def set_result(self, result: T) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/futures.py | 80 | def set_exception(self, exception: BaseException) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/futures.py | 328 | def set_result(self, result: T) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/posix_shm.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | lmcache/v1/multiprocess/transport/zmq_impl/__init__.py | 60 | __all__ = ["ZmqMultiprocessClient", "create_request_client"] | CODE |
| LOW | lmcache/v1/multiprocess/transfer_context/__init__.py | 29 | __all__ = [ | CODE |
| LOW | lmcache/v1/multiprocess/modules/p2p_controller.py | 635 | def _setup_metrics(self) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/modules/lookup.py | 604 | def _setup_metrics(self) -> None: | CODE |
| LOW | lmcache/v1/multiprocess/modules/blend/__init__.py | 38 | __all__ = ["BlendModule"] | CODE |
| LOW | lmcache/v1/offload_server/__init__.py | 11 | __all__ = [ | CODE |
| LOW | …che/v1/lookup_client/chunk_statistics_lookup_client.py | 197 | def _setup_metrics(self) -> None: | CODE |
| LOW | lmcache/v1/lookup_client/__init__.py | 17 | __all__ = [ | CODE |
| LOW | lmcache/v1/lookup_client/record_strategies/__init__.py | 56 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/quota_manager.py | 61 | def set_quota(self, cache_salt: str, limit_bytes: int) -> None: | CODE |
| LOW | lmcache/v1/distributed/quota_manager.py | 97 | def set_default_limit_bytes(self, limit_bytes: int | None) -> None: | CODE |
| LOW | lmcache/v1/distributed/memory_manager/__init__.py | 24 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/eviction_policy/__init__.py | 23 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/storage_controllers/__init__.py | 36 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/bitmap_ops/__init__.py | 21 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/transfer_channel/__init__.py | 30 | __all__ = [ | CODE |
| LOW⚡ | …ache/v1/distributed/l2_adapters/hfbucket_l2_adapter.py | 874 | def _set_cached_object_size_locked(self, object_path: str, size: int) -> None: | CODE |
| LOW | lmcache/v1/distributed/l2_adapters/__init__.py | 64 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/l2_adapters/base.py | 363 | def set_backend_identity(self, name: str, shared: bool = False) -> None: | CODE |
| LOW⚡ | lmcache/v1/distributed/l2_adapters/serde_wrapper.py | 340 | def set_backend_identity(self, name: str, shared: bool = False) -> None: | CODE |
| LOW | …/v1/distributed/l2_adapters/fault_inject_l2_adapter.py | 387 | def set_backend_identity(self, name: str, shared: bool = False) -> None: | CODE |
| LOW | lmcache/v1/distributed/serde/__init__.py | 47 | __all__ = [ | CODE |
| LOW | lmcache/v1/distributed/serde/turboquant/__init__.py | 11 | __all__ = [ | CODE |
| LOW | lmcache/v1/mp_observability/trace/decorator.py | 49 | def set_tracing_enabled(enabled: bool) -> None: | CODE |
| LOW | lmcache/v1/mp_observability/trace/__init__.py | 39 | __all__ = [ | CODE |
| LOW | lmcache/v1/mp_observability/subscribers/__init__.py | 18 | __all__ = [ | CODE |
| LOW | …he/v1/mp_observability/subscribers/metrics/__init__.py | 52 | __all__ = [ | CODE |
| LOW | …he/v1/mp_observability/subscribers/tracing/__init__.py | 21 | __all__ = [ | CODE |
| LOW | …he/v1/mp_observability/subscribers/logging/__init__.py | 22 | __all__ = [ | CODE |
| LOW | lmcache/v1/cache_controller/__init__.py | 6 | __all__ = [ | CODE |
| LOW | lmcache/v1/cache_controller/utils.py | 187 | def update_seq_num(self, location: str, seq_num: int) -> None: | CODE |
| LOW | lmcache/v1/cache_controller/commands/__init__.py | 12 | __all__ = [ | CODE |
| LOW | lmcache/v1/cache_controller/controllers/__init__.py | 8 | __all__ = [ | CODE |
| LOW | …e/v1/cache_controller/controllers/full_sync_tracker.py | 71 | def set_need_full_sync_all(self, need: bool) -> None: | CODE |
| LOW | …cache/v1/cache_controller/controllers/kv_controller.py | 74 | def _setup_metrics(self) -> None: | CODE |
| LOW | lmcache/v1/platform/__init__.py | 26 | __all__ = [ | CODE |
| 49 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tests/v1/test_mp_mem_kernels.py | 31 | # Tensor factories (ported from kernel harness) | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_cache_server.py | 184 | #: backend has no such requirement, but this keeps the harness valid for | COMMENT |
| MEDIUM | tests/v1/multiprocess/test_engine_driven_transfer.py | 279 | # real IPC-backed factories to be usable in the harness. | COMMENT |
| MEDIUM | tests/cli/commands/trace/test_driver.py | 274 | # the test robust against future decorator additions. | COMMENT |
| MEDIUM | .github/workflows/operator_release.yml | 51 | # so behavior is robust whether or not that box is ticked in the UI. | COMMENT |
| MEDIUM | .buildkite/pipelines/comprehensive-tests.yml | 9 | - .buildkite/scripts/should-run-comprehensive.sh || exit 0 # Skip comprehensive tests for safe-path-only PRs. | CODE |
| MEDIUM | .buildkite/k3_harness/setup-env.sh | 309 | # harness. Re-probe the full chain here so broken envs fail fast with the | COMMENT |
| MEDIUM | .buildkite/k3_harness/setup-blend-env.sh | 17 | # 2. Plugin-harness dep not in the LMCache/vLLM dependency closure. | COMMENT |
| MEDIUM | .buildkite/k3_harness/setup-blend-env.sh | 59 | # server-boot timeout inside the harness. | COMMENT |
| MEDIUM⚡ | .buildkite/scripts/should-run-comprehensive.sh | 4 | # Decide whether comprehensive tests should run for this build. | COMMENT |
| MEDIUM⚡ | .buildkite/scripts/should-run-comprehensive.sh | 6 | # 0 -> run comprehensive tests | COMMENT |
| MEDIUM⚡ | .buildkite/scripts/should-run-comprehensive.sh | 7 | # 1 -> skip comprehensive tests (safe paths only) | COMMENT |
| MEDIUM⚡ | .buildkite/scripts/should-run-comprehensive.sh | 9 | # If this isn't a PR build, always run comprehensive tests. | COMMENT |
| MEDIUM | .buildkite/scripts/should-run-comprehensive.sh | 70 | # Non-safe file touched -> run comprehensive tests. | COMMENT |
| MEDIUM | …dkite/k3_tests/multiprocess/scripts/run-single-test.sh | 9 | # This mirrors the comprehensive tests' run-single-config.sh pattern. | COMMENT |
| MEDIUM | …s/multiprocess/scripts/workloads/vllm/dsv4-flash-tp.sh | 386 | # across 128 tokens), making the comparison robust. | COMMENT |
| MEDIUM | …tests/multiprocess/scripts/workloads/common/lm-eval.sh | 4 | # Engine setup and test dependencies are installed by the harness entrypoint. | COMMENT |
| MEDIUM | …ests/multiprocess/scripts/workloads/common/deadlock.sh | 4 | # The multiprocess harness launches the selected inference engine with the | COMMENT |
| MEDIUM | …ldkite/k3_tests/multiprocess/scripts/engines/sglang.sh | 2 | # SGLang adapter for the LMCache multiprocess integration-test harness. | COMMENT |
| MEDIUM | …uildkite/k3_tests/multiprocess/scripts/engines/vllm.sh | 2 | # vLLM adapter for the LMCache multiprocess integration-test harness. | COMMENT |
| MEDIUM | …ite/k3_tests/comprehensive/scripts/upload-baselines.sh | 3 | # Runs AFTER all comprehensive config steps complete (via `wait`). | COMMENT |
| MEDIUM | .buildkite/k3_tests/xpu/multiprocess/run.sh | 4 | # Reuse multiprocess test harness, but switch to the XPU environment/bootstrap. | COMMENT |
| MEDIUM | .buildkite/k3_tests/xpu/multiprocess/run.sh | 17 | # The shared vLLM harness defaults to FLASH_ATTN when this is unset. | COMMENT |
| MEDIUM | .buildkite/k3_tests/amd/run-unit-tests.sh | 13 | # k3 harness behavior used by the other test suites. | COMMENT |
| MEDIUM⚡ | .buildkite/k3_tests/common_scripts/path-filter.sh | 18 | # - Shared CI harness files fan out only to the tests that actually depend | COMMENT |
| MEDIUM⚡ | .buildkite/k3_tests/common_scripts/path-filter.sh | 20 | # to that suite, while shared harness changes under .buildkite/k3_harness/ | COMMENT |
| MEDIUM⚡ | .buildkite/k3_tests/common_scripts/path-filter.sh | 21 | # are classified by the harness file they touch. | COMMENT |
| MEDIUM | .buildkite/k3_tests/common_scripts/path-filter.sh | 162 | # Keep other example changes out of the comprehensive pipeline. | COMMENT |
| LOW | lmcache/v1/memory_management.py | 1079 | # so just return None here | COMMENT |
| LOW | …cache/v1/memory_allocators/cu_file_memory_allocator.py | 21 | # layer - for now just use the current device. | COMMENT |
| MEDIUM | lmcache/v1/gpu_connector/utils.py | 818 | # Also accept [P,2,B,H,D] (or [NB,2,BS,NH,HS]) to be more robust. | COMMENT |
| MEDIUM | lmcache/cli/commands/bench/l2_adapter_bench/command.py | 475 | # the one-time tensor allocation + fill (benchmark harness work, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | README.md | 32 | - [2026/05] 🔥 Agentic workload benchmark on AMD MI300X ([blog](https://blog.lmcache.ai/en/2026/05/12/benchmarking-lmcach | CODE |
| MEDIUM⚡ | tests/v1/distributed/serde/test_asym_k16_v8_multi.py | 34 | # Test scaffolding (mirrors the _FakeMemoryObj in test_multi.py / test_fp8.py) | COMMENT |
| MEDIUM⚡ | tests/v1/distributed/serde/test_multi.py | 52 | # Test scaffolding: a minimal MemoryObj stand-in mirroring test_fp8.py. | COMMENT |
| MEDIUM | docs/design/v1/gpu_connector/layout-invariant.md | 42 | ├── detection.py # detect_format() orchestration | CODE |
| MEDIUM | …design/cli/commands/bench/engine_bench/bench-engine.md | 42 | # RAG answer quality (real QA data, documents cached individually) | COMMENT |
| MEDIUM | benchmarks/rag/README.md | 1 | # Benchmarking LLM Performance: RAG Use Case | COMMENT |
| MEDIUM | benchmarks/rag/README.md | 16 | ## Running the RAG Benchmark | COMMENT |
| MEDIUM | lmcache/cli/commands/bench/server_bench/command.py | 56 | # orchestration safe. | COMMENT |
| MEDIUM | operator/AGENTS.md | 355 | Do NOT delete `// +kubebuilder:scaffold:*` comments. CLI injects code at these markers. | CODE |
| MEDIUM | operator/AGENTS.md | 389 | ### Deploy Image Plugin (scaffold to deploy/manage ANY container image) | COMMENT |
| MEDIUM | operator/cmd/main.go | 44 | // +kubebuilder:scaffold:imports | COMMENT |
| MEDIUM | operator/cmd/main.go | 57 | // +kubebuilder:scaffold:scheme | COMMENT |
| MEDIUM | operator/cmd/main.go | 175 | // In the default scaffold provided, the program ends immediately after | COMMENT |
| MEDIUM | operator/cmd/main.go | 221 | // +kubebuilder:scaffold:builder | COMMENT |
| MEDIUM | operator/test/e2e/e2e_test.go | 168 | // +kubebuilder:scaffold:e2e-metrics-webhooks-readiness | COMMENT |
| MEDIUM | operator/test/e2e/e2e_test.go | 208 | // +kubebuilder:scaffold:e2e-webhooks-checks | COMMENT |
| MEDIUM | operator/config/crd/kustomization.yaml | 8 | # +kubebuilder:scaffold:crdkustomizeresource | COMMENT |
| MEDIUM | operator/config/crd/kustomization.yaml | 13 | # +kubebuilder:scaffold:crdkustomizewebhookpatch | COMMENT |
| MEDIUM⚡ | operator/config/default/kustomization.yaml | 225 | # targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD. | COMMENT |
| MEDIUM⚡ | operator/config/default/kustomization.yaml | 226 | # +kubebuilder:scaffold:crdkustomizecainjectionns | COMMENT |
| MEDIUM⚡ | operator/config/default/kustomization.yaml | 233 | # targets: # Do not remove or uncomment the following scaffold marker; required to generate code for target CRD. | COMMENT |
| MEDIUM⚡ | operator/config/default/kustomization.yaml | 234 | # +kubebuilder:scaffold:crdkustomizecainjectionname | COMMENT |
| MEDIUM | operator/config/samples/vllm_cacheblend_deployment.yaml | 1 | # Sample vLLM Deployment that OPTS IN to CacheBlend dependency injection. | COMMENT |
| MEDIUM | operator/config/samples/kustomization.yaml | 6 | # +kubebuilder:scaffold:manifestskustomizesamples | COMMENT |
| MEDIUM | operator/config/samples/vllm_lmcache_deployment.yaml | 1 | # Sample vLLM Deployment that OPTS IN to LMCacheEngine dependency injection. | COMMENT |
| MEDIUM | operator/internal/controller/suite_test.go | 38 | // +kubebuilder:scaffold:imports | COMMENT |
| MEDIUM | operator/internal/controller/suite_test.go | 70 | // +kubebuilder:scaffold:scheme | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …s/v1/multiprocess/test_lmcache_driven_transfer_skip.py | 63 | # chunk size = 2 blocks. Chunk 0 = [0, 0] (null), chunk 1 = [0, 9] (has a | COMMENT |
| HIGH⚡ | …s/v1/multiprocess/test_lmcache_driven_transfer_skip.py | 95 | # chunk 0: kg0=0 and kg1=0 -> null; chunk 1: kg0=0 but kg1=4 -> not null. | COMMENT |
| HIGH | tests/v1/shm_allocator/verify_shmfile_tcp.py | 15 | mkdir -p tests/v1/shm_allocator/csrc/build && cd tests/v1/shm_allocator/csrc/build | STRING |
| HIGH | lmcache/v1/cache_controller/worker.py | 644 | self.push(), | CODE |
| HIGH | lmcache/v1/storage_backend/nixl_storage_backend.py | 1191 | self.pool.push(index) | CODE |
| HIGH | lmcache/v1/storage_backend/nixl_storage_backend.py | 1491 | self.pool.push(metadata.index) | CODE |
| HIGH | lmcache/v1/internal_api_server/vllm/cache_api.py | 346 | # "locations": null, "request_configs": null} | STRING |
| HIGH | lmcache/v1/internal_api_server/vllm/cache_api.py | 354 | # "request_configs": null} | STRING |
| HIGH | …ommands/bench/engine_bench/workloads/rag_qa_quality.py | 423 | An unparsed sample's ``f1`` is null, not zero, so a cross-run diff can | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | tests/v1/mp_coordinator/test_directory_api.py | 224 | key_directory = client.app.state.ctx.views.get(KeyDirectory) | CODE |
| CRITICAL | tests/v1/multiprocess/test_free_locks.py | 321 | ctx.session_manager.get_or_create.return_value.record_prefetch_result.assert_not_called() | CODE |
| CRITICAL | lmcache/v1/storage_backend/connector/azure_connector.py | 145 | from azure.core.exceptions import ResourceNotFoundError | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/test_vllm_local_rank.py | 29 | CODE | |
| LOW | tests/v1/mp_coordinator/test_key_directory.py | 35 | CODE | |
| LOW | tests/v1/mp_coordinator/test_event_gate.py | 37 | CODE | |
| LOW | tests/cli/commands/bench/engine_bench/test_stats.py | 25 | CODE | |
| LOW | …ds/bench/engine_bench/workloads/test_rag_qa_quality.py | 82 | CODE | |
| LOW | …che/v1/distributed/l2_adapters/aerospike_l2_adapter.py | 48 | CODE | |
| LOW | …che/v1/distributed/l2_adapters/raw_block_l2_adapter.py | 219 | CODE | |
| LOW | …1/distributed/l2_adapters/sagemaker_hyperpod_client.py | 159 | CODE | |
| LOW | …stributed/l2_adapters/sagemaker_hyperpod_l2_adapter.py | 60 | CODE | |
| LOW | …ache/v1/distributed/l2_adapters/bigtable_l2_adapter.py | 172 | CODE | |
| LOW | lmcache/v1/distributed/l2_adapters/valkey_l2_adapter.py | 165 | CODE | |
| LOW | lmcache/v1/storage_backend/valkey/worker_pool.py | 173 | CODE | |
| LOW | …/v1/storage_backend/native_clients/aerospike_client.py | 22 | CODE | |
| LOW | lmcache/v1/storage_backend/connector/eic_connector.py | 432 | CODE | |
| LOW | …cache/v1/storage_backend/connector/valkey_connector.py | 107 | CODE | |
| LOW | lmcache/v1/kv_codec/asym_k16_v8.py | 271 | CODE | |
| LOW | lmcache/cli/commands/bench/server_bench/helpers.py | 237 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/v1/shm_allocator/shmfile_basic_check.yaml | 3 | # Usage: | COMMENT |
| LOW | …es/lmc_external_l2_adapter/scripts/install_and_test.sh | 7 | # Usage: | COMMENT |
| LOW | .github/scripts/download_model.sh | 8 | # Usage: | COMMENT |
| LOW | .github/scripts/install_lmcache_cpu.sh | 9 | # Usage: | COMMENT |
| LOW | .github/scripts/install_vllm_cpu.sh | 16 | # Usage: | COMMENT |
| LOW | .buildkite/k3_harness/install-agent-stack.sh | 4 | # Usage: | COMMENT |
| LOW | .buildkite/k3_harness/resolve-pinned-vllm.sh | 25 | # Usage: | COMMENT |
| LOW | .buildkite/k3_tests/common_scripts/path-filter.sh | 5 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lmcache/v1/memory_management.py | 885 | # TODO: consider using one of the alternatives | COMMENT |
| LOW | lmcache/v1/multiprocess/transport/zmq_impl/mq.py | 517 | # TODO: implement this in the future versions if needed | COMMENT |
| LOW⚡ | …distributed/storage_controllers/prefetch_controller.py | 1007 | # TODO: implement the dynamic in flight request admission | COMMENT |
| LOW | lmcache/v1/storage_backend/gds_backend.py | 532 | # TODO: implement pin() semantics | COMMENT |
| LOW | lmcache/cli/commands/query/kvcache_command.py | 24 | # TODO: implement kvcache query logic | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/test_sglang_mp_adapter.py | 363 | conn._create_key = lambda *args, **kwargs: "fake-key" # type: ignore[method-assign,assignment] | CODE |
| LOW | tests/v1/test_sglang_mp_adapter.py | 393 | conn._create_key = lambda *args, **kwargs: "fake-key" # type: ignore[method-assign,assignment] | CODE |
| LOW | benchmarks/multi_doc_qa/shuffle_doc_qa.py | 263 | api_key="dummy-key", | CODE |
| LOW | benchmarks/ttft-estimator/ttft-estimator.py | 37 | client = OpenAI(api_key="dummy-key", base_url="http://localhost:8000/v1") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | .github/workflows/codeql.yml | 59 | # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize how | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/v1/mp_coordinator/test_cache_events.py | 710 | def handle_request(self, request: httpx.Request) -> httpx.Response: | CODE |
| LOW | lmcache/v1/cache_controller/worker.py | 529 | async def handle_request(self): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | lmcache/v1/mp_coordinator/persistence/store.py | 122 | CODE |