Achieve state of the art inference performance with modern accelerators on Kubernetes
This report summarizes scanner evidence for llm-d/llm-d, a Python project with 4,789 GitHub stars. SynthScan examined 121,279 lines of code across 1255 source files, recording 863 pattern matches distributed across 16 syntactic categories. The legacy adjusted pattern signal is 13.9 (Moderate pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 601 finding(s).
Are imports declared and package/API names verified? 25 finding(s).
Are wrappers, guards, and repeated structures necessary? 438 finding(s).
Which changes need focused human review? 863 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 863 distinct pattern matches across 16 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | docs/operations/integrations/kong.md | 174 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 178 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 210 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 213 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 245 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 248 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 287 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/kong.md | 290 | # ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 262 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 265 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 281 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 284 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 300 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | docs/operations/integrations/litellm.md | 303 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | guides/flow-control/scripts/tuning_wizard.py | 18 | # ========================================== | COMMENT |
| MEDIUM | guides/flow-control/scripts/tuning_wizard.py | 20 | # ========================================== | COMMENT |
| MEDIUM⚡ | guides/flow-control/scripts/tuning_wizard.py | 45 | # ========================================== | COMMENT |
| MEDIUM⚡ | guides/flow-control/scripts/tuning_wizard.py | 47 | # ========================================== | COMMENT |
| MEDIUM | guides/flow-control/scripts/tuning_wizard.py | 147 | # ========================================== | COMMENT |
| MEDIUM | guides/flow-control/scripts/tuning_wizard.py | 149 | # ========================================== | COMMENT |
| MEDIUM | …models/nemotron-3-ultra/benchmark-templates/guide.yaml | 1 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …models/nemotron-3-ultra/benchmark-templates/guide.yaml | 21 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …models/qwen3-coder-480b/benchmark-templates/guide.yaml | 1 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …models/qwen3-coder-480b/benchmark-templates/guide.yaml | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …s/recipes/observability/alerts/epp-alerting-rules.yaml | 9 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …s/recipes/observability/alerts/epp-alerting-rules.yaml | 11 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …s/recipes/observability/alerts/epp-alerting-rules.yaml | 63 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …s/recipes/observability/alerts/epp-alerting-rules.yaml | 65 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …observability/alerts/batch-gateway-alerting-rules.yaml | 9 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …observability/alerts/batch-gateway-alerting-rules.yaml | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 23 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 25 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 106 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 108 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 116 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 118 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 123 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 125 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 62 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 64 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 139 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 141 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 199 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 201 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 212 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 214 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 239 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …-token-aware/optimized-baseline/base/scaledobject.yaml | 59 | # ── PREFILL: seconds of uncached prefill backlog ──────────────────────────── | COMMENT |
| MEDIUM | …-token-aware/optimized-baseline/base/scaledobject.yaml | 96 | # ── DECODE: pods' worth of full KV cache ──────────────────────────────────── | COMMENT |
| MEDIUM⚡ | scripts/guide.py | 99 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | scripts/guide.py | 101 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 172 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 174 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 241 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 243 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 302 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 304 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 989 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | scripts/guide.py | 991 | # -------------------------------------------------------------------------- | COMMENT |
| 154 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | SIGS.md | 54 | | **[SIG Agentic Inference](#sig-agentic-inference)** | Optimizing inference for agentic and multi-step AI workloads | • | CODE |
| MEDIUM | SIGS.md | 286 | - **Slack Channel**: [#sig-agentic-inference](https://llm-d.slack.com/archives/C0ALHNZJCFJ) | CODE |
| MEDIUM | release/README.md | 23 | | [Agentic API](../guides/agentic-api/README.md) | | | [; GLM-5.2 replays production agentic | CODE |
| MEDIUM | docs/operations/README.md | 107 | ### [Serve the Responses API with Agentic API](../../guides/agentic-api/README.md) (Experimental) | COMMENT |
| MEDIUM | guides/models/glm-5-2/README.md | 9 | [GLM-5.2 agentic serving blog post](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d), | CODE |
| MEDIUM | guides/models/glm-5-2/README.md | 460 | [blog post](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d) for the full | CODE |
| MEDIUM | …server/gpu/vllm/deployments/default/kustomization.yaml | 3 | # Recommended deployment of GLM-5.2-FP8 on H200 for agentic workloads: the | COMMENT |
| MEDIUM | guides/models/nemotron-3-ultra/README.md | 4 | [agentic workloads section of the Models overview](../../../docs/well-lit-paths/models/README.md#agentic-workloads) | CODE |
| MEDIUM⚡ | …s/nemotron-3-ultra/router/nemotron-3-ultra.values.yaml | 4 | ## This deployment serves the agentic code-generation workload on NVIDIA GPUs with | COMMENT |
| MEDIUM⚡ | …s/nemotron-3-ultra/router/nemotron-3-ultra.values.yaml | 10 | ## The plugin config name and the `llm-d.ai/guide: agentic-serving-gpu` pod | COMMENT |
| MEDIUM⚡ | …s/nemotron-3-ultra/router/nemotron-3-ultra.values.yaml | 11 | ## selector are kept from the former agentic-serving guide; they must match the | COMMENT |
| MEDIUM | guides/models/qwen3-coder-480b/README.md | 4 | [agentic workloads section of the Models overview](../../../docs/well-lit-paths/models/README.md#agentic-workloads) | CODE |
| MEDIUM⚡ | …-coder-480b/router/qwen3-coder-480b-disagg.values.yaml | 4 | ## This deployment serves the agentic code-generation workload on Google TPUs with | COMMENT |
| MEDIUM⚡ | …-coder-480b/router/qwen3-coder-480b-disagg.values.yaml | 10 | ## The `llm-d.ai/guide: agentic-serving` pod selector is kept from the former | COMMENT |
| MEDIUM⚡ | …-coder-480b/router/qwen3-coder-480b-disagg.values.yaml | 11 | ## agentic-serving guide; it must match the labels set in | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 3 | [ | CODE |
| MEDIUM | guides/agentic-api/README.md | 30 | ([`ARCHITECTURE.md`](https://github.com/vllm-project/agentic-api/blob/main/ARCHITECTURE.md), ADR-01 | CODE |
| MEDIUM | guides/agentic-api/README.md | 334 | # agentic-api cannot drive tool calls unless the base guide's vLLM was | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 375 | --from-literal=database-url="postgres://postgres:${PGPASS}@agentic-api-postgres:5432/agentic_api" | CODE |
| MEDIUM | guides/agentic-api/README.md | 390 | ### 5. Point agentic-api at the base guide's router | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 398 | # Service speaks plain HTTP on :80 and agentic-api can dial it by DNS. | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 409 | # agentic-api's upstream call goes back through the Gateway. The hostname | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 449 | ### 7. Deploy agentic-api | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 490 | # gateway-gke adds the networking.gke.io policies for Service/agentic-api on | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 563 | # the agentic route, so they fall through to the InferencePool. | COMMENT |
| MEDIUM | guides/agentic-api/README.md | 600 | Once [`agentic-api`](https://github.com/vllm-project/agentic-api) is reachable at `${AGENTIC_API_BASE_URL}`, you can att | CODE |
| MEDIUM | guides/agentic-api/verify.py | 107 | # Turn 1: Store state in PostgreSQL via agentic-api | COMMENT |
| MEDIUM | guides/agentic-api/verify.py | 219 | # The most common cause of an empty function_call list is not agentic-api but | COMMENT |
| MEDIUM⚡ | guides/agentic-api/verify.py | 258 | # Step 3: Return webhook delivery receipt to agentic-api via stateful previous_response_id | COMMENT |
| MEDIUM | guides/agentic-api/verify.py | 289 | # against the turn agentic-api had persisted. | COMMENT |
| MEDIUM | guides/agentic-api/guide.yaml | 38 | # agentic-api cannot drive tool calls unless the base guide's vLLM was | COMMENT |
| MEDIUM | guides/agentic-api/guide.yaml | 68 | --from-literal=database-url="postgres://postgres:${PGPASS}@agentic-api-postgres:5432/agentic_api" | CODE |
| MEDIUM | guides/agentic-api/guide.yaml | 82 | # Service speaks plain HTTP on :80 and agentic-api can dial it by DNS. | COMMENT |
| MEDIUM | guides/agentic-api/guide.yaml | 88 | # agentic-api's upstream call goes back through the Gateway. The hostname | COMMENT |
| MEDIUM | guides/agentic-api/guide.yaml | 136 | # gateway-gke adds the networking.gke.io policies for Service/agentic-api on | COMMENT |
| MEDIUM | guides/agentic-api/guide.yaml | 179 | # the agentic route, so they fall through to the InferencePool. | COMMENT |
| MEDIUM⚡ | guides/agentic-api/scripts/nightly-deploy-gke.sh | 4 | # Nightly deploy for the agentic-api guide on GKE. | COMMENT |
| MEDIUM⚡ | guides/agentic-api/scripts/nightly-deploy-gke.sh | 7 | # .github/workflows/nightly-e2e-agentic-api-gke-acc-gpu-vllm-x.yaml. Runs from | COMMENT |
| MEDIUM⚡ | guides/agentic-api/scripts/nightly-deploy-gke.sh | 11 | # agentic-api is an extension, so this stands up a base guide first: | COMMENT |
| MEDIUM⚡ | guides/agentic-api/scripts/nightly-deploy-gke.sh | 20 | # files, default /tmp/agentic-api.ci), CRD_RETRY_DELAY, MODELSERVER_TIMEOUT | COMMENT |
| MEDIUM | guides/agentic-api/scripts/nightly-deploy-gke.sh | 107 | # agentic-api check sends one request at a time, so one replica is enough. | COMMENT |
| MEDIUM | …s/agentic-api/manifests/gateway-gke/kustomization.yaml | 5 | # for Service/agentic-api. | COMMENT |
| MEDIUM | …s/agentic-api/manifests/gateway-gke/kustomization.yaml | 9 | # `provider.name=gke`. Only the agentic-api Service is invisible to that chart. | COMMENT |
| MEDIUM | …es/agentic-api/manifests/gateway-gke/gke-policies.yaml | 1 | # GKE-only backend and health-check policies for Service/agentic-api. | COMMENT |
| MEDIUM | …es/agentic-api/manifests/gateway-gke/gke-policies.yaml | 5 | # Gateway Mode step in README.md). Only the agentic-api Service is invisible to | COMMENT |
| MEDIUM | guides/agentic-api/manifests/base/kustomization.yaml | 4 | # agentic-api in front of an already-deployed llm-d guide's router. | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/kustomization.yaml | 4 | # Gateway Mode: the same agentic-api Deployment as ../base, reached through the | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/kustomization.yaml | 13 | # networking.gke.io policies for Service/agentic-api. | COMMENT |
| MEDIUM⚡ | …s/agentic-api/manifests/gateway/patch-hostaliases.yaml | 6 | # request agentic-api makes carries `Host: epp.gateway.internal`, which matches | COMMENT |
| MEDIUM⚡ | …s/agentic-api/manifests/gateway/patch-hostaliases.yaml | 7 | # HTTPRoute/agentic-api-internal in routes.yaml and is routed straight to the base | COMMENT |
| MEDIUM⚡ | …s/agentic-api/manifests/gateway/patch-hostaliases.yaml | 9 | # HTTPRoute/agentic-api on path length and loop back into agentic-api itself. | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/routes.yaml | 1 | # Provider-neutral HTTPRoutes that put agentic-api in front of the base guide's | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/routes.yaml | 23 | # Internal route for the inference requests agentic-api itself emits. | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/routes.yaml | 25 | # agentic-api's upstream call from looping back into agentic-api. | COMMENT |
| MEDIUM | guides/agentic-api/manifests/gateway/routes.yaml | 47 | # "the provider maximum", which long agentic turns need. | COMMENT |
| MEDIUM⚡ | guides/agentic-api/manifests/gateway/routes.yaml | 73 | # agentic-api transforms the upstream list into the Codex model catalog. | COMMENT |
| MEDIUM⚡ | guides/agentic-api/manifests/gateway/routes.yaml | 76 | # agentic-api on the /v1/models path for the base deployment too. Drop | COMMENT |
| MEDIUM⚡ | guides/agentic-api/manifests/gateway/routes.yaml | 78 | # be pointed at Service/agentic-api:9000 directly. | COMMENT |
| 25 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 55 | def test_clear_cache_with_env_var(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 65 | def test_clear_cache_non_existent(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 70 | def test_clear_cache_removes_all_entries_in_directory(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 402 | def test_default_unset_env_returns_none(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 407 | def test_empty_env_returns_none(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 412 | def test_whitespace_env_returns_none(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 417 | def test_valid_gke_keywords_return_gke(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 423 | def test_disabled_or_unknown_keywords_return_none(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 432 | def test_build_app_hooks_and_patches_lifespan(self, mock_patch_lifespan): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 457 | def test_launcher_main_vllm_not_installed_raises(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 465 | def test_launcher_api_server_not_importable_warning(self): | CODE |
| LOW⚡ | docker/scripts/snapshot/test_providers.py | 475 | def test_launcher_hook_api_server_success(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 28 | def test_clear_cache_with_explicit_path_directory(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 41 | def test_clear_cache_with_explicit_path_file(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 89 | def test_clear_cache_empty_directory(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 95 | def test_clear_cache_failure_raises_snapshot_error(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 109 | def test_open_checkpoint_file_not_writable(self, mock_clear, mock_access): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 132 | def test_gke_snapshot_provider_success( | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 154 | def test_gke_snapshot_provider_einval_failure( | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 203 | def test_patch_vllm_lifespan_disabled_provider(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 228 | def test_patch_vllm_lifespan_empty_string_provider(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 253 | def test_patch_vllm_lifespan_provider_not_available_skips_sleep_and_wake(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 286 | def test_patch_vllm_lifespan_unsupported_engine_logs_error(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 310 | def test_patch_vllm_lifespan_trigger_failure_handled_gracefully(self): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 343 | def test_patch_vllm_lifespan_default_provider_unset(self, mock_provider_cls): | CODE |
| LOW | docker/scripts/snapshot/test_providers.py | 375 | def test_patch_vllm_lifespan_provider_gke_gvisor(self, mock_provider_cls): | CODE |
| LOW | docker/scripts/snapshot/vllm/wrapper.py | 35 | def _is_eager_loading_configured() -> bool: | CODE |
| LOW | docker/scripts/cpu/install_nixl.py | 45 | def install_system_dependencies(): | CODE |
| LOW | docker/scripts/cpu/install_nixl.py | 74 | def build_and_install_prerequisites(args): | CODE |
| LOW⚡ | guides/flow-control/scripts/tuning_wizard.py | 49 | def calculate_compute_constraint(throughput: float, latency_sec: float) -> int: | CODE |
| LOW⚡ | guides/flow-control/scripts/tuning_wizard.py | 53 | def calculate_memory_constraint( | CODE |
| LOW | guides/flow-control/scripts/tuning_wizard.py | 91 | def calculate_lookahead_buffer(active_batch: int, max_num_batched_tokens: int, isl_mean: Optional[float]) -> int: | CODE |
| LOW | guides/agentic-api/verify.py | 95 | def verify_http_stateful_responses(base_url: str, model: str) -> None: | CODE |
| LOW | guides/agentic-api/verify.py | 350 | def verify_websocket_responses(base_url: str, model: str) -> None: | CODE |
| LOW | scripts/lint-envvars.py | 36 | def find_locally_defined_vars(script_content: str) -> Set[str]: | CODE |
| LOW | scripts/lint-dockerfile-envvars.py | 12 | def parse_script_requirements(script_path: Path) -> Set[str]: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 48 | def test_team_queues_tiers_and_quotas(overlay: str) -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 66 | def test_no_queue_level_inference_objective(overlay: str) -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 75 | def test_lane_objectives_match_the_guide_objectives(overlay: str) -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 86 | def test_prometheus_overlays_scrape_the_processor(overlay: str) -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 95 | def test_no_namespace_or_router_placeholders(overlay: str) -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 106 | def test_objectives_and_pod_monitor_bind_the_router_pool() -> None: | CODE |
| LOW | scripts/tests/test_multitenant_values.py | 120 | def test_model_server_overlay_carries_the_label_the_router_selects() -> None: | CODE |
| LOW | scripts/tests/test_tuning_wizard.py | 35 | def test_invalid_parameters_are_reported_without_traceback( | CODE |
| LOW | scripts/tests/test_tuning_wizard.py | 45 | def test_valid_parameters_still_produce_recommendations() -> None: | CODE |
| LOW | scripts/tests/test_pd_traffic_stats.py | 13 | def test_statistics_start_at_zero(tmp_path: Path) -> None: | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 95 | def test_linked_pull_request_counts(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 99 | def test_linked_query_includes_closed_pull_requests(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 103 | def test_assignee_pull_request_mention_counts(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 107 | def test_mention_in_title_counts(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 111 | def test_other_authors_mention_does_not_count(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 115 | def test_ghost_author_and_empty_body_are_tolerated(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 125 | def test_recent_activity_is_left_alone(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 129 | def test_quiet_issue_gets_a_reminder(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 133 | def test_quiet_issue_without_comments_uses_creation_date(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 138 | def test_recent_assignment_counts_as_activity(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 142 | def test_bot_comments_are_not_activity(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 147 | def test_pending_reminder_waits_out_the_grace_period(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 151 | def test_unanswered_reminder_unassigns(): | CODE |
| LOW⚡ | scripts/tests/test_assigned_issue_reminder.py | 155 | def test_reply_after_reminder_restarts_the_clock(): | CODE |
| 141 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/scripts/snapshot/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | docker/scripts/common/build-uccl.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docs/well-lit-paths/guides.yaml | 1 | # Guides published on llm-d.ai. | COMMENT |
| LOW | docs/operations/integrations/litellm.md | 281 | # ───────────────────────────────────────────────────────────────── | COMMENT |
| LOW | …structure/providers/gke/dynamic-slicing/kueue-tas.yaml | 1 | # Cluster-scoped Kueue resources for scheduling llm-d model servers onto | COMMENT |
| LOW | guides/omni-serving/httproutes.yaml | 1 | # Exact-path HTTPRoute for an Omni pool behind a Kubernetes Gateway. | COMMENT |
| LOW | guides/omni-serving/guide.yaml | 1 | name: omni-serving | COMMENT |
| LOW | …des/no-kubernetes-deployment/router/epp/endpoints.yaml | 1 | # Endpoints file consumed by the file-discovery plugin. | COMMENT |
| LOW | guides/no-kubernetes-deployment/router/envoy/envoy.yaml | 1 | # Envoy config for the no-Kubernetes file-discovery deployment. | COMMENT |
| LOW | …tion-keda/modelserver/gpu/vllm/base/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | guides/flow-control/scripts/nightly-deploy-gke.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | guides/models/glm-5-2/render/service.yaml | 1 | apiVersion: v1 | COMMENT |
| LOW | guides/models/glm-5-2/monitoring/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1alpha1 | COMMENT |
| LOW | …ides/models/glm-5-2/router/precise-routing.values.yaml | 1 | # Precise prefix-cache routing overrides for glm-5-2.values.yaml: replaces | COMMENT |
| LOW | …/modelserver/gpu/vllm/providers/oci/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | guides/models/deepseek-v4/monitoring/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1alpha1 | COMMENT |
| LOW | …models/nemotron-3-ultra/benchmark-templates/guide.yaml | 1 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | …s/nemotron-3-ultra/router/nemotron-3-ultra.values.yaml | 1 | ## NVIDIA-Nemotron-3-Ultra (GPU / P/D-disaggregated) guide overrides for the llm-d router. | COMMENT |
| LOW | …models/qwen3-coder-480b/benchmark-templates/guide.yaml | 1 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | …-coder-480b/router/qwen3-coder-480b-disagg.values.yaml | 1 | ## Qwen3-Coder-480B (TPU / P/D-disaggregated) guide overrides for the llm-d router. | COMMENT |
| LOW | …ide-ep/modelserver/amd/vllm/base/disaggregatedset.yaml | 141 | # Fabric-, NIC- and driver-specific MoRI settings have no portable default; set them in | COMMENT |
| LOW | guides/wide-ep/monitoring/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1alpha1 | COMMENT |
| LOW | guides/wide-ep/router/gpu.values.yaml | 1 | # NVIDIA GPU (ACCELERATOR=gpu). Layer after wide-ep.values.yaml, like amd.values.yaml and | COMMENT |
| LOW | …precise-prefix-cache-routing/render/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | guides/precise-prefix-cache-routing/render/service.yaml | 1 | apiVersion: v1 | COMMENT |
| LOW | …fix-cache-routing/render/standalone/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | …outing/router/precise-prefix-cache-routing.values.yaml | 1 | ## precise-prefix-cache-routing guide overrides for the router. | COMMENT |
| LOW | guides/agentic-api/guide.yaml | 1 | name: agentic-api | COMMENT |
| LOW | guides/agentic-api/scripts/nightly-deploy-gke.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | …s/agentic-api/manifests/gateway-gke/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | guides/agentic-api/manifests/base/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | guides/agentic-api/manifests/gateway/routes.yaml | 1 | # Provider-neutral HTTPRoutes that put agentic-api in front of the base guide's | COMMENT |
| LOW | …nts/images/tpu-vllm/release-v0.26.0/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1alpha1 | COMMENT |
| LOW | …server/components/graceful-shutdown/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1alpha1 | COMMENT |
| LOW | guides/recipes/observability/generate-traffic-pd.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …/recipes/autoscaling/metrics-reader/kustomization.yaml | 1 | # Shared OpenShift auth bundle for KEDA -> Thanos Querier: a dedicated | COMMENT |
| LOW | guides/recipes/router/base.values.yaml | 21 | protocol: http # http, grpc | COMMENT |
| LOW | …router/calibration/calibrate-min-cached-token-delta.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …router/calibration/calibrate-min-cached-token-delta.sh | 21 | # ... DP_RANKS=16 ./calibrate-min-cached-token-delta.sh | COMMENT |
| LOW | …router/calibration/calibrate-min-cached-token-delta.sh | 41 | # DP>1 fleet calibrates correctly without this. Set it to | COMMENT |
| LOW | …er/calibration/calibration-min-cached-token-delta.yaml | 41 | # Measures the pull-versus-recompute crossover between two live model | COMMENT |
| LOW | guides/recipes/router/calibration/calibrate.sh | 1 | #!/bin/bash | COMMENT |
| LOW | guides/recipes/router/calibration/calibrate.sh | 21 | # MODEL_NAME — model name vLLM is serving (default: Qwen/Qwen3-32B) | COMMENT |
| LOW | …/pod-snapshot/modelserver/gpu/vllm/gke/patch-vllm.yaml | 41 | env: | COMMENT |
| LOW | …y-routing/modelserver/xpu/vllm/base/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | …outing/router/predicted-latency-multimodal.values.yaml | 41 | # A workload of 3×720p images + ~1.3K text tokens peaks around ~5K tokens | COMMENT |
| LOW | …tency-routing/router/predicted-latency-slo.values.yaml | 1 | ## Predicted Latency-Based Scheduling — SLO-aware setup (streamingMode: true). | COMMENT |
| LOW | …zed-baseline/modelserver/gpu/vllm/base/patch-vllm.yaml | 21 | # recipes/modelserver/components/graceful-shutdown; raise both together. | COMMENT |
| LOW | …baseline/modelserver/gpu/sglang/base/patch-sglang.yaml | 21 | # Uncomment for distributed tracing | COMMENT |
| LOW | …zed-baseline/modelserver/xpu/vllm/base/patch-vllm.yaml | 21 | - "--disable-access-log-for-endpoints=/health,/metrics,/v1/models" | COMMENT |
| LOW | …zed-baseline/modelserver/amd/vllm/base/patch-vllm.yaml | 21 | # - "--collect-detailed-traces=all" | COMMENT |
| LOW | …baseline/modelserver/amd/sglang/base/patch-sglang.yaml | 21 | # - "--enable-trace" | COMMENT |
| LOW | …-baseline/modelserver/tpu/v6/vllm/base/patch-vllm.yaml | 21 | # recipes/modelserver/components/graceful-shutdown; raise both together. | COMMENT |
| LOW | …-baseline/modelserver/tpu/v7/vllm/base/patch-vllm.yaml | 21 | # recipes/modelserver/components/graceful-shutdown; raise both together. | COMMENT |
| LOW | guides/optimized-baseline/router/npu.rbln.values.yaml | 1 | # Rebellions NPU overrides for optimized-baseline.values.yaml. Apply after it; | COMMENT |
| LOW | …e-sharing/modelserver/gpu/vllm/rdma/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | …e-sharing/modelserver/gpu/vllm/base/kustomization.yaml | 1 | apiVersion: kustomize.config.k8s.io/v1beta1 | COMMENT |
| LOW | …ache-sharing/modelserver/gpu/vllm/base/patch-vllm.yaml | 21 | - --port=8200 | COMMENT |
| LOW | …ache-sharing/modelserver/xpu/vllm/base/patch-vllm.yaml | 21 | command: ["sh", "-c", "rm -f /dev/shm/vllm_offload_*.mmap 2>/dev/null; exec vllm serve \"$@\"", "sh"] | COMMENT |
| LOW | …-cache-sharing/router/p2p-kv-cache-sharing.values.yaml | 1 | ## p2p-kv-cache-sharing guide overrides for the router. | COMMENT |
| 94 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docs/operations/traffic/flow-control-tuning.md | 45 | ### Step 1: Gather System Telemetry (For Compute Bound) | COMMENT |
| LOW | docs/operations/traffic/flow-control-tuning.md | 57 | ### Step 2: Gather Workload Statistics (For Memory Bound) | COMMENT |
| LOW | docs/operations/traffic/flow-control-tuning.md | 67 | ### Step 3: Run the Tuning Wizard | COMMENT |
| LOW | docs/operations/traffic/flow-control-tuning.md | 105 | ### Step 4: Apply Configuration | COMMENT |
| LOW | docs/operations/observability/setup.md | 12 | ## Step 1: Install Prometheus and Grafana | COMMENT |
| LOW | docs/operations/observability/setup.md | 145 | ## Step 2: Load Grafana Dashboards | COMMENT |
| LOW | docs/operations/observability/setup.md | 160 | ## Step 3: Install Distributed Tracing (Optional) | COMMENT |
| LOW | docs/operations/observability/alerting.md | 20 | ## Step 1: Apply the Alerting Rules | COMMENT |
| LOW | docs/operations/observability/alerting.md | 31 | ## Step 2: Verify | COMMENT |
| LOW | docs/operations/observability/tracing.md | 24 | ## Step 1: Deploy OTel Collector and Jaeger | COMMENT |
| LOW | docs/operations/observability/tracing.md | 68 | ## Step 2: Enable Tracing on the Model Server and Routing Proxy | COMMENT |
| LOW | docs/operations/observability/tracing.md | 89 | ## Step 3: Enable Tracing on EPP | COMMENT |
| LOW | docs/operations/observability/tracing.md | 104 | ## Step 4: View Traces | COMMENT |
| LOW | docs/operations/observability/metrics.md | 21 | ## Step 1: Scrape Model Server Metrics | COMMENT |
| LOW | docs/operations/observability/metrics.md | 53 | ## Step 2: Scrape EPP Metrics | COMMENT |
| LOW | docs/operations/observability/metrics.md | 70 | ## Step 3: Query Metrics in Prometheus | COMMENT |
| LOW | docs/operations/integrations/kong.md | 46 | ## Step 1: Create Secret for External Provider Keys | COMMENT |
| LOW | docs/operations/integrations/kong.md | 62 | ## Step 2: Install Kong Ingress Controller + Gateway via Helm | COMMENT |
| LOW | docs/operations/integrations/kong.md | 110 | ## Step 3: Create GatewayClass, Gateway, and Placeholder Service | COMMENT |
| LOW | docs/operations/integrations/kong.md | 159 | ## Step 4: Configure Routes and `ai-proxy` Plugins | COMMENT |
| LOW | docs/operations/integrations/kong.md | 355 | ## Step 5: Verification | COMMENT |
| LOW | docs/operations/integrations/litellm.md | 41 | ## Step 1: Create Secrets for LiteLLM | COMMENT |
| LOW | docs/operations/integrations/litellm.md | 68 | ## Step 2: Set Up PostgreSQL and Redis Backends | COMMENT |
| LOW | docs/operations/integrations/litellm.md | 208 | ## Step 3: Construct LiteLLM Helm Values and Install | COMMENT |
| LOW | docs/operations/integrations/litellm.md | 328 | ## Step 4: Verify Both Models | COMMENT |
| LOW⚡ | docs/infrastructure/providers/openshift-aws/README.md | 16 | ## Step 1: Create a Red Hat OpenShift Service on AWS (ROSA) Cluster | COMMENT |
| LOW⚡ | docs/infrastructure/providers/openshift-aws/README.md | 25 | ## Step 2: Add a Machineset with NVIDIA GPU Instances | COMMENT |
| LOW⚡ | docs/infrastructure/providers/openshift-aws/README.md | 34 | ## Step 3: Enable GPU support on OpenShift with the NFD and GPU Operators | COMMENT |
| LOW | docs/infrastructure/gateway/gke.md | 27 | ## Step 1: Install Gateway API and Gateway API Inference Extension CRDs | COMMENT |
| LOW | docs/infrastructure/gateway/gke.md | 46 | ## Step 2: Deploy the Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/gke.md | 70 | ## Step 3: Verify the Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/gke.md | 87 | ## Step 4: Deploy a Model Serving Workload | COMMENT |
| LOW | docs/infrastructure/gateway/gke.md | 194 | ## Step 5: Send a Request | COMMENT |
| LOW | docs/infrastructure/gateway/agentgateway.md | 18 | ## Step 1: Install Gateway API and Gateway API Inference Extension CRDs | COMMENT |
| LOW | docs/infrastructure/gateway/agentgateway.md | 22 | ## Step 2: Install Agentgateway | COMMENT |
| LOW | docs/infrastructure/gateway/agentgateway.md | 58 | ## Step 3: Deploy the Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/agentgateway.md | 99 | ## Step 4: Send a Request | COMMENT |
| LOW | docs/infrastructure/gateway/envoy-ai-gateway.md | 18 | ## Step 1: Install Gateway API and Gateway API Inference Extension CRDs | COMMENT |
| LOW | docs/infrastructure/gateway/envoy-ai-gateway.md | 22 | ## Step 2: Install Envoy AI Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/envoy-ai-gateway.md | 128 | ## Step 3: Deploy the Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/envoy-ai-gateway.md | 157 | ## Step 4: Send a Request | COMMENT |
| LOW | docs/infrastructure/gateway/istio.md | 15 | ## Step 1: Install Gateway API and Gateway API Inference Extension CRDs | COMMENT |
| LOW | docs/infrastructure/gateway/istio.md | 19 | ## Step 2: Install Istio | COMMENT |
| LOW | docs/infrastructure/gateway/istio.md | 44 | ## Step 3: Deploy the Gateway | COMMENT |
| LOW | docs/infrastructure/gateway/istio.md | 73 | ## Step 4: Send a Request | COMMENT |
| LOW | …che/modelserver/tpu/common/single-host/patch-vllm.yaml | 18 | # WARNING: This changes the HOST memory settings, not just the container. | COMMENT |
| LOW | …/qwen3-coder-480b/modelserver/tpu/vllm/patch-vllm.yaml | 15 | # WARNING: This changes the HOST memory settings, not just the container. | COMMENT |
| LOW | guides/multi-model-routing/README.md | 85 | ## Step 1: Deploy IPP | COMMENT |
| LOW | guides/multi-model-routing/README.md | 110 | ## Step 2: Create Model Mapping ConfigMaps | COMMENT |
| LOW | guides/multi-model-routing/README.md | 123 | ## Step 3: Configure HTTPRoutes | COMMENT |
| LOW | guides/multi-model-routing/README.md | 135 | ## Step 4: Test the Deployment | COMMENT |
| LOW | guides/agentic-api/verify.py | 190 | # Step 1: Request with function tool that triggers a webhook notification | COMMENT |
| LOW | guides/agentic-api/verify.py | 239 | # Step 2: Deliver the webhook event to the live HTTP webhook server | COMMENT |
| LOW⚡ | guides/agentic-api/verify.py | 258 | # Step 3: Return webhook delivery receipt to agentic-api via stateful previous_response_id | COMMENT |
| LOW | …ecipes/observability/inferencecost/install-opencost.sh | 742 | # Step 1: Check for existing OpenCost | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 760 | # Step 2: Detect or install Prometheus | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 768 | # Step 3: Confirm pricing | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 771 | # Step 4: Install | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 774 | # Step 5: Wait for Prometheus to scrape, then check llm-d config | COMMENT |
| LOW | guides/batch-serving/asynchronous-processing/README.md | 40 | #### Step 1: Deploy llm-d Router | COMMENT |
| 28 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …re/providers/digitalocean/gpu-configs/l40s-values.yaml | 38 | # Enable comprehensive metrics collection | COMMENT |
| MEDIUM | …ders/digitalocean/gpu-configs/rtx-4000-ada-values.yaml | 47 | # Enable comprehensive metrics collection | COMMENT |
| MEDIUM | …ders/digitalocean/gpu-configs/rtx-6000-ada-values.yaml | 36 | # Enable comprehensive metrics collection | COMMENT |
| MEDIUM | guides/flow-control/guide.yaml | 153 | # --harness/--workload stay literal because flow-control has no dedicated | COMMENT |
| MEDIUM | …models/nemotron-3-ultra/benchmark-templates/guide.yaml | 38 | namespace: *namespace # Namespace where harness is deployed. Typically with stack. | CODE |
| MEDIUM | …models/nemotron-3-ultra/benchmark-templates/guide.yaml | 48 | workload: # yaml configuration for harness workload(s) | CODE |
| MEDIUM | …models/qwen3-coder-480b/benchmark-templates/guide.yaml | 39 | namespace: *namespace # Namespace where harness is deployed. Typically with stack. | CODE |
| MEDIUM | …models/qwen3-coder-480b/benchmark-templates/guide.yaml | 49 | workload: # yaml configuration for harness workload(s) | CODE |
| MEDIUM | …ocessing/multitenant/manifests/coordinator/config.yaml | 25 | # topology is plain HTTP end to end (harness pods, the llm-d-async dispatch | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 42 | # Source the shared guide environment so this harness tests the same llm-d Router | COMMENT |
| MEDIUM | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 159 | # This harness is CPU-only by design (no GPU in CI/dev kind). | COMMENT |
| MEDIUM | …-workload-autoscaling-keda-epp-ibm-acc-gpu-vllm-x.yaml | 18 | # decode_pods/prefill_pods/harness/workload are accepted only for | COMMENT |
| MEDIUM | …flows/nightly-e2e-flow-control-gke-acc-gpu-vllm-x.yaml | 8 | # Why not the shared benchmark harness? Two reasons, both still true: | COMMENT |
| MEDIUM | …flows/nightly-e2e-flow-control-gke-acc-gpu-vllm-x.yaml | 13 | # with "unable to detect model". (The harness has a flow-control special | COMMENT |
| MEDIUM | .github/workflows/release-e2e.yaml | 48 | # Least privilege by default; the jobs below elevate what they need. | COMMENT |
| MEDIUM | …workload-autoscaling-keda-epp-amd-acc-rocm-vllm-x.yaml | 12 | # decode_pods, prefill_pods, harness and workload are accepted only because | COMMENT |
| MEDIUM | .github/workflows/slash-test-nightly.yaml | 13 | # harness=<name> Benchmark harness (default: inference-perf) | COMMENT |
| MEDIUM | .github/scripts/e2e/e2e-validate-flow-control.sh | 356 | # missed by scrape timing, so it is the robust backbone assertion. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/scripts/snapshot/test_providers.py | 5 | CODE | |
| LOW | docker/scripts/snapshot/__init__.py | 5 | CODE | |
| LOW | docker/scripts/snapshot/__init__.py | 5 | CODE | |
| LOW | docker/scripts/snapshot/__init__.py | 5 | CODE | |
| LOW | docker/scripts/snapshot/__init__.py | 10 | CODE | |
| LOW | docker/scripts/snapshot/providers.py | 7 | CODE | |
| LOW | docker/scripts/snapshot/launcher.py | 8 | CODE | |
| LOW | docker/scripts/snapshot/vllm/wrapper.py | 14 | CODE | |
| LOW | docker/scripts/snapshot/vllm/__init__.py | 5 | CODE | |
| LOW | guides/agentic-api/verify.py | 13 | CODE | |
| LOW | guides/agentic-api/verify.py | 19 | CODE | |
| LOW | guides/agentic-api/verify.py | 21 | CODE | |
| LOW | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 14 | CODE | |
| LOW | …us-processing/multitenant/scripts/stress-test-redis.py | 18 | CODE | |
| LOW | …s-processing/multitenant/scripts/stress-test-pubsub.py | 15 | CODE | |
| LOW | scripts/guide.py | 77 | CODE | |
| LOW | scripts/tests/test_multitenant_values.py | 8 | CODE | |
| LOW | scripts/tests/test_nightly_deploy_agentic_api.py | 10 | CODE | |
| LOW | scripts/tests/test_multitenant_coordinator_values.py | 9 | CODE | |
| LOW | …cripts/nightly-e2e-verification/test_verify_helpers.py | 6 | CODE | |
| LOW | …hub/scripts/nightly-e2e-verification/verify_helpers.py | 8 | CODE | |
| LOW | …ly-e2e-verification/tiered-prefix-cache/test_verify.py | 6 | CODE | |
| LOW | …nightly-e2e-verification/tiered-prefix-cache/verify.py | 28 | CODE | |
| LOW | …b/scripts/nightly-e2e-verification/_template/verify.py | 15 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ture/providers/digitalocean/verify-do-prerequisites.sh | 60 | # Check if we're on DOKS | COMMENT |
| LOW | …ture/providers/digitalocean/verify-do-prerequisites.sh | 123 | # Check if DO CSI driver is available | COMMENT |
| LOW | …/providers/digitalocean/monitoring/setup-monitoring.sh | 72 | # Check if kubectl can connect to cluster | COMMENT |
| LOW | …/providers/digitalocean/monitoring/setup-monitoring.sh | 177 | # Check if release already exists | COMMENT |
| LOW | …structure/providers/gke/dynamic-slicing/kueue-tas.yaml | 63 | # Set nominalQuota to your reserved capacity to enforce quota, or | COMMENT |
| LOW | …che/modelserver/tpu/common/single-host/patch-vllm.yaml | 22 | # Check if the VFIO IOMMU module parameter exists, and if so, increase the | COMMENT |
| LOW | …/qwen3-coder-480b/modelserver/tpu/vllm/patch-vllm.yaml | 19 | # Check if the VFIO IOMMU module parameter exists, and if so, increase the | COMMENT |
| LOW | …recipes/observability/generate-prometheus-tls-certs.sh | 190 | # Check if namespace exists | COMMENT |
| LOW | guides/recipes/observability/load-llm-d-dashboards.sh | 31 | # Check if namespace exists | COMMENT |
| LOW | guides/recipes/observability/load-llm-d-dashboards.sh | 37 | # Check if dashboard directory exists | COMMENT |
| LOW | …es/recipes/observability/install-prometheus-grafana.sh | 253 | # Check if certificates already exist | COMMENT |
| LOW | …es/recipes/observability/install-prometheus-grafana.sh | 281 | # Check if user workload monitoring is enabled | COMMENT |
| LOW | …ecipes/observability/inferencecost/install-opencost.sh | 284 | # Check if the endpoint is already reachable (e.g. running inside the cluster) | COMMENT |
| LOW | …rebalancing/optimized-baseline/base/clusterqueues.yaml | 11 | # Set them to the GPUs actually installed: `kubectl describe nodes | grep nvidia.com/gpu`. | COMMENT |
| LOW | .github/scripts/e2e/e2e-validate.sh | 150 | # Check if we got a specific error | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/scripts/snapshot/vllm/wrapper.py | 98 | except Exception as e: | CODE |
| LOW | guides/agentic-api/verify.py | 53 | except Exception: | CODE |
| LOW | …er/calibration/calibration-min-cached-token-delta.yaml | 127 | except Exception: | CODE |
| LOW | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 112 | except Exception: | CODE |
| LOW | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 130 | except Exception: | CODE |
| LOW | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 142 | except Exception: | CODE |
| LOW | …us-processing/multitenant/scripts/stress-test-redis.py | 66 | except Exception: | CODE |
| LOW | …us-processing/multitenant/scripts/stress-test-redis.py | 142 | except Exception as e: | CODE |
| LOW | …us-processing/multitenant/scripts/stress-test-redis.py | 164 | except Exception as e: | CODE |
| LOW | …s-processing/multitenant/scripts/stress-test-pubsub.py | 30 | except Exception: | CODE |
| LOW | …s-processing/multitenant/scripts/stress-test-pubsub.py | 75 | except Exception: | CODE |
| LOW | …-autoscaling/slo-aware/benchmark-templates/plot_run.py | 97 | except Exception: | CODE |
| LOW | scripts/lint-envvars.py | 96 | except Exception as e: | CODE |
| LOW | scripts/lint-dockerfile-envvars.py | 16 | except Exception: | CODE |
| MEDIUM | scripts/lint-dockerfile-envvars.py | 210 | print(f"Error: Scripts directory not found: {scripts_dir}", file=sys.stderr) | CODE |
| MEDIUM | scripts/lint-dockerfile-envvars.py | 216 | print(f"Error: Dockerfile not found: {dockerfile}", file=sys.stderr) | CODE |
| LOW | …hub/scripts/nightly-e2e-verification/verify_helpers.py | 389 | except Exception as e: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | guides/agentic-api/verify.py | 190 | # Step 1: Request with function tool that triggers a webhook notification | COMMENT |
| LOW | guides/agentic-api/verify.py | 239 | # Step 2: Deliver the webhook event to the live HTTP webhook server | COMMENT |
| LOW⚡ | guides/agentic-api/verify.py | 258 | # Step 3: Return webhook delivery receipt to agentic-api via stateful previous_response_id | COMMENT |
| LOW | …ecipes/observability/inferencecost/install-opencost.sh | 742 | # Step 1: Check for existing OpenCost | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 760 | # Step 2: Detect or install Prometheus | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 768 | # Step 3: Confirm pricing | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 771 | # Step 4: Install | COMMENT |
| LOW⚡ | …ecipes/observability/inferencecost/install-opencost.sh | 774 | # Step 5: Wait for Prometheus to scrape, then check llm-d config | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …ron-3-ultra/modelserver/gpu/vllm/gke/patch-decode.yaml | 46 | # Define the GCS FUSE volume specifications | COMMENT |
| MEDIUM | …on-3-ultra/modelserver/gpu/vllm/gke/patch-prefill.yaml | 45 | # Define the GCS FUSE volume specifications | COMMENT |
| MEDIUM | …recipes/observability/generate-prometheus-tls-certs.sh | 104 | # Define the Prometheus service DNS names. Both the chart's Service and the | COMMENT |
| MEDIUM | …recipes/observability/generate-prometheus-tls-certs.sh | 202 | # Create the secret | COMMENT |
| MEDIUM | .github/slack-channels.yaml | 4 | # This file is the single source of truth. Two consumers read it: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ides/models/glm-5-2/monitoring/apply-scrape-configs.sh | 4 | # Usage: | COMMENT |
| LOW | …/models/deepseek-v4/monitoring/apply-scrape-configs.sh | 4 | # Usage: | COMMENT |
| LOW | guides/wide-ep/monitoring/apply-scrape-configs.sh | 4 | # Usage: | COMMENT |
| LOW | …router/calibration/calibrate-min-cached-token-delta.sh | 16 | # Usage: | COMMENT |
| LOW | guides/recipes/router/calibration/calibrate.sh | 11 | # Usage: | COMMENT |
| LOW | …ynchronous-processing/multitenant/scripts/gcp-setup.sh | 8 | # Usage: | COMMENT |
| LOW | …hronous-processing/multitenant/scripts/gcp-teardown.sh | 4 | # Usage: | COMMENT |
| LOW⚡ | …batch-serving/asynchronous-processing/test/kind-e2e.sh | 16 | # Usage: | COMMENT |
| LOW | …hub/scripts/nightly-e2e-verification/verify-locally.sh | 11 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/scripts/snapshot/providers.py | 43 | CODE | |
| LOW | guides/agentic-api/verify.py | 58 | CODE | |
| LOW | guides/agentic-api/verify.py | 71 | CODE | |
| LOW | …us-processing/multitenant/scripts/stress-test-redis.py | 123 | CODE | |
| LOW | scripts/guide.py | 341 | CODE | |
| LOW | scripts/guide.py | 404 | CODE | |
| LOW | scripts/guide.py | 618 | CODE | |
| LOW | scripts/guide.py | 666 | CODE | |
| LOW | scripts/guide.py | 680 | CODE | |
| LOW | scripts/guide.py | 803 | CODE | |
| LOW | scripts/guide.py | 840 | CODE | |
| LOW | scripts/guide.py | 1112 | CODE | |
| LOW | scripts/guide.py | 1867 | CODE | |
| LOW | scripts/guide.py | 1951 | CODE | |
| LOW | scripts/guide.py | 2083 | CODE | |
| LOW | scripts/matrix_common.py | 233 | CODE | |
| LOW | scripts/lint-dockerfile-envvars.py | 52 | CODE | |
| LOW | .github/scripts/notify-slack-nightly.py | 283 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 112 | except Exception: | CODE |
| HIGH | …rocessing/multitenant/scripts/benchmark-heavy-redis.py | 142 | except Exception: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | scripts/tests/test_nightly_deploy_agentic_api.py | 40 | "get priorityclass") [[ "${FAKE_PRIORITYCLASS:-1}" == "1" ]] && exit 0 || exit 1 ;; | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docker/scripts/snapshot/__init__.py | 12 | __all__ = [ | CODE |
| LOW | docker/scripts/snapshot/providers.py | 17 | __all__ = [ | CODE |
| LOW | docker/scripts/snapshot/vllm/__init__.py | 7 | __all__ = ["patch_vllm_lifespan"] | CODE |
| LOW⚡ | scripts/guide.py | 89 | __all__ = [ | CODE |