Repository Analysis

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

11.0 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of llm-d/llm-d, a Shell project with 4,308 GitHub stars. SynthScan v2.0 examined 96,942 lines of code across 1018 source files, recording 500 pattern matches distributed across 13 syntactic categories. The overall adjusted score of 11.0 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

11.0
Adjusted Score
11.0
Raw Score
100%
Time Factor
2026-08-28
Last Push
4.3K
Stars
Shell
Language
96.9K
Lines of Code
1.0K
Files
500
Pattern Hits
2026-08-29
Scan Date
0.00
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 0MEDIUM 229LOW 271

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 500 distinct pattern matches across 13 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators169 hits · 560 pts
SeverityFileLineSnippetContext
MEDIUMdocker/scripts/cuda/builder/build-ucx.sh5# --------------------------------------------COMMENT
MEDIUMdocker/scripts/cuda/builder/build-ucx.sh9# --------------------------------------------COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md174# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md178# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md210# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md213# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md245# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md248# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md287# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/kong.md290# ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md262 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md265 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md281 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md284 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md300 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs/operations/serve-external-apis/litellm.md303 # ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py18# ==========================================COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py20# ==========================================COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py45# ==========================================COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py47# ==========================================COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py104# ==========================================COMMENT
MEDIUMguides/flow-control/scripts/tuning_wizard.py106# ==========================================COMMENT
MEDIUM…s/recipes/observability/alerts/epp-alerting-rules.yaml9 # ---------------------------------------------------------------------------COMMENT
MEDIUM…s/recipes/observability/alerts/epp-alerting-rules.yaml11 # ---------------------------------------------------------------------------COMMENT
MEDIUM…s/recipes/observability/alerts/epp-alerting-rules.yaml63 # ---------------------------------------------------------------------------COMMENT
MEDIUM…s/recipes/observability/alerts/epp-alerting-rules.yaml65 # ---------------------------------------------------------------------------COMMENT
MEDIUM…ed-latency-routing/benchmark-templates/multimodal.yaml1# ---------------------------------------------------------------------------COMMENT
MEDIUM…ed-latency-routing/benchmark-templates/multimodal.yaml17# ---------------------------------------------------------------------------COMMENT
MEDIUM…edicted-latency-routing/benchmark-templates/guide.yaml1# ---------------------------------------------------------------------------COMMENT
MEDIUM…edicted-latency-routing/benchmark-templates/guide.yaml25# ---------------------------------------------------------------------------COMMENT
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml1# ---------------------------------------------------------------------------COMMENT
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml21# ---------------------------------------------------------------------------COMMENT
MEDIUMguides/agentic-serving/benchmark-templates/guide.yaml1# ---------------------------------------------------------------------------COMMENT
MEDIUMguides/agentic-serving/benchmark-templates/guide.yaml22# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh23# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh25# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh86# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh88# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh96# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh98# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh103# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh105# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh62# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh64# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh119# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh121# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh179# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh181# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh192# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh194# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh213# ---------------------------------------------------------------------------COMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh215# ---------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py91# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py93# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py164# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py166# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py224# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py226# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py285# --------------------------------------------------------------------------COMMENT
MEDIUMscripts/guide.py287# --------------------------------------------------------------------------COMMENT
109 more matches not shown…
Structural Annotation Overuse81 hits · 126 pts
SeverityFileLineSnippetContext
LOWdocs/operations/serve-external-apis/kong.md46## Step 1: Create Secret for External Provider KeysCOMMENT
LOWdocs/operations/serve-external-apis/kong.md62## Step 2: Install Kong Ingress Controller + Gateway via HelmCOMMENT
LOWdocs/operations/serve-external-apis/kong.md110## Step 3: Create GatewayClass, Gateway, and Placeholder ServiceCOMMENT
LOWdocs/operations/serve-external-apis/kong.md159## Step 4: Configure Routes and `ai-proxy` PluginsCOMMENT
LOWdocs/operations/serve-external-apis/kong.md355## Step 5: VerificationCOMMENT
LOWdocs/operations/serve-external-apis/litellm.md41## Step 1: Create Secrets for LiteLLMCOMMENT
LOWdocs/operations/serve-external-apis/litellm.md68## Step 2: Set Up PostgreSQL and Redis BackendsCOMMENT
LOWdocs/operations/serve-external-apis/litellm.md208## Step 3: Construct LiteLLM Helm Values and InstallCOMMENT
LOWdocs/operations/serve-external-apis/litellm.md328## Step 4: Verify Both ModelsCOMMENT
LOWdocs/operations/observability/setup.md12## Step 1: Install Prometheus and GrafanaCOMMENT
LOWdocs/operations/observability/setup.md145## Step 2: Load Grafana DashboardsCOMMENT
LOWdocs/operations/observability/setup.md176## Step 3: Install Distributed Tracing (Optional)COMMENT
LOWdocs/operations/observability/alerting.md20## Step 1: Apply the Alerting RulesCOMMENT
LOWdocs/operations/observability/alerting.md31## Step 2: VerifyCOMMENT
LOWdocs/operations/observability/tracing.md24## Step 1: Deploy OTel Collector and JaegerCOMMENT
LOWdocs/operations/observability/tracing.md68## Step 2: Enable Tracing on the Model Server and Routing ProxyCOMMENT
LOWdocs/operations/observability/tracing.md89## Step 3: Enable Tracing on EPPCOMMENT
LOWdocs/operations/observability/tracing.md104## Step 4: View TracesCOMMENT
LOWdocs/operations/observability/metrics.md17## Step 1: Enable Model Server MetricsCOMMENT
LOWdocs/operations/observability/metrics.md76## Step 3: Enable EPP MetricsCOMMENT
LOWdocs/operations/observability/metrics.md212## Step 4: View DashboardsCOMMENT
LOWdocs/operations/observability/metrics.md264## Step 5: Query MetricsCOMMENT
LOWdocs/infrastructure/providers/openshift-aws/README.md16## Step 1: Create a Red Hat OpenShift Service on AWS (ROSA) ClusterCOMMENT
LOWdocs/infrastructure/providers/openshift-aws/README.md25## Step 2: Add a Machineset with NVIDIA GPU InstancesCOMMENT
LOWdocs/infrastructure/providers/openshift-aws/README.md34## Step 3: Enable GPU support on OpenShift with the NFD and GPU OperatorsCOMMENT
LOWdocs/infrastructure/gateway/gke.md26## Step 1: Install Gateway API and Gateway API Inference Extension CRDsCOMMENT
LOWdocs/infrastructure/gateway/gke.md45## Step 2: Deploy the GatewayCOMMENT
LOWdocs/infrastructure/gateway/gke.md69## Step 3: Verify the GatewayCOMMENT
LOWdocs/infrastructure/gateway/gke.md86## Step 4: Send a RequestCOMMENT
LOWdocs/infrastructure/gateway/agentgateway.md18## Step 1: Install Gateway API and Gateway API Inference Extension CRDsCOMMENT
LOWdocs/infrastructure/gateway/agentgateway.md22## Step 2: Install AgentgatewayCOMMENT
LOWdocs/infrastructure/gateway/agentgateway.md58## Step 3: Deploy the GatewayCOMMENT
LOWdocs/infrastructure/gateway/agentgateway.md99## Step 4: Send a RequestCOMMENT
LOWdocs/infrastructure/gateway/envoy-ai-gateway.md18## Step 1: Install Gateway API and Gateway API Inference Extension CRDsCOMMENT
LOWdocs/infrastructure/gateway/envoy-ai-gateway.md22## Step 2: Install Envoy AI GatewayCOMMENT
LOWdocs/infrastructure/gateway/envoy-ai-gateway.md128## Step 3: Deploy the GatewayCOMMENT
LOWdocs/infrastructure/gateway/envoy-ai-gateway.md157## Step 4: Send a RequestCOMMENT
LOWdocs/infrastructure/gateway/istio.md15## Step 1: Install Gateway API and Gateway API Inference Extension CRDsCOMMENT
LOWdocs/infrastructure/gateway/istio.md19## Step 2: Install IstioCOMMENT
LOWdocs/infrastructure/gateway/istio.md44## Step 3: Deploy the GatewayCOMMENT
LOWdocs/infrastructure/gateway/istio.md73## Step 4: Send a RequestCOMMENT
LOW…prefix-cache/modelserver/tpu/base/vllm/patch-vllm.yaml18 # WARNING: This changes the HOST memory settings, not just the container.COMMENT
LOWguides/flow-control/tuning.md43### Step 1: Gather System Telemetry (For Compute Bound)COMMENT
LOWguides/flow-control/tuning.md55### Step 2: Gather Workload Statistics (For Memory Bound)COMMENT
LOWguides/flow-control/tuning.md65### Step 3: Run the Tuning WizardCOMMENT
LOWguides/flow-control/tuning.md103### Step 4: Apply ConfigurationCOMMENT
LOWguides/multi-model-routing/README.md57## Step 1: Deploy IPPCOMMENT
LOWguides/multi-model-routing/README.md82## Step 2: Create Model Mapping ConfigMapsCOMMENT
LOWguides/multi-model-routing/README.md95## Step 3: Configure HTTPRoutesCOMMENT
LOWguides/multi-model-routing/README.md107## Step 4: Test the DeploymentCOMMENT
LOW…s/agentic-serving/modelserver/tpu/vllm/patch-vllm.yaml15 # WARNING: This changes the HOST memory settings, not just the container.COMMENT
LOWguides/p2p-kv-cache-sharing/benchmarking/README.md191## Step 0 - pull-versus-recompute crossover (single request)COMMENT
LOWguides/batch-serving/asynchronous-processing/README.md40#### Step 1: Deploy llm-d RouterCOMMENT
LOWguides/batch-serving/asynchronous-processing/README.md53#### Step 2: Configure ValuesCOMMENT
LOWguides/batch-serving/asynchronous-processing/README.md60#### Step 3: Deploy Async ProcessorCOMMENT
LOWguides/batch-serving/batch-gateway/README.md45### Step 1: Create the NamespaceCOMMENT
LOWguides/batch-serving/batch-gateway/README.md52### Step 2: Create the SecretsCOMMENT
LOWguides/batch-serving/batch-gateway/README.md64### Step 3: Configure the llm-d Router URLCOMMENT
LOWguides/batch-serving/batch-gateway/README.md76### Step 4: Create the File Storage PVCCOMMENT
LOWguides/batch-serving/batch-gateway/README.md97### Step 5: DeployCOMMENT
21 more matches not shown…
Modern AI Meta-Vocabulary34 hits · 104 pts
SeverityFileLineSnippetContext
MEDIUMSIGS.md54| **[SIG Agentic Inference](#sig-agentic-inference)** | Optimizing inference for agentic and multi-step AI workloads | •CODE
MEDIUMSIGS.md286- **Slack Channel**: [#sig-agentic-inference](https://llm-d.slack.com/archives/C0ALHNZJCFJ)CODE
MEDIUM…des/wide-ep-lws/modelserver/gpu/vllm-glm-5.2/README.md132[blog post](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d).CODE
MEDIUMguides/recipes/router/calibration/calibrate.sh12# GUIDE_NAME=agentic-serving NAMESPACE=llm-d-agentic-serving \COMMENT
MEDIUMguides/predicted-latency-routing/README.md344Uses the agentic-serving guide's `inference-perf` workload, tuned for the 480B model and very long (up to 256K-token) coCODE
MEDIUMguides/predicted-latency-routing/README.md347# Fetch the existing-stack benchmark runner from llm-d-benchmark (the script the agentic-serving guide uses).COMMENT
MEDIUM…atency-routing/modelserver/tpu/vllm/kustomization.yaml4# Reuse the agentic-serving guide's TPU model server: Qwen3-Coder-480B-A35B-Instruct-FP8COMMENT
MEDIUM…atency-routing/router/predicted-latency-pd.values.yaml35 # the 256K agentic sizing, so a smaller match window keeps EPP prefix-matchingCOMMENT
MEDIUM…d-latency-routing/router/predicted-latency.values.yaml27 # Sized for the 256K-context TPU agentic case (Qwen3-Coder-480B): matching longerCOMMENT
MEDIUM…d-latency-routing/router/predicted-latency.values.yaml28 # prefixes raises the cache-hit rate on long, shared agentic prompts. Tradeoff: itCOMMENT
MEDIUM…tency-routing/router/predicted-latency-slo.values.yaml30 # Sized for the 256K-context TPU agentic case (Qwen3-Coder-480B): matching longerCOMMENT
MEDIUM…tency-routing/router/predicted-latency-slo.values.yaml31 # prefixes raises the cache-hit rate on long, shared agentic prompts. Tradeoff: itCOMMENT
MEDIUMguides/agentic-serving/nemotron-3-ultra-550b-h200.md165# from the guide directory: guides/agentic-servingCOMMENT
MEDIUMguides/agentic-serving/nemotron-3-ultra-550b-h200.md173# from the guide directory: guides/agentic-servingCOMMENT
MEDIUMguides/agentic-serving/nemotron-3-ultra-550b-h200.md203curl -LJO "https://raw.githubusercontent.com/llm-d/llm-d/main/guides/${GUIDE_NAME}/benchmark-templates/agentic-serving-nCODE
MEDIUMguides/agentic-serving/README.md45- [GLM-5.2-FP8 on H200](glm-5-2-h200.md) — wide expert-parallel P/D-disaggregated serving with MTP and tiered KV-offloadCODE
MEDIUMguides/agentic-serving/glm-5-2-h200.md8[GLM-5.2 agentic serving blog post](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d),CODE
MEDIUMguides/agentic-serving/glm-5-2-h200.md180[blog post](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d) for the fullCODE
MEDIUM…erving/modelserver/gpu/vllm/glm-5-2/kustomization.yaml3# Recommended agentic-serving deployment of GLM-5.2-FP8 on H200: the wide-ep-lwsCOMMENT
MEDIUM…ng/modelserver/gpu/vllm/nemotron-3-ultra/gke/README.md109Once the model is stored in your GCS, please refer back to <https://github.com/llm-d/llm-d/blob/main/guides/agentic-servCODE
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml2# inference-perf workload template for the agentic-serving guide.COMMENT
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml4# Render with `envsubst < agentic-serving-nemotron-3-ultra.yaml > config.yaml` AFTER exporting theCOMMENT
MEDIUMguides/agentic-serving/benchmark-templates/guide.yaml2# inference-perf workload template for the agentic-serving guide.COMMENT
MEDIUM…-serving/router/agentic-serving-tpu-disagg.values.yaml1## agentic-serving (TPU / P/D-disaggregated) guide overrides for the llm-d router.COMMENT
MEDIUM…-serving/router/agentic-serving-tpu-disagg.values.yaml4## This deployment serves the agentic code-generation workload on Google TPUs withCOMMENT
MEDIUM…-serving/router/agentic-serving-tpu-disagg.values.yaml8## by the non-disaggregated TPU deployment in agentic-serving.values.yaml.COMMENT
MEDIUM…agentic-serving/router/agentic-serving-gpu.values.yaml1## agentic-serving (GPU / P/D-disaggregated) guide overrides for the llm-d router.COMMENT
MEDIUM…agentic-serving/router/agentic-serving-gpu.values.yaml4## This deployment serves the agentic code-generation workload on NVIDIA GPUs withCOMMENT
MEDIUM…agentic-serving/router/agentic-serving-gpu.values.yaml8## by the non-disaggregated TPU deployment in agentic-serving.values.yaml.COMMENT
MEDIUM…p2p-kv-cache-sharing/benchmark-results/glm-5.2-h200.md119## 2P2D agentic C64 policy comparisonCOMMENT
MEDIUM…p2p-kv-cache-sharing/benchmark-results/glm-5.2-h200.md122study](https://llm-d.ai/blog/serving-glm-5-2-agentic-workloads-on-llm-d)CODE
MEDIUM…sharing/benchmark-results/qwen3-30b-h200-pd-agentic.md1# Qwen/Qwen3-30B-A3B-Thinking P2P KV Cache Sharing on P/D (H200, agentic)COMMENT
MEDIUMguides/coord-disaggregation/router/httproute.yaml4# (conditional-decode, media handling, orchestration) entirely -- there is no portableCOMMENT
MEDIUMguides/coord-disaggregation/router/httproute-3-epp.yaml4# pipeline (conditional-decode, media handling, orchestration) entirely -- there isCOMMENT
Over-Commented Block96 hits · 96 pts
SeverityFileLineSnippetContext
LOWdocker/scripts/cuda/runtime/install-vllm.sh1#!/bin/bashCOMMENT
LOWdocker/scripts/cuda/builder/build-nixl.sh1#!/bin/bashCOMMENT
LOWdocker/scripts/cuda/builder/build-nvshmem.sh1#!/bin/bashCOMMENT
LOWdocker/scripts/cuda/builder/build-gdrcopy.sh1#!/bin/bashCOMMENT
LOWdocker/scripts/cuda/builder/build-compiled-wheels.sh1#!/bin/bashCOMMENT
LOWdocker/scripts/cuda/builder/build-ucx.sh1#!/bin/bashCOMMENT
LOWdocs/operations/serve-external-apis/litellm.md281 # ─────────────────────────────────────────────────────────────────COMMENT
LOW…ion/modelserver/gpu/vllm-ds/base/disaggregatedset.yaml21 # domain, zone, ...) and spread slices across domains, so prefill hands KVCOMMENT
LOW…des/no-kubernetes-deployment/router/epp/endpoints.yaml1# Endpoints file consumed by the file-discovery plugin.COMMENT
LOWguides/no-kubernetes-deployment/router/envoy/envoy.yaml1# Envoy config for the no-Kubernetes file-discovery deployment.COMMENT
LOW…odelserver/gpu/vllm-deepseek-r1-0528/base/prefill.yaml81 --all2all-backend deepep_high_throughputCOMMENT
LOWguides/wide-ep-lws/render/service.yaml1apiVersion: v1COMMENT
LOWguides/wide-ep-lws/monitoring/kustomization.yaml1apiVersion: kustomize.config.k8s.io/v1alpha1COMMENT
LOWguides/wide-ep-lws/router/precise-routing.values.yaml1# Precise prefix-cache routing overrides for wide-ep-lws.values.yaml: replacesCOMMENT
LOWguides/flow-control/scripts/nightly-deploy-gke.sh1#!/usr/bin/env bashCOMMENT
LOW…precise-prefix-cache-routing/render/kustomization.yaml1apiVersion: kustomize.config.k8s.io/v1beta1COMMENT
LOWguides/precise-prefix-cache-routing/render/service.yaml1apiVersion: v1COMMENT
LOW…fix-cache-routing/render/standalone/kustomization.yaml1apiVersion: kustomize.config.k8s.io/v1beta1COMMENT
LOW…outing/router/precise-prefix-cache-routing.values.yaml1## precise-prefix-cache-routing guide overrides for the router.COMMENT
LOWguides/recipes/observability/generate-traffic-pd.sh1#!/bin/bashCOMMENT
LOW…/recipes/autoscaling/metrics-reader/kustomization.yaml1# Shared OpenShift auth bundle for KEDA -> Thanos Querier: a dedicatedCOMMENT
LOWguides/recipes/router/base.values.yaml21 protocol: http # http, grpcCOMMENT
LOW…router/calibration/calibrate-min-cached-token-delta.sh1#!/bin/bashCOMMENT
LOW…router/calibration/calibrate-min-cached-token-delta.sh21# ... DP_RANKS=16 ./calibrate-min-cached-token-delta.shCOMMENT
LOW…router/calibration/calibrate-min-cached-token-delta.sh41# DP>1 fleet calibrates correctly without this. Set it toCOMMENT
LOW…er/calibration/calibration-min-cached-token-delta.yaml41 # Measures the pull-versus-recompute crossover between two live modelCOMMENT
LOWguides/recipes/router/calibration/calibrate.sh1#!/bin/bashCOMMENT
LOWguides/recipes/router/calibration/calibrate.sh21# MODEL_NAME — model name vLLM is serving (default: Qwen/Qwen3-32B)COMMENT
LOW…ed-latency-routing/benchmark-templates/multimodal.yaml1# ---------------------------------------------------------------------------COMMENT
LOW…edicted-latency-routing/benchmark-templates/guide.yaml1# ---------------------------------------------------------------------------COMMENT
LOW…outing/router/predicted-latency-multimodal.values.yaml41 # The guide's benchmark workload peaks around ~5K tokens per requestCOMMENT
LOW…tency-routing/router/predicted-latency-slo.values.yaml1## Predicted Latency-Based Scheduling — SLO-aware setup (streamingMode: true).COMMENT
LOW…-baseline/modelserver/gpu/vllm/gpt-oss/patch-vllm.yaml21 - "--reasoning-parser=openai_gptoss"COMMENT
LOW…zed-baseline/modelserver/gpu/vllm/base/patch-vllm.yaml21 - name: HF_TOKENCOMMENT
LOW…baseline/modelserver/gpu/sglang/base/patch-sglang.yaml21 # - "--otlp-traces-endpoint=http://otel-collector:4317"COMMENT
LOW…ptimized-baseline/modelserver/cpu/vllm/patch-vllm.yaml21 - name: HF_TOKENCOMMENT
LOW…ptimized-baseline/modelserver/xpu/vllm/patch-vllm.yaml21 - "--disable-access-log-for-endpoints=/health,/metrics,/v1/models"COMMENT
LOW…ized-baseline/modelserver/amd/sglang/patch-sglang.yaml21 # - "--enable-trace"COMMENT
LOW…mized-baseline/modelserver/tpu/v6/vllm/patch-vllm.yaml21 # - "--otlp-traces-endpoint=http://otel-collector:4317"COMMENT
LOW…mized-baseline/modelserver/tpu/v7/vllm/patch-vllm.yaml21 # - "--otlp-traces-endpoint=http://otel-collector:4317"COMMENT
LOW…chmark-templates/agentic-serving-nemotron-3-ultra.yaml1# ---------------------------------------------------------------------------COMMENT
LOWguides/agentic-serving/benchmark-templates/guide.yaml1# ---------------------------------------------------------------------------COMMENT
LOW…e-sharing/modelserver/gpu/vllm/rdma/kustomization.yaml1apiVersion: kustomize.config.k8s.io/v1beta1COMMENT
LOW…e-sharing/modelserver/gpu/vllm/base/kustomization.yaml1apiVersion: kustomize.config.k8s.io/v1beta1COMMENT
LOW…ache-sharing/modelserver/gpu/vllm/base/patch-vllm.yaml21 - --tensor-parallel-size=1COMMENT
LOW…-cache-sharing/router/p2p-kv-cache-sharing.values.yaml1## p2p-kv-cache-sharing guide overrides for the router.COMMENT
LOW…-cache-sharing/router/p2p-kv-cache-sharing.values.yaml21## arm is the default because affinity is the safer placement in theCOMMENT
LOW…-cache-sharing/router/p2p-kv-cache-sharing.values.yaml81 # hot shared-prefix block has on any fleet above fiveCOMMENT
LOW…es/coord-disaggregation/coordinator/patch-pd-only.yaml1# PD-only pipeline: drops replace-media-urls, render, and encode -- see theCOMMENT
LOWguides/coord-disaggregation/router/httproute.yaml21 - backendRefs:COMMENT
LOW…egation/router/coord-disaggregation-encode.values.yaml1## Coordinator Disaggregation guide overrides for the encode-only EPP / InferencePool,COMMENT
LOW…gation/router/coord-disaggregation-prefill.values.yaml1## Coordinator Disaggregation guide overrides for the prefill-only EPP / InferencePool,COMMENT
LOW…disaggregation/router/coord-disaggregation.values.yaml1## Coordinator Disaggregation guide overrides for the single EPP / InferencePool thatCOMMENT
LOW…disaggregation/router/coord-disaggregation.values.yaml41 registry: ghcr.io/llm-dCOMMENT
LOW…egation/router/coord-disaggregation-decode.values.yaml1## Coordinator Disaggregation guide overrides for the decode-only EPP / InferencePool,COMMENT
LOW…us-processing/multitenant/values/redis/quota-only.yaml1# Values for the multi-tenant scenario — team × tier × MODEL (Scenarios A + B),COMMENT
LOW…ng/multitenant/values/redis/saturation-prometheus.yaml1# Redis SortedSet backend + self-hosted Prometheus + Grafana — team × tier × MODELCOMMENT
LOW…s-processing/multitenant/values/pubsub/quota-only.yaml1# Values for the multi-tenant Pub/Sub demo — team × tier × MODEL (Scenarios A + B).COMMENT
LOW…g/multitenant/values/pubsub/saturation-prometheus.yaml1# Pub/Sub backend + self-hosted Prometheus + Grafana — team × tier × MODEL withCOMMENT
LOW…ocessing/multitenant/values/pubsub/saturation-gmp.yaml1# Scenario C — team × tier × MODEL with per-model saturation (GCP-native, GMP).COMMENT
36 more matches not shown…
Hyper-Verbose Identifiers54 hits · 62 pts
SeverityFileLineSnippetContext
LOWdocker/scripts/cpu/install_nixl.py45def install_system_dependencies():CODE
LOWdocker/scripts/cpu/install_nixl.py74def build_and_install_prerequisites(args):CODE
LOWguides/flow-control/scripts/tuning_wizard.py49def calculate_compute_constraint(throughput: float, latency_sec: float) -> int:CODE
LOWguides/flow-control/scripts/tuning_wizard.py53def calculate_memory_constraint(CODE
LOWguides/flow-control/scripts/tuning_wizard.py91def calculate_lookahead_buffer(active_batch: int, max_num_batched_tokens: int, isl_mean: Optional[float]) -> int:CODE
LOWscripts/lint-envvars.py36def find_locally_defined_vars(script_content: str) -> Set[str]:CODE
LOWscripts/lint-dockerfile-envvars.py12def parse_script_requirements(script_path: Path) -> Set[str]:CODE
LOWscripts/tests/test_guide.py49def test_env_default_emitted_verbatim():CODE
LOWscripts/tests/test_guide.py58def test_env_override_is_shell_quoted():CODE
LOWscripts/tests/test_guide.py65def test_sensitive_without_override_emits_no_placeholder():CODE
LOWscripts/tests/test_guide.py72def test_sensitive_with_override_is_exported_quoted():CODE
LOWscripts/tests/test_guide.py78def test_unknown_var_override_is_an_error():CODE
LOWscripts/tests/test_guide.py83def test_override_outside_declared_values_is_an_error():CODE
LOWscripts/tests/test_guide.py92def test_yaml_null_and_bool_env_values_fail_validation():CODE
LOWscripts/tests/test_guide.py105def test_non_bool_sensitive_flag_fails_validation():CODE
LOWscripts/tests/test_guide.py114def test_provenance_records_var_names_not_values():CODE
LOWscripts/tests/test_guide.py126def test_skip_in_filters_by_context():CODE
LOWscripts/tests/test_guide.py163def test_fully_filtered_section_is_marked_not_silent():CODE
LOWscripts/tests/test_guide.py170def test_steps_join_with_blank_lines_and_no_when_comment():CODE
LOWscripts/tests/test_guide.py182def test_sections_emitted_in_cli_order():CODE
LOWscripts/tests/test_guide.py139def test_when_filter_uses_default_and_override():CODE
LOWscripts/tests/test_guide.py152def test_when_on_sensitive_var_without_override_is_an_error():CODE
LOWscripts/tests/test_guide.py195def test_unknown_section_is_an_error():CODE
LOWscripts/tests/test_guide.py200def test_emitting_parent_section_concatenates_all_subgroups():CODE
LOWscripts/tests/test_guide.py216def test_cli_refuses_invalid_yaml(tmp_path, capsys):CODE
LOWscripts/tests/test_guide.py243def test_cli_rejects_malformed_var(tmp_path, capsys):CODE
LOWscripts/tests/test_guide.py252def test_cli_selection_flags_still_guarded(command, tmp_path, capsys):CODE
LOWscripts/tests/test_guide.py284def test_nightly_crds_use_env_sh_release_urls(flow_control):CODE
LOWscripts/tests/test_guide.py296def test_nightly_deploy_carries_ci_overrides(flow_control):CODE
LOWscripts/tests/test_guide.py310def test_nightly_ci_context_drops_clone_and_secrets(flow_control):CODE
LOWscripts/tests/test_guide.py320def test_nightly_wrapper_vars_match_this_contract(flow_control):CODE
LOWscripts/tests/test_guide.py331def test_nightly_modelserver_mirror_matches_guide(flow_control):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py93 def test_empty_workspace_returns_none(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py97 def test_empty_namespace_returns_none(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py101 def test_no_results_dir_anywhere(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py112 def test_namespace_mismatch_returns_none(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py117 def test_results_without_run_metadata_returns_none(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py123 def test_concurrent_runs_isolated_by_namespace(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py133 def test_sequential_same_namespace_newest_wins(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py142 def test_multiple_experiments_in_one_run_returned_together(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py196 def test_stops_at_non_digit_segment(self, mock_kubectl):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py202 def test_empty_output_returns_none(self, mock_kubectl):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py207 def test_leading_non_digit_returns_none(self, mock_kubectl):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py401 def test_nonzero_exit_returns_empty(self, mock_run):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py409 def test_timeout_returns_empty(self, mock_run):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py416 def test_generic_exception_returns_empty(self, mock_run):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py425 def test_decode_prefill_match(self, mock_kubectl):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py154 def test_stray_metadata_outside_results_ignored(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py167 def test_malformed_yaml_skipped(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py184 def test_parses_local_version_tag(self, mock_kubectl):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py231 def test_missing_aggregated_defaults_to_empty(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py238 def test_non_dict_top_level_values_ignored(self):CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py342 def test_name_includes_reducer(self):CODE
LOW…ly-e2e-verification/tiered-prefix-cache/test_verify.py58 def test_volume_without_pvc_claim(self, mock_kubectl):CODE
AI Slop Vocabulary21 hits · 52 pts
SeverityFileLineSnippetContext
MEDIUM…re/providers/digitalocean/gpu-configs/l40s-values.yaml38# Enable comprehensive metrics collectionCOMMENT
MEDIUM…ders/digitalocean/gpu-configs/rtx-4000-ada-values.yaml47# Enable comprehensive metrics collectionCOMMENT
MEDIUM…ders/digitalocean/gpu-configs/rtx-6000-ada-values.yaml36# Enable comprehensive metrics collectionCOMMENT
MEDIUMguides/pd-disaggregation/benchmark-templates/tpu.yaml17 namespace: *namespace # Namespace where harness is deployed. Typically with stack.CODE
MEDIUMguides/pd-disaggregation/benchmark-templates/tpu.yaml28workload: # yaml configuration for harness workload(s)CODE
MEDIUMguides/flow-control/guide.yaml153 # --harness/--workload stay literal because flow-control has no dedicatedCOMMENT
MEDIUM…ed-latency-routing/benchmark-templates/multimodal.yaml32 namespace: *namespace # Namespace where harness is deployed. Typically with stack.CODE
MEDIUM…edicted-latency-routing/benchmark-templates/guide.yaml42 namespace: *namespace # Namespace where harness is deployed. Typically with stack.CODE
MEDIUM…edicted-latency-routing/benchmark-templates/guide.yaml52workload: # yaml configuration for harness workload(s)CODE
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml38 namespace: *namespace # Namespace where harness is deployed. Typically with stack.CODE
MEDIUM…chmark-templates/agentic-serving-nemotron-3-ultra.yaml48workload: # yaml configuration for harness workload(s)CODE
MEDIUMguides/agentic-serving/benchmark-templates/guide.yaml39 namespace: *namespace # Namespace where harness is deployed. Typically with stack.CODE
MEDIUMguides/agentic-serving/benchmark-templates/guide.yaml49workload: # yaml configuration for harness workload(s)CODE
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh42# Source the shared guide environment so this harness tests the same llm-d RouterCOMMENT
MEDIUM…batch-serving/asynchronous-processing/test/kind-e2e.sh139# This harness is CPU-only by design (no GPU in CI/dev kind).COMMENT
LOWscripts/warn-vllm-precompiled.sh41# Append to vllm user's rc if it exists; otherwise just create itCOMMENT
MEDIUM…-workload-autoscaling-keda-epp-ibm-acc-gpu-vllm-x.yaml17 # decode_pods/prefill_pods/harness/workload are accepted only forCOMMENT
MEDIUM…flows/nightly-e2e-flow-control-gke-acc-gpu-vllm-x.yaml8# Why not the shared benchmark harness? Two reasons, both still true:COMMENT
MEDIUM…flows/nightly-e2e-flow-control-gke-acc-gpu-vllm-x.yaml13# with "unable to detect model". (The harness has a flow-control specialCOMMENT
MEDIUM.github/workflows/slash-test-nightly.yaml13# harness=<name> Benchmark harness (default: inference-perf)COMMENT
MEDIUM.github/scripts/e2e/e2e-validate-flow-control.sh274# missed by scrape timing, so it is the robust backbone assertion.COMMENT
Redundant / Tautological Comments12 hits · 18 pts
SeverityFileLineSnippetContext
LOW…ture/providers/digitalocean/verify-do-prerequisites.sh60 # Check if we're on DOKSCOMMENT
LOW…ture/providers/digitalocean/verify-do-prerequisites.sh123 # Check if DO CSI driver is availableCOMMENT
LOW…/providers/digitalocean/monitoring/setup-monitoring.sh72 # Check if kubectl can connect to clusterCOMMENT
LOW…/providers/digitalocean/monitoring/setup-monitoring.sh177 # Check if release already existsCOMMENT
LOW…prefix-cache/modelserver/tpu/base/vllm/patch-vllm.yaml22 # Check if the VFIO IOMMU module parameter exists, and if so, increase theCOMMENT
LOW…recipes/observability/generate-prometheus-tls-certs.sh185 # Check if namespace existsCOMMENT
LOWguides/recipes/observability/load-llm-d-dashboards.sh31# Check if namespace existsCOMMENT
LOWguides/recipes/observability/load-llm-d-dashboards.sh37# Check if dashboard directory existsCOMMENT
LOW…es/recipes/observability/install-prometheus-grafana.sh240 # Check if certificates already existCOMMENT
LOW…es/recipes/observability/install-prometheus-grafana.sh268 # Check if user workload monitoring is enabledCOMMENT
LOW…s/agentic-serving/modelserver/tpu/vllm/patch-vllm.yaml19 # Check if the VFIO IOMMU module parameter exists, and if so, increase theCOMMENT
LOW.github/scripts/e2e/e2e-validate.sh134 # Check if we got a specific errorCOMMENT
Example Usage Blocks8 hits · 12 pts
SeverityFileLineSnippetContext
LOWguides/wide-ep-lws/monitoring/apply-scrape-configs.sh4# Usage:COMMENT
LOW…router/calibration/calibrate-min-cached-token-delta.sh16# Usage:COMMENT
LOWguides/recipes/router/calibration/calibrate.sh11# Usage:COMMENT
LOW…ynchronous-processing/multitenant/scripts/gcp-setup.sh8# Usage:COMMENT
LOW…hronous-processing/multitenant/scripts/gcp-teardown.sh4# Usage:COMMENT
LOW…batch-serving/asynchronous-processing/test/kind-e2e.sh16# Usage:COMMENT
LOW…hub/scripts/nightly-e2e-verification/verify-locally.sh11# Usage:COMMENT
LOW…ers/local-llm-d-cuda-builder/build-local-llm-d-cuda.sh5# Usage:COMMENT
Self-Referential Comments4 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUM…recipes/observability/generate-prometheus-tls-certs.sh104 # Define the Prometheus service DNS namesCOMMENT
MEDIUM…recipes/observability/generate-prometheus-tls-certs.sh197 # Create the secretCOMMENT
MEDIUM…server/gpu/vllm/nemotron-3-ultra/gke/patch-decode.yaml46 # Define the GCS FUSE volume specificationsCOMMENT
MEDIUM…erver/gpu/vllm/nemotron-3-ultra/gke/patch-prefill.yaml45 # Define the GCS FUSE volume specificationsCOMMENT
Excessive Try-Catch Wrapping8 hits · 10 pts
SeverityFileLineSnippetContext
LOW…er/calibration/calibration-min-cached-token-delta.yaml127 except Exception:CODE
LOW…-autoscaling/slo-aware/benchmark-templates/plot_run.py97 except Exception:CODE
LOWscripts/lint-envvars.py94 except Exception as e:CODE
LOWscripts/lint-dockerfile-envvars.py16 except Exception:CODE
MEDIUMscripts/lint-dockerfile-envvars.py180 print(f"Error: Scripts directory not found: {scripts_dir}", file=sys.stderr)CODE
MEDIUMscripts/lint-dockerfile-envvars.py186 print(f"Error: Dockerfile not found: {dockerfile}", file=sys.stderr)CODE
LOW.github/workflows/release-matrix.yaml66 except Exception as exc: # noqa: BLE001 - best-effort snapshotCODE
LOW…hub/scripts/nightly-e2e-verification/verify_helpers.py330 except Exception as e:CODE
Unused Imports7 hits · 6 pts
SeverityFileLineSnippetContext
LOW…-deepseek-r1-0528/scripts/generate-disaggregatedset.py4CODE
LOWscripts/guide.py69CODE
LOW…cripts/nightly-e2e-verification/test_verify_helpers.py6CODE
LOW…hub/scripts/nightly-e2e-verification/verify_helpers.py8CODE
LOW…ly-e2e-verification/tiered-prefix-cache/test_verify.py6CODE
LOW…nightly-e2e-verification/tiered-prefix-cache/verify.py28CODE
LOW…b/scripts/nightly-e2e-verification/_template/verify.py15CODE
Deep Nesting5 hits · 3 pts
SeverityFileLineSnippetContext
LOWscripts/guide.py296CODE
LOWscripts/guide.py359CODE
LOWscripts/guide.py640CODE
LOWscripts/guide.py1271CODE
LOWscripts/lint-dockerfile-envvars.py45CODE
Modern Structural Boilerplate1 hit · 2 pts
SeverityFileLineSnippetContext
LOWscripts/guide.py81__all__ = [CODE