AI Slop Code RIsk Monitor

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

12.7 Moderate pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for ai-dynamo/dynamo, a Rust project with 8,256 GitHub stars. SynthScan examined 2,012,339 lines of code across 5972 source files, recording 19405 pattern matches distributed across 27 syntactic categories. The legacy adjusted pattern signal is 12.7 (Moderate pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

12.7
Adjusted Signal
12.7
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
8.3K
Stars
Rust
Language
2.0M
Lines of Code
6.0K
Files
19.4K
Pattern Hits
2026-10-12
Scan Date
0.08
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 30.9/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 14540 finding(s).

Hallucinated Dependency & Supply Chain Risk 4.1/100 · LOW

Are imports declared and package/API names verified? 1290 finding(s).

Agent Over-Engineering Ratio 36.0/100 · MEDIUM

Are wrappers, guards, and repeated structures necessary? 13483 finding(s).

PR Review Velocity Impact 47.8/100 · MEDIUM

Which changes need focused human review? 19405 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 10HIGH 496MEDIUM 2077LOW 16822

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 19405 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers9851 hits · 8872 pts
SeverityFileLineSnippetContext
LOWconftest.py80 def _patched_get_preparation_data(name):CODE
LOW⚡deploy/power-agent/power_agent.py130def _extract_pod_uid_from_cgroup(pid: int) -> Optional[str]:CODE
LOW⚡deploy/power-agent/power_agent.py1010def _restore_orphaned_gpus_on_startup(actuator: Actuator) -> None:CODE
LOWdeploy/power-agent/power_agent.py252def _load_previously_managed_gpus() -> set[str]:CODE
LOWdeploy/power-agent/power_agent.py299def _record_managed_gpu_by_uuid(uuid: str) -> None:CODE
LOWdeploy/power-agent/power_agent.py339def _flush_pending_acquisitions() -> None:CODE
LOWdeploy/power-agent/power_agent.py521def _retire_actuator_ownership(actuator: Actuator, uuid: str) -> None:CODE
LOWdeploy/power-agent/power_agent.py582def _flush_pending_retirements() -> None:CODE
LOWdeploy/power-agent/actuator.py1170 def _coerce_power_limit_watts(value: Any, field_name: str, gpu_idx: int) -> int:CODE
LOWdeploy/power-agent/tests/test_multi_pod_policy.py59 def safe_default_applied_total(self):CODE
LOWdeploy/power-agent/tests/test_multi_pod_policy.py77 def test_single_pod_apply_annotation(self):CODE
LOWdeploy/power-agent/tests/test_multi_pod_policy.py101 def test_no_parseable_annotation(self):CODE
LOW⚡deploy/power-agent/tests/test_multi_pod_policy.py113 def test_invalid_annotation_value(self):CODE
LOW⚡deploy/power-agent/tests/test_multi_pod_policy.py121 def test_three_pods_all_agree(self):CODE
LOW⚡deploy/power-agent/tests/test_multi_pod_policy.py131 def test_multipod_missing_annotation_on_one_pod_is_conflict(self):CODE
LOWdeploy/power-agent/tests/test_multi_pod_policy.py153 def test_multipod_invalid_annotation_on_one_pod_is_conflict(self):CODE
LOWdeploy/power-agent/tests/test_multi_pod_policy.py167 def test_multipod_all_missing_is_conflict(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py107 def test_unmanaged_uuid_is_skipped(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py161 def test_gpu_with_running_pids_is_skipped(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py236 def test_one_gpu_failure_does_not_abort_others(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py275 def test_successful_restore_discards_uuid(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py560 def test_inconclusive_read_skips_recovery_and_does_not_rewrite(self):CODE
LOW⚡deploy/power-agent/tests/test_orphan_recovery.py590 def test_persist_failure_queues_retirements_and_does_not_raise(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py140 def test_no_managed_uuids_means_no_writes(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py195 def test_idle_managed_gpu_delegates_to_restore_by_uuid(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py211 def test_caller_does_not_read_current_or_default(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py291 def test_at_default_gpu_retires_ownership(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py319 def test_retired_uuid_is_not_clobbered_on_next_startup(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py381 def test_true_return_discards_uuid(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py391 def test_none_return_retires_ownership(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py405 def test_false_return_retains_uuid(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py436 def test_absent_uuid_is_pruned_on_complete_scan_without_hardware_write(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py462 def test_absent_uuid_pruned_when_no_devices_present(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py474 def test_incomplete_scan_retains_unobserved_uuid_and_skips_hardware(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py495 def test_busy_gpu_behind_inconclusive_scan_keeps_its_cap(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py521 def test_uuid_moved_to_new_index_after_growth_is_not_pruned(self):CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py609 def test_reconcile_flush_persists_queued_startup_retirement(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py34 def test_fresh_module_copy_shares_managed_state(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py71 def test_handler_sets_shutdown_event(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py76 def test_handler_does_no_cleanup_work(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py96 def test_cleanup_runs_once_on_normal_shutdown(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py108 def test_cleanup_still_runs_when_reconcile_raises(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py128 def test_restores_default_via_actuator_for_each_managed_gpu(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py141 def test_dcgm_actuator_routes_restore_through_dcgm(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py154 def test_per_gpu_restore_failure_does_not_prevent_shutdown(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py167 def test_actuator_shutdown_failure_is_logged_not_raised(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py181 def test_no_managed_gpus_still_shuts_actuator_down(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py210 def test_successful_restore_prunes_uuid_and_persists(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py226 def test_successful_restore_prunes_actuator_managed_uuid_when_available(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py253 def test_skipped_restore_does_not_prune(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py270 def test_failed_restore_does_not_prune(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py291 def test_uuid_lookup_failure_is_logged_but_not_fatal(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py309 def test_persist_failure_does_not_prevent_shutdown(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py382 def test_sweep_restores_leaked_uuid_not_in_index_set(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py399 def test_sweep_ignores_unowned_persisted_uuid(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py416 def test_sweep_retires_owned_uuid_already_at_default(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py430 def test_sweep_keeps_uuid_on_inconclusive_scan(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py444 def test_sweep_exception_keeps_uuid_and_still_shuts_down(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py458 def test_indexed_restore_retires_uuid_before_sweep(self):CODE
LOWdeploy/power-agent/tests/test_shutdown.py507 def test_sweep_does_not_run_on_nvml_actuator(self):CODE
9791 more matches not shown…
Decorative Section Separators1708 hits · 5979 pts
SeverityFileLineSnippetContext
MEDIUM⚡deploy/power-agent/power_agent.py116# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/power_agent.py120# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/power_agent.py1005# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/power_agent.py1007# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/power_agent.py1680# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/power_agent.py1682# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py76# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py78# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py154# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py156# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py368# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py370# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py451# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py453# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py824# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py826# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py852# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py854# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py1162# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py1164# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py1260# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/power_agent.py1262# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/actuator.py764 # ------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/actuator.py766 # ------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/actuator.py2043 # ------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/actuator.py2045 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py640 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py642 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py833 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py835 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py1200 # ------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/actuator.py1202 # ------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py101# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py103# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py155# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py157# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py230# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py232# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py269# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py271# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py549# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py551# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py579# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡deploy/power-agent/tests/test_orphan_recovery.py581# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py41# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py43# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py182# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py184# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py359# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py361# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py419# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/test_orphan_recovery.py421# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py62# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py66# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py93# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py97# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py141# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py143# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py223# ---------------------------------------------------------------------------COMMENT
MEDIUMdeploy/power-agent/tests/e2e_actuator_parity.py226# ---------------------------------------------------------------------------COMMENT
1648 more matches not shown…
Over-Commented Block2741 hits · 2642 pts
SeverityFileLineSnippetContext
LOWdeny.toml1# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWconftest.py21from tests.marker_categories import REQUIRED_CATEGORIESCOMMENT
LOW.pre-commit-config.yaml1# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpyproject.toml241 # FIXME: Get relative/generic blob paths to work hereCOMMENT
LOWdeploy/__init__.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/power-agent/pytest.ini1# Standalone pytest config for the power-agent deployable unit.COMMENT
LOWdeploy/power-agent/managed_state.py61# currently OWNS a below-default cap on — added on a successful cap write andCOMMENT
LOWdeploy/power-agent/power_agent.py81RECONCILE_INTERVAL_S = 15COMMENT
LOWdeploy/power-agent/power_agent.py101# client (see `_build_k8s_core_v1`) — the 15s reconcile loop is the only retryCOMMENT
LOWdeploy/power-agent/power_agent.py281 return uuid.decode("ascii") if isinstance(uuid, bytes) else uuidCOMMENT
LOWdeploy/power-agent/power_agent.py701 # that fallback would make managed_uuid == uuid, silently pass theCOMMENT
LOWdeploy/power-agent/power_agent.py1061COMMENT
LOWdeploy/power-agent/power_agent.py1081 # Bind the idle check to `uuid` (same reason as the reconcile path):COMMENT
LOWdeploy/power-agent/power_agent.py1101 # index's identity could not be confirmed at write time / a midCOMMENT
LOWdeploy/power-agent/power_agent.py1281 raise RuntimeError("pynvml is required — install pynvml or nvidia-ml-py")COMMENT
LOWdeploy/power-agent/power_agent.py1341 # TODO(#9682 follow-up): this polls a full pod LIST per agent everyCOMMENT
LOWdeploy/power-agent/power_agent.py1441 if _shutdown.is_set():COMMENT
LOWdeploy/power-agent/power_agent.py1621COMMENT
LOWdeploy/power-agent/power_agent.py1781if __name__ == "__main__":COMMENT
LOWdeploy/power-agent/actuator.py601 # init() would leak one refcount per reconnect and leave NVMLCOMMENT
LOWdeploy/power-agent/actuator.py621 # In-process restore identity snapshot. `_managed_gpu_indices` storesCOMMENT
LOWdeploy/power-agent/actuator.py821COMMENT
LOWdeploy/power-agent/actuator.py1241 # establish which physical GPU that is, we cannot guarantee the capCOMMENT
LOWdeploy/power-agent/actuator.py1261 gpu_idx,COMMENT
LOWdeploy/power-agent/actuator.py1421 # the Set, and no post-Set reconnect-capable re-read that aCOMMENT
LOWdeploy/power-agent/actuator.py1501COMMENT
LOWdeploy/power-agent/actuator.py1581 # Guard the write with the UUID we intend to restore so a reconnectCOMMENT
LOWdeploy/power-agent/tests/test_dcgm_actuator.py901 nvml = MagicMock()COMMENT
LOWdeploy/utils/dynamo_deployment.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/utils/__init__.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/utils/kubernetes.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/utils/convert_api_version.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/utils/tests/__init__.py1# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/utils/tests/test_convert_api_version.py1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWdeploy/pre-deployment/pre-deployment-check.sh1#!/usr/bin/env bashCOMMENT
LOW…ploy/inference-gateway/ext-proc/tests/ext_proc_test.rs1// SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…oy/inference-gateway/ext-proc/examples/onramp/agg.yaml1# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…oy/inference-gateway/ext-proc/examples/onramp/agg.yaml21# The EPP runs the runtime-free selection service in-process, so there is NOCOMMENT
LOW…oy/inference-gateway/ext-proc/examples/onramp/agg.yaml41# - A secret `hf-token-secret` with key `HF_TOKEN` for the vLLM worker.COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs261 /// router accepts without checking.COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs281 // the body.COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs341 }COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs381 routing_constraints,COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs441 }COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs501 allowed_worker_ids,COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs881///COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs921/// helper additionally validates the address and port before comparing anCOMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs941/// `"main"` hashes to the pod identity (`hash_container_name`), so a pod whoseCOMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs981///COMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs1141 // During a relist the reflector emits Init + one InitApply perCOMMENT
LOWdeploy/inference-gateway/ext-proc/src/epp.rs1221 tokio::spawn(run_pod_reflector(COMMENT
LOWdeploy/inference-gateway/ext-proc/src/lib.rs1// SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…nference-gateway/ext-proc/src/epp_standalone_config.rs121 pub inference_pool_name: String,COMMENT
LOW…nference-gateway/ext-proc/src/epp_standalone_config.rs141 #[validate(range(min = 1, message = "DYN_KV_CACHE_BLOCK_SIZE must be >= 1"))]COMMENT
LOW…nference-gateway/ext-proc/src/epp_standalone_config.rs161 message = "DYN_EPP_KV_EVENT_REPLAY_PORT must be greater than zero when set"COMMENT
LOW…nference-gateway/ext-proc/src/epp_standalone_config.rs261/// Reject `DYN_KUBE_DISCOVERY_MODE=container` (e.g. intra-pod GMS failover)COMMENT
LOWdeploy/inference-gateway/ext-proc/src/server.rs661 // In streaming mode the upstream flushes HTTPCOMMENT
LOWdeploy/inference-gateway/ext-proc/src/server.rs781/// * We tokenize it.COMMENT
LOWdeploy/inference-gateway/ext-proc/src/server.rs801/// Streaming the response also requires `FULL_DUPLEX_STREAMED` specifically:COMMENT
LOWdeploy/inference-gateway/ext-proc/src/peer_discovery.rs1// SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
2681 more matches not shown…
Empty Error Handlers275 hits · 1348 pts
SeverityFileLineSnippetContext
HIGHconftest.py85except Exception:CODE
HIGHhatch_build.py56except (subprocess.CalledProcessError, FileNotFoundError):CODE
HIGHdeploy/power-agent/tests/e2e_actuator_parity.py509except Exception:CODE
HIGHdeploy/utils/kubernetes.py98except Exception:CODE
HIGHdeploy/utils/kubernetes.py134except Exception:CODE
HIGH…ploy/operator/api/scripts/generate_pydantic_from_go.py121except (subprocess.CalledProcessError, FileNotFoundError):CODE
HIGHdeploy/operator/api/scripts/validate_pydantic_models.py39except (subprocess.CalledProcessError, FileNotFoundError):CODE
HIGHdeploy/operator/api/scripts/validate_pydantic_models.py195except pydantic.ValidationError:CODE
HIGHdeploy/operator/api/scripts/validate_pydantic_models.py202except pydantic.ValidationError:CODE
HIGHtests/report_pytest_markers.py713except (KeyError, AttributeError):CODE
HIGHtests/report_pytest_markers.py724except (ImportError, AttributeError):CODE
HIGHtests/report_pytest_markers.py502except (ImportError, AttributeError):CODE
HIGHtests/frontend/test_request_tracing_logs.py483except (CODE
HIGHtests/frontend/test_request_tracing_logs.py560except (CODE
HIGHtests/frontend/test_request_tracing_logs.py685except (CODE
HIGHtests/frontend/test_request_tracing_logs.py721except (CODE
HIGHtests/frontend/test_frontend_route_extension.py121except requests.RequestException:CODE
HIGHtests/gpu_memory_service/test_shadow_failover.py60except ChildProcessError:CODE
HIGHtests/deploy/dgd_utils.py1633except ValueError:CODE
HIGHtests/utils/profile_pytest.py162except OSError:CODE
HIGHtests/utils/profile_pytest.py262except pynvml.NVMLError:CODE
HIGHtests/utils/test_managed_process_teardown.py71except psutil.NoSuchProcess:CODE
HIGHtests/utils/test_managed_process_teardown.py299except (ProcessLookupError, PermissionError, OSError):CODE
HIGHtests/utils/test_managed_process_teardown.py344except (ProcessLookupError, PermissionError, OSError):CODE
HIGHtests/utils/test_managed_process_teardown.py255except (ProcessLookupError, OSError):CODE
HIGHtests/utils/test_managed_process_teardown.py308except (ProcessLookupError, PermissionError, OSError):CODE
HIGHtests/utils/test_managed_process_teardown.py353except (ProcessLookupError, PermissionError, OSError):CODE
HIGHtests/utils/vram_utils.py112except (OSError, ValueError):CODE
HIGHtests/utils/vram_utils.py121except (OSError, ValueError):CODE
HIGHtests/utils/vram_utils.py146except (OverflowError, ValueError):CODE
HIGHtests/utils/managed_process.py574except psutil.NoSuchProcess:CODE
HIGHtests/utils/managed_process.py586except ProcessLookupError:CODE
HIGHtests/utils/managed_process.py625except ProcessLookupError:CODE
HIGHtests/utils/managed_process.py317except (CODE
HIGHtests/utils/managed_process.py612except (ProcessLookupError, OSError):CODE
HIGHtests/utils/managed_process.py892except (CODE
HIGHtests/utils/managed_process.py566except (ProcessLookupError, OSError):CODE
HIGHtests/fault_tolerance/test_unified_canary.py45except (requests.exceptions.RequestException, ValueError):CODE
HIGHtests/fault_tolerance/client.py67except json.JSONDecodeError:CODE
HIGHtests/fault_tolerance/test_canary_rank_pause.py118except psutil.NoSuchProcess:CODE
HIGHtests/fault_tolerance/test_canary_rank_pause.py203except ProcessLookupError:CODE
HIGHtests/fault_tolerance/cancellation/test_vllm.py190except FileNotFoundError:CODE
HIGHtests/fault_tolerance/cancellation/test_sglang.py143except FileNotFoundError:CODE
HIGHtests/fault_tolerance/cancellation/utils.py621except ValueError:CODE
HIGHtests/fault_tolerance/cancellation/utils.py456except ValueError:CODE
HIGHtests/fault_tolerance/cancellation/utils.py495except ValueError:CODE
HIGH…ware/fault_injection_service/helpers/k8s_operations.py227except Exception:CODE
HIGHtests/fault_tolerance/deploy/client.py414except ProcessLookupError:CODE
HIGHtests/fault_tolerance/deploy/legacy_client.py302except Exception:CODE
HIGHtests/fault_tolerance/deploy/legacy_client.py134except ValueError:CODE
HIGHtests/fault_tolerance/deploy/test_deployment.py58except (KeyError, AttributeError):CODE
HIGHtests/fault_tolerance/etcd_ha/test_vllm.py149except FileNotFoundError:CODE
HIGHtests/fault_tolerance/etcd_ha/test_vllm.py568except psutil.NoSuchProcess:CODE
HIGHtests/fault_tolerance/etcd_ha/test_trtllm.py105except FileNotFoundError:CODE
HIGHtests/fault_tolerance/etcd_ha/test_sglang.py121except FileNotFoundError:CODE
HIGHtests/fault_tolerance/etcd_ha/utils.py171except FileNotFoundError:CODE
HIGHtests/fault_tolerance/migration/test_sglang.py75except (psutil.AccessDenied, psutil.NoSuchProcess):CODE
HIGHtests/fault_tolerance/migration/test_sglang.py73except (ProcessLookupError, OSError):CODE
HIGHtests/fault_tolerance/migration/test_sglang.py90except ProcessLookupError:CODE
HIGHtests/fault_tolerance/migration/utils.py226except FileNotFoundError:CODE
215 more matches not shown…
Unused Imports1171 hits · 1105 pts
SeverityFileLineSnippetContext
LOWconftest.py12CODE
LOWdeploy/power-agent/actuator.py39CODE
LOWdeploy/power-agent/tests/test_orphan_recovery.py33CODE
LOWdeploy/power-agent/tests/e2e_actuator_parity.py43CODE
LOWdeploy/power-agent/tests/test_managed_state_parser.py35CODE
LOWdeploy/power-agent/tests/test_reconcile_wiring.py27CODE
LOWdeploy/power-agent/tests/test_multi_dgd_topology.py37CODE
LOWdeploy/power-agent/tests/test_dcgm_actuator.py34CODE
LOWtests/report_pytest_markers.py14CODE
LOWtests/frontend/realtime_omni_mock_worker.py14CODE
LOWtests/frontend/test_vllm_prepost_integration.py4CODE
LOWtests/frontend/test_completion_mocker_engine.py11CODE
LOWtests/frontend/test_vllm.py12CODE
LOWtests/frontend/test_request_tracing_logs.py14CODE
LOWtests/frontend/realtime_echo_worker.py13CODE
LOWtests/frontend/test_realtime_python_bridge.py18CODE
LOWtests/frontend/test_unified_worker_otlp_export.py14CODE
LOWtests/frontend/vllm_prepost_worker.py6CODE
LOWtests/frontend/router_ais_image_smoke.py6CODE
LOWtests/frontend/test_sglang_generate_mocker.py6CODE
LOWtests/frontend/test_anthropic_messages_stream_usage.py30CODE
LOWtests/frontend/test_frontend_route_construction.py11CODE
LOWtests/frontend/test_realtime_omni_bridge.py19CODE
LOWtests/frontend/test_self_host_metadata.py17CODE
LOWtests/frontend/http_status_propagation_worker.py18CODE
LOWtests/frontend/test_prompt_embeds.py20CODE
LOWtests/frontend/route_extension_provider.py17CODE
LOWtests/frontend/test_http_status_propagation.py11CODE
LOWtests/frontend/test_frontend_route_extension.py19CODE
LOWtests/frontend/test_unified_worker_tracing_smoke.py17CODE
LOWtests/frontend/test_tool_calling_sglang.py16CODE
LOWtests/frontend/test_frontend_route_extension_mode.py13CODE
LOWtests/frontend/grpc/test_tensor_mocker_engine.py13CODE
LOW…s/gpu_memory_service/test_restored_engine_reconnect.py18CODE
LOWtests/gpu_memory_service/conftest.py11CODE
LOWtests/gpu_memory_service/test_shadow_failover.py4CODE
LOWtests/gpu_memory_service/flow_assertions.py4CODE
LOWtests/gpu_memory_service/test_pause_resume.py4CODE
LOWtests/gpu_memory_service/common/runtime.py6CODE
LOWtests/gpu_memory_service/common/_gms_server_runner.py12CODE
LOWtests/gpu_memory_service/common/gms.py6CODE
LOWtests/deploy/test_dgdr_h100.py6CODE
LOWtests/deploy/test_dgdr.py6CODE
LOWtests/deploy/dgdr_utils.py6CODE
LOWtests/runtime/test_fetch_model_runtime_bridge.py4CODE
LOWtests/runtime/test_sample_multimodal_smoke.py6CODE
LOWtests/dependencies/test_aisimulate_namespaces.py6CODE
LOWtests/dependencies/test_no_software_video_codecs.py33CODE
LOWtests/dependencies/test_aisimulate_consistency.py6CODE
LOWtests/utils/gpu_args.py6CODE
LOWtests/utils/http_checks.py6CODE
LOWtests/utils/sglang_generate.py10CODE
LOWtests/utils/vram_utils.py21CODE
LOWtests/utils/test_http_checks.py4CODE
LOWtests/utils/collection_env_guard.py6CODE
LOWtests/utils/pytest_parallel_gpu.py26CODE
LOWtests/utils/router_logs.py6CODE
LOWtests/utils/managed_process.py20CODE
LOWtests/utils/payloads.py33CODE
LOWtests/utils/payloads.py34CODE
1111 more matches not shown…
Excessive Try-Catch Wrapping981 hits · 939 pts
SeverityFileLineSnippetContext
LOWconftest.py85except Exception:CODE
LOW⚡deploy/power-agent/power_agent.py989 except Exception as e:CODE
LOW⚡deploy/power-agent/power_agent.py997 except Exception:CODE
LOW⚡deploy/power-agent/power_agent.py1671 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py322 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py353 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py439 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py571 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py595 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py662 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py698 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py789 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py919 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py928 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py944 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py968 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1120 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1150 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1387 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1481 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1504 except Exception as e:CODE
LOWdeploy/power-agent/power_agent.py1565 except Exception as e:CODE
LOW⚡deploy/power-agent/actuator.py756 except Exception:CODE
LOW⚡deploy/power-agent/actuator.py2034 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py302 except Exception:CODE
LOWdeploy/power-agent/actuator.py329 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py342 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py489 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py726 except Exception:CODE
LOWdeploy/power-agent/actuator.py735 except Exception:CODE
LOWdeploy/power-agent/actuator.py806 except Exception:CODE
LOWdeploy/power-agent/actuator.py871 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1254 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1438 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1560 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1739 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1851 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py1954 except Exception as e:CODE
LOWdeploy/power-agent/actuator.py2022 except Exception as e:CODE
LOWdeploy/power-agent/tests/e2e_actuator_parity.py480 except Exception as e:CODE
LOWdeploy/power-agent/tests/e2e_actuator_parity.py509 except Exception:CODE
LOWdeploy/utils/dynamo_deployment.py160 except Exception:CODE
LOWdeploy/utils/dynamo_deployment.py349 except Exception:CODE
LOWdeploy/utils/dynamo_deployment.py525 except Exception as e:CODE
MEDIUMdeploy/utils/dynamo_deployment.py629 print(f"Error getting logs for pod {pod.metadata.name}: {e}")CODE
LOWdeploy/utils/dynamo_deployment.py672 except Exception as e:CODE
LOWdeploy/utils/kubernetes.py98 except Exception:CODE
LOWdeploy/utils/kubernetes.py103 except Exception as e:CODE
LOWdeploy/utils/kubernetes.py134 except Exception:CODE
LOWdeploy/utils/kubernetes.py184 except Exception as e:CODE
LOWdeploy/operator/internal/dynamo/backend_vllm.go245 except Exception as e:CODE
LOWdeploy/operator/internal/dynamo/backend_vllm.go263 except Exception as e:CODE
MEDIUMdeploy/operator/internal/dynamo/backend_vllm.go220def leader_pod_is_healthy():CODE
MEDIUM…ploy/operator/api/scripts/generate_pydantic_from_go.py643 print(f"Error: Input file not found: {args.input}")CODE
MEDIUMtests/conftest.py903def check():CODE
LOWtests/conftest.py513 except Exception as exc:CODE
LOWtests/conftest.py657 except Exception as exc:CODE
LOWtests/conftest.py858 except Exception as e:CODE
LOWtests/conftest.py917 except Exception:CODE
LOWtests/conftest.py938 except Exception as e:CODE
921 more matches not shown…
Structural Annotation Overuse425 hits · 740 pts
SeverityFileLineSnippetContext
LOW⚡deploy/pre-deployment/nixl/README.md97### Step 1: Build nixlbench Docker ImageCOMMENT
LOW⚡deploy/pre-deployment/nixl/README.md104### Step 2: Update Deployment YAML FileCOMMENT
LOW⚡deploy/pre-deployment/nixl/README.md110### Step 3: Deploy to KubernetesCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh18# Step 1: Delete Grafana dashboard ConfigMapCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh23# Step 2: Revert DCGM custom metrics configurationCOMMENT
LOWdeploy/observability/cleanup-monitoring.sh43# Step 3: Revert Dynamo operator Prometheus endpointCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh64# Step 4: Uninstall kube-prometheus-stackCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh72# Step 5: Delete monitoring namespace (optional)COMMENT
LOW⚡deploy/observability/setup-monitoring.sh20# Step 1: Add Helm repositoriesCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh27# Step 2: Update Helm repositoriesCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh32# Step 3: Install kube-prometheus-stackCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh67# Step 4: Wait for pods to be readyCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh73# Step 5: Verify installationCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh78# Step 6: Update Dynamo operator with Prometheus endpointCOMMENT
LOWdeploy/observability/setup-monitoring.sh102# Step 7: Configure DCGM custom metrics for NVLink profilingCOMMENT
LOWdeploy/observability/setup-monitoring.sh123# Step 8: Verify DCGM ServiceMonitor exists (created by GPU operator during cluster setup)COMMENT
LOW⚡deploy/observability/setup-monitoring.sh136# Step 9: Deploy Grafana dashboard ConfigMapCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh142# Step 10: Get Grafana credentialsCOMMENT
LOWdeploy/operator/internal/dynamo/backend_vllm.go416 // Step 1: Check explicit overrideCOMMENT
LOWdeploy/operator/internal/dynamo/backend_vllm.go431 // Step 2: Check operator origin version gateCOMMENT
LOW…ontroller/dynamocomponentdeployment_controller_test.go1792 // Step 1: Create the deployment with 1 replicaCOMMENT
LOW…ontroller/dynamocomponentdeployment_controller_test.go1806 // Step 2: Manually update the deployment to 2 replicas (simulating manual edit)COMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1824 // Step 3: Call createOrUpdateOrDeleteDeployments again - it should reconcile back to 1 replicaCOMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1830 // Step 4: Verify the deployment was reconciled back to 1 replicaCOMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1837 // Step 5: Call createOrUpdateOrDeleteDeployments again - it should not be modifiedCOMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1892 // Step 1: first apply. Server ConvertsFrom the user's v1beta1 toCOMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1907 // Step 2: second apply. Server reads stored, converts to v1beta1 soCOMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1918 // Step 3: apply JSON merge patch. Arrays are replaced wholesale.COMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1928 // Step 4: server converts back to v1alpha1 for storage. This isCOMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1935 // Step 5: apiserver generation-bump check.COMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1953 // Step 6: mimic the apiserver's unstructured-level comparison. TheCOMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go289 // Step 1: v1alpha1 → v1beta1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go295 // Step 2: v1beta1 → v1alpha1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go348 // Step 1: v1beta1 → v1alpha1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go354 // Step 2: v1alpha1 → v1beta1COMMENT
LOW⚡…ploy/operator/api/scripts/generate_pydantic_from_go.py302 # Step 1: find the index just after the last non-comment line before the blockCOMMENT
LOW⚡…ploy/operator/api/scripts/generate_pydantic_from_go.py310 # Step 2: forward scan — collect the first paragraph, skip markersCOMMENT
LOW⚡tests/utils/managed_process.py596 # Step 3: poll for all process groups to exit.COMMENT
LOWtests/utils/managed_process.py557 # Step 1: Snapshot all process groups before signaling. Only self.proc runsCOMMENT
LOWtests/utils/managed_process.py577 # Step 2: SIGTERM all snapshotted process groups (graceful shutdown).COMMENT
LOWtests/utils/managed_process.py619 # Step 4: SIGKILL all snapshotted process groups to ensure nothingCOMMENT
LOWtests/utils/managed_process.py860 # WARNING: This method is NOT pytest-xdist safe! Kills ALL matching processes system-wide.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py135 # Step 1: Start the frontendCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py142 # Step 2: Start a workerCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py154 # Step 3: Send a test request to prove the worker is live.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py161 # Step 4: Find and kill vLLM engine processes to force the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py175 # Step 5: Send a request triggering the handler to shutdown everything.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py181 # Step 6: Ensure the worker process has been stopped as a result of the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py208 # Step 1: Start the frontendCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py215 # Step 2: Start a workerCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py227 # Step 3: Send a test request to prove the worker is live.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py234 # Step 4: Find and kill vLLM engine processes to force the EngineDeadError condition.COMMENT
LOWtests/fault_tolerance/test_vllm_health_check.py248 # Step 5: Ensure the worker process has been stopped as a result of the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py161 # Step 1: Start the frontend (allocates its own frontend_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py165 # Step 2: Start an aggregated worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py172 # Step 3: Test request cancellation with polling approachCOMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py254 # Step 1: Start the frontend (allocates its own frontend_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py258 # Step 2: Start the prefill worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py264 # Step 3: Start the decode worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py273 # Step 4: Test request cancellation for streaming scenarioCOMMENT
365 more matches not shown…
Modern Structural Boilerplate560 hits · 569 pts
SeverityFileLineSnippetContext
LOWtests/metrics/test_otlp_prometheus_parity.py45logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_vllm_prepost_integration.py20logger = logging.getLogger(__name__)CODE
LOWtests/frontend/conftest.py23logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_completion_mocker_engine.py22logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_vllm.py30logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_request_tracing_logs.py32logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_realtime_python_bridge.py32logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_anthropic_messages_stream_usage.py43logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_realtime_omni_bridge.py38logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_self_host_metadata.py28logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_prompt_embeds.py42logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_frontend_route_extension.py40logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_frontend_api_surface_compliance.py62logger = logging.getLogger(__name__)CODE
LOWtests/frontend/test_tool_calling_sglang.py42logger = logging.getLogger(__name__)CODE
LOWtests/frontend/grpc/test_tensor_fp16.py37logger = logging.getLogger(__name__)CODE
LOWtests/frontend/grpc/test_tensor_parameters.py48logger = logging.getLogger(__name__)CODE
LOWtests/frontend/grpc/test_tensor_mocker_engine.py36logger = logging.getLogger(__name__)CODE
LOWtests/frontend/grpc/test_triton_identity.py20logger = logging.getLogger(__name__)CODE
LOWtests/gpu_memory_service/conftest.py19logger = logging.getLogger(__name__)CODE
LOWtests/gpu_memory_service/test_shadow_failover.py43logger = logging.getLogger(__name__)CODE
LOWtests/gpu_memory_service/flow_assertions.py16logger = logging.getLogger(__name__)CODE
LOWtests/gpu_memory_service/common/runtime.py26logger = logging.getLogger(__name__)CODE
LOWtests/deploy/efa_utils.py40logger = logging.getLogger(__name__)CODE
LOWtests/deploy/dgd_utils.py39logger = logging.getLogger(__name__)CODE
LOWtests/deploy/dgd_utils.py385 def _set_args(self, tokens: list[str]) -> None:CODE
LOWtests/deploy/test_dgdr_h100.py15logger = logging.getLogger(__name__)CODE
LOWtests/deploy/test_kvcr_guard.py40logger = logging.getLogger(__name__)CODE
LOWtests/deploy/test_dynamocheckpoint.py22logger = logging.getLogger(__name__)CODE
LOWtests/deploy/test_dgd.py44logger = logging.getLogger(__name__)CODE
LOWtests/deploy/api_checks.py28logger = logging.getLogger(__name__)CODE
LOWtests/deploy/dgdr_utils.py30logger = logging.getLogger(__name__)CODE
LOWtests/deploy/dgdr_utils.py125def _set_ci_profiling_job_defaults(spec: dict[str, Any]) -> None:CODE
LOWtests/utils/device.py13logger = logging.getLogger(__name__)CODE
LOWtests/utils/client.py13logger = logging.getLogger(__name__)CODE
LOWtests/utils/profile_pytest.py68logger = logging.getLogger(__name__)CODE
LOWtests/utils/engine_process.py17logger = logging.getLogger(__name__)CODE
LOWtests/utils/test_mock_gpu_alloc.py26logger = logging.getLogger(__name__)CODE
LOWtests/utils/payloads.py42logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/test_vllm_health_check.py18logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/test_canary_rank_pause.py30logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/cancellation/test_vllm.py39logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/cancellation/test_trtllm.py32logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/cancellation/test_sglang.py31logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/cancellation/utils.py21logger = logging.getLogger(__name__)CODE
LOW…_service/agents/gpu_fault_injector/gpu_xid_injector.py76logger = logging.getLogger(__name__)CODE
LOW…t_injection_service/agents/gpu_fault_injector/agent.py41logger = logging.getLogger(__name__)CODE
LOW⚡…e/hardware/fault_injection_service/api_service/main.py32logger = logging.getLogger(__name__)CODE
LOW…e/hardware/fault_injection_service/helpers/__init__.py11__all__ = [CODE
LOW…ware/fault_injection_service/helpers/k8s_operations.py19logger = logging.getLogger(__name__)CODE
LOW…dware/fault_injection_service/helpers/gpu_discovery.py17logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/deploy/scenarios.py36logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/deploy/k8s_utils.py28logger = logging.getLogger(__name__)CODE
LOW⚡tests/fault_tolerance/deploy/checkers.py38logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/deploy/base_checker.py29logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/deploy/checker_factory.py40logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/deploy/validation_checks.py28logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/etcd_ha/test_vllm.py34logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/etcd_ha/test_trtllm.py23logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/etcd_ha/test_sglang.py27logger = logging.getLogger(__name__)CODE
LOWtests/fault_tolerance/etcd_ha/utils.py25logger = logging.getLogger(__name__)CODE
500 more matches not shown…
Verbosity Indicators301 hits · 546 pts
SeverityFileLineSnippetContext
LOW⚡deploy/observability/cleanup-monitoring.sh18# Step 1: Delete Grafana dashboard ConfigMapCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh23# Step 2: Revert DCGM custom metrics configurationCOMMENT
LOWdeploy/observability/cleanup-monitoring.sh43# Step 3: Revert Dynamo operator Prometheus endpointCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh64# Step 4: Uninstall kube-prometheus-stackCOMMENT
LOW⚡deploy/observability/cleanup-monitoring.sh72# Step 5: Delete monitoring namespace (optional)COMMENT
LOW⚡deploy/observability/setup-monitoring.sh20# Step 1: Add Helm repositoriesCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh27# Step 2: Update Helm repositoriesCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh32# Step 3: Install kube-prometheus-stackCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh67# Step 4: Wait for pods to be readyCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh73# Step 5: Verify installationCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh78# Step 6: Update Dynamo operator with Prometheus endpointCOMMENT
LOWdeploy/observability/setup-monitoring.sh102# Step 7: Configure DCGM custom metrics for NVLink profilingCOMMENT
LOWdeploy/observability/setup-monitoring.sh123# Step 8: Verify DCGM ServiceMonitor exists (created by GPU operator during cluster setup)COMMENT
LOW⚡deploy/observability/setup-monitoring.sh136# Step 9: Deploy Grafana dashboard ConfigMapCOMMENT
LOW⚡deploy/observability/setup-monitoring.sh142# Step 10: Get Grafana credentialsCOMMENT
LOWdeploy/operator/internal/dynamo/backend_vllm.go416 // Step 1: Check explicit overrideCOMMENT
LOWdeploy/operator/internal/dynamo/backend_vllm.go431 // Step 2: Check operator origin version gateCOMMENT
LOW…ontroller/dynamocomponentdeployment_controller_test.go1792 // Step 1: Create the deployment with 1 replicaCOMMENT
LOW…ontroller/dynamocomponentdeployment_controller_test.go1806 // Step 2: Manually update the deployment to 2 replicas (simulating manual edit)COMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1824 // Step 3: Call createOrUpdateOrDeleteDeployments again - it should reconcile back to 1 replicaCOMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1830 // Step 4: Verify the deployment was reconciled back to 1 replicaCOMMENT
LOW⚡…ontroller/dynamocomponentdeployment_controller_test.go1837 // Step 5: Call createOrUpdateOrDeleteDeployments again - it should not be modifiedCOMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1892 // Step 1: first apply. Server ConvertsFrom the user's v1beta1 toCOMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1907 // Step 2: second apply. Server reads stored, converts to v1beta1 soCOMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1918 // Step 3: apply JSON merge patch. Arrays are replaced wholesale.COMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1928 // Step 4: server converts back to v1alpha1 for storage. This isCOMMENT
LOW⚡…/api/v1alpha1/dynamographdeployment_conversion_test.go1935 // Step 5: apiserver generation-bump check.COMMENT
LOW…/api/v1alpha1/dynamographdeployment_conversion_test.go1953 // Step 6: mimic the apiserver's unstructured-level comparison. TheCOMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go289 // Step 1: v1alpha1 → v1beta1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go295 // Step 2: v1beta1 → v1alpha1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go348 // Step 1: v1beta1 → v1alpha1COMMENT
LOW⚡…alpha1/dynamographdeploymentrequest_conversion_test.go354 // Step 2: v1alpha1 → v1beta1COMMENT
LOW⚡…ploy/operator/api/scripts/generate_pydantic_from_go.py302 # Step 1: find the index just after the last non-comment line before the blockCOMMENT
LOW⚡…ploy/operator/api/scripts/generate_pydantic_from_go.py310 # Step 2: forward scan — collect the first paragraph, skip markersCOMMENT
LOW⚡tests/utils/managed_process.py596 # Step 3: poll for all process groups to exit.COMMENT
LOWtests/utils/managed_process.py557 # Step 1: Snapshot all process groups before signaling. Only self.proc runsCOMMENT
LOWtests/utils/managed_process.py577 # Step 2: SIGTERM all snapshotted process groups (graceful shutdown).COMMENT
LOWtests/utils/managed_process.py619 # Step 4: SIGKILL all snapshotted process groups to ensure nothingCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py135 # Step 1: Start the frontendCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py142 # Step 2: Start a workerCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py154 # Step 3: Send a test request to prove the worker is live.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py161 # Step 4: Find and kill vLLM engine processes to force the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py175 # Step 5: Send a request triggering the handler to shutdown everything.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py181 # Step 6: Ensure the worker process has been stopped as a result of the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py208 # Step 1: Start the frontendCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py215 # Step 2: Start a workerCOMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py227 # Step 3: Send a test request to prove the worker is live.COMMENT
LOW⚡tests/fault_tolerance/test_vllm_health_check.py234 # Step 4: Find and kill vLLM engine processes to force the EngineDeadError condition.COMMENT
LOWtests/fault_tolerance/test_vllm_health_check.py248 # Step 5: Ensure the worker process has been stopped as a result of the EngineDeadError condition.COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py161 # Step 1: Start the frontend (allocates its own frontend_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py165 # Step 2: Start an aggregated worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py172 # Step 3: Test request cancellation with polling approachCOMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py254 # Step 1: Start the frontend (allocates its own frontend_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py258 # Step 2: Start the prefill worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py264 # Step 3: Start the decode worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py273 # Step 4: Test request cancellation for streaming scenarioCOMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py358 # Step 1: Start the frontend (allocates its own frontend_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py362 # Step 2: Start the prefill worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py368 # Step 3: Start the decode worker (allocates its own system_port)COMMENT
LOW⚡tests/fault_tolerance/cancellation/test_trtllm.py377 # Step 4: Test request cancellation during prefill phaseCOMMENT
241 more matches not shown…
Deep Nesting601 hits · 507 pts
SeverityFileLineSnippetContext
LOWdeploy/power-agent/power_agent.py876CODE
LOWdeploy/power-agent/tests/e2e_actuator_parity.py146CODE
LOWdeploy/utils/dynamo_deployment.py323CODE
LOWdeploy/utils/dynamo_deployment.py382CODE
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py203CODE
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py265CODE
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py334CODE
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py460CODE
LOWtests/conftest.py671CODE
LOWtests/conftest.py1145CODE
LOWtests/conftest.py1172CODE
LOWtests/test_kustomize_matrix.py32CODE
LOWtests/metrics/test_otlp_prometheus_parity.py211CODE
LOWtests/metrics/test_otlp_prometheus_parity.py89CODE
LOWtests/frontend/test_http_mtls.py89CODE
LOWtests/frontend/test_vllm_prepost_integration.py143CODE
LOWtests/frontend/conftest.py79CODE
LOWtests/frontend/test_request_tracing_logs.py247CODE
LOWtests/frontend/test_request_tracing_logs.py599CODE
LOWtests/frontend/test_realtime_python_bridge.py164CODE
LOWtests/frontend/test_unified_worker_otlp_export.py73CODE
LOWtests/frontend/test_unified_worker_otlp_export.py183CODE
LOWtests/frontend/test_unified_worker_otlp_export.py281CODE
LOWtests/frontend/test_unified_worker_otlp_export.py422CODE
LOWtests/frontend/test_prepost_mistral.py556CODE
LOWtests/frontend/test_anthropic_messages_stream_usage.py129CODE
LOWtests/frontend/test_realtime_omni_bridge.py135CODE
LOWtests/frontend/test_prepost.py1444CODE
LOWtests/frontend/test_frontend_route_extension.py94CODE
LOWtests/frontend/test_frontend_api_surface_compliance.py182CODE
LOWtests/frontend/test_unified_worker_tracing_smoke.py72CODE
LOWtests/frontend/test_tool_calling_sglang.py516CODE
LOWtests/frontend/grpc/test_tensor_mocker_engine.py154CODE
LOWtests/frontend/grpc/echo_tensor_worker.py57CODE
LOWtests/deploy/test_api_checks.py312CODE
LOWtests/deploy/test_api_checks.py313CODE
LOWtests/deploy/dgd_utils.py1023CODE
LOWtests/deploy/dgd_utils.py1142CODE
LOWtests/deploy/dgd_utils.py1212CODE
LOWtests/deploy/dgd_utils.py1671CODE
LOWtests/deploy/dgd_utils.py1734CODE
LOWtests/deploy/test_dynamocheckpoint.py239CODE
LOWtests/deploy/test_dgdr.py98CODE
LOWtests/deploy/test_dgd.py110CODE
LOWtests/deploy/api_checks.py114CODE
LOWtests/basic/test_cuda_version_consistency.py156CODE
LOWtests/dependencies/test_no_software_video_codecs.py176CODE
LOWtests/dependencies/test_pynvvideocodec_spec.py90CODE
LOWtests/utils/client.py26CODE
LOWtests/utils/client.py51CODE
LOWtests/utils/client.py157CODE
LOWtests/utils/profile_pytest.py118CODE
LOWtests/utils/profile_pytest.py832CODE
LOWtests/utils/test_managed_process_teardown.py224CODE
LOWtests/utils/pytest_parallel_gpu.py448CODE
LOWtests/utils/pytest_parallel_gpu.py681CODE
LOWtests/utils/managed_process.py272CODE
LOWtests/utils/managed_process.py350CODE
LOWtests/utils/managed_process.py523CODE
LOWtests/utils/managed_process.py645CODE
541 more matches not shown…
Modern AI Meta-Vocabulary163 hits · 462 pts
SeverityFileLineSnippetContext
MEDIUMdeploy/helm/charts/platform/README.md497 enabled: true # Enables multinode orchestration via PodCliqueSetsCODE
MEDIUMdeploy/helm/charts/platform/README.md507 enabled: true # Enables multinode orchestration via PodCliqueSetsCODE
MEDIUMdeploy/helm/charts/platform/values.yaml54 # -- Whether to enable Grove integration (multinode orchestration via PodCliqueSets).COMMENT
MEDIUMdeploy/helm/charts/platform/values.yaml286# Grove component - distributed inference orchestrationCOMMENT
MEDIUMdeploy/operator/cmd/main.go82 //+kubebuilder:scaffold:importsCOMMENT
MEDIUMdeploy/operator/cmd/main.go139 //+kubebuilder:scaffold:schemeCOMMENT
MEDIUMdeploy/operator/internal/AGENTS.md6# DGD workload orchestrationCOMMENT
MEDIUMtests/frontend/test_vllm.py102 "--max-model-len", # this reduced max context window and amount of GPU memory allocated for contextCODE
MEDIUMtests/frontend/test_frontend_api_surface_compliance.py566 # hallucination — it must actually invoke `ls` to discover it.COMMENT
MEDIUMtests/frontend/test_tool_calling_sglang.py739 # hallucinate values for optional fields. Validate only that theCOMMENT
MEDIUM…lerance/deploy/templates/sglang/sglang_elastic_ep.yaml40# The joining group is NOT launched by the operator yet (that orchestration isCOMMENT
MEDIUM⚡tests/serve/test_vllm.py1018# 1. Load-balances across N workers serving the SAME embedding model.COMMENT
MEDIUMdocs/fern/components/RecipeStyles.tsx234#workload-agentic-coding:checked ~ .dynamo-recipe-browser label[for="workload-agentic-coding"],COMMENT
MEDIUMdocs/fern/components/RecipeStyles.tsx712#workload-agentic-coding:checked ~ .dynamo-model-grid [data-recipe-card]:not([data-workload~="agentic-coding"]),COMMENT
MEDIUMdocs/fern/components/publications.data.ts432 url: "https://www.digitalocean.com/blog/workato-nvidia-technical-deep-dive-agentic-inference-cloud",CODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx617body:has(.dynamo-blog-home) #fern-sidebar .fern-sidebar-group-level-1 a[href$="/agentic-harnesses"]::before,CODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx618body:has(.dynamo-blog-article) #fern-sidebar .fern-sidebar-group-level-1 a[href$="/agentic-harnesses"]::before { contentCODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx620body:has(.dynamo-blog-home) #fern-sidebar .fern-sidebar-group-level-1 a[href$="/agentic-inference"]::before,CODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx621body:has(.dynamo-blog-article) #fern-sidebar .fern-sidebar-group-level-1 a[href$="/agentic-inference"]::before { contentCODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx1000body:has(.dynamo-blog-home) #fern-sidebar a[href$="/agentic-harnesses"] .fern-sidebar-link-title-inner::before,CODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx1001body:has(.dynamo-blog-article) #fern-sidebar a[href$="/agentic-harnesses"] .fern-sidebar-link-title-inner::before { contCODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx1003body:has(.dynamo-blog-home) #fern-sidebar a[href$="/agentic-inference"] .fern-sidebar-link-title-inner::before,CODE
MEDIUM⚡docs/fern/components/BlogStyles.tsx1004body:has(.dynamo-blog-article) #fern-sidebar a[href$="/agentic-inference"] .fern-sidebar-link-title-inner::before { contCODE
MEDIUMdocs/fern/pages/use-cases/multimodal-serving/voice.md46[external orchestration](https://github.com/ai-dynamo/dynamo/tree/main/examples/nemotron_speech_cascaded_pipeline#externCODE
MEDIUM…es/reinforcement-learning/operations-and-simulation.md63Open the result in the [Perfetto UI](https://ui.perfetto.dev/). The timeline shows request, prefill, and decode slices; CODE
MEDIUM…-guide/advanced-customizations/developing-with-tilt.md103# enable_grove: false # PodClique-based multi-node orchestrationCOMMENT
MEDIUM…es/tensorrt-llm-details/building-a-custom-container.md87If your custom build places TRT-LLM's bundled NIXL at a different path (or uses a non-3.12 Python), edit the `LD_PRELOADCODE
MEDIUM…/fern/pages/developer-guide/knowledge-base/overview.md70### Control Plane (adaptation and orchestration path)COMMENT
MEDIUM…/modular-components/backends/sglang/reference-guide.md40| `--dyn-reasoning-parser` | `DYN_REASONING_PARSER` | `None` | [Reasoning](../../../../../use-cases/tool-calling-and-reaCODE
MEDIUM…n/pages/kubernetes/model-deployment/deploy-with-dgd.md462**Multinode.** When TP × PP exceeds the GPUs on one node, set `multinode.nodeCount` on the worker so it spans machines; CODE
MEDIUM…s/fern/pages/kubernetes/installation/install-dynamo.md60**Grove + KAI Scheduler** — Grove is the default multinode orchestrator. The operator returns a hard error on multinode CODE
MEDIUM…s/fern/pages/kubernetes/installation/install-dynamo.md240See the [LWS docs](https://lws.sigs.k8s.io/docs/) and [Volcano docs](https://github.com/volcano-sh/volcano#quick-start-gCODE
MEDIUM…bernetes-api/additional-resources/api-reference-k8s.md876| `extraClientPods` _[GMSClientPodSpec](#gmsclientpodspec) array_ | ExtraClientPods declares additional GMS client pods CODE
MEDIUM…bernetes-api/additional-resources/api-reference-k8s.md2359| `extraClientPods` _[GMSClientPodSpec](#gmsclientpodspec) array_ | extraClientPods declares additional GMS client pods CODE
MEDIUM…ntainer/compliance/base_sboms/capture_baseline_sbom.py606# ---- main capture orchestration ----------------------------------------------COMMENT
MEDIUMcomponents/src/dynamo/frontend/tests/FRONTEND_CASES.md139## `FRONTEND.9` — Reasoning ↔ tool-call orchestrationCOMMENT
MEDIUM⚡…rc/dynamo/frontend/tests/test_sglang_processor_unit.py5508class TestReasoningParsing: # FRONTEND.9 — reasoning ↔ tool-call orchestrationCODE
MEDIUMcomponents/src/dynamo/vllm/instrumented_scheduler.py7143 # scaffolding. A rank that reached the deadline with theCOMMENT
MEDIUMcomponents/src/dynamo/vllm/instrumented_scheduler.py7271 # Warmup replicas are best-effort scaffolding and must beCOMMENT
MEDIUMcomponents/src/dynamo/vllm/instrumented_scheduler.py7409 # Warmup replicas are best-effort scaffolding on EVERY failureCOMMENT
MEDIUM…nts/src/dynamo/profiler/utils/config_modifiers/vllm.py134 # vllm reads the context window cap from --max-model-lenCOMMENT
MEDIUM…src/dynamo/profiler/utils/config_modifiers/protocol.py178 # Worker CLI args that cap the context window. An external generator derivesCOMMENT
MEDIUMcomponents/src/dynamo/replay/simulation.py339 # The native loader distinguishes standard from agentic DynamoCOMMENT
MEDIUMcomponents/src/dynamo/replay/api.py355 # offline planner run (matches the CLI's guardrails).COMMENT
MEDIUMagent-docs/rules/execution/user-workload.md37 type: chat # chat | agentic | customCODE
MEDIUMrecipes/gpt-oss-120b/vllm/agg-b200-agentic/deploy.yaml3# gpt-oss-120b — AGGREGATED, B200, agentic (64k/400) — Dynamo 1.3.0 / vLLM 0.23.COMMENT
MEDIUMrecipes/gpt-oss-120b/vllm/agg-h200-agentic/deploy.yaml3# gpt-oss-120b — AGGREGATED, H200, agentic (64k/400) — Dynamo 1.3.0 / vLLM 0.23.COMMENT
MEDIUMrecipes/gpt-oss-120b/vllm/agg-h200-agentic/deploy.yaml76 # agentic trace (2026-07-09 perf A/B) — the host tier relieves GPU KV eviction pressure — and itCOMMENT
MEDIUM…ipes/gpt-oss-120b/vllm/disagg-b200-agentic/deploy.yaml3# gpt-oss-120b -- DISAGGREGATED (DGD, single-node colocated), B200, agentic -- Dynamo 1.3.0 / vLLM 0.23.COMMENT
MEDIUM…ipes/gpt-oss-120b/vllm/disagg-b200-agentic/deploy.yaml8# fast path; EAGLE3 spec on both P and D. 2P6D is the best B200 split on the agentic trace -- see perf/README.md.COMMENT
MEDIUM…ipes/gpt-oss-120b/vllm/disagg-h200-agentic/deploy.yaml3# gpt-oss-120b -- DISAGGREGATED (DGD, single-node colocated), H200, agentic -- Dynamo 1.3.0 / vLLM 0.23.COMMENT
MEDIUM…ipes/gpt-oss-120b/vllm/disagg-h200-agentic/deploy.yaml8# fast path; EAGLE3 spec on both P and D. 4P4D is the best H200 split on the agentic trace -- see perf/README.md.COMMENT
MEDIUMrecipes/gpt-oss-120b/perf/README.md151# kubectl delete pods -n ${NAMESPACE} -l nvidia.com/dynamo-graph-deployment-name=turbo-gptoss-120b-disagg-b200-agentic,nCOMMENT
MEDIUMrecipes/gpt-oss-120b/perf/perf.yaml146 value: /model-cache/traces/64k_400_90kv_agent_new_noschedule_short_15perc.jsonl # agentic 15% trace (staged fCODE
MEDIUMrecipes/gpt-oss-120b/perf/perf.yaml148 value: "384" # B200 agentic ~50-tps floor; H200 ~128. Sweep by restarting DGD workers between runs.CODE
MEDIUMrecipes/inkling/vllm/agg-gb300-agentic/deploy.yaml4# Inkling-NVFP4 on vLLM, aggregated serving on GB300, tuned for an agenticCOMMENT
MEDIUM⚡…inkling/vllm/disagg-gb300-agentic/deploy-aws-roce.yaml6# scripts/kustomize-matrix.py unfold recipes/inkling/vllm/disagg-gb300-agentic/.kustomize-matrix.yamlCOMMENT
MEDIUM⚡…inkling/vllm/disagg-gb300-agentic/deploy-aws-roce.yaml7# scripts/kustomize-matrix.py render recipes/inkling/vllm/disagg-gb300-agentic/.kustomize-matrix.yamlCOMMENT
MEDIUM⚡…inkling/vllm/disagg-gb300-agentic/deploy-aws-roce.yaml9# kustomize build recipes/inkling/vllm/disagg-gb300-agentic/kustomize/overlays/aws-roceCOMMENT
MEDIUM…inkling/vllm/disagg-gb300-agentic/deploy-aws-roce.yaml28# agentic workload (64K median ISL / 400 median OSL, 90% KV cache hit) withCOMMENT
103 more matches not shown…
Cross-Language Confusion95 hits · 461 pts
SeverityFileLineSnippetContext
HIGHdeploy/utils/convert_api_version.py309 misread as bool/null, so converted manifests round-trip through kubectl."""STRING
HIGHtests/test_kustomize_matrix.py930 # An empty (or all-null) mapping would render `legacySortOptions:` with noCOMMENT
HIGHtests/fault_tolerance/cancellation/test_utils.py45 b'data: {"choices":[{"delta":{"role":"assistant"},"finish_reason":null}]}',CODE
HIGHtests/fault_tolerance/cancellation/test_utils.py62 b'data: {"choices":[{"delta":{"content":"healthy"},"finish_reason":null}]}',CODE
HIGH…ault_injection_service/helpers/cuda_fault_injection.py458 f'mkdir -p /host-fault && echo "{toggle_value}" > /host-fault/cuda_fault_enabled && cat /host-fault/CODE
HIGH…ault_injection_service/helpers/cuda_fault_injection.py565 'rm -f /host-fault/cuda_fault_enabled 2>/dev/null; echo "ok"',CODE
HIGHtests/kvbm_integration/test_determinism_disagg.py328 f"pip install hf_transfer && HF_HUB_ENABLE_HF_TRANSFER=1 hf download {model}",CODE
HIGHtests/router/e2e_harness.py77 stack.push(process)CODE
HIGH…ynamo-interconnect-check/scripts/check_interconnect.py285 "command -v nixlbench nixl_test 2>/dev/null; ls /usr/local/nixl 2>/dev/null",CODE
HIGHdocs/fern/scripts/gen_nightly_selector.py491 " dynamo: string | null;",CODE
HIGHdocs/fern/scripts/gen_llms_tables.py63 numbers, true/false/null, and bare identifier references to previouslySTRING
HIGHdocs/fern/pages/recipes/_catalog/validate.py27mappings, block lists of scalars and of mappings, quoted/plain scalars, null,STRING
HIGHcomponents/src/dynamo/frontend/vllm_processor.py350 (not null) from usage.STRING
HIGH…/src/dynamo/frontend/tests/test_vllm_processor_unit.py329 text='[{"name":"get_weather","parameters":null}]',CODE
HIGHcomponents/src/dynamo/planner/plugins/scheduler.py191 # call (last_call_at == -inf) lag is undefined; pin atCOMMENT
HIGH…/src/dynamo/vllm/multimodal_utils/request_processor.py173 f"strings or null; got invalid entry at index {index}"CODE
HIGHcomponents/src/dynamo/vllm/omni/audex.py332 """Return the (conditional, null) ChatML prompt builders for a task.STRING
HIGH…src/dynamo/common/configuration/groups/runtime_args.py283 help="[Deprecated for vLLM] Use --kv-transfer-config instead. For TRT-LLM, options: nixl, lmcache, kvbm, nulCODE
HIGH⚡…namo/common/tests/configuration/test_kv_router_args.py609 '{"eff_isl_ratio_threshold":null}',CODE
HIGH…c/dynamo/profiler/tests/unit/test_profiler_protocol.py1718 "export FOO=bar && python3 -m vllm.entrypoints.openai.api_server "CODE
HIGH⚡…namo/profiler/tests/unit/test_trtllm_override_merge.py152 "export READY=1 && python3 -m dynamo.trtllm "CODE
HIGH⚡…namo/profiler/tests/unit/test_trtllm_override_merge.py154 "--trtllm.enable_chunked_prefill false && echo ready"CODE
HIGH…namo/profiler/tests/unit/test_trtllm_override_merge.py187 "export READY=1 && python3 -m dynamo.trtllm "CODE
HIGH…namo/profiler/tests/unit/test_trtllm_override_merge.py189 "--trtllm.enable_chunked_prefill true && echo ready"CODE
HIGH…onents/src/dynamo/profiler/utils/dgdr_v1beta1_types.py215 description="Planner contains the raw Planner configuration passed to the Planner service. Its schema is definedCODE
HIGH…/src/dynamo/trtllm/tests/test_trtllm_logits_runtime.py83 """When `stream_ptr` is non-null, the adapter wraps the processorSTRING
HIGHbenchmarks/frontend/scripts/sweep_k8s/aiperf.py63apt-get update -qq && apt-get install -y -qq curl jq git procps 2>/dev/nullCODE
HIGHbenchmarks/frontend/scripts/sweep_k8s/aiperf.py311 command: ["sh", "-c", "echo ready && sleep 300"]CODE
HIGH…nchmarks/request_trace/validate_convert_to_perfetto.py206 '{"request_kind":"compaction","unknown":null}',CODE
HIGHlib/gpu_memory_service/common/vmm/_sycl_vmm/__init__.py51 "Build it with: cd _sycl_vmm && cmake -B build "CODE
HIGH⚡dev/sanity_check.py3972 print(" Runtime: (cd lib/bindings/python && maturin develop)")CODE
HIGH⚡dev/sanity_check.py3986 " Runtime: (cd lib/bindings/python && maturin develop)",CODE
HIGHgyms/planner-gym/tests/test_html_report.py964 assert "if (!schedulerReuse.length && cachePoints.length)" in renderedCODE
HIGHgyms/planner-gym/tests/test_html_report.py966 "if (!routerKvHit.length && !schedulerReuse.length && cachePoints.length)"CODE
HIGH⚡gyms/planner-gym/tests/test_scorecard.py136 _rec(250.0, 250.0, 1), # bad (itl undefined)CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1846 const queueMeasurements = result.timeline.filter(point => point.total_queued_requests !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1847 const schedulerQueue = result.timeline.filter(point => point.scheduler_waiting_requests !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1848 const routerQueue = result.timeline.filter(point => point.router_pending_requests !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1849 const latency = result.timeline.filter(point => point.ttft_ms !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1850 const tpot = result.timeline.filter(point => point.tpot_ms !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1851 const activeKv = result.timeline.filter(point => point.active_kv_cache_utilization !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1852 const physicalKv = result.timeline.filter(point => point.physical_kv_cache_utilization !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1853 const schedulerReuse = result.timeline.filter(point => point.scheduler_cache_reuse !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1854 const routerKvHit = result.timeline.filter(point => point.router_kv_hit_rate !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1855 const decisions = result.timeline.filter(point => point.requested_replicas !== null);CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1863 if (activeKv.length || physicalKv.length) laneCounts.kv += 1;CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1867 if (cacheAggregate !== null) laneCounts.cacheAggregate += 1;CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1877 if (queueMeasurements.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1917 if (latency.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1927 if (tpot.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1937 if (activeKv.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1989 if (!schedulerReuse.length && cachePoints.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1989 if (!schedulerReuse.length && cachePoints.length) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1999 if (!schedulerReuse.length && !cachePoints.length && cacheAggregate !== null) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1999 if (!schedulerReuse.length && !cachePoints.length && cacheAggregate !== null) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py1999 if (!schedulerReuse.length && !cachePoints.length && cacheAggregate !== null) traces.push({CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py2075 if (scope.arrivals.status !== "ok") annotations.push(laneAnnotation(scope.arrivals.note, .945));CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py2077 .filter(result => !result.timeline.some(point => point.total_queued_requests !== null))CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py2080 annotations.push(laneAnnotation("Total requests in queue unavailable; no values inferred.", .8125));CODE
HIGH⚡gyms/planner-gym/src/autoscaling_arena/html_report.py2082 annotations.push(laneAnnotation(`Queue depth unavailable for ${queueUnavailable.join(", ")}; no values inferred.`,CODE
35 more matches not shown…
Docstring Block Structure80 hits · 385 pts
SeverityFileLineSnippetContext
HIGHtests/frontend/conftest.py82Check if the gRPC server process is up and accepting connections. Uses KServe `server_live` rather than `server_reaSTRING
HIGHtests/deploy/dgd_utils.py83Validate the structure and content of a chat completion response. Args: response: HTTP response from the chSTRING
HIGHtests/utils/client.py59 Send an HTTP request to the engine with detailed logging. Args: url: The endpoint URL payload:STRING
HIGHtests/utils/output_paths.py18Resolve a test output path to an absolute path. This function ensures test output is written to a dedicated locatioSTRING
HIGH…_service/agents/gpu_fault_injector/gpu_xid_injector.py157 Get PCI address for GPU by reading /host/proc/driver/nvidia/gpus/. This method works without nvidia-smSTRING
HIGHtests/fault_tolerance/deploy/parse_factory.py110Auto-detect and parse test results using the appropriate parser. This function automatically detects whether resultSTRING
HIGHtests/fault_tolerance/deploy/client_factory.py22Get the appropriate client function based on client type. This factory function returns the correct client implemenSTRING
HIGHtests/fault_tolerance/deploy/client_factory.py95Get a human-readable description of a client type. Args: client_type: Client type to describe Returns:STRING
HIGHtests/kvbm_integration/common.py1329Fetch and parse KVBM metrics from the metrics endpoint. Args: port: Metrics server port (required for dynamSTRING
HIGHtests/router/helper.py423Poll the endpoint's discovery client until the expected number of worker instances appear. Args: endpoint: STRING
HIGHtests/router/helper.py470Wait for workers to be ready and return their instance IDs. Supports mocker and vLLM workers. This function polSTRING
HIGHdocs/fern/scripts/tests/test_gen_python_api.py152\ """Fixture package exercising every docstring section the renderer maps.""" def documented(request_model: str, respoSTRING
HIGHcomponents/src/dynamo/planner/connectors/kubernetes.py438Get GPU shapes from an already-fetched deployment. Args: deployment: Deployment dict to inspect STRING
HIGHcomponents/src/dynamo/planner/plugins/transport/base.py60Invoke a plugin RPC by method name. Args: method: RPC method name. One of ``"Predict"`` / ``"ProposSTRING
HIGHcomponents/src/dynamo/vllm/envs.py27 Resolve port from environment variable with validation. Args: env_var: Environment variable name STRING
HIGHcomponents/src/dynamo/vllm/handlers.py3202 Decode base64-encoded prompt embeddings in PyTorch format. Use vllm's safe loader to prevent out-of-boSTRING
HIGHcomponents/src/dynamo/vllm/handlers.py3245 Decode prompt embeddings and create EmbedsPrompt for vLLM. Args: prompt_embeds_base64: BasSTRING
HIGHcomponents/src/dynamo/vllm/handlers.py3278 Build a prompt from request, handling both prompt_embeds and token_ids. Args: request: TheSTRING
HIGHcomponents/src/dynamo/vllm/multimodal_utils/model.py132Return the multimodal model family for the given identifier, or `None` if no registered family matches. ResolutSTRING
HIGH…nents/src/dynamo/vllm/multimodal_utils/encode_utils.py47 Extract image features using Qwen-style vision encoder. Args: vision_encoder: The vision encoder modelSTRING
HIGH…nents/src/dynamo/vllm/multimodal_utils/encode_utils.py92 Encode image embeddings using the appropriate model-specific encoder. Args: model_name: The model idenSTRING
HIGH…nents/src/dynamo/vllm/multimodal_utils/encode_utils.py136 Get the appropriate vision encoder and projector components for a given model. Args: model_name: The mSTRING
HIGH…vllm/multimodal_utils/custom_encoder/adapter/linear.py56Build the mixed token-ids/embeds inputs for an aggregated request. Args: token_ids: The full prompt token ISTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py137Format the next text delta as a chat-completion chunk. Args: request_output: vLLM request output coSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py213Format a diffusion stage output as an image or video response. Args: stage_output: vLLM-Omni stage STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py258Encode generated frames and optional audio as video responses. Args: images: Primary generated videSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py421Separate a batched diffusion payload into individual videos. Args: images: Primary video-frame paylSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py466Normalize one video to uint8 ``(frames, height, width, channels)``. Args: video: Video tensor, arraSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py544Align generated audio payloads with their corresponding videos. Args: audio: Batched or per-video aSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py579Convert an audio payload to a float32 NumPy array. Args: audio: Tensor, array, or array-like audio STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py604Resolve positive numeric metadata rounded to the nearest integer. Args: multimodal_output: MultimodSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py631Resolve an audio sample rate from known metadata aliases. Args: multimodal_output: Multimodal payloSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py667Round a scalar value to a positive integer when possible. Args: value: Scalar-like value to convertSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py696Encode generated images for chat or image-generation responses. Args: images: Generated image objecSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py760Serialize images as data URLs or upload-backed URLs. Args: images: Generated image objects supportiSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py925Encode all buffered raw chunks as one complete audio file. Args: request_id: Identifier included inSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py957Normalize and append one chunk to aggregate audio state. Args: state: Aggregate state receiving theSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py993Validate and record stable audio-stream metadata. Args: state: Streaming or aggregate state to valiSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1030Extract new float32 audio samples and their sample rate. Args: mm_output: Multimodal mapping contaiSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1078Resolve the latest sample rate from multimodal output. Args: mm_output: Multimodal mapping containiSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1103Encode one incremental audio chunk as PCM or streaming WAV. Args: audio_np: Raw mono or stereo audiSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1139Normalize mono or stereo audio to vLLM-Omni's channel-first layout. An established channel axis determines the STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1226Convert supported audio layouts to soundfile's frame-major layout. Args: audio_np: Raw mono or sterSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1253Build a PCM WAV header whose payload length is not known yet. Args: sample_rate: Audio sample rate STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1290Normalize, optionally retime, and encode complete audio. Args: audio_np: Raw mono or stereo audio sSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1322Encode frame-major audio with soundfile. Args: audio_np: Frame-major mono or stereo samples. STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1404Build token-usage statistics from a vLLM request output. Args: request_output: Request output containing prSTRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1479Dispatch a stage output to its modality formatter. Args: stage_output: vLLM-Omni output carrying ``STRING
HIGHcomponents/src/dynamo/vllm/omni/output_formatter.py1518Finalize buffered audio through the audio formatter. Args: request_id: Identifier included in the fSTRING
HIGHcomponents/src/dynamo/vllm/omni/omni_handler.py855Build engine inputs from an NvCreateVideoRequest. Args: req: Parsed video generation request. STRING
HIGHcomponents/src/dynamo/common/storage.py76Build a public URL for a file stored in the media filesystem. Args: fs: The DirFileSystem returned by ``getSTRING
HIGH…mo/common/memory/multimodal_embedding_cache_manager.py84Calculate tensor size in bytes. Args: tensor: Must be a contiguous tensor. Returns: STRING
HIGHcomponents/src/dynamo/common/utils/endpoint_types.py10Parse comma-separated endpoint types into ModelType flags. Args: endpoint_types_str: Comma-separated list oSTRING
HIGHcomponents/src/dynamo/common/utils/image_utils.py20Encode numpy image to PNG bytes (in-memory). Args: image: Numpy image array of shape (H, W, 3) with uint8 vSTRING
HIGHcomponents/src/dynamo/common/utils/video_utils.py86Convert a list of video frames to a numpy array suitable for encoding. Accepts either PIL Images or numpy arrays. DSTRING
HIGHcomponents/src/dynamo/common/utils/video_utils.py135Encode numpy frames to MP4 file. Args: frames: Video frames as numpy array of shape (num_frames, height, wiSTRING
HIGHcomponents/src/dynamo/common/utils/video_utils.py198Encode numpy frames to video bytes (in-memory). Args: frames: Video frames as numpy array of shape (num_fraSTRING
HIGHcomponents/src/dynamo/common/utils/runtime.py22Parse a Dynamo endpoint string into its components. Args: endpoint: Endpoint string in format 'namespace.coSTRING
HIGHcomponents/src/dynamo/common/utils/topology.py121Read topology config from a file-backed source and env vars. The deployment environment injects env vars for topoloSTRING
HIGHcomponents/src/dynamo/common/config_dump/environment.py56 Get relevant environment variables based on prefixes. Args: prefixes: List of environment variable preSTRING
20 more matches not shown…
AI Slop Vocabulary104 hits · 278 pts
SeverityFileLineSnippetContext
MEDIUMconftest.py30# examples/backends/sglang/test_sglang_profile.py assumes a server the harnessCOMMENT
MEDIUM.pre-commit-config.yaml165 # the reproducibility claim is only as good as the harness asserting it.COMMENT
MEDIUMdeploy/helm/charts/power-agent/templates/dev-pod.yaml7# In-cluster dev-iteration harness. Renders a single Pod that mountsCOMMENT
MEDIUM…perator/internal/namespace_scope/lease_manager_test.go263 // Poll for renewal with timeout (more robust than fixed sleep)COMMENT
MEDIUMtests/deploy/efa_utils.py60# so request a larger budget here to keep these single-completion tests robust.COMMENT
MEDIUMtests/utils/collection_env_guard.py46# Nothing should mutate a watched var during collection -- legitimate harnessCOMMENT
MEDIUMtests/utils/managed_process.py482 # Capture the child's process group id for robust cleanup even if parent shell exitsCOMMENT
MEDIUMtests/utils/managed_process.py509 # Capture the child's process group id for robust cleanup even if parent shell exitsCOMMENT
MEDIUMtests/utils/payloads.py1586 # by the harness). Each indexed worker must have observed >0 deltaCOMMENT
MEDIUMtests/utils/payloads.py1590 # config-construction time because the harness assigns dynamic ports.COMMENT
MEDIUMtests/fault_tolerance/deploy/scenarios.py475 """Log comprehensive pod diagnostics including process list, GPU info, and nvidia-smi."""STRING
MEDIUMtests/kvbm_integration/common.py359 """Perform comprehensive server warmup with all test prompts."""STRING
MEDIUMtests/kvbm_integration/common.py413 """Run the test iterations with comprehensive warmup."""STRING
MEDIUMtests/serve/test_sidecar.py181 # kill timer, while EngineConfig.timeout is what the harness givesCOMMENT
MEDIUMtests/serve/test_vllm.py685 # Pooling models do not use a KV cache, but the test harness stillCOMMENT
MEDIUMtests/serve/test_vllm.py758 # Pooling models do not use a KV cache, but the harness requiresCOMMENT
MEDIUMtests/serve/common.py51# subclasses (e.g. ChatPayloadWithLogprobs) and is robust to ad-hoc `endpoint`COMMENT
MEDIUMtests/router/test_router_e2e_with_vllm.py194 # harness launches internal-LB DP (only --data-parallel-size, noCOMMENT
MEDIUMtests/router/test_router_e2e_with_vllm_xpu.py197 # health_check_ports=[kv_event_port]: the harness will pollCOMMENT
MEDIUM.agents/skills/dynamo-frontend-benchmark/scripts/env.sh5# Shared environment for the Dynamo frontend benchmark harness.COMMENT
MEDIUMdocs/fern/scripts/simulate_docs_website.sh5# simulate_docs_website.sh — local regression harness for the fern-docs.ymlCOMMENT
MEDIUMcontainer/compliance/generators/dpkg.py233# Detecting these references is the highest-leverage lever for cutting UNKNOWNs.COMMENT
MEDIUMcomponents/src/dynamo/frontend/sglang_prepost.py1267 # Full text accumulator for robust finish-time re-parse.COMMENT
LOWcomponents/src/dynamo/common/utils/output_modalities.py60 # For now, we ignore model repo and just use cli input to determine output modalities.COMMENT
MEDIUMexamples/custom_encoder/launch/agg_qwen3_5_native.sh49# test harness can replace this per run through the same override.COMMENT
MEDIUMexamples/custom_encoder/launch/agg_custom.sh45# Precedence: explicit DYN_WORKER_GPU/--gpu > harness-set CUDA_VISIBLE_DEVICESCOMMENT
MEDIUMexamples/custom_encoder/launch/agg_custom.sh91# VRAM sizing: honors the profiler/test-harness overrideCOMMENT
MEDIUM⚡…ds/vllm/launch/agg_multimodal_router_chat_processor.sh37# Honor DYN_HTTP_PORT (set by the tests/serve harness for dynamicCOMMENT
MEDIUM…ds/vllm/launch/agg_multimodal_router_chat_processor.sh80# The serve-test harness invokes scripts as `bash <script> --model NAME ...`,COMMENT
MEDIUMexamples/backends/vllm/launch/disagg_same_gpu.sh27# Inherit GPU from parent (profiler/test harness sets CUDA_VISIBLE_DEVICES);COMMENT
MEDIUM⚡…launch/xpu/agg_multimodal_router_chat_processor_xpu.sh37# Honor DYN_HTTP_PORT (set by the tests/serve harness for dynamicCOMMENT
MEDIUM…launch/xpu/agg_multimodal_router_chat_processor_xpu.sh80# The serve-test harness invokes scripts as `bash <script> --model NAME ...`,COMMENT
MEDIUM…ples/backends/sample/launch/multimodal_smoke_client.py175 # a fresh timeout that can exceed the outer test harness deadline.COMMENT
MEDIUMexamples/backends/sglang/launch/diffusion_llada.sh25# Manual HTTP_PORT override, else the harness-assigned DYN_HTTP_PORT, else the default.COMMENT
MEDIUMexamples/backends/sglang/launch/agg_vision.sh85# Profiler/test-harness override: when _PROFILE_OVERRIDE_SGLANG_MAX_TOTAL_TOKENS isCOMMENT
MEDIUM…amples/backends/sglang/launch/agg_multimodal_router.sh23# Honor DYN_HTTP_PORT (set by tests/serve harness for dynamic port allocation)COMMENT
MEDIUM…amples/backends/sglang/launch/agg_multimodal_router.sh98# harness for parallel runs; standalone runs fall back to the script's port bases.COMMENT
MEDIUM…amples/backends/sglang/launch/agg_multimodal_router.sh165 # the harness may have applied (instead of the default formula).COMMENT
MEDIUMexamples/backends/trtllm/launch/disagg_e_pd.sh34# Profiler/test-harness override applied to the KV-cache-bearing PD worker.COMMENT
MEDIUM…s/trtllm/launch/epd_multimodal_image_and_embeddings.sh30# Profiler/test-harness override applied to KV-cache-bearing workers (prefill, decode).COMMENT
MEDIUMexamples/backends/trtllm/launch/disagg_multimodal.sh21# Profiler/test-harness override applied to KV-cache-bearing workers (prefill, decode).COMMENT
MEDIUMexamples/backends/trtllm/launch/agg_multimodal.sh18# Profiler/test-harness override: when _PROFILE_OVERRIDE_TRTLLM_MAX_TOTAL_TOKENS orCOMMENT
MEDIUMexamples/backends/trtllm/launch/agg_router_approx.sh18# Profiler/test-harness override applied to the KV-cache-bearing worker.COMMENT
MEDIUM…amples/backends/trtllm/launch/agg_multimodal_router.sh28# Profiler/test-harness override: KvCacheConfig JSON when env var is set, empty otherwise.COMMENT
MEDIUM⚡examples/common/launch_utils.sh123# harness signalling the process group) otherwise interrupts wait -n andCOMMENT
MEDIUM⚡examples/common/launch_utils.sh134# subreaper (pytest in CI), and the harness's pgid liveness checkCOMMENT
MEDIUM.github/filters.yaml320 # Standalone CRD apiVersion converter: not used by the deploy-test harness andCOMMENT
MEDIUM.github/actions/docker-remote-build/action.yml296 # Output single comprehensive JSON with all build stagesCOMMENT
MEDIUM.github/actions/docker-remote-build/action.yml344 # Upload comprehensive build metrics as artifactCOMMENT
LOW.github/actions/bootstrap-buildkit/action.yml93 # If the builder already exists, these commands will just set the right configurations to use itCOMMENT
MEDIUM.github/actions/docker-build/action.yml301 # Output single comprehensive JSON with all build stagesCOMMENT
MEDIUM.github/actions/docker-build/action.yml349 # Upload comprehensive build metrics as artifactCOMMENT
MEDIUMlib/llm/tests/kv_manager.rs203// /// and hold them until a RDMA GET COMPLETION notification is received. Essentially, the task whichCOMMENT
MEDIUM…ests/data/deepseek-v3.2/test_input_search_wo_date.json243 "content": "[4] www.annualreports.com (https://www.annualreports.com/HostedData/AnnualReportArchive/d/defendCODE
MEDIUM…ests/data/deepseek-v3.2/test_input_search_wo_date.json283 "content": "[6] www.annualreports.com (https://www.annualreports.com/HostedData/AnnualReportArchive/d/defendCODE
MEDIUM…ests/data/deepseek-v3.2/test_input_search_wo_date.json323 "content": "[8] www.annualreports.com (https://www.annualreports.com/HostedData/AnnualReportArchive/d/defendCODE
MEDIUM…ests/data/deepseek-v3.2/test_input_search_wo_date.json423 "content": "[13] As of December 5, 2021, Kenya had received a total of 16,201,670 vaccines (Search_Results/ACODE
MEDIUM…ests/data/deepseek-v3.2/test_input_search_wo_date.json443 "content": "[14] www.worldbank.org (https://www.worldbank.org/en/news/press-release/2021/12/14/kenya-s-econoCODE
MEDIUM⚡…tests/data/deepseek-v3.2/test_input_search_w_date.json199 "content": "[2] (https://ar5iv.org/html/2510.19631v1)\n**viewing lines [0 - 119] of 983**\n\nL0: \nL1: URL:CODE
MEDIUM⚡…tests/data/deepseek-v3.2/test_input_search_w_date.json199 "content": "[2] (https://ar5iv.org/html/2510.19631v1)\n**viewing lines [0 - 119] of 983**\n\nL0: \nL1: URL:CODE
44 more matches not shown…
Cross-File Repetition42 hits · 210 pts
SeverityFileLineSnippetContext
HIGHtests/fault_tolerance/etcd_ha/test_vllm.py0test etcd high availability with repeated node failures and recoveries for trt-llm in disaggregated mode. this test: 1. STRING
HIGHtests/fault_tolerance/etcd_ha/test_trtllm.py0test etcd high availability with repeated node failures and recoveries for trt-llm in disaggregated mode. this test: 1. STRING
HIGHtests/fault_tolerance/etcd_ha/test_sglang.py0test etcd high availability with repeated node failures and recoveries for trt-llm in disaggregated mode. this test: 1. STRING
HIGHtests/fault_tolerance/migration/test_vllm.py0end-to-end test for aggregated worker request migration. parameters: immediate_kill: true for abrupt kill (sigkill), falSTRING
HIGHtests/fault_tolerance/migration/test_trtllm.py0end-to-end test for aggregated worker request migration. parameters: immediate_kill: true for abrupt kill (sigkill), falSTRING
HIGHtests/fault_tolerance/migration/test_sglang.py0end-to-end test for aggregated worker request migration. parameters: immediate_kill: true for abrupt kill (sigkill), falSTRING
HIGHtests/kvbm_integration/test_determinism_agg.py0create determinism tester bound to the running server's base url.STRING
HIGHtests/kvbm_integration/common.py0create determinism tester bound to the running server's base url.STRING
HIGHtests/kvbm_integration/test_determinism_disagg.py0create determinism tester bound to the running server's base url.STRING
HIGHtests/kvbm_integration/test_determinism_agg.py0test determinism across cache reset: run test with warmup, reset cache, run again without warmup.STRING
HIGHtests/kvbm_integration/common.py0test determinism across cache reset: run test with warmup, reset cache, run again without warmup.STRING
HIGHtests/kvbm_integration/test_determinism_disagg.py0test determinism across cache reset: run test with warmup, reset cache, run again without warmup.STRING
HIGHtests/serve/test_vllm.py0test lora inference with aggregated sglang deployment. this test: 1. uses minio fixture to provide s3-compatible storageSTRING
HIGHtests/serve/test_vllm_xpu.py0test lora inference with aggregated sglang deployment. this test: 1. uses minio fixture to provide s3-compatible storageSTRING
HIGHtests/serve/test_sglang.py0test lora inference with aggregated sglang deployment. this test: 1. uses minio fixture to provide s3-compatible storageSTRING
HIGHtests/router/test_router_e2e_with_sglang.py0validate kv cache prefix reuse with vllm by sending progressive requests with overlapping prefixes. same flow as test_roSTRING
HIGHtests/router/test_router_e2e_with_trtllm.py0validate kv cache prefix reuse with vllm by sending progressive requests with overlapping prefixes. same flow as test_roSTRING
HIGHtests/router/test_router_e2e_with_vllm.py0validate kv cache prefix reuse with vllm by sending progressive requests with overlapping prefixes. same flow as test_roSTRING
HIGHcomponents/src/dynamo/vllm/tests/test_vllm_unit.py0test that invalid file path raises filenotfounderror.STRING
HIGHcomponents/src/dynamo/sglang/tests/test_sglang_unit.py0test that invalid file path raises filenotfounderror.STRING
HIGHcomponents/src/dynamo/trtllm/tests/test_trtllm_unit.py0test that invalid file path raises filenotfounderror.STRING
HIGHcomponents/src/dynamo/vllm/tests/test_vllm_unit.py0test that environment variables in paths are expanded by python code.STRING
HIGHcomponents/src/dynamo/sglang/tests/test_sglang_unit.py0test that environment variables in paths are expanded by python code.STRING
HIGHcomponents/src/dynamo/trtllm/tests/test_trtllm_unit.py0test that environment variables in paths are expanded by python code.STRING
HIGH…s/src/dynamo/vllm/tests/omni/test_video_encode_real.py0return the video stream codec of encoded bytes, via the shipped ffmpeg.STRING
HIGH…ents/src/dynamo/sglang/tests/test_video_encode_real.py0return the video stream codec of encoded bytes, via the shipped ffmpeg.STRING
HIGH…ents/src/dynamo/trtllm/tests/test_video_encode_real.py0return the video stream codec of encoded bytes, via the shipped ffmpeg.STRING
HIGH…rc/dynamo/common/tests/multimodal/test_audio_loader.py0wiring smoke: videoloader plumbs ``url_policy`` to the validator. validator behavior is covered in ``test_url_validator.STRING
HIGH…rc/dynamo/common/tests/multimodal/test_image_loader.py0wiring smoke: videoloader plumbs ``url_policy`` to the validator. validator behavior is covered in ``test_url_validator.STRING
HIGH…rc/dynamo/common/tests/multimodal/test_video_loader.py0wiring smoke: videoloader plumbs ``url_policy`` to the validator. validator behavior is covered in ``test_url_validator.STRING
HIGH…mponents/src/dynamo/common/protocols/image_protocol.py0worker-boundary passthrough. the frontend nests unknown top-level request fields (an openai client's extra_body) under tSTRING
HIGH…mponents/src/dynamo/common/protocols/audio_protocol.py0worker-boundary passthrough. the frontend nests unknown top-level request fields (an openai client's extra_body) under tSTRING
HIGH…mponents/src/dynamo/common/protocols/video_protocol.py0worker-boundary passthrough. the frontend nests unknown top-level request fields (an openai client's extra_body) under tSTRING
HIGH…c/dynamo/profiler/tests/unit/test_profiler_protocol.py0set dgdr_name so _validate_dgd_service_name_lengths runs in tests.STRING
HIGH…dynamo/profiler/tests/unit/test_helpers_profile_sla.py0set dgdr_name so _validate_dgd_service_name_lengths runs in tests.STRING
HIGH…mo/profiler/tests/integration/test_profile_sla_dgdr.py0set dgdr_name so _validate_dgd_service_name_lengths runs in tests.STRING
HIGHlib/bindings/python/examples/hello_world/server.py0create and serve the `generate` endpoint using the distributed runtime. multiple endpoints can be served from a single wSTRING
HIGHlib/bindings/python/examples/error_handling/server.py0create and serve the `generate` endpoint using the distributed runtime. multiple endpoints can be served from a single wSTRING
HIGHlib/bindings/python/examples/typed/server.py0create and serve the `generate` endpoint using the distributed runtime. multiple endpoints can be served from a single wSTRING
HIGHlib/bindings/python/examples/hello_world/client.py0instantiate a `backend` client and call the `generate` endpointSTRING
HIGHlib/bindings/python/examples/error_handling/client.py0instantiate a `backend` client and call the `generate` endpointSTRING
HIGHlib/bindings/python/examples/typed/client.py0instantiate a `backend` client and call the `generate` endpointSTRING
Redundant / Tautological Comments112 hits · 158 pts
SeverityFileLineSnippetContext
LOWdeploy/utils/dynamo_deployment.py490 # Check if deployment is readyCOMMENT
LOWdeploy/utils/kubernetes.py65 # Check if pod exists and delete it if it doesCOMMENT
LOWdeploy/utils/kubernetes.py114 # Check if pod already exists and is runningCOMMENT
LOWdeploy/utils/setup_benchmarking_resources.sh49# Check if namespace existsCOMMENT
LOWdeploy/utils/setup_benchmarking_resources.sh55# Check if Dynamo platform is installedCOMMENT
LOWdeploy/pre-deployment/pre-deployment-check.sh114 # Check if there are multiple default storage classes (which can cause issues)COMMENT
LOWdeploy/pre-deployment/nixl/build_and_deploy.sh257 # Check if at least one valid step was selectedCOMMENT
LOWdeploy/pre-deployment/nixl/build_and_deploy.sh387 # Check if deployment file existsCOMMENT
LOW…/controller/dynamographdeploymentrequest_controller.go211 # Check if profiler container terminatedCOMMENT
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py438 # Check if it's a known enumCOMMENT
LOW…ploy/operator/api/scripts/generate_pydantic_from_go.py445 # Check if it's a struct we're definingCOMMENT
LOWtests/conftest.py1036 # Check if a process is already running on the stored portCOMMENT
LOWtests/conftest.py922 asyncio.get_running_loop() # Check if we're in async contextCODE
LOWtests/deploy/dgd_utils.py1698 # Check if port is assignedCOMMENT
LOWtests/deploy/dgd_utils.py852 ) # Check if process existsCODE
LOW⚡tests/utils/managed_process.py605 # Check if any signaled group is still aliveCOMMENT
LOWtests/utils/managed_process.py691 # Check if the main process is still aliveCOMMENT
LOWtests/utils/payloads.py104 # Check if content is emptyCOMMENT
LOWtests/utils/payloads.py111 # Check if ANY of the expected strings are found (OR logic) and count matchesCOMMENT
LOW⚡tests/fault_tolerance/cancellation/utils.py130 # Set socket to non-blocking to avoid hangingCOMMENT
LOW…_service/agents/gpu_fault_injector/gpu_xid_injector.py181 # Check if proc path existsCOMMENT
LOW⚡…e/hardware/fault_injection_service/api_service/main.py1006 # Check if it's a NetworkPolicyCOMMENT
LOW⚡…e/hardware/fault_injection_service/api_service/main.py1009 # Check if it's a ChaosMesh resourceCOMMENT
LOW…ction_service/cuda_fault_injection/inject_into_pods.py811 # Check if we have the expected number of podsCOMMENT
LOW…ction_service/cuda_fault_injection/inject_into_pods.py813 # Check if all pods are runningCOMMENT
LOW…ction_service/cuda_fault_injection/inject_into_pods.py883 # Check if library exists (try both /tmp and /cuda-fault paths)COMMENT
LOW…ware/fault_injection_service/helpers/k8s_operations.py203 # Check if pod is readyCOMMENT
LOW…ware/fault_injection_service/helpers/k8s_operations.py365 # Check if ready (all containers must be ready)COMMENT
LOW…dware/fault_injection_service/helpers/gpu_discovery.py115 # Check if our PID is in the listCOMMENT
LOWtests/fault_tolerance/deploy/scenarios.py1101 # Check if this is an MoE deploymentCOMMENT
LOWtests/fault_tolerance/deploy/parse_results.py196 # Check if this is a token overflow testCOMMENT
LOWtests/fault_tolerance/deploy/parse_results.py259 # Check if this is a mixed token testCOMMENT
LOWtests/fault_tolerance/deploy/parse_results.py883 # Check if this is an overflow/recovery pair and show timing infoCOMMENT
LOWtests/fault_tolerance/deploy/legacy_parse_results.py104 # Check if request was successfulCOMMENT
LOWtests/fault_tolerance/deploy/test_deployment.py143 # Check if this is a continuous load test (rolling upgrade scenarios)COMMENT
LOWtests/fault_tolerance/deploy/test_deployment.py146 # Check if this is a mixed token test (overflow + recovery)COMMENT
LOWtests/fault_tolerance/etcd_ha/utils.py227 # Check if a leader is elected indicating cluster healthCOMMENT
LOWtests/kvbm_integration/common.py648 # Check if process is listening on our portCOMMENT
LOWtests/kvbm_integration/test_consolidator_router_e2e.py30# Check if engines are available and build list of available enginesCOMMENT
LOWtests/kvbm_integration/test_consolidator_router_e2e.py206 # Check if consolidator startedCOMMENT
LOWtests/serve/lora_utils.py149 # Check if MinIO is already runningCOMMENT
LOWtests/serve/launch/template_verifier.py30 # Check if the custom template marker is presentCOMMENT
LOWtests/lmcache/summarize_scores_dynamo.py185 # Check if this model passed consistency checkCOMMENT
LOWtests/lmcache/run_test.sh30# Check if data existsCOMMENT
LOWtests/lmcache/run_test.sh34 # Check if Python dependencies are installedCOMMENT
LOWtests/lmcache/run_test.sh63# Check if server is respondingCOMMENT
LOWtests/lmcache/run_test.sh104# Check if server is respondingCOMMENT
LOWtests/lmcache/run_test.sh141# Check if result files existCOMMENT
LOWtests/router/helper.py834 # Check if response has token_idsCOMMENT
LOWtests/router/helper.py864 # Verify if expected number of tokens are generated if max_tokens specified and ignore_eos is TrueCOMMENT
LOWcontainer/compliance/generate_go_deps.py260 # Check if the package path starts with the module pathCOMMENT
LOWcomponents/src/dynamo/frontend/vllm_processor.py715 # Set DYNAMO_MM_TRANSFER to choose transfer mode:COMMENT
LOWcomponents/src/dynamo/planner/core/load/predictors.py154 # Check if all values are the same (constant data)COMMENT
LOWcomponents/src/dynamo/planner/plugins/_proto_bridge.py273 # Check if THIS message has a oneof named "result"COMMENT
LOW…onents/src/dynamo/planner/tests/unit/load_generator.py381 # Print results summaryCOMMENT
LOWcomponents/src/dynamo/vllm/worker_factory.py2408 # Check if kv event consolidator is enabled (port was allocated in setup_vllm_engine)COMMENT
LOWcomponents/src/dynamo/vllm/worker_factory.py2705 # Check if kv event consolidator is enabled (port was allocated in setup_vllm_engine)COMMENT
LOWcomponents/src/dynamo/vllm/handlers.py3077 # Check if the LoRA exists *after* waiting for any in-progress load.COMMENT
LOWcomponents/src/dynamo/vllm/args.py702 # Check if --connector was explicitly provided via CLI or DYN_CONNECTOR env varCOMMENT
LOWcomponents/src/dynamo/vllm/main.py481 # Check if kv_cache_events are explicitly disabledCOMMENT
52 more matches not shown…
Self-Referential Comments50 hits · 149 pts
SeverityFileLineSnippetContext
MEDIUMhatch_build.py59 version_content = f'# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All righCODE
MEDIUM…rence-gateway/scripts/install_gaie_crd_agentgateway.sh50# Create an AgentgatewayParameters resource that excludes Istio sidecar injectionCOMMENT
MEDIUMtests/conftest.py1069 # Create a log directory for session-scoped serversCOMMENT
MEDIUMtests/conftest.py1092 # Create a log directory for session-scoped serversCOMMENT
MEDIUMtests/frontend/grpc/triton_echo_client.py91 # Define the callback function. Note the last two parameters should beCOMMENT
MEDIUMtests/frontend/grpc/test_tensor_mocker_engine.py174 # Define the callback function. Note the last two parameters should beCOMMENT
MEDIUM…e/hardware/fault_injection_service/api_service/main.py769 # Create the NetworkPolicyCOMMENT
MEDIUM…e/hardware/fault_injection_service/api_service/main.py966 # Create the NetworkChaos resourceCOMMENT
MEDIUMtests/fault_tolerance/deploy/scenarios.py797 # Define the yaml files for agg and disagg deploymentsCOMMENT
MEDIUMtests/fault_tolerance/deploy/scenarios.py803 # Define the different configurations to testCOMMENT
MEDIUMtests/fault_tolerance/deploy/test_deployment.py92 # Create a copy of the load config with overridden client typeCOMMENT
MEDIUMtests/lmcache/download_mmlu.py68 # Create the expected CSV format: question, A, B, C, D, answerCOMMENT
MEDIUM.devcontainer/gen_devcontainer_json.py17 # Define the frameworks to generateCOMMENT
MEDIUM.devcontainer/gen_devcontainer_json.py29 # Create the target directoryCOMMENT
MEDIUMcontainer/context.yaml4# This file represents the default ARG values of Dockerfiles generatedCOMMENT
MEDIUMcomponents/src/dynamo/planner/core/base.py763 # Creating the remote task is the admission point. PATCH usesCOMMENT
MEDIUMcomponents/src/dynamo/vllm/publisher.py17# Create a dedicated registry for dynamo_component metricsCOMMENT
MEDIUM⚡…ests/memory/test_multimodal_embedding_cache_manager.py264 # Create a non-contiguous tensor via transposeCOMMENT
MEDIUM…amo/common/tests/multimodal/test_mm_kwargs_transfer.py572 # Create a receiver with a mocked poolCOMMENT
MEDIUM⚡…ponents/src/dynamo/common/config_dump/config_dumper.py243# Create a canonical JSON encoder with consistent formattingCOMMENT
MEDIUM…nts/src/dynamo/common/multimodal/embedding_transfer.py426 # Create a queue hinting whether the sender is expecting future transferCOMMENT
MEDIUMcomponents/src/dynamo/mocker/main.py192 # Create a separate DistributedRuntime for this worker (on same event loop)COMMENT
MEDIUMcomponents/src/dynamo/mocker/main.py248 # Create the engine with this worker's isolated runtimeCOMMENT
MEDIUMcomponents/src/dynamo/sglang/args.py769 # Create a minimal ServerArgs-like object that bypasses model config loadingCOMMENT
MEDIUM…mo/sglang/tests/test_sglang_image_diffusion_handler.py146 # Create a simple test imageCOMMENT
MEDIUM…mo/sglang/tests/test_sglang_image_diffusion_handler.py187 # Create a simple test imageCOMMENT
MEDIUM…mo/sglang/tests/test_sglang_image_diffusion_handler.py344 # Create a numpy array representing an imageCOMMENT
MEDIUMcomponents/src/dynamo/profiler/utils/plot.py242 # Create the surface plot with customizationsCOMMENT
MEDIUMcomponents/src/dynamo/profiler/utils/plot.py278 # Create the throughput surface plot with customizationsCOMMENT
MEDIUMcomponents/src/dynamo/trtllm/publisher.py50# Create a dedicated registry for dynamo_component metricsCOMMENT
MEDIUM…ts/src/dynamo/trtllm/workers/image_diffusion_worker.py76 # Create the request handlerCOMMENT
MEDIUM…ts/src/dynamo/trtllm/workers/video_diffusion_worker.py75 # Create the request handlerCOMMENT
MEDIUMexamples/backends/vllm/deploy/gms-failover.yaml13# This file contains variants you can use under .spec.components:COMMENT
MEDIUMbenchmarks/prefix_data_generator/cli.py29 # Create the parser for the "analyze" commandCOMMENT
MEDIUMbenchmarks/prefix_data_generator/cli.py32 # Create the parser for the "synthesize" commandCOMMENT
MEDIUM⚡benchmarks/prefix_data_generator/tests/test_sampler.py26 # Create a test array with equal numbers of 1, 2, and 3COMMENT
MEDIUM⚡benchmarks/prefix_data_generator/tests/test_sampler.py29 # Create the samplerCOMMENT
MEDIUMbenchmarks/frontend/scripts/sweep_k8s/aiperf.py300 # Create a helper pod to access the PVCCOMMENT
MEDIUMbenchmarks/frontend/scripts/sweep_k8s/aiperf.py460 # Create the JobSTRING
MEDIUMbenchmarks/multimodal/image/aiperf_large_image.sh10# Create a JSONL file with 11 identical large image URLsCOMMENT
MEDIUM…ks/multimodal/image/aiperf_small_image_50_isl_ratio.sh12# Create a JSONL file with 30 identical small image URLsCOMMENT
MEDIUMbenchmarks/multimodal/image/aiperf_small_image.sh11# Create a JSONL file with 12 identical small image URLsCOMMENT
MEDIUM.github/codeowners/external_contributors.yaml14# This file is also the single source for CONTRIBUTORS.md. Do not hand-editCOMMENT
MEDIUM.github/workflows/detect_broken_links.py937 # Create a cleaned version of the report without resolved_path for JSON outputSTRING
MEDIUM.github/workflows/detect_broken_links.py942 # Create a copy of the link without resolved_pathSTRING
MEDIUM.github/actions/docker-remote-build/action.yml252 # Create the job metrics fileCOMMENT
MEDIUM.github/actions/docker-build/action.yml249 # Create the job metrics fileCOMMENT
MEDIUM…gpu_memory_service/integrations/sglang/model_loader.py39# This module is only imported when load_format="gms" is used.COMMENT
MEDIUMlib/bindings/python/tests/test_kv_bindings.py49 # Create a store event with parent_hash=None, block_hash=0COMMENT
MEDIUMlib/bindings/python/src/dynamo/nixl_connect/__init__.py686 # This method is a no-op for now, in the future it may be used to initialize the connection.COMMENT
Hallucination Indicators10 hits · 115 pts
SeverityFileLineSnippetContext
CRITICAL⚡deploy/power-agent/tests/test_apply_cap.py138 self.metrics.cap_clamped_total.labels.return_value.inc.assert_called_once()CODE
CRITICAL⚡deploy/power-agent/tests/test_apply_cap.py146 self.metrics.cap_clamped_total.labels.return_value.inc.assert_called_once()CODE
CRITICAL⚡deploy/power-agent/tests/test_apply_cap.py215 metrics.applied_limit_watts.labels.return_value.set.assert_called_once_with(450)CODE
CRITICALdeploy/power-agent/tests/test_actuator_protocol.py353 metrics.applied_limit_watts.labels.return_value.set.assert_called_with(410)CODE
CRITICALdeploy/power-agent/tests/test_actuator_protocol.py466 metrics.applied_limit_watts.labels.return_value.set.assert_called_with(700)CODE
CRITICALdeploy/power-agent/tests/test_dcgm_actuator.py299 handle.GetSystem.return_value.discovery.GetAllGpuIds.assert_called_once_with()CODE
CRITICALdeploy/power-agent/tests/test_dcgm_actuator.py1214 metrics.applied_limit_watts.labels.return_value.set.assert_called_with(300)CODE
CRITICALdeploy/power-agent/tests/test_dcgm_actuator.py2585 metrics.applied_limit_watts.labels.return_value.set.assert_called_with(410)CODE
CRITICALdeploy/power-agent/tests/test_dcgm_actuator.py2606 metrics.applied_limit_watts.labels.return_value.set.assert_called_with(700)CODE
CRITICALdeploy/operator/internal/cert/cert_test.go503 originalService := crd.Spec.Conversion.Webhook.ClientConfig.Service.DeepCopy()CODE
Example Usage Blocks46 hits · 70 pts
SeverityFileLineSnippetContext
LOW…lates/vllm/run_bare_multinode_elastic_ep_scale_test.sh24# Usage:COMMENT
LOW…nce/deploy/templates/vllm/run_elastic_ep_scale_test.sh16# Usage:COMMENT
LOW…/templates/vllm/run_multinode_elastic_ep_scale_test.sh28# Usage:COMMENT
LOW…emplates/sglang/run_sglang_elastic_ep_scale_up_test.sh24# Usage:COMMENT
LOWdocs/fern/scripts/hero-demo/record-hero.sh8# Usage:COMMENT
LOW…s/fern/pages/blog/_assets/flash-indexer/tools/build.sh11# Usage:COMMENT
LOWrecipes/qwen3-vl-32b-fp8/benchmark/run-benchmark.sh9# Usage:COMMENT
LOW…qwen3-vl-30b/vllm/agg-embedding-cache/run-benchmark.sh5# Usage:COMMENT
LOWrecipes/inkling/cleanup.sh7# Usage:COMMENT
LOWrecipes/qwen3.6-35b/run-all-benchmarks.sh12# Usage:COMMENT
LOWrecipes/qwen3.6-35b/run-benchmark.sh12# Usage:COMMENT
LOWexamples/custom_encoder/launch/agg_custom.sh26# Usage:COMMENT
LOWexamples/backends/vllm/launch/agg_omni_i2v.sh7# Usage:COMMENT
LOWexamples/backends/vllm/launch/multi_node_tp.sh9# Usage:COMMENT
LOWexamples/backends/vllm/launch/agg_embed_multiworker.sh19# Usage:COMMENT
LOW…kends/vllm/launch/lora/multimodal/validate_lora_agg.sh13# Usage:COMMENT
LOW⚡…mples/backends/vllm/launch/lora/multimodal/lora_agg.sh11# Usage:COMMENT
LOW…ckends/vllm/launch/lora/omni/validate_omni_lora_agg.sh13# Usage:COMMENT
LOWexamples/common/gpu_utils.sh7# Usage:COMMENT
LOWexamples/common/gpu_utils.sh22# Usage:COMMENT
LOWexamples/common/gpu_utils.sh88# Usage:COMMENT
LOWexamples/common/launch_utils.sh19# Usage:COMMENT
LOW⚡examples/common/launch_utils.sh127# Usage:COMMENT
LOWexamples/common/launch_utils.sh342# Usage:COMMENT
LOWexamples/global_planner/global-planner-gpu-budget.yaml27# Usage:COMMENT
LOWexamples/global_planner/global-planner-vllm-test.yaml19# Usage:COMMENT
LOWexamples/global_planner/global-planner-mocker-test.yaml15# Usage:COMMENT
LOW…s/global_planner/global-planner-vllm-test-xpu-dra.yaml21# Usage:COMMENT
LOWbenchmarks/frontend/dgd/templates/mocker.yaml19# Usage:COMMENT
LOWbenchmarks/frontend/dgd/templates/vllm-gpt-oss-20b.yaml32# Usage:COMMENT
LOWbenchmarks/frontend/dgd/templates/vllm.yaml17# Usage:COMMENT
LOWbenchmarks/frontend/scripts/run_perf.sh9# Usage:COMMENT
LOWbenchmarks/frontend/scripts/nsight/nsys_profile.sh13# Usage:COMMENT
LOW…marks/frontend/scripts/flamegraph/offcpu_flamegraph.sh8# Usage:COMMENT
LOW…chmarks/frontend/scripts/flamegraph/diff_flamegraph.sh8# Usage:COMMENT
LOW…nchmarks/frontend/scripts/flamegraph/cpu_flamegraph.sh8# Usage:COMMENT
LOWbenchmarks/frontend/scripts/bpf/setup.sh10# Usage:COMMENT
LOWbenchmarks/frontend/scripts/bpf/run.sh7# Usage:COMMENT
LOW…modal/sweep/experiments/embedding_cache/trtllm_e_pd.sh9# Usage:COMMENT
LOW…odal/sweep/experiments/embedding_cache/vllm_serve.yaml6# Usage:COMMENT
LOW…dal/sweep/experiments/embedding_cache/trtllm_e_pd.yaml6# Usage:COMMENT
LOW…modal/sweep/experiments/embedding_cache/vllm_e_pd.yaml6# Usage:COMMENT
LOW…dal/sweep/experiments/embedding_cache/sglang_e_pd.yaml6# Usage:COMMENT
LOWbenchmarks/omni/image/aiperf_image_gen.sh8# Usage:COMMENT
LOWlib/llm/tests/kv_manager.rs249// // Example usage:COMMENT
LOWdev/docker-observability.yml7# Usage:COMMENT
AI Structural Patterns57 hits · 44 pts
SeverityFileLineSnippetContext
LOWtests/frontend/test_completion_mocker_engine.py51CODE
LOWtests/frontend/test_vllm.py162CODE
LOWtests/utils/managed_process.py938CODE
LOWtests/utils/payloads.py457CODE
LOWtests/utils/payload_builder.py63CODE
LOWtests/utils/payload_builder.py105CODE
LOWtests/utils/payload_builder.py299CODE
LOWtests/utils/payload_builder.py425CODE
LOWtests/fault_tolerance/deploy/scenarios.py985CODE
LOWtests/fault_tolerance/deploy/scenarios.py1026CODE
LOWtests/fault_tolerance/migration/utils.py519CODE
LOWtests/router/test_router_e2e_with_sglang.py75CODE
LOWtests/router/router_process.py44CODE
LOWtests/router/test_router_e2e_with_trtllm.py71CODE
LOWtests/router/test_router_e2e_with_vllm.py117CODE
LOWtests/router/common.py2033CODE
LOWtests/router/common.py2882CODE
LOWtests/router/helper.py754CODE
LOWtests/router/mocker_process.py78CODE
LOWtests/router/mocker_process.py495CODE
LOWdocs/fern/scripts/convert_callouts.py124CODE
LOWcomponents/src/dynamo/frontend/sglang_prepost.py1170CODE
LOWcomponents/src/dynamo/frontend/prepost.py522CODE
LOWcomponents/src/dynamo/frontend/prepost.py685CODE
LOWcomponents/src/dynamo/frontend/sglang_processor.py321CODE
LOWcomponents/src/dynamo/frontend/sglang_processor.py530CODE
LOW…rc/dynamo/planner/connectors/clients/kubernetes_api.py860CODE
LOW…nts/src/dynamo/planner/tests/unit/test_batch_policy.py77CODE
LOW…c/dynamo/planner/tests/unit/test_load_based_scaling.py50CODE
LOWcomponents/src/dynamo/vllm/handlers.py1249CODE
LOWcomponents/src/dynamo/vllm/handlers.py3440CODE
LOWcomponents/src/dynamo/vllm/handlers.py3660CODE
LOWcomponents/src/dynamo/vllm/handlers.py4251CODE
LOW…/src/dynamo/vllm/multimodal_utils/request_processor.py306CODE
LOWcomponents/src/dynamo/common/utils/prometheus.py224CODE
LOWcomponents/src/dynamo/mocker/__init__.py36CODE
LOWcomponents/src/dynamo/sglang/engine_generate.py39CODE
LOWcomponents/src/dynamo/sglang/tests/test_sglang_unit.py962CODE
LOW…ents/src/dynamo/profiler/tests/test_replay_optimize.py278CODE
LOW…ents/src/dynamo/profiler/tests/test_replay_optimize.py311CODE
LOWcomponents/src/dynamo/profiler/utils/aiperf.py75CODE
LOW…src/dynamo/profiler/utils/config_modifiers/protocol.py135CODE
LOW…src/dynamo/profiler/utils/config_modifiers/protocol.py461CODE
LOWcomponents/src/dynamo/replay/api.py233CODE
LOWcomponents/src/dynamo/replay/api.py442CODE
LOWcomponents/src/dynamo/trtllm/publisher.py1325CODE
LOWcomponents/src/dynamo/trtllm/publisher.py514CODE
LOW…mponents/src/dynamo/trtllm/engines/diffusion_engine.py158CODE
LOWbenchmarks/frontend/scripts/sweep_k8s/aiperf.py382CODE
LOWlib/gpu_memory_service/snapshot/storage_client.py38CODE
LOWgyms/planner-gym/tests/test_html_report.py48CODE
LOWgyms/planner-gym/tests/test_html_report.py87CODE
LOWgyms/planner-gym/src/autoscaling_arena/saved_report.py147CODE
LOWgyms/planner-gym/src/autoscaling_arena/adapters/jev.py77CODE
LOW…planner-gym/src/autoscaling_arena/adapters/reactive.py58CODE
LOWgyms/planner-gym/src/autoscaling_arena/adapters/keda.py178CODE
LOWgyms/planner-gym/src/autoscaling_arena/runners/sims.py1325CODE
Synthetic Comment Markers3 hits · 20 pts
SeverityFileLineSnippetContext
HIGH…pages/recipes/feature-benchmarks/benchmarking-guide.md303└── plots/ # Generated by aiperf plotCODE
HIGHlib/llm/src/kv_router/publisher/tests.rs2207 #[ignore] // Mark as ignored as requested, because CI's integrations still don't have NATSCOMMENT
HIGHlib/llm/src/kv_router/publisher/tests.rs2207 #[ignore] // Mark as ignored as requested, because CI's integrations still don't have NATSCOMMENT
Dead Code9 hits · 17 pts
SeverityFileLineSnippetContext
MEDIUMtests/frontend/http_status_propagation_worker.py51CODE
MEDIUMtests/frontend/http_status_propagation_worker.py64CODE
MEDIUM…ponents/src/dynamo/vllm/tests/test_vllm_legacy_lora.py653CODE
MEDIUM…s/src/dynamo/vllm/tests/omni/test_omni_stage_worker.py71CODE
MEDIUMcomponents/src/dynamo/vllm/omni/base_handler.py229CODE
MEDIUM…amo/trtllm/request_handlers/base_generative_handler.py46CODE
MEDIUM…ts/src/dynamo/trtllm/tests/test_trtllm_handler_base.py1114CODE
MEDIUMcomponents/src/dynamo/trtllm/tests/test_push_egress.py170CODE
MEDIUM…/bindings/python/tests/test_kv_router_stream_errors.py30CODE
Fake / Example Data14 hits · 16 pts
SeverityFileLineSnippetContext
LOWdeploy/operator/internal/webhook/common_test.go144 username: "admin@example.com",CODE
LOW…/tests/multimodal_utils/test_vllm_request_processor.py1086 decode_mm_data = {"image": {"placeholder": object()}}CODE
LOW…/tests/multimodal_utils/test_vllm_request_processor.py1119 image = {"placeholder": object()}CODE
LOW⚡.github/codeowners/test_codeowners.py1796 "name": "Jane Doe",CODE
LOW⚡.github/codeowners/test_codeowners.py1804 assert "Jane Doe" in mdCODE
LOWlib/bench/multiturn_bench.rs51 /// Approximate user-prompt token count per turn (lorem ipsum)COMMENT
LOWlib/bench/multiturn_bench.rs137// Lorem ipsum generatorCOMMENT
LOW⚡lib/llm/tests/tokenizers.rs35 ("Tell me about the following text.", "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempoCODE
LOW⚡lib/llm/tests/tokenizers.rs35 ("Tell me about the following text.", "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempoCODE
LOW⚡lib/llm/tests/tokenizers.rs38 ("Tell me about the following text.", "Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur,CODE
LOW⚡lib/llm/tests/tokenizers.rs38 ("Tell me about the following text.", "Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur,CODE
LOW…sts/data/replays/deepseek-r1-distill-llama-8b/notes.md10 "messages": [{"role": "user", "content": "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod teCODE
LOW…sts/data/replays/deepseek-r1-distill-llama-8b/notes.md10 "messages": [{"role": "user", "content": "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod teCODE
LOW…rc/protocols/openai/chat_completions/unified_parser.rs11007 let input = r#"{"to":"user@example.com","subject":"Hello","body":"Hi"}<|tool_call_end|>"#;CODE
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHexamples/global_planner/global-planner-gpu-budget.yaml12# --managed-namespaces), not to every DGD in the cluster. In this example theCOMMENT
Slop Phrases2 hits · 4 pts
SeverityFileLineSnippetContext
MEDIUMexamples/backends/vllm/deploy/gms-failover.yaml13# This file contains variants you can use under .spec.components:COMMENT
LOWlib/llm/tests/parallel_tool_call_integration.rs105 r#"<think>Okay, the user is asking two things: the weather in Dallas, Texas, and whether today is a holiday. I need CODE
Overly Generic Function Names2 hits · 2 pts
SeverityFileLineSnippetContext
LOWlib/gpu_memory_service/v1/server/rpc.py338 def handle_request(CODE
LOWlib/gpu_memory_service/server/gms.py252 async def handle_request(CODE
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOWlib/kvbm-engine/src/worker/coordinated.rs392 // TODO: Add tests with mock Worker implementationCOMMENT