Repository Analysis

rohitg00/ai-engineering-from-scratch

Learn it. Build it. Ship it for others.

16.5 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of rohitg00/ai-engineering-from-scratch, a Python project with 50,598 GitHub stars. SynthScan v2.0 examined 485,274 lines of code across 2641 source files, recording 4978 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 16.5 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

16.5
Adjusted Score
16.5
Raw Score
100%
Time Factor
2026-08-23
Last Push
50.6K
Stars
Python
Language
485.3K
Lines of Code
2.6K
Files
5.0K
Pattern Hits
2026-08-29
Scan Date
0.02
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 5HIGH 38MEDIUM 849LOW 4086

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 4978 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators717 hits · 2208 pts
SeverityFileLineSnippetContext
MEDIUMscripts/translate_lessons.py165# ── NLLB-200: free, key-less, runs in the CI runner ──────────────────────────COMMENT
MEDIUMsite/figures-capstone-g.js44 // ── 24: plan-execute-replan — a failed step hands the cursor back ──────────COMMENT
MEDIUMsite/figures-capstone-g.js135 // ── 26: sandbox path jail — traversal bounces off the root fence ───────────COMMENT
MEDIUMsite/figures-capstone-g.js185 // ── 29: end-to-end harness — one run token weaving through four strata ─────COMMENT
MEDIUMsite/figures-capstone-g.js220 // ── 41: eval pipeline — four gauges fold into one report ───────────────────COMMENT
MEDIUMsite/figures-capstone-g.js264 // ── 48: DDP collectives — gradients meet in the middle, mean returns ───────COMMENT
MEDIUMsite/figures-capstone-g.js400 // ── 52: experiment runner — two meters on the child, one kill path ─────────COMMENT
MEDIUMsite/figures-capstone-g.js454 // ── 53: result evaluator — per-seed differences carry the verdict ──────────COMMENT
MEDIUMsite/figures-infra4.js58 // ── i4-platform-lanes: PTU reserved lane vs shared on-demand lane ──────────COMMENT
MEDIUMsite/figures-infra4.js97 // ── i4-otel-glue: gateway spans fan out through OTel to two backends ───────COMMENT
MEDIUMsite/figures-infra4.js146 // ── i4-canary-ramp: shadow mirror first, then gated traffic steps ──────────COMMENT
MEDIUMsite/figures-infra4.js194 // ── i4-incident-agents: supervisor fans out to agents, human gate acts ─────COMMENT
MEDIUMsite/figures-nlp3.js32 // ── pos-tagger: grammatical tags drop onto tokens one by one ────────────────COMMENT
MEDIUMsite/figures-nlp3.js56 // ── dependency-arcs: labeled head→dependent arcs draw themselves ────────────COMMENT
MEDIUMsite/figures-nlp3.js80 // ── qa-span: an answer span sweeps and highlights inside a passage ──────────COMMENT
MEDIUMsite/figures-nlp3.js103 // ── summarize-collapse: a long bar collapses into a short summary bar ────────COMMENT
MEDIUMsite/figures-nlp3.js129 // ── topic-drift: scattered words drift into colored topic clusters ──────────COMMENT
MEDIUMsite/figures-nlp3.js153 // ── coref-links: pronoun mentions animate links back to one entity ──────────COMMENT
MEDIUMsite/figures-nlp3.js176 // ── nli-router: a premise/hypothesis pair routes to one of three labels ─────COMMENT
MEDIUMsite/figures-nlp3.js233 // ── constrained-decoder: invalid tokens get masked to -inf each step ────────COMMENT
MEDIUMsite/figures-systems3.js38 // ── masked-diffusion-unmask (Show-o): masked grid fills in over steps ──────COMMENT
MEDIUMsite/figures-systems3.js72 // ── any-to-any-stream (MIO): four modality tokens merge into one stream ─────COMMENT
MEDIUMsite/figures-systems3.js112 // ── video-diffusion-denoise (Sora-style): noisy frame strip sharpens ───────COMMENT
MEDIUMsite/figures-systems3.js182 // ── agentic-rag-loop: retrieve → reason → act cycle ────────────────────────COMMENT
MEDIUMsite/figures-systems3.js222 // ── mcp-nxm-collapse: N hosts × M servers → one protocol hub ───────────────COMMENT
MEDIUMsite/figures-agents3.js29 // ── htn-tree-expand: a task tree decomposing node by node ──────────────────COMMENT
MEDIUMsite/figures-agents3.js68 // ── workflow-chain: prompt chaining links lighting up in sequence ──────────COMMENT
MEDIUMsite/figures-agents3.js97 // ── actor-mailbox: messages flying into actor inboxes, async ───────────────COMMENT
MEDIUMsite/figures-agents3.js162 // ── computer-use-cursor: a cursor gliding across a mock UI ─────────────────COMMENT
MEDIUMsite/figures-agents3.js186 // ── voice-pipeline: a waveform morphing into a text token ──────────────────COMMENT
MEDIUMsite/figures-agents3.js221 // ── injection-hijack: a malicious token glowing red, hijacking flow ────────COMMENT
MEDIUMsite/figures-agents3.js256 // ── failure-cascade: an error tumbling down a chain of agents ──────────────COMMENT
MEDIUMsite/figures-capstone-c.js79 // ── 34: transformer block — two residual bypasses skip the sublayers ────────COMMENT
MEDIUMsite/figures-capstone-c.js173 // ── 37: weight remapping — pretrained names rewired into local names ────────COMMENT
MEDIUMsite/figures-foundations2.js24 // ── data-augmentation: one source image, four transformed copies ───────────COMMENT
MEDIUMsite/figures-foundations2.js87 // ── transfer-learning: freeze a pretrained backbone, train the head ────────COMMENT
MEDIUMsite/figures-foundations2.js121 // ── batchnorm-inference: batch stats in training vs running averages ───────COMMENT
MEDIUMsite/figures-foundations2.js160 // ── ctc-collapse: per-frame chars collapse to a transcript ─────────────────COMMENT
MEDIUMsite/figures-foundations2.js205 // ── mfcc-pipeline: spectrogram → mel → log → DCT → keep N coeffs ────────────COMMENT
MEDIUMsite/figures-foundations2.js244 // ── autoencoder-bottleneck: reconstruction quality vs latent dim ───────────COMMENT
MEDIUMsite/figures-foundations2.js297 // ── normalizing-flow: invertible map, base → target, log-det Jacobian ──────COMMENT
MEDIUMsite/figures-foundations2.js342 // ── score-matching: score vector field and Langevin sampling steps ─────────COMMENT
MEDIUMsite/figures-setup.js69 // ── s0-env-stack: the four-layer dev stack assembles bottom-up ────────────COMMENT
MEDIUMsite/figures-setup.js95 // ── s0-commit-dag: a commit DAG grows, a branch merges back to main ───────COMMENT
MEDIUMsite/figures-setup.js125 // ── s0-gpu-dispatch: the same matmul batch on CPU vs GPU lanes ────────────COMMENT
MEDIUMsite/figures-setup.js168 // ── s0-secret-inject: the key flows from .env into the request header ─────COMMENT
MEDIUMsite/figures-setup.js422 // ── s0-process-fork: the process tree forks down to your training run ─────COMMENT
MEDIUMsite/figures-setup.js468 // ── s0-flame-hot: the profile widens on the real bottleneck ───────────────COMMENT
MEDIUMsite/figures-frontier.js159 // ── world-model-rollout: imagine future states with a learned model ────────COMMENT
MEDIUMsite/figures-frontier.js243 // ── pass-at-k: pass@k = 1 - (1-p)^k rises toward 1 as k grows ───────────────COMMENT
MEDIUMsite/figures-frontier.js279 // ── eval-harness-matrix: tasks x variants grid, aggregate per variant ──────COMMENT
MEDIUMsite/figures-frontier.js332 // ── canary-rollout: traffic split, error rate, rollback trigger ────────────COMMENT
MEDIUMsite/figures-alignment4.js87 // ── bias: identical resumes, one scorer, unequal scores ─────────────────────COMMENT
MEDIUMsite/figures-alignment4.js133 // ── fairness: three criteria, unequal base rates, pick two ──────────────────COMMENT
MEDIUMsite/figures-alignment4.js163 // ── differential privacy: clip each gradient, then add calibrated noise ─────COMMENT
MEDIUMsite/figures-alignment4.js212 // ── watermarking: green-list bias at sampling, z-score at detection ─────────COMMENT
MEDIUMsite/figures-alignment4.js250 // ── EU AI Act: obligations arrive in dated waves ────────────────────────────COMMENT
MEDIUMsite/figures-alignment4.js281 // ── EchoLeak: zero-click packet crosses the org trust boundary ──────────────COMMENT
MEDIUMsite/figures-alignment4.js316 // ── cards: dataset, model, and system scopes telescope outward ──────────────COMMENT
MEDIUMsite/figures-alignment4.js381 // ── moderation: input, model, output layers each get a turn ─────────────────COMMENT
657 more matches not shown…
Hyper-Verbose Identifiers1812 hits · 2171 pts
SeverityFileLineSnippetContext
LOWscripts/test_translate_workflow.py101 def test_trigger_and_manual_scope_remain_phase_only(self) -> None:CODE
LOWscripts/test_translate_workflow.py110 def test_manual_phase_rejects_traversal_that_resolves_to_a_directory(self) -> None:CODE
LOWscripts/test_translate_workflow.py141 def test_publisher_uses_retryable_detached_worktree(self) -> None:CODE
LOWscripts/test_translate_workflow.py153 def test_rejected_bootstrap_push_retries_and_cleans_registration(self) -> None:CODE
LOWscripts/test_translate_workflow.py204 def test_commit_failure_never_reports_publish_success(self) -> None:CODE
LOWscripts/install_skills.py300def validate_output_directory(output_dir: Path) -> None:CODE
LOWscripts/install_skills.py480def _ensure_safe_destination_parent(target_root: Path, parent: Path) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py49 def test_phase_and_lesson_are_derived_after_the_phases_segment(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py56 def test_installer_discovers_one_bundle_from_its_skill_entrypoint(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py94 def test_bundle_file_lists_share_sorted_posix_order(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py119 def test_installer_copies_the_complete_bundle_to_one_skill_directory(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py160 def test_failed_forced_bundle_swap_restores_the_previous_directory(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py205 def test_flat_skill_keeps_all_existing_layouts_and_skill_conversion(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py244 def test_bundle_targets_resolve_for_every_layout(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py274 def test_duplicate_flat_and_bundle_names_choose_the_flat_artifact_once(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py317 def test_installer_rejects_bundle_symlinks_before_writing_any_artifact(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py344 def test_installer_rejects_bundle_file_symlink_swap_at_open_boundary(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py394 def test_installer_rejects_flat_file_symlink_swap_at_open_boundary(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py435 def test_forced_flat_install_replaces_destination_symlink_not_its_target(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py464 def test_installer_rejects_symlinked_layout_parent(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py498 def test_installer_rejects_a_bundle_reached_through_an_escaping_parent_symlink(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py525 def test_installer_rejects_a_flat_only_escaping_outputs_parent(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py552 def test_installer_rejects_an_in_repository_outputs_directory_symlink(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py580 def test_installer_rejects_a_direct_flat_artifact_symlink(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py604 def test_dry_run_rejects_unsafe_bundle_before_previewing_it(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py633 def test_discovery_rejects_symlinked_bundle_before_reading_skill_file(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py658 def test_discovery_ignores_unrecognized_symlinked_file_entries(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py680 def test_cli_reports_an_unsafe_bundle_without_a_traceback(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py708 def test_cli_rejects_an_artifact_name_that_escapes_the_target(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py730 def test_catalog_surfaces_bundle_metadata_files_and_skill_entrypoint_once(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py797 def test_catalog_rejects_a_bundle_that_resolves_outside_the_repository(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py818 def test_catalog_rejects_a_flat_only_escaping_outputs_parent(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py843 def test_catalog_rejects_an_in_repository_outputs_directory_symlink(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py869 def test_catalog_rejects_a_direct_flat_artifact_symlink(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py891 def test_manifest_describes_the_single_artifact_that_was_installed(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py927 def test_manifest_includes_bundle_entrypoint_root_and_files(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py967 def test_manifest_uses_cached_bundle_files_after_install(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py1006 def test_manifest_atomically_replaces_symlink_without_touching_target(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py1022 def test_manifest_rejects_symlinked_target_directory(self) -> None:CODE
LOWscripts/test_skill_artifact_bundles.py1042 def test_mcp_tutor_migrates_legacy_state_and_skill_mirrors_match(self) -> None:CODE
LOWscripts/audit_certifications.py161def check_fenced_code_languages(audit: Audit, path: Path, text: str) -> None:CODE
LOWscripts/audit_certifications.py414def check_assessment_question(CODE
LOWscripts/audit_certifications.py738def check_ai_native_learning_surface(audit: Audit, actual_lessons: set[str]) -> None:CODE
LOWscripts/_lib.py25def _resolve_within_repository(CODE
LOWscripts/_lib.py41def validate_repository_directory(CODE
LOWsite/lesson.html2772 function learningPathPrerequisiteLabel(path) {CODE
LOWsite/lesson.html2778 function unmetLearningPathPrerequisites(entry) {CODE
LOWsite/lesson.html2787 function learningPathPrerequisiteChecks(entry) {CODE
LOWsite/lesson.html2893 function linkUnmetLearningPathCheckIds(link) {CODE
LOWsite/lesson.html2901 function linkUnmetLearningPathPrerequisitePaths(link) {CODE
LOWsite/lesson.html2909 function linkHasUnmetLearningPathPrerequisite(link) {CODE
LOWsite/lesson.html2915 function syncLearningPathGateLinks() {CODE
LOWsite/lesson.html2927 function findLearningPathConfirmButton(checkId) {CODE
LOWsite/lesson.html2935 function findLearningPathPrerequisiteCallout(paths) {CODE
LOWsite/lesson.html2945 function ensureLearningPathPrerequisiteCallout(link) {CODE
LOWsite/lesson.html2701 function certificationTrackContains(track, path) {CODE
LOWsite/lesson.html2715 function certificationContextTrack() {CODE
LOWsite/lesson.html2798 function learningPathPrerequisitePaths(entry) {CODE
LOWsite/lesson.html2813 function learningPathGateAttributes(entry) {CODE
LOWsite/lesson.html2825 function learningPathPreflightDefinitions() {CODE
1752 more matches not shown…
Structural Annotation Overuse1239 hits · 1961 pts
SeverityFileLineSnippetContext
LOW.claude/skills/start-learning/SKILL.md105## Step 1: The interview (3 questions, keep it short)COMMENT
LOW.claude/skills/start-learning/SKILL.md119## Step 2: PlacementCOMMENT
LOW.claude/skills/start-learning/SKILL.md137## Step 3: Write LEARNING.mdCOMMENT
LOW.claude/skills/start-learning/SKILL.md171## Step 4: Hand offCOMMENT
LOW.claude/skills/check-understanding/SKILL.md54### Step 1: Resolve the PhaseCOMMENT
LOW.claude/skills/check-understanding/SKILL.md58### Step 2: Read the Phase ContentCOMMENT
LOW.claude/skills/check-understanding/SKILL.md64### Step 3: Generate 8 QuestionsCOMMENT
LOW.claude/skills/check-understanding/SKILL.md86### Step 4: Present Questions One at a TimeCOMMENT
LOW.claude/skills/check-understanding/SKILL.md103### Step 5: Track and ScoreCOMMENT
LOW.claude/skills/check-understanding/SKILL.md109### Step 6: Show ResultsCOMMENT
LOW.claude/skills/check-understanding/SKILL.md129### Step 7: Wrong Answer BreakdownCOMMENT
LOW.claude/skills/check-understanding/SKILL.md141### Step 8: What Next?COMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md234### Step 1: Normalize TokensCOMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md240### Step 2: Chunk With Stable IdentityCOMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md246### Step 3: Exclude Inactive Sources Before IndexingCOMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md252### Step 4: Score TransparentlyCOMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md258### Step 5: Return ProvenanceCOMMENT
LOW…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md264### Step 6: Evaluate the RetrieverCOMMENT
LOW…ons/04-context-knowledge-memory-and-caching/docs/en.md148### Step 1: Inventory the contextCOMMENT
LOW…ons/04-context-knowledge-memory-and-caching/docs/en.md164### Step 2: Create a source registryCOMMENT
LOW…ons/04-context-knowledge-memory-and-caching/docs/en.md182### Step 3: Design retrieval with abstentionCOMMENT
LOW…ons/04-context-knowledge-memory-and-caching/docs/en.md195### Step 4: Budget the promptCOMMENT
LOW…ons/04-context-knowledge-memory-and-caching/docs/en.md207### Step 5: Establish maintenanceCOMMENT
LOW…s/32-architect-professional-system-capstone/docs/en.md225### Step 1: Encode RequirementsCOMMENT
LOW…s/32-architect-professional-system-capstone/docs/en.md230### Step 2: Encode DecisionsCOMMENT
LOW…s/32-architect-professional-system-capstone/docs/en.md236### Step 3: Encode ControlsCOMMENT
LOW…s/32-architect-professional-system-capstone/docs/en.md242### Step 4: Evaluate GatesCOMMENT
LOW…s/32-architect-professional-system-capstone/docs/en.md248### Step 5: Make the Release DecisionCOMMENT
LOW…6-production-observability-latency-and-cost/docs/en.md243### Step 1: Represent One Task TrajectoryCOMMENT
LOW…6-production-observability-latency-and-cost/docs/en.md250### Step 2: Aggregate Without Hiding FailureCOMMENT
LOW…6-production-observability-latency-and-cost/docs/en.md256### Step 3: Compare VariantsCOMMENT
LOW…6-production-observability-latency-and-cost/docs/en.md261### Step 4: Evaluate Service ObjectivesCOMMENT
LOW…lessons/05-output-evaluation-and-validation/docs/en.md191### Step 1: Define release gatesCOMMENT
LOW…lessons/05-output-evaluation-and-validation/docs/en.md203### Step 2: Build a validation recordCOMMENT
LOW…lessons/05-output-evaluation-and-validation/docs/en.md239### Step 3: Separate generation and reviewCOMMENT
LOW…lessons/05-output-evaluation-and-validation/docs/en.md253### Step 4: Calibrate gradersCOMMENT
LOW…lessons/05-output-evaluation-and-validation/docs/en.md259### Step 5: Close the loopCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md153### Step 1: Choose one primary lensCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md170### Step 2: Complete the architecture packetCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md183### Step 3: Encode the packet as JSONCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md212### Step 4: Run failure-first testsCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md232### Step 5: Transfer across all six lensesCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md258### Step 6: Defend tradeoffsCOMMENT
LOW…/31-architect-foundations-scenario-capstone/docs/en.md268### Step 7: Conduct independent reviewCOMMENT
LOW…lessons/03-prompting-and-task-decomposition/docs/en.md147### Step 1: Write the acceptance cardCOMMENT
LOW…lessons/03-prompting-and-task-decomposition/docs/en.md164### Step 2: Create a source hierarchyCOMMENT
LOW…lessons/03-prompting-and-task-decomposition/docs/en.md179### Step 3: Design the stagesCOMMENT
LOW…lessons/03-prompting-and-task-decomposition/docs/en.md193### Step 4: Add uncertainty behaviorCOMMENT
LOW…lessons/03-prompting-and-task-decomposition/docs/en.md205### Step 5: Test adversarial casesCOMMENT
LOW…ns/06-governance-safety-and-responsible-use/docs/en.md192### Step 1: Write a use-case cardCOMMENT
LOW…ns/06-governance-safety-and-responsible-use/docs/en.md209### Step 2: Create a control mapCOMMENT
LOW…ns/06-governance-safety-and-responsible-use/docs/en.md222### Step 3: Design the approval packetCOMMENT
LOW…ns/06-governance-safety-and-responsible-use/docs/en.md236### Step 4: Run a threat workshopCOMMENT
LOW…ssons/07-workflow-design-and-human-handoffs/docs/en.md197### Step 1: Map one real caseCOMMENT
LOW…ssons/07-workflow-design-and-human-handoffs/docs/en.md210### Step 2: Score candidate interventionsCOMMENT
LOW…ssons/07-workflow-design-and-human-handoffs/docs/en.md224### Step 3: Write the future-state contractCOMMENT
LOW…ssons/07-workflow-design-and-human-handoffs/docs/en.md228### Step 4: Build the handoff packetCOMMENT
LOW…ssons/07-workflow-design-and-human-handoffs/docs/en.md247### Step 5: Pilot in shadow modeCOMMENT
LOW…end-to-end-architecture-and-value-tradeoffs/docs/en.md275### Step 1: Draw Three CandidatesCOMMENT
LOW…end-to-end-architecture-and-value-tradeoffs/docs/en.md280### Step 2: Score Explicit TradeoffsCOMMENT
1179 more matches not shown…
Unused Imports676 hits · 664 pts
SeverityFileLineSnippetContext
LOWscripts/link_check.py29CODE
LOWscripts/build_catalog.py50CODE
LOWscripts/test_translate_workflow.py4CODE
LOWscripts/scaffold_workbench.py26CODE
LOWscripts/check_readme_counts.py28CODE
LOWscripts/audit_lessons.py12CODE
LOWscripts/install_skills.py27CODE
LOWscripts/test_skill_artifact_bundles.py4CODE
LOWscripts/lesson_run.py30CODE
LOWscripts/audit_certifications.py9CODE
LOWscripts/backfill_certification_references.py9CODE
LOWscripts/_lib.py11CODE
LOWscripts/debias_certification_questions.py14CODE
LOW…-business-discovery-requirements-and-slas/code/main.py3CODE
LOW…ssons/24-rag-retrieval-and-data-pipelines/code/main.py8CODE
LOW…s/04-context-knowledge-memory-and-caching/code/main.py7CODE
LOW…ons/01-claude-product-and-model-landscape/code/main.py7CODE
LOW…-agent-sdk-sessions-subagents-and-context/code/main.py3CODE
LOW…evals-testing-debugging-and-observability/code/main.py7CODE
LOW…32-architect-professional-system-capstone/code/main.py8CODE
LOW…/claude/lessons/00-certification-strategy/code/main.py7CODE
LOW…production-observability-latency-and-cost/code/main.py8CODE
LOW…ssons/05-output-evaluation-and-validation/code/main.py7CODE
LOW…de/lessons/29-associate-workflow-capstone/code/main.py8CODE
LOW…29-associate-workflow-capstone/code/tests/test_main.py3CODE
LOW…1-architect-foundations-scenario-capstone/code/main.py8CODE
LOW…-foundations-scenario-capstone/code/tests/test_main.py3CODE
LOW…lessons/30-developer-application-capstone/code/main.py7CODE
LOW…0-reliable-extraction-batch-and-reviewers/code/main.py3CODE
LOW…ssons/03-prompting-and-task-decomposition/code/main.py7CODE
LOW…ude/lessons/10-tool-use-and-agentic-loops/code/main.py7CODE
LOW…/06-governance-safety-and-responsible-use/code/main.py7CODE
LOW…ons/07-workflow-design-and-human-handoffs/code/main.py7CODE
LOW…sons/11-mcp-server-design-and-integration/code/main.py7CODE
LOW…ude/lessons/12-claude-agent-sdk-and-hooks/code/main.py7CODE
LOW…d-to-end-architecture-and-value-tradeoffs/code/main.py3CODE
LOW…sons/15-claude-code-for-development-teams/code/main.py3CODE
LOW…ssons/13-application-security-and-secrets/code/main.py7CODE
LOW…enterprise-governance-compliance-and-hitl/code/main.py3CODE
LOW…08-messages-api-and-application-lifecycle/code/main.py7CODE
LOW…9-structured-output-and-defensive-parsing/code/main.py7CODE
LOW…19-claude-code-memory-rules-skills-and-ci/code/main.py3CODE
LOW…/outputs/migration-review-skill/scripts/check_scope.py3CODE
LOW…ns/02-model-selection-and-token-economics/code/main.py8CODE
LOW…ontracts-errors-and-progressive-discovery/code/main.py3CODE
LOW…keholder-communication-adrs-and-lifecycle/code/main.py3CODE
LOW…-multi-agent-orchestration-and-delegation/code/main.py3CODE
LOW…on-protocols-identity-and-least-privilege/code/main.py8CODE
LOW…ext-reliability-provenance-and-escalation/code/main.py3CODE
LOW…peech-and-audio/04-speech-recognition-asr/code/main.py9CODE
LOW…speech-and-audio/10-audio-language-models/code/main.py10CODE
LOW…-audio/05-whisper-architecture-finetuning/code/main.py9CODE
LOW…ses/06-speech-and-audio/07-text-to-speech/code/main.py10CODE
LOW…llm-engineering/14-model-context-protocol/code/main.py9CODE
LOW…ases/11-llm-engineering/15-prompt-caching/code/main.py14CODE
LOW…ases/11-llm-engineering/15-prompt-caching/code/main.py16CODE
LOW…m-engineering/16-langgraph-state-machines/code/main.py23CODE
LOW…1-llm-engineering/10-evaluation/code/eval_framework.py1CODE
LOW…1-llm-engineering/10-evaluation/code/eval_framework.py6CODE
LOW…-engineering/17-agent-framework-tradeoffs/code/main.py12CODE
616 more matches not shown…
Modern AI Meta-Vocabulary123 hits · 339 pts
SeverityFileLineSnippetContext
MEDIUMsite/figures-systems3.js182 // ── agentic-rag-loop: retrieve → reason → act cycle ────────────────────────COMMENT
MEDIUMsite/figures-autoswarm5.js61 // ── a5-scaffold-delta: one model feeds two scaffolds; the score bars landCOMMENT
MEDIUMsite/data.js2119 "url": "https://github.com/rohitg00/ai-engineering-from-scratch/tree/main/phases/11-llm-engineering/12-guardrailCODE
MEDIUMsite/data.js2926 "url": "https://github.com/rohitg00/ai-engineering-from-scratch/tree/main/phases/14-agent-engineering/26-failureCODE
MEDIUMglossary/myths.md69## "Bigger context window = better"COMMENT
MEDIUMglossary/terms.md1544### RAG (Retrieval-Augmented Generation)COMMENT
MEDIUM…rtifications/claude/assessments/ccdv-f/diagnostic.json317 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json488 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json865 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json931 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json975 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json997 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccdv-f/mock-01.json1018 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUM…rtifications/claude/assessments/ccao-f/diagnostic.json70 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-hallucinations"CODE
MEDIUMcertifications/claude/assessments/ccao-f/mock-01.json177 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-hallucinations"CODE
MEDIUMcertifications/claude/assessments/ccao-f/mock-01.json241 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-hallucinations"CODE
MEDIUMcertifications/claude/assessments/ccao-f/mock-01.json1051 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-prompt-leak"CODE
MEDIUMcertifications/claude/assessments/ccar-p/mock-01.json961 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUMcertifications/claude/assessments/ccar-p/mock-01.json1124 "https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/mitigate-jailbreaks",CODE
MEDIUM…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md1# RAG, Retrieval, and Data PipelinesCOMMENT
MEDIUM…lessons/24-rag-retrieval-and-data-pipelines/docs/en.md34### RAG Is a Data SystemCOMMENT
MEDIUM…4-evals-testing-debugging-and-observability/docs/en.md331- [Create strong empirical evaluations](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/incrCODE
MEDIUM…s/32-architect-professional-system-capstone/docs/en.md96### 5. Knowledge and RAG DesignCOMMENT
MEDIUM…ystem-capstone/outputs/architecture-packet-template.md37## 5. RAG and KnowledgeCOMMENT
MEDIUM…stem-capstone/outputs/reference-architecture-packet.md34## 5. RAG and KnowledgeCOMMENT
MEDIUM…lessons/05-output-evaluation-and-validation/docs/en.md351- [Anthropic: Reduce hallucinations](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-CODE
MEDIUM…/31-architect-foundations-scenario-capstone/docs/en.md72#### Gate 1: Agentic architecture and orchestrationCOMMENT
MEDIUM…ns/06-governance-safety-and-responsible-use/docs/en.md331- [Anthropic: Reduce prompt leak](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-proCODE
MEDIUM…lessons/13-application-security-and-secrets/docs/en.md339- [Mitigate jailbreaks and prompt injections](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrailCODE
MEDIUM…lessons/13-application-security-and-secrets/docs/en.md340- [Reduce prompt leak](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/reduce-prompt-leak)CODE
MEDIUM…/09-structured-output-and-defensive-parsing/docs/en.md356- [Increase output consistency](https://platform.claude.com/docs/en/test-and-evaluate/strengthen-guardrails/increase-conCODE
MEDIUM…peech-and-audio/08-voice-cloning-conversion/docs/en.md77### Step 2: zero-shot clone with F5-TTSCOMMENT
MEDIUMphases/11-llm-engineering/07-advanced-rag/docs/en.md1# Advanced RAG (Chunking, Reranking, Hybrid Search)COMMENT
MEDIUMphases/11-llm-engineering/07-advanced-rag/docs/en.md534- [Asai et al., "Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection" (ICLR 2024)](https://arCODE
MEDIUM…ineering/07-advanced-rag/outputs/skill-advanced-rag.md10# Advanced RAG PatternCOMMENT
MEDIUM…ineering/07-advanced-rag/outputs/skill-advanced-rag.md21## When to upgrade from basic RAGCOMMENT
MEDIUMphases/11-llm-engineering/06-rag/docs/en.md1# RAG (Retrieval-Augmented Generation)COMMENT
MEDIUMphases/11-llm-engineering/06-rag/docs/en.md28### The RAG PatternCOMMENT
MEDIUMphases/11-llm-engineering/06-rag/docs/en.md58### Why RAG Beats Fine-TuningCOMMENT
MEDIUMphases/11-llm-engineering/06-rag/docs/en.md277### Step 5: The Complete RAG PipelineCOMMENT
MEDIUM…1-llm-engineering/06-rag/outputs/skill-rag-pipeline.md10# RAG Pipeline PatternCOMMENT
MEDIUM…1-llm-engineering/06-rag/outputs/skill-rag-pipeline.md21## When to use RAGCOMMENT
MEDIUM…1-llm-engineering/06-rag/outputs/skill-rag-pipeline.md28## When NOT to use RAGCOMMENT
MEDIUM…s/11-llm-engineering/05-context-engineering/docs/en.md548### RAG as Context EngineeringCOMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/code/main.ts3// code/guardrails.py and the OWASP LLM defense-in-depth pattern.COMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/code/main.ts6// https://github.com/presidio-oss/hai-guardrailsCOMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/docs/en.md836# Install: pip install guardrails-aiCOMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/docs/en.md838# import guardrails as gdCOMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/docs/en.md839# from guardrails.hub import DetectPII, ToxicLanguage, CompetitorCheckCOMMENT
MEDIUMphases/11-llm-engineering/12-guardrails/docs/en.md856Guardrails AI has 50+ validators on their hub. Install validators individually: `guardrails hub install hub://guardrailsCODE
MEDIUMphases/11-llm-engineering/12-guardrails/docs/en.md896- [NeMo Guardrails Documentation](https://docs.nvidia.com/nemo/guardrails/) -- NVIDIA's guide to implementing programmabCODE
MEDIUM…ring/12-guardrails/outputs/skill-guardrail-patterns.md14## When to add guardrailsCOMMENT
MEDIUMphases/11-llm-engineering/13-production-app/docs/en.md1165- [Eugene Yan, "Patterns for Building LLM-based Systems"](https://eugeneyan.com/writing/llm-patterns/) -- architectural CODE
MEDIUM…ions-to-advanced/23-chunking-strategies-rag/docs/en.md1# Chunking Strategies for RAGCOMMENT
MEDIUM…undations-to-advanced/13-question-answering/docs/en.md61### Step 2: a retrieval-augmented pipeline (sketch)COMMENT
MEDIUM…undations-to-advanced/13-question-answering/docs/en.md96### Step 3: generative with RAGCOMMENT
MEDIUM…foundations-to-advanced/18-multilingual-nlp/docs/en.md58### Step 1: zero-shot cross-lingual classificationCOMMENT
MEDIUM…foundations-to-advanced/18-multilingual-nlp/docs/en.md111### Step 3: few-shot fine-tuning strategyCOMMENT
MEDIUM…to-advanced/14-information-retrieval-search/docs/en.md174### The hard-won lessons from 2026 production RAGCOMMENT
MEDIUM…tions-to-advanced/21-nli-textual-entailment/docs/en.md76### Step 2: zero-shot classificationCOMMENT
63 more matches not shown…
Deep Nesting209 hits · 206 pts
SeverityFileLineSnippetContext
LOWscripts/build_readme_i18n.py52CODE
LOWscripts/link_check.py115CODE
LOWscripts/link_check.py278CODE
LOWscripts/debias_quizzes.py117CODE
LOWscripts/build_book.py109CODE
LOWscripts/check_readme_counts.py213CODE
LOWscripts/install_skills.py90CODE
LOWscripts/install_skills.py390CODE
LOWscripts/test_skill_artifact_bundles.py160CODE
LOWscripts/test_skill_artifact_bundles.py344CODE
LOWscripts/test_skill_artifact_bundles.py394CODE
LOWscripts/audit_certifications.py321CODE
LOWscripts/audit_certifications.py541CODE
LOWscripts/audit_certifications.py665CODE
LOWscripts/backfill_certification_references.py62CODE
LOW…s/04-context-knowledge-memory-and-caching/code/main.py18CODE
LOW…ssons/05-output-evaluation-and-validation/code/main.py24CODE
LOW…1-architect-foundations-scenario-capstone/code/main.py89CODE
LOW…sons/11-mcp-server-design-and-integration/code/main.py569CODE
LOW…ude/lessons/12-claude-agent-sdk-and-hooks/code/main.py46CODE
LOW…ude/lessons/12-claude-agent-sdk-and-hooks/code/main.py129CODE
LOW…08-messages-api-and-application-lifecycle/code/main.py227CODE
LOW…9-structured-output-and-defensive-parsing/code/main.py51CODE
LOW…/outputs/migration-review-skill/scripts/check_scope.py10CODE
LOW…audio/06-speaker-recognition-verification/code/main.py135CODE
LOW…peech-and-audio/04-speech-recognition-asr/code/main.py27CODE
LOW…ech-and-audio/12-voice-assistant-pipeline/code/main.py69CODE
LOW…ses/06-speech-and-audio/07-text-to-speech/code/main.py53CODE
LOW…ch-and-audio/02-spectrograms-mel-features/code/main.py85CODE
LOW…llm-engineering/14-model-context-protocol/code/main.py146CODE
LOW…m-engineering/16-langgraph-state-machines/code/main.py117CODE
LOW…gineering/09-function-calling/code/function_calling.py200CODE
LOW…es/11-llm-engineering/08-fine-tuning-lora/code/lora.py35CODE
LOW…1-llm-engineering/10-evaluation/code/eval_framework.py300CODE
LOW…/11-llm-engineering/03-structured-outputs/code/main.py10CODE
LOW…/11-llm-engineering/03-structured-outputs/code/main.py121CODE
LOW…es/11-llm-engineering/04-embeddings/code/embeddings.py109CODE
LOW…m-engineering/13-production-app/code/production_app.py374CODE
LOW…ering/01-prompt-engineering/code/prompt_engineering.py321CODE
LOW…13-debugging-neural-networks/code/debug_neural_nets.py140CODE
LOW…s/03-deep-learning-core/10-mini-framework/code/main.py373CODE
LOW…eep-learning-core/01-the-perceptron/code/perceptron.py12CODE
LOW…eep-learning-core/01-the-perceptron/code/perceptron.py132CODE
LOW…-learning-core/09-learning-rate-schedules/code/main.py76CODE
LOW…-learning-core/09-learning-rate-schedules/code/main.py148CODE
LOW…/03-deep-learning-core/03-backpropagation/code/main.py188CODE
LOW…ep-learning-core/08-weight-initialization/code/main.py64CODE
LOW…ep-learning-core/08-weight-initialization/code/main.py126CODE
LOW…ep-learning-core/08-weight-initialization/code/main.py157CODE
LOW…ep-learning-core/08-weight-initialization/code/main.py166CODE
LOW…ns-to-advanced/23-chunking-strategies-rag/code/main.py36CODE
LOW…ations-to-advanced/07-pos-tagging-parsing/code/main.py52CODE
LOW…s-to-advanced/03-word-embeddings-word2vec/code/main.py22CODE
LOW…s-to-advanced/06-named-entity-recognition/code/main.py6CODE
LOW…s-to-advanced/06-named-entity-recognition/code/main.py20CODE
LOW…s-to-advanced/06-named-entity-recognition/code/main.py43CODE
LOW…dations-to-advanced/12-text-summarization/code/main.py20CODE
LOW…foundations-to-advanced/15-topic-modeling/code/main.py13CODE
LOW…ons-to-advanced/04-glove-fasttext-subword/code/main.py13CODE
LOW…ons-to-advanced/24-coreference-resolution/code/main.py27CODE
149 more matches not shown…
Cross-Language Confusion17 hits · 98 pts
SeverityFileLineSnippetContext
HIGH…ering/01-prompt-engineering/code/prompt_engineering.py418 'Output: {"sentiment": "negative", "food": null, "service": "negative"}'CODE
HIGHphases/13-tools-and-protocols/14-mcp-apps/code/main.py97 if (event.origin !== hostOrigin || !event.data || event.data.jsonrpc !== "2.0") return;CODE
HIGHphases/13-tools-and-protocols/14-mcp-apps/code/main.py98 if (event.data.id === 0 && event.data.result) {{CODE
HIGH…00-setup-and-tooling/01-dev-environment/code/verify.py111 return "Run `sudo apt-get update && sudo apt-get install -y git`, then `git --version`."CODE
HIGH…00-setup-and-tooling/01-dev-environment/code/verify.py124 "Run `fnm install 22 && fnm use 22`, then `node --version`.",CODE
HIGH…formers-deep-dive/16-speculative-decoding/code/main.py136 print("=== acceptance rate vs KL(q || p) ===")CODE
HIGH…h-foundations/14-norms-and-distances/code/distances.py375 print(f" KL(P || Q) = {kl_pq:.4f} nats")CODE
HIGH…h-foundations/14-norms-and-distances/code/distances.py376 print(f" KL(Q || P) = {kl_qp:.4f} nats")CODE
HIGH…h-foundations/14-norms-and-distances/code/distances.py386 print(f" KL(P || Q) = {kl_divergence(p2, q2):.4f} nats")CODE
HIGH…h-foundations/14-norms-and-distances/code/distances.py387 print(f" KL(Q || P) = {kl_divergence(q2, p2):.4f} nats")CODE
HIGH…tions/09-information-theory/code/information_theory.py225 print(f" KL(true || good): {kl_good:.4f} bits")CODE
HIGH…tions/09-information-theory/code/information_theory.py226 print(f" KL(true || bad): {kl_bad:.4f} bits")CODE
HIGH…tions/09-information-theory/code/information_theory.py240 print(f" KL(P || Q) = {kl_divergence(p, q):.4f} bits")CODE
HIGH…tions/09-information-theory/code/information_theory.py241 print(f" KL(Q || P) = {kl_divergence(q, p):.4f} bits")CODE
HIGH…one-projects/05-autonomous-research-agent/code/main.py136 tree.push(root)CODE
HIGH…one-projects/05-autonomous-research-agent/code/main.py160 tree.push(ch)CODE
HIGH…s-systems/10-claude-code-permission-modes/code/main.py161 Action("shell", "git add /tmp/secrets.txt && git push"),CODE
Cross-File Repetition15 hits · 75 pts
SeverityFileLineSnippetContext
HIGHphases/11-llm-engineering/07-advanced-rag/code/main.py0acme corp refund policy. all standard plan customers are eligible for a full refund within 30 days of purchase. enterpriSTRING
HIGHphases/11-llm-engineering/06-rag/code/main.py0acme corp refund policy. all standard plan customers are eligible for a full refund within 30 days of purchase. enterpriSTRING
HIGH…es/11-llm-engineering/04-embeddings/code/embeddings.py0acme corp refund policy. all standard plan customers are eligible for a full refund within 30 days of purchase. enterpriSTRING
HIGHphases/11-llm-engineering/07-advanced-rag/code/main.py0acme corp product overview. acme corp offers three product tiers: starter, professional, and enterprise. the starter plaSTRING
HIGHphases/11-llm-engineering/06-rag/code/main.py0acme corp product overview. acme corp offers three product tiers: starter, professional, and enterprise. the starter plaSTRING
HIGH…es/11-llm-engineering/04-embeddings/code/embeddings.py0acme corp product overview. acme corp offers three product tiers: starter, professional, and enterprise. the starter plaSTRING
HIGHphases/11-llm-engineering/07-advanced-rag/code/main.py0acme corp security practices. acme corp maintains soc 2 type ii compliance and undergoes annual third-party security audSTRING
HIGHphases/11-llm-engineering/06-rag/code/main.py0acme corp security practices. acme corp maintains soc 2 type ii compliance and undergoes annual third-party security audSTRING
HIGH…es/11-llm-engineering/04-embeddings/code/embeddings.py0acme corp security practices. acme corp maintains soc 2 type ii compliance and undergoes annual third-party security audSTRING
HIGHphases/11-llm-engineering/07-advanced-rag/code/main.py0acme corp api documentation. the acme api uses rest with json request and response bodies. authentication is via bearer STRING
HIGHphases/11-llm-engineering/06-rag/code/main.py0acme corp api documentation. the acme api uses rest with json request and response bodies. authentication is via bearer STRING
HIGH…es/11-llm-engineering/04-embeddings/code/embeddings.py0acme corp api documentation. the acme api uses rest with json request and response bodies. authentication is via bearer STRING
HIGHphases/11-llm-engineering/07-advanced-rag/code/main.py0acme corp uptime and reliability. acme corp guarantees 99.9% uptime for professional plans and 99.99% uptime for enterprSTRING
HIGHphases/11-llm-engineering/06-rag/code/main.py0acme corp uptime and reliability. acme corp guarantees 99.9% uptime for professional plans and 99.99% uptime for enterprSTRING
HIGH…es/11-llm-engineering/04-embeddings/code/embeddings.py0acme corp uptime and reliability. acme corp guarantees 99.9% uptime for professional plans and 99.99% uptime for enterprSTRING
Excessive Try-Catch Wrapping69 hits · 72 pts
SeverityFileLineSnippetContext
LOWscripts/link_check.py258 except Exception as exc:CODE
LOWscripts/link_check.py343 except Exception as exc:CODE
LOWscripts/install_skills.py424 except Exception:CODE
LOWscripts/install_skills.py525 except Exception:CODE
LOW…evals-testing-debugging-and-observability/code/main.py62 except Exception as exc:CODE
LOW…ude/lessons/10-tool-use-and-agentic-loops/code/main.py217 except Exception as exc:CODE
LOW…sons/11-mcp-server-design-and-integration/code/main.py183 except Exception:CODE
LOW…08-messages-api-and-application-lifecycle/code/main.py137 except Exception as exc: # Tool failures become model-visible results.CODE
LOW…llm-engineering/14-model-context-protocol/code/main.py204 except Exception:CODE
LOW…llm-engineering/14-model-context-protocol/code/main.py232 except Exception:CODE
LOW…llm-engineering/14-model-context-protocol/code/main.py275 except Exception:CODE
LOW…m-engineering/16-langgraph-state-machines/code/main.py57 except Exception as exc:CODE
LOW…gineering/09-function-calling/code/function_calling.py31 except Exception as e:CODE
LOW…gineering/09-function-calling/code/function_calling.py129 except Exception as e:CODE
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md220 except Exception as e:CODE
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md302 except Exception as e:CODE
LOW…engineering/02-few-shot-cot/code/advanced_prompting.py326 except Exception as e:CODE
LOW…-permissions-sandboxes-and-trust/code/sandbox/probe.py15 except Exception as error:CODE
LOW…s-and-protocols/07-building-an-mcp-server/code/main.py355 except Exception as exc:CODE
LOW…ools-and-protocols/18-mcp-auth-production/code/main.py488 except Exception:CODE
LOW…ent-engineering/02-rewoo-plan-and-execute/code/main.py43 except Exception as e:CODE
LOW…t-engineering/42-agent-workbench-capstone/code/main.py547 except Exception as exc:CODE
LOW…tputs/agent-workbench-pack/scripts/generate_handoff.py112 except Exception as exc:CODE
LOW…nt-engineering/10-skill-libraries-voyager/code/main.py100 except Exception as e:CODE
LOW…/14-agent-engineering/17-claude-agent-sdk/code/main.py100 except Exception as e:CODE
LOW…gent-engineering/34-repo-memory-and-state/code/main.py108 except Exception:CODE
LOW…ineering/06-tool-use-and-function-calling/code/main.py134 except Exception as e:CODE
LOW…-agent-engineering/14-autogen-actor-model/code/main.py67 except Exception as e:CODE
LOW…es/14-agent-engineering/01-the-agent-loop/code/main.py52 except Exception as e:CODE
LOW…es/14-agent-engineering/01-the-agent-loop/code/main.py62 except Exception as e:CODE
LOW…ineering/07-memory-virtual-context-memgpt/code/main.py136 except Exception as e:CODE
LOW…00-setup-and-tooling/01-dev-environment/code/verify.py94 except Exception as exc:CODE
LOW…i-agent-and-swarms/08-role-specialization/code/main.py75 except Exception as e:CODE
LOW…i-agent-and-swarms/08-role-specialization/code/main.py84 except Exception as e:CODE
MEDIUM…gent-and-swarms/07-society-of-mind-debate/code/main.py94 print(f"Error vs truth: {abs(control_mean - TRUE_ANSWER):.2f}")CODE
LOW…tch/09-constitutional-ai-self-improvement/code/main.py80 except Exception:CODE
LOW…tch/09-constitutional-ai-self-improvement/code/main.py137 except Exception:CODE
LOW…ratch/09-constitutional-ai-self-improvement/docs/en.md220 except Exception:CODE
LOW…ojects/60-projection-layer-modality-align/code/main.py36 except Exception:CODE
LOW…projects/15-constitutional-safety-harness/code/main.py33 except Exception:CODE
LOW…tone-projects/13-mcp-server-with-registry/code/main.py288 except Exception as exc:CODE
LOW…stone-projects/42-large-corpus-downloader/code/main.py355 except Exception:CODE
LOW…apstone-projects/43-hdf5-tokenized-corpus/code/main.py273 except Exception:CODE
LOW…apstone-projects/43-hdf5-tokenized-corpus/code/main.py277 except Exception:CODE
LOW…apstone-projects/43-hdf5-tokenized-corpus/code/main.py292 except Exception:CODE
MEDIUM…apstone-projects/43-hdf5-tokenized-corpus/code/main.py140def __exit__(self, exc_type, exc, tb) -> None:CODE
LOW…one-projects/24-plan-execute-control-flow/code/main.py156 except Exception as exc:CODE
LOW…-capstone-projects/56-iteration-scheduler/code/main.py202 except Exception as exc:CODE
LOW…-capstone-projects/56-iteration-scheduler/code/main.py264 except Exception:CODE
LOW…tone-projects/23-function-call-dispatcher/code/main.py190 except Exception as exc:CODE
LOW…tone-projects/23-function-call-dispatcher/code/main.py240 except Exception as exc:CODE
LOW…s/19-capstone-projects/49-lm-eval-harness/code/main.py96 except Exception:CODE
LOW…s/19-capstone-projects/49-lm-eval-harness/code/main.py225 except Exception:CODE
LOW…s/19-capstone-projects/49-lm-eval-harness/code/main.py237 except Exception:CODE
LOW…stone-projects/22-jsonrpc-stdio-transport/code/main.py150 except Exception as exc:CODE
LOW…capstone-projects/48-distributed-fsdp-ddp/code/main.py278 except Exception as exc:CODE
LOW…capstone-projects/48-distributed-fsdp-ddp/code/main.py338 except Exception:CODE
LOW…-projects/81-end-to-end-distributed-train/code/main.py387 except Exception:CODE
LOW…-projects/01-terminal-native-coding-agent/code/main.py214 except Exception as exc:CODE
LOW…one-projects/83-prompt-injection-detector/code/main.py87 except Exception:CODE
9 more matches not shown…
Hallucination Indicators5 hits · 60 pts
SeverityFileLineSnippetContext
CRITICAL…s/19-capstone-projects/59-vit-transformer/code/main.py226 grad_norm = enc2.front.patch.proj.weight.grad.norm().item()CODE
CRITICAL…9-capstone-projects/36-training-loop-eval/code/main.py159 block.attn.out_proj.weight.data.mul_(scale)CODE
CRITICAL…9-capstone-projects/36-training-loop-eval/code/main.py160 block.mlp.fc2.weight.data.mul_(scale)CODE
CRITICAL…9-capstone-projects/35-gpt-model-assembly/code/main.py156 block.attn.out_proj.weight.data.mul_(scale)CODE
CRITICAL…9-capstone-projects/35-gpt-model-assembly/code/main.py157 block.mlp.fc2.weight.data.mul_(scale)CODE
Over-Commented Block48 hits · 48 pts
SeverityFileLineSnippetContext
LOW.github/workflows/translate.yml1name: translateCOMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md561COMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md581# },COMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md601# {"role": "user", "content": "Weather in Tokyo?"},COMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md621# tools=[{COMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md641# max_tokens=1024,COMMENT
LOW…ases/11-llm-engineering/09-function-calling/docs/en.md661# from mcp import ClientSession, StdioServerParametersCOMMENT
LOWphases/11-llm-engineering/10-evaluation/docs/en.md741# promptfooconfig.yaml:COMMENT
LOWphases/11-llm-engineering/10-evaluation/docs/en.md761#COMMENT
LOWphases/11-llm-engineering/10-evaluation/docs/en.md781#COMMENT
LOWphases/11-llm-engineering/10-evaluation/docs/en.md801#COMMENT
LOWphases/11-llm-engineering/12-guardrails/docs/en.md761# model="omni-moderation-latest",COMMENT
LOWphases/11-llm-engineering/12-guardrails/docs/en.md781# from transformers import AutoTokenizer, AutoModelForCausalLMCOMMENT
LOWphases/11-llm-engineering/12-guardrails/docs/en.md801# NeMo Guardrails uses Colang -- a DSL for defining conversational rails.COMMENT
LOWphases/11-llm-engineering/12-guardrails/docs/en.md821# user ask about bankingCOMMENT
LOWphases/11-llm-engineering/12-guardrails/docs/en.md841# guard = gd.Guard().use_many(COMMENT
LOW…es/11-llm-engineering/03-structured-outputs/docs/en.md421 print(f" Output: {json.dumps(result)}")COMMENT
LOW…es/11-llm-engineering/03-structured-outputs/docs/en.md441# response = client.beta.chat.completions.parse(COMMENT
LOW…es/11-llm-engineering/03-structured-outputs/docs/en.md461# client = anthropic.Anthropic()COMMENT
LOW…es/11-llm-engineering/03-structured-outputs/docs/en.md481```COMMENT
LOWphases/11-llm-engineering/13-production-app/docs/en.md1021### FastAPI Server (Production Deployment)COMMENT
LOWphases/11-llm-engineering/13-production-app/docs/en.md1041# stream: bool = FalseCOMMENT
LOWphases/11-llm-engineering/13-production-app/docs/en.md1061# @app.get("/v1/costs")COMMENT
LOWphases/11-llm-engineering/13-production-app/docs/en.md1081```pythonCOMMENT
LOWphases/11-llm-engineering/13-production-app/docs/en.md1101# async with client.messages.stream(COMMENT
LOW…es/11-llm-engineering/01-prompt-engineering/docs/en.md881COMMENT
LOW…es/11-llm-engineering/01-prompt-engineering/docs/en.md901#COMMENT
LOW…es/11-llm-engineering/01-prompt-engineering/docs/en.md921# "role": "user",COMMENT
LOW…es/11-llm-engineering/01-prompt-engineering/docs/en.md941#COMMENT
LOW…es/11-llm-engineering/01-prompt-engineering/docs/en.md961```pythonCOMMENT
LOWphases/11-llm-engineering/11-caching-cost/docs/en.md761#COMMENT
LOWphases/11-llm-engineering/11-caching-cost/docs/en.md781COMMENT
LOWphases/11-llm-engineering/11-caching-cost/docs/en.md801# print(f"Completion tokens: {response.usage.completion_tokens}")COMMENT
LOWphases/11-llm-engineering/11-caching-cost/docs/en.md821# "model": "gpt-4o-mini",COMMENT
LOWphases/11-llm-engineering/11-caching-cost/docs/en.md841# import numpy as npCOMMENT
LOW…tools-and-protocols/01-the-tool-interface/code/main.ts1// Phase 13 Lesson 01 — the tool interface, in TypeScript.COMMENT
LOW…es/13-tools-and-protocols/19-a2a-protocol/code/main.ts1// Phase 13 Lesson 19 — A2A agent-to-agent protocol, in TypeScript.COMMENT
LOW…-engineering/13-langgraph-stateful-graphs/code/main.ts1// Phase 14 Lesson 13 — LangGraph-shaped stateful graph, in TypeScript.COMMENT
LOW…ineering/06-tool-use-and-function-calling/code/main.ts1// Phase 14 Lesson 06 — tool use and function calling, in TypeScript.COMMENT
LOW…es/14-agent-engineering/01-the-agent-loop/code/main.ts1// Phase 14 Lesson 01 — toy ReAct agent loop, in TypeScript.COMMENT
LOW…/00-setup-and-tooling/10-terminal-and-shell/docs/en.md241COMMENT
LOWphases/10-llms-from-scratch/11-quantization/docs/en.md781# from transformers import AutoTokenizerCOMMENT
LOWphases/10-llms-from-scratch/11-quantization/docs/en.md801# pip install autoawqCOMMENT
LOWphases/10-llms-from-scratch/10-evaluation/docs/en.md421The standard tool for running benchmarks on any model.COMMENT
LOW…jects/03-realtime-voice-assistant/code/ts/src/index.ts1// Capstone 19/03: realtime voice web client (multi-file TypeScript).COMMENT
LOW…s/01-terminal-native-coding-agent/code/ts/src/index.ts1// Capstone 19/01: terminal-native coding agent harness (multi-file TypeScript).COMMENT
LOW…one-projects/02-rag-over-codebase/code/ts/src/index.ts1// Capstone 19/02: code RAG query API (multi-file TypeScript).COMMENT
LOW…utonomous-systems/16-checkpoints-rollback/code/main.py101COMMENT
Synthetic Comment Markers5 hits · 25 pts
SeverityFileLineSnippetContext
HIGH…/lessons/13-application-security-and-secrets/quiz.json22 "Inside encrypted tool arguments generated by Claude for each authorized request",CODE
HIGH…llms-from-scratch/06-instruction-tuning-sft/docs/en.md25Stanford Alpaca proved you don't need millions of examples. In March 2023, they fine-tuned Llama 7B on just 52,000 instrCODE
HIGH…llms-from-scratch/06-instruction-tuning-sft/docs/en.md61Simple and widely used. The `input` field is optional -- many instructions don't need additional context. Stanford releaCODE
HIGH…modal-ai/05-llava-visual-instruction-tuning/docs/en.md3> LLaVA (April 2023) is the most copied multimodal architecture on the planet. It replaced BLIP-2's Q-Former with a 2-laCODE
HIGH…modal-ai/05-llava-visual-instruction-tuning/docs/en.md168| ShareGPT4V | "Better captions" | 1M dense captions generated by GPT-4V, used for higher-quality alignment |CODE
AI Structural Patterns13 hits · 13 pts
SeverityFileLineSnippetContext
LOW…oundations/05-chain-rule-and-autodiff/code/autodiff.py210CODE
LOW…-math-foundations/21-graph-theory/code/graph_theory.py150CODE
LOW…-llms-from-scratch/05-scaling-distributed/code/main.py85CODE
LOW…pstone-projects/58-vision-encoder-patches/code/main.py102CODE
LOW…-capstone-projects/56-iteration-scheduler/code/main.py117CODE
LOW…19-capstone-projects/34-transformer-block/code/main.py111CODE
LOW…pstone-projects/47-checkpoint-save-resume/code/main.py366CODE
LOW…s/19-capstone-projects/59-vit-transformer/code/main.py103CODE
LOW…capstone-projects/48-distributed-fsdp-ddp/code/main.py294CODE
LOW…/85-content-classifier-integration/code/classifiers.py148CODE
LOW…9-capstone-projects/35-gpt-model-assembly/code/main.py91CODE
LOW…04-computer-vision/14-vision-transformers/code/main.py40CODE
LOW…odal-ai/04-flamingo-gated-cross-attention/code/main.py86CODE
Verbosity Indicators6 hits · 11 pts
SeverityFileLineSnippetContext
LOWscripts/scaffold-lesson.sh77### Step 1: [name]COMMENT
LOWscripts/scaffold-lesson.sh85### Step 2: [name]COMMENT
LOW…s/15-autonomous-systems/11-browser-agents/code/main.py91 # Step 1: fetch. Apply sanitizer if enabled.COMMENT
LOW…s/15-autonomous-systems/11-browser-agents/code/main.py97 # Step 2: "read" the combined context. In a real stack, URL fragmentCOMMENT
LOW…s/15-autonomous-systems/11-browser-agents/code/main.py101 # Step 3: decide what to post.COMMENT
LOW…s/15-autonomous-systems/11-browser-agents/code/main.py117 # Step 4: R/W boundary check.COMMENT
Slop Phrases5 hits · 10 pts
SeverityFileLineSnippetContext
MEDIUM…1-llm-engineering/10-evaluation/code/eval_framework.py259 reference_output="I cannot provide instructions for illegal activities.",CODE
MEDIUMphases/11-llm-engineering/12-guardrails/code/main.ts327 return { response: "I cannot provide that response. Let me help you differently.", report };CODE
MEDIUM…es/11-llm-engineering/12-guardrails/code/guardrails.py341 return "I apologize, but I cannot provide that response. Let me help you differently.", reportCODE
MEDIUM…m-engineering/13-production-app/code/production_app.py352 "Let me know if you need more detail on any specific aspect."CODE
MEDIUM…m-engineering/13-production-app/code/production_app.py493 result["text"] = "I cannot provide that response as it was flagged by our safety system."CODE
AI Slop Vocabulary2 hits · 9 pts
SeverityFileLineSnippetContext
MEDIUM…ne-projects/27-eval-harness-fixture-tasks/code/main.py332# The harnessCOMMENT
MEDIUM…e-projects/29-end-to-end-coding-task-demo/code/main.py32# Minimal harness primitives, copied with intent from lessons 25-28.COMMENT
Modern Structural Boilerplate8 hits · 8 pts
SeverityFileLineSnippetContext
LOW…-engineering/13-langgraph-stateful-graphs/code/main.py41 def set_entry(self, name: str) -> None:CODE
LOW…tooling/12-debugging-and-profiling/code/debug_tools.py10logger = logging.getLogger(__name__)CODE
LOW…nd-swarms/17-generative-agents-simulation/code/main.py53 def update_plan(self, tick: int) -> None:CODE
LOW…pstone-projects/66-reranker-cross-encoder/code/main.py35def _set_seed(seed: int = SEED) -> None:CODE
LOW…19-capstone-projects/34-transformer-block/code/main.py195def _set_eval_mode(stack: BlockStack) -> None:CODE
LOW…apstone-projects/45-gradient-clipping-amp/code/main.py183 def set_loss_fn(self, fn: Callable[[torch.Tensor, torch.Tensor], torch.Tensor]) -> None:CODE
LOW…apstone-projects/45-gradient-clipping-amp/code/main.py186 def set_lr(self, lr: float) -> None:CODE
LOW…/19-capstone-projects/44-cosine-lr-warmup/code/main.py150 def set_lr(self, lr: float) -> None:CODE
Overly Generic Function Names5 hits · 5 pts
SeverityFileLineSnippetContext
LOW…m-engineering/13-production-app/code/production_app.py445 async def handle_request(self, user_id, query, template_name="general_chat", variables=None):CODE
LOW…t-engineering/19-benchmarks-swebench-gaia/code/main.py34def run_task(task: Task) -> TaskResult:CODE
LOW…rms/24-evaluation-coordination-benchmarks/code/main.py42def run_task(system: SystemSim, task_id: str, seen: bool, rng: random.Random) -> TaskResult:CODE
LOW…s/19-capstone-projects/49-lm-eval-harness/code/main.py289def run_task(CODE
LOW…odal-ai/25-multimodal-agents-computer-use/code/main.py87def run_task(task: Task) -> dict:CODE
Magic Placeholder Names1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH…engineering/02-few-shot-cot/code/advanced_prompting.py510 client = OpenAI(api_key=os.environ.get("OPENAI_API_KEY", "your-api-key"))CODE
Fake / Example Data3 hits · 3 pts
SeverityFileLineSnippetContext
LOW…-tools-and-protocols/04-structured-output/code/main.py143 "customer": "Acme Corp",CODE
LOW…dal-ai/05-llava-visual-instruction-tuning/code/main.py76 "placeholder": placeholder,CODE
LOW…utonomous-systems/14-kill-switches-canaries/docs/en.md971. Run `code/main.py`. Confirm the circuit breaker fires on turn 5 (fifth identical call) and the canary fires on turn 9CODE