AI Slop Code Risk Monitor

jetify-com/devbox

SlopCodeMonitor badge for jetify-com/devbox Adjusted legacy signal; badge bands: 25 / 50 / 75 (different from dashboard bands).

Instant, easy, and predictable development environments

2.9 Low pattern signal View on GitHub

Open-Source Code Quality, Security and Technical Debt Review

This report summarizes scanner evidence for jetify-com/devbox, a Go project with 12,439 GitHub stars. SynthScan examined 58,557 lines of code across 753 source files, recording 125 pattern matches distributed across 8 syntactic categories. The legacy adjusted pattern signal is 2.9 (Low pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

2.9
Adjusted Signal
2.9
Raw Pattern Score
100%
Time Factor
2026-10-30
Last Push
12.4K
Stars
Go
Language
58.6K
Lines of Code
753
Files
125
Pattern Hits
2026-10-31
Scan Date
0.00
HC Hit Rate

Risk Review · Payload v1

Use each vector to guide manual verification of the underlying findings.

Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.

Cognitive Ownership Risk 10.3/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 111 finding(s).

Hallucinated Dependency & Supply Chain Risk 1.3/100 · LOW

Are imports declared and package/API names verified? 6 finding(s).

Agent Over-Engineering Ratio 2.0/100 · LOW

Are wrappers, guards, and repeated structures necessary? 8 finding(s).

PR Review Velocity Impact 13.2/100 · LOW

Which changes need focused human review? 125 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 1HIGH 0MEDIUM 16LOW 108

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 125 distinct pattern matches across 8 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Over-Commented Block99 hits · 99 pts
SeverityFileLineSnippetContext
LOW.goreleaser.yaml41release:COMMENT
LOWdevbox.json61 "update-hash": [COMMENT
LOWdevbox.json81 "release-changes": "node scripts/release.ts --changes \"$@\"",COMMENT
LOWnix/nix.go221COMMENT
LOWnix/nix.go281 // StoreDir is the path to the Nix store directory, usually /nix/store.COMMENT
LOWnix/nix.go381 // If the version isn't a valid semver, check to see if it's aCOMMENT
LOWnix/nix.go401 if !i.IsLix() {COMMENT
LOWnix/command.go21COMMENT
LOWnix/flake/flakeref.go21 TypeGitHub = "github"COMMENT
LOWnix/flake/flakeref.go81COMMENT
LOWnix/flake/flakeref.go321 // (which defaults to true), so we have to be conservative andCOMMENT
LOWnix/flake/flakeref.go341//COMMENT
LOWnix/flake/flakeref.go601COMMENT
LOWnix/flake/flakeref.go621type Installable struct {COMMENT
LOWtestscripts/basic/install_hello.test.txt21# As is, we always print 'Ensuring packages are installed'.COMMENT
LOWtestscripts/languages/python_patch_cuda.test.txt1# Python Patch CUDA TestCOMMENT
LOWtestscripts/add/add_insecure.tst.txt1# Tests installing an insecure package.COMMENT
LOWinternal/boxcli/featureflag/impure_print_dev_env.go1// Copyright 2024 Jetify Inc. and contributors. All rights reserved.COMMENT
LOWinternal/searcher/model.go61 Systems map[string]struct {COMMENT
LOWinternal/fileutil/fileutil.go21//COMMENT
LOWinternal/nix/doc.go1// Copyright 2024 Jetify Inc. and contributors. All rights reserved.COMMENT
LOWinternal/nix/install.go21COMMENT
LOWinternal/nix/nixprofile/item.go21 // This field is used instead of index for `list`, `remove` and `upgrade` subcommands of `nix profile`.COMMENT
LOWinternal/shellgen/doc.go1package shellgenCOMMENT
LOWinternal/devpkg/package.go41COMMENT
LOWinternal/devpkg/package.go61 // - If the package doesn't exist in the lockfile, it resolves to theCOMMENT
LOWinternal/devpkg/package.go801COMMENT
LOWinternal/devpkg/narinfo_cache.go221// stores hits. Misses stay in memory because they can become hits later (a pathCOMMENT
LOWinternal/plugin/plugin.go61// embedded ConfigFile.Hash only covers the plugin.json itself, so without thisCOMMENT
LOWinternal/lock/resolve.go221 }COMMENT
LOWinternal/redact/redact.go1// Copyright 2024 Jetify Inc. and contributors. All rights reserved.COMMENT
LOWinternal/redact/redact.go21// redactable. A redactable error defines an alternative message for itsCOMMENT
LOWinternal/redact/redact.go41// }COMMENT
LOWinternal/redact/redact.go101 return &redactedError{COMMENT
LOWinternal/devbox/inithookenv.go21// EnvVarsWithInitHook returns the environment variables for the DevboxCOMMENT
LOWinternal/devbox/update.go81 if opts.NoInstall {COMMENT
LOWinternal/devbox/envvars.go81 } else {COMMENT
LOWinternal/devbox/devbox.go341 // my fileCOMMENT
LOWinternal/devbox/devbox.go701 // functions that we don't need (like genericBuild). For reference, each type translates to bash as follows:COMMENT
LOWinternal/devbox/devbox.go721 if ignoreDevEnvVar[key] {COMMENT
LOWinternal/devbox/devbox.go741// 2. Copy variables from "nix print-dev-env" except for those inCOMMENT
LOWinternal/devbox/devbox.go821 // devboxEnvPath starts with the initial PATH from print-dev-env, and isCOMMENT
LOWinternal/devbox/shellcmd/command.go41// value such that:COMMENT
LOWinternal/devbox/envpath/stack.go21// 1. The stack enables tracking which sub-paths in PATH come from which devbox-projectCOMMENT
LOWinternal/patchpkg/elf.go61COMMENT
LOWinternal/vercheck/project.go21)COMMENT
LOWinternal/devconfig/configfile/ast.go21// automatically be marshaled back to JSON. Support for modifying a part ofCOMMENT
LOWinternal/devconfig/configfile/ast.go41 root, err := hujson.Parse(b)COMMENT
LOWinternal/devconfig/configfile/file.go21COMMENT
LOWinternal/devconfig/configfile/file.go61 Shell *shellConfig `json:"shell,omitempty"`COMMENT
LOWinternal/devconfig/configfile/devbox_version.go41// version constraint string, which uses the default "warn" policy:COMMENT
LOWinternal/conf/doc.go1// Copyright 2024 Jetify Inc. and contributors. All rights reserved.COMMENT
LOWinternal/cuecfg/doc.go1// Copyright 2024 Jetify Inc. and contributors. All rights reserved.COMMENT
LOWexamples/stacks/jekyll/myblog/_config.yml1# Welcome to Jekyll!COMMENT
LOWexamples/stacks/jekyll/myblog/_config.yml41# - vendor/cache/COMMENT
LOWexamples/stacks/drupal/web/robots.txt1#COMMENT
LOW…mples/stacks/drupal/web/sites/development.services.yml1# Local development services.COMMENT
LOW…s/stacks/drupal/web/sites/default/default.settings.php901 */COMMENT
LOW…s/stacks/drupal/web/sites/default/default.services.yml1parameters:COMMENT
LOW…s/stacks/drupal/web/sites/default/default.services.yml21 # is deleted, authenticated users are logged out, and the contents of theCOMMENT
39 more matches not shown…
Decorative Section Separators8 hits · 24 pts
SeverityFileLineSnippetContext
MEDIUMscripts/install.sh11# ========================COMMENT
MEDIUMscripts/install.sh13# ========================COMMENT
MEDIUMscripts/install.sh36# ====================COMMENT
MEDIUMscripts/install.sh38# ====================COMMENT
MEDIUMscripts/install.sh56# ====================COMMENT
MEDIUMscripts/install.sh58# ====================COMMENT
MEDIUMscripts/install.sh195# ==============COMMENT
MEDIUMscripts/install.sh197# ==============COMMENT
Self-Referential Comments5 hits · 14 pts
SeverityFileLineSnippetContext
MEDIUM…s/rails/blog/config/initializers/permissions_policy.rb1# Define an application-wide HTTP permissions policy. For furtherCOMMENT
MEDIUM…ls/blog/config/initializers/content_security_policy.rb3# Define an application-wide content security policy.COMMENT
MEDIUMexamples/stacks/rails/blog/db/schema.rb1# This file is auto-generated from the current state of the database. InsteadCOMMENT
MEDIUMexamples/stacks/rails/blog/db/schema.rb5# This file is the source Rails uses to define your schema when running `bin/railsCOMMENT
MEDIUMexamples/data_science/R/src/examplePlot.R13 geom_point() + # Create a scatter plotCODE
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICAL.github/workflows/random-reviewer-assignment.yml32 const prAuthor = context.payload.pull_request.user.login.toLowerCase();CODE
AI Slop Vocabulary3 hits · 9 pts
SeverityFileLineSnippetContext
MEDIUMinternal/shellgen/generate.go114 // Definitely a new file if we had to make the directory.COMMENT
MEDIUMinternal/devconfig/configfile/env.go27 // before calling this method. But having it makes it more robustCOMMENT
MEDIUMexamples/development/haskell/my-project/stack.yaml4# For advanced use and comprehensive documentation of the format, please see:COMMENT
Redundant / Tautological Comments4 hits · 6 pts
SeverityFileLineSnippetContext
LOWplugins/python/venvShellHook.sh25# Check if the directory existsCOMMENT
LOWplugins/python/venvShellHook.sh28 # Check if we've already run this scriptCOMMENT
LOW…es/stacks/rails/blog/config/environments/production.rb68 # Set this to true and configure the email server for immediate delivery to raise delivery errors.COMMENT
LOW.github/workflows/cli-tests.yaml305 # Check if file exists, create directory if neededCOMMENT
Unused Imports3 hits · 3 pts
SeverityFileLineSnippetContext
LOWexamples/stacks/django/todo_project/todo_app/admin.py1CODE
LOWexamples/stacks/django/todo_project/todo_app/tests.py1CODE
LOW…les/cloud_development/temporal/hello/hello_activity.py2CODE
Fake / Example Data2 hits · 2 pts
SeverityFileLineSnippetContext
LOWexamples/stacks/lepp-stack/setup_postgres_db.sql24INSERT INTO address_book (first_name, last_name, phone, email) VALUES ('Jim', 'Hawkins', '555-0100', 'jhawk@jetpack.io')CODE
LOWexamples/stacks/lapp-stack/setup_postgres_db.sql24INSERT INTO address_book (first_name, last_name, phone, email) VALUES ('Jim', 'Hawkins', '555-0100', 'jhawk@jetpack.io')CODE