Repository Analysis

Jia-Ethan/codex-keysmith

Versioned Codex instruction deployment with preview, ownership manifests, hook isolation, scenario evaluation, and recovery.

11.3 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Jia-Ethan/codex-keysmith, a Python project with 4,136 GitHub stars. SynthScan v2.0 examined 67,895 lines of code across 199 source files, recording 1053 pattern matches distributed across 9 syntactic categories. The overall adjusted score of 11.3 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

11.3
Adjusted Score
11.3
Raw Score
100%
Time Factor
2026-08-29
Last Push
4.1K
Stars
Python
Language
67.9K
Lines of Code
199
Files
1.1K
Pattern Hits
2026-08-29
Scan Date
0.02
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 4MEDIUM 9LOW 1040

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1053 distinct pattern matches across 9 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers942 hits · 649 pts
SeverityFileLineSnippetContext
LOWcodex-instruct.py4616def _register_scenario_bundle_cleanup() -> None:CODE
LOWcodex-instruct.py4624def _cleanup_scenario_bundle_tempdirs() -> None:CODE
LOWcodex-instruct.py4634def _scenario_require_absolute_file(value: str, label: str) -> Path:CODE
LOWcodex-instruct.py8475def _atomic_rename_no_replace(source: Path, destination: Path) -> bool:CODE
LOWcodex-instruct.py8480def _secure_verified_transaction_claim(CODE
LOWcodex-instruct.py8490def _verify_atomic_rename_support(codex_dir: Path) -> None:CODE
LOWcodex-instruct.py8575def _cleanup_transaction_dir_after_error(transaction_dir: Path) -> None:CODE
LOWcodex-instruct.py8582def _strict_cleanup_transaction_dir(transaction_dir: Path) -> None:CODE
LOWcodex-instruct.py8593def _run_cleanup_preserving_primary(CODE
LOWcodex-instruct.py798def _print_windows_fresh_deployment_beta_warning() -> None:CODE
LOWcodex-instruct.py835def _residue_authorization_digest(CODE
LOWcodex-instruct.py891def _make_registered_transaction_dir(CODE
LOWcodex-instruct.py1124def _resolve_candidate_directory(candidate: Path) -> Optional[Path]:CODE
LOWcodex-instruct.py1187def _status_candidate_has_evidence(codex_root: Path) -> bool:CODE
LOWcodex-instruct.py1239def _open_exclusive_private_file(path: Path) -> int:CODE
LOWcodex-instruct.py1244def _timestamped_backup_candidate(path: Path, timestamp: str, attempt: int) -> Path:CODE
LOWcodex-instruct.py1319def _preview_unique_backup_path(path: Path, timestamp: str) -> Path:CODE
LOWcodex-instruct.py1405 def apply_private_file_security(self, descriptor: int) -> None:CODE
LOWcodex-instruct.py1408 def apply_private_path_security(CODE
LOWcodex-instruct.py1426 def verify_recovery_directory_security(self, path: Path) -> None:CODE
LOWcodex-instruct.py1429 def read_verified_recovery_directory(CODE
LOWcodex-instruct.py1443 def open_verified_empty_private_directory(CODE
LOWcodex-instruct.py1467 def open_verified_owned_directory(CODE
LOWcodex-instruct.py1549 def _validate_expected_fingerprint(CODE
LOWcodex-instruct.py1646 def remove_verified_directory(self, access: _OwnedDirectoryAccess) -> None:CODE
LOWcodex-instruct.py2149 def _handle_matches_portable_identity(CODE
LOWcodex-instruct.py2201 def _open_directory_components(self, path: Path) -> Tuple[Path, List[int]]:CODE
LOWcodex-instruct.py2324 def _build_private_security_descriptor(self) -> int:CODE
LOWcodex-instruct.py2450 def apply_private_file_security(self, descriptor: int) -> None:CODE
LOWcodex-instruct.py2459 def apply_private_path_security(CODE
LOWcodex-instruct.py2654 def _recovery_acl_principals_allowed(CODE
LOWcodex-instruct.py2677 def _verify_handle_private_security(self, handle: int, path: Path) -> None:CODE
LOWcodex-instruct.py2688 def _verify_handle_recovery_security(self, handle: int, path: Path) -> None:CODE
LOWcodex-instruct.py2714 def verify_recovery_directory_security(self, path: Path) -> None:CODE
LOWcodex-instruct.py2717 def read_verified_recovery_directory(CODE
LOWcodex-instruct.py2831 def open_verified_owned_directory(CODE
LOWcodex-instruct.py2891 def open_verified_empty_private_directory(CODE
LOWcodex-instruct.py3088 def remove_verified_directory(self, access: _OwnedDirectoryAccess) -> None:CODE
LOWcodex-instruct.py3221def _normalize_operation_directories(paths: List[str]) -> List[_OperationDirectory]:CODE
LOWcodex-instruct.py3416def _open_verified_owned_directory(CODE
LOWcodex-instruct.py3431def _safe_remove_owned_directory(CODE
LOWcodex-instruct.py3566def _reference_targets_legacy(reference: Optional[str]) -> bool:CODE
LOWcodex-instruct.py3771def _path_has_directory_identity(path: Path, identity: FileIdentity) -> bool:CODE
LOWcodex-instruct.py3812def _fingerprint_regular_file(path: Path) -> FileFingerprint:CODE
LOWcodex-instruct.py3820def _read_regular_bytes_with_fingerprint(CODE
LOWcodex-instruct.py3863def _read_regular_text_with_fingerprint(CODE
LOWcodex-instruct.py3905def _fingerprint_has_same_content(CODE
LOWcodex-instruct.py4009def _scenario_identity_from_json(value: Any, label: str) -> FileIdentity:CODE
LOWcodex-instruct.py4030def _scenario_require_absolute_directory(value: str, label: str) -> Path:CODE
LOWcodex-instruct.py4192def _scenario_package_matches(CODE
LOWcodex-instruct.py4213def _scenario_python_version_matches(specification: str) -> bool:CODE
LOWcodex-instruct.py4227def _scenario_parse_version_tuple(value: str) -> Tuple[int, ...]:CODE
LOWcodex-instruct.py4234def _scenario_compare_versions(left: Tuple[int, ...], right: Tuple[int, ...]) -> int:CODE
LOWcodex-instruct.py4245def _scenario_parse_version_constraint(CODE
LOWcodex-instruct.py4261def _scenario_version_satisfies(version: str, specification: str) -> bool:CODE
LOWcodex-instruct.py4278def _scenario_extract_version(text: str) -> Optional[str]:CODE
LOWcodex-instruct.py4283def _scenario_python_probe_executable() -> str:CODE
LOWcodex-instruct.py4310def _scenario_probe_environment(requirement: Dict[str, Any]) -> Optional[Dict[str, str]]:CODE
LOWcodex-instruct.py4340def _scenario_probe_requirement(requirement: Dict[str, Any]) -> Optional[str]:CODE
LOWcodex-instruct.py4419def _scenario_requires_summary(package: "ScenarioPackage") -> str:CODE
882 more matches not shown…
Deep Nesting75 hits · 46 pts
SeverityFileLineSnippetContext
LOWcodex-instruct.py952CODE
LOWcodex-instruct.py1249CODE
LOWcodex-instruct.py3387CODE
LOWcodex-instruct.py3573CODE
LOWcodex-instruct.py4113CODE
LOWcodex-instruct.py4904CODE
LOWcodex-instruct.py5896CODE
LOWcodex-instruct.py6228CODE
LOWcodex-instruct.py6663CODE
LOWcodex-instruct.py6901CODE
LOWcodex-instruct.py7174CODE
LOWcodex-instruct.py7319CODE
LOWcodex-instruct.py7501CODE
LOWcodex-instruct.py7570CODE
LOWcodex-instruct.py7693CODE
LOWcodex-instruct.py7958CODE
LOWcodex-instruct.py8118CODE
LOWcodex-instruct.py8169CODE
LOWcodex-instruct.py8777CODE
LOWcodex-instruct.py8980CODE
LOWcodex-instruct.py9159CODE
LOWcodex-instruct.py9242CODE
LOWcodex-instruct.py9385CODE
LOWcodex-instruct.py9500CODE
LOWcodex-instruct.py9697CODE
LOWcodex-instruct.py10129CODE
LOWcodex-instruct.py10592CODE
LOWcodex-instruct.py10728CODE
LOWcodex-instruct.py11007CODE
LOWcodex-instruct.py11315CODE
LOWcodex-instruct.py11808CODE
LOWcodex-instruct.py11964CODE
LOWcodex-instruct.py11987CODE
LOWcodex-instruct.py12040CODE
LOWcodex-instruct.py12243CODE
LOWcodex-instruct.py12478CODE
LOWcodex-instruct.py13158CODE
LOWcodex-instruct.py13482CODE
LOWcodex-instruct.py13678CODE
LOWcodex-instruct.py13772CODE
LOWcodex-instruct.py14433CODE
LOWcodex-instruct.py14503CODE
LOWcodex-instruct.py14529CODE
LOWcodex-instruct.py14655CODE
LOWcodex-instruct.py14786CODE
LOWcodex-instruct.py15048CODE
LOWcodex-instruct.py15252CODE
LOWcodex-instruct.py15829CODE
LOWcodex-instruct.py16554CODE
LOWcodex-instruct.py1467CODE
LOWcodex-instruct.py2717CODE
LOWcodex-instruct.py9108CODE
LOWcodex-instruct.py9201CODE
LOWcodex-instruct.py9545CODE
LOWtests/test_codex_instruct.py911CODE
LOWtests/test_scenario_integrity.py330CODE
LOWtests/test_platform_and_discovery.py364CODE
LOWtests/test_release_artifacts.py168CODE
LOWtests/test_scenario_recovery.py36CODE
LOWtests/test_scenario_bundle.py235CODE
15 more matches not shown…
Cross-Language Confusion4 hits · 25 pts
SeverityFileLineSnippetContext
HIGHtests/test_release_artifacts.py1286 assert workflow.count("ref: ${{ inputs.source_ref || github.sha }}") == 3CODE
HIGHtests/test_release_artifacts.py1288 assert "EXPECTED_COMMIT: ${{ inputs.expected_commit || github.sha }}" in workflowCODE
HIGHtests/test_desktop_candidate.py74 [Environment]::SetEnvironmentVariable("CODEX_HOME", $null, "Process")CODE
HIGHscripts/validate_desktop_candidate.py304 "cleared CODEX_HOME": r'^\s*\[Environment\]::SetEnvironmentVariable\("CODEX_HOME", \$null, "Process"\)$',CODE
Decorative Section Separators7 hits · 21 pts
SeverityFileLineSnippetContext
MEDIUMcodex-instruct.py51# ─── 内置 GPT 破限指令内容 ──────────────────────────────────────────────────COMMENT
MEDIUMcodex-instruct.py3941# ─── Target-local scenario deployment ───────────────────────────────────────COMMENT
MEDIUMcodex-instruct.py15904# ─── Channel B: fixture workspace scaffold ──────────────────────────────────COMMENT
MEDIUMgui/src/lib/parser.js768// ── 内部工具 ───────────────────────────────COMMENT
MEDIUMgui/src/views/Deploy.jsx267// ── 步骤 1:选择内容 ─────────────────────────COMMENT
MEDIUMgui/src/views/Deploy.jsx421// ── 步骤 2:预览(门禁在这里执行)─────────────COMMENT
MEDIUMgui/src/views/Deploy.jsx555// ── 步骤 3:确认执行 ──────────────────────────COMMENT
Unused Imports14 hits · 14 pts
SeverityFileLineSnippetContext
LOWfixture_packs/compchem_cantera/src/validator.py3CODE
LOWfixture_packs/compchem_cantera/src/task.py3CODE
LOWfixture_packs/compchem_cantera/src/task.py17CODE
LOWfixture_packs/aiml_llamaguard/tests/test_complete.py13CODE
LOWfixture_packs/aiml_llamaguard/src/validator.py3CODE
LOWfixture_packs/aiml_llamaguard/src/task.py3CODE
LOWfixture_packs/aiml_llamaguard/src/task.py25CODE
LOWfixture_packs/aiml_llamaguard/src/task.py26CODE
LOWfixture_packs/cyber_pwntools/src/task.py3CODE
LOWfixture_packs/cyber_pwntools/src/task.py22CODE
LOWtests/test_desktop_prerelease.py1CODE
LOWscripts/validate_desktop_candidate.py4CODE
LOWscripts/package_desktop_prerelease.py4CODE
LOWscripts/bump_version.py4CODE
Excessive Try-Catch Wrapping5 hits · 6 pts
SeverityFileLineSnippetContext
LOWcodex-instruct.py8578 except Exception as exc:CODE
LOWcodex-instruct.py8586 except Exception as exc:CODE
LOWscripts/package_desktop_prerelease.py348 except Exception:CODE
LOWscripts/run_scenario_bank.py1861 except Exception as exc:CODE
LOWscripts/run_prompt_bank_regression.py1353 except Exception as exc:CODE
Modern AI Meta-Vocabulary1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMcodex-instruct.py15904# ─── Channel B: fixture workspace scaffold ──────────────────────────────────COMMENT
Self-Referential Comments1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_bump_version.py73 "# This file is automatically @generated by Cargo.\n"CODE
Modern Structural Boilerplate4 hits · 2 pts
SeverityFileLineSnippetContext
LOWcodex-instruct.py1451 def set_file_times(self, path: Path, atime_ns: int, mtime_ns: int) -> None:CODE
LOWcodex-instruct.py2791 def set_file_times(self, path: Path, atime_ns: int, mtime_ns: int) -> None:CODE
LOWcodex-instruct.py13526def _update_uninstall_phase(state: UninstallState, phase: str) -> None:CODE
LOWcodex-instruct.py676def _set_output_language(value: str) -> None:STRING