AI-Driven Life Cycle (AI-DLC) adaptive workflow steering rules for AI coding agents
This report presents the forensic synthetic code analysis of awslabs/aidlc-workflows, a Python project with 4,212 GitHub stars. SynthScan v2.0 examined 49,230 lines of code across 279 source files, recording 900 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 34.9 places this repository in the Strong AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 900 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | .markdownlint-cli2.yaml | 7 | # ============================================================ | COMMENT |
| MEDIUM | .markdownlint-cli2.yaml | 9 | # ============================================================ | COMMENT |
| MEDIUM | .markdownlint-cli2.yaml | 23 | # ============================================================ | COMMENT |
| MEDIUM | .markdownlint-cli2.yaml | 25 | # ============================================================ | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 32 | # ─────────────────────────── paths ─────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 36 | # ── Health ───────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 50 | # ── Arithmetic ───────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 230 | # ── Powers & Roots ───────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 359 | # ── Trigonometry ─────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 660 | # ── Logarithmic ─────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 790 | # ── Statistics ───────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 1015 | # ── Constants ────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 1126 | # ── Conversions ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 1227 | # ── Error cases (spec-level) ────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 30 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 32 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 135 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 139 | # ── Health ─────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 151 | # ── Auth ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 208 | # ── Books (Catalog) ───────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 383 | # ── Checkouts (Lending) ───────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 448 | # ── Holds ──────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 508 | # ── Fees ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 535 | # ── Members ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 571 | # ── Reports ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 606 | # ── 404 Catch-all ─────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 58 | # ── helpers ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 305 | # ── stages ─────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 561 | # ── CLI ────────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 671 | # ── Test mode ──────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 676 | # ── Resolve defaults from config YAML when not provided on CLI ────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 696 | # ── Optional tool paths from config ───────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 699 | # ── Resolve scenario and apply defaults ────────────────────────────── | COMMENT |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 717 | # ── Evaluate-only mode ─────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 771 | # ── Full pipeline ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_evaluation.py | 839 | # ── Summary ────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_batch_evaluation.py | 329 | # ── Resolve defaults from base config YAML ──────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_batch_evaluation.py | 345 | # ── Select models ───────────────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_extension_test.py | 140 | # =============================================== | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 217 | # ── Resolve defaults from config YAML when not provided on CLI ────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 236 | # ── Resolve AIDLC rules config ──────────────────────────────────────── | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 261 | # ── Setup AIDLC rules (git clone or local copy) ───────────────────── | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 24 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 72 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 74 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 121 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 123 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 153 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …valuator/packages/quantitative/tests/test_analyzers.py | 155 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 78 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 80 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 131 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 133 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 189 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 191 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 235 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …or/packages/quantitative/src/quantitative/analyzers.py | 284 | # --------------------------------------------------------------------------- | COMMENT |
| 174 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 11 | ### Step 1: Project Structure Setup | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 20 | ### Step 2: Engine — Custom Exceptions | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 23 | ### Step 3: Engine — Arithmetic Operations | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 27 | ### Step 4: Engine — Powers and Roots | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 31 | ### Step 5: Engine — Trigonometry | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 36 | ### Step 6: Engine — Logarithmic Operations | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 40 | ### Step 7: Engine — Statistics | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 44 | ### Step 8: Engine — Constants | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 48 | ### Step 9: Engine — Unit Conversions | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 52 | ### Step 10: Models — Request Models | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 55 | ### Step 11: Models — Response Models | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 58 | ### Step 12: Routes — Arithmetic | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 61 | ### Step 13: Routes — Powers | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 64 | ### Step 14: Routes — Trigonometry | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 67 | ### Step 15: Routes — Logarithmic | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 70 | ### Step 16: Routes — Statistics | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 73 | ### Step 17: Routes — Constants | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 76 | ### Step 18: Routes — Conversions | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 79 | ### Step 19: Application Entry Point | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 82 | ### Step 20: Tests — Engine Unit Tests | COMMENT |
| LOW⚡ | …cs/construction/plans/sci-calc-code-generation-plan.md | 91 | ### Step 21: Tests — API Integration Tests | COMMENT |
| LOW | …valuator/packages/qualitative/tests/test_comparator.py | 37 | "# Code Plan\n## Step 1: Setup\nCreate project structure.\n" | CODE |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 11 | ## Step 1: Multi-Package Discovery | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 46 | ## Step 2: Generate Business Overview Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 67 | ## Step 3: Generate Architecture Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 101 | ## Step 4: Generate Code Structure Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 134 | ## Step 5: Generate API Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 162 | ## Step 6: Generate Component Inventory | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 189 | ## Step 7: Generate Technology Stack Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 212 | ## Step 8: Generate Dependencies Documentation | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 233 | ## Step 9: Generate Code Quality Assessment | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 258 | ## Step 10: Create Timestamp File | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 280 | ## Step 11: Update State Tracking | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 290 | ## Step 12: Present Completion Message to User | COMMENT |
| LOW | …ws-aidlc-rule-details/inception/reverse-engineering.md | 308 | ## Step 13: Wait for User Approval | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 146 | ## Step 4: Include Mandatory Story Artifacts in Plan | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 154 | ## Step 5: Present Story Options | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 164 | ## Step 6: Store Story Plan | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 170 | ## Step 7: Request User Input | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 176 | ## Step 8: Collect Answers | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 181 | ## Step 9: ANALYZE ANSWERS (MANDATORY) | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 191 | ## Step 10: MANDATORY Follow-up Questions | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 205 | ## Step 11: Avoid Implementation Details | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 211 | ## Step 12: Log Approval Prompt | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 216 | ## Step 13: Wait for Explicit Approval of Plan | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 221 | ## Step 14: Record Approval Response | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 230 | ## Step 15: Load Story Generation Plan | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 235 | ## Step 16: Execute Current Step | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 241 | ## Step 17: Update Progress | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 246 | ## Step 18: Continue or Complete Generation | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 251 | ## Step 19: Log Approval Prompt | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 256 | ## Step 20: Present Completion Message | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 289 | ## Step 21: Wait for Explicit Approval of Generated Stories | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 294 | ## Step 22: Record Approval Response | COMMENT |
| LOW⚡ | …rules/aws-aidlc-rule-details/inception/user-stories.md | 299 | ## Step 23: Update Progress | COMMENT |
| LOW | …rules/aws-aidlc-rule-details/inception/user-stories.md | 67 | ## Step 1: Validate User Stories Need (MANDATORY) | COMMENT |
| LOW | …rules/aws-aidlc-rule-details/inception/user-stories.md | 118 | ## Step 2: Create Story Plan | COMMENT |
| LOW | …rules/aws-aidlc-rule-details/inception/user-stories.md | 124 | ## Step 3: Generate Context-Appropriate Questions | COMMENT |
| LOW | …-aidlc-rule-details/inception/requirements-analysis.md | 15 | ### Step 1: Load Reverse Engineering Context (if available) | COMMENT |
| LOW | …-aidlc-rule-details/inception/requirements-analysis.md | 23 | ### Step 2: Analyze User Request (Intent Analysis) | COMMENT |
| 109 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …g-inputs/example-tech-env-scientific-calculator-api.md | 595 | def test_pythagorean_identity(self, x: float) -> None: | CODE |
| LOW | …g-inputs/example-tech-env-scientific-calculator-api.md | 925 | def test_sin_invalid_angle_mode(self, client: TestClient) -> None: | CODE |
| LOW⚡ | …g-inputs/example-tech-env-scientific-calculator-api.md | 1064 | def test_log_of_zero_raises_domain_error(self) -> None: | CODE |
| LOW⚡ | …g-inputs/example-tech-env-scientific-calculator-api.md | 1069 | def test_log_of_negative_raises_domain_error(self) -> None: | CODE |
| LOW⚡ | …g-inputs/example-tech-env-scientific-calculator-api.md | 1074 | def test_log_base_zero_raises_domain_error(self) -> None: | CODE |
| LOW⚡ | …g-inputs/example-tech-env-scientific-calculator-api.md | 1079 | def test_log_base_one_raises_domain_error(self) -> None: | CODE |
| LOW⚡ | …g-inputs/example-tech-env-scientific-calculator-api.md | 1084 | def test_log_base_negative_raises_domain_error(self) -> None: | CODE |
| LOW | …g-inputs/example-tech-env-scientific-calculator-api.md | 1111 | def test_log_product_identity(self, a: float, b: float) -> None: | CODE |
| LOW | …/example-minimal-tech-env-scientific-calculator-api.md | 126 | def test_log_of_negative_raises_domain_error() -> None: | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_batch_evaluation.py | 69 | def _find_latest_timestamped_run(runs_dir: Path) -> Path | None: | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 72 | def run_evaluation_with_config( | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 258 | def generate_extension_comparison( | CODE |
| LOW | …ripts/aidlc-evaluator/scripts/run_comparison_report.py | 121 | def generate_comparison_markdown( | CODE |
| LOW | …c-evaluator/packages/quantitative/tests/test_models.py | 6 | def test_compute_summary_lint_only(): | CODE |
| LOW | …c-evaluator/packages/quantitative/tests/test_models.py | 25 | def test_compute_summary_security_only(): | CODE |
| LOW | …c-evaluator/packages/quantitative/tests/test_models.py | 43 | def test_compute_summary_both(): | CODE |
| LOW | …c-evaluator/packages/quantitative/tests/test_models.py | 57 | def test_compute_summary_unavailable_tool(): | CODE |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 77 | def test_handles_missing_sections(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/reporting/tests/test_baseline.py | 154 | def test_fewer_lint_errors_is_improvement(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/reporting/tests/test_baseline.py | 161 | def test_more_lint_errors_is_regression(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/reporting/tests/test_baseline.py | 168 | def test_fewer_tokens_is_improvement(self): | CODE |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 190 | def test_promote_creates_file(self, tmp_path): | CODE |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 208 | def test_markdown_includes_comparison(self): | CODE |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 223 | def test_html_includes_comparison(self): | CODE |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 238 | def test_no_comparison_when_absent(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 98 | def test_contains_verdict_table(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 104 | def test_contains_token_usage(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 109 | def test_contains_qualitative_score(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 114 | def test_contains_lint_findings(self): | CODE |
| LOW | …idlc-evaluator/packages/reporting/tests/test_render.py | 133 | def test_contains_verdict_cards(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 144 | def test_contains_handoff_timeline(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 149 | def test_contains_qualitative_bars(self): | CODE |
| LOW⚡ | …idlc-evaluator/packages/reporting/tests/test_render.py | 154 | def test_contains_lint_findings(self): | CODE |
| LOW | …c-evaluator/packages/reporting/tests/test_collector.py | 112 | def test_collect_all_artifacts(tmp_path): | CODE |
| LOW | …c-evaluator/packages/reporting/tests/test_collector.py | 144 | def test_collect_missing_artifacts(tmp_path): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_sparkline.py | 58 | def test_zero_first_positive_last(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_yaml.py | 56 | def test_run_type_serialized_as_value(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_yaml.py | 78 | def test_infra_failure_serialized(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_yaml.py | 92 | def test_infra_failure_reason_serialized_as_value(self): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 40 | def test_contains_all_sections(self): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 55 | def test_contains_version_labels(self): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 78 | def test_no_banner_when_no_infra_failure(self): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 83 | def test_banner_when_infra_failure(self): | CODE |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 99 | def test_section_f_shows_infra_failure_column(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 11 | def test_no_regressions_passes(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 18 | def test_contract_test_regression(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 25 | def test_unit_test_failures_regression(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 32 | def test_qualitative_regression(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 39 | def test_small_qualitative_drop_not_regression(self): | CODE |
| LOW⚡ | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 45 | def test_fewer_than_two_runs_passes(self): | CODE |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 99 | def test_latest_infra_failure_skips_regression(self): | CODE |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 119 | def test_previous_infra_failure_finds_older_comparison(self): | CODE |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 136 | def test_non_infra_failure_still_detects_regression(self): | CODE |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 144 | def test_all_runs_infra_failure_gate_passes(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 40 | def test_contains_section_anchors(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 55 | def test_contains_version_labels(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 79 | def test_no_banner_when_no_infra_failure(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 84 | def test_banner_when_infra_failure(self): | CODE |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 99 | def test_section_f_shows_infra_badge(self): | CODE |
| LOW | …-evaluator/packages/trend-reports/tests/test_models.py | 24 | def test_parse_without_v_prefix(self): | CODE |
| 128 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/aidlc-evaluator/run.py | 52 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_evaluation.py | 37 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_batch_evaluation.py | 26 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_trend_report.py | 11 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 32 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_ide_evaluation.py | 17 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_ide_evaluation.py | 20 | CODE | |
| LOW | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 23 | CODE | |
| LOW | …ripts/aidlc-evaluator/scripts/run_comparison_report.py | 18 | CODE | |
| LOW | …-evaluator/packages/quantitative/tests/test_scanner.py | 3 | CODE | |
| LOW | …or/packages/quantitative/src/quantitative/analyzers.py | 8 | CODE | |
| LOW | …ator/packages/quantitative/src/quantitative/scanner.py | 3 | CODE | |
| LOW | …uator/packages/quantitative/src/quantitative/models.py | 3 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 12 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 12 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 12 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 12 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 13 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 13 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 13 | CODE | |
| LOW | …tor/packages/quantitative/src/quantitative/__main__.py | 3 | CODE | |
| LOW | …lc-evaluator/packages/reporting/tests/test_baseline.py | 7 | CODE | |
| LOW | …idlc-evaluator/packages/reporting/tests/test_render.py | 3 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/baseline.py | 8 | CODE | |
| LOW | …valuator/packages/reporting/src/reporting/collector.py | 3 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 13 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 23 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 23 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 24 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 24 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 25 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 25 | CODE | |
| LOW | …valuator/packages/reporting/src/reporting/render_md.py | 3 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__main__.py | 3 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/__main__.py | 9 | CODE | |
| LOW | …luator/packages/reporting/src/reporting/render_html.py | 3 | CODE | |
| LOW | …dlc-evaluator/packages/trend-reports/tests/conftest.py | 3 | CODE | |
| LOW | …aluator/packages/trend-reports/tests/test_sparkline.py | 3 | CODE | |
| LOW | …uator/packages/trend-reports/tests/test_render_yaml.py | 3 | CODE | |
| LOW | …aluator/packages/trend-reports/tests/test_render_md.py | 7 | CODE | |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_gate.py | 3 | CODE | |
| LOW | …uator/packages/trend-reports/tests/test_render_html.py | 6 | CODE | |
| LOW | …-evaluator/packages/trend-reports/tests/test_models.py | 3 | CODE | |
| LOW | …aluator/packages/trend-reports/tests/test_collector.py | 6 | CODE | |
| LOW | …evaluator/packages/trend-reports/tests/test_fetcher.py | 6 | CODE | |
| LOW | …lc-evaluator/packages/trend-reports/tests/test_main.py | 3 | CODE | |
| LOW | …ackages/trend-reports/src/trend_reports/render_yaml.py | 3 | CODE | |
| LOW | …tor/packages/trend-reports/src/trend_reports/models.py | 3 | CODE | |
| LOW | …/packages/trend-reports/src/trend_reports/collector.py | 3 | CODE | |
| LOW | …r/packages/trend-reports/src/trend_reports/__init__.py | 12 | CODE | |
| LOW | …r/packages/trend-reports/src/trend_reports/__init__.py | 12 | CODE | |
| LOW | …r/packages/trend-reports/src/trend_reports/__init__.py | 12 | CODE | |
| LOW | …r/packages/trend-reports/src/trend_reports/__init__.py | 12 | CODE | |
| 105 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | scripts/aidlc-evaluator/run.py | 164 | print(f"Error: script not found: {script}", file=sys.stderr) | CODE |
| LOW | scripts/aidlc-evaluator/run.py | 186 | except Exception as e: | CODE |
| MEDIUM | scripts/aidlc-evaluator/run.py | 187 | print(f"Error running {script.name}: {e}", file=sys.stderr) | CODE |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 720 | print(f"Error: path not found: {args.evaluate_only}", file=sys.stderr) | CODE |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 723 | print(f"Error: golden baseline not found: {args.golden}", file=sys.stderr) | CODE |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 773 | print(f"Error: vision file not found: {args.vision}", file=sys.stderr) | CODE |
| MEDIUM⚡ | scripts/aidlc-evaluator/scripts/run_evaluation.py | 776 | print(f"Error: golden baseline not found: {args.golden}", file=sys.stderr) | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 244 | except Exception as e: | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 574 | except Exception as e: | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_ide_evaluation.py | 90 | except Exception as e: | CODE |
| LOW | …aidlc-evaluator/scripts/regenerate_extension_report.py | 25 | except Exception as e: | CODE |
| MEDIUM | …aidlc-evaluator/scripts/regenerate_extension_report.py | 55 | print(f"Error: {summary_path} not found", file=sys.stderr) | CODE |
| LOW | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 202 | except Exception as e: | CODE |
| LOW | …ripts/aidlc-evaluator/scripts/run_comparison_report.py | 107 | except Exception as e: | CODE |
| MEDIUM | …tor/packages/quantitative/src/quantitative/__main__.py | 36 | print(f"Error: workspace not found: {args.workspace}", file=sys.stderr) | CODE |
| MEDIUM | …evaluator/packages/reporting/src/reporting/__main__.py | 21 | print(f"Error: run folder not found: {args.run_folder}", file=sys.stderr) | CODE |
| MEDIUM | …evaluator/packages/reporting/src/reporting/__main__.py | 48 | print(f"Error: run folder not found: {args.run_folder}", file=sys.stderr) | CODE |
| MEDIUM | …evaluator/packages/reporting/src/reporting/__main__.py | 64 | print(f"Error: run folder not found: {args.run_folder}", file=sys.stderr) | CODE |
| MEDIUM | …evaluator/packages/reporting/src/reporting/__main__.py | 67 | print(f"Error: baseline not found: {args.baseline}", file=sys.stderr) | CODE |
| MEDIUM | …r/packages/trend-reports/src/trend_reports/__main__.py | 117 | print(f"Error: {exc}", file=sys.stderr) | CODE |
| LOW | …kages/cli-harness/src/cli_harness/adapters/kiro_cli.py | 270 | except Exception as exc: | CODE |
| LOW | …es/cli-harness/src/cli_harness/adapters/claude_code.py | 312 | except Exception as exc: | CODE |
| LOW⚡ | …ckages/ide-harness/src/ide_harness/adapters/copilot.py | 190 | except Exception as exc: | CODE |
| LOW | …kages/ide-harness/src/ide_harness/adapters/windsurf.py | 273 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …kages/ide-harness/src/ide_harness/adapters/windsurf.py | 282 | except Exception: # noqa: BLE001 | CODE |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 345 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 354 | except Exception: # noqa: BLE001 | CODE |
| LOW | …/packages/ide-harness/src/ide_harness/adapters/kiro.py | 274 | except Exception as exc: | CODE |
| LOW | …ackages/ide-harness/src/ide_harness/adapters/cursor.py | 220 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | …uator/packages/contracttest/src/contracttest/runner.py | 97 | except Exception: | CODE |
| LOW | …uator/packages/contracttest/src/contracttest/runner.py | 147 | except Exception as e: | CODE |
| MEDIUM | …tor/packages/contracttest/src/contracttest/__main__.py | 57 | print(f"Error: workspace not found: {args.workspace}", file=sys.stderr) | CODE |
| MEDIUM | …tor/packages/contracttest/src/contracttest/__main__.py | 60 | print(f"Error: OpenAPI spec not found: {args.openapi}", file=sys.stderr) | CODE |
| MEDIUM | …uator/packages/qualitative/src/qualitative/__main__.py | 68 | print(f"Error: reference path does not exist: {args.reference}", file=sys.stderr) | CODE |
| MEDIUM | …uator/packages/qualitative/src/qualitative/__main__.py | 71 | print(f"Error: candidate path does not exist: {args.candidate}", file=sys.stderr) | CODE |
| LOW | …aluator/packages/qualitative/src/qualitative/scorer.py | 196 | except Exception: | STRING |
| MEDIUM | …c-evaluator/packages/execution/src/aidlc_runner/cli.py | 130 | print(f"Error: Vision file not found: {args.vision}", file=sys.stderr) | CODE |
| MEDIUM | …c-evaluator/packages/execution/src/aidlc_runner/cli.py | 135 | print(f"Error: Technical environment file not found: {args.tech_env}", file=sys.stderr) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | .gitleaks-baseline.json | 19 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | .gitleaks-baseline.json | 40 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | .gitleaks-baseline.json | 61 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | .gitleaks-baseline.json | 82 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | .gitleaks-baseline.json | 103 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | .gitleaks-baseline.json | 124 | "Message": "feat: add AIDLC Evaluation \u0026 Reporting Framework (#115)\n\n* feat: add aidlc-evaluator framework\n\nE | CODE |
| MEDIUM | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 4 | # tech-env.md. The contract-test harness reads this spec, discovers every | COMMENT |
| MEDIUM | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 4 | # tech-env.md. The contract-test harness reads this spec, discovers every | COMMENT |
| MEDIUM⚡ | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 33 | # The contract test harness will call setup endpoints (register + login) before | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_ide_evaluation.py | 28 | # Add ide-harness and shared packages to path | COMMENT |
| MEDIUM | scripts/aidlc-evaluator/scripts/run_cli_evaluation.py | 41 | # Add cli-harness to path | COMMENT |
| MEDIUM | …r/packages/cli-harness/src/cli_harness/orchestrator.py | 16 | REPO_ROOT = Path(__file__).resolve().parents[4] # packages/cli-harness/src/cli_harness -> repo root | CODE |
| MEDIUM | …r/packages/ide-harness/src/ide_harness/orchestrator.py | 16 | REPO_ROOT = Path(__file__).resolve().parents[4] # packages/ide-harness/src/ide_harness -> repo root | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | CONTRIBUTING.md | 68 | ### AI-generated contributions | COMMENT |
| HIGH | …s/aidlc-evaluator/test_cases/sci-calc/golden-report.md | 419 | *Report generated by aidlc-reporting v0.1.0* | COMMENT |
| HIGH | …aidlc-evaluator/test_cases/sci-calc/golden-report.html | 464 | <div class="footer">Generated by aidlc-reporting v0.1.0</div> | CODE |
| HIGH | …valuator/packages/reporting/src/reporting/render_md.py | 421 | w(f"*Report generated by aidlc-reporting v0.1.0*") | CODE |
| HIGH | …luator/packages/reporting/src/reporting/render_html.py | 576 | w(f'<div class="footer">Generated by aidlc-reporting v0.1.0</div>') | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …kages/ide-harness/src/ide_harness/adapters/windsurf.py | 0 | build the ``extra`` dict for :class:`adapterresult`. | STRING |
| HIGH | …packages/ide-harness/src/ide_harness/adapters/cline.py | 0 | build the ``extra`` dict for :class:`adapterresult`. | STRING |
| HIGH | …ackages/ide-harness/src/ide_harness/adapters/cursor.py | 0 | build the ``extra`` dict for :class:`adapterresult`. | STRING |
| HIGH | …kages/ide-harness/src/ide_harness/adapters/windsurf.py | 0 | return the aidlc-docs path if it was produced, else ``none``. | STRING |
| HIGH | …packages/ide-harness/src/ide_harness/adapters/cline.py | 0 | return the aidlc-docs path if it was produced, else ``none``. | STRING |
| HIGH | …ackages/ide-harness/src/ide_harness/adapters/cursor.py | 0 | return the aidlc-docs path if it was produced, else ``none``. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 258 | CODE | |
| LOW | …aidlc-evaluator/scripts/regenerate_extension_report.py | 39 | CODE | |
| LOW | …ripts/aidlc-evaluator/scripts/run_comparison_report.py | 121 | CODE | |
| LOW | …or/packages/quantitative/src/quantitative/analyzers.py | 375 | CODE | |
| LOW | …evaluator/packages/reporting/src/reporting/baseline.py | 91 | CODE | |
| LOW | …valuator/packages/reporting/src/reporting/render_md.py | 78 | CODE | |
| LOW | …luator/packages/reporting/src/reporting/render_html.py | 226 | CODE | |
| LOW | …/packages/trend-reports/src/trend_reports/render_md.py | 247 | CODE | |
| LOW | …r/packages/trend-reports/src/trend_reports/__main__.py | 123 | CODE | |
| LOW | …ackages/trend-reports/src/trend_reports/render_html.py | 942 | CODE | |
| LOW | …or/packages/trend-reports/src/trend_reports/fetcher.py | 205 | CODE | |
| LOW | …tor/packages/cli-harness/src/cli_harness/normalizer.py | 176 | CODE | |
| LOW | …kages/cli-harness/src/cli_harness/adapters/kiro_cli.py | 66 | CODE | |
| LOW | …es/cli-harness/src/cli_harness/adapters/claude_code.py | 36 | CODE | |
| LOW | …es/cli-harness/src/cli_harness/adapters/claude_code.py | 87 | CODE | |
| LOW | …ator/packages/shared/src/shared/credential_scrubber.py | 114 | CODE | |
| LOW | …tor/packages/ide-harness/src/ide_harness/normalizer.py | 109 | CODE | |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 140 | CODE | |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 371 | CODE | |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 471 | CODE | |
| LOW | …/packages/ide-harness/src/ide_harness/adapters/kiro.py | 100 | CODE | |
| LOW | …uator/packages/contracttest/src/contracttest/runner.py | 44 | CODE | |
| LOW | …uator/packages/contracttest/src/contracttest/runner.py | 118 | CODE | |
| LOW | …uator/packages/contracttest/src/contracttest/server.py | 240 | CODE | |
| LOW | …aluator/packages/execution/src/aidlc_runner/metrics.py | 75 | CODE | |
| LOW | …luator/packages/execution/src/aidlc_runner/post_run.py | 210 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …tor/packages/quantitative/src/quantitative/__init__.py | 15 | __all__ = [ | CODE |
| LOW | …evaluator/packages/reporting/src/reporting/__init__.py | 27 | __all__ = [ | CODE |
| LOW | …/packages/trend-reports/src/trend_reports/collector.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | …r/packages/trend-reports/src/trend_reports/__init__.py | 35 | __all__ = [ | CODE |
| LOW | …or/packages/trend-reports/src/trend_reports/fetcher.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | …uator/packages/cli-harness/src/cli_harness/__init__.py | 10 | __all__ = [ | CODE |
| LOW | …kages/cli-harness/src/cli_harness/adapters/kiro_cli.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | …es/cli-harness/src/cli_harness/adapters/claude_code.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | …aidlc-evaluator/packages/shared/src/shared/scenario.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | …uator/packages/ide-harness/src/ide_harness/__init__.py | 11 | __all__ = [ | CODE |
| LOW | …ckages/ide-harness/src/ide_harness/adapters/copilot.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | …kages/ide-harness/src/ide_harness/adapters/windsurf.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | …packages/ide-harness/src/ide_harness/adapters/cline.py | 47 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | …/packages/ide-harness/src/ide_harness/adapters/kiro.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | …ackages/ide-harness/src/ide_harness/adapters/cursor.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW | …tor/packages/contracttest/src/contracttest/__init__.py | 20 | __all__ = [ | CODE |
| LOW | …uator/packages/qualitative/src/qualitative/__init__.py | 11 | __all__ = [ | CODE |
| LOW | …aluator/packages/qualitative/src/qualitative/scorer.py | 153 | logger = logging.getLogger(__name__) | STRING |
| LOW | …valuator/packages/execution/src/aidlc_runner/config.py | 11 | logger = logging.getLogger(__name__) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …g-inputs/example-tech-env-scientific-calculator-api.md | 978 | Compute the logarithm of a value with the given base. Args: value: The number to compute the logarithm of. | STRING |
| HIGH | …ator/packages/shared/src/shared/credential_scrubber.py | 83 | Remove sensitive credentials from text using pattern matching. Detects common credential formats (AWS keys, JWTs, A | STRING |
| HIGH | …ator/packages/shared/src/shared/credential_scrubber.py | 115 | Scrub credential values from a dictionary. Recursively processes dictionary values, scrubbing credentials from stri | STRING |
| HIGH | …ckages/ide-harness/src/ide_harness/adapters/copilot.py | 243 | Run the Copilot CLI in headless (``-p``) mode. Args: prompt: The full AIDLC prompt text. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | scripts/aidlc-evaluator/scripts/run_extension_test.py | 215 | # Create a placeholder directory for the log | COMMENT |
| MEDIUM⚡ | …aluator/packages/trend-reports/tests/test_collector.py | 580 | # Create a directory bundle | COMMENT |
| MEDIUM | …aluator/packages/trend-reports/tests/test_collector.py | 609 | # Create a zip bundle | COMMENT |
| MEDIUM | …lc-evaluator/packages/execution/tests/test_post_run.py | 314 | # Create a minimal Python project that will fail install but still produce output | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .markdownlint-cli2.yaml | 1 | # markdownlint-cli2 configuration | COMMENT |
| LOW | .grype.yaml | 1 | # Grype configuration | COMMENT |
| LOW | .checkov.yaml | 1 | # Checkov configuration | COMMENT |
| LOW | .checkov.yaml | 21 | # | COMMENT |
| LOW | …ripts/aidlc-evaluator/test_cases/sci-calc/openapi.yaml | 1 | # OpenAPI 3.1 Specification — Scientific Calculator API | COMMENT |
| LOW | …pts/aidlc-evaluator/test_cases/all-stages/openapi.yaml | 1 | # BookShelf Community Library API - Contract Test Specification | COMMENT |
| LOW | scripts/aidlc-evaluator/scripts/run_extension_test.py | 141 | # The extension hook feature is still under development. Once the | COMMENT |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 221 | COMMENT | |
| LOW | .github/workflows/release.yml | 1 | # Release Pipeline | COMMENT |
| LOW | .github/workflows/release-pr.yml | 1 | # Release PR | COMMENT |
| LOW | .github/workflows/codeql.yml | 1 | # For most projects, this workflow file will not need changing; you simply need | COMMENT |
| LOW | .github/workflows/codeql.yml | 61 | COMMENT | |
| LOW | .github/workflows/tag-on-merge.yml | 1 | # Tag Release | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | docs/GENERATED_DOCS_REFERENCE.md | 43 | │ ├── services.md # Service definitions, responsibilities, and orchestration p | CODE |
| MEDIUM | scripts/aidlc-evaluator/docs/file-structure.md | 36 | │ │ │ ├── comparator.py # Comparison orchestration | CODE |
| MEDIUM | scripts/aidlc-evaluator/docs/ide-harness-design.md | 171 | orchestrator.py # Run orchestration (invoke adapter + evaluation) | CODE |
| MEDIUM | scripts/aidlc-evaluator/packages/execution/README.md | 220 | │ ├── runner.py # Run folder creation, rules setup, swarm orchestration | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …kages/cli-harness/src/cli_harness/adapters/kiro_cli.py | 180 | # Check if aidlc-docs looks complete (has construction phase files) | COMMENT |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 510 | # Check if VS Code has exited | COMMENT |
| LOW | …packages/ide-harness/src/ide_harness/adapters/cline.py | 517 | # Check if output was produced before exit | COMMENT |
| LOW | …uator/packages/contracttest/src/contracttest/server.py | 212 | # Check if the process/container has died | COMMENT |
| LOW | .github/workflows/release-pr.yml | 112 | # Check if branch already exists (local or remote) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | …ckages/ide-harness/src/ide_harness/adapters/copilot.py | 180 | elapsed = time.monotonic() - start # type: ignore[possibly-undefined] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …dlc-evaluator/packages/trend-reports/tests/conftest.py | 23 | CODE | |
| LOW | …r/packages/cli-harness/src/cli_harness/orchestrator.py | 105 | CODE | |
| LOW | …r/packages/ide-harness/src/ide_harness/orchestrator.py | 19 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | .github/workflows/codeql.yml | 56 | # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize how | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .github/workflows/release-pr.yml | 9 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …valuator/packages/qualitative/tests/test_comparator.py | 37 | "# Code Plan\n## Step 1: Setup\nCreate project structure.\n" | CODE |