Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
This report presents the forensic synthetic code analysis of ifixai-ai/iFixAi, a Python project with 11,365 GitHub stars. SynthScan v2.0 examined 72,478 lines of code across 382 source files, recording 663 pattern matches distributed across 14 syntactic categories. The overall adjusted score of 19.2 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 663 distinct pattern matches across 14 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | ifixai/inspections/judge_probe.py | 0 | one driven turn of a trajectory (typed, not a bare tuple). | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | one driven turn of a trajectory (typed, not a bare tuple). | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | one driven turn of a trajectory (typed, not a bare tuple). | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | one driven turn of a trajectory (typed, not a bare tuple). | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | one driven turn of a trajectory (typed, not a bare tuple). | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → incon | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → incon | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → incon | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → incon | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …ai/inspections/c02_low_confidence_abstention/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …inspections/x11_pre_action_confirmation_gate/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …i/inspections/x04_detection_performance_gate/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …pections/c11_operational_outcome_conformance/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | ifixai/inspections/c05_human_fallback_routing/runner.py | 0 | build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict on | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict on | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict on | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict on | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scored | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scored | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scored | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scored | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …i/inspections/m07_cross_org_delegation_scope/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …ai/inspections/c02_low_confidence_abstention/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …i/inspections/p08_self_audit_trail_integrity/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …inspections/x11_pre_action_confirmation_gate/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …i/inspections/x04_detection_performance_gate/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …pections/c11_operational_outcome_conformance/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | ifixai/inspections/c05_human_fallback_routing/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …i/inspections/m06_model_identity_attestation/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …pections/m02_standing_authority_revalidation/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …nspections/m03_finetune_corpus_contamination/runner.py | 0 | pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corp | STRING |
| HIGH | …ctions/p13_hidden_side_objective_persistence/runner.py | 0 | unscorable mid-trajectory provider failure — see build_unscorable_item. | STRING |
| HIGH | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 0 | unscorable mid-trajectory provider failure — see build_unscorable_item. | STRING |
| HIGH | ifixai/inspections/p27_privilege_creep/runner.py | 0 | unscorable mid-trajectory provider failure — see build_unscorable_item. | STRING |
| HIGH | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 0 | unscorable mid-trajectory provider failure — see build_unscorable_item. | STRING |
| HIGH | …i/inspections/m07_cross_org_delegation_scope/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …ai/inspections/c02_low_confidence_abstention/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …inspections/x11_pre_action_confirmation_gate/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …i/inspections/x04_detection_performance_gate/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …pections/c11_operational_outcome_conformance/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | ifixai/inspections/c05_human_fallback_routing/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …i/inspections/m06_model_identity_attestation/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …pections/m02_standing_authority_revalidation/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …nspections/m03_finetune_corpus_contamination/runner.py | 0 | call screen_training_corpus for one probe (under the concurrency bound) and build its evidence item. a none return (prov | STRING |
| HIGH | …i/inspections/m07_cross_org_delegation_scope/runner.py | 0 | probe items that count toward the score: adverse band, no provider-contract error, and not a non-scored diagnostic. the | STRING |
| HIGH | …i/inspections/m06_model_identity_attestation/runner.py | 0 | probe items that count toward the score: adverse band, no provider-contract error, and not a non-scored diagnostic. the | STRING |
| HIGH | …pections/m02_standing_authority_revalidation/runner.py | 0 | probe items that count toward the score: adverse band, no provider-contract error, and not a non-scored diagnostic. the | STRING |
| HIGH | …ai/inspections/c02_low_confidence_abstention/runner.py | 0 | probe items that count toward the score: adverse band, no provider-contract error, and not a non-scored diagnostic. the | STRING |
| HIGH | ifixai/inspections/c05_human_fallback_routing/runner.py | 0 | probe items that count toward the score: adverse band, no provider-contract error, and not a non-scored diagnostic. the | STRING |
| 58 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …ctions/p13_hidden_side_objective_persistence/runner.py | 466 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/p13_hidden_side_objective_persistence/runner.py | 567 | # ── trajectory collection + judging ────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/p13_hidden_side_objective_persistence/runner.py | 645 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/m07_cross_org_delegation_scope/runner.py | 435 | # ── probe scoring ──────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/m07_cross_org_delegation_scope/runner.py | 581 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/m07_cross_org_delegation_scope/runner.py | 634 | # ── sentinels ──────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ai/inspections/c02_low_confidence_abstention/runner.py | 429 | # ── probe selection + scoring ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ai/inspections/c02_low_confidence_abstention/runner.py | 553 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ai/inspections/c02_low_confidence_abstention/runner.py | 591 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/p08_self_audit_trail_integrity/runner.py | 249 | # ── sweep ───────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/p08_self_audit_trail_integrity/runner.py | 320 | # ── the four scored checks ────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/p08_self_audit_trail_integrity/runner.py | 443 | # ── diagnostics (non-scored) ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/p08_self_audit_trail_integrity/runner.py | 586 | # ── builders & matchers ───────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/p08_self_audit_trail_integrity/runner.py | 708 | # ── action selection ──────────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 13 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 15 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 177 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 179 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 301 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 303 | # ------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …inspections/x11_pre_action_confirmation_gate/runner.py | 554 | # ── probe selection + scoring ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …inspections/x11_pre_action_confirmation_gate/runner.py | 708 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …inspections/x11_pre_action_confirmation_gate/runner.py | 740 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 570 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 690 | # ── trajectory collection + judging ────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 773 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 813 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/runner.py | 565 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/runner.py | 688 | # ── trajectory collection + judging ────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/runner.py | 836 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/runner.py | 876 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 17 | # ── sla_breach ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 52 | # ── cost_externalization ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 85 | # ── economic_viability_threat ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 120 | # ── safety_or_quality_floor_erosion ────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 155 | # ── resource_allocation_deprivation ────────────────────────────────────────── | COMMENT |
| MEDIUM | …ctions/s02_configurer_stakeholder_conflict/corpus.yaml | 190 | # ── consent_or_privacy_burden ───────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 63 | # ── constants ───────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 145 | # ── data types ──────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 246 | # ── inspection ──────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 543 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 661 | # ── probe send + judging ────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 780 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 814 | # ── diagnostics (non-scored evidence) ───────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/x04_detection_performance_gate/runner.py | 564 | # ── probe selection + scoring ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/x04_detection_performance_gate/runner.py | 742 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …i/inspections/x04_detection_performance_gate/runner.py | 774 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 577 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 707 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 741 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/c11_operational_outcome_conformance/runner.py | 544 | # ── probe selection + scoring ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/c11_operational_outcome_conformance/runner.py | 710 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | …pections/c11_operational_outcome_conformance/runner.py | 743 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/c05_human_fallback_routing/runner.py | 465 | # ── probe selection + scoring ──────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/c05_human_fallback_routing/runner.py | 609 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/c05_human_fallback_routing/runner.py | 647 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 605 | # ── corpus ────────────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 731 | # ── trajectory collection + judging ────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 877 | # ── fixture gate ───────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 917 | # ── diagnostics ────────────────────────────────────────────────────────────── | COMMENT |
| 21 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | conftest.py | 11 | def pytest_collection_modifyitems( | CODE |
| LOW | ifixai/quick_build.py | 33 | def collect_quick_build_context() -> QuickBuildContext: | CODE |
| LOW | ifixai/quick_build.py | 55 | def generate_fixture_from_context(context: QuickBuildContext, system_name: str = "My AI Assistant") -> Fixture: | CODE |
| LOW | ifixai/quick_build.py | 89 | def generate_fixture_from_profile( | CODE |
| LOW | ifixai/_version.py | 9 | def _read_pyproject_version_fallback() -> str | None: | CODE |
| LOW | ifixai/api.py | 43 | def _resolve_provider_with_governance( | CODE |
| LOW | ifixai/wizard.py | 114 | def generate_fixture_from_wizard( | CODE |
| LOW | ifixai/reporting/health.py | 83 | def measurement_failure_banner(health: _RunHealth) -> str | None: | CODE |
| LOW | ifixai/reporting/scorecard.py | 128 | def insufficient_evidence_warnings( | CODE |
| LOW | ifixai/reporting/scorecard.py | 143 | def exploratory_inspection_warnings( | CODE |
| LOW | ifixai/reporting/scorecard.py | 154 | def advisory_inspection_warnings( | CODE |
| LOW | ifixai/reporting/scorecard.py | 167 | def attestation_inspection_warnings( | CODE |
| LOW | ifixai/reporting/scorecard.py | 178 | def extraction_error_warnings( | CODE |
| LOW | ifixai/reporting/scorecard.py | 193 | def judge_substitution_warnings(judge_stats: dict | None) -> list[str]: | CODE |
| LOW | ifixai/reporting/scorecard.py | 513 | def build_category_scores_section( | CODE |
| LOW | ifixai/reporting/scorecard.py | 529 | def build_mandatory_minimums_section( | CODE |
| LOW | ifixai/reporting/scorecard.py | 548 | def build_test_results_section( | CODE |
| LOW | ifixai/reporting/scorecard.py | 647 | def _format_run_minimums_status(result: TestRunResult) -> str: | CODE |
| LOW | ifixai/reporting/scorecard.py | 707 | def render_mandatory_minimums(result: TestRunResult) -> str: | CODE |
| LOW | ifixai/reporting/scorecard.py | 773 | def _dominant_evaluation_path(br: TestResult) -> str: | CODE |
| LOW | ifixai/reporting/scorecard.py | 923 | def render_exploratory_section(result: TestRunResult) -> str: | CODE |
| LOW | ifixai/reporting/scorecard.py | 949 | def render_attestation_section(result: TestRunResult) -> str: | CODE |
| LOW | ifixai/reporting/scorecard.py | 976 | def render_regulatory_compliance( | CODE |
| LOW | ifixai/reporting/scorecard.py | 1003 | def render_consistency_warnings(result: TestRunResult) -> str: | CODE |
| LOW | ifixai/reporting/regulatory.py | 42 | def build_regulatory_json_section( | CODE |
| LOW | ifixai/reporting/regulatory.py | 57 | def get_test_regulatory_mappings( | CODE |
| LOW | ifixai/core/runner.py | 555 | async def _execute_single_inspection( | CODE |
| LOW | ifixai/core/discovery.py | 132 | def display_discovery_summary(result: DiscoveryResult) -> None: | CODE |
| LOW | ifixai/core/discovery.py | 188 | def build_fixture_from_discovery( | CODE |
| LOW | ifixai/core/types.py | 547 | def classify_detection_window( | CODE |
| LOW | ifixai/core/types.py | 618 | def check_gate_config_coherent(self) -> "ActionConfirmationRequest": | CODE |
| LOW | ifixai/core/types.py | 758 | def check_grant_record_coherent(self) -> "StandingActivationRequest": | CODE |
| LOW | ifixai/core/types.py | 821 | def classify_activation_authority( | CODE |
| LOW | ifixai/core/types.py | 861 | def collect_activation_staleness_reasons( | CODE |
| LOW | ifixai/core/types.py | 1054 | def collect_corpus_contamination_reasons( | CODE |
| LOW | ifixai/core/types.py | 1139 | def check_attestation_coherent(self) -> "ResponseIdentityClaim": | CODE |
| LOW | ifixai/core/types.py | 1244 | def classify_response_identity( | CODE |
| LOW | ifixai/core/types.py | 1296 | def collect_substitution_reasons(claim: ResponseIdentityClaim) -> list[str]: | CODE |
| LOW | ifixai/core/types.py | 1483 | def classify_delegation_scope( | CODE |
| LOW | ifixai/core/types.py | 1541 | def collect_delegation_scope_reasons(claim: DelegationHandoffClaim) -> list[str]: | CODE |
| LOW | ifixai/core/types.py | 1721 | def check_exclusion_flags_mutually_exclusive(self) -> "InspectionSpec": | CODE |
| LOW | ifixai/core/types.py | 1819 | def check_dimension_weights_sum_to_one(self) -> "AnalyticRubric": | CODE |
| LOW | ifixai/core/fixture_loader.py | 151 | def _normalize_fixture_format(raw: dict[str, Any]) -> dict[str, Any]: | CODE |
| LOW | ifixai/providers/governance_mixin.py | 183 | def _ensure_seeded_audit_records(self) -> None: | CODE |
| LOW | ifixai/providers/governance_mixin.py | 279 | async def get_configuration_version( | CODE |
| LOW | ifixai/providers/governance_mixin.py | 301 | async def get_governance_architecture( | CODE |
| LOW | ifixai/providers/governance_mixin.py | 445 | async def evaluate_confirmation_gate( | CODE |
| LOW | ifixai/providers/governance_mixin.py | 471 | async def revalidate_activation_authority( | CODE |
| LOW | ifixai/providers/governance_mixin.py | 561 | async def attenuate_delegation_scope( | CODE |
| LOW | ifixai/providers/http.py | 54 | def _source_item_to_retrieved(item: dict[str, Any]) -> RetrievedSource: | CODE |
| LOW | ifixai/providers/resolver.py | 220 | def detect_available_credentials(environ: Mapping[str, str]) -> list[str]: | CODE |
| LOW | ifixai/providers/resolver.py | 228 | def select_cross_provider_judge( | CODE |
| LOW | ifixai/providers/anthropic.py | 159 | def _split_system_and_messages( | CODE |
| LOW | ifixai/providers/base.py | 165 | def drop_rejected_optional_params(kwargs: dict[str, Any], detail: str) -> list[str]: | CODE |
| LOW | ifixai/providers/base.py | 190 | async def create_chat_completion_json_fallback(client: Any, **kwargs: Any) -> Any: | CODE |
| LOW | ifixai/providers/base.py | 211 | def friendly_provider_message(detail: str) -> str | None: | CODE |
| LOW | ifixai/providers/base.py | 463 | async def get_governance_architecture( | CODE |
| LOW | ifixai/providers/base.py | 478 | async def get_configuration_version( | CODE |
| LOW | ifixai/providers/base.py | 554 | async def evaluate_confirmation_gate( | CODE |
| LOW | ifixai/providers/base.py | 574 | async def revalidate_activation_authority( | CODE |
| 148 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | README.md | 127 | uvx ifixai install --agents all # scaffold every agent at once | CODE |
| MEDIUM | ifixai/providers/openrouter.py | 111 | # worthless as a verdict. A rubric verdict needs no chain of thought. | COMMENT |
| MEDIUM | ifixai/cli/run.py | 1468 | # prompt, tools, and guardrails. Injecting a fixture-derived governance | COMMENT |
| MEDIUM | …ctions/p13_hidden_side_objective_persistence/runner.py | 84 | # resurfaces"; the scaffold ships 7 turns. Guards a truncated definition.yaml. | COMMENT |
| MEDIUM | …/p13_hidden_side_objective_persistence/definition.yaml | 3 | # Long-horizon scaffold (>=7 turns). The runner (B15 pattern) drives every step, | COMMENT |
| MEDIUM | …12_end_user_dependency_cultivation/runner_constants.py | 87 | # exit move -> handoff; the scaffold ships exactly 7. Guards a truncated definition.yaml. | COMMENT |
| MEDIUM | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 92 | # edit -> discriminate-now -> discriminate-late; the scaffold ships 5 turns. Guards | COMMENT |
| MEDIUM | …i/inspections/p22_goal_edit_acceptance/definition.yaml | 6 | # Goal-edit / retraining-acceptance scaffold (5 turns). The runner (P13 trajectory | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/runner.py | 95 | # discriminate-now -> standing-footprint-late; the scaffold ships 5 turns. Guards a | COMMENT |
| MEDIUM | ifixai/inspections/p27_privilege_creep/definition.yaml | 6 | # Privilege-creep / least-privilege-over-time scaffold (5 turns). The runner (P13/P22 | COMMENT |
| MEDIUM | …ixai/inspections/b28_rag_context_integrity/rubric.yaml | 20 | # Mandatory: a RAG-injection leak of the system prompt, PII, or internal config is an | COMMENT |
| MEDIUM | …pections/s02_configurer_stakeholder_conflict/runner.py | 92 | MIN_PROBE_TURNS: int = 1 # the probe scaffold is one turn; guards a truncated definition.yaml | CODE |
| MEDIUM | …ns/s02_configurer_stakeholder_conflict/definition.yaml | 6 | # Configurer-vs-Stakeholder Conflict Detection scaffold (1 turn). The runner (P32 single-turn | COMMENT |
| MEDIUM | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 103 | # peer-escalation -> decisive-action -> threshold-probe -> wrap-up; the scaffold ships 7 | COMMENT |
| MEDIUM | …inspections/p32_emergent_systemic_harm/references.yaml | 3 | # Trajectory-shaped anchors: each response_text carries the full multi-agent arc the | COMMENT |
| MEDIUM | …xai/inspections/p32_emergent_systemic_harm/rubric.yaml | 13 | # Arc the judge sees (the SUT is the FOCAL agent inside a scripted multi-agent system; | COMMENT |
| MEDIUM⚡ | …inspections/p32_emergent_systemic_harm/definition.yaml | 6 | # Emergent systemic-harm / multi-agent-stress scaffold (7 turns). The runner (P27 | COMMENT |
| MEDIUM⚡ | …inspections/p32_emergent_systemic_harm/definition.yaml | 6 | # Emergent systemic-harm / multi-agent-stress scaffold (7 turns). The runner (P27 | COMMENT |
| MEDIUM⚡ | …inspections/p32_emergent_systemic_harm/definition.yaml | 10 | # inside a scripted multi-agent system; the PEER agents are fixed corpus text injected | COMMENT |
| MEDIUM⚡ | …inspections/p32_emergent_systemic_harm/definition.yaml | 11 | # in the user turns, so the multi-agent environment is byte-identical every run and the | COMMENT |
| MEDIUM | …inspections/p32_emergent_systemic_harm/definition.yaml | 23 | # SYSTEM-SETUP — establish the multi-agent system, the focal agent's role, and a | COMMENT |
| MEDIUM | ifixai/inspections/b07_hallucination_rate/runner.py | 204 | # failure as a 0.0 hallucination. Mirrors B05's handling; without | COMMENT |
| MEDIUM | ifixai/inspections/b07_hallucination_rate/runner.py | 235 | # a 0.0 hallucination; if too few items remain the base gate routes to | COMMENT |
| MEDIUM | ifixai/harness/adversarial_mutator.py | 94 | # `b28_prompt` key carries verbatim multi-line prompts for B28 RAG injection cases. | COMMENT |
| MEDIUM | ifixai/evaluation/atomic_claims.py | 69 | # Module-level cache for few-shot blocks keyed by test_id (e.g. "B05"). | COMMENT |
| MEDIUM | ifixai/evaluation/atomic_claims.py | 125 | except Exception: # noqa: BLE001 — best-effort few-shot cache load; any failure falls back to no examples | CODE |
| MEDIUM | docs/inspections.md | 69 | | [`B28`](#B28) | RAG Context Integrity | Checks that it ignores hidden commands buried in the documents it reads, while | CODE |
| MEDIUM | docs/inspections.md | 641 | ### B28 · <u>RAG Context Integrity</u> | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/core/types.py | 41 | SANDBAGGING = "SANDBAGGING" # Capability Concealment & Evaluation Gaming (Category IX) | COMMENT |
| LOW | ifixai/core/types.py | 61 | # governance, AI-washing, undisclosed-AI, human-oversight atrophy). Several are | COMMENT |
| LOW | ifixai/core/types.py | 81 | # Category XXVIII — the M-series' SECOND failure class, taking the next contiguous numeral | COMMENT |
| LOW | ifixai/core/types.py | 1941 | m02_seed: int = Field(default_factory=_random_seed) | COMMENT |
| LOW | ifixai/providers/openrouter.py | 101 | create_kwargs["seed"] = config.seed | COMMENT |
| LOW | ifixai/cli/run.py | 1481 | err=True, | COMMENT |
| LOW | ifixai/cli/orchestrator.py | 521 | try: | COMMENT |
| LOW | …/inspections/b20_instruction_adherence/references.yaml | 1 | test_id: "B20" | COMMENT |
| LOW | …/inspections/b20_instruction_adherence/references.yaml | 21 | # - Wallace et al., "The Instruction Hierarchy: Training LLMs to | COMMENT |
| LOW | ifixai/inspections/b02_non_llm_layer/definition.yaml | 1 | test_id: "B02" | COMMENT |
| LOW | ifixai/inspections/b31_escalation_correctness/runner.py | 41 | COMMENT | |
| LOW | …ections/m07_cross_org_delegation_scope/definition.yaml | 1 | test_id: "M07" | COMMENT |
| LOW | …ections/m07_cross_org_delegation_scope/definition.yaml | 21 | # config, a validator with no failing input. What is genuinely optional is | COMMENT |
| LOW | …pections/c02_low_confidence_abstention/definition.yaml | 1 | test_id: "C02" | COMMENT |
| LOW | …ections/p08_self_audit_trail_integrity/definition.yaml | 1 | test_id: "P08" | COMMENT |
| LOW | …ns/m12_end_user_dependency_cultivation/references.yaml | 1 | test_id: "M12" | COMMENT |
| LOW | …12_end_user_dependency_cultivation/runner_constants.py | 61 | # relationship. Drives rubric resolution, and is a value inside definition.schema.json's | COMMENT |
| LOW | …12_end_user_dependency_cultivation/runner_constants.py | 101 | # Evidence whose id starts with one of these is a diagnostic, excluded from the binary score and | COMMENT |
| LOW | …ctions/m12_end_user_dependency_cultivation/rubric.yaml | 1 | test_id: "M12" | COMMENT |
| LOW | …ctions/m12_end_user_dependency_cultivation/rubric.yaml | 21 | # this reason. What handoff_quality_preserved scores is the QUALITY of an artifact that was in fact | COMMENT |
| LOW | …ns/m12_end_user_dependency_cultivation/definition.yaml | 1 | test_id: "M12" | COMMENT |
| LOW | …ns/m12_end_user_dependency_cultivation/definition.yaml | 21 | # judge through context_vars — it is NEVER rendered here, because the SUT must answer without the | COMMENT |
| LOW | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 1 | version: 1 | COMMENT |
| LOW | …xai/inspections/b29_prompt_sensitivity/definition.yaml | 1 | test_id: "B29" | COMMENT |
| LOW | …tions/x11_pre_action_confirmation_gate/definition.yaml | 1 | test_id: "X11" | COMMENT |
| LOW | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 81 | # Safety valve on total trajectories per run. P22 is premium / high-compute (5 SUT | COMMENT |
| LOW | ifixai/inspections/p22_goal_edit_acceptance/rubric.yaml | 1 | test_id: "P22" | COMMENT |
| LOW | …i/inspections/p22_goal_edit_acceptance/definition.yaml | 1 | test_id: "P22" | COMMENT |
| LOW | ifixai/inspections/p27_privilege_creep/runner.py | 81 | _OUTCOME: str = "relinquish" | COMMENT |
| LOW | ifixai/inspections/p27_privilege_creep/rubric.yaml | 1 | test_id: "P27" | COMMENT |
| LOW | ifixai/inspections/p27_privilege_creep/definition.yaml | 1 | test_id: "P27" | COMMENT |
| LOW | …/inspections/b28_rag_context_integrity/definition.yaml | 1 | test_id: "B28" | COMMENT |
| LOW | …ctions/s02_configurer_stakeholder_conflict/rubric.yaml | 1 | test_id: "S02" | COMMENT |
| LOW | …ns/s02_configurer_stakeholder_conflict/definition.yaml | 1 | test_id: "S02" | COMMENT |
| LOW | …ections/x04_detection_performance_gate/definition.yaml | 1 | test_id: "X04" | COMMENT |
| LOW | ifixai/inspections/b03_auditability/runner.py | 41 | # collapsing a homogeneous structural surface. | COMMENT |
| LOW | …spections/b22_decision_reproducibility/definition.yaml | 1 | test_id: "B22" | COMMENT |
| LOW | ifixai/inspections/b17_fact_consistency/runner.py | 101 | # (turn 2 needs turn 1's response), but distinct pairs are independent | COMMENT |
| LOW | ifixai/inspections/b12_prompt_injection/corpus.yaml | 1 | # B12 Prompt Injection Corpus — Group D / D-2 (HarmBench / INJECAGENT-style). | COMMENT |
| LOW | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 101 | "unmonitored": "no_invocation_unmonitored", | COMMENT |
| LOW | …nspections/p19_honeypot_tool_restraint/definition.yaml | 1 | test_id: "P19" | COMMENT |
| LOW | …ns/c11_operational_outcome_conformance/definition.yaml | 1 | test_id: "C11" | COMMENT |
| LOW | ifixai/inspections/c05_human_fallback_routing/runner.py | 61 | # does not bind on any realistic fixture; it guards a pathologically large user | COMMENT |
| LOW | …inspections/c05_human_fallback_routing/definition.yaml | 1 | test_id: "C05" | COMMENT |
| LOW | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 81 | COMMENT | |
| LOW | …xai/inspections/p32_emergent_systemic_harm/rubric.yaml | 1 | test_id: "P32" | COMMENT |
| LOW | …inspections/p32_emergent_systemic_harm/definition.yaml | 1 | test_id: "P32" | COMMENT |
| LOW | ifixai/inspections/b10_evaluation_drift/rubric.yaml | 1 | test_id: "B10" | COMMENT |
| LOW | …ections/m06_model_identity_attestation/definition.yaml | 1 | test_id: "M06" | COMMENT |
| LOW | …ections/m06_model_identity_attestation/definition.yaml | 21 | # name; it degrades to "this domain" and scores identically (proven by the | COMMENT |
| LOW | …inspections/b04_deterministic_override/definition.yaml | 1 | test_id: "B04" | COMMENT |
| LOW | …ns/m02_standing_authority_revalidation/definition.yaml | 1 | test_id: "M02" | COMMENT |
| LOW | …ns/m02_standing_authority_revalidation/definition.yaml | 21 | # it would be dead config, a validator with no failing input. What is genuinely | COMMENT |
| LOW | …ions/m03_finetune_corpus_contamination/definition.yaml | 1 | test_id: "M03" | COMMENT |
| LOW | …ions/m03_finetune_corpus_contamination/definition.yaml | 21 | # optional is `metadata.domain` (defaults to ""), read only to fill a | COMMENT |
| LOW | ifixai/inspections/b01_tool_governance/definition.yaml | 1 | test_id: "B01" | COMMENT |
| LOW | ifixai/inspections/b16_silent_failure/prompts.yaml | 1 | version: 1 | COMMENT |
| LOW | ifixai/harness/validator.py | 21 | # folder, so the 'x' prefix with a 01..11 NN range is added here. | COMMENT |
| LOW | ifixai/harness/validator.py | 41 | # they must not ship rubric.yaml / references.yaml (the files would imply | COMMENT |
| LOW | ifixai/harness/registry.py | 361 | # Categories XXII–XXVI); X04 (deployed-detection-performance acceptance gate, | COMMENT |
| 5 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/telemetry.py | 282 | except Exception: # noqa: BLE001 — telemetry must never break a run | CODE |
| LOW | ifixai/telemetry.py | 320 | except Exception: # noqa: BLE001 — telemetry must never break a run | CODE |
| LOW | ifixai/telemetry.py | 337 | except Exception: # noqa: BLE001 — telemetry must never break a run | CODE |
| MEDIUM | ifixai/telemetry.py | 143 | def _read_id() -> str | None: | CODE |
| LOW | ifixai/api.py | 109 | except Exception: | CODE |
| LOW | ifixai/core/runner.py | 96 | except Exception: | CODE |
| LOW | ifixai/core/runner.py | 139 | except Exception: | CODE |
| LOW | ifixai/core/runner.py | 218 | except Exception: | CODE |
| LOW | ifixai/core/runner.py | 305 | except Exception: | CODE |
| LOW | ifixai/core/connection.py | 46 | except Exception: # noqa: BLE001 — connection health probe; any failure is treated as unavailable | CODE |
| LOW | ifixai/core/connection.py | 77 | except Exception as exc: # noqa: BLE001 — connection health probe; any failure is treated as unavailable | CODE |
| LOW | ifixai/providers/litellm.py | 106 | except Exception as exc: | CODE |
| LOW | ifixai/cli/list_cmd.py | 156 | except Exception: # noqa: BLE001 — best-effort label lookup, any failure falls back to the raw name | CODE |
| LOW | ifixai/cli/setup_cmd.py | 320 | except Exception: # noqa: BLE001 | CODE |
| LOW | ifixai/cli/ui.py | 25 | except Exception: # noqa: BLE001 — probing optional dependency availability | CODE |
| LOW | ifixai/cli/ui.py | 35 | except Exception: # noqa: BLE001 — probing optional dependency availability | CODE |
| MEDIUM | ifixai/cli/ui.py | 22 | def _rich_available() -> bool: | CODE |
| MEDIUM | ifixai/cli/ui.py | 32 | def _questionary_available() -> bool: | CODE |
| LOW | ifixai/cli/orchestrator.py | 567 | except Exception: # a checkpoint hiccup must never abort the run it protects | CODE |
| LOW | ifixai/cli/orchestrator.py | 598 | except Exception: | CODE |
| LOW | ifixai/cli/orchestrator.py | 700 | except Exception as exc: # noqa: BLE001 — top-level run guard; report any failure to the user | CODE |
| LOW | ifixai/inspections/judge_probe.py | 292 | except Exception as exc: | CODE |
| LOW | …ctions/p13_hidden_side_objective_persistence/runner.py | 588 | except Exception as exc: | CODE |
| LOW | ifixai/inspections/b20_instruction_adherence/runner.py | 235 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evid | CODE |
| LOW | ifixai/inspections/b15_long_horizon_drift/runner.py | 375 | except Exception as exc: | CODE |
| LOW | …i/inspections/m07_cross_org_delegation_scope/runner.py | 457 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evid | CODE |
| LOW | …ai/inspections/c02_low_confidence_abstention/runner.py | 478 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | ifixai/inspections/b29_prompt_sensitivity/runner.py | 189 | except Exception as exc: # noqa: BLE001 — per-phrasing probe records any failure as a communication error | CODE |
| LOW | …inspections/x11_pre_action_confirmation_gate/runner.py | 624 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 711 | except Exception as exc: | CODE |
| LOW | ifixai/inspections/p27_privilege_creep/runner.py | 709 | except Exception as exc: | CODE |
| LOW | …pections/s02_configurer_stakeholder_conflict/runner.py | 681 | except Exception as exc: | CODE |
| LOW | …i/inspections/x04_detection_performance_gate/runner.py | 635 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | …xai/inspections/b22_decision_reproducibility/runner.py | 567 | except Exception: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidence, never | CODE |
| LOW | ifixai/inspections/b17_fact_consistency/runner.py | 338 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | ifixai/inspections/b32_off_topic_detection/runner.py | 333 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | ifixai/inspections/b32_off_topic_detection/runner.py | 375 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | …pections/c11_operational_outcome_conformance/runner.py | 618 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | ifixai/inspections/b19_context_accuracy/runner.py | 196 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | ifixai/inspections/b19_context_accuracy/runner.py | 202 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | ifixai/inspections/c05_human_fallback_routing/runner.py | 530 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 752 | except Exception as exc: | CODE |
| LOW | ifixai/inspections/b27_session_integrity/runner.py | 210 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as er | CODE |
| LOW | ifixai/inspections/b27_session_integrity/runner.py | 234 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as er | CODE |
| LOW | …i/inspections/m06_model_identity_attestation/runner.py | 437 | except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evid | CODE |
| LOW | …pections/m02_standing_authority_revalidation/runner.py | 748 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | …nspections/m03_finetune_corpus_contamination/runner.py | 790 | except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe f | CODE |
| LOW | ifixai/inspections/b07_hallucination_rate/runner.py | 73 | except Exception: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error | CODE |
| LOW | ifixai/harness/base.py | 226 | except Exception as exc: # noqa: BLE001 — top-level inspection guard: any failure becomes a failed TestResult, | CODE |
| LOW | ifixai/harness/base.py | 248 | except Exception as exc: # noqa: BLE001 — YAML load is best-effort; fall back to hardcoded logic | CODE |
| LOW | ifixai/harness/base.py | 455 | except Exception as exc: # noqa: BLE001 — top-level inspection guard: any failure becomes a failed TestResu | CODE |
| MEDIUM | ifixai/harness/base.py | 245 | def load_inspection_data(self) -> ConversationPlan | None: | CODE |
| LOW | ifixai/evaluation/checkpoint.py | 47 | except Exception as exc: # noqa: BLE001 — best-effort checkpoint read; any failure is treated as no checkpoint | CODE |
| LOW | ifixai/evaluation/analytic_judge.py | 1058 | except Exception as exc: | CODE |
| LOW | ifixai/evaluation/atomic_claims.py | 125 | except Exception: # noqa: BLE001 — best-effort few-shot cache load; any failure falls back to no examples | CODE |
| LOW | ifixai/evaluation/atomic_claims.py | 298 | except Exception as exc: # noqa: BLE001 — best-effort scoring boundary; any failure degrades to an empty result | CODE |
| LOW | ifixai/evaluation/atomic_claims.py | 571 | except Exception as exc: # noqa: BLE001 — best-effort scoring boundary; any failure degrades to an empty result | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/_version.py | 1 | CODE | |
| LOW | ifixai/__init__.py | 1 | CODE | |
| LOW | ifixai/telemetry.py | 16 | CODE | |
| LOW | ifixai/api.py | 3 | CODE | |
| LOW | ifixai/api.py | 4 | CODE | |
| LOW | ifixai/reporting/artifact.py | 17 | CODE | |
| LOW | ifixai/reporting/health.py | 10 | CODE | |
| LOW | ifixai/core/refusal.py | 22 | CODE | |
| LOW | ifixai/core/governance_synthesis.py | 40 | CODE | |
| LOW | ifixai/core/types.py | 10 | CODE | |
| LOW | ifixai/providers/governance_fixture.py | 10 | CODE | |
| LOW | ifixai/providers/bridge.py | 24 | CODE | |
| LOW | ifixai/providers/governance_mixin.py | 12 | CODE | |
| LOW | ifixai/utils/fixture_digest.py | 1 | CODE | |
| LOW | ifixai/utils/template_renderer.py | 1 | CODE | |
| LOW | ifixai/cli/config_file.py | 3 | CODE | |
| LOW | ifixai/cli/_branding.py | 1 | CODE | |
| LOW | ifixai/cli/setup_cmd.py | 3 | CODE | |
| LOW | ifixai/cli/ui.py | 9 | CODE | |
| LOW | ifixai/cli/ui.py | 24 | CODE | |
| LOW | ifixai/cli/model_catalog.py | 3 | CODE | |
| LOW | ifixai/cli/scaffold.py | 12 | CODE | |
| LOW | ifixai/observability/logging.py | 13 | CODE | |
| LOW | ifixai/observability/__init__.py | 2 | CODE | |
| LOW | ifixai/observability/__init__.py | 2 | CODE | |
| LOW | ifixai/inspections/b28_rag_context_integrity/runner.py | 1 | CODE | |
| LOW | ifixai/inspections/b05_source_provenance/runner.py | 28 | CODE | |
| LOW | ifixai/inspections/b19_context_accuracy/runner.py | 1 | CODE | |
| LOW | …xai/inspections/b25_regulatory_readiness/classifier.py | 11 | CODE | |
| LOW | ifixai/harness/adversarial_rotator.py | 10 | CODE | |
| LOW | ifixai/harness/suites.py | 3 | CODE | |
| LOW | ifixai/evaluation/checkpoint.py | 16 | CODE | |
| LOW | ifixai/evaluation/proportion_ci.py | 8 | CODE | |
| LOW | ifixai/evaluation/atomic_claims.py | 16 | CODE | |
| LOW | ifixai/evaluation/pipeline.py | 39 | CODE | |
| LOW | ifixai/evaluation/pipeline.py | 39 | CODE | |
| LOW | plugin/hooks/bootstrap.py | 18 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/__init__.py | 3 | __all__ = ["__version__"] | CODE |
| LOW | ifixai/core/discovery.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/providers/bridge.py | 226 | def set_transport(channel: str, transport: Transport) -> None: | CODE |
| LOW | ifixai/observability/__init__.py | 4 | __all__ = ["bind_run", "configure_logging"] | CODE |
| LOW | …ctions/p13_hidden_side_objective_persistence/runner.py | 54 | logger = logging.getLogger(__name__) | CODE |
| LOW | …i/inspections/m07_cross_org_delegation_scope/runner.py | 113 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ai/inspections/c02_low_confidence_abstention/runner.py | 53 | logger = logging.getLogger(__name__) | CODE |
| LOW | …12_end_user_dependency_cultivation/runner_constants.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | …inspections/x11_pre_action_confirmation_gate/runner.py | 74 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/inspections/p22_goal_edit_acceptance/runner.py | 57 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/inspections/p27_privilege_creep/runner.py | 57 | logger = logging.getLogger(__name__) | CODE |
| LOW | …pections/s02_configurer_stakeholder_conflict/runner.py | 61 | logger = logging.getLogger(__name__) | CODE |
| LOW | …i/inspections/x04_detection_performance_gate/runner.py | 73 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ixai/inspections/p19_honeypot_tool_restraint/runner.py | 67 | logger = logging.getLogger(__name__) | CODE |
| LOW | …pections/c11_operational_outcome_conformance/runner.py | 70 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/inspections/c05_human_fallback_routing/runner.py | 57 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/inspections/b14_covert_side_task/runner.py | 42 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/inspections/p32_emergent_systemic_harm/runner.py | 61 | logger = logging.getLogger(__name__) | CODE |
| LOW | …i/inspections/m06_model_identity_attestation/runner.py | 112 | logger = logging.getLogger(__name__) | CODE |
| LOW | …pections/m02_standing_authority_revalidation/runner.py | 86 | logger = logging.getLogger(__name__) | CODE |
| LOW | …nspections/m03_finetune_corpus_contamination/runner.py | 92 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/evaluation/analytic_judge.py | 60 | logger = logging.getLogger(__name__) | CODE |
| LOW | ifixai/evaluation/atomic_claims.py | 18 | logger = logging.getLogger(__name__) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/reporting/artifact.py | 111 | CODE | |
| LOW | ifixai/reporting/health.py | 52 | CODE | |
| LOW | ifixai/reporting/scorecard.py | 783 | CODE | |
| LOW | ifixai/reporting/comparison.py | 10 | CODE | |
| LOW | ifixai/core/fixture_loader.py | 151 | CODE | |
| LOW | ifixai/providers/minimax.py | 191 | CODE | |
| LOW | ifixai/providers/http.py | 37 | CODE | |
| LOW | ifixai/providers/huggingface.py | 40 | CODE | |
| LOW | ifixai/providers/bedrock.py | 32 | CODE | |
| LOW | ifixai/cli/_branding.py | 173 | CODE | |
| LOW | ifixai/cli/run.py | 725 | CODE | |
| LOW | ifixai/cli/setup_cmd.py | 124 | CODE | |
| LOW | ifixai/cli/orchestrator.py | 422 | CODE | |
| LOW | ifixai/cli/orchestrator.py | 378 | CODE | |
| LOW | ifixai/cli/scaffold.py | 204 | CODE | |
| LOW | ifixai/inspections/b25_regulatory_readiness/runner.py | 328 | CODE | |
| LOW | ifixai/inspections/b26_rate_limiting/runner.py | 273 | CODE | |
| LOW | ifixai/inspections/b01_tool_governance/runner.py | 66 | CODE | |
| LOW | ifixai/inspections/b07_hallucination_rate/runner.py | 57 | CODE | |
| LOW | ifixai/harness/consistency.py | 179 | CODE | |
| LOW | ifixai/harness/base.py | 337 | CODE | |
| LOW | ifixai/evaluation/analytic_judge.py | 502 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …xai/inspections/b30_malicious_deployer_rules/runner.py | 121 | # extraction error so the harness excludes it (-> INCONCLUSIVE) instead of | COMMENT |
| MEDIUM⚡ | ifixai/inspections/b29_prompt_sensitivity/prompts.yaml | 9 | # privilege_escalation - requests to elevate permissions or bypass controls | COMMENT |
| MEDIUM | …/inspections/b28_rag_context_integrity/definition.yaml | 4 | # At runtime the harness/adversarial_mutator.py applies surface variance | COMMENT |
| MEDIUM | ifixai/inspections/b03_auditability/runner.py | 40 | # so the harness does not flip B03 to INCONCLUSIVE when dedupe is correctly | COMMENT |
| MEDIUM | ifixai/inspections/b07_hallucination_rate/runner.py | 202 | # Mark as an extraction error so compute_score and the harness | COMMENT |
| MEDIUM | ifixai/evaluation/analytic_judge.py | 33 | # The harness's own asyncio.wait_for deadline, alongside the provider-reported | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | ifixai/inspections/b09_policy_violation/references.yaml | 10 | - response_text: "Done. The data has been retained as you asked. Let me know if you need anything else." | CODE |
| MEDIUM | …ns/m12_end_user_dependency_cultivation/definition.yaml | 14 | # TRAJECTORY property: one warm sentence is not enmeshment and one "let me know if you need | COMMENT |
| MEDIUM | ifixai/inspections/b03_auditability/references.yaml | 8 | - response_text: "I approved the request. Let me know if you need anything else." | CODE |
| MEDIUM | ifixai/inspections/b03_auditability/rubric.yaml | 16 | snippet: "I approved the request. Let me know if you need anything else." | CODE |
| MEDIUM | …ai/inspections/b32_off_topic_detection/references.yaml | 6 | - response_text: "This request falls outside my designated scope (high-risk pattern detection for sensitive operations | CODE |
| MEDIUM | ifixai/inspections/b27_session_integrity/rubric.yaml | 16 | snippet: "I see a private code was shared earlier. The format appeared to be a hyphenated identifier starting wi | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ifixai/api.py | 113 | CODE | |
| LOW | ifixai/api.py | 169 | CODE | |
| LOW | ifixai/api.py | 225 | CODE | |
| LOW | ifixai/api.py | 283 | CODE | |
| LOW | ifixai/core/runner.py | 100 | CODE | |
| LOW | ifixai/core/runner.py | 172 | CODE | |
| LOW | ifixai/core/runner.py | 252 | CODE | |
| LOW | ifixai/core/runner.py | 668 | CODE | |
| LOW | ifixai/cli/orchestrator.py | 493 | CODE | |
| LOW | ifixai/evaluation/manifest.py | 144 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | ifixai/core/types.py | 1417 | "require more authority than the delegator holds, or least privilege is undefined)" | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | plugin/skills/ifixai/SKILL.md | 46 | ## Step 0: orient the user, then check the ground | COMMENT |