AI Slop Code RIsk Monitor

ifixai-ai/iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

24.9 Elevated pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for ifixai-ai/iFixAi, a Python project with 23,805 GitHub stars. SynthScan examined 140,888 lines of code across 672 source files, recording 1764 pattern matches distributed across 15 syntactic categories. The legacy adjusted pattern signal is 24.9 (Elevated pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

24.9
Adjusted Signal
24.9
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
23.8K
Stars
Python
Language
140.9K
Lines of Code
672
Files
1.8K
Pattern Hits
2026-10-12
Scan Date
0.50
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 36.8/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 1131 finding(s).

Hallucinated Dependency & Supply Chain Risk 5.4/100 · LOW

Are imports declared and package/API names verified? 88 finding(s).

Agent Over-Engineering Ratio 64.0/100 · HIGH

Are wrappers, guards, and repeated structures necessary? 1339 finding(s).

PR Review Velocity Impact 74.0/100 · HIGH

Which changes need focused human review? 1764 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 339MEDIUM 167LOW 1258

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 1764 distinct pattern matches across 15 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Cross-File Repetition315 hits · 1575 pts
SeverityFileLineSnippetContext
HIGHifixai/providers/vercel.py0return a long-lived asyncopenai client keyed on connection params. caching by (base_url, api_key, timeout, max_retries) STRING
HIGHifixai/providers/cloudflare.py0return a long-lived asyncopenai client keyed on connection params. caching by (base_url, api_key, timeout, max_retries) STRING
HIGHifixai/providers/openrouter.py0return a long-lived asyncopenai client keyed on connection params. caching by (base_url, api_key, timeout, max_retries) STRING
HIGHifixai/providers/requesty.py0return a long-lived asyncopenai client keyed on connection params. caching by (base_url, api_key, timeout, max_retries) STRING
HIGHifixai/providers/orcarouter.py0return a long-lived asyncopenai client keyed on connection params. caching by (base_url, api_key, timeout, max_retries) STRING
HIGHifixai/inspections/judge_probe.py0one driven turn of a trajectory (typed, not a bare tuple).STRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0one driven turn of a trajectory (typed, not a bare tuple).STRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0one driven turn of a trajectory (typed, not a bare tuple).STRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0one driven turn of a trajectory (typed, not a bare tuple).STRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0one driven turn of a trajectory (typed, not a bare tuple).STRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → inconSTRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → inconSTRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → inconSTRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0collect + score one trajectory under the concurrency bound. provideremptycontenterror propagates (unscorable run → inconSTRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…ai/inspections/c02_low_confidence_abstention/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…inspections/x11_pre_action_confirmation_gate/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…i/inspections/x04_detection_performance_gate/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…ixai/inspections/p19_honeypot_tool_restraint/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…pections/c11_operational_outcome_conformance/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGHifixai/inspections/c05_human_fallback_routing/runner.py0build the (user, probe) item set, deterministically ordered. when the sorted cross-product fits the cap, no rng is used STRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict onSTRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict onSTRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict onSTRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0single call for an ensemble judge; 3-sample majority for a single judge. the 3-sample majority stabilises the verdict onSTRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scoredSTRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scoredSTRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scoredSTRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0bidirectional taxonomy coverage audit (excluded from score): every declared systemic-risk class is exercised by a scoredSTRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…i/inspections/m07_cross_org_delegation_scope/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…ai/inspections/c02_low_confidence_abstention/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…i/inspections/p08_self_audit_trail_integrity/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…inspections/x11_pre_action_confirmation_gate/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…i/inspections/x04_detection_performance_gate/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…ixai/inspections/p19_honeypot_tool_restraint/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…pections/c11_operational_outcome_conformance/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGHifixai/inspections/c05_human_fallback_routing/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…i/inspections/m06_model_identity_attestation/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…pections/m02_standing_authority_revalidation/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…nspections/m03_finetune_corpus_contamination/runner.py0pre-run shortfall sentinel: too few scored probes for a meaningful rate. short-circuited before any screen_training_corpSTRING
HIGH…ctions/p13_hidden_side_objective_persistence/runner.py0unscorable mid-trajectory provider failure — see build_unscorable_item.STRING
HIGHifixai/inspections/p22_goal_edit_acceptance/runner.py0unscorable mid-trajectory provider failure — see build_unscorable_item.STRING
HIGHifixai/inspections/p27_privilege_creep/runner.py0unscorable mid-trajectory provider failure — see build_unscorable_item.STRING
HIGHifixai/inspections/p32_emergent_systemic_harm/runner.py0unscorable mid-trajectory provider failure — see build_unscorable_item.STRING
HIGH…inspections/v01_overcorrection_check/runner_helpers.py0probes the catalogue will yield: one per case, capped. invariant to the fixture's user count on purpose -- the probe setSTRING
HIGH…tions/v04_honesty_source_attribution/runner_helpers.py0probes the catalogue will yield: one per case, capped. invariant to the fixture's user count on purpose -- the probe setSTRING
HIGH…/inspections/v02_agreement_integrity/runner_helpers.py0probes the catalogue will yield: one per case, capped. invariant to the fixture's user count on purpose -- the probe setSTRING
HIGH…nspections/v03_warranted_persistence/runner_helpers.py0probes the catalogue will yield: one per case, capped. invariant to the fixture's user count on purpose -- the probe setSTRING
HIGH…inspections/v01_overcorrection_check/runner_helpers.py0build the probe set in a deterministic order, requester already assigned. the requester is assigned by case index over tSTRING
HIGH…/inspections/v02_agreement_integrity/runner_helpers.py0build the probe set in a deterministic order, requester already assigned. the requester is assigned by case index over tSTRING
HIGH…nspections/v03_warranted_persistence/runner_helpers.py0build the probe set in a deterministic order, requester already assigned. the requester is assigned by case index over tSTRING
HIGH…inspections/v01_overcorrection_check/runner_helpers.py0free-text orientation for the judge call. the case specifics go through context_vars and the rubric template; this is orSTRING
HIGH…tions/v04_honesty_source_attribution/runner_helpers.py0free-text orientation for the judge call. the case specifics go through context_vars and the rubric template; this is orSTRING
255 more matches not shown…
Hyper-Verbose Identifiers784 hits · 819 pts
SeverityFileLineSnippetContext
LOWconftest.py11def pytest_collection_modifyitems(CODE
LOWifixai/quick_build.py33def collect_quick_build_context() -> QuickBuildContext:CODE
LOWifixai/quick_build.py55def generate_fixture_from_context(context: QuickBuildContext, system_name: str = "My AI Assistant") -> Fixture:CODE
LOWifixai/quick_build.py89def generate_fixture_from_profile(CODE
LOWifixai/_version.py9def _read_pyproject_version_fallback() -> str | None:CODE
LOWifixai/api.py43def _resolve_provider_with_governance(CODE
LOWifixai/wizard.py114def generate_fixture_from_wizard(CODE
LOWifixai/reporting/health.py93def measurement_failure_banner(health: _RunHealth) -> str | None:CODE
LOWifixai/reporting/scorecard.py135def insufficient_evidence_warnings(CODE
LOWifixai/reporting/scorecard.py150def exploratory_inspection_warnings(CODE
LOWifixai/reporting/scorecard.py161def advisory_inspection_warnings(CODE
LOWifixai/reporting/scorecard.py174def attestation_inspection_warnings(CODE
LOWifixai/reporting/scorecard.py185def extraction_error_warnings(CODE
LOWifixai/reporting/scorecard.py208def judge_substitution_warnings(judge_stats: dict | None) -> list[str]:CODE
LOWifixai/reporting/scorecard.py593def build_category_scores_section(CODE
LOWifixai/reporting/scorecard.py609def build_mandatory_minimums_section(CODE
LOWifixai/reporting/scorecard.py628def build_test_results_section(CODE
LOWifixai/reporting/scorecard.py745def _format_run_minimums_status(result: TestRunResult) -> str:CODE
LOWifixai/reporting/scorecard.py805def render_mandatory_minimums(result: TestRunResult) -> str:CODE
LOWifixai/reporting/scorecard.py871def _dominant_evaluation_path(br: TestResult) -> str:CODE
LOWifixai/reporting/scorecard.py1021def render_exploratory_section(result: TestRunResult) -> str:CODE
LOWifixai/reporting/scorecard.py1047def render_attestation_section(result: TestRunResult) -> str:CODE
LOWifixai/reporting/scorecard.py1074def render_regulatory_compliance(CODE
LOWifixai/reporting/scorecard.py1101def render_consistency_warnings(result: TestRunResult) -> str:CODE
LOWifixai/reporting/regulatory.py50def build_regulatory_json_section(CODE
LOWifixai/reporting/regulatory.py65def get_test_regulatory_mappings(CODE
LOWifixai/core/runner.py583async def _execute_single_inspection(CODE
LOWifixai/core/discovery.py158def display_discovery_summary(result: DiscoveryResult) -> None:CODE
LOWifixai/core/discovery.py219def build_fixture_from_discovery(CODE
LOWifixai/core/types.py602def classify_detection_window(CODE
LOWifixai/core/types.py673 def check_gate_config_coherent(self) -> "ActionConfirmationRequest":CODE
LOWifixai/core/types.py813 def check_grant_record_coherent(self) -> "StandingActivationRequest":CODE
LOWifixai/core/types.py876def classify_activation_authority(CODE
LOWifixai/core/types.py916def collect_activation_staleness_reasons(CODE
LOWifixai/core/types.py1109def collect_corpus_contamination_reasons(CODE
LOWifixai/core/types.py1194 def check_attestation_coherent(self) -> "ResponseIdentityClaim":CODE
LOWifixai/core/types.py1299def classify_response_identity(CODE
LOWifixai/core/types.py1351def collect_substitution_reasons(claim: ResponseIdentityClaim) -> list[str]:CODE
LOWifixai/core/types.py1538def classify_delegation_scope(CODE
LOWifixai/core/types.py1596def collect_delegation_scope_reasons(claim: DelegationHandoffClaim) -> list[str]:CODE
LOWifixai/core/types.py1777 def check_exclusion_flags_mutually_exclusive(self) -> "InspectionSpec":CODE
LOWifixai/core/types.py1875 def check_dimension_weights_sum_to_one(self) -> "AnalyticRubric":CODE
LOWifixai/core/training_specification_screening.py164 def check_declarations_resolve(self) -> TrainingSpecificationCandidate:CODE
LOWifixai/core/training_specification_screening.py282def classify_training_specification(CODE
LOWifixai/core/fixture_loader.py172def _normalize_fixture_format(raw: dict[str, Any]) -> dict[str, Any]:CODE
LOWifixai/providers/vercel.py212def raise_for_payment_required(endpoint: str, exc: openai.APIStatusError) -> NoReturn:CODE
LOWifixai/providers/governance_mixin.py221 def _ensure_seeded_audit_records(self) -> None:CODE
LOWifixai/providers/governance_mixin.py317 async def get_configuration_version(CODE
LOWifixai/providers/governance_mixin.py339 async def get_governance_architecture(CODE
LOWifixai/providers/governance_mixin.py483 async def evaluate_confirmation_gate(CODE
LOWifixai/providers/governance_mixin.py509 async def revalidate_activation_authority(CODE
LOWifixai/providers/governance_mixin.py568 async def screen_training_specification(CODE
LOWifixai/providers/governance_mixin.py639 async def attenuate_delegation_scope(CODE
LOWifixai/providers/cloudflare.py367def raise_for_rejected_access(CODE
LOWifixai/providers/cloudflare.py408def raise_for_exhausted_allocation(CODE
LOWifixai/providers/cloudflare.py425def raise_for_payment_required(endpoint: str, exc: openai.APIStatusError) -> NoReturn:CODE
LOWifixai/providers/http.py58def _source_item_to_retrieved(item: dict[str, Any]) -> RetrievedSource:CODE
LOWifixai/providers/resolver.py254def detect_available_credentials(environ: Mapping[str, str]) -> list[str]:CODE
LOWifixai/providers/resolver.py262def select_cross_provider_judge(CODE
LOWifixai/providers/anthropic.py201def _split_system_and_messages(CODE
724 more matches not shown…
Decorative Section Separators99 hits · 300 pts
SeverityFileLineSnippetContext
MEDIUM…ctions/p13_hidden_side_objective_persistence/runner.py466# ── corpus ──────────────────────────────────────────────────────────────────COMMENT
MEDIUM…ctions/p13_hidden_side_objective_persistence/runner.py567# ── trajectory collection + judging ──────────────────────────────────────────COMMENT
MEDIUM…ctions/p13_hidden_side_objective_persistence/runner.py645# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…ions/v01_overcorrection_check/runner_scenarios_care.py26 # ── care_stripping_under_load · user is CORRECT ───────────────────────────COMMENT
MEDIUM…ions/v01_overcorrection_check/runner_scenarios_care.py134 # ── care_stripping_under_load · user is REASONABLE ────────────────────────COMMENT
MEDIUM…ions/v01_overcorrection_check/runner_scenarios_care.py242 # ── grief_disparagement · user is CORRECT ─────────────────────────────────COMMENT
MEDIUM…ions/v01_overcorrection_check/runner_scenarios_care.py354 # ── grief_disparagement · user is MISTAKEN ────────────────────────────────COMMENT
MEDIUM…_overcorrection_check/runner_scenarios_disagreement.py24 # ── manufactured_disagreement · user is CORRECT ───────────────────────────COMMENT
MEDIUM…_overcorrection_check/runner_scenarios_disagreement.py120 # ── manufactured_disagreement · user is REASONABLE ────────────────────────COMMENT
MEDIUM…_overcorrection_check/runner_scenarios_disagreement.py278 # ── contemptuous_delivery · user is CORRECT ───────────────────────────────COMMENT
MEDIUM…_overcorrection_check/runner_scenarios_disagreement.py367 # ── contemptuous_delivery · user is MISTAKEN ──────────────────────────────COMMENT
MEDIUM…i/inspections/m07_cross_org_delegation_scope/runner.py435# ── probe scoring ────────────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/m07_cross_org_delegation_scope/runner.py581# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/m07_cross_org_delegation_scope/runner.py634# ── sentinels ────────────────────────────────────────────────────────────────COMMENT
MEDIUM…ai/inspections/c02_low_confidence_abstention/runner.py429# ── probe selection + scoring ────────────────────────────────────────────────COMMENT
MEDIUM…ai/inspections/c02_low_confidence_abstention/runner.py553# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…ai/inspections/c02_low_confidence_abstention/runner.py591# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/p08_self_audit_trail_integrity/runner.py249# ── sweep ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/p08_self_audit_trail_integrity/runner.py320# ── the four scored checks ──────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/p08_self_audit_trail_integrity/runner.py443# ── diagnostics (non-scored) ────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/p08_self_audit_trail_integrity/runner.py586# ── builders & matchers ─────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/p08_self_audit_trail_integrity/runner.py708# ── action selection ────────────────────────────────────────────────────────COMMENT
MEDIUM⚡ifixai/inspections/b29_prompt_sensitivity/prompts.yaml13 # -------------------------------------------------------------------------COMMENT
MEDIUM⚡ifixai/inspections/b29_prompt_sensitivity/prompts.yaml15 # -------------------------------------------------------------------------COMMENT
MEDIUMifixai/inspections/b29_prompt_sensitivity/prompts.yaml177 # -------------------------------------------------------------------------COMMENT
MEDIUMifixai/inspections/b29_prompt_sensitivity/prompts.yaml179 # -------------------------------------------------------------------------COMMENT
MEDIUMifixai/inspections/b29_prompt_sensitivity/prompts.yaml301 # -------------------------------------------------------------------------COMMENT
MEDIUMifixai/inspections/b29_prompt_sensitivity/prompts.yaml303 # -------------------------------------------------------------------------COMMENT
MEDIUM…inspections/x11_pre_action_confirmation_gate/runner.py554# ── probe selection + scoring ────────────────────────────────────────────────COMMENT
MEDIUM…inspections/x11_pre_action_confirmation_gate/runner.py708# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…inspections/x11_pre_action_confirmation_gate/runner.py740# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p22_goal_edit_acceptance/runner.py570# ── corpus ──────────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p22_goal_edit_acceptance/runner.py690# ── trajectory collection + judging ──────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p22_goal_edit_acceptance/runner.py773# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p22_goal_edit_acceptance/runner.py813# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p27_privilege_creep/runner.py565# ── corpus ──────────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p27_privilege_creep/runner.py688# ── trajectory collection + judging ──────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p27_privilege_creep/runner.py836# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUMifixai/inspections/p27_privilege_creep/runner.py876# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml17 # ── sla_breach ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml52 # ── cost_externalization ────────────────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml85 # ── economic_viability_threat ────────────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml120 # ── safety_or_quality_floor_erosion ──────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml155 # ── resource_allocation_deprivation ──────────────────────────────────────────COMMENT
MEDIUM…ctions/s02_configurer_stakeholder_conflict/corpus.yaml190 # ── consent_or_privacy_burden ─────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py63# ── constants ─────────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py145# ── data types ────────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py246# ── inspection ────────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py543# ── corpus ──────────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py661# ── probe send + judging ──────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py780# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py814# ── diagnostics (non-scored evidence) ─────────────────────────────────────────COMMENT
MEDIUM…i/inspections/x04_detection_performance_gate/runner.py564# ── probe selection + scoring ────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/x04_detection_performance_gate/runner.py742# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…i/inspections/x04_detection_performance_gate/runner.py774# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…ixai/inspections/p19_honeypot_tool_restraint/runner.py577# ── corpus ──────────────────────────────────────────────────────────────────COMMENT
MEDIUM…ixai/inspections/p19_honeypot_tool_restraint/runner.py707# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
MEDIUM…ixai/inspections/p19_honeypot_tool_restraint/runner.py741# ── diagnostics ──────────────────────────────────────────────────────────────COMMENT
MEDIUM…pections/c11_operational_outcome_conformance/runner.py544# ── probe selection + scoring ────────────────────────────────────────────────COMMENT
MEDIUM…pections/c11_operational_outcome_conformance/runner.py710# ── fixture gate ─────────────────────────────────────────────────────────────COMMENT
39 more matches not shown…
Over-Commented Block236 hits · 236 pts
SeverityFileLineSnippetContext
LOWifixai/core/types.py41 SANDBAGGING = "SANDBAGGING" # Capability Concealment & Evaluation Gaming (Category IX)COMMENT
LOWifixai/core/types.py61 # governance, AI-washing, undisclosed-AI, human-oversight atrophy). Several areCOMMENT
LOWifixai/core/types.py81 # Category XXVIII — the M-series' SECOND failure class, taking the next contiguous numeralCOMMENT
LOWifixai/core/types.py101 # INSUBORDINATION (X), which governs the operator's authority over the agent, where thisCOMMENT
LOWifixai/core/types.py121 # XLVII: frankness only helps when what is said is true. B07 scores whether an answer isCOMMENT
LOWifixai/core/types.py141 # rate of recognising those shapes rather than a transferable disposition. Not SANDBAGGINGCOMMENT
LOWifixai/cli/run.py1561 # (explicit or synth via `synthesize: true`) is composed onto theCOMMENT
LOWifixai/cli/orchestrator.py521 try:COMMENT
LOW…ections/v01_overcorrection_check/runner_diagnostics.py241 # `EvaluationPipeline.evaluate` either attaches a rubric verdict or sets an extraction_error,COMMENT
LOW…i/inspections/v01_overcorrection_check/references.yaml1test_id: "V01"COMMENT
LOW…spections/v01_overcorrection_check/runner_constants.py61# V01 measures lands on first contact. Guards a truncated definition.yaml.COMMENT
LOW…spections/v01_overcorrection_check/runner_constants.py121)COMMENT
LOWifixai/inspections/v01_overcorrection_check/rubric.yaml1test_id: "V01"COMMENT
LOWifixai/inspections/v01_overcorrection_check/rubric.yaml21# WHY substance_delivered IS SOFT, and this is the one that needs stating. A response that abandonsCOMMENT
LOWifixai/inspections/v01_overcorrection_check/rubric.yaml41#COMMENT
LOW…spections/v01_overcorrection_check/runner_scenarios.py21from ifixai.inspections.v01_overcorrection_check.runner_scenarios_disagreement import (COMMENT
LOW…i/inspections/v01_overcorrection_check/definition.yaml1test_id: "V01"COMMENT
LOW…i/inspections/v01_overcorrection_check/definition.yaml21# {actor_frame} {opening} {message} (plus {user} {role} {domain}, which {actor_frame} isCOMMENT
LOW…i/inspections/v01_overcorrection_check/definition.yaml41# case" and fake the acknowledgment without reading the distress. `register` is catalogue prose likeCOMMENT
LOW…/inspections/b20_instruction_adherence/references.yaml1test_id: "B20"COMMENT
LOW…/inspections/b20_instruction_adherence/references.yaml21# - Wallace et al., "The Instruction Hierarchy: Training LLMs toCOMMENT
LOW…ns/v07_benchmark_contamination_check/runner_helpers.py61# THE THREE MANDATORY DIMENSIONS AND THE ONE SOFT ONE, named once here rather than re-derived at eachCOMMENT
LOW…nspections/v07_benchmark_contamination_check/runner.py321 raise JudgePipelineRequiredError(COMMENT
LOW…ions/v07_benchmark_contamination_check/references.yaml1test_id: "V07"COMMENT
LOW…ions/v07_benchmark_contamination_check/references.yaml21# "cautious = pass" or "compliant = pass" -- and either miscalibration would be worse here thanCOMMENT
LOW…/v07_benchmark_contamination_check/runner_constants.py101COMMENT
LOW…/v07_benchmark_contamination_check/runner_constants.py121# dispositions intact is 36 scored probes, which clears the total floor exactly, while the fourth sitsCOMMENT
LOW…/v07_benchmark_contamination_check/runner_constants.py141COMMENT
LOW…/v07_benchmark_contamination_check/runner_constants.py161# chosen: `smallest_conclusive_pair_count` returns the smallest n with 2**-n <= alpha, which is five atCOMMENT
LOW…pections/v07_benchmark_contamination_check/rubric.yaml1test_id: "V07"COMMENT
LOW…pections/v07_benchmark_contamination_check/rubric.yaml21#COMMENT
LOW…pections/v07_benchmark_contamination_check/rubric.yaml41# NO DIMENSION HERE IS CONDITIONAL, AND THAT IS A DELIBERATE DIFFERENCE FROM V02 AND V03. Both of themCOMMENT
LOW…pections/v07_benchmark_contamination_check/rubric.yaml61# {required_move} *IS* SUPPLIED, AND IT IS NOT A LEAK. It describes the move THIS scenario requires; itCOMMENT
LOW…pections/v07_benchmark_contamination_check/rubric.yaml81# What the judge sees: ONE reply to ONE scenario. {scenario} is the situation the reply answers;COMMENT
LOW…ions/v07_benchmark_contamination_check/runner_cases.py101COMMENT
LOW…ions/v07_benchmark_contamination_check/runner_cases.py121# THE TWO SIDES ARE CROSSED RATHER THAN PAIRED. Within a disposition the three cases carrying publishedCOMMENT
LOW…ions/v07_benchmark_contamination_check/runner_cases.py141# some way OTHER than category membership -- they are longer, or denser, or more numerate -- and theCOMMENT
LOW…ions/v07_benchmark_contamination_check/runner_cases.py161# than the other is the realistic authoring drift -- a held-out scenario needs more setup because it isCOMMENT
LOW…ions/v07_benchmark_contamination_check/definition.yaml1test_id: "V07"COMMENT
LOW…ions/v07_benchmark_contamination_check/definition.yaml21# ONE TURN, AND THAT IS THE BOUNDARY OF THE MEASURAND. Whether the deployment made the disposition'sCOMMENT
LOW…ions/v07_benchmark_contamination_check/definition.yaml41# is the entire basis of the inference: with the frame identical and the disposition held, a differenceCOMMENT
LOW…ions/v07_benchmark_contamination_check/definition.yaml61#COMMENT
LOWifixai/inspections/b02_non_llm_layer/definition.yaml1test_id: "B02"COMMENT
LOWifixai/inspections/b31_escalation_correctness/runner.py41COMMENT
LOW…ections/m07_cross_org_delegation_scope/definition.yaml1test_id: "M07"COMMENT
LOW…ections/m07_cross_org_delegation_scope/definition.yaml21# config, a validator with no failing input. What is genuinely optional isCOMMENT
LOW…pections/c02_low_confidence_abstention/definition.yaml1test_id: "C02"COMMENT
LOW…spections/v10_care_under_vulnerability/references.yaml1test_id: "V10"COMMENT
LOW…tions/v10_care_under_vulnerability/runner_constants.py41# a case's two probes and the comparison cannot be partly a measure of the manipulation itself. TheCOMMENT
LOW…tions/v10_care_under_vulnerability/runner_constants.py61# Fixture users are rotated across CASES so the requester is not a constant. The cap bounds how manyCOMMENT
LOW…tions/v10_care_under_vulnerability/runner_constants.py101# written beside it: `smallest_conclusive_pair_count` returns the fewest discordant pairs at whichCOMMENT
LOW…tions/v10_care_under_vulnerability/runner_constants.py141COMMENT
LOW…i/inspections/v10_care_under_vulnerability/rubric.yaml1test_id: "V10"COMMENT
LOW…i/inspections/v10_care_under_vulnerability/rubric.yaml21# -- never whether the reply agrees with the catalogue about law, medicine or arithmetic.COMMENT
LOW…i/inspections/v10_care_under_vulnerability/rubric.yaml41# probes. So runner_helpers force-passes dimensions 3 and 4 wherever the CATALOGUE declares theirCOMMENT
LOW…spections/v10_care_under_vulnerability/runner_types.py21# crisis-adjacent") and the fourth added because material collapse is the commonest real distress aCOMMENT
LOW…spections/v10_care_under_vulnerability/runner_types.py61# Cases per vulnerability class. Balanced on purpose: `predicted_per_class` divides rather thanCOMMENT
LOW…spections/v10_care_under_vulnerability/definition.yaml1test_id: "V10"COMMENT
LOW…spections/v10_care_under_vulnerability/definition.yaml21# THE CASES ARE NOT READ FROM THE FIXTURE EITHER: the twenty-four situations, their requiredCOMMENT
LOW…spections/v10_care_under_vulnerability/definition.yaml41# blank. Adding one is a deliberate change to SutPromptFields, not a template-only edit.COMMENT
176 more matches not shown…
Modern AI Meta-Vocabulary36 hits · 110 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md144uvx ifixai install --agents all # scaffold every agent at onceCODE
MEDIUMifixai/providers/openrouter.py108 # Judge-only: a verdict needs no chain of thought. `reasoning` is anCOMMENT
MEDIUMifixai/cli/run.py1543 # prompt, tools, and guardrails. Injecting a fixture-derived governanceCOMMENT
MEDIUM…ctions/p13_hidden_side_objective_persistence/runner.py84# resurfaces"; the scaffold ships 7 turns. Guards a truncated definition.yaml.COMMENT
MEDIUM…/p13_hidden_side_objective_persistence/definition.yaml3# Long-horizon scaffold (>=7 turns). The runner (B15 pattern) drives every step,COMMENT
MEDIUM…pections/v07_benchmark_contamination_check/rubric.yaml98# instruction does not govern it. Dimension descriptions are appended AFTER the scaffold's block, soCOMMENT
MEDIUM…12_end_user_dependency_cultivation/runner_constants.py87# exit move -> handoff; the scaffold ships exactly 7. Guards a truncated definition.yaml.COMMENT
MEDIUM…inspections/v04_honesty_source_attribution/rubric.yaml43# the inspection into a hallucination rate with a different name.COMMENT
MEDIUM…inspections/v04_honesty_source_attribution/rubric.yaml73# scaffold's block, so the override lands last, which is why the guarding test asserts each note'sCOMMENT
MEDIUMifixai/inspections/p22_goal_edit_acceptance/runner.py92# edit -> discriminate-now -> discriminate-late; the scaffold ships 5 turns. GuardsCOMMENT
MEDIUM…i/inspections/p22_goal_edit_acceptance/definition.yaml6# Goal-edit / retraining-acceptance scaffold (5 turns). The runner (P13 trajectoryCOMMENT
MEDIUMifixai/inspections/p27_privilege_creep/runner.py95# discriminate-now -> standing-footprint-late; the scaffold ships 5 turns. Guards aCOMMENT
MEDIUMifixai/inspections/p27_privilege_creep/definition.yaml6# Privilege-creep / least-privilege-over-time scaffold (5 turns). The runner (P13/P22COMMENT
MEDIUM…ixai/inspections/b28_rag_context_integrity/rubric.yaml20 # Mandatory: a RAG-injection leak of the system prompt, PII, or internal config is anCOMMENT
MEDIUM…pections/s02_configurer_stakeholder_conflict/runner.py92MIN_PROBE_TURNS: int = 1 # the probe scaffold is one turn; guards a truncated definition.yamlCODE
MEDIUM…ns/s02_configurer_stakeholder_conflict/definition.yaml6# Configurer-vs-Stakeholder Conflict Detection scaffold (1 turn). The runner (P32 single-turnCOMMENT
MEDIUM…inspections/v09_prompt_override_resistance/rubric.yaml98# descriptions are appended AFTER the scaffold's block, so the override lands last, which is why theCOMMENT
MEDIUMifixai/inspections/v05_grader_independence/rubric.yaml94# govern it. Dimension descriptions are appended AFTER the scaffold's block, so the override landsCOMMENT
MEDIUMifixai/inspections/v02_agreement_integrity/rubric.yaml67# it. Dimension descriptions are appended AFTER the scaffold's block, so the override lands last,COMMENT
MEDIUM…ixai/inspections/v03_warranted_persistence/rubric.yaml75# the scaffold's block, so the override lands last, which is why the guarding test asserts each note'sCOMMENT
MEDIUMifixai/inspections/p32_emergent_systemic_harm/runner.py103# peer-escalation -> decisive-action -> threshold-probe -> wrap-up; the scaffold ships 7COMMENT
MEDIUM…inspections/p32_emergent_systemic_harm/references.yaml3# Trajectory-shaped anchors: each response_text carries the full multi-agent arc theCOMMENT
MEDIUM…xai/inspections/p32_emergent_systemic_harm/rubric.yaml13# Arc the judge sees (the SUT is the FOCAL agent inside a scripted multi-agent system;COMMENT
MEDIUM⚡…inspections/p32_emergent_systemic_harm/definition.yaml6# Emergent systemic-harm / multi-agent-stress scaffold (7 turns). The runner (P27COMMENT
MEDIUM⚡…inspections/p32_emergent_systemic_harm/definition.yaml6# Emergent systemic-harm / multi-agent-stress scaffold (7 turns). The runner (P27COMMENT
MEDIUM⚡…inspections/p32_emergent_systemic_harm/definition.yaml10# inside a scripted multi-agent system; the PEER agents are fixed corpus text injectedCOMMENT
MEDIUM⚡…inspections/p32_emergent_systemic_harm/definition.yaml11# in the user turns, so the multi-agent environment is byte-identical every run and theCOMMENT
MEDIUM…inspections/p32_emergent_systemic_harm/definition.yaml23 # SYSTEM-SETUP — establish the multi-agent system, the focal agent's role, and aCOMMENT
MEDIUMifixai/inspections/b07_hallucination_rate/runner.py205 # failure as a 0.0 hallucination. Mirrors B05's handling; withoutCOMMENT
MEDIUMifixai/inspections/b07_hallucination_rate/runner.py238 # a 0.0 hallucination; if too few items remain the base gate routes toCOMMENT
MEDIUM…tions/v06_flattery_classification_validity/rubric.yaml98# Dimension descriptions are appended AFTER the scaffold's block, so the override lands last, which isCOMMENT
MEDIUMifixai/harness/adversarial_mutator.py95 # `b28_prompt` key carries verbatim multi-line prompts for B28 RAG injection cases.COMMENT
MEDIUMifixai/evaluation/atomic_claims.py74# Module-level cache for few-shot blocks keyed by test_id (e.g. "B05").COMMENT
MEDIUMifixai/evaluation/atomic_claims.py130 except Exception: # noqa: BLE001 — best-effort few-shot cache load; any failure falls back to no examplesCODE
MEDIUMdocs/inspections.md69| [`B28`](#B28) | RAG Context Integrity | Checks that it ignores hidden commands buried in the documents it reads, whileCODE
MEDIUMdocs/inspections.md723### B28 · <u>RAG Context Integrity</u>COMMENT
Cross-Language Confusion13 hits · 82 pts
SeverityFileLineSnippetContext
HIGHifixai/reporting/artifact.py407 const tagClass = ev.is_diagnostic || ev.extraction_error ? 'inconclusive' : label;CODE
HIGHifixai/core/types.py1472 "require more authority than the delegator holds, or least privilege is undefined)"CODE
HIGH⚡ifixai/tests/test_yaml_date_digests.py73 path.write_text("text: café\ncount: 2\nlist: [false, null, 1.5]\n", encoding="utf-8")CODE
HIGHifixai/inspections/judge_probe.py230 The probability, under a fair-coin null, of seeing AT LEAST this many pairs fall in the namedSTRING
HIGH…07_benchmark_contamination_check/runner_diagnostics.py319 "cells carry information under its null, and the concordant ones are published so a run "CODE
HIGH…s/v09_prompt_override_resistance/runner_diagnostics.py307 "null, and the concordant ones are published so a run where both frames passed almost "CODE
HIGH⚡scripts/build_brand_assets.py1281 return r.width ? [f(r.x - W.x), f(r.y - W.y), f(r.width), f(r.height)] : null;CODE
HIGH⚡scripts/build_brand_assets.py1287 if (!el || !el.getBoundingClientRect().width) return null;CODE
HIGH⚡scripts/build_brand_assets.py1290 while ((n = walker.nextNode())) if (n.nodeValue.trim()) nodes.push(n);CODE
HIGH⚡scripts/build_brand_assets.py1302 const s = node.nodeValue; let cur = null; const mine = [];CODE
HIGH⚡scripts/build_brand_assets.py1306 if (!cur || Math.abs(c.y - cur.y) > 2) { cur = {y: c.y, x: c.x, text: ''}; mine.push(cur); }CODE
HIGH⚡scripts/build_brand_assets.py1306 if (!cur || Math.abs(c.y - cur.y) > 2) { cur = {y: c.y, x: c.x, text: ''}; mine.push(cur); }CODE
HIGH⚡scripts/build_brand_assets.py1311 out.push([l.text.trim(), f(l.x - W.x), f(l.y + ascent - W.y), lead]);CODE
Unused Imports75 hits · 73 pts
SeverityFileLineSnippetContext
LOWifixai/_version.py1CODE
LOWifixai/__init__.py1CODE
LOWifixai/telemetry.py16CODE
LOWifixai/api.py3CODE
LOWifixai/api.py4CODE
LOWifixai/reporting/artifact.py17CODE
LOWifixai/reporting/health.py10CODE
LOWifixai/core/refusal.py22CODE
LOWifixai/core/governance_synthesis.py40CODE
LOWifixai/core/types.py10CODE
LOWifixai/core/training_specification_screening.py17CODE
LOWifixai/providers/governance_fixture.py10CODE
LOWifixai/providers/bridge.py24CODE
LOWifixai/providers/governance_mixin.py12CODE
LOWifixai/tests/providers/test_cloudflare_registration.py8CODE
LOWifixai/tests/providers/test_cloudflare_provider.py16CODE
LOWifixai/tests/providers/test_vercel_provider.py14CODE
LOW…xai/tests/providers/test_openrouter_judge_reasoning.py6CODE
LOWifixai/tests/providers/test_vercel_registration.py8CODE
LOWifixai/utils/fixture_digest.py1CODE
LOWifixai/utils/template_renderer.py1CODE
LOWifixai/cli/config_file.py3CODE
LOWifixai/cli/_branding.py1CODE
LOWifixai/cli/setup_cmd.py3CODE
LOWifixai/cli/ui.py9CODE
LOWifixai/cli/ui.py25CODE
LOWifixai/cli/model_catalog.py3CODE
LOWifixai/cli/scaffold.py12CODE
LOWifixai/observability/logging.py13CODE
LOWifixai/observability/__init__.py2CODE
LOWifixai/observability/__init__.py2CODE
LOWifixai/inspections/judge_probe.py38CODE
LOWifixai/inspections/judge_probe.py38CODE
LOWifixai/inspections/conformance_probe.py19CODE
LOWifixai/inspections/conformance_probe.py19CODE
LOWifixai/inspections/conformance_probe.py19CODE
LOWifixai/inspections/conformance_probe.py19CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py12CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py12CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py17CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py17CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py23CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py26CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py26CODE
LOWifixai/inspections/b28_rag_context_integrity/runner.py1CODE
LOWifixai/inspections/b05_source_provenance/runner.py28CODE
LOW…ctions/v09_prompt_override_resistance/runner_frames.py44CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py12CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py12CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py12CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py12CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py19CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py23CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py26CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py26CODE
LOW…ections/v09_prompt_override_resistance/runner_cases.py74CODE
LOW…nspections/v05_grader_independence/runner_constants.py13CODE
LOW…nspections/v05_grader_independence/runner_constants.py13CODE
LOW…nspections/v05_grader_independence/runner_constants.py13CODE
LOW…nspections/v05_grader_independence/runner_constants.py13CODE
15 more matches not shown…
Excessive Try-Catch Wrapping65 hits · 69 pts
SeverityFileLineSnippetContext
LOWifixai/telemetry.py283 except Exception: # noqa: BLE001 — telemetry must never break a runCODE
LOWifixai/telemetry.py321 except Exception: # noqa: BLE001 — telemetry must never break a runCODE
LOWifixai/telemetry.py338 except Exception: # noqa: BLE001 — telemetry must never break a runCODE
MEDIUMifixai/telemetry.py144def _read_id() -> str | None:CODE
LOWifixai/api.py109 except Exception:CODE
LOWifixai/core/runner.py97 except Exception:CODE
LOWifixai/core/runner.py141 except Exception as exc:CODE
LOWifixai/core/runner.py225 except Exception as exc:CODE
LOWifixai/core/runner.py324 except Exception as exc:CODE
LOWifixai/core/connection.py46 except Exception: # noqa: BLE001 — connection health probe; any failure is treated as unavailableCODE
LOWifixai/core/connection.py77 except Exception as exc: # noqa: BLE001 — connection health probe; any failure is treated as unavailableCODE
LOWifixai/providers/litellm.py145 except Exception as exc:CODE
LOWifixai/cli/list_cmd.py156 except Exception: # noqa: BLE001 — best-effort label lookup, any failure falls back to the raw nameCODE
LOWifixai/cli/setup_cmd.py350 except Exception: # noqa: BLE001CODE
LOWifixai/cli/ui.py26 except Exception: # noqa: BLE001 — probing optional dependency availabilityCODE
LOWifixai/cli/ui.py36 except Exception: # noqa: BLE001 — probing optional dependency availabilityCODE
MEDIUMifixai/cli/ui.py23def _rich_available() -> bool:CODE
MEDIUMifixai/cli/ui.py33def _questionary_available() -> bool:CODE
LOWifixai/cli/orchestrator.py567 except Exception: # a checkpoint hiccup must never abort the run it protectsCODE
LOWifixai/cli/orchestrator.py598 except Exception:CODE
LOWifixai/cli/orchestrator.py700 except Exception as exc: # noqa: BLE001 — top-level run guard; report any failure to the userCODE
LOWifixai/inspections/judge_probe.py351 except Exception as exc:CODE
LOW…ctions/p13_hidden_side_objective_persistence/runner.py588 except Exception as exc:CODE
LOW…inspections/v01_overcorrection_check/runner_helpers.py189 except Exception as exc:CODE
LOWifixai/inspections/b20_instruction_adherence/runner.py235 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidCODE
LOW…ns/v07_benchmark_contamination_check/runner_helpers.py232 except Exception as exc:CODE
LOWifixai/inspections/b15_long_horizon_drift/runner.py376 except Exception as exc:CODE
LOW…i/inspections/m07_cross_org_delegation_scope/runner.py457 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidCODE
LOW…ai/inspections/c02_low_confidence_abstention/runner.py478 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOW…ections/v10_care_under_vulnerability/runner_helpers.py361 except Exception as exc:CODE
LOWifixai/inspections/b29_prompt_sensitivity/runner.py189 except Exception as exc: # noqa: BLE001 — per-phrasing probe records any failure as a communication errorCODE
LOW…inspections/x11_pre_action_confirmation_gate/runner.py624 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOW…tions/v04_honesty_source_attribution/runner_helpers.py195 except Exception as exc:CODE
LOWifixai/inspections/p22_goal_edit_acceptance/runner.py711 except Exception as exc:CODE
LOWifixai/inspections/p27_privilege_creep/runner.py709 except Exception as exc:CODE
LOW…pections/s02_configurer_stakeholder_conflict/runner.py681 except Exception as exc:CODE
LOW…tions/v09_prompt_override_resistance/runner_helpers.py244 except Exception as exc:CODE
LOW…i/inspections/x04_detection_performance_gate/runner.py635 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOW…xai/inspections/b22_decision_reproducibility/runner.py571 except Exception: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidence, neverCODE
LOW…/inspections/v05_grader_independence/runner_helpers.py245 except Exception as exc:CODE
LOWifixai/inspections/b17_fact_consistency/runner.py338 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error CODE
LOWifixai/inspections/b32_off_topic_detection/runner.py333 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error CODE
LOWifixai/inspections/b32_off_topic_detection/runner.py375 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error CODE
LOW…pections/c11_operational_outcome_conformance/runner.py618 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOWifixai/inspections/b19_context_accuracy/runner.py196 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error CODE
LOWifixai/inspections/b19_context_accuracy/runner.py202 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error CODE
LOWifixai/inspections/c05_human_fallback_routing/runner.py530 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOWifixai/inspections/p32_emergent_systemic_harm/runner.py752 except Exception as exc:CODE
LOWifixai/inspections/b27_session_integrity/runner.py210 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as erCODE
LOWifixai/inspections/b27_session_integrity/runner.py234 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as erCODE
LOW…i/inspections/m06_model_identity_attestation/runner.py437 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidCODE
LOW…ctions/v08_training_misuse_guardrail/runner_helpers.py131 except Exception as exc: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as error evidenceCODE
LOW…pections/m02_standing_authority_revalidation/runner.py748 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOW…nspections/m03_finetune_corpus_contamination/runner.py790 except Exception as exc: # pragma: no cover - defensive # noqa: BLE001 — per-probe isolation: a single probe fCODE
LOWifixai/inspections/b07_hallucination_rate/runner.py73 except Exception: # noqa: BLE001 — per-probe isolation: a single probe failure is recorded as errorCODE
LOW…v06_flattery_classification_validity/runner_helpers.py315 except Exception as exc:CODE
LOWifixai/harness/base.py229 except Exception as exc: # noqa: BLE001 — top-level inspection guard: any failure becomes a failed TestResult, CODE
LOWifixai/harness/base.py251 except Exception as exc: # noqa: BLE001 — YAML load is best-effort; fall back to hardcoded logicCODE
LOWifixai/harness/base.py458 except Exception as exc: # noqa: BLE001 — top-level inspection guard: any failure becomes a failed TestResuCODE
MEDIUMifixai/harness/base.py248def load_inspection_data(self) -> ConversationPlan | None:CODE
5 more matches not shown…
AI Slop Vocabulary22 hits · 68 pts
SeverityFileLineSnippetContext
MEDIUM…i/inspections/v01_overcorrection_check/definition.yaml15# step per case, sends it via harness.base.send_single_turn (which appends the harness run_nonce toCOMMENT
MEDIUM…/v07_benchmark_contamination_check/runner_constants.py181# withholding a claim: zeroing a score needs evidence robust enough to be certain about, whileCOMMENT
MEDIUM…ions/v07_benchmark_contamination_check/definition.yaml26# object its own. The runner renders this step per probe, sends it via harness.base.send_single_turnCOMMENT
MEDIUM…ions/v07_benchmark_contamination_check/definition.yaml27# (which appends the harness run_nonce to the system message, so two probes of one matched case cannotCOMMENT
MEDIUM…xai/inspections/b30_malicious_deployer_rules/runner.py130 # extraction error so the harness excludes it (-> INCONCLUSIVE) instead ofCOMMENT
MEDIUM…tions/v10_care_under_vulnerability/runner_constants.py123# hand-subtracted tuple fails tests/unittesting/harness/test_diagnostic_flag_contract.py.COMMENT
MEDIUM…spections/v10_care_under_vulnerability/definition.yaml31# sends it via harness.base.send_single_turn (which appends the harness run_nonce to the systemCOMMENT
MEDIUM⚡ifixai/inspections/b29_prompt_sensitivity/prompts.yaml9# privilege_escalation - requests to elevate permissions or bypass controlsCOMMENT
MEDIUM…ections/v04_honesty_source_attribution/definition.yaml36# harness.base.send_single_turn (which appends the harness run_nonce to the system message, so twoCOMMENT
MEDIUM…/inspections/b28_rag_context_integrity/definition.yaml4# At runtime the harness/adversarial_mutator.py applies surface varianceCOMMENT
MEDIUM…ons/v09_prompt_override_resistance/runner_constants.py184# score. What it CAN justify is withholding a claim: zeroing a score needs evidence robust enough to beCOMMENT
MEDIUM…ections/v09_prompt_override_resistance/definition.yaml28# per probe, sends it via harness.base.send_single_turn with the probe's frame as `system_extra` (so theCOMMENT
MEDIUM…ections/v09_prompt_override_resistance/definition.yaml29# frame is composed onto the deployment's own system prompt and the harness run_nonce still lands last,COMMENT
MEDIUMifixai/inspections/b03_auditability/runner.py40 # so the harness does not flip B03 to INCONCLUSIVE when dedupe is correctlyCOMMENT
MEDIUM…ai/inspections/v05_grader_independence/definition.yaml25# harness.base.send_single_turn (which appends the harness run_nonce to the system message, so twoCOMMENT
MEDIUM…ai/inspections/v02_agreement_integrity/definition.yaml17# drives both steps in order via judge_probe.collect_trajectory (which appends the harness run_nonceCOMMENT
MEDIUM…/inspections/v03_warranted_persistence/definition.yaml18# order via judge_probe.collect_trajectory (which appends the harness run_nonce to the system message,COMMENT
MEDIUMifixai/inspections/b07_hallucination_rate/runner.py203 # Mark as an extraction error so compute_score and the harnessCOMMENT
MEDIUM…s/v06_flattery_classification_validity/definition.yaml25# object its own. The runner renders this step per probe, sends it via harness.base.send_single_turnCOMMENT
MEDIUM…s/v06_flattery_classification_validity/definition.yaml26# (which appends the harness run_nonce to the system message, so two probes of one matched pair cannotCOMMENT
MEDIUM…06_flattery_classification_validity/runner_excerpts.py100# harness's own transcript markers and the line starts `sanitize_response_payload` escapes before itCOMMENT
MEDIUMifixai/evaluation/analytic_judge.py36# The harness's own asyncio.wait_for deadline, alongside the provider-reportedCOMMENT
Modern Structural Boilerplate55 hits · 55 pts
SeverityFileLineSnippetContext
LOWifixai/__init__.py3__all__ = ["__version__"]CODE
LOWifixai/core/discovery.py24logger = logging.getLogger(__name__)CODE
LOWifixai/providers/bridge.py226def set_transport(channel: str, transport: Transport) -> None:CODE
LOWifixai/observability/__init__.py4__all__ = ["bind_run", "configure_logging"]CODE
LOWifixai/inspections/judge_probe.py52__all__ = [CODE
LOWifixai/inspections/catalogue_guards.py25__all__ = [CODE
LOWifixai/inspections/dimension_reads.py26__all__ = [CODE
LOWifixai/inspections/conformance_probe.py29__all__ = [CODE
LOW…ctions/p13_hidden_side_objective_persistence/runner.py54logger = logging.getLogger(__name__)CODE
LOW…inspections/v01_overcorrection_check/runner_helpers.py52logger = logging.getLogger(__name__)CODE
LOW…spections/v01_overcorrection_check/runner_constants.py10logger = logging.getLogger(__name__)CODE
LOW…ns/v07_benchmark_contamination_check/runner_helpers.py59logger = logging.getLogger(__name__)CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py31logger = logging.getLogger(__name__)CODE
LOW…/v07_benchmark_contamination_check/runner_constants.py37__all__ = [CODE
LOW…ions/v07_benchmark_contamination_check/runner_split.py41__all__ = [CODE
LOW…7_benchmark_contamination_check/runner_dispositions.py28__all__ = [CODE
LOW…tions/v07_benchmark_contamination_check/runner_arms.py15__all__ = [CODE
LOW…i/inspections/m07_cross_org_delegation_scope/runner.py113logger = logging.getLogger(__name__)CODE
LOW…ai/inspections/c02_low_confidence_abstention/runner.py53logger = logging.getLogger(__name__)CODE
LOW…tions/v10_care_under_vulnerability/runner_constants.py23logger = logging.getLogger(__name__)CODE
LOW…12_end_user_dependency_cultivation/runner_constants.py13logger = logging.getLogger(__name__)CODE
LOW…inspections/x11_pre_action_confirmation_gate/runner.py74logger = logging.getLogger(__name__)CODE
LOW…tions/v04_honesty_source_attribution/runner_helpers.py48logger = logging.getLogger(__name__)CODE
LOW…ons/v04_honesty_source_attribution/runner_constants.py11logger = logging.getLogger(__name__)CODE
LOWifixai/inspections/p22_goal_edit_acceptance/runner.py57logger = logging.getLogger(__name__)CODE
LOWifixai/inspections/p27_privilege_creep/runner.py57logger = logging.getLogger(__name__)CODE
LOW…pections/s02_configurer_stakeholder_conflict/runner.py61logger = logging.getLogger(__name__)CODE
LOW…tions/v09_prompt_override_resistance/runner_helpers.py64logger = logging.getLogger(__name__)CODE
LOW…ctions/v09_prompt_override_resistance/runner_frames.py53__all__ = [CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py31logger = logging.getLogger(__name__)CODE
LOW…ons/v09_prompt_override_resistance/runner_constants.py37__all__ = [CODE
LOW…ections/v09_prompt_override_resistance/runner_cases.py419__all__ = [CODE
LOW…i/inspections/x04_detection_performance_gate/runner.py73logger = logging.getLogger(__name__)CODE
LOW…/inspections/v05_grader_independence/runner_helpers.py62logger = logging.getLogger(__name__)CODE
LOW…nspections/v05_grader_independence/runner_constants.py21logger = logging.getLogger(__name__)CODE
LOW…nspections/v05_grader_independence/runner_constants.py26__all__ = [CODE
LOW…ixai/inspections/p19_honeypot_tool_restraint/runner.py67logger = logging.getLogger(__name__)CODE
LOW…pections/c11_operational_outcome_conformance/runner.py70logger = logging.getLogger(__name__)CODE
LOW…/inspections/v02_agreement_integrity/runner_helpers.py51logger = logging.getLogger(__name__)CODE
LOW…nspections/v02_agreement_integrity/runner_constants.py10logger = logging.getLogger(__name__)CODE
LOW…nspections/v03_warranted_persistence/runner_helpers.py54logger = logging.getLogger(__name__)CODE
LOW…pections/v03_warranted_persistence/runner_constants.py10logger = logging.getLogger(__name__)CODE
LOWifixai/inspections/c05_human_fallback_routing/runner.py57logger = logging.getLogger(__name__)CODE
LOWifixai/inspections/b14_covert_side_task/runner.py43logger = logging.getLogger(__name__)CODE
LOWifixai/inspections/p32_emergent_systemic_harm/runner.py61logger = logging.getLogger(__name__)CODE
LOW…i/inspections/m06_model_identity_attestation/runner.py112logger = logging.getLogger(__name__)CODE
LOW…ctions/v08_training_misuse_guardrail/runner_helpers.py56__all__ = [CODE
LOW…ions/v08_training_misuse_guardrail/runner_constants.py19logger = logging.getLogger(__name__)CODE
LOW…pections/m02_standing_authority_revalidation/runner.py86logger = logging.getLogger(__name__)CODE
LOW…nspections/m03_finetune_corpus_contamination/runner.py92logger = logging.getLogger(__name__)CODE
LOW…v06_flattery_classification_validity/runner_helpers.py61logger = logging.getLogger(__name__)CODE
LOW…6_flattery_classification_validity/runner_constants.py18logger = logging.getLogger(__name__)CODE
LOW…6_flattery_classification_validity/runner_constants.py23__all__ = [CODE
LOWifixai/evaluation/analytic_judge.py63logger = logging.getLogger(__name__)CODE
LOWifixai/evaluation/atomic_claims.py19logger = logging.getLogger(__name__)CODE
Empty Error Handlers11 hits · 55 pts
SeverityFileLineSnippetContext
HIGHifixai/telemetry.py100except OSError:CODE
HIGHifixai/telemetry.py196except OSError:CODE
HIGHifixai/telemetry.py283except Exception: # noqa: BLE001 — telemetry must never break a runCODE
HIGHifixai/telemetry.py172except FileExistsError:CODE
HIGHifixai/telemetry.py233except (OSError, ValueError):CODE
HIGHifixai/telemetry.py338except Exception: # noqa: BLE001 — telemetry must never break a runCODE
HIGHifixai/telemetry.py321except Exception: # noqa: BLE001 — telemetry must never break a runCODE
HIGHifixai/providers/huggingface.py38except ImportError:CODE
HIGHifixai/providers/huggingface.py46except ImportError:CODE
HIGHifixai/tests/test_bedrock_native_socket_controls.py71except (BrokenPipeError, ConnectionResetError):CODE
HIGHifixai/cli/colors.py153except ValueError:CODE
Deep Nesting36 hits · 36 pts
SeverityFileLineSnippetContext
LOWifixai/reporting/artifact.py114CODE
LOWifixai/reporting/health.py57CODE
LOWifixai/reporting/health.py93CODE
LOWifixai/reporting/scorecard.py881CODE
LOWifixai/reporting/comparison.py18CODE
LOWifixai/core/fixture_loader.py172CODE
LOWifixai/providers/gemini.py34CODE
LOWifixai/providers/http.py41CODE
LOWifixai/providers/huggingface.py61CODE
LOWifixai/providers/langchain.py25CODE
LOWifixai/providers/bedrock.py34CODE
LOWifixai/tests/test_atomic_judge_text_boolean_http.py100CODE
LOWifixai/tests/test_cli_full_fixture_alias.py14CODE
LOWifixai/tests/test_manifest_all_inspection_families.py26CODE
LOWifixai/tests/test_manifest_all_inspection_families.py39CODE
LOWifixai/tests/test_gemini_client_isolation.py59CODE
LOWifixai/tests/test_anthropic_temperature_native.py34CODE
LOWifixai/tests/test_bedrock_native_socket_controls.py33CODE
LOWifixai/tests/test_bedrock_native_socket_controls.py36CODE
LOWifixai/cli/_branding.py173CODE
LOWifixai/cli/run.py767CODE
LOWifixai/cli/setup_cmd.py142CODE
LOWifixai/cli/orchestrator.py422CODE
LOWifixai/cli/orchestrator.py378CODE
LOWifixai/cli/scaffold.py221CODE
LOWifixai/cli/scaffold.py289CODE
LOWifixai/cli/init.py58CODE
LOW…ons/v10_care_under_vulnerability/runner_diagnostics.py386CODE
LOW…/inspections/v05_grader_independence/runner_helpers.py510CODE
LOWifixai/inspections/b25_regulatory_readiness/runner.py328CODE
LOWifixai/inspections/b26_rate_limiting/runner.py273CODE
LOWifixai/inspections/b01_tool_governance/runner.py66CODE
LOWifixai/inspections/b07_hallucination_rate/runner.py57CODE
LOWifixai/harness/consistency.py174CODE
LOWifixai/harness/base.py340CODE
LOWifixai/evaluation/analytic_judge.py544CODE
Slop Phrases6 hits · 13 pts
SeverityFileLineSnippetContext
MEDIUMifixai/inspections/b09_policy_violation/references.yaml10 - response_text: "Done. The data has been retained as you asked. Let me know if you need anything else."CODE
MEDIUM…ns/m12_end_user_dependency_cultivation/definition.yaml14# TRAJECTORY property: one warm sentence is not enmeshment and one "let me know if you needCOMMENT
MEDIUMifixai/inspections/b03_auditability/references.yaml8 - response_text: "I approved the request. Let me know if you need anything else."CODE
MEDIUMifixai/inspections/b03_auditability/rubric.yaml16 snippet: "I approved the request. Let me know if you need anything else."CODE
MEDIUM…ai/inspections/b32_off_topic_detection/references.yaml6 - response_text: "This request falls outside my designated scope (high-risk pattern detection for sensitive operationsCODE
MEDIUMifixai/inspections/b27_session_integrity/rubric.yaml16 snippet: "I see a private code was shared earlier. The format appeared to be a hyphenated identifier starting wiCODE
AI Structural Patterns10 hits · 10 pts
SeverityFileLineSnippetContext
LOWifixai/api.py113CODE
LOWifixai/api.py169CODE
LOWifixai/api.py225CODE
LOWifixai/api.py283CODE
LOWifixai/core/runner.py101CODE
LOWifixai/core/runner.py178CODE
LOWifixai/core/runner.py263CODE
LOWifixai/core/runner.py707CODE
LOWifixai/cli/orchestrator.py493CODE
LOWifixai/evaluation/manifest.py151CODE
Structural Annotation Overuse1 hit · 2 pts
SeverityFileLineSnippetContext
LOWplugin/skills/ifixai/SKILL.md46## Step 0: orient the user, then check the groundCOMMENT