Repository Analysis

Giskard-AI/giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

35.7 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Giskard-AI/giskard-oss, a Python project with 5,782 GitHub stars. SynthScan v2.0 examined 58,114 lines of code across 391 source files, recording 2018 pattern matches distributed across 18 syntactic categories. The overall adjusted score of 35.7 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

35.7
Adjusted Score
35.7
Raw Score
100%
Time Factor
2026-08-28
Last Push
5.8K
Stars
Python
Language
58.1K
Lines of Code
391
Files
2.0K
Pattern Hits
2026-08-29
Scan Date
0.01
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 5MEDIUM 28LOW 1985

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 2018 distinct pattern matches across 18 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers1461 hits · 1476 pts
SeverityFileLineSnippetContext
LOWtools/test_check_extra_pins.py13def test_matching_lower_bound_is_ok() -> None:CODE
LOWtools/test_check_extra_pins.py61def test_stale_lib_pin_is_ignored_by_root_only_check(tmp_path: Path) -> None:CODE
LOWtools/test_check_extra_pins.py67def test_stale_giskard_scan_pin_is_a_package_mismatch(tmp_path: Path) -> None:CODE
LOWtools/test_check_extra_pins.py85def test_package_pins_reject_non_ge_operators(tmp_path: Path, scan_req: str) -> None:CODE
LOWtools/test_check_extra_pins.py92def test_package_pins_ok_when_root_and_lib_match(tmp_path: Path) -> None:CODE
LOWtools/test_check_extra_pins.py97def test_package_pins_ok_when_no_requirement_names_package(tmp_path: Path) -> None:CODE
LOWtools/test_check_extra_pins.py110def test_current_tree_giskard_has_no_versioned_pins() -> None:CODE
LOWtools/test_lint_readme_snippets.py6def test_lint_markdown_checks_spaced_python_fences(tmp_path: Path) -> None:CODE
LOWtools/test_lint_readme_snippets.py18def test_lint_markdown_checks_positional_f_strings(tmp_path: Path) -> None:CODE
LOWtools/test_bump_workspace_pins.py12def test_rewrite_preserves_extras_comments_and_other_packages() -> None:CODE
LOWtools/test_bump_workspace_pins.py27def test_rewrite_does_not_match_package_name_prefix() -> None:CODE
LOWtools/test_bump_workspace_pins.py42def test_bump_pins_updates_root_and_downstream_libs(tmp_path: Path) -> None:CODE
LOWtools/test_bump_workspace_pins.py72def test_simulated_checks_release_keeps_root_pins_aligned() -> None:CODE
LOWtools/check_extra_pins.py82def _iter_project_requirements(CODE
LOWtools/check_extra_pins.py153def collect_package_pin_mismatches(CODE
LOWlibs/giskard-scan/tests/conftest.py7def isolated_vulnerability_registry():CODE
LOWlibs/giskard-scan/tests/conftest.py18def isolated_quality_registry():CODE
LOWlibs/giskard-scan/tests/test_public_import_surface.py47def test_scan_src_imports_upstream_libs_only_from_package_roots():CODE
LOWlibs/giskard-scan/tests/test_generators_concrete.py5def test_prompt_injection_generator_is_importable():CODE
LOWlibs/giskard-scan/tests/test_generators_concrete.py10async def test_prompt_injection_scenarios_have_tags():CODE
LOWlibs/giskard-scan/tests/test_public_api.py28def _registry_generator_types(registry: SuiteGeneratorRegistry) -> set[type]:CODE
LOWlibs/giskard-scan/tests/test_public_api.py32def test_default_registry_generators_are_public():CODE
LOWlibs/giskard-scan/tests/test_public_api.py43def test_all_public_symbols_importable():CODE
LOWlibs/giskard-scan/tests/test_public_api.py56def test_vulnerability_suite_generator_registry_contains_builtin_generators():CODE
LOWlibs/giskard-scan/tests/test_public_api.py64def test_vulnerability_scan_accepts_target_mode_param():CODE
LOWlibs/giskard-scan/tests/test_public_api.py75def test_quality_scan_accepts_target_mode_param():CODE
LOWlibs/giskard-scan/tests/test_public_api.py86def test_quality_suite_generator_registry_contains_builtin_generators():CODE
LOWlibs/giskard-scan/tests/test_public_api.py96def test_list_scan_items_giskard():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py19def test_scenario_generator_is_importable():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py24async def test_scenario_generator_generate_scenario_accepts_target_mode():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py44def test_dataset_generator_has_dataset_name_field():CODE
LOWlibs/giskard-scan/tests/test_scan_options.py28def test_resolve_scan_options_matches_for_identical_shared_kwargs():CODE
LOWlibs/giskard-scan/tests/test_scan_options.py50def test_scan_entrypoints_expose_shared_explicit_kwargs():CODE
LOWlibs/giskard-scan/tests/test_scan_options.py70def test_scan_entrypoints_require_keyword_only_options_after_languages():CODE
LOWlibs/giskard-scan/tests/test_vulnerability.py39async def test_vulnerability_scan_runs_registry_scenarios_and_returns_suite_result(CODE
LOWlibs/giskard-scan/tests/test_vulnerability.py92async def test_vulnerability_scan_forwards_run_options(CODE
LOWlibs/giskard-scan/tests/test_quality.py71async def test_quality_scan_runs_registry_scenarios_and_returns_suite_result(CODE
LOWlibs/giskard-scan/tests/test_quality.py139async def test_quality_scan_forwards_run_options(CODE
LOWlibs/giskard-scan/tests/test_quality.py192async def test_quality_scan_uses_empty_registry_by_default(CODE
LOWlibs/giskard-scan/tests/test_quality.py222async def test_quality_scan_warns_and_skips_empty_raw_knowledge_base(CODE
LOWlibs/giskard-scan/tests/test_quality.py273async def test_quality_scan_configures_knowledge_base_generator(CODE
LOWlibs/giskard-scan/tests/test_quality.py334async def test_quality_scan_does_not_generate_recommendation_without_failures(CODE
LOWlibs/giskard-scan/tests/test_quality.py359async def test_quality_scan_hides_recommendation_when_generation_fails(CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py30def test_knowledge_base_from_texts_does_not_compute_embeddings():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py43def test_normalize_knowledge_base_accepts_existing_instance_and_texts():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py53def test_normalize_knowledge_base_rejects_single_string():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py59def test_knowledge_base_drops_empty_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py68def test_knowledge_base_rejects_all_empty_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py73async def test_closest_documents_computes_missing_embeddings_lazily_in_batch():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py99async def test_closest_documents_initializes_embeddings_once_for_concurrent_callers():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py123async def test_closest_documents_recomputes_all_embeddings_when_any_is_missing():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py150async def test_closest_documents_to_text_embeds_query_against_cached_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py172async def test_closest_documents_to_text_rejects_empty_query_without_embedding():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py188async def test_closest_documents_rejects_non_finite_embeddings():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py201def test_knowledge_base_documents_are_immutable():CODE
LOW…iskard-scan/tests/integrations/test_list_scan_items.py7def test_list_scan_items_rejects_unknown_tool() -> None:CODE
LOW…iskard-scan/tests/integrations/test_list_scan_items.py14def test_list_scan_items_garak() -> None:CODE
LOW…iskard-scan/tests/integrations/test_list_scan_items.py23def test_list_scan_items_deepteam() -> None:CODE
LOW…iskard-scan/tests/integrations/garak/test_garak_e2e.py40def test_resolve_probes_empty_list_returns_no_probes() -> None:CODE
LOW…iskard-scan/tests/integrations/garak/test_garak_e2e.py47async def test_run_actual_garak_probe() -> None:CODE
1401 more matches not shown…
Unused Imports408 hits · 351 pts
SeverityFileLineSnippetContext
LOWtools/lint_readme_snippets.py3CODE
LOW…iskard-scan/tests/integrations/garak/test_garak_e2e.py26CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py8CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py9CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py16CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py17CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py18CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py19CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py20CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py28CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py29CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py29CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py29CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py30CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py30CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py31CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py32CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py33CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py33CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py34CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py34CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOW…giskard-scan/src/giskard/scan/integrations/__init__.py3CODE
LOW…giskard-scan/src/giskard/scan/integrations/__init__.py4CODE
LOW…giskard-scan/src/giskard/scan/integrations/__init__.py4CODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py28CODE
LOW…d-scan/src/giskard/scan/integrations/garak/__init__.py3CODE
LOW…d-scan/src/giskard/scan/integrations/garak/__init__.py3CODE
LOW…d-scan/src/giskard/scan/integrations/garak/__init__.py3CODE
LOW…d-scan/src/giskard/scan/integrations/garak/__init__.py3CODE
LOW…d-scan/src/giskard/scan/integrations/lidar/__init__.py3CODE
LOW…can/src/giskard/scan/integrations/deepteam/__init__.py3CODE
LOW…can/src/giskard/scan/integrations/deepteam/__init__.py3CODE
LOW…can/src/giskard/scan/integrations/deepteam/__init__.py4CODE
LOW…can/src/giskard/scan/integrations/deepteam/__init__.py4CODE
LOW…giskard/scan/integrations/deepteam/_judge_generator.py17CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py3CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py5CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py6CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py8CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py9CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py9CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py9CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py9CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py9CODE
348 more matches not shown…
Decorative Section Separators21 hits · 75 pts
SeverityFileLineSnippetContext
MEDIUMlibs/giskard-agents/tests/test_generator.py213# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_generator.py215# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py194# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py196# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py255# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py257# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py355# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py357# ---------------------------------------------------------------------------COMMENT
MEDIUM…d-agents/src/giskard/agents/tools/_docstring_parser.py2# ==============================================================================COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py208# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py210# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py310# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py312# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py408# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py410# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py28# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py59# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py452# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py454# ---------------------------------------------------------------------------COMMENT
Modern Structural Boilerplate52 hits · 52 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/__init__.py40__all__ = [CODE
LOWlibs/giskard-scan/src/giskard/scan/quality.py23logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py5__all__ = [CODE
LOW…giskard-scan/src/giskard/scan/integrations/__init__.py6__all__ = ["ScanTool", "list_scan_items", "third_party_scan"]CODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py33logger = logging.getLogger(__name__)CODE
LOW…d-scan/src/giskard/scan/integrations/garak/__init__.py5__all__ = [CODE
LOW…d-scan/src/giskard/scan/integrations/lidar/_adapter.py23logger = logging.getLogger(__name__)CODE
LOW…d-scan/src/giskard/scan/integrations/lidar/__init__.py5__all__ = [CODE
LOW…can/src/giskard/scan/integrations/deepteam/_adapter.py31logger = logging.getLogger(__name__)CODE
LOW…can/src/giskard/scan/integrations/deepteam/__init__.py6__all__ = [CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py19__all__ = [CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py18logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-scan/src/giskard/scan/generators/base.py13logger = logging.getLogger(__name__)CODE
LOW…/giskard/scan/generators/knowledge_base/multi_topic.py20logger = logging.getLogger(__name__)CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py19__all__ = [CODE
LOW…giskard/scan/generators/knowledge_base/out_of_scope.py25logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py40__all__ = [CODE
LOW…giskard-llm/src/giskard/llm/translators/openai_chat.py26logger = logging.getLogger(__name__)CODE
LOW…giskard-llm/src/giskard/llm/translators/google_chat.py59logger = logging.getLogger(__name__)CODE
LOW…ard-llm/src/giskard/llm/translators/google_response.py56logger = logging.getLogger(__name__)CODE
LOW…s/giskard-llm/src/giskard/llm/translators/anthropic.py50logger = logging.getLogger(__name__)CODE
LOW…ard-llm/src/giskard/llm/translators/openai_response.py22logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/types/__init__.py68__all__ = [CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py96logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/openai.py84logger = logging.getLogger(__name__)CODE
LOW…/giskard-llm/src/giskard/llm/providers/azure_openai.py47logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/anthropic.py78logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/azure_ai.py58logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/utils/__init__.py7__all__ = [CODE
LOWlibs/giskard-core/src/giskard/core/__init__.py46__all__ = [CODE
LOW…bs/giskard-core/src/giskard/core/telemetry/__init__.py11__all__ = [CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py71def _set_tags() -> None:CODE
LOW…giskard-core/src/giskard/core/rate_limiter/__init__.py9__all__ = [CODE
LOWlibs/giskard-agents/src/giskard/agents/__init__.py20__all__ = [CODE
LOWlibs/giskard-agents/src/giskard/agents/pipeline.py5__all__ = ["Pipeline"]CODE
LOW…bs/giskard-agents/src/giskard/agents/tools/__init__.py5__all__ = ["Tool", "tool", "Function", "ToolCall"]CODE
LOW…skard-agents/src/giskard/agents/embeddings/__init__.py7__all__ = [CODE
LOW…iskard-agents/src/giskard/agents/templates/__init__.py11__all__ = [CODE
LOW…skard-agents/src/giskard/agents/generators/__init__.py20__all__ = [CODE
LOW…skard-agents/src/giskard/agents/errors/serializable.py5__all__ = ["Error"]CODE
LOW…s/giskard-agents/src/giskard/agents/errors/__init__.py4__all__ = ["ModelRefusalError", "WorkflowError", "Error"]CODE
LOWlibs/giskard-checks/tests/generators/conftest.py3__all__ = ["LLMTrace", "MockGenerator"]CODE
LOWlibs/giskard-checks/src/giskard/checks/__init__.py86__all__ = [CODE
LOWlibs/giskard-checks/src/giskard/checks/settings.py65def set_default_generator(generator: BaseGenerator | str) -> None:CODE
LOWlibs/giskard-checks/src/giskard/checks/core/__init__.py22__all__ = [CODE
LOW…checks/src/giskard/checks/core/interaction/__init__.py6__all__ = ["InteractionSpec", "Interact", "Interaction", "Trace"]CODE
LOW…s/giskard-checks/src/giskard/checks/judges/__init__.py11__all__ = [CODE
LOW…/giskard-checks/src/giskard/checks/testing/__init__.py3__all__ = ["WithSpy"]CODE
LOW…iskard-checks/src/giskard/checks/scenarios/__init__.py4__all__ = [CODE
LOW…skard-checks/src/giskard/checks/generators/__init__.py7__all__ = [CODE
LOW…s/giskard-checks/src/giskard/checks/export/__init__.py4__all__ = ["to_hub_format", "to_junit_xml"]CODE
LOW…/giskard-checks/src/giskard/checks/builtin/__init__.py22__all__ = [CODE
Excessive Try-Catch Wrapping23 hits · 24 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/quality.py133 except Exception:CODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py171 except Exception as exc: # noqa: BLE001 — one bad plugin must not abortCODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py199 except Exception as exc: # noqa: BLE001 — one bad plugin must not abort the scanCODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py276 except Exception: # noqa: BLE001 — unknown module: fall back to instance pathCODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py369 except Exception as exc: # noqa: BLE001 — one bad detector must not abort the scanCODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py441 except Exception as exc: # noqa: BLE001 — a broken detector skips, not abortsCODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py514 except Exception as exc: # noqa: BLE001 — one bad probe must not abort the scanCODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py150 except Exception as exc:CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py286 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py319 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py382 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
MEDIUMlibs/giskard-llm/src/giskard/llm/providers/google.py106def _import_genai() -> Any:CODE
LOWlibs/giskard-core/src/giskard/core/welcome.py31 except Exception:CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py186 except Exception as e:CODE
LOWlibs/giskard-agents/src/giskard/agents/workflow.py474 except Exception as err:CODE
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py192 except Exception as error:CODE
LOW…rd-checks/src/giskard/checks/core/interaction/trace.py170 except Exception as error:CODE
LOW…s/giskard-checks/src/giskard/checks/utils/inference.py19 except Exception:CODE
LOW…s/giskard-checks/src/giskard/checks/utils/inference.py32 except Exception:CODE
LOW…bs/giskard-checks/src/giskard/checks/testing/runner.py30 except Exception as e:CODE
LOW…/giskard-checks/src/giskard/checks/scenarios/runner.py184 except Exception as caught:CODE
LOW…skard-checks/src/giskard/checks/builtin/nlp_metrics.py147 except Exception as exc:CODE
LOW…iskard-checks/src/giskard/checks/builtin/comparison.py99 except Exception:CODE
Structural Annotation Overuse8 hits · 16 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/README.md248### Step 1: Define a custom checkCOMMENT
LOWlibs/giskard-checks/README.md270### Step 2: Define a custom interaction specificationCOMMENT
LOWlibs/giskard-checks/README.md291### Step 3: Verify registrationCOMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py787 # Step 1: interaction0, check1COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py788 # Step 2: interaction2, check3COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py789 # Step 3: interaction4, check5COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py790 # Step 4: interaction6, check7COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py791 # Step 5: interaction8, check9COMMENT
Deep Nesting13 hits · 13 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/tests/test_public_import_surface.py29CODE
LOW…d-scan/src/giskard/scan/integrations/garak/_adapter.py139CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py49CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py121CODE
LOWlibs/giskard-llm/tests/conftest.py49CODE
LOW…ard-llm/src/giskard/llm/translators/google_response.py278CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py169CODE
LOWlibs/giskard-agents/tests/conftest.py32CODE
LOWlibs/giskard-checks/tests/test_public_import_surface.py29CODE
LOWlibs/giskard-checks/src/giskard/checks/core/result.py747CODE
LOW…/giskard-checks/src/giskard/checks/scenarios/runner.py138CODE
LOW…s/giskard-checks/src/giskard/checks/generators/base.py72CODE
LOWlibs/giskard-checks/src/giskard/checks/export/junit.py58CODE
Verbosity Indicators5 hits · 11 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/tests/core/test_scenario.py787 # Step 1: interaction0, check1COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py788 # Step 2: interaction2, check3COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py789 # Step 3: interaction4, check5COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py790 # Step 4: interaction6, check7COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py791 # Step 5: interaction8, check9COMMENT
Docstring Block Structure2 hits · 10 pts
SeverityFileLineSnippetContext
HIGH…ard-scan/src/giskard/scan/integrations/_entry_point.py63Run an external security scanner against a Giskard target. Requires the scanner's optional extra: ``pip install gisSTRING
HIGH…giskard-scan/src/giskard/scan/integrations/_listing.py28List selectable item names for a scan tool. Args: tool: ``"giskard"`` returns scenario generator class nameSTRING
Redundant / Tautological Comments7 hits · 10 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-core/src/giskard/core/discriminated.py100 # Check if the class is directly registeredCOMMENT
LOWlibs/giskard-core/src/giskard/core/__init__.py33# Check if the legacy package is installedCOMMENT
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py81 # Check if this parameter is a RunContextCOMMENT
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py273 # Check if this is a class method by looking for 'self' as first parameterCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py296 # Check if extraction failedCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py312 # Check if keyword appears in textCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py454 # Check if extraction failedSTRING
Modern AI Meta-Vocabulary2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md205### [RAGET](https://legacy-docs.giskard.ai/en/stable/open_source/testset_generation/index.html) — generate evaluation daCOMMENT
MEDIUM…skard-agents/src/giskard/agents/embeddings/__init__.py4# Default embedding model uses LitellmCOMMENT
Self-Referential Comments2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUM…can/tests/integrations/garak/test_resolve_detectors.py151 # Create a minimal probe with only a skipped detectorCOMMENT
MEDIUM…can/tests/integrations/garak/test_resolve_detectors.py166 # Create a minimal attempt with 2 conversations (_evaluate_attempt onlyCOMMENT
Fake / Example Data5 hits · 6 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/tests/integration/test_stateless.py123 expected_value="test@test.com",STRING
LOWlibs/giskard-checks/tests/integration/test_stateful.py149 expected_value="test@test.com",STRING
LOWlibs/giskard-checks/tests/generators/test_dataset.py41 with pytest.raises(ValueError, match="placeholder"):CODE
LOWlibs/giskard-checks/tests/generators/test_dataset.py123 with pytest.raises(ValueError, match="placeholder"):CODE
LOWlibs/giskard-checks/tests/generators/test_dataset.py240 with pytest.raises(ValueError, match="placeholder"):CODE
Magic Placeholder Names1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH.pre-commit-config.yaml39 args: ["--baseline", ".secrets.baseline", "--exclude-secrets", "YOUR_API_KEY"]CODE
Cross-Language Confusion2 hits · 5 pts
SeverityFileLineSnippetContext
HIGH…skard-llm/tests/translators/test_openai_chat_return.py158 """Tool-only turn: `content` is null, `tool_calls` populated, `finish_reason` is `tool_calls`."""STRING
HIGH…skard-checks/src/giskard/checks/builtin/rego_policy.py162 undefined, error if evaluation fails or the rule value is notSTRING
Dead Code2 hits · 4 pts
SeverityFileLineSnippetContext
MEDIUMlibs/giskard-core/src/giskard/core/rate_limiter/base.py162CODE
MEDIUMlibs/giskard-checks/tests/core/test_scenario.py142CODE
AI Structural Patterns2 hits · 2 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/vulnerability.py35CODE
LOWlibs/giskard-scan/src/giskard/scan/quality.py38CODE
Over-Commented Block2 hits · 2 pts
SeverityFileLineSnippetContext
LOW…rd-scan/src/giskard/scan/integrations/lidar/_target.py41COMMENT
LOW…d-agents/src/giskard/agents/tools/_docstring_parser.py1# THIS MODULE IS TAKEN FROM Pydantic AI, with only slight modifications.COMMENT