Repository Analysis

Giskard-AI/giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

35.8 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Giskard-AI/giskard-oss, a Python project with 5,518 GitHub stars. SynthScan v2.0 examined 46,501 lines of code across 317 source files, recording 1639 pattern matches distributed across 15 syntactic categories. The overall adjusted score of 35.8 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

35.8
Adjusted Score
35.8
Raw Score
100%
Time Factor
2026-07-13
Last Push
5.5K
Stars
Python
Language
46.5K
Lines of Code
317
Files
1.6K
Pattern Hits
2026-07-14
Scan Date
0.01
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 3MEDIUM 25LOW 1611

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1639 distinct pattern matches across 15 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers1134 hits · 1130 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/tests/conftest.py7def isolated_vulnerability_registry():CODE
LOWlibs/giskard-scan/tests/conftest.py18def isolated_quality_registry():CODE
LOWlibs/giskard-scan/tests/test_public_import_surface.py47def test_scan_src_imports_upstream_libs_only_from_package_roots():CODE
LOWlibs/giskard-scan/tests/test_generators_concrete.py5def test_prompt_injection_generator_is_importable():CODE
LOWlibs/giskard-scan/tests/test_generators_concrete.py10async def test_prompt_injection_scenarios_have_tags():CODE
LOWlibs/giskard-scan/tests/test_public_api.py23def test_all_public_symbols_importable():CODE
LOWlibs/giskard-scan/tests/test_public_api.py33def test_vulnerability_suite_generator_registry_contains_builtin_generators():CODE
LOWlibs/giskard-scan/tests/test_public_api.py41def test_vulnerability_scan_accepts_target_mode_param():CODE
LOWlibs/giskard-scan/tests/test_public_api.py52def test_quality_scan_accepts_target_mode_param():CODE
LOWlibs/giskard-scan/tests/test_public_api.py63def test_quality_suite_generator_registry_contains_builtin_generators():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py19def test_scenario_generator_is_importable():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py24async def test_scenario_generator_generate_scenario_accepts_target_mode():CODE
LOWlibs/giskard-scan/tests/test_generators_base.py44def test_dataset_generator_has_dataset_name_field():CODE
LOWlibs/giskard-scan/tests/test_vulnerability.py39async def test_vulnerability_scan_runs_registry_scenarios_and_returns_suite_result(CODE
LOWlibs/giskard-scan/tests/test_vulnerability.py92async def test_vulnerability_scan_forwards_parallel_and_max_concurrency(CODE
LOWlibs/giskard-scan/tests/test_quality.py71async def test_quality_scan_runs_registry_scenarios_and_returns_suite_result(CODE
LOWlibs/giskard-scan/tests/test_quality.py139async def test_quality_scan_forwards_parallel_and_max_concurrency(CODE
LOWlibs/giskard-scan/tests/test_quality.py188async def test_quality_scan_uses_empty_registry_by_default(CODE
LOWlibs/giskard-scan/tests/test_quality.py218async def test_quality_scan_warns_and_skips_empty_raw_knowledge_base(CODE
LOWlibs/giskard-scan/tests/test_quality.py268async def test_quality_scan_configures_knowledge_base_generator(CODE
LOWlibs/giskard-scan/tests/test_quality.py328async def test_quality_scan_does_not_generate_recommendation_without_failures(CODE
LOWlibs/giskard-scan/tests/test_quality.py353async def test_quality_scan_hides_recommendation_when_generation_fails(CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py30def test_knowledge_base_from_texts_does_not_compute_embeddings():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py43def test_normalize_knowledge_base_accepts_existing_instance_and_texts():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py53def test_normalize_knowledge_base_rejects_single_string():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py59def test_knowledge_base_drops_empty_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py68def test_knowledge_base_rejects_all_empty_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py73async def test_closest_documents_computes_missing_embeddings_lazily_in_batch():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py99async def test_closest_documents_initializes_embeddings_once_for_concurrent_callers():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py123async def test_closest_documents_recomputes_all_embeddings_when_any_is_missing():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py150async def test_closest_documents_to_text_embeds_query_against_cached_documents():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py172async def test_closest_documents_to_text_rejects_empty_query_without_embedding():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py188async def test_closest_documents_rejects_non_finite_embeddings():CODE
LOWlibs/giskard-scan/tests/test_knowledge_base.py201def test_knowledge_base_documents_are_immutable():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py38def test_register_bare_type_adds_instance():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py45def test_register_instance_adds_instance():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py51def test_register_bare_type_equivalent_to_default_instance():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py57def test_register_duplicate_bare_type_raises():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py64def test_register_duplicate_instance_raises():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py71def test_register_different_parameterized_instances_both_succeed():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py78def test_register_bare_type_same_as_default_param_raises():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py86def test_register_non_generator_type_raises():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py95def test_unregister_bare_type_removes_instance():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py102def test_unregister_instance_removes_it():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py109def test_unregister_not_registered_raises():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py118def test_clear_empties_registry():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py126def test_clear_on_empty_registry_is_noop():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py135def test_generators_returns_copy():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py161def test_generators_commercial_use_false_returns_all():CODE
LOWlibs/giskard-scan/tests/generators/test_registry.py168def test_generators_commercial_use_true_excludes_non_commercial():CODE
LOW…giskard-scan/tests/generators/test_prompt_injection.py7async def test_prompt_injection_generator_loads_scenarios():CODE
LOW…giskard-scan/tests/generators/test_prompt_injection.py15async def test_prompt_injection_generator_injects_annotations():CODE
LOW…giskard-scan/tests/generators/test_prompt_injection.py36async def test_prompt_injection_multiturn_keeps_dataset_max_steps():CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py48async def test_generate_suite_requires_explicit_generators():CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py57async def test_generate_suite_does_not_read_vulnerability_registry(CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py69async def test_generate_suite_generators_bare_type_is_normalized():CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py79async def test_generate_suite_empty_generators_returns_empty_suite(CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py87async def test_generate_suite_max_scenarios_limits_output():CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py100async def test_generate_suite_max_scenarios_distributed_across_generators():CODE
LOWlibs/giskard-scan/tests/generators/test_catalog.py130async def test_generate_suite_no_max_passes_none_to_generators():CODE
1074 more matches not shown…
Unused Imports383 hits · 328 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/__init__.py8CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py9CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py10CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py11CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py12CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py13CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py14CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py22CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py23CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py23CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py24CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py25CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py26CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py26CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py27CODE
LOWlibs/giskard-scan/src/giskard/scan/__init__.py27CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py3CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py3CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py4CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py5CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py6CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py7CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py15CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py3CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py3CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py3CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py3CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py9CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py10CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py11CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py11CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py11CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py16CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py17CODE
LOWlibs/giskard-llm/tests/test_providers.py29CODE
LOWlibs/giskard-llm/tests/test_providers.py30CODE
LOWlibs/giskard-llm/tests/test_smoke.py15CODE
LOWlibs/giskard-llm/tests/test_smoke.py36CODE
LOWlibs/giskard-llm/tests/test_smoke.py36CODE
LOWlibs/giskard-llm/tests/test_smoke.py36CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py5CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py6CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py6CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py6CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py6CODE
323 more matches not shown…
Decorative Section Separators21 hits · 75 pts
SeverityFileLineSnippetContext
MEDIUMlibs/giskard-agents/tests/test_generator.py213# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_generator.py215# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py194# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py196# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py255# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py257# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py355# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-agents/tests/test_tools.py357# ---------------------------------------------------------------------------COMMENT
MEDIUM…d-agents/src/giskard/agents/tools/_docstring_parser.py2# ==============================================================================COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py164# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py166# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py247# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py249# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py311# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py313# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py28# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py30# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py61# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py63# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py355# ---------------------------------------------------------------------------COMMENT
MEDIUMlibs/giskard-checks/tests/builtin/test_composition.py357# ---------------------------------------------------------------------------COMMENT
Modern Structural Boilerplate43 hits · 43 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/__init__.py33__all__ = [CODE
LOWlibs/giskard-scan/src/giskard/scan/quality.py22logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-scan/src/giskard/scan/utils/__init__.py5__all__ = [CODE
LOW…s/giskard-scan/src/giskard/scan/generators/__init__.py17__all__ = [CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py18logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-scan/src/giskard/scan/generators/base.py13logger = logging.getLogger(__name__)CODE
LOW…/giskard/scan/generators/knowledge_base/multi_topic.py20logger = logging.getLogger(__name__)CODE
LOW…src/giskard/scan/generators/knowledge_base/__init__.py19__all__ = [CODE
LOW…giskard/scan/generators/knowledge_base/out_of_scope.py25logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/__init__.py40__all__ = [CODE
LOW…giskard-llm/src/giskard/llm/translators/openai_chat.py26logger = logging.getLogger(__name__)CODE
LOW…giskard-llm/src/giskard/llm/translators/google_chat.py59logger = logging.getLogger(__name__)CODE
LOW…ard-llm/src/giskard/llm/translators/google_response.py56logger = logging.getLogger(__name__)CODE
LOW…ard-llm/src/giskard/llm/translators/openai_response.py22logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/types/__init__.py68__all__ = [CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py94logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/openai.py84logger = logging.getLogger(__name__)CODE
LOW…/giskard-llm/src/giskard/llm/providers/azure_openai.py47logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/anthropic.py78logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/azure_ai.py58logger = logging.getLogger(__name__)CODE
LOWlibs/giskard-llm/src/giskard/llm/utils/__init__.py7__all__ = [CODE
LOWlibs/giskard-core/src/giskard/core/__init__.py46__all__ = [CODE
LOW…bs/giskard-core/src/giskard/core/telemetry/__init__.py11__all__ = [CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py82def _set_tags() -> None:CODE
LOW…giskard-core/src/giskard/core/rate_limiter/__init__.py9__all__ = [CODE
LOWlibs/giskard-agents/src/giskard/agents/__init__.py21__all__ = [CODE
LOWlibs/giskard-agents/src/giskard/agents/pipeline.py5__all__ = ["Pipeline"]CODE
LOW…bs/giskard-agents/src/giskard/agents/tools/__init__.py5__all__ = ["Tool", "tool", "Function", "ToolCall"]CODE
LOW…skard-agents/src/giskard/agents/embeddings/__init__.py7__all__ = [CODE
LOW…iskard-agents/src/giskard/agents/templates/__init__.py12__all__ = [CODE
LOW…skard-agents/src/giskard/agents/generators/__init__.py20__all__ = [CODE
LOW…s/giskard-agents/src/giskard/agents/errors/__init__.py4__all__ = ["ModelRefusalError", "WorkflowError", "Error"]CODE
LOWlibs/giskard-checks/tests/generators/conftest.py3__all__ = ["LLMTrace", "MockGenerator"]CODE
LOWlibs/giskard-checks/src/giskard/checks/__init__.py82__all__ = [CODE
LOWlibs/giskard-checks/src/giskard/checks/settings.py65def set_default_generator(generator: BaseGenerator) -> None:CODE
LOWlibs/giskard-checks/src/giskard/checks/core/__init__.py19__all__ = [CODE
LOW…checks/src/giskard/checks/core/interaction/__init__.py6__all__ = ["InteractionSpec", "Interact", "Interaction", "Trace"]CODE
LOW…s/giskard-checks/src/giskard/checks/judges/__init__.py11__all__ = [CODE
LOW…/giskard-checks/src/giskard/checks/testing/__init__.py3__all__ = ["WithSpy"]CODE
LOW…iskard-checks/src/giskard/checks/scenarios/__init__.py4__all__ = [CODE
LOW…skard-checks/src/giskard/checks/generators/__init__.py7__all__ = [CODE
LOW…s/giskard-checks/src/giskard/checks/export/__init__.py4__all__ = ["to_hub_format", "to_junit_xml"]CODE
LOW…/giskard-checks/src/giskard/checks/builtin/__init__.py35__all__ = [CODE
Structural Annotation Overuse8 hits · 16 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/README.md243### Step 1: Define a custom checkCOMMENT
LOWlibs/giskard-checks/README.md263### Step 2: Define a custom interaction specificationCOMMENT
LOWlibs/giskard-checks/README.md284### Step 3: Verify registrationCOMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py681 # Step 1: interaction0, check1COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py682 # Step 2: interaction2, check3COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py683 # Step 3: interaction4, check5COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py684 # Step 4: interaction6, check7COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py685 # Step 5: interaction8, check9COMMENT
Excessive Try-Catch Wrapping14 hits · 15 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/src/giskard/scan/quality.py98 except Exception:CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py148 except Exception as exc:CODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py281 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py314 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
LOWlibs/giskard-llm/src/giskard/llm/providers/google.py377 except Exception as e: # Broad catch: _map_error checks SDK types first, then applies timeout heuristic, then rCODE
MEDIUMlibs/giskard-llm/src/giskard/llm/providers/google.py104def _import_genai() -> Any:CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py193 except Exception as e:CODE
LOWlibs/giskard-agents/src/giskard/agents/workflow.py474 except Exception as err:CODE
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py192 except Exception as error:CODE
LOW…s/giskard-checks/src/giskard/checks/utils/inference.py18 except Exception:CODE
LOW…s/giskard-checks/src/giskard/checks/utils/inference.py31 except Exception:CODE
LOW…bs/giskard-checks/src/giskard/checks/testing/runner.py30 except Exception as e:CODE
LOW…skard-checks/src/giskard/checks/builtin/nlp_metrics.py147 except Exception as exc:CODE
LOW…iskard-checks/src/giskard/checks/builtin/comparison.py95 except Exception:CODE
Deep Nesting12 hits · 12 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-scan/tests/test_public_import_surface.py29CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py49CODE
LOW…iskard-scan/src/giskard/scan/generators/huggingface.py121CODE
LOWlibs/giskard-llm/tests/conftest.py49CODE
LOW…ard-llm/src/giskard/llm/translators/google_response.py273CODE
LOW…s/giskard-core/src/giskard/core/telemetry/telemetry.py176CODE
LOWlibs/giskard-agents/tests/conftest.py32CODE
LOWlibs/giskard-checks/tests/test_public_import_surface.py29CODE
LOW…giskard-checks/tests/core/test_jsonpath_enforcement.py55CODE
LOWlibs/giskard-checks/src/giskard/checks/core/result.py678CODE
LOW…s/giskard-checks/src/giskard/checks/generators/base.py72CODE
LOWlibs/giskard-checks/src/giskard/checks/export/junit.py58CODE
Verbosity Indicators5 hits · 11 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/tests/core/test_scenario.py681 # Step 1: interaction0, check1COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py682 # Step 2: interaction2, check3COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py683 # Step 3: interaction4, check5COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py684 # Step 4: interaction6, check7COMMENT
LOWlibs/giskard-checks/tests/core/test_scenario.py685 # Step 5: interaction8, check9COMMENT
Redundant / Tautological Comments7 hits · 10 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-core/src/giskard/core/discriminated.py77 # Check if the class is directly registeredCOMMENT
LOWlibs/giskard-core/src/giskard/core/__init__.py33# Check if the legacy package is installedCOMMENT
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py81 # Check if this parameter is a RunContextCOMMENT
LOWlibs/giskard-agents/src/giskard/agents/tools/tool.py273 # Check if this is a class method by looking for 'self' as first parameterCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py292 # Check if extraction failedCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py308 # Check if keyword appears in textCOMMENT
LOW…ard-checks/src/giskard/checks/builtin/text_matching.py450 # Check if extraction failedSTRING
Modern AI Meta-Vocabulary2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md171### [RAGET](https://legacy-docs.giskard.ai/en/stable/open_source/testset_generation/index.html) — generate evaluation daCOMMENT
MEDIUM…skard-agents/src/giskard/agents/embeddings/__init__.py4# Default embedding model uses LitellmCOMMENT
Fake / Example Data5 hits · 6 pts
SeverityFileLineSnippetContext
LOWlibs/giskard-checks/tests/integration/test_stateless.py123 expected_value="test@test.com",STRING
LOWlibs/giskard-checks/tests/integration/test_stateful.py149 expected_value="test@test.com",STRING
LOWlibs/giskard-checks/tests/generators/test_dataset.py41 with pytest.raises(ValueError, match="placeholder"):CODE
LOWlibs/giskard-checks/tests/generators/test_dataset.py123 with pytest.raises(ValueError, match="placeholder"):CODE
LOWlibs/giskard-checks/tests/generators/test_dataset.py240 with pytest.raises(ValueError, match="placeholder"):CODE
Magic Placeholder Names1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH.pre-commit-config.yaml39 args: ["--baseline", ".secrets.baseline", "--exclude-secrets", "YOUR_API_KEY"]CODE
Cross-Language Confusion2 hits · 5 pts
SeverityFileLineSnippetContext
HIGH…skard-llm/tests/translators/test_openai_chat_return.py158 """Tool-only turn: `content` is null, `tool_calls` populated, `finish_reason` is `tool_calls`."""STRING
HIGH…skard-checks/src/giskard/checks/builtin/rego_policy.py162 undefined, error if evaluation fails or the rule value is notSTRING
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMlibs/giskard-core/src/giskard/core/rate_limiter/base.py145CODE
Over-Commented Block1 hit · 1 pts
SeverityFileLineSnippetContext
LOW…d-agents/src/giskard/agents/tools/_docstring_parser.py1# THIS MODULE IS TAKEN FROM Pydantic AI, with only slight modifications.COMMENT