Repository Analysis

gepa-ai/gepa

Optimize prompts, code, and more with AI-powered Reflective Optimization

33.1 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of gepa-ai/gepa, a Jupyter Notebook project with 6,277 GitHub stars. SynthScan v2.0 examined 89,538 lines of code across 437 source files, recording 1874 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 33.1 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

33.1
Adjusted Score
33.1
Raw Score
100%
Time Factor
2026-08-26
Last Push
6.3K
Stars
Jupyter Notebook
Language
89.5K
Lines of Code
437
Files
1.9K
Pattern Hits
2026-08-29
Scan Date
0.08
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 36MEDIUM 385LOW 1453

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1874 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators304 hits · 1117 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_mcp_adapter.py146# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py148# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py235# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py237# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py455# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py457# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py576# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py578# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py625# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py627# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py32# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py34# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py91# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py93# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py430# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py432# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py556# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py558# ============================================================================COMMENT
MEDIUMtests/test_callbacks.py154# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py156# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py213# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py215# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py267# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py269# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py327# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py329# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py419# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py421# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py677# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py679# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py756# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py758# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py820# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py822# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py885# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py887# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1058# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1060# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1128# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1130# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1231# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1233# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py45# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py47# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1294# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1296# =============================================================================COMMENT
MEDIUMtests/test_reflection_lm.py332# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py334# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py345# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py347# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py370# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py372# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py151# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py153# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py258# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py260# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py478# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_reflection_lm.py481# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_combee_reflection_lm.py182# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_combee_reflection_lm.py184# ---------------------------------------------------------------------------COMMENT
244 more matches not shown…
Hyper-Verbose Identifiers789 hits · 730 pts
SeverityFileLineSnippetContext
LOWtests/test_gepa_utils.py6def test_select_program_candidate_respects_frequency_bias():CODE
LOWtests/test_mcp_adapter.py115 def test_create_streamable_http_client(self):CODE
LOWtests/test_mcp_adapter.py124 def test_create_client_invalid_both_params(self, server_params):CODE
LOWtests/test_mcp_adapter.py132 def test_create_client_missing_params(self):CODE
LOWtests/test_mcp_adapter.py137 def test_create_client_invalid_transport(self):CODE
LOWtests/test_mcp_adapter.py154 def test_adapter_with_single_tool(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py243 def test_build_system_prompt_single_tool(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py463 def test_make_reflective_dataset_tool_description(self, server_params, simple_metric, seed_candidate):CODE
LOWtests/test_mcp_adapter.py584 def test_multi_tool_initialization(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py633 def test_two_pass_enabled_by_default(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py167 def test_adapter_with_multiple_tools(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py179 def test_adapter_with_remote_sse(self, simple_metric):CODE
LOWtests/test_mcp_adapter.py194 def test_adapter_with_remote_streamable_http(self, simple_metric):CODE
LOWtests/test_mcp_adapter.py206 def test_adapter_with_callable_model(self, server_params, simple_metric, mock_model_callable):CODE
LOWtests/test_mcp_adapter.py218 def test_adapter_custom_parameters(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py267 def test_build_system_prompt_multiple_tools(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py292 def test_extract_tool_response(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py316 def test_extract_tool_response_with_error(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py337 def test_extract_tool_response_with_structured_content(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py356 def test_extract_tool_response_with_image_content(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py377 def test_generate_tool_feedback_success(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py403 def test_generate_tool_feedback_failure(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py515 def test_make_reflective_dataset_system_prompt(self, server_params, simple_metric, seed_candidate):CODE
LOWtests/test_mcp_adapter.py597 def test_multi_tool_system_prompt_generation(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py644 def test_two_pass_can_be_disabled(self, server_params, simple_metric):CODE
LOWtests/test_evaluation_cache.py22 def test_empty_cache_returns_none(self):CODE
LOWtests/test_evaluation_cache.py36 def test_different_examples_separate_entries(self):CODE
LOWtests/test_evaluation_cache.py45 def test_different_candidates_separate_entries(self):CODE
LOWtests/test_evaluation_cache.py86 def test_unknown_split_is_rejected(self):CODE
LOWtests/test_evaluation_cache.py119 def test_optimize_with_caching_enabled(self, tmp_path):CODE
LOWtests/test_evaluation_cache.py135 def test_caching_does_not_break_optimization(self, tmp_path):CODE
LOWtests/test_evaluation_cache.py186def test_aime_prompt_optimize_with_cache(mocked_lms, recorder_dir):CODE
LOWtests/test_evaluation_cache.py245def test_pareto_frontier_type_with_cache(pareto_mocked_lms, pareto_recorder_dir, frontier_type):CODE
LOWtests/test_result.py35def test_to_dict_omits_runtime_oa_fields():CODE
LOWtests/test_data_loader.py59def test_list_data_loader_basic():CODE
LOWtests/test_data_loader.py69def test_staged_data_loader_unlocks_after_batches():CODE
LOWtests/test_data_loader.py96def test_staged_data_loader_manual_unlock():CODE
LOWtests/test_optimize_anything_callbacks.py25 def test_callbacks_receive_events(self):CODE
LOWtests/test_optimize_anything_callbacks.py83 def test_no_callbacks_default(self):CODE
LOWtests/test_optimize_anything_callbacks.py95 def test_proposal_events_received(self):CODE
LOWtests/test_optimize_anything_gepa_config.py38def test_tracking_key_is_forwarded_not_dropped():CODE
LOWtests/test_optimize_anything_gepa_config.py45def test_unknown_key_fails_fast():CODE
LOWtests/test_optimize_anything_gepa_config.py51def test_legacy_gepa_config_call_returns_gepa_result():CODE
LOWtests/test_optimize_anything_gepa_config.py76def test_legacy_gepa_config_returns_gepa_result_even_when_budget_dies_early():CODE
LOWtests/test_optimize_anything_gepa_config.py100def test_legacy_max_workers_sizes_the_eval_server():CODE
LOWtests/test_optimize_anything_gepa_config.py110def test_legacy_parallel_false_maps_to_sequential_eval_server():CODE
LOWtests/test_optimize_anything_gepa_config.py118def test_legacy_max_workers_none_falls_back_to_cpu_count():CODE
LOWtests/test_optimize_anything_gepa_config.py128def test_legacy_gepa_config_accepts_test_set():CODE
LOWtests/test_optimize_anything_gepa_config.py152def test_no_config_returns_unified_gepa_result(monkeypatch):CODE
LOWtests/test_optimize_anything_gepa_config.py207def test_no_config_accepts_test_set(monkeypatch):CODE
LOWtests/test_optimize_anything_gepa_config.py236def test_explicit_optimize_anything_config_returns_unified_gepa_result():CODE
LOWtests/test_optimize_anything_gepa_config.py265def test_non_gepa_engine_returns_single_candidate_gepa_result(monkeypatch):CODE
LOWtests/test_optimize_anything_gepa_config.py309def test_full_config_passthrough_and_reflective_dataset_persistence(tmp_path):CODE
LOWtests/conftest.py9def create_mocked_lms_context(cache_dir: Path):CODE
LOWtests/test_callbacks.py162 def test_callback_protocol_is_runtime_checkable(self):CODE
LOWtests/test_callbacks.py171 def test_empty_callback_implementation(self):CODE
LOWtests/test_callbacks.py221 def test_on_optimization_start_called_with_correct_args(self):CODE
LOWtests/test_callbacks.py275 def test_on_iteration_start_called_with_correct_args(self):CODE
LOWtests/test_callbacks.py335 def test_on_candidate_selected_called_with_selection_info(self):CODE
LOWtests/test_callbacks.py427 def test_on_evaluation_start_called_with_batch_info(self):CODE
729 more matches not shown…
Unused Imports215 hits · 200 pts
SeverityFileLineSnippetContext
LOWtests/test_optimize_anything_callbacks.py6CODE
LOWtests/test_refiner.py11CODE
LOWtests/test_best_example_evals.py6CODE
LOWtests/test_optimize_anything_adaptive_sequential.py1CODE
LOWtests/test_attach_existing_run.py6CODE
LOWtests/test_attach_existing_run.py8CODE
LOWtests/test_lm.py6CODE
LOWtests/test_best_of_n_engine.py20CODE
LOWtests/test_langchain_adapter.py18CODE
LOWtests/test_eval_server_register.py13CODE
LOWtests/test_optimize_anything_eval_server.py1CODE
LOWtests/ensure_gepa_dspy_dependency.py4CODE
LOWtests/test_seed_candidate_typing.py11CODE
LOWtests/test_dspy_full_program_adapter.py13CODE
LOW…sts/test_confidence_adapter/test_confidence_adapter.py14CODE
LOWtests/test_confidence_adapter/test_scoring.py12CODE
LOW…ude/skills/gepa-optimize-anything/scripts/preflight.py10CODE
LOW…ude/skills/gepa-optimize-anything/scripts/preflight.py64CODE
LOW…ude/skills/gepa-optimize-anything/scripts/preflight.py64CODE
LOWexamples/blackbox/utils.py4CODE
LOWexamples/blackbox/utils.py5CODE
LOWexamples/blackbox/evalset/evalset.py42CODE
LOWexamples/confidence_adapter/main.py32CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py17CODE
LOWexamples/adrs/can_be_late/utils/dataset.py3CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py35CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py12CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py15CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py16CODE
LOW…e_late/utils/simulator/sky_spot/strategies/__init__.py1CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py10CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py12CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py12CODE
LOWexamples/adrs/cloudcast/utils/simulation.py17CODE
LOWexamples/adrs/cloudcast/utils/dataset.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py5CODE
LOW…ples/adrs/cloudcast/utils/cloudcast/initial_program.py10CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py6CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py9CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py8CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/broadcast.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/broadcast.py4CODE
LOWexamples/langchain_adapter/pair_sum_product.py10CODE
LOWexamples/langchain_adapter/big_number_arithmetic.py12CODE
LOWexamples/langchain_adapter/gsm8k.py11CODE
LOWexamples/langchain_adapter/aime.py10CODE
155 more matches not shown…
Excessive Try-Catch Wrapping182 hits · 182 pts
SeverityFileLineSnippetContext
LOWtests/test_evaluator_wrapper.py726 except Exception:CODE
LOWtests/test_batch_evaluator_user_fn.py418 except Exception: # only the warning matters hereCODE
LOW…ude/skills/gepa-optimize-anything/scripts/preflight.py66 except Exception as e: # noqaCODE
LOW…ude/skills/gepa-optimize-anything/scripts/preflight.py103 except Exception as e: # noqaCODE
LOWdocs/docs/guides/callbacks.md257 except Exception:CODE
LOWdocs/docs/guides/adapters.md205 except Exception as e:CODE
LOWdocs/hooks/scholarly_pdf.py82 except Exception:CODE
LOWdocs/scripts/generate_social_screenshots.py84 except Exception as e:CODE
LOWdocs/scripts/generate_social_screenshots.py91 except Exception as e:CODE
MEDIUMdocs/scripts/generate_social_screenshots.py92 print(f"Error generating screenshots: {e}")CODE
LOWdocs/scripts/generate_social_screenshots.py157 except Exception as e:CODE
LOWexamples/circle_packing/utils.py59 except Exception as e:CODE
LOWexamples/arc_agi/utils.py130 except Exception:CODE
LOWexamples/arc_agi/utils.py313 except Exception as e:CODE
LOWexamples/arc_agi/utils.py401 except Exception as e:CODE
LOWexamples/confidence_adapter/main.py153 except Exception as _e:CODE
LOWexamples/confidence_adapter/main.py167 except Exception:CODE
LOWexamples/confidence_adapter/main.py298 except Exception as e:CODE
MEDIUMexamples/confidence_adapter/main.py115def evaluator(data, response_text):CODE
LOWexamples/adrs/can_be_late/utils/simulation.py95 except Exception as e:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py140 except Exception as e:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py252 except Exception:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py399 except Exception:CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py67 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py90 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py137 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py149 except Exception as e:CODE
LOWsrc/gepa/optimize_anything.py370 except Exception:CODE
LOWsrc/gepa/optimize_anything.py405 except Exception:CODE
LOWsrc/gepa/optimize_anything.py412 except Exception:CODE
LOWsrc/gepa/gepa_launcher.py1062 except Exception as e:CODE
LOWsrc/gepa/lm.py118 except Exception:CODE
LOWsrc/gepa/lm.py169 except Exception:CODE
LOWsrc/gepa/gepa_utils.py13 except Exception:CODE
LOWsrc/gepa/core/engine.py1073 except Exception as e:CODE
LOWsrc/gepa/core/engine.py1240 except Exception as e:CODE
LOWsrc/gepa/core/callbacks.py470 except Exception as e:CODE
LOWsrc/gepa/core/callbacks.py565 except Exception as e:CODE
LOWsrc/gepa/core/state.py436 except Exception as e:CODE
LOWsrc/gepa/utils/stop_condition.py79 except Exception:CODE
LOWsrc/gepa/utils/stop_condition.py106 except Exception:CODE
MEDIUMsrc/gepa/utils/code_execution.py31 print(f"Error: {result.error}")STRING
LOWsrc/gepa/utils/code_execution.py265 except Exception:CODE
LOWsrc/gepa/utils/code_execution.py330 except Exception as e:CODE
LOWsrc/gepa/utils/code_execution.py495except Exception as _e:CODE
LOW…pa/proposer/reflective_mutation/reflective_mutation.py260 except Exception as e:CODE
LOW…pa/proposer/reflective_mutation/reflective_mutation.py269 except Exception as e2:CODE
LOW…pa/proposer/reflective_mutation/reflective_mutation.py500 except Exception as e:CODE
LOWsrc/gepa/proposer/reflective_mutation/combee.py557 except Exception:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py293 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py322 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py422 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py459 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py592 except Exception as e:STRING
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py216 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py314 except Exception as e:CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py113 except Exception as e:CODE
LOWsrc/gepa/adapters/anymaths_adapter/anymaths_adapter.py109 except Exception:CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py428 except Exception:CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py434 except Exception:CODE
122 more matches not shown…
Cross-Language Confusion19 hits · 112 pts
SeverityFileLineSnippetContext
HIGHsrc/gepa/visualization.py249let pinnedIdx = null; // non-null when tooltip is click-pinned (scrollable)CODE
HIGHsrc/gepa/visualization.py250let hoverIdx = null; // non-null when hovering over a nodeCODE
HIGHsrc/gepa/visualization.py292 pinnedIdx = null;CODE
HIGHsrc/gepa/visualization.py293 hoverIdx = null;CODE
HIGHsrc/gepa/visualization.py300 if (pinnedIdx !== null && tt.style.display === "block"CODE
HIGHsrc/gepa/visualization.py324 if (pinnedIdx !== null) return; // don't override a pinned tooltipCODE
HIGHsrc/gepa/visualization.py329 if (pinnedIdx !== null || hoverIdx !== idx) return;CODE
HIGHsrc/gepa/visualization.py333 if (pinnedIdx !== null) return;CODE
HIGHsrc/gepa/visualization.py334 hoverIdx = null;CODE
HIGHsrc/gepa/adapters/dspy_adapter/dspy_adapter.py372 trace_instances = [t for t in trace if t[0].signature.equals(module.signature)]CODE
HIGH…ters/dspy_full_program_adapter/full_program_adapter.py240 if predictor.signature.equals(selected[0].signature):CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py512id -u claude_user >/dev/null 2>&1 || useradd -m -s /bin/bash claude_userCODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py515chown -R claude_user:claude_user {DOCKER_WORKDIR} 2>/dev/null || trueCODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py525 ls -la {problem_file_container} 2>&1 || echo "Source not found"CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py309 apt-get clean && rm -rf /var/lib/apt/lists/*CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py318RUN claude --version || echo "Claude Code installed"CODE
HIGH…/gepa/examples/mcp_adapter/mcp_optimization_example.py16Pull models: ollama pull llama3.1:8b && ollama pull qwen3:8bSTRING
HIGHsrc/gepa/examples/rag_adapter/rag_optimization.py46 - For Ollama: ollama pull qwen3:8b && ollama pull nomic-embed-text:latestSTRING
HIGHsrc/gepa/oa/engines/meta_harness.py744 # starts with a real best_score (not null) for iter 2+.STRING
Deep Nesting92 hits · 87 pts
SeverityFileLineSnippetContext
LOWtests/test_evaluator_wrapper.py740CODE
LOWtests/test_optimize_anything_eval_server.py17CODE
LOWtests/test_rag_adapter/conftest.py95CODE
LOWtests/test_rag_adapter/test_rag_end_to_end.py244CODE
LOWdocs/scripts/generate_social_screenshots.py54CODE
LOWdocs/scripts/generate_social_screenshots.py96CODE
LOWdocs/scripts/generate_api_docs.py246CODE
LOWexamples/blackbox/evalset/evalset.py894CODE
LOWexamples/confidence_adapter/main.py270CODE
LOWexamples/adrs/can_be_late/utils/simulation.py246CODE
LOWexamples/adrs/can_be_late/utils/simulation.py295CODE
LOWexamples/adrs/can_be_late/utils/simulation.py326CODE
LOWexamples/adrs/can_be_late/utils/simulation.py376CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py41CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py72CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py404CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py708CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py733CODE
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py123CODE
LOWexamples/adrs/cloudcast/utils/simulation.py279CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py120CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py143CODE
LOWsrc/gepa/visualization.py34CODE
LOWsrc/gepa/visualization.py105CODE
LOWsrc/gepa/gepa_launcher.py1131CODE
LOWsrc/gepa/core/engine.py268CODE
LOWsrc/gepa/core/engine.py520CODE
LOWsrc/gepa/core/engine.py714CODE
LOWsrc/gepa/core/state.py506CODE
LOWsrc/gepa/core/state.py922CODE
LOWsrc/gepa/strategies/instruction_proposal.py45CODE
LOWsrc/gepa/strategies/instruction_proposal.py54CODE
LOWsrc/gepa/strategies/instruction_proposal.py63CODE
LOWsrc/gepa/utils/code_execution.py248CODE
LOWsrc/gepa/utils/code_execution.py379CODE
LOWsrc/gepa/proposer/merge.py118CODE
LOWsrc/gepa/proposer/reflective_mutation/combee.py578CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py177CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py230CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py341CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py478CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py235CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py187CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py357CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py197CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py208CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py357CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py463CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py524CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py596CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py318CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py137CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py187CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py151CODE
LOW…pa/adapters/generic_rag_adapter/generic_rag_adapter.py398CODE
LOW…ters/generic_rag_adapter/vector_stores/qdrant_store.py227CODE
LOW…ters/generic_rag_adapter/vector_stores/qdrant_store.py274CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py148CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py207CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py256CODE
32 more matches not shown…
AI Slop Vocabulary33 hits · 78 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_pareto_frontier_types/llm_cache.json130 "('task_lm', '[{\"content\": \"You are a helpful assistant.\\\\n\\\\nYour task is to read and accurately respond to diCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json133 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n1. Keto CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json135 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Based on this daCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json136 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Please describe CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json136 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Please describe CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json138 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nBased on CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json139 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json139 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json141 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json143 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json144 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nWrite me CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json146 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json157 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json158 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json158 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json169 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nI want yoCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json170 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nHow does CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json170 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nHow does CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json171 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_aime_prompt_optimization/llm_cache.json25 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_rag_adapter/conftest.py82 # For testing, just return similarity search resultsCOMMENT
LOWtests/test_rag_adapter/test_vector_store_interface.py60 # For testing, just return similarity search resultsCOMMENT
MEDIUMsrc/gepa/adapters/dspy_adapter/instruction_proposal.py312 # instead of just the current instruction, for more holistic instruction proposals.COMMENT
MEDIUM…ull_program_adapter/dspy_program_proposal_signature.py12 prompt_template = """I am trying to solve a task using the DSPy framework. Here's a comprehensive overview of DSPy cCODE
MEDIUMsrc/gepa/gskill/gskill/swe_fitness_fn.py27 # Create harness pool - one per workerCOMMENT
MEDIUMsrc/gepa/gskill/gskill/swe_fitness_fn.py51 # Get a harness from the poolCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py46 # Get a harness from the poolCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py322 # Create harness poolCOMMENT
MEDIUMsrc/gepa/oa/ensemble.py282 # engine harness, which would otherwise re-score the held-out set perCOMMENT
Structural Annotation Overuse45 hits · 68 pts
SeverityFileLineSnippetContext
LOWtests/test_pareto_frontier_types/llm_cache.json152 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
LOWtests/test_pareto_frontier_types/llm_cache.json164 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_pareto_frontier_types/llm_cache.json44 "('task_lm', '[{\"content\": \"You are a helpful assistant designed to assist with rewriting, translating, and respondCODE
LOWtests/test_pareto_frontier_types/llm_cache.json56 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_aime_prompt_optimization/llm_cache.json2 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json3 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json4 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json7 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json12 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json15 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json16 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json17 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json19 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json21 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json22 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
LOWtests/test_aime_prompt_optimization/llm_cache.json23 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json24 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json27 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json28 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json29 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json31 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json32 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json34 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json35 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWdocs/docs/guides/adapters.md39### Step 1: Define Your TypesCOMMENT
LOWdocs/docs/guides/adapters.md68### Step 2: Implement `evaluate`COMMENT
LOWdocs/docs/guides/adapters.md120### Step 3: Implement `make_reflective_dataset`COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py63 # Step 1: Query reformulation (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py68 # Step 2: RetrievalCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py71 # Step 3: Reranking (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py75 # Step 4: Context synthesisCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py78 # Step 5: Answer generationCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py705 # Step 1: Setup vector storeCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py709 # Step 2: Create datasetsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py715 # Step 3: Initialize LLM clientCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py747 # Step 5: Create initial promptsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py751 # Step 6: Test initial performanceCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py759 # Step 7: Run GEPA optimizationCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py111### Step 0: Post-eval reports (write if missing)COMMENT
LOWsrc/gepa/oa/engines/meta_harness.py115### Step 1: AnalyzeCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py140### Step 2: Prototype — MANDATORYCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py150### Step 3: ImplementCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py160### Step 4: Write pending_eval.jsonCOMMENT
Verbosity Indicators42 hits · 64 pts
SeverityFileLineSnippetContext
LOWtests/test_pareto_frontier_types/llm_cache.json152 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
LOWtests/test_pareto_frontier_types/llm_cache.json164 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_pareto_frontier_types/llm_cache.json44 "('task_lm', '[{\"content\": \"You are a helpful assistant designed to assist with rewriting, translating, and respondCODE
LOWtests/test_pareto_frontier_types/llm_cache.json56 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_aime_prompt_optimization/llm_cache.json2 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json3 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json4 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json7 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json12 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json15 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json16 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json17 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json19 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json21 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json22 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
LOWtests/test_aime_prompt_optimization/llm_cache.json23 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json24 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json27 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json28 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json29 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json31 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json32 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json34 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json35 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py63 # Step 1: Query reformulation (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py68 # Step 2: RetrievalCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py71 # Step 3: Reranking (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py75 # Step 4: Context synthesisCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py78 # Step 5: Answer generationCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py705 # Step 1: Setup vector storeCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py709 # Step 2: Create datasetsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py715 # Step 3: Initialize LLM clientCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py747 # Step 5: Create initial promptsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py751 # Step 6: Test initial performanceCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py759 # Step 7: Run GEPA optimizationCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py111### Step 0: Post-eval reports (write if missing)COMMENT
LOWsrc/gepa/oa/engines/meta_harness.py115### Step 1: AnalyzeCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py140### Step 2: Prototype — MANDATORYCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py150### Step 3: ImplementCOMMENT
LOWsrc/gepa/oa/engines/meta_harness.py160### Step 4: Write pending_eval.jsonCOMMENT
Modern AI Meta-Vocabulary19 hits · 58 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py295 # Create RAG configurationCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py298 # Create the RAG adapter with our mocked LLMCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py305 # Initial seed candidate with basic RAG promptsCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py308 # 2. Execution: Run the core RAG optimization logicCOMMENT
MEDIUM…ude/skills/gepa-optimize-anything/scripts/preflight.py80 # 3) agentic engines need the claude CLI (and autoresearch's eval.sh uses jq)COMMENT
MEDIUM…docs/blog/posts/2026-07-30-parallel-proposals/index.md170Parallel proposals fit into the bigger picture of scaling each reflection optimization step along several axes. P controCODE
MEDIUMdocs/docs/guides/faq.md569### How do I use GEPA for agentic systems with expensive rollouts?STRING
MEDIUMdocs/docs/guides/use-cases.md1132 [:material-arrow-right: Read the blog post](https://super-agentic.ai/resources/super-posts/gepa-dspy-optimizer-superCODE
MEDIUM…pa/adapters/generic_rag_adapter/generic_rag_adapter.py264 # Execute RAG pipeline with candidate promptsCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md1# Generic RAG Adapter for GEPA (DOCS ONLY)COMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md24# Install RAG adapter dependenciesCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md55# 2. Create the RAG adapterCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md150### RAG Pipeline FlowCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md327### RAG Pipeline ConfigurationCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md544### Unified RAG Optimization ScriptSTRING
MEDIUMsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/requirements-rag.txt1# RAG Adapter DependenciesCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/RAG_GUIDE.md1# GEPA Generic RAG Adapter GuideCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/RAG_GUIDE.md108## 🚀 Using the Unified RAG Optimization ScriptCOMMENT
Self-Referential Comments16 hits · 51 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_mcp_adapter.py327 # Create a proper MCP error resultCOMMENT
MEDIUMtests/test_refiner.py716 # This function is passed directly to OptimizeAnythingAdapter (bypassingCOMMENT
MEDIUMtests/test_module_selector.py159 # Create a mock state (not used in the new implementation)COMMENT
MEDIUM…lbacks_integration/test_callbacks_with_optimization.py348 # Create a callback that only implements some methodsCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py298 # Create the RAG adapter with our mocked LLMCOMMENT
MEDIUMexamples/blackbox/evalset/problems.py107# # Create a test point at midpoint of boundsCOMMENT
MEDIUM…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py381 # This method is only here because it's abstract in base classCOMMENT
MEDIUMsrc/gepa/gepa_launcher.py1027 # Create a fresh, shared log context for this evaluator call.COMMENT
MEDIUMsrc/gepa/adapters/dspy_adapter/instruction_proposal.py86 # Create a rich multimodal examples_with_feedback that includes both text and imagesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py305 # Define the two evaluation conditionsCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code_skills.py109 # Create the skill directory structureCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py507 # Create a runner script to avoid shell escaping issuesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py529# Create a wrapper script for claude_user that reads from filesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py203 # Create a set for fast lookupCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py375 # Create the image from locally-built baseSTRING
MEDIUM…gskill/gskill/mini_swe_agent_config/original_mini.yaml60 ### Create a new file:COMMENT
Modern Structural Boilerplate44 hits · 48 pts
SeverityFileLineSnippetContext
LOWtests/test_state.py685 def set_adapter_state(self, state: dict) -> None:CODE
LOWdocs/scripts/generate_social_screenshots.py96def update_og_tags(site_dir: str = "site", docs_dir: str = ".") -> None:CODE
LOWexamples/adrs/can_be_late/__init__.py19__all__ = [CODE
LOWexamples/adrs/can_be_late/main.py37logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/can_be_late/utils/simulation.py23logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py39logger = logging.getLogger(__name__)CODE
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py4logger = logging.getLogger(__name__)CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py18logger = logging.getLogger(__name__)CODE
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py18logger = logging.getLogger(__name__)CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py14logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/main.py36logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/simulation.py22logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/dataset.py8logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py7__all__ = [CODE
LOWsrc/gepa/optimize_anything.py456__all__ = [CODE
LOWsrc/gepa/gepa_launcher.py313def _set_log_context(ctx: "LogContext | None") -> None:CODE
LOWsrc/gepa/gepa_launcher.py351def set_log_context(ctx: LogContext) -> None:CODE
LOWsrc/gepa/lm.py27logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/core/callbacks.py43logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/core/state.py910 def _update_objective_pareto_front(self, objective_scores: ObjectiveScores, program_idx: ProgramIdx) -> None:CODE
LOWsrc/gepa/strategies/eval_policy.py60__all__ = [CODE
LOWsrc/gepa/utils/code_execution.py55def set_use_cloudpickle(value: bool) -> None:CODE
LOWsrc/gepa/utils/code_execution.py225def _set_random_seeds(seed: int) -> None:CODE
LOWsrc/gepa/utils/__init__.py41__all__ = [CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py24logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py208 def _update_tool_descriptions(self, program: Module, tool_candidates: dict[str, Any]) -> None:STRING
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py497 # def _update_candidate_tools(self, candidate, program, trajectories) -> None:COMMENT
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py10logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py26logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/mcp_adapter/__init__.py22__all__ = [CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py14logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/dspy_full_program_adapter/__init__.py6__all__ = ["DspyAdapter"]CODE
LOWsrc/gepa/adapters/confidence_adapter/__init__.py17__all__ = [CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py25logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/generic_rag_adapter/__init__.py38__all__ = [CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py29logger = logging.getLogger(__name__)CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py238 def _update_best_example_evals(self, example: object, score: float, side_info: "SideInfo") -> None:CODE
LOW…c/gepa/adapters/langchain_adapter/langchain_adapter.py15logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/langchain_adapter/__init__.py7__all__ = [CODE
LOW…/gepa/examples/mcp_adapter/mcp_optimization_example.py62logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/oa/__init__.py23__all__ = [CODE
LOWsrc/gepa/oa/proposers/__init__.py14__all__ = ["ClaudeCodeAgentProposer"]CODE
LOWsrc/gepa/oa/engines/__init__.py14__all__ = ["AutoResearchEngine", "BestOfNEngine", "GepaEngine", "MetaHarnessEngine"]CODE
LOWsrc/gepa/oa/engines/best_of_n.py34logger = logging.getLogger(__name__)CODE
Docstring Block Structure7 hits · 35 pts
SeverityFileLineSnippetContext
HIGHexamples/adrs/cloudcast/utils/cloudcast/utils.py47 Create a networkx graph with capacity constraints and cost info. nodes: regions edges: links with the STRING
HIGHsrc/gepa/api.py105 GEPA is an evolutionary optimizer that evolves (multiple) text components of a complex system to optimize them towaSTRING
HIGHsrc/gepa/gepa_launcher.py1142Optimize any text artifact using LLM-guided search. This is the main entry point for GEPA. You declare the **what*STRING
HIGHsrc/gepa/adapters/mcp_adapter/mcp_client.py326 Factory function to create the appropriate MCP client. Args: server_params: StdioServerParameters for STRING
HIGH…pa/adapters/generic_rag_adapter/generic_rag_adapter.py211 Evaluate RAG system performance on a batch of query-answer examples. This method runs the complete RAGSTRING
HIGH…adapters/generic_rag_adapter/vector_store_interface.py44 Search for documents semantically similar to the query text. This method performs semantic similarity STRING
HIGH…adapters/generic_rag_adapter/vector_store_interface.py85 Search using a pre-computed query embedding vector. This method allows direct vector similarity searchSTRING
Cross-File Repetition7 hits · 35 pts
SeverityFileLineSnippetContext
HIGH…st_pareto_frontier_types/test_pareto_frontier_types.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…lbacks_integration/test_callbacks_with_optimization.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…_aime_prompt_optimization/test_aime_prompt_optimize.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…ters/generic_rag_adapter/vector_stores/qdrant_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…ers/generic_rag_adapter/vector_stores/lancedb_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…ters/generic_rag_adapter/vector_stores/milvus_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…rs/generic_rag_adapter/vector_stores/weaviate_store.py0search for documents similar to the query text using embeddings.STRING
Redundant / Tautological Comments18 hits · 28 pts
SeverityFileLineSnippetContext
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py158 # Check if progress has met or passed the end of this sub-taskCOMMENT
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py199 # Check if progress has met or passed the end of this sub-task (using a small tolerance)COMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py311 # Check if tick is within the valid range for this regionCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py418 # Check if we need to apply strong guaranteeCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py428 # Check if we have a working SPOT instance with no restart overheadCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py493 # Check if trying to terminate the SAME instance type that was just launchedCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py534 # Check if this is a cold start (no instances running anywhere)COMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py537 # Check if this is a region switchCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py749 # Check if we had a new launch in the previous tickCOMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py25 # Check if this is a multi-region setupCOMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py39 # Check if task became done after progress updateCOMMENT
LOW.github/workflows/build_and_release.yml144 # Check if this exact version already exists on PyPICOMMENT
LOWsrc/gepa/core/engine.py721 # Check if stop_callback contains MaxMetricCallsStopperCOMMENT
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py170 # Check if field is a list type (vector field)COMMENT
LOW…ters/generic_rag_adapter/vector_stores/milvus_store.py126 # Check if insertion was successfulCOMMENT
LOWsrc/gepa/gskill/gskill/swe_harness.py82 # Check if rootless socket existsCOMMENT
LOWsrc/gepa/gskill/gskill/evaluate/claude_code.py50 # Check if rootless socket existsCOMMENT
LOWsrc/gepa/gskill/gskill/evaluate/claude_code.py283 # Check if base image exists locally - DO NOT PULL (would overwrite local build)COMMENT
Slop Phrases8 hits · 24 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_pareto_frontier_types/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Kindly be informCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json29 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nKindly bCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json32 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json103 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json105 "('task_lm', '[{\"content\": \"You are a helpful assistant that receives short business communications (such as internCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json108 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nlist allCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json130 "('task_lm', '[{\"content\": \"You are a helpful assistant.\\\\n\\\\nYour task is to read and accurately respond to diCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json133 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n1. Keto CODE
Over-Commented Block15 hits · 15 pts
SeverityFileLineSnippetContext
LOW.claude/skills/gepa-optimize-anything/SKILL.md81`test_set` is **separate from the modes and reporting-only**: the seed and the final candidate areCOMMENT
LOWexamples/blackbox/evalset/problems.py101COMMENT
LOWexamples/blackbox/evalset/problems.py121# if config["res"] is not None:COMMENT
LOWexamples/confidence_adapter/main.py1#!/usr/bin/env python3COMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py261 # if len(envs) > 1:COMMENT
LOW.github/workflows/run_tests.yml101 - name: Run lint with testsCOMMENT
LOW.github/workflows/run_tests.yml121 # with:COMMENT
LOW.github/workflows/dependency_canary.yml1# Fresh-resolution canary: regular CI installs from the committed uv.lockCOMMENT
LOWsrc/gepa/gepa_launcher.py521 # include it in side_info as {"stdout": "...", "stderr": "..."}.COMMENT
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py501 # TODO: The current DSPyAdapter implementation uses the GEPA default propose_new_texts.COMMENT
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py521 # "current_instruction_doc": base_instruction,COMMENT
LOW…adapters/generic_rag_adapter/vector_stores/__init__.py1# Copyright (c) 2025 Lakshya A Agrawal and the GEPA contributorsCOMMENT
LOWsrc/gepa/examples/rag_adapter/requirements-rag.txt21pyarrow>=10.0.0COMMENT
LOWsrc/gepa/oa/eval_server.py741 # Clients may disconnect after their own timeout or after budgetCOMMENT
LOWsrc/gepa/oa/engines/gepa.py81COMMENT
Magic Placeholder Names3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md195 auth_credentials=weaviate.AuthApiKey("your-api-key"),CODE
HIGHsrc/gepa/examples/rag_adapter/RAG_GUIDE.md79 export OPENAI_API_KEY="your-api-key"CODE
HIGHsrc/gepa/examples/rag_adapter/RAG_GUIDE.md80 export ANTHROPIC_API_KEY="your-api-key"CODE
AI Structural Patterns15 hits · 14 pts
SeverityFileLineSnippetContext
LOWsrc/gepa/api.py46CODE
LOWsrc/gepa/optimize_anything.py94CODE
LOWsrc/gepa/gepa_launcher.py1131CODE
LOWsrc/gepa/core/engine.py126CODE
LOWsrc/gepa/utils/code_execution.py135CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py90CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py131CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py349CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py176CODE
LOWsrc/gepa/oa/ensemble.py214CODE
LOWsrc/gepa/oa/ensemble.py324CODE
LOWsrc/gepa/oa/ensemble.py375CODE
LOWsrc/gepa/oa/ensemble.py412CODE
LOWsrc/gepa/logging/experiment_tracker.py408CODE
LOWsrc/gepa/logging/experiment_tracker.py23CODE
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOW.github/workflows/build_and_release.yml104 # TODO: Add tests using gepaCOMMENT