Repository Analysis

gepa-ai/gepa

Optimize prompts, code, and more with AI-powered Reflective Text Evolution

35.0 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of gepa-ai/gepa, a Jupyter Notebook project with 5,641 GitHub stars. SynthScan v2.0 examined 69,333 lines of code across 373 source files, recording 1439 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 35.0 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

35.0
Adjusted Score
35.0
Raw Score
100%
Time Factor
2026-07-14
Last Push
5.6K
Stars
Jupyter Notebook
Language
69.3K
Lines of Code
373
Files
1.4K
Pattern Hits
2026-07-14
Scan Date
0.09
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 35MEDIUM 334LOW 1070

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1439 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators256 hits · 938 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_mcp_adapter.py146# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py148# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py235# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py237# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py455# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py457# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py576# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py578# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py625# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py627# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py32# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py34# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py91# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py93# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py430# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py432# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py556# ============================================================================COMMENT
MEDIUMtests/test_mcp_adapter.py558# ============================================================================COMMENT
MEDIUMtests/test_callbacks.py154# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py156# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py213# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py215# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py267# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py269# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py327# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py329# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py419# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py421# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py677# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py679# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py756# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py758# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py820# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py822# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py885# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py887# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1058# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1060# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1128# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1130# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1231# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1233# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py45# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py47# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1294# =============================================================================COMMENT
MEDIUMtests/test_callbacks.py1296# =============================================================================COMMENT
MEDIUMtests/test_image.py21# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py23# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py35# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py37# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py67# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py148# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py150# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py237# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_image.py239# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_attach_existing_run.py14# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_attach_existing_run.py16# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_attach_existing_run.py72# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_attach_existing_run.py74# ---------------------------------------------------------------------------COMMENT
196 more matches not shown…
Hyper-Verbose Identifiers538 hits · 509 pts
SeverityFileLineSnippetContext
LOWtests/test_gepa_utils.py6def test_select_program_candidate_respects_frequency_bias():CODE
LOWtests/test_mcp_adapter.py115 def test_create_streamable_http_client(self):CODE
LOWtests/test_mcp_adapter.py124 def test_create_client_invalid_both_params(self, server_params):CODE
LOWtests/test_mcp_adapter.py132 def test_create_client_missing_params(self):CODE
LOWtests/test_mcp_adapter.py137 def test_create_client_invalid_transport(self):CODE
LOWtests/test_mcp_adapter.py154 def test_adapter_with_single_tool(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py243 def test_build_system_prompt_single_tool(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py463 def test_make_reflective_dataset_tool_description(self, server_params, simple_metric, seed_candidate):CODE
LOWtests/test_mcp_adapter.py584 def test_multi_tool_initialization(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py633 def test_two_pass_enabled_by_default(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py167 def test_adapter_with_multiple_tools(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py179 def test_adapter_with_remote_sse(self, simple_metric):CODE
LOWtests/test_mcp_adapter.py194 def test_adapter_with_remote_streamable_http(self, simple_metric):CODE
LOWtests/test_mcp_adapter.py206 def test_adapter_with_callable_model(self, server_params, simple_metric, mock_model_callable):CODE
LOWtests/test_mcp_adapter.py218 def test_adapter_custom_parameters(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py267 def test_build_system_prompt_multiple_tools(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py292 def test_extract_tool_response(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py316 def test_extract_tool_response_with_error(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py337 def test_extract_tool_response_with_structured_content(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py356 def test_extract_tool_response_with_image_content(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py377 def test_generate_tool_feedback_success(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py403 def test_generate_tool_feedback_failure(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py515 def test_make_reflective_dataset_system_prompt(self, server_params, simple_metric, seed_candidate):CODE
LOWtests/test_mcp_adapter.py597 def test_multi_tool_system_prompt_generation(self, server_params, simple_metric):CODE
LOWtests/test_mcp_adapter.py644 def test_two_pass_can_be_disabled(self, server_params, simple_metric):CODE
LOWtests/test_evaluation_cache.py22 def test_empty_cache_returns_none(self):CODE
LOWtests/test_evaluation_cache.py36 def test_different_examples_separate_entries(self):CODE
LOWtests/test_evaluation_cache.py45 def test_different_candidates_separate_entries(self):CODE
LOWtests/test_evaluation_cache.py99 def test_optimize_with_caching_enabled(self, tmp_path):CODE
LOWtests/test_evaluation_cache.py115 def test_caching_does_not_break_optimization(self, tmp_path):CODE
LOWtests/test_evaluation_cache.py166def test_aime_prompt_optimize_with_cache(mocked_lms, recorder_dir):CODE
LOWtests/test_evaluation_cache.py225def test_pareto_frontier_type_with_cache(pareto_mocked_lms, pareto_recorder_dir, frontier_type):CODE
LOWtests/test_data_loader.py59def test_list_data_loader_basic():CODE
LOWtests/test_data_loader.py69def test_staged_data_loader_unlocks_after_batches():CODE
LOWtests/test_data_loader.py96def test_staged_data_loader_manual_unlock():CODE
LOWtests/test_optimize_anything_callbacks.py25 def test_callbacks_receive_events(self):CODE
LOWtests/test_optimize_anything_callbacks.py83 def test_no_callbacks_default(self):CODE
LOWtests/test_optimize_anything_callbacks.py95 def test_proposal_events_received(self):CODE
LOWtests/conftest.py9def create_mocked_lms_context(cache_dir: Path):CODE
LOWtests/test_callbacks.py162 def test_callback_protocol_is_runtime_checkable(self):CODE
LOWtests/test_callbacks.py171 def test_empty_callback_implementation(self):CODE
LOWtests/test_callbacks.py221 def test_on_optimization_start_called_with_correct_args(self):CODE
LOWtests/test_callbacks.py275 def test_on_iteration_start_called_with_correct_args(self):CODE
LOWtests/test_callbacks.py335 def test_on_candidate_selected_called_with_selection_info(self):CODE
LOWtests/test_callbacks.py427 def test_on_evaluation_start_called_with_batch_info(self):CODE
LOWtests/test_callbacks.py685 def test_on_reflective_dataset_built_called_with_dataset(self):CODE
LOWtests/test_callbacks.py764 def test_on_merge_attempted_called_with_parents(self):CODE
LOWtests/test_callbacks.py828 def test_on_pareto_front_updated_called_with_changes(self):CODE
LOWtests/test_callbacks.py893 def test_on_valset_evaluated_called_with_correct_args(self):CODE
LOWtests/test_callbacks.py1066 def test_on_error_called_with_exception(self):CODE
LOWtests/test_callbacks.py1136 def test_composite_callback_calls_all_callbacks(self):CODE
LOWtests/test_callbacks.py1212 def test_notify_callbacks_with_none(self):CODE
LOWtests/test_callbacks.py1221 def test_notify_callbacks_with_empty_list(self):CODE
LOWtests/test_callbacks.py1239 def test_reflective_dataset_structure_is_correct(self):CODE
LOWtests/test_callbacks.py95 def on_reflective_dataset_built(self, event):CODE
LOWtests/test_callbacks.py186 def test_partial_callback_implementation(self):CODE
LOWtests/test_callbacks.py243 def test_on_optimization_end_called_with_final_state(self):CODE
LOWtests/test_callbacks.py294 def test_on_iteration_end_called_with_outcome(self):CODE
LOWtests/test_callbacks.py357 def test_on_minibatch_sampled_called_with_ids(self):CODE
LOWtests/test_callbacks.py376 def test_on_candidate_accepted_called_on_improvement(self):CODE
478 more matches not shown…
Excessive Try-Catch Wrapping159 hits · 161 pts
SeverityFileLineSnippetContext
LOWtests/test_evaluator_wrapper.py725 except Exception:CODE
LOWdocs/docs/guides/callbacks.md257 except Exception:CODE
LOWdocs/docs/guides/adapters.md205 except Exception as e:CODE
LOWdocs/hooks/scholarly_pdf.py82 except Exception:CODE
LOWdocs/scripts/generate_social_screenshots.py84 except Exception as e:CODE
LOWdocs/scripts/generate_social_screenshots.py91 except Exception as e:CODE
MEDIUMdocs/scripts/generate_social_screenshots.py92 print(f"Error generating screenshots: {e}")CODE
LOWdocs/scripts/generate_social_screenshots.py157 except Exception as e:CODE
LOWexamples/circle_packing/utils.py59 except Exception as e:CODE
LOWexamples/arc_agi/utils.py130 except Exception:CODE
LOWexamples/arc_agi/utils.py313 except Exception as e:CODE
LOWexamples/arc_agi/utils.py401 except Exception as e:CODE
LOWexamples/confidence_adapter/main.py153 except Exception as _e:CODE
LOWexamples/confidence_adapter/main.py167 except Exception:CODE
LOWexamples/confidence_adapter/main.py298 except Exception as e:CODE
MEDIUMexamples/confidence_adapter/main.py115def evaluator(data, response_text):CODE
LOWexamples/adrs/can_be_late/utils/simulation.py95 except Exception as e:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py140 except Exception as e:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py252 except Exception:CODE
LOWexamples/adrs/can_be_late/utils/simulation.py399 except Exception:CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py67 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py90 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py137 except Exception as e:CODE
LOWexamples/adrs/cloudcast/utils/simulation.py149 except Exception as e:CODE
LOWsrc/gepa/optimize_anything.py1039 except Exception as e:CODE
LOWsrc/gepa/lm.py118 except Exception:CODE
LOWsrc/gepa/lm.py169 except Exception:CODE
LOWsrc/gepa/gepa_utils.py13 except Exception:CODE
LOWsrc/gepa/core/engine.py431 except Exception as e:CODE
LOWsrc/gepa/core/engine.py751 except Exception as e:CODE
LOWsrc/gepa/core/engine.py891 except Exception as e:CODE
LOWsrc/gepa/core/callbacks.py455 except Exception as e:CODE
LOWsrc/gepa/core/callbacks.py550 except Exception as e:CODE
LOWsrc/gepa/core/state.py331 except Exception as e:CODE
LOWsrc/gepa/utils/stop_condition.py79 except Exception:CODE
LOWsrc/gepa/utils/stop_condition.py106 except Exception:CODE
MEDIUMsrc/gepa/utils/code_execution.py31 print(f"Error: {result.error}")STRING
LOWsrc/gepa/utils/code_execution.py265 except Exception:CODE
LOWsrc/gepa/utils/code_execution.py330 except Exception as e:CODE
LOWsrc/gepa/utils/code_execution.py495except Exception as _e:CODE
LOW…pa/proposer/reflective_mutation/reflective_mutation.py391 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py293 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py322 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py422 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py459 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py592 except Exception as e:STRING
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py216 except Exception as e:CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py314 except Exception as e:CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py59 except Exception as e:CODE
LOWsrc/gepa/adapters/anymaths_adapter/anymaths_adapter.py109 except Exception:CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py428 except Exception:CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py434 except Exception:CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py519 except Exception as exc:CODE
LOW…pa/adapters/generic_rag_adapter/generic_rag_adapter.py315 except Exception as e:CODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py109 except Exception:CODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py168 except Exception:CODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py202 except Exception:CODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py223 except Exception as e:CODE
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py233 except Exception as e:CODE
LOW…ters/generic_rag_adapter/vector_stores/qdrant_store.py44 except Exception as e:CODE
99 more matches not shown…
Unused Imports138 hits · 135 pts
SeverityFileLineSnippetContext
LOWtests/test_optimize_anything_callbacks.py6CODE
LOWtests/test_refiner.py11CODE
LOWtests/test_best_example_evals.py6CODE
LOWtests/test_attach_existing_run.py6CODE
LOWtests/test_attach_existing_run.py8CODE
LOWtests/test_import.py6CODE
LOWtests/test_import.py16CODE
LOWtests/test_lm.py6CODE
LOWtests/test_langchain_adapter.py18CODE
LOWtests/ensure_gepa_dspy_dependency.py4CODE
LOWtests/test_dspy_full_program_adapter.py10CODE
LOW…sts/test_confidence_adapter/test_confidence_adapter.py14CODE
LOWtests/test_confidence_adapter/test_scoring.py12CODE
LOWexamples/blackbox/utils.py4CODE
LOWexamples/blackbox/utils.py5CODE
LOWexamples/blackbox/evalset/evalset.py42CODE
LOWexamples/confidence_adapter/main.py32CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py3CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py11CODE
LOWexamples/adrs/can_be_late/__init__.py17CODE
LOWexamples/adrs/can_be_late/utils/dataset.py3CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py35CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py12CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py15CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py16CODE
LOW…e_late/utils/simulator/sky_spot/strategies/__init__.py1CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py10CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py12CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py12CODE
LOWexamples/adrs/cloudcast/utils/simulation.py17CODE
LOWexamples/adrs/cloudcast/utils/dataset.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py5CODE
LOW…ples/adrs/cloudcast/utils/cloudcast/initial_program.py10CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py6CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py9CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py4CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py8CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/broadcast.py3CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/broadcast.py4CODE
LOWexamples/langchain_adapter/pair_sum_product.py10CODE
LOWexamples/langchain_adapter/big_number_arithmetic.py12CODE
LOWexamples/langchain_adapter/gsm8k.py11CODE
LOWexamples/langchain_adapter/aime.py10CODE
LOWsrc/gepa/__init__.py4CODE
LOWsrc/gepa/__init__.py7CODE
LOWsrc/gepa/__init__.py8CODE
LOWsrc/gepa/__init__.py9CODE
LOWsrc/gepa/__init__.py9CODE
LOWsrc/gepa/__init__.py10CODE
78 more matches not shown…
Cross-Language Confusion18 hits · 110 pts
SeverityFileLineSnippetContext
HIGHsrc/gepa/visualization.py249let pinnedIdx = null; // non-null when tooltip is click-pinned (scrollable)CODE
HIGHsrc/gepa/visualization.py250let hoverIdx = null; // non-null when hovering over a nodeCODE
HIGHsrc/gepa/visualization.py292 pinnedIdx = null;CODE
HIGHsrc/gepa/visualization.py293 hoverIdx = null;CODE
HIGHsrc/gepa/visualization.py300 if (pinnedIdx !== null && tt.style.display === "block"CODE
HIGHsrc/gepa/visualization.py324 if (pinnedIdx !== null) return; // don't override a pinned tooltipCODE
HIGHsrc/gepa/visualization.py329 if (pinnedIdx !== null || hoverIdx !== idx) return;CODE
HIGHsrc/gepa/visualization.py333 if (pinnedIdx !== null) return;CODE
HIGHsrc/gepa/visualization.py334 hoverIdx = null;CODE
HIGHsrc/gepa/adapters/dspy_adapter/dspy_adapter.py372 trace_instances = [t for t in trace if t[0].signature.equals(module.signature)]CODE
HIGH…ters/dspy_full_program_adapter/full_program_adapter.py186 if predictor.signature.equals(selected[0].signature):CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py512id -u claude_user >/dev/null 2>&1 || useradd -m -s /bin/bash claude_userCODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py515chown -R claude_user:claude_user {DOCKER_WORKDIR} 2>/dev/null || trueCODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py525 ls -la {problem_file_container} 2>&1 || echo "Source not found"CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py309 apt-get clean && rm -rf /var/lib/apt/lists/*CODE
HIGHsrc/gepa/gskill/gskill/evaluate/claude_code.py318RUN claude --version || echo "Claude Code installed"CODE
HIGH…/gepa/examples/mcp_adapter/mcp_optimization_example.py16Pull models: ollama pull llama3.1:8b && ollama pull qwen3:8bSTRING
HIGHsrc/gepa/examples/rag_adapter/rag_optimization.py46 - For Ollama: ollama pull qwen3:8b && ollama pull nomic-embed-text:latestSTRING
AI Slop Vocabulary32 hits · 76 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_pareto_frontier_types/llm_cache.json130 "('task_lm', '[{\"content\": \"You are a helpful assistant.\\\\n\\\\nYour task is to read and accurately respond to diCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json133 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n1. Keto CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json135 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Based on this daCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json136 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Please describe CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json136 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Please describe CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json138 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nBased on CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json139 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json139 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json140 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json141 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json143 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json144 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nWrite me CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json146 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nPlease dCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json157 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json158 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json158 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json169 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nI want yoCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json170 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nHow does CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json170 "('reflection_lm', 'You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nHow does CODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json171 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
MEDIUMtests/test_aime_prompt_optimization/llm_cache.json25 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_rag_adapter/conftest.py82 # For testing, just return similarity search resultsCOMMENT
LOWtests/test_rag_adapter/test_vector_store_interface.py60 # For testing, just return similarity search resultsCOMMENT
MEDIUMsrc/gepa/adapters/dspy_adapter/instruction_proposal.py312 # instead of just the current instruction, for more holistic instruction proposals.COMMENT
MEDIUM…ull_program_adapter/dspy_program_proposal_signature.py12 prompt_template = """I am trying to solve a task using the DSPy framework. Here's a comprehensive overview of DSPy cCODE
MEDIUMsrc/gepa/gskill/gskill/swe_fitness_fn.py27 # Create harness pool - one per workerCOMMENT
MEDIUMsrc/gepa/gskill/gskill/swe_fitness_fn.py51 # Get a harness from the poolCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py46 # Get a harness from the poolCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py322 # Create harness poolCOMMENT
Deep Nesting78 hits · 72 pts
SeverityFileLineSnippetContext
LOWtests/test_evaluator_wrapper.py739CODE
LOWtests/test_rag_adapter/conftest.py95CODE
LOWtests/test_rag_adapter/test_rag_end_to_end.py244CODE
LOWdocs/scripts/generate_social_screenshots.py54CODE
LOWdocs/scripts/generate_social_screenshots.py96CODE
LOWdocs/scripts/generate_api_docs.py228CODE
LOWexamples/blackbox/evalset/evalset.py894CODE
LOWexamples/confidence_adapter/main.py270CODE
LOWexamples/adrs/can_be_late/utils/simulation.py246CODE
LOWexamples/adrs/can_be_late/utils/simulation.py295CODE
LOWexamples/adrs/can_be_late/utils/simulation.py326CODE
LOWexamples/adrs/can_be_late/utils/simulation.py376CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py41CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py72CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py404CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py708CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py733CODE
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py123CODE
LOWexamples/adrs/cloudcast/utils/simulation.py279CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/utils.py120CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/simulator.py143CODE
LOWsrc/gepa/visualization.py34CODE
LOWsrc/gepa/visualization.py105CODE
LOWsrc/gepa/optimize_anything.py1119CODE
LOWsrc/gepa/core/engine.py458CODE
LOWsrc/gepa/core/state.py486CODE
LOWsrc/gepa/strategies/instruction_proposal.py45CODE
LOWsrc/gepa/strategies/instruction_proposal.py54CODE
LOWsrc/gepa/strategies/instruction_proposal.py63CODE
LOWsrc/gepa/utils/code_execution.py248CODE
LOWsrc/gepa/utils/code_execution.py379CODE
LOWsrc/gepa/proposer/merge.py118CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py177CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py230CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py341CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py478CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py235CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py187CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py357CODE
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py197CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py208CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py357CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py463CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py524CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py596CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py318CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py83CODE
LOW…ters/dspy_full_program_adapter/full_program_adapter.py133CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py151CODE
LOW…pa/adapters/generic_rag_adapter/generic_rag_adapter.py398CODE
LOW…ters/generic_rag_adapter/vector_stores/qdrant_store.py227CODE
LOW…ters/generic_rag_adapter/vector_stores/qdrant_store.py274CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py148CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py207CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py256CODE
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py325CODE
LOW…ters/generic_rag_adapter/vector_stores/milvus_store.py206CODE
LOW…ters/generic_rag_adapter/vector_stores/milvus_store.py260CODE
LOW…rs/generic_rag_adapter/vector_stores/weaviate_store.py130CODE
LOW…rs/generic_rag_adapter/vector_stores/weaviate_store.py209CODE
18 more matches not shown…
Structural Annotation Overuse43 hits · 62 pts
SeverityFileLineSnippetContext
LOWtests/test_pareto_frontier_types/llm_cache.json152 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
LOWtests/test_pareto_frontier_types/llm_cache.json164 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_pareto_frontier_types/llm_cache.json44 "('task_lm', '[{\"content\": \"You are a helpful assistant designed to assist with rewriting, translating, and respondCODE
LOWtests/test_pareto_frontier_types/llm_cache.json56 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_aime_prompt_optimization/llm_cache.json2 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json3 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json4 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json7 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json12 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json15 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json16 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json17 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json19 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json21 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json22 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
LOWtests/test_aime_prompt_optimization/llm_cache.json23 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json24 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json27 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json28 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json29 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json31 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json32 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json34 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json35 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWdocs/docs/guides/adapters.md39### Step 1: Define Your TypesCOMMENT
LOWdocs/docs/guides/adapters.md68### Step 2: Implement `evaluate`COMMENT
LOWdocs/docs/guides/adapters.md120### Step 3: Implement `make_reflective_dataset`COMMENT
LOWsrc/gepa/core/engine.py444 # Step 3: Process acceptances sequentiallyCOMMENT
LOWsrc/gepa/core/engine.py393 # Step 1: Pre-sample N contexts (sequential)COMMENT
LOWsrc/gepa/core/engine.py420 # Step 2: Execute proposals in parallel (thread-safe heavy compute)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py63 # Step 1: Query reformulation (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py68 # Step 2: RetrievalCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py71 # Step 3: Reranking (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py75 # Step 4: Context synthesisCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py78 # Step 5: Answer generationCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py705 # Step 1: Setup vector storeCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py709 # Step 2: Create datasetsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py715 # Step 3: Initialize LLM clientCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py747 # Step 5: Create initial promptsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py751 # Step 6: Test initial performanceCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py759 # Step 7: Run GEPA optimizationCOMMENT
Verbosity Indicators40 hits · 58 pts
SeverityFileLineSnippetContext
LOWtests/test_pareto_frontier_types/llm_cache.json152 "('task_lm', '[{\"content\": \"You are a helpful assistant tasked with drafting written content for a variety of profeCODE
LOWtests/test_pareto_frontier_types/llm_cache.json164 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_pareto_frontier_types/llm_cache.json44 "('task_lm', '[{\"content\": \"You are a helpful assistant designed to assist with rewriting, translating, and respondCODE
LOWtests/test_pareto_frontier_types/llm_cache.json56 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n[REDACTECODE
LOWtests/test_aime_prompt_optimization/llm_cache.json2 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json3 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json4 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json7 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json12 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json15 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json16 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json17 "('task_lm', '[{\"content\": \"You are a helpful assistant. Your task is to answer math olympiad and contest-style proCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json19 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json21 "('task_lm', '[{\"content\": \"You are a helpful assistant. You are given a question and you need to answer it. The anCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json22 "('reflection_lm', 'I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou are CODE
LOWtests/test_aime_prompt_optimization/llm_cache.json23 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json24 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json27 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json28 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json29 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json31 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json32 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json34 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWtests/test_aime_prompt_optimization/llm_cache.json35 "('task_lm', '[{\"content\": \"You are a helpful assistant for mathematics competition problems. You will be given a qCODE
LOWsrc/gepa/core/engine.py444 # Step 3: Process acceptances sequentiallyCOMMENT
LOWsrc/gepa/core/engine.py393 # Step 1: Pre-sample N contexts (sequential)COMMENT
LOWsrc/gepa/core/engine.py420 # Step 2: Execute proposals in parallel (thread-safe heavy compute)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py63 # Step 1: Query reformulation (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py68 # Step 2: RetrievalCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py71 # Step 3: Reranking (if enabled)COMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py75 # Step 4: Context synthesisCOMMENT
LOWsrc/gepa/adapters/generic_rag_adapter/rag_pipeline.py78 # Step 5: Answer generationCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py705 # Step 1: Setup vector storeCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py709 # Step 2: Create datasetsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py715 # Step 3: Initialize LLM clientCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py747 # Step 5: Create initial promptsCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py751 # Step 6: Test initial performanceCOMMENT
LOWsrc/gepa/examples/rag_adapter/rag_optimization.py759 # Step 7: Run GEPA optimizationCOMMENT
Modern AI Meta-Vocabulary17 hits · 54 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py295 # Create RAG configurationCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py298 # Create the RAG adapter with our mocked LLMCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py305 # Initial seed candidate with basic RAG promptsCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py308 # 2. Execution: Run the core RAG optimization logicCOMMENT
MEDIUMdocs/docs/guides/faq.md569### How do I use GEPA for agentic systems with expensive rollouts?STRING
MEDIUMdocs/docs/guides/use-cases.md1118 [:material-arrow-right: Read the blog post](https://super-agentic.ai/resources/super-posts/gepa-dspy-optimizer-superCODE
MEDIUM…pa/adapters/generic_rag_adapter/generic_rag_adapter.py264 # Execute RAG pipeline with candidate promptsCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md1# Generic RAG Adapter for GEPA (DOCS ONLY)COMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md24# Install RAG adapter dependenciesCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md55# 2. Create the RAG adapterCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md150### RAG Pipeline FlowCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md327### RAG Pipeline ConfigurationCOMMENT
MEDIUMsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md544### Unified RAG Optimization ScriptSTRING
MEDIUMsrc/gepa/examples/rag_adapter/rag_optimization.py726 # Step 4: Initialize RAG adapterCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/requirements-rag.txt1# RAG Adapter DependenciesCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/RAG_GUIDE.md1# GEPA Generic RAG Adapter GuideCOMMENT
MEDIUMsrc/gepa/examples/rag_adapter/RAG_GUIDE.md108## 🚀 Using the Unified RAG Optimization ScriptCOMMENT
Self-Referential Comments16 hits · 51 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_mcp_adapter.py327 # Create a proper MCP error resultCOMMENT
MEDIUMtests/test_refiner.py719 # This function is passed directly to OptimizeAnythingAdapter (bypassingCOMMENT
MEDIUMtests/test_module_selector.py159 # Create a mock state (not used in the new implementation)COMMENT
MEDIUM…lbacks_integration/test_callbacks_with_optimization.py348 # Create a callback that only implements some methodsCOMMENT
MEDIUMtests/test_rag_adapter/test_rag_end_to_end.py298 # Create the RAG adapter with our mocked LLMCOMMENT
MEDIUMexamples/blackbox/evalset/problems.py107# # Create a test point at midpoint of boundsCOMMENT
MEDIUM…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py381 # This method is only here because it's abstract in base classCOMMENT
MEDIUMsrc/gepa/optimize_anything.py1004 # Create a fresh, shared log context for this evaluator call.COMMENT
MEDIUMsrc/gepa/adapters/dspy_adapter/instruction_proposal.py86 # Create a rich multimodal examples_with_feedback that includes both text and imagesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/mini_swe_agent.py305 # Define the two evaluation conditionsCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code_skills.py109 # Create the skill directory structureCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py507 # Create a runner script to avoid shell escaping issuesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py529# Create a wrapper script for claude_user that reads from filesCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py203 # Create a set for fast lookupCOMMENT
MEDIUMsrc/gepa/gskill/gskill/evaluate/claude_code.py375 # Create the image from locally-built baseSTRING
MEDIUM…gskill/gskill/mini_swe_agent_config/original_mini.yaml60 ### Create a new file:COMMENT
Modern Structural Boilerplate39 hits · 43 pts
SeverityFileLineSnippetContext
LOWtests/test_state.py366 def set_adapter_state(self, state: dict) -> None:CODE
LOWdocs/scripts/generate_social_screenshots.py96def update_og_tags(site_dir: str = "site", docs_dir: str = ".") -> None:CODE
LOWexamples/adrs/can_be_late/__init__.py19__all__ = [CODE
LOWexamples/adrs/can_be_late/main.py37logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/can_be_late/utils/simulation.py23logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/can_be_late/utils/simulator/main.py39logger = logging.getLogger(__name__)CODE
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py4logger = logging.getLogger(__name__)CODE
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py18logger = logging.getLogger(__name__)CODE
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py18logger = logging.getLogger(__name__)CODE
LOW…e_late/utils/simulator/sky_spot/strategies/strategy.py14logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/main.py36logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/simulation.py22logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/dataset.py8logger = logging.getLogger(__name__)CODE
LOWexamples/adrs/cloudcast/utils/cloudcast/__init__.py7__all__ = [CODE
LOWsrc/gepa/optimize_anything.py301def _set_log_context(ctx: "LogContext | None") -> None:CODE
LOWsrc/gepa/optimize_anything.py339def set_log_context(ctx: LogContext) -> None:CODE
LOWsrc/gepa/lm.py27logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/core/callbacks.py41logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/core/state.py474 def _update_objective_pareto_front(self, objective_scores: ObjectiveScores, program_idx: ProgramIdx) -> None:CODE
LOWsrc/gepa/strategies/eval_policy.py60__all__ = [CODE
LOWsrc/gepa/utils/code_execution.py55def set_use_cloudpickle(value: bool) -> None:CODE
LOWsrc/gepa/utils/code_execution.py225def _set_random_seeds(seed: int) -> None:CODE
LOWsrc/gepa/utils/__init__.py41__all__ = [CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py24logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py208 def _update_tool_descriptions(self, program: Module, tool_candidates: dict[str, Any]) -> None:STRING
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py497 # def _update_candidate_tools(self, candidate, program, trajectories) -> None:COMMENT
LOWsrc/gepa/adapters/dspy_adapter/instruction_proposal.py10logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py26logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/mcp_adapter/__init__.py22__all__ = [CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_client.py14logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/dspy_full_program_adapter/__init__.py6__all__ = ["DspyAdapter"]CODE
LOWsrc/gepa/adapters/confidence_adapter/__init__.py17__all__ = [CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py25logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/generic_rag_adapter/__init__.py38__all__ = [CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py25logger = logging.getLogger(__name__)CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py112 def _update_best_example_evals(self, example: object, score: float, side_info: "SideInfo") -> None:CODE
LOW…c/gepa/adapters/langchain_adapter/langchain_adapter.py15logger = logging.getLogger(__name__)CODE
LOWsrc/gepa/adapters/langchain_adapter/__init__.py7__all__ = [CODE
LOW…/gepa/examples/mcp_adapter/mcp_optimization_example.py62logger = logging.getLogger(__name__)CODE
Docstring Block Structure7 hits · 35 pts
SeverityFileLineSnippetContext
HIGHexamples/adrs/cloudcast/utils/cloudcast/utils.py47 Create a networkx graph with capacity constraints and cost info. nodes: regions edges: links with the STRING
HIGHsrc/gepa/api.py97 GEPA is an evolutionary optimizer that evolves (multiple) text components of a complex system to optimize them towaSTRING
HIGHsrc/gepa/optimize_anything.py1129Optimize any text artifact using LLM-guided search. This is the main entry point for GEPA. You declare the **what*STRING
HIGHsrc/gepa/adapters/mcp_adapter/mcp_client.py326 Factory function to create the appropriate MCP client. Args: server_params: StdioServerParameters for STRING
HIGH…pa/adapters/generic_rag_adapter/generic_rag_adapter.py211 Evaluate RAG system performance on a batch of query-answer examples. This method runs the complete RAGSTRING
HIGH…adapters/generic_rag_adapter/vector_store_interface.py44 Search for documents semantically similar to the query text. This method performs semantic similarity STRING
HIGH…adapters/generic_rag_adapter/vector_store_interface.py85 Search using a pre-computed query embedding vector. This method allows direct vector similarity searchSTRING
Cross-File Repetition7 hits · 35 pts
SeverityFileLineSnippetContext
HIGH…st_pareto_frontier_types/test_pareto_frontier_types.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…lbacks_integration/test_callbacks_with_optimization.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…_aime_prompt_optimization/test_aime_prompt_optimize.py0provides the path to the recording directory and ensures it exists.STRING
HIGH…ters/generic_rag_adapter/vector_stores/qdrant_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…ers/generic_rag_adapter/vector_stores/lancedb_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…ters/generic_rag_adapter/vector_stores/milvus_store.py0search for documents similar to the query text using embeddings.STRING
HIGH…rs/generic_rag_adapter/vector_stores/weaviate_store.py0search for documents similar to the query text using embeddings.STRING
Redundant / Tautological Comments18 hits · 28 pts
SeverityFileLineSnippetContext
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py158 # Check if progress has met or passed the end of this sub-taskCOMMENT
LOW…ples/adrs/can_be_late/utils/simulator/sky_spot/task.py199 # Check if progress has met or passed the end of this sub-task (using a small tolerance)COMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py311 # Check if tick is within the valid range for this regionCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py418 # Check if we need to apply strong guaranteeCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py428 # Check if we have a working SPOT instance with no restart overheadCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py493 # Check if trying to terminate the SAME instance type that was just launchedCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py534 # Check if this is a cold start (no instances running anywhere)COMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py537 # Check if this is a region switchCOMMENT
LOW…mples/adrs/can_be_late/utils/simulator/sky_spot/env.py749 # Check if we had a new launch in the previous tickCOMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py25 # Check if this is a multi-region setupCOMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py39 # Check if task became done after progress updateCOMMENT
LOW.github/workflows/build_and_release.yml144 # Check if this exact version already exists on PyPICOMMENT
LOWsrc/gepa/core/engine.py465 # Check if stop_callback contains MaxMetricCallsStopperCOMMENT
LOW…ers/generic_rag_adapter/vector_stores/lancedb_store.py170 # Check if field is a list type (vector field)COMMENT
LOW…ters/generic_rag_adapter/vector_stores/milvus_store.py126 # Check if insertion was successfulCOMMENT
LOWsrc/gepa/gskill/gskill/swe_harness.py82 # Check if rootless socket existsCOMMENT
LOWsrc/gepa/gskill/gskill/evaluate/claude_code.py50 # Check if rootless socket existsCOMMENT
LOWsrc/gepa/gskill/gskill/evaluate/claude_code.py283 # Check if base image exists locally - DO NOT PULL (would overwrite local build)COMMENT
Slop Phrases8 hits · 24 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_pareto_frontier_types/llm_cache.json26 "('task_lm', '[{\"content\": \"You are a helpful assistant.\", \"role\": \"system\"}, {\"content\": \"Kindly be informCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json29 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nKindly bCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json32 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json103 "('reflection_lm', \"I provided an assistant with the following instructions to perform a task for me:\\n```\\nYou areCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json105 "('task_lm', '[{\"content\": \"You are a helpful assistant that receives short business communications (such as internCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json108 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\nlist allCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json130 "('task_lm', '[{\"content\": \"You are a helpful assistant.\\\\n\\\\nYour task is to read and accurately respond to diCODE
MEDIUMtests/test_pareto_frontier_types/llm_cache.json133 "('reflection_lm', \"You are a strict grader. Compare the assistant response to the gold redaction.\\nGOLD:\\n1. Keto CODE
Magic Placeholder Names3 hits · 15 pts
SeverityFileLineSnippetContext
HIGHsrc/gepa/adapters/generic_rag_adapter/GEPA_RAG.md195 auth_credentials=weaviate.AuthApiKey("your-api-key"),CODE
HIGHsrc/gepa/examples/rag_adapter/RAG_GUIDE.md79 export OPENAI_API_KEY="your-api-key"CODE
HIGHsrc/gepa/examples/rag_adapter/RAG_GUIDE.md80 export ANTHROPIC_API_KEY="your-api-key"CODE
Over-Commented Block12 hits · 12 pts
SeverityFileLineSnippetContext
LOWexamples/blackbox/evalset/problems.py101COMMENT
LOWexamples/blackbox/evalset/problems.py121# if config["res"] is not None:COMMENT
LOWexamples/confidence_adapter/main.py1#!/usr/bin/env python3COMMENT
LOW…/adrs/can_be_late/utils/simulator/sky_spot/simulate.py261 # if len(envs) > 1:COMMENT
LOW.github/workflows/run_tests.yml101 - name: Run lint with testsCOMMENT
LOW.github/workflows/run_tests.yml121 # - uses: actions/checkout@v4COMMENT
LOW.github/workflows/dependency_canary.yml1# Fresh-resolution canary: regular CI installs from the committed uv.lockCOMMENT
LOWsrc/gepa/optimize_anything.py501 # Track top-K best evaluations per example, passed to evaluator via OptimizationStateCOMMENT
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py501 # TODO: The current DSPyAdapter implementation uses the GEPA default propose_new_texts.COMMENT
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py521 # "current_instruction_doc": base_instruction,COMMENT
LOW…adapters/generic_rag_adapter/vector_stores/__init__.py1# Copyright (c) 2025 Lakshya A Agrawal and the GEPA contributorsCOMMENT
LOWsrc/gepa/examples/rag_adapter/requirements-rag.txt21pyarrow>=10.0.0COMMENT
AI Structural Patterns9 hits · 8 pts
SeverityFileLineSnippetContext
LOWsrc/gepa/api.py43CODE
LOWsrc/gepa/core/engine.py54CODE
LOWsrc/gepa/utils/code_execution.py135CODE
LOWsrc/gepa/adapters/dspy_adapter/dspy_adapter.py90CODE
LOWsrc/gepa/adapters/mcp_adapter/mcp_adapter.py131CODE
LOW…gepa/adapters/confidence_adapter/confidence_adapter.py349CODE
LOW…optimize_anything_adapter/optimize_anything_adapter.py63CODE
LOWsrc/gepa/logging/experiment_tracker.py408CODE
LOWsrc/gepa/logging/experiment_tracker.py23CODE
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOW.github/workflows/build_and_release.yml104 # TODO: Add tests using gepaCOMMENT