Repository Analysis

openai/openai-cookbook

Examples and guides for using the OpenAI API

7.2 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of openai/openai-cookbook, a Jupyter Notebook project with 74,676 GitHub stars. SynthScan v2.0 examined 129,969 lines of code across 712 source files, recording 594 pattern matches distributed across 21 syntactic categories. The overall adjusted score of 7.2 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

7.2
Adjusted Score
7.2
Raw Score
100%
Time Factor
2026-07-10
Last Push
74.7K
Stars
Jupyter Notebook
Language
130.0K
Lines of Code
712
Files
594
Pattern Hits
2026-07-14
Scan Date
0.04
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 3HIGH 26MEDIUM 81LOW 484

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 594 distinct pattern matches across 21 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers187 hits · 190 pts
SeverityFileLineSnippetContext
LOWexamples/api_request_parallel_processor.py110async def process_api_requests_from_file(CODE
LOWexamples/api_request_parallel_processor.py387def num_tokens_consumed_from_request(CODE
LOWexamples/api_request_parallel_processor.py446def task_id_generator_function():CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py27def build_generation_judge_content(case: TestCase, output_image: Path) -> list[dict]:CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py40def build_editing_judge_content(case: TestCase, output_image: Path) -> list[dict]:CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py161def build_failed_simulation_result(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py209def build_tool_output_by_call_id(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py221def transcript_lines_for_assistant_turn(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py242def build_simulator_prompt_text(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py361def apply_turn_level_tool_grades(CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py28def test_crawl_result_csv_row_omits_tool_arg_columns_when_disabled() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py64def test_walk_result_csv_row_omits_all_tool_columns_when_disabled() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py94def test_run_result_csv_row_uses_enabled_grader_union() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py135def test_apply_turn_level_tool_grades_keeps_results_row_local() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py178def test_trace_grade_row_indices_targets_last_row_only() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py183def test_walk_parse_args_does_not_expose_max_output_tokens() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py74def test_check_tool_call_names_correct_matches_expected_set() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py84def test_check_tool_args_correct_normalizes_addresses() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py106def test_check_tool_args_correct_handles_nested_json_arguments() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py142def test_compute_tool_call_grade_uses_deterministic_graders() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py154def test_instruction_following_grader_uses_instruction_prompt_and_schema() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py176def test_audio_text_mismatch_grader_uses_specialized_prompt() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py193def test_stt_then_text_grader_uses_transcript_as_grounding() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py211def test_transcribe_model_response_audio_writes_valid_wav() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py229def test_transcribe_model_response_audio_rejects_missing_audio() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py242def test_audio_text_mismatch_from_model_response_transcribes_then_grades() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py261def test_stt_then_text_from_model_response_transcribes_then_grades() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py281def test_run_default_grader_dispatches_named_graders() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py26def test_coerce_float_treats_blank_and_non_numeric_strings_as_missing() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py33def test_clean_path_value_resolves_paths_within_run_directory(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py44def test_clean_path_value_rejects_absolute_and_escaping_paths(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py54def test_input_audio_path_for_row_rejects_example_ids_that_escape_run_directory(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py68def test_run_viewer_table_key_uses_full_relative_path() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py75def test_build_run_viewer_table_marks_active_row_with_checkbox() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py96def test_display_run_label_uses_leaf_name() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py100def test_build_summary_table_uses_short_run_label_for_display() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py17def test_crawl_failure_row_serializes_error_info() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py46def test_walk_failure_row_handles_missing_audio_path() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py69def test_run_failure_row_uses_turn_zero() -> None:CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py30def test_run_eval_run_summary_coerces_types_and_feeds_results_viewer() -> None:CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py98def test_walk_eval_result_csv_row_uses_repo_absolute_paths_in_results_viewer(CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py152def test_run_turn_result_csv_row_is_compatible_with_run_viewer_helpers(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py14def test_harness_results_roots_include_bootstrap_eval_results(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py53def test_discover_result_directories_uses_root_relative_labels(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py77def test_row_text_value_returns_first_non_empty_candidate() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py91def test_resolve_active_row_index_prefers_navigation_state_until_selection_changes() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py114def test_run_viewer_table_widget_key_changes_when_selection_is_reset() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py130def test_resolve_run_viewer_table_selected_index_prefers_latest_checked_row() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py153def test_run_viewer_table_matches_active_row_requires_single_checked_row() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_plotting_utils.py14def test_build_realtime_eval_plots_writes_expected_files(tmp_path: Path) -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_plotting_utils.py71def test_plot_eval_results_cli_infers_labels(tmp_path: Path) -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py62def test_collect_realtime_response_times_out() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py80def test_collect_realtime_response_raises_on_error_event() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py106def test_collect_realtime_response_requires_completed_status() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py133def test_collect_realtime_response_returns_completed_response() -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py29def test_validate_input_accepts_valid_run_bundle(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py70def test_validate_input_rejects_walk_audio_with_wrong_format(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py91def test_validate_output_accepts_valid_run_output(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py155def test_validate_output_rejects_missing_run_grade_mean(tmp_path: Path) -> None:CODE
LOWexamples/evals/realtime_evals/shared/plotting_utils.py64def build_realtime_eval_plots(CODE
127 more matches not shown…
Decorative Section Separators37 hits · 142 pts
SeverityFileLineSnippetContext
MEDIUMexamples/codex/secure_quality_gitlab.md239# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md241# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md413# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md415# ---------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py1# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py3# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py12# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py14# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py21# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py23# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py28# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py30# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py37# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py39# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py239 # ------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py241 # ------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py10# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py12# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py20# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py22# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py38# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py40# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py52# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py54# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py72# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py74# ---------------------------------------------------------------------------COMMENT
MEDIUM…nt-portfolio-collaboration/mcp/yahoo_finance_server.py32# ---------------------------------------------------------------------------COMMENT
MEDIUM…nt-portfolio-collaboration/mcp/yahoo_finance_server.py34# ---------------------------------------------------------------------------COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py208# ======================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py210# ======================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py278# =====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py280# =====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py356# ====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py358# ====================COMMENT
MEDIUM…rtners/agentic_governance_guide/promptfoo/redteam.yaml2# ===================================================================COMMENT
MEDIUM…rtners/agentic_governance_guide/promptfoo/redteam.yaml4# ===================================================================COMMENT
MEDIUM…rtners/agentic_governance_guide/promptfoo/redteam.yaml12# ===================================================================COMMENT
Excessive Try-Catch Wrapping100 hits · 114 pts
SeverityFileLineSnippetContext
LOWarticles/gpt-oss/run-locally-lmstudio.md120 except Exception as exc:CODE
LOW…als/realtime_evals/crawl_harness/run_realtime_evals.py442 except Exception as exc:CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py880 except Exception as exc:CODE
LOW…vals/realtime_evals/walk_harness/run_realtime_evals.py505 except Exception as exc:CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py350 except Exception as exc:CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py27 except Exception:CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py108 except Exception:CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py117 except Exception:CODE
LOW…loyment_manager/runtime/trace_capture/sitecustomize.py5except Exception:CODE
LOWexamples/agents_sdk/sandboxed-code-migration/evals.py138 except Exception as exc:CODE
LOW…dk/sandboxed-code-migration/src/run_migration_agent.py171 except Exception as exc:CODE
LOW…dk/sandboxed-code-migration/src/run_migration_agent.py198 except Exception as exc:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py185 except Exception as e:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py192 except Exception as e:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py262 except Exception as e:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/utils.py69 except Exception:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py177 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py189 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py145 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py226 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py234 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py261 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py309 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py357 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py389 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py429 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py463 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py480 except Exception as e:CODE
LOWexamples/fine-tuned_qa/answers_with_ft.py97 except Exception as e:CODE
LOW…opilot-with-agent-sdk-and-databricks-mcp/api_server.py118 except Exception as log_exc:CODE
LOW…opilot-with-agent-sdk-and-databricks-mcp/api_server.py127 except Exception:CODE
LOW…opilot-with-agent-sdk-and-databricks-mcp/api_server.py133 except Exception:CODE
LOW…/resources/object_oriented_agents/utils/openai_util.py34 except Exception as e:CODE
LOW…ject_oriented_agents/services/openai_language_model.py49 except Exception as e:CODE
LOW…_approach/resources/registry/tools/file_access_tool.py67 except Exception as e:CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py15except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py21except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py27except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py36except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py41except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py46except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py51except Exception: # pragma: no coverCODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py374 except Exception:CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py1100 except Exception:CODE
LOW…artners/temporal_agents_with_knowledge_graphs/utils.py32 except Exception:CODE
MEDIUM…s/partners/agentic_governance_guide/tune_guardrails.py102 print(f"Error: Config file not found: {args.config}", file=sys.stderr)STRING
MEDIUM…s/partners/agentic_governance_guide/tune_guardrails.py106 print(f"Error: Dataset file not found: {args.dataset}", file=sys.stderr)STRING
LOW…agentic_governance_guide/promptfoo/promptfoo_target.py200 except Exception as e:CODE
MEDIUM…agentic_governance_guide/promptfoo/promptfoo_target.py192def _run():CODE
LOW…ch_api/how_to_build_a_deep_research_mcp_server/main.py202 except Exception as e:CODE
LOW…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py365 except Exception as e: # noqa: BLE001STRING
LOW…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py382 except Exception as e: # noqa: BLE001STRING
LOW…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py428 except Exception as e: # noqa: BLE001STRING
LOW…-optimization-cookbook/results_topk_baseline/run_16.py27 except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_22.py36except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_26.py44except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_03.py42except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_27.py36except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_13.py30 except Exception:CODE
LOW…-optimization-cookbook/results_topk_baseline/run_23.py40except Exception:CODE
40 more matches not shown…
Unused Imports92 hits · 90 pts
SeverityFileLineSnippetContext
LOWexamples/evals/imagegen_evals/vision_harness/io.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py9CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py10CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py10CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py11CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py12CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/types.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/runners.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/storage.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/evaluate.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/sweeps.py1CODE
LOWexamples/evals/imagegen_evals/shared/rendering.py1CODE
LOWexamples/evals/imagegen_evals/shared/rendering.py5CODE
LOWexamples/evals/imagegen_evals/shared/reporting.py1CODE
LOW…/realtime_evals/shared/scripts/validate_eval_output.py1CODE
LOW…s/realtime_evals/shared/scripts/validate_eval_input.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/config.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/ui.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py1CODE
LOWexamples/vector_databases/redis/nbutils.py4CODE
LOWexamples/agents_sdk/deployment_manager/app/store.py1CODE
LOWexamples/agents_sdk/deployment_manager/app/runner.py1CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py1CODE
LOWexamples/agents_sdk/deployment_manager/app/models.py1CODE
LOW…agents_sdk/deployment_manager/app/project_inspector.py1CODE
LOW…agents_sdk/deployment_manager/app/dockerfile_writer.py1CODE
LOWexamples/agents_sdk/deployment_manager/app/main.py1CODE
LOW…mples/agents_sdk/deployment_manager/app/trace_store.py1CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py1CODE
LOW…agents_sdk/deployment_manager/scripts/start_manager.py1CODE
LOW…/agents_sdk/deployment_manager/scripts/local_deploy.py2CODE
LOWexamples/agents_sdk/sandboxed-code-migration/evals.py1CODE
LOW…es/case_summary_service/case_summary_service/client.py1CODE
LOW…/case_summary_service/case_summary_service/__init__.py1CODE
LOW…case_summary_service/case_summary_service/summaries.py1CODE
LOW…_fixtures/case_summary_service/tests/test_summaries.py1CODE
LOW…epo_fixtures/case_summary_service/tests/test_client.py1CODE
LOW…/support_reply_service/customer_support_bot/replies.py1CODE
LOW…s/support_reply_service/customer_support_bot/client.py1CODE
LOW…support_reply_service/customer_support_bot/__init__.py1CODE
LOW…o_fixtures/support_reply_service/tests/test_replies.py1CODE
LOW…po_fixtures/support_reply_service/tests/test_client.py1CODE
LOW…/agents_sdk/sandboxed-code-migration/tests/conftest.py1CODE
LOW…ndboxed-code-migration/tests/test_migration_fixture.py1CODE
LOW…dk/sandboxed-code-migration/src/run_migration_agent.py1CODE
32 more matches not shown…
Magic Placeholder Names16 hits · 85 pts
SeverityFileLineSnippetContext
HIGHexamples/evals/imagegen_evals/README.md20export OPENAI_API_KEY="your_api_key"CODE
HIGHexamples/evals/realtime_evals/README.md19export OPENAI_API_KEY="your_api_key"CODE
HIGH…strap-realtime-eval/scripts/bootstrap_realtime_eval.py663export OPENAI_API_KEY="your_api_key"CODE
HIGHexamples/data/oai_docs/curl-setup.txt263. **Add environment variable**: In the editor, add the line below, replacing `your-api-key-here` with your actual API kCODE
HIGHexamples/data/oai_docs/curl-setup.txt29export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/curl-setup.txt442. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/curl-setup.txt47setx OPENAI_API_KEY "your-api-key-here"CODE
HIGHexamples/data/oai_docs/python-setup.txt723. **Add Environment Variable**: In the editor, add the line below, replacing `your-api-key-here` with your actual API kCODE
HIGHexamples/data/oai_docs/python-setup.txt75export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/python-setup.txt942. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/python-setup.txt97setx OPENAI_API_KEY "your-api-key-here"CODE
HIGHexamples/data/oai_docs/node-setup.txt373. **Add Environment Variable**: In the editor, ensure you have set your API key as shown below, replacing `your-api-keyCODE
HIGHexamples/data/oai_docs/node-setup.txt40export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/node-setup.txt552. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/node-setup.txt58setx OPENAI_API_KEY "your-api-key-here"CODE
HIGH…tions/one_way_translation_using_realtime_api/README.md24 REACT_APP_OPENAI_API_KEY=<your_api_key>CODE
Modern AI Meta-Vocabulary19 hits · 56 pts
SeverityFileLineSnippetContext
MEDIUMarticles/how_to_work_with_large_language_models.md94### Demonstration prompt example (few-shot learning)COMMENT
MEDIUMarticles/openai-harmony.md194The `final` channel will contain the answer to your user’s request. Check out the [reasoning section](#reasoning) for moCODE
MEDIUMarticles/techniques_to_improve_reliability.md305## Extensions to chain-of-thought promptingCOMMENT
MEDIUMarticles/techniques_to_improve_reliability.md534#### Fine-tuned chain of thought prompting / Self-taught reasonerCOMMENT
MEDIUMarticles/gpt-oss/handle-raw-cot.md1# How to handle the raw chain of thought in gpt-ossCOMMENT
MEDIUMexamples/vector_databases/cassandra_astradb/README.md1# RAG with Astra DB and CassandraCOMMENT
MEDIUMexamples/vector_databases/elasticsearch/README.md25### [Retrieval augmented generation](https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/elastCOMMENT
MEDIUMexamples/codex/code_modernization.md209# Test scaffoldingCOMMENT
MEDIUM…les/agents_sdk/migrate-from-claude-agent-sdk/README.md523### Step 5: Choose multi-agent ownershipCOMMENT
MEDIUM…agentic_governance_guide/promptfoo/promptfoo_target.py98# ---------- Centralized guardrails config ----------COMMENT
MEDIUM…ntic_governance_guide/guardrail_tuner/feedback_loop.py257 # Load config and identify tunable guardrailsCOMMENT
MEDIUM…ntic_governance_guide/guardrail_tuner/feedback_loop.py278 # Initialize states for all tunable guardrailsCOMMENT
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/oai_docs/fine-tuning.txt775### When should I use fine-tuning vs embeddings / retrieval augmented generation?COMMENT
MEDIUMexamples/data/oai_docs/optimizing-llm-accuracy.txt170### Retrieval-augmented generation (RAG)COMMENT
MEDIUMexamples/data/oai_docs/optimizing-llm-accuracy.txt259#### RAG + Fine-tuningCOMMENT
Structural Annotation Overuse33 hits · 52 pts
SeverityFileLineSnippetContext
LOWexamples/codex/secure_quality_gitlab.md177### Step 1: Generating RecommendationsCOMMENT
LOWexamples/codex/secure_quality_gitlab.md365### Step 2: Remediating Security Issues Based on RecommendationsCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md396### Step 1: Define the first OpenAI agentCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md405### Step 2: Port custom toolsCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md418### Step 3: Map built-in tools by execution boundaryCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md435### Step 4: Move validation to the right guardrail boundaryCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md523### Step 5: Choose multi-agent ownershipCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md586### Step 6: Choose one conversation-state strategyCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md597### Step 7: Add approvals for side effects with human reviewCOMMENT
LOWexamples/data/oai_docs/curl-setup.txt4## Step 1: Set up curlCOMMENT
LOWexamples/data/oai_docs/curl-setup.txt17## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/curl-setup.txt67## Step 3: Sending your first API requestCOMMENT
LOWexamples/data/oai_docs/function-calling.txt85 # Step 1: send the conversation and available functions to the modelCOMMENT
LOWexamples/data/oai_docs/function-calling.txt115 # Step 2: check if the model wanted to call a functionCOMMENT
LOWexamples/data/oai_docs/function-calling.txt117 # Step 3: call the functionCOMMENT
LOWexamples/data/oai_docs/function-calling.txt123 # Step 4: send the info for each function call and function response to the modelCOMMENT
LOWexamples/data/oai_docs/function-calling.txt165 // Step 1: send the conversation and available functions to the modelCOMMENT
LOWexamples/data/oai_docs/function-calling.txt197 // Step 2: check if the model wanted to call a functionCOMMENT
LOWexamples/data/oai_docs/function-calling.txt200 // Step 3: call the functionCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt17### Step 1: Define functionsCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt125### Step 2: Create a Thread and add MessagesCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt150### Step 3: Initiate a RunCOMMENT
LOWexamples/data/oai_docs/python-setup.txt4## Step 1: Setting up PythonCOMMENT
LOWexamples/data/oai_docs/python-setup.txt57## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/python-setup.txt156## Step 3: Sending your first API requestCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt12### Step 1: Create a new Assistant with File Search EnabledCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt60### Step 2: Upload files and add them to a Vector StoreCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt103### Step 3: Update the assistant to to use the new Vector StoreCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt124### Step 4: Create a threadCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt181### Step 5: Create a run and check the outputCOMMENT
LOWexamples/data/oai_docs/node-setup.txt4## Step 1: Setting up NodeCOMMENT
LOWexamples/data/oai_docs/node-setup.txt26## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/node-setup.txt77## Step 3: Sending your first API requestCOMMENT
Deep Nesting47 hits · 44 pts
SeverityFileLineSnippetContext
LOWexamples/api_request_parallel_processor.py110CODE
LOWexamples/api_request_parallel_processor.py387CODE
LOW…amples/evals/imagegen_evals/vision_harness/evaluate.py17CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py459CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py850CODE
LOW…/evals/realtime_evals/shared/realtime_harness_utils.py124CODE
LOWexamples/evals/realtime_evals/shared/graders.py273CODE
LOW…strap-realtime-eval/scripts/bootstrap_realtime_eval.py242CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py425CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py1157CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py84CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py186CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py478CODE
LOW…mples/agents_sdk/deployment_manager/app/trace_store.py367CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py52CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py159CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py265CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py313CODE
LOW…opilot-with-agent-sdk-and-databricks-mcp/api_server.py92CODE
LOWexamples/partners/model_selection_guide/tools.py179CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py874CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py2793CODE
LOW…ntic_governance_guide/guardrail_tuner/feedback_loop.py159CODE
LOW…ntic_governance_guide/guardrail_tuner/feedback_loop.py191CODE
LOW…ntic_governance_guide/guardrail_tuner/feedback_loop.py246CODE
LOW…ch_api/how_to_build_a_deep_research_mcp_server/main.py28CODE
LOW…ch_api/how_to_build_a_deep_research_mcp_server/main.py40CODE
LOWexamples/gpt-5/apply_patch.py24CODE
LOWexamples/gpt-5/apply_patch.py252CODE
LOWexamples/gpt-5/apply_patch.py390CODE
LOWexamples/gpt-5/apply_patch.py423CODE
LOWexamples/gpt-5/apply_patch.py141CODE
LOW…-optimization-cookbook/results_topk_baseline/run_06.py4CODE
LOW…-optimization-cookbook/results_topk_baseline/run_26.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_03.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_27.py6CODE
LOW…-optimization-cookbook/results_topk_baseline/run_13.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_07.py5CODE
LOW…-optimization-cookbook/results_topk_baseline/run_23.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_09.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_29.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_24.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_14.py7CODE
LOW…-optimization-cookbook/results_topk_baseline/run_20.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_05.py3CODE
LOW…-optimization-cookbook/results_topk_baseline/run_15.py6CODE
LOW…pt-5/prompt-optimization-cookbook/scripts/llm_judge.py59CODE
Hallucination Indicators3 hits · 30 pts
SeverityFileLineSnippetContext
CRITICALexamples/data/oai_docs/tool-code-interpreter.txt277run_steps = client.beta.threads.runs.steps.list(CODE
CRITICALexamples/data/oai_docs/tool-code-interpreter.txt283const runSteps = await openai.beta.threads.runs.steps.list(CODE
CRITICAL…a/oai_docs/function-calling-run-example--streaming.txt99 const stream = this.client.beta.threads.runs.submitToolOutputsStream(CODE
Self-Referential Comments8 hits · 20 pts
SeverityFileLineSnippetContext
MEDIUMregistry.yaml3# This file is used to generate cookbook.openai.com. It specifies which paths weCOMMENT
MEDIUM…roach/resources/object_oriented_agents/utils/logger.py14 # Create a console handlerCOMMENT
MEDIUM…ch/resources/registry/agents/python_code_exec_agent.py16# Create a LanguageModelInterface instance using the OpenAILanguageModelCOMMENT
MEDIUM…ch/resources/registry/agents/python_code_exec_agent.py58 # Create the Python execution toolSTRING
MEDIUM…pproach/resources/registry/agents/file_access_agent.py16# Create a LanguageModelInterface instance using the OpenAILanguageModelCOMMENT
MEDIUM…ch_api/how_to_build_a_deep_research_mcp_server/main.py93 # Create a snippet from contentSTRING
MEDIUM…ch_api/how_to_build_a_deep_research_mcp_server/main.py189 # Create the MCP serverCOMMENT
MEDIUMexamples/chatgpt/rag-quickstart/azure/function_app.py86 # Create a vectorized queryCOMMENT
AI Slop Vocabulary7 hits · 20 pts
SeverityFileLineSnippetContext
MEDIUM…evals/realtime_evals/run_harness/run_realtime_evals.py578 # Disable turn detection (VAD) for both connections so this harness controls turnCOMMENT
MEDIUM…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py18CRITERIA_ANSWERABLE = """CRITERIA: The answer is completely accurate and comprehensive, extending the ground truth with CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Synthetic Comment Markers3 hits · 18 pts
SeverityFileLineSnippetContext
HIGH…-optimization-cookbook/results_topk_baseline/run_06.py47# Expose result as requestedCOMMENT
HIGHexamples/data/oai_docs/latency-optimization.txt310This opens up the possibility of a trade-off. Do we keep this as a **single request entirely generated by GPT-4**, or **CODE
HIGHexamples/data/oai_docs/text-to-speech.txt157Yes, like with all outputs from our API, the person who created them owns the output. You are still required to inform eCODE
Modern Structural Boilerplate15 hits · 16 pts
SeverityFileLineSnippetContext
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py24__all__ = [CODE
LOWexamples/evals/realtime_evals/shared/result_types.py668 def set_grader_result(self, grader_id: str, grade: int, rationale: str) -> None:CODE
LOW…/case_summary_service/case_summary_service/__init__.py3__all__ = ["summarize_case"]CODE
LOW…support_reply_service/customer_support_bot/__init__.py3__all__ = ["draft_reply"]CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py280__all__ = [CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/utils.py101__all__ = [CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py30logger = logging.getLogger(__name__)CODE
LOW…s/macro_evals_for_agentic_systems/helpers/data_prep.py1467__all__ = [CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py2856__all__ = [CODE
LOW…/temporal_agents_with_knowledge_graphs/db_interface.py401def update_events_batch(conn: sqlite3.Connection, events: list[TemporalEvent]) -> None:CODE
LOW…s/agentic_governance_guide/guardrail_tuner/__init__.py28__all__ = [CODE
LOW…governance_guide/guardrail_tuner/threshold_adjuster.py15logger = logging.getLogger(__name__)CODE
LOW…ntic_governance_guide/guardrail_tuner/feedback_loop.py22logger = logging.getLogger(__name__)CODE
LOW…ch_api/how_to_build_a_deep_research_mcp_server/main.py16logger = logging.getLogger(__name__)CODE
LOW…-optimization-cookbook/results_topk_baseline/run_01.py34__all__ = ['top_k']CODE
Cross-Language Confusion4 hits · 14 pts
SeverityFileLineSnippetContext
HIGH…mples/agents_sdk/deployment_manager/app/trace_store.py108 trace_id text not null,STRING
HIGH…mples/agents_sdk/deployment_manager/app/trace_store.py123 trace_id text not null,STRING
HIGH…mples/agents_sdk/deployment_manager/app/trace_store.py127 event_type text not null,STRING
HIGH…mples/agents_sdk/deployment_manager/app/trace_store.py128 received_at text not null,STRING
Docstring Block Structure2 hits · 10 pts
SeverityFileLineSnippetContext
HIGH…gents_sdk/multi-agent-portfolio-collaboration/tools.py53 Executes a quantitative analysis request using OpenAI's Code Interpreter (cloud). Args: request (str):STRING
HIGH…ch_api/how_to_build_a_deep_research_mcp_server/main.py111 Retrieve complete document content by ID for detailed analysis and citation. This tool fetchesSTRING
Redundant / Tautological Comments6 hits · 9 pts
SeverityFileLineSnippetContext
LOWexamples/vector_databases/redis/nbutils.py44 # Set vector_id to be a stringCOMMENT
LOW…_approach/resources/registry/tools/file_access_tool.py81 # Check if container is runningCOMMENT
LOWexamples/partners/model_selection_guide/tools.py154 # Check if chemical exists in our mock databaseCOMMENT
LOWexamples/partners/model_selection_guide/tools.py280 # Check if any keyword appears in title or abstractCOMMENT
LOW…governance_guide/guardrail_tuner/threshold_adjuster.py165 # Check if we hit boundsCOMMENT
LOWexamples/chatgpt/rag-quickstart/azure/function_app.py17 # Check if text is providedCOMMENT
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Over-Commented Block6 hits · 6 pts
SeverityFileLineSnippetContext
LOW…-portfolio-collaboration/investment_agents/__init__.py1# This file marks the agents directory as a Python package. COMMENT
LOW…rtners/agentic_governance_guide/promptfoo/redteam.yaml1# yaml-language-server: $schema=https://promptfoo.dev/config-schema.jsonCOMMENT
LOW…optimization-cookbook/results_topk_optimized/run_07.py41# Complexity: counting O(N tokens); selection O(U log k) with heap or O(U log U) when sorting; extra space O(U) + O(k)COMMENT
LOW…optimization-cookbook/results_topk_optimized/run_29.py41# Complexity: counting O(N tokens) time, O(U) space; selection O(U log k) via heap for small k or O(U log U) for large kCOMMENT
LOW…optimization-cookbook/results_topk_optimized/run_14.py41# Complexity: counting O(N tokens); selection O(U log k) via heap for k < 0.3U, else O(U log U); extra space O(U) for coCOMMENT
LOW…anslation_guide/livekit-translation-demo/next-env.d.ts1/// <reference types="next" />COMMENT
AI Structural Patterns6 hits · 4 pts
SeverityFileLineSnippetContext
LOWexamples/fine-tuned_qa/answers_with_ft.py46CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py563CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py1163CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py2269CODE
LOW…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py268CODE
LOW…-optimization-cookbook/results_topk_baseline/run_07.py34CODE
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMexamples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Fake / Example Data1 hit · 1 pts
SeverityFileLineSnippetContext
LOW…magegen_evals/generation_harness/run_imagegen_evals.py187- Do not include placeholder or lorem ipsum text.CODE