AI Slop Code RIsk Monitor

openai/openai-cookbook

Examples and guides for using the OpenAI API

11.9 Moderate pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for openai/openai-cookbook, a Jupyter Notebook project with 76,541 GitHub stars. SynthScan examined 251,275 lines of code across 1192 source files, recording 2049 pattern matches distributed across 23 syntactic categories. The legacy adjusted pattern signal is 11.9 (Moderate pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

11.9
Adjusted Signal
11.9
Raw Pattern Score
100%
Time Factor
2026-10-09
Last Push
76.5K
Stars
Jupyter Notebook
Language
251.3K
Lines of Code
1.2K
Files
2.0K
Pattern Hits
2026-10-12
Scan Date
0.11
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 24.9/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 1338 finding(s).

Hallucinated Dependency & Supply Chain Risk 18.3/100 · LOW

Are imports declared and package/API names verified? 439 finding(s).

Agent Over-Engineering Ratio 28.2/100 · MEDIUM

Are wrappers, guards, and repeated structures necessary? 1416 finding(s).

PR Review Velocity Impact 45.7/100 · MEDIUM

Which changes need focused human review? 2049 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 40HIGH 97MEDIUM 89LOW 1823

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 2049 distinct pattern matches across 23 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers1135 hits · 1113 pts
SeverityFileLineSnippetContext
LOWexamples/api_request_parallel_processor.py110async def process_api_requests_from_file(CODE
LOWexamples/api_request_parallel_processor.py387def num_tokens_consumed_from_request(CODE
LOWexamples/api_request_parallel_processor.py446def task_id_generator_function():CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py27def build_generation_judge_content(case: TestCase, output_image: Path) -> list[dict]:CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py40def build_editing_judge_content(case: TestCase, output_image: Path) -> list[dict]:CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py161def build_failed_simulation_result(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py209def build_tool_output_by_call_id(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py221def transcript_lines_for_assistant_turn(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py242def build_simulator_prompt_text(CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py361def apply_turn_level_tool_grades(CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py28def test_crawl_result_csv_row_omits_tool_arg_columns_when_disabled() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py64def test_walk_result_csv_row_omits_all_tool_columns_when_disabled() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py94def test_run_result_csv_row_uses_enabled_grader_union() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py135def test_apply_turn_level_tool_grades_keeps_results_row_local() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py178def test_trace_grade_row_indices_targets_last_row_only() -> None:CODE
LOW…ls/realtime_evals/tests/test_dynamic_result_columns.py183def test_walk_parse_args_does_not_expose_max_output_tokens() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py74def test_check_tool_call_names_correct_matches_expected_set() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py84def test_check_tool_args_correct_normalizes_addresses() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py106def test_check_tool_args_correct_handles_nested_json_arguments() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py142def test_compute_tool_call_grade_uses_deterministic_graders() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py154def test_instruction_following_grader_uses_instruction_prompt_and_schema() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py176def test_audio_text_mismatch_grader_uses_specialized_prompt() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py193def test_stt_then_text_grader_uses_transcript_as_grounding() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py211def test_transcribe_model_response_audio_writes_valid_wav() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py229def test_transcribe_model_response_audio_rejects_missing_audio() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py242def test_audio_text_mismatch_from_model_response_transcribes_then_grades() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py261def test_stt_then_text_from_model_response_transcribes_then_grades() -> None:CODE
LOWexamples/evals/realtime_evals/tests/test_graders.py281def test_run_default_grader_dispatches_named_graders() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py26def test_coerce_float_treats_blank_and_non_numeric_strings_as_missing() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py33def test_clean_path_value_resolves_paths_within_run_directory(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py44def test_clean_path_value_rejects_absolute_and_escaping_paths(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py54def test_input_audio_path_for_row_rejects_example_ids_that_escape_run_directory(CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py68def test_run_viewer_table_key_uses_full_relative_path() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py75def test_build_run_viewer_table_marks_active_row_with_checkbox() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py96def test_display_run_label_uses_leaf_name() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_results_viewer.py100def test_build_summary_table_uses_short_run_label_for_display() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py17def test_crawl_failure_row_serializes_error_info() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py46def test_walk_failure_row_handles_missing_audio_path() -> None:CODE
LOW…amples/evals/realtime_evals/tests/test_failure_rows.py69def test_run_failure_row_uses_turn_zero() -> None:CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py30def test_run_eval_run_summary_coerces_types_and_feeds_results_viewer() -> None:CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py98def test_walk_eval_result_csv_row_uses_repo_absolute_paths_in_results_viewer(CODE
LOW…altime_evals/tests/test_eval_run_type_compatibility.py152def test_run_turn_result_csv_row_is_compatible_with_run_viewer_helpers(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py14def test_harness_results_roots_include_bootstrap_eval_results(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py53def test_discover_result_directories_uses_root_relative_labels(CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py77def test_row_text_value_returns_first_non_empty_candidate() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py91def test_resolve_active_row_index_prefers_navigation_state_until_selection_changes() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py114def test_run_viewer_table_widget_key_changes_when_selection_is_reset() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py130def test_resolve_run_viewer_table_selected_index_prefers_latest_checked_row() -> None:CODE
LOW…/evals/realtime_evals/tests/test_results_viewer_app.py153def test_run_viewer_table_matches_active_row_requires_single_checked_row() -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_plotting_utils.py14def test_build_realtime_eval_plots_writes_expected_files(tmp_path: Path) -> None:CODE
LOW…ples/evals/realtime_evals/tests/test_plotting_utils.py71def test_plot_eval_results_cli_infers_labels(tmp_path: Path) -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py62def test_collect_realtime_response_times_out() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py80def test_collect_realtime_response_raises_on_error_event() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py106def test_collect_realtime_response_requires_completed_status() -> None:CODE
LOW…ls/realtime_evals/tests/test_realtime_harness_utils.py133def test_collect_realtime_response_returns_completed_response() -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py29def test_validate_input_accepts_valid_run_bundle(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py70def test_validate_input_rejects_walk_audio_with_wrong_format(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py91def test_validate_output_accepts_valid_run_output(tmp_path: Path) -> None:CODE
LOW…/evals/realtime_evals/tests/test_validation_scripts.py155def test_validate_output_rejects_missing_run_grade_mean(tmp_path: Path) -> None:CODE
LOWexamples/evals/realtime_evals/shared/plotting_utils.py64def build_realtime_eval_plots(CODE
1075 more matches not shown…
Hallucination Indicators40 hits · 372 pts
SeverityFileLineSnippetContext
CRITICAL…_api/sandboxes/digitalocean/webhook_managed/handler.py32from azure.core.exceptions import StreamConsumedErrorCODE
CRITICALexamples/agents_api/sandboxes/aws/common.py128 async with await client.beta.agents.sessions.events.stream(session_id) as events:CODE
CRITICALexamples/agents_api/apps/data_analyst/README.md200await client.beta.agents.sessions.events.create(STRING
CRITICALexamples/agents_api/apps/data_analyst/agent.py128 session = await self.client.beta.agents.sessions.retrieve(session_id)CODE
CRITICALexamples/agents_api/apps/data_analyst/agent.py129 events = self.client.beta.agents.sessions.stream(CODE
CRITICALexamples/agents_api/apps/data_analyst/agent.py140 events = await self.client.beta.agents.sessions.create(CODE
CRITICALexamples/agents_api/apps/data_analyst/agent.py174 await self.client.beta.agents.sessions.events.create(CODE
CRITICALexamples/agents_api/apps/data_analyst/agent.py224 *(self.client.beta.agents.sessions.delete(sid) for sid in session_ids),COMMENT
CRITICALexamples/agents_api/apps/slack_bot/connections.py76 async for candidate in self.client.beta.agents.vaults.list(limit=100)CODE
CRITICALexamples/agents_api/apps/slack_bot/connections.py88 vault = await self.client.beta.agents.vaults.create(CODE
CRITICALexamples/agents_api/apps/slack_bot/connections.py94 async for item in self.client.beta.agents.vaults.credentials.list(vault.id)CODE
CRITICALexamples/agents_api/apps/slack_bot/connections.py111 await self.client.beta.agents.vaults.credentials.create(CODE
CRITICALexamples/agents_api/apps/slack_bot/connections.py117 await self.client.beta.agents.vaults.credentials.update(CODE
CRITICALexamples/agents_api/apps/slack_bot/README.md231await client.beta.agents.sessions.events.create(STRING
CRITICALexamples/agents_api/apps/slack_bot/README.md291await client.beta.agents.vaults.credentials.create(STRING
CRITICALexamples/agents_api/apps/slack_bot/agent.py87 session = await self.client.beta.agents.sessions.retrieve(CODE
CRITICALexamples/agents_api/apps/slack_bot/agent.py99 session = await self.client.beta.agents.sessions.create(CODE
CRITICAL⚡examples/agents_api/apps/slack_bot/agent.py117 await self.client.beta.agents.sessions.delete(session.id)CODE
CRITICAL⚡examples/agents_api/apps/slack_bot/agent.py127 async with self.client.beta.agents.sessions.stream(CODE
CRITICALexamples/agents_api/apps/slack_bot/agent.py188 await self.client.beta.agents.sessions.events.create(CODE
CRITICAL⚡examples/agents_api/apps/slack_bot/agent.py204 await self.client.beta.agents.sessions.events.create(CODE
CRITICAL⚡examples/agents_api/apps/slack_bot/agent.py213 await self.client.beta.agents.sessions.delete(session_id)CODE
CRITICALexamples/agents_api/apps/sev_bot/README.md68await client.beta.agents.sessions.events.create(CODE
CRITICALexamples/agents_api/apps/sev_bot/agent.py243 session = await self.client.beta.agents.sessions.retrieve(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py261 session = await self.client.beta.agents.sessions.create(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py288 async with self.client.beta.agents.sessions.stream(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py364 session = await self.client.beta.agents.sessions.retrieve(session_id)STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py388 await self.client.beta.agents.sessions.events.create(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py425 session = await self.client.beta.agents.sessions.retrieve(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py435 await self.client.beta.agents.sessions.events.create(STRING
CRITICALexamples/agents_api/apps/sev_bot/agent.py490 await self.client.beta.agents.sessions.events.create(STRING
CRITICAL⚡examples/agents_api/apps/sev_bot/agent.py546 await self.client.beta.agents.sessions.delete(session_id)STRING
CRITICALexamples/agents_api/apps/document_review/README.md204async for subagent in client.beta.agents.sessions.subagents.list(session.id):STRING
CRITICALexamples/agents_api/apps/document_review/README.md205 async for item in client.beta.agents.sessions.subagents.items.list(STRING
CRITICAL⚡examples/agents_api/apps/document_review/agent.py45 async for subagent in client.beta.agents.sessions.subagents.list(session_id)CODE
CRITICAL⚡examples/agents_api/apps/document_review/agent.py50 client.beta.agents.sessions.items.list(session_id, limit=100, order="asc")CODE
CRITICAL⚡examples/agents_api/apps/document_review/agent.py52 else client.beta.agents.sessions.subagents.items.list(CODE
CRITICALexamples/data/oai_docs/tool-code-interpreter.txt277run_steps = client.beta.threads.runs.steps.list(CODE
CRITICALexamples/data/oai_docs/tool-code-interpreter.txt283const runSteps = await openai.beta.threads.runs.steps.list(CODE
CRITICAL…a/oai_docs/function-calling-run-example--streaming.txt99 const stream = this.client.beta.threads.runs.submitToolOutputsStream(CODE
Unused Imports347 hits · 338 pts
SeverityFileLineSnippetContext
LOWexamples/evals/imagegen_evals/vision_harness/io.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py2CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py9CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py10CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py10CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py11CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py12CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py13CODE
LOWexamples/evals/imagegen_evals/vision_harness/graders.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/types.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/runners.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/storage.py1CODE
LOW…amples/evals/imagegen_evals/vision_harness/evaluate.py1CODE
LOWexamples/evals/imagegen_evals/vision_harness/sweeps.py1CODE
LOWexamples/evals/imagegen_evals/shared/rendering.py1CODE
LOWexamples/evals/imagegen_evals/shared/rendering.py5CODE
LOWexamples/evals/imagegen_evals/shared/reporting.py1CODE
LOW…/realtime_evals/shared/scripts/validate_eval_output.py1CODE
LOW…s/realtime_evals/shared/scripts/validate_eval_input.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/config.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/ui.py1CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py1CODE
LOWexamples/vector_databases/redis/nbutils.py4CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py10CODE
LOW…/agents_api/sandboxes/vercel/webhook_managed/client.py10CODE
LOW…agents_api/sandboxes/runloop/webhook_managed/deploy.py10CODE
LOW…gents_api/sandboxes/runloop/webhook_managed/handler.py13CODE
LOW…agents_api/sandboxes/runloop/webhook_managed/client.py10CODE
LOW…_api/sandboxes/digitalocean/webhook_managed/handler.py24CODE
LOW…s_api/sandboxes/digitalocean/webhook_managed/client.py10CODE
LOW…nts_api/sandboxes/cloudflare/webhook_managed/client.py10CODE
LOW…s/agents_api/sandboxes/oci/application_managed/main.py8CODE
LOW…/agents_api/sandboxes/blaxel/webhook_managed/deploy.py10CODE
LOW…agents_api/sandboxes/blaxel/webhook_managed/handler.py14CODE
LOW…/agents_api/sandboxes/blaxel/webhook_managed/client.py10CODE
LOW…agents_api/sandboxes/daytona/webhook_managed/deploy.py10CODE
LOW…gents_api/sandboxes/daytona/webhook_managed/handler.py14CODE
LOW…agents_api/sandboxes/daytona/webhook_managed/client.py10CODE
LOW…agents_api/sandboxes/modal/application_managed/main.py11CODE
LOW…/agents_api/sandboxes/modal/webhook_managed/handler.py12CODE
LOW…s/agents_api/sandboxes/modal/webhook_managed/client.py10CODE
LOW…les/agents_api/sandboxes/e2b/webhook_managed/deploy.py10CODE
LOW…es/agents_api/sandboxes/e2b/webhook_managed/handler.py14CODE
LOW…les/agents_api/sandboxes/e2b/webhook_managed/client.py10CODE
LOWexamples/agents_api/apps/github_issues/agent.py3CODE
LOWexamples/agents_api/apps/github_issues/github.py3CODE
LOWexamples/agents_api/apps/github_issues/main.py14CODE
LOWexamples/agents_api/apps/data_analyst/warehouse.py3CODE
287 more matches not shown…
Cross-Language Confusion34 hits · 216 pts
SeverityFileLineSnippetContext
HIGH⚡…agents_api/sandboxes/runloop/webhook_managed/deploy.py142 "cd /home/user/controller/webhook_managed && exec uv run handler.py"CODE
HIGH⚡…agents_api/sandboxes/runloop/webhook_managed/deploy.py149 "(sudo apt-get update && sudo apt-get install -y libsqlite3-0)"CODE
HIGH⚡…agents_api/sandboxes/runloop/webhook_managed/deploy.py151 "command -v uv || python -m pip install uv",CODE
HIGH…gents_api/sandboxes/runloop/webhook_managed/handler.py119 "sudo install -d -o user -g user /workspace && command -v flock"CODE
HIGH…s/agents_api/sandboxes/oci/application_managed/main.py142 inner_command = "cd /workspace && exec " + shlex.join(CODE
HIGH⚡examples/agents_api/sandboxes/blaxel/sandbox.py13 command = "mkdir -p /workspace && npm install -g @openai/codex@alpha"CODE
HIGH⚡examples/agents_api/sandboxes/blaxel/sandbox.py17 "(command -v codex || npm install -g @openai/codex@alpha) && "CODE
HIGH⚡examples/agents_api/sandboxes/blaxel/sandbox.py18 "(command -v rg || apk add --no-cache ripgrep util-linux)"CODE
HIGH…/agents_api/sandboxes/blaxel/webhook_managed/deploy.py50 "command": "apk add --no-cache python3 py3-pip && python3 -m venv /opt/controller && /opt/controller/bin/pipCODE
HIGH…agents_api/sandboxes/daytona/webhook_managed/deploy.py76 "python -m pip install uv && uv pip install --system -r /app/webhook_managed/handler.py",CODE
HIGH…agents_api/sandboxes/daytona/webhook_managed/deploy.py91 command="cd /app/webhook_managed && python -m uvicorn handler:app --host 0.0.0.0 --port 8000 >> /app/conCODE
HIGH…mples/agents_sdk/deployment_manager/app/trace_store.py108 trace_id text not null,STRING
HIGH⚡…mples/agents_sdk/deployment_manager/app/trace_store.py123 trace_id text not null,STRING
HIGH⚡…mples/agents_sdk/deployment_manager/app/trace_store.py127 event_type text not null,STRING
HIGH⚡…mples/agents_sdk/deployment_manager/app/trace_store.py128 received_at text not null,STRING
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py599 monitor.push("user", array("h", [1_100, 30_000, -30_000, 1_100]).tobytes())CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py600 monitor.push("assistant", array("h", [2_200, 10_000, -10_000]).tobytes())CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py616 monitor.push("user", caller, start_ms=1_000)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py617 monitor.push("assistant", first, start_ms=1_040)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py618 monitor.push("assistant", second, start_ms=1_120)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py632 monitor.push("user", caller, start_ms=1_000)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py635 monitor.push("assistant", late_assistant, start_ms=1_050)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py648 monitor.push("user", caller, start_ms=1_000)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py651 monitor.push("assistant", first, start_ms=1_040)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py652 monitor.push("assistant", second, start_ms=1_120)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py664 monitor.push("user", caller, start_ms=1_000)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py667 monitor.push("assistant", first, start_ms=1_040)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py668 monitor.push("assistant", first, start_ms=1_040)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py669 monitor.push("assistant", overlapping, start_ms=1_050)CODE
HIGH⚡…_evaluation/crawl_harness/tests/test_shared_runtime.py681 monitor.push("user", first, start_ms=2_000)CODE
HIGH…t_evaluation/run_harness/simulation/gpt_live_runner.py924 self.monitor.push("user", caller_pcm, start_ms=start_ms)CODE
HIGH…t_evaluation/run_harness/simulation/gpt_live_runner.py925 self.monitor.push("assistant", assistant_pcm, start_ms=start_ms)CODE
HIGH…_voice_agent_evaluation/shared/single_turn/response.py262 self.audio_monitor.push("assistant", pcm, start_ms=None if contiguous else audio_start_ms)CODE
HIGH…x_voice_agent_evaluation/shared/single_turn/runtime.py154 audio_monitor.push("user", chunk, start_ms=offset_ms)CODE
Excessive Try-Catch Wrapping170 hits · 187 pts
SeverityFileLineSnippetContext
LOWarticles/gpt-oss/run-locally-lmstudio.md120 except Exception as exc:CODE
LOW…als/realtime_evals/crawl_harness/run_realtime_evals.py442 except Exception as exc:CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py880 except Exception as exc:CODE
LOW…vals/realtime_evals/walk_harness/run_realtime_evals.py505 except Exception as exc:CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py350 except Exception as exc:CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py183 except Exception as error:CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py209 except Exception as error:CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py228 except Exception as error:CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py306 except Exception as error:CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py309 except Exception as cleanup_error:CODE
LOW…agents_api/sandboxes/runloop/webhook_managed/deploy.py54 except Exception: # noqa: BLE001 - Retry while the devbox is starting.CODE
LOW…gents_api/sandboxes/runloop/webhook_managed/handler.py166 except Exception as error: # noqa: BLE001 - Keep failed jobs in the retry queue.CODE
LOW…s/agents_api/sandboxes/oci/application_managed/main.py187 except Exception as error:CODE
LOW…pi/sandboxes/aws/application_managed/sandbox_server.py66 except Exception as error:CODE
LOW…es/agents_api/sandboxes/aws/webhook_managed/handler.py64 except Exception:CODE
LOW…es/agents_api/sandboxes/aws/webhook_managed/handler.py104 except Exception as error:CODE
MEDIUM…es/agents_api/sandboxes/aws/webhook_managed/handler.py18def reconcile(client, microvms, session_id):CODE
LOW…agents_api/sandboxes/blaxel/webhook_managed/handler.py57 except Exception as error:CODE
LOW…agents_api/sandboxes/blaxel/webhook_managed/handler.py104 except Exception as error:CODE
LOW…gents_api/sandboxes/daytona/webhook_managed/handler.py119 except Exception as error:CODE
LOW…agents_api/sandboxes/modal/application_managed/main.py151 except Exception as error:CODE
LOW…agents_api/sandboxes/modal/application_managed/main.py169 except Exception as error:CODE
LOW…es/agents_api/sandboxes/e2b/webhook_managed/handler.py112 except Exception as error:CODE
LOWexamples/agents_api/apps/github_issues/agent.py110 except Exception as error:STRING
LOWexamples/agents_api/apps/github_issues/agent.py116 except Exception as error:STRING
LOWexamples/agents_api/apps/data_analyst/agent.py172 except Exception:CODE
LOW⚡examples/agents_api/apps/slack_bot/agent.py118 except Exception as cleanup_error:CODE
LOW⚡examples/agents_api/apps/slack_bot/agent.py216 except Exception as error:CODE
LOWexamples/agents_api/apps/slack_bot/agent.py229 except Exception as error:CODE
LOWexamples/agents_api/apps/slack_bot/main.py97 except Exception:CODE
LOWexamples/agents_api/apps/sev_bot/agent.py218 except Exception as error:CODE
LOWexamples/agents_api/apps/sev_bot/agent.py463 except Exception:STRING
LOW⚡examples/agents_api/apps/sev_bot/agent.py550 except Exception as error:STRING
LOW⚡examples/agents_api/apps/sev_bot/agent.py560 except Exception as error:STRING
LOWexamples/agents_api/apps/sev_bot/agent.py580 except Exception as error:STRING
LOWexamples/agents_api/apps/document_review/agent.py275 except Exception as error:STRING
LOWexamples/agents_api/apps/document_review/agent.py282 except Exception as error:STRING
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py27 except Exception:CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py108 except Exception:CODE
LOW…ager/runtime/trace_capture/agents_sdk_trace_capture.py117 except Exception:CODE
LOW…loyment_manager/runtime/trace_capture/sitecustomize.py5except Exception:CODE
LOWexamples/agents_sdk/sandboxed-code-migration/evals.py138 except Exception as exc:CODE
LOW…dk/sandboxed-code-migration/src/run_migration_agent.py171 except Exception as exc:CODE
LOW…dk/sandboxed-code-migration/src/run_migration_agent.py198 except Exception as exc:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py185 except Exception as e:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py192 except Exception as e:CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py262 except Exception as e:CODE
LOW⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py69 except Exception:CODE
LOW⚡…nt-portfolio-collaboration/mcp/yahoo_finance_server.py177 except Exception as e:CODE
LOW⚡…nt-portfolio-collaboration/mcp/yahoo_finance_server.py189 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py145 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py226 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py234 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py261 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py309 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py357 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py389 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py429 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py463 except Exception as e:CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py480 except Exception as e:CODE
110 more matches not shown…
Decorative Section Separators37 hits · 142 pts
SeverityFileLineSnippetContext
MEDIUMexamples/codex/secure_quality_gitlab.md241# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md243# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md415# ---------------------------COMMENT
MEDIUMexamples/codex/secure_quality_gitlab.md417# ---------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py1# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py3# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py12# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py14# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py21# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py23# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py28# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py30# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py37# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/tools.py39# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py239 # ------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/tools.py241 # ------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py10# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py12# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py20# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py22# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py38# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py40# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py52# ---------------------------------------------------------------------------COMMENT
MEDIUM…gents_sdk/multi-agent-portfolio-collaboration/utils.py54# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py72# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…gents_sdk/multi-agent-portfolio-collaboration/utils.py74# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…nt-portfolio-collaboration/mcp/yahoo_finance_server.py32# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…nt-portfolio-collaboration/mcp/yahoo_finance_server.py34# ---------------------------------------------------------------------------COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py208# ======================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py210# ======================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py278# =====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py280# =====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py356# ====================COMMENT
MEDIUM…/temporal_agents_with_knowledge_graphs/db_interface.py358# ====================COMMENT
MEDIUM⚡…rtners/agentic_governance_guide/promptfoo/redteam.yaml2# ===================================================================COMMENT
MEDIUM⚡…rtners/agentic_governance_guide/promptfoo/redteam.yaml4# ===================================================================COMMENT
MEDIUM⚡…rtners/agentic_governance_guide/promptfoo/redteam.yaml12# ===================================================================COMMENT
Empty Error Handlers26 hits · 130 pts
SeverityFileLineSnippetContext
HIGH…agents_api/sandboxes/daytona/webhook_managed/deploy.py83except DaytonaNotFoundError:CODE
HIGHexamples/agents_api/apps/github_issues/agent.py108except docker.errors.NotFound:CODE
HIGHexamples/agents_api/apps/github_issues/agent.py114except NotFoundError:CODE
HIGHexamples/agents_api/apps/slack_bot/agent.py214except NotFoundError:CODE
HIGHexamples/agents_api/apps/slack_bot/agent.py227except docker.errors.NotFound:CODE
HIGHexamples/agents_api/apps/document_review/agent.py273except ContainerNotFound:CODE
HIGHexamples/agents_api/apps/document_review/agent.py280except NotFoundError:CODE
HIGHexamples/agents_sdk/security_review_helpers.py204except OSError:CODE
HIGHexamples/agents_sdk/security_review_helpers.py452except subprocess.TimeoutExpired:CODE
HIGHexamples/agents_sdk/deployment_manager/app/runner.py148except (FileNotFoundError, subprocess.TimeoutExpired):CODE
HIGHexamples/agents_sdk/deployment_manager/app/runner.py374except ProcessLookupError:CODE
HIGH…loyment_manager/runtime/trace_capture/sitecustomize.py5except Exception:CODE
HIGH…/agents_sdk/deployment_manager/scripts/local_deploy.py187except (urllib.error.URLError, TimeoutError, http.client.HTTPException, OSError):CODE
HIGH…ex_voice_agent_evaluation/crawl_harness/audio_cache.py65except (EOFError, ValueError, wave.Error):CODE
HIGH…ice_agent_evaluation/shared/observability/redaction.py111except (ValueError, RecursionError):CODE
HIGHexamples/partners/model_selection_guide/agent_utils.py175except json.JSONDecodeError:CODE
HIGH…s_agentcore_cookbook/runtime-agent/notebook_helpers.py295except (urllib.error.URLError, TimeoutError):CODE
HIGH…ore_payments/src/agentic_commerce/agentcore_session.py217except AgentCorePaymentError:CODE
HIGH…ore_payments/src/agentic_commerce/agentcore_session.py203except OSError:CODE
HIGH…pt-optimization-cookbook/scripts/results_summarizer.py164except Exception:CODE
HIGH…pt-optimization-cookbook/scripts/results_summarizer.py241except Exception:CODE
HIGH…pt-optimization-cookbook/scripts/results_summarizer.py246except Exception:CODE
HIGH…pt-5/prompt-optimization-cookbook/scripts/topk_eval.py142except Exception:CODE
HIGH…pt-5/prompt-optimization-cookbook/scripts/topk_eval.py162except Exception:CODE
HIGH…pt-5/prompt-optimization-cookbook/scripts/topk_eval.py107except Exception:CODE
HIGH…pt-5/prompt-optimization-cookbook/scripts/topk_eval.py220except Exception:CODE
Deep Nesting103 hits · 99 pts
SeverityFileLineSnippetContext
LOWexamples/api_request_parallel_processor.py110CODE
LOWexamples/api_request_parallel_processor.py387CODE
LOW…amples/evals/imagegen_evals/vision_harness/evaluate.py17CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py459CODE
LOW…evals/realtime_evals/run_harness/run_realtime_evals.py850CODE
LOW…/evals/realtime_evals/shared/realtime_harness_utils.py124CODE
LOWexamples/evals/realtime_evals/shared/graders.py273CODE
LOW…strap-realtime-eval/scripts/bootstrap_realtime_eval.py242CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py425CODE
LOWexamples/evals/realtime_evals/results_viewer/app.py1157CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py63CODE
LOW…gents_api/sandboxes/docker/application_managed/main.py330CODE
LOW…gents_api/sandboxes/runloop/webhook_managed/handler.py76CODE
LOW…_api/sandboxes/digitalocean/webhook_managed/handler.py69CODE
LOW…mples/agents_api/sandboxes/aws/webhook_managed/main.py33CODE
LOW…agents_api/sandboxes/modal/application_managed/main.py47CODE
LOW…agents_api/sandboxes/modal/application_managed/main.py237CODE
LOWexamples/agents_api/apps/data_analyst/agent.py93CODE
LOWexamples/agents_api/apps/data_analyst/agent.py219CODE
LOWexamples/agents_api/apps/slack_bot/agent.py134CODE
LOWexamples/agents_api/apps/slack_bot/agent.py208CODE
LOWexamples/agents_api/apps/sev_bot/agent.py304CODE
LOWexamples/agents_api/apps/sev_bot/agent.py353CODE
LOWexamples/agents_api/apps/document_review/agent.py106CODE
LOWexamples/agents_sdk/security_review_helpers.py316CODE
LOWexamples/agents_sdk/security_review_helpers.py414CODE
LOWexamples/agents_sdk/security_review_helpers.py534CODE
LOWexamples/agents_sdk/security_review_helpers.py1001CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py84CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py186CODE
LOWexamples/agents_sdk/deployment_manager/app/timeline.py478CODE
LOW…mples/agents_sdk/deployment_manager/app/trace_store.py367CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py52CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py159CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py265CODE
LOW…nt-portfolio-collaboration/mcp/yahoo_finance_server.py313CODE
LOW…opilot-with-agent-sdk-and-databricks-mcp/api_server.py92CODE
LOW…oice_agent_evaluation/assistants/frontend/assistant.py98CODE
LOW…oice_agent_evaluation/assistants/frontend/assistant.py183CODE
LOW…valuation/assistants/tests/test_restaurant_baseline.py279CODE
LOW…ex_voice_agent_evaluation/assistants/client/service.py100CODE
LOW…agent_evaluation/assistants/client/service_protocol.py55CODE
LOW…uplex_voice_agent_evaluation/crawl_harness/evaluate.py386CODE
LOW…evaluation/crawl_harness/tests/test_readme_contract.py147CODE
LOW…luation/crawl_harness/tests/test_response_collector.py46CODE
LOW…valuation/crawl_harness/tests/test_restaurant_crawl.py234CODE
LOW…ation/crawl_harness/tests/test_harness_independence.py22CODE
LOW…_evaluation/run_harness/visualization/export_viewer.py163CODE
LOW…_evaluation/run_harness/visualization/export_viewer.py293CODE
LOW…nt_evaluation/run_harness/visualization/delegations.py99CODE
LOW…t_evaluation/run_harness/simulation/gpt_live_runner.py346CODE
LOW…t_evaluation/run_harness/simulation/gpt_live_runner.py732CODE
LOW…t_evaluation/run_harness/simulation/gpt_live_runner.py812CODE
LOW…x_voice_agent_evaluation/shared/metrics/interaction.py312CODE
LOW…x_voice_agent_evaluation/shared/metrics/interaction.py426CODE
LOW…x_voice_agent_evaluation/shared/metrics/interaction.py523CODE
LOW…duplex_voice_agent_evaluation/shared/metrics/tokens.py91CODE
LOW…_voice_agent_evaluation/shared/single_turn/response.py396CODE
LOW…x_voice_agent_evaluation/shared/single_turn/runtime.py235CODE
LOW…ice_agent_evaluation/shared/observability/redaction.py91CODE
43 more matches not shown…
Magic Placeholder Names17 hits · 90 pts
SeverityFileLineSnippetContext
HIGHexamples/evals/imagegen_evals/README.md20export OPENAI_API_KEY="your_api_key"CODE
HIGHexamples/evals/realtime_evals/README.md19export OPENAI_API_KEY="your_api_key"CODE
HIGH…strap-realtime-eval/scripts/bootstrap_realtime_eval.py663export OPENAI_API_KEY="your_api_key"CODE
HIGH…/partners/harness_aware_plugin_evals/notebook_setup.py14PLACEHOLDERS = ("", "your-api-key")CODE
HIGH⚡examples/data/oai_docs/curl-setup.txt263. **Add environment variable**: In the editor, add the line below, replacing `your-api-key-here` with your actual API kCODE
HIGH⚡examples/data/oai_docs/curl-setup.txt29export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/curl-setup.txt442. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/curl-setup.txt47setx OPENAI_API_KEY "your-api-key-here"CODE
HIGHexamples/data/oai_docs/python-setup.txt723. **Add Environment Variable**: In the editor, add the line below, replacing `your-api-key-here` with your actual API kCODE
HIGHexamples/data/oai_docs/python-setup.txt75export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/python-setup.txt942. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/python-setup.txt97setx OPENAI_API_KEY "your-api-key-here"CODE
HIGHexamples/data/oai_docs/node-setup.txt373. **Add Environment Variable**: In the editor, ensure you have set your API key as shown below, replacing `your-api-keyCODE
HIGHexamples/data/oai_docs/node-setup.txt40export OPENAI_API_KEY='your-api-key-here'CODE
HIGHexamples/data/oai_docs/node-setup.txt552. **Set environment variable in the current session**: To set the environment variable in the current session, use the CODE
HIGHexamples/data/oai_docs/node-setup.txt58setx OPENAI_API_KEY "your-api-key-here"CODE
HIGH…tions/one_way_translation_using_realtime_api/README.md24 REACT_APP_OPENAI_API_KEY=<your_api_key>CODE
Cross-File Repetition12 hits · 60 pts
SeverityFileLineSnippetContext
HIGH…gents_api/sandboxes/vercel/application_managed/main.py0run an agents api task in a daytona sandbox and clean up both resources.STRING
HIGH…api/sandboxes/digitalocean/application_managed/main.py0run an agents api task in a daytona sandbox and clean up both resources.STRING
HIGH…gents_api/sandboxes/blaxel/application_managed/main.py0run an agents api task in a daytona sandbox and clean up both resources.STRING
HIGH…ents_api/sandboxes/daytona/application_managed/main.py0run an agents api task in a daytona sandbox and clean up both resources.STRING
HIGH…/agents_api/sandboxes/vercel/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…agents_api/sandboxes/runloop/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…s_api/sandboxes/digitalocean/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…nts_api/sandboxes/cloudflare/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…/agents_api/sandboxes/blaxel/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…agents_api/sandboxes/daytona/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…s/agents_api/sandboxes/modal/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
HIGH…les/agents_api/sandboxes/e2b/webhook_managed/client.py0use agents api without importing a sandbox provider sdk.STRING
Modern AI Meta-Vocabulary20 hits · 59 pts
SeverityFileLineSnippetContext
MEDIUMarticles/how_to_work_with_large_language_models.md94### Demonstration prompt example (few-shot learning)COMMENT
MEDIUMarticles/openai-harmony.md194The `final` channel will contain the answer to your user’s request. Check out the [reasoning section](#reasoning) for moCODE
MEDIUMarticles/techniques_to_improve_reliability.md305## Extensions to chain-of-thought promptingCOMMENT
MEDIUMarticles/techniques_to_improve_reliability.md534#### Fine-tuned chain of thought prompting / Self-taught reasonerCOMMENT
MEDIUMarticles/gpt-oss/handle-raw-cot.md1# How to handle the raw chain of thought in gpt-ossCOMMENT
MEDIUMexamples/vector_databases/cassandra_astradb/README.md1# RAG with Astra DB and CassandraCOMMENT
MEDIUMexamples/vector_databases/elasticsearch/README.md25### [Retrieval augmented generation](https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/elastCOMMENT
MEDIUMexamples/agents_api/apps/document_review/README.md69### 1. Create a multi-agent review sessionCOMMENT
MEDIUMexamples/codex/code_modernization.md209# Test scaffoldingCOMMENT
MEDIUM…les/agents_sdk/migrate-from-claude-agent-sdk/README.md523### Step 5: Choose multi-agent ownershipCOMMENT
MEDIUM…agentic_governance_guide/promptfoo/promptfoo_target.py98# ---------- Centralized guardrails config ----------COMMENT
MEDIUM…ntic_governance_guide/guardrail_tuner/feedback_loop.py257 # Load config and identify tunable guardrailsCOMMENT
MEDIUM…ntic_governance_guide/guardrail_tuner/feedback_loop.py278 # Initialize states for all tunable guardrailsCOMMENT
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUMexamples/data/oai_docs/fine-tuning.txt775### When should I use fine-tuning vs embeddings / retrieval augmented generation?COMMENT
MEDIUMexamples/data/oai_docs/optimizing-llm-accuracy.txt170### Retrieval-augmented generation (RAG)COMMENT
MEDIUMexamples/data/oai_docs/optimizing-llm-accuracy.txt259#### RAG + Fine-tuningCOMMENT
Structural Annotation Overuse33 hits · 52 pts
SeverityFileLineSnippetContext
LOWexamples/codex/secure_quality_gitlab.md179### Step 1: Generating RecommendationsCOMMENT
LOWexamples/codex/secure_quality_gitlab.md367### Step 2: Remediating Security Issues Based on RecommendationsCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md396### Step 1: Define the first OpenAI agentCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md405### Step 2: Port custom toolsCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md418### Step 3: Map built-in tools by execution boundaryCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md435### Step 4: Move validation to the right guardrail boundaryCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md523### Step 5: Choose multi-agent ownershipCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md586### Step 6: Choose one conversation-state strategyCOMMENT
LOW…les/agents_sdk/migrate-from-claude-agent-sdk/README.md597### Step 7: Add approvals for side effects with human reviewCOMMENT
LOWexamples/data/oai_docs/curl-setup.txt4## Step 1: Set up curlCOMMENT
LOW⚡examples/data/oai_docs/curl-setup.txt17## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/curl-setup.txt67## Step 3: Sending your first API requestCOMMENT
LOWexamples/data/oai_docs/function-calling.txt85 # Step 1: send the conversation and available functions to the modelCOMMENT
LOW⚡examples/data/oai_docs/function-calling.txt115 # Step 2: check if the model wanted to call a functionCOMMENT
LOW⚡examples/data/oai_docs/function-calling.txt117 # Step 3: call the functionCOMMENT
LOW⚡examples/data/oai_docs/function-calling.txt123 # Step 4: send the info for each function call and function response to the modelCOMMENT
LOWexamples/data/oai_docs/function-calling.txt165 // Step 1: send the conversation and available functions to the modelCOMMENT
LOWexamples/data/oai_docs/function-calling.txt197 // Step 2: check if the model wanted to call a functionCOMMENT
LOWexamples/data/oai_docs/function-calling.txt200 // Step 3: call the functionCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt17### Step 1: Define functionsCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt125### Step 2: Create a Thread and add MessagesCOMMENT
LOWexamples/data/oai_docs/tool-function-calling.txt150### Step 3: Initiate a RunCOMMENT
LOWexamples/data/oai_docs/python-setup.txt4## Step 1: Setting up PythonCOMMENT
LOWexamples/data/oai_docs/python-setup.txt57## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/python-setup.txt156## Step 3: Sending your first API requestCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt12### Step 1: Create a new Assistant with File Search EnabledCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt60### Step 2: Upload files and add them to a Vector StoreCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt103### Step 3: Update the assistant to to use the new Vector StoreCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt124### Step 4: Create a threadCOMMENT
LOWexamples/data/oai_docs/tool-file-search.txt181### Step 5: Create a run and check the outputCOMMENT
LOWexamples/data/oai_docs/node-setup.txt4## Step 1: Setting up NodeCOMMENT
LOWexamples/data/oai_docs/node-setup.txt26## Step 2: Set up your API keyCOMMENT
LOWexamples/data/oai_docs/node-setup.txt77## Step 3: Sending your first API requestCOMMENT
Modern Structural Boilerplate27 hits · 28 pts
SeverityFileLineSnippetContext
LOW…amples/evals/imagegen_evals/vision_harness/__init__.py24__all__ = [CODE
LOWexamples/evals/realtime_evals/shared/result_types.py668 def set_grader_result(self, grader_id: str, grade: int, rationale: str) -> None:CODE
LOWexamples/agents_api/apps/slack_bot/main.py84 async def update_progress(message: str) -> None:CODE
LOWexamples/agents_api/apps/sev_bot/alerts.py14logger = logging.getLogger(__name__)CODE
LOWexamples/agents_api/apps/sev_bot/agent.py29logger = logging.getLogger(__name__)CODE
LOWexamples/agents_api/apps/document_review/agent.py20logger = logging.getLogger(__name__)CODE
LOW…/case_summary_service/case_summary_service/__init__.py3__all__ = ["summarize_case"]CODE
LOW…support_reply_service/customer_support_bot/__init__.py3__all__ = ["draft_reply"]CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/tools.py280__all__ = [CODE
LOW…gents_sdk/multi-agent-portfolio-collaboration/utils.py101__all__ = [CODE
LOW⚡…nt-portfolio-collaboration/mcp/yahoo_finance_server.py30logger = logging.getLogger(__name__)CODE
LOW…o/duplex_voice_agent_evaluation/assistants/__init__.py35__all__ = [CODE
LOW…oice_agent_evaluation/assistants/responses/__init__.py5__all__ = ["ResponsesManagedAssistant"]CODE
LOW…x_voice_agent_evaluation/assistants/client/__init__.py5__all__ = ["ClientDelegatedAssistant"]CODE
LOW…t_evaluation/run_harness/simulation/gpt_live_runner.py1164__all__ = ["DualGptLiveRunner"]CODE
LOW…oice_agent_evaluation/run_harness/simulation/models.py70__all__ = [CODE
LOW…uation/run_harness/simulation/gpt_live_participants.py230 def set_speech_activity(self, speaking: bool) -> None:CODE
LOW…/duplex_voice_agent_evaluation/shared/audio/effects.py505__all__ = [CODE
LOW…s/macro_evals_for_agentic_systems/helpers/data_prep.py1467__all__ = [CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py2856__all__ = [CODE
LOW…/temporal_agents_with_knowledge_graphs/db_interface.py401def update_events_batch(conn: sqlite3.Connection, events: list[TemporalEvent]) -> None:CODE
LOW…th_agentcore_payments/src/agentic_commerce/__init__.py15__all__ = [CODE
LOW…s/agentic_governance_guide/guardrail_tuner/__init__.py28__all__ = [CODE
LOW…governance_guide/guardrail_tuner/threshold_adjuster.py15logger = logging.getLogger(__name__)CODE
LOW…ntic_governance_guide/guardrail_tuner/feedback_loop.py22logger = logging.getLogger(__name__)CODE
LOW…ch_api/how_to_build_a_deep_research_mcp_server/main.py16logger = logging.getLogger(__name__)CODE
LOW…-optimization-cookbook/results_topk_baseline/run_01.py34__all__ = ['top_k']CODE
Synthetic Comment Markers5 hits · 28 pts
SeverityFileLineSnippetContext
HIGH…/agents_api/sandboxes/vercel/webhook_managed/README.md25- `OPENAI_WEBHOOK_SECRET`: generated by OpenAI when registering the endpoint.CODE
HIGH…s_api/sandboxes/digitalocean/webhook_managed/README.md57- `OPENAI_WEBHOOK_SECRET`: generated by OpenAI when registering the endpoint.CODE
HIGH…-optimization-cookbook/results_topk_baseline/run_06.py47# Expose result as requestedCOMMENT
HIGHexamples/data/oai_docs/latency-optimization.txt310This opens up the possibility of a trade-off. Do we keep this as a **single request entirely generated by GPT-4**, or **CODE
HIGHexamples/data/oai_docs/text-to-speech.txt157Yes, like with all outputs from our API, the person who created them owns the output. You are still required to inform eCODE
Self-Referential Comments8 hits · 20 pts
SeverityFileLineSnippetContext
MEDIUMregistry.yaml3# This file is used to generate cookbook.openai.com. It specifies which paths weCOMMENT
MEDIUM…roach/resources/object_oriented_agents/utils/logger.py14 # Create a console handlerCOMMENT
MEDIUM…ch/resources/registry/agents/python_code_exec_agent.py16# Create a LanguageModelInterface instance using the OpenAILanguageModelCOMMENT
MEDIUM…ch/resources/registry/agents/python_code_exec_agent.py58 # Create the Python execution toolSTRING
MEDIUM…pproach/resources/registry/agents/file_access_agent.py16# Create a LanguageModelInterface instance using the OpenAILanguageModelCOMMENT
MEDIUM…ch_api/how_to_build_a_deep_research_mcp_server/main.py93 # Create a snippet from contentSTRING
MEDIUM…ch_api/how_to_build_a_deep_research_mcp_server/main.py189 # Create the MCP serverCOMMENT
MEDIUMexamples/chatgpt/rag-quickstart/azure/function_app.py86 # Create a vectorized queryCOMMENT
AI Slop Vocabulary7 hits · 20 pts
SeverityFileLineSnippetContext
MEDIUM…evals/realtime_evals/run_harness/run_realtime_evals.py578 # Disable turn detection (VAD) for both connections so this harness controls turnCOMMENT
MEDIUM…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py18CRITERIA_ANSWERABLE = """CRITERIA: The answer is completely accurate and comprehensive, extending the ground truth with CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Docstring Block Structure2 hits · 10 pts
SeverityFileLineSnippetContext
HIGH…gents_sdk/multi-agent-portfolio-collaboration/tools.py53 Executes a quantitative analysis request using OpenAI's Code Interpreter (cloud). Args: request (str):STRING
HIGH…ch_api/how_to_build_a_deep_research_mcp_server/main.py111 Retrieve complete document content by ID for detailed analysis and citation. This tool fetchesSTRING
Redundant / Tautological Comments6 hits · 9 pts
SeverityFileLineSnippetContext
LOWexamples/vector_databases/redis/nbutils.py44 # Set vector_id to be a stringCOMMENT
LOW…_approach/resources/registry/tools/file_access_tool.py81 # Check if container is runningCOMMENT
LOWexamples/partners/model_selection_guide/tools.py154 # Check if chemical exists in our mock databaseCOMMENT
LOWexamples/partners/model_selection_guide/tools.py280 # Check if any keyword appears in title or abstractCOMMENT
LOW…governance_guide/guardrail_tuner/threshold_adjuster.py165 # Check if we hit boundsCOMMENT
LOWexamples/chatgpt/rag-quickstart/azure/function_app.py17 # Check if text is providedCOMMENT
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGH⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Over-Commented Block7 hits · 7 pts
SeverityFileLineSnippetContext
LOWexamples/agents_api/apps/sev_bot/main.py1# /// scriptCOMMENT
LOW…-portfolio-collaboration/investment_agents/__init__.py1# This file marks the agents directory as a Python package. COMMENT
LOW…rtners/agentic_governance_guide/promptfoo/redteam.yaml1# yaml-language-server: $schema=https://promptfoo.dev/config-schema.jsonCOMMENT
LOW…optimization-cookbook/results_topk_optimized/run_07.py41# Complexity: counting O(N tokens); selection O(U log k) with heap or O(U log U) when sorting; extra space O(U) + O(k)COMMENT
LOW…optimization-cookbook/results_topk_optimized/run_29.py41# Complexity: counting O(N tokens) time, O(U) space; selection O(U log k) via heap for small k or O(U log U) for large kCOMMENT
LOW…optimization-cookbook/results_topk_optimized/run_14.py41# Complexity: counting O(N tokens); selection O(U log k) via heap for k < 0.3U, else O(U log U); extra space O(U) for coCOMMENT
LOW…anslation_guide/livekit-translation-demo/next-env.d.ts1/// <reference types="next" />COMMENT
AI Structural Patterns9 hits · 7 pts
SeverityFileLineSnippetContext
LOWexamples/fine-tuned_qa/answers_with_ft.py46CODE
LOW…t_evaluation/run_harness/simulation/gpt_live_runner.py56CODE
LOW…uplex_voice_agent_evaluation/shared/grading/scoring.py281CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py563CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py1163CODE
LOW…als_for_agentic_systems/helpers/macro_eval_pipeline.py2269CODE
LOW…th_agentcore_payments/tests/test_agentcore_payments.py31CODE
LOW…s/gpt-5/prompt-optimization-cookbook/run_FailSafeQA.py268CODE
LOW…-optimization-cookbook/results_topk_baseline/run_07.py34CODE
Slop Phrases2 hits · 5 pts
SeverityFileLineSnippetContext
MEDIUM…tners/harness_aware_plugin_evals/tests/test_grading.py45 answer = "Sorry, I cannot provide that data."CODE
MEDIUM⚡examples/data/parsed_pdf_docs.json1[{"filename": "rag-deck.pdf", "text": "RAG\nTechnique\n\nFebruary 2024\n\n\fOverview\n\nRetrieval-Augmented Generation \CODE
Fake / Example Data1 hit · 1 pts
SeverityFileLineSnippetContext
LOW…magegen_evals/generation_harness/run_imagegen_evals.py187- Do not include placeholder or lorem ipsum text.CODE