Repository Analysis

openai/gpt-oss

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

6.3 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of openai/gpt-oss, a Python project with 20,221 GitHub stars. SynthScan v2.0 examined 25,079 lines of code across 122 source files, recording 150 pattern matches distributed across 12 syntactic categories. The overall adjusted score of 6.3 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

6.3
Adjusted Score
6.3
Raw Score
100%
Time Factor
2026-06-09
Last Push
20.2K
Stars
Python
Language
25.1K
Lines of Code
122
Files
150
Pattern Hits
2026-07-14
Scan Date
0.00
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 0MEDIUM 7LOW 143

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 150 distinct pattern matches across 12 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers36 hits · 38 pts
SeverityFileLineSnippetContext
LOWgpt_oss/evals/gpqa_eval.py28def format_multichoice_question(row):STRING
LOWgpt_oss/evals/healthbench_eval.py213def _aggregate_get_clipped_mean(CODE
LOWgpt_oss/evals/healthbench_eval.py535def physician_completions_main(CODE
LOWgpt_oss/tools/tool.py13def _maybe_update_inplace_and_validate_channel(CODE
LOWgpt_oss/tools/tool.py46 def output_channel_should_match_input_channel(self) -> bool:CODE
LOWgpt_oss/tools/python_docker/docker_tool.py82def call_python_script_with_uv(script: str) -> str:CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py60def function_the_model_can_call(CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py78def _tiktoken_vocabulary_lengths(enc_name: str) -> list[int]:CODE
LOWgpt_oss/tools/simple_browser/page_contents.py93def _tiktoken_vocabulary_lengths(enc_name: str) -> list[int]:CODE
LOWgpt_oss/triton/model.py39 def _compute_concentration_and_inv_freq(self) -> torch.Tensor:CODE
LOWgpt_oss/torch/model.py85 def _compute_concentration_and_inv_freq(self) -> torch.Tensor:CODE
LOWgpt_oss/responses_api/api_server.py452 def _resolve_browser_recipient(CODE
LOWgpt_oss/responses_api/api_server.py478 def _ensure_reasoning_item_id(self) -> str:CODE
LOWtests/test_api_endpoints.py10 def test_basic_response_creation(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py18 def test_response_with_high_reasoning(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py26 def test_response_with_medium_reasoning(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py34 def test_response_with_invalid_model(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py40 def test_response_with_empty_input(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py54 def test_response_with_custom_temperature(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py77 def test_response_with_session_id(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py95 def test_response_continuation(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py114 def test_missing_required_fields(self, api_client):CODE
LOWtests/test_api_endpoints.py119 def test_invalid_reasoning_effort(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py133 def test_extremely_long_input(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py151 def test_function_tool_integration(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py181 def test_response_time_under_threshold(self, api_client, sample_request_data, performance_timer):CODE
LOWtests/test_api_endpoints.py190 def test_multiple_sequential_requests(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py201 def test_usage_object_structure(self, api_client, sample_request_data):CODE
LOWtests/test_api_endpoints.py219 def test_usage_increases_with_longer_input(self, api_client, sample_request_data):CODE
LOWtests/gpt_oss/tools/simple_browser/test_backend.py34async def test_youcom_backend_search(mock_session_get):CODE
LOWtests/gpt_oss/tools/simple_browser/test_backend.py57async def test_youcom_backend_fetch(mock_session_get):CODE
LOW_build/gpt_oss_build_backend/backend.py73def prepare_metadata_for_build_wheel(CODE
LOW_build/gpt_oss_build_backend/backend.py100def get_requires_for_build_wheel(CODE
LOW_build/gpt_oss_build_backend/backend.py115def get_requires_for_build_sdist(CODE
LOW_build/gpt_oss_build_backend/backend.py126def get_requires_for_build_editable(CODE
LOWgpt-oss-mcp-server/build-system-prompt.py55def post_process_tools_description(CODE
Excessive Try-Catch Wrapping27 hits · 29 pts
SeverityFileLineSnippetContext
LOWgpt_oss/chat.py205 except Exception as e:CODE
LOWgpt_oss/chat.py211 except Exception as e:CODE
LOWgpt_oss/evals/responses_sampler.py77 except Exception as e:CODE
LOWgpt_oss/evals/chat_completions_sampler.py85 except Exception as e:CODE
LOWgpt_oss/evals/__main__.py197 except Exception as e:CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py84 except Exception as e:CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py441 except Exception as e:CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py472 except Exception as e:CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py653 except Exception:CODE
MEDIUMgpt_oss/tools/simple_browser/simple_browser_tool.py650def extract_domain(url):CODE
LOWgpt_oss/tools/simple_browser/backend.py40except Exception:CODE
LOWgpt_oss/tools/simple_browser/page_contents.py149 except Exception:CODE
LOWgpt_oss/responses_api/api_server.py113 except Exception as body_exc:CODE
LOWgpt_oss/responses_api/api_server.py145 except Exception as e:CODE
MEDIUMgpt_oss/responses_api/api_server.py146 print(f"Error parsing tokens: {e}")CODE
LOWgpt_oss/responses_api/api_server.py229 except Exception as e:CODE
MEDIUMgpt_oss/responses_api/api_server.py230 print(f"Error processing browser tool arguments: {e}")CODE
LOWgpt_oss/responses_api/api_server.py351 except Exception:CODE
LOWgpt_oss/responses_api/api_server.py355 except Exception:CODE
LOWgpt_oss/responses_api/api_server.py359 except Exception:CODE
LOWgpt_oss/responses_api/api_server.py552 except Exception:CODE
LOWgpt_oss/responses_api/inference/ollama.py111 except Exception as e:CODE
LOWexamples/streamlit/streamlit_chat.py148 except Exception:STRING
LOWexamples/streamlit/streamlit_chat.py246 except Exception:STRING
LOWexamples/streamlit/streamlit_chat.py261 except Exception:STRING
LOWexamples/gradio/gradio_chat.py104 except Exception:STRING
LOWexamples/gradio/gradio_chat.py173 except Exception as e:STRING
Unused Imports29 hits · 28 pts
SeverityFileLineSnippetContext
LOWgpt_oss/evals/types.py2CODE
LOWgpt_oss/evals/types.py2CODE
LOWgpt_oss/tools/apply_patch.py10CODE
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py8CODE
LOWgpt_oss/tools/simple_browser/backend.py5CODE
LOWgpt_oss/tools/simple_browser/backend.py6CODE
LOWgpt_oss/tools/simple_browser/backend.py12CODE
LOWgpt_oss/tools/simple_browser/backend.py15CODE
LOWgpt_oss/tools/simple_browser/backend.py25CODE
LOWgpt_oss/tools/simple_browser/backend.py25CODE
LOWgpt_oss/tools/simple_browser/backend.py25CODE
LOWgpt_oss/tools/simple_browser/__init__.py1CODE
LOWgpt_oss/tools/simple_browser/__init__.py2CODE
LOWgpt_oss/tools/simple_browser/__init__.py2CODE
LOWgpt_oss/tools/simple_browser/page_contents.py5CODE
LOWgpt_oss/metal/scripts/create-local-model.py6CODE
LOWgpt_oss/triton/moe.py12CODE
LOWgpt_oss/responses_api/inference/triton.py1CODE
LOWgpt_oss/responses_api/inference/triton.py7CODE
LOWgpt_oss/responses_api/inference/triton.py9CODE
LOWgpt_oss/responses_api/inference/vllm.py7CODE
LOWtests/conftest.py4CODE
LOWtests/conftest.py5CODE
LOWtests/test_api_endpoints.py1CODE
LOWtests/test_api_endpoints.py3CODE
LOWtests/test_api_endpoints.py5CODE
LOWtests/test_api_endpoints.py5CODE
LOWtests/test_api_endpoints.py5CODE
LOWtests/gpt_oss/tools/simple_browser/test_backend.py2CODE
Deep Nesting26 hits · 26 pts
SeverityFileLineSnippetContext
LOWgpt_oss/chat.py61CODE
LOWgpt_oss/evals/responses_sampler.py37CODE
LOWgpt_oss/evals/aime_eval.py20CODE
LOWgpt_oss/evals/report.py27CODE
LOWgpt_oss/evals/healthbench_eval.py247CODE
LOWgpt_oss/tools/apply_patch.py280CODE
LOWgpt_oss/tools/apply_patch.py389CODE
LOWgpt_oss/tools/apply_patch.py459CODE
LOWgpt_oss/tools/apply_patch.py177CODE
LOWgpt_oss/tools/python_docker/docker_tool.py144CODE
LOWgpt_oss/tools/python_docker/docker_tool.py337CODE
LOWgpt_oss/metal/examples/chat.py38CODE
LOWgpt_oss/triton/model.py422CODE
LOWgpt_oss/vllm/token_generator.py13CODE
LOWgpt_oss/responses_api/api_server.py100CODE
LOWgpt_oss/responses_api/api_server.py118CODE
LOWgpt_oss/responses_api/api_server.py1136CODE
LOWgpt_oss/responses_api/api_server.py493CODE
LOWgpt_oss/responses_api/inference/ollama.py60CODE
LOWgpt_oss/responses_api/inference/ollama.py64CODE
LOWgpt_oss/responses_api/inference/ollama.py119CODE
LOWgpt_oss/responses_api/inference/ollama.py67CODE
LOWtests/test_api_endpoints.py62CODE
LOWexamples/streamlit/streamlit_chat.py105CODE
LOWexamples/gradio/gradio_chat.py18CODE
LOWexamples/agents-sdk-python/example.py24CODE
Over-Commented Block20 hits · 20 pts
SeverityFileLineSnippetContext
LOWgpt_oss/metal/include/gpt-oss.h1#pragma onceCOMMENT
LOWgpt_oss/metal/include/gpt-oss/macros.h1#pragma onceCOMMENT
LOWgpt_oss/metal/source/generate.c1#include <assert.h>COMMENT
LOWgpt_oss/metal/source/model.c1#include <assert.h>COMMENT
LOWgpt_oss/metal/source/context.c1#include <assert.h>COMMENT
LOWgpt_oss/metal/source/tokenizer.c1#include <assert.h>COMMENT
LOWgpt_oss/metal/source/include/internal/macros.h1#pragma onceCOMMENT
LOWgpt_oss/metal/source/include/internal/macros.h21#elseCOMMENT
LOWgpt_oss/metal/source/include/internal/macros.h41 #define GPTOSS_LIKELY(condition) (!!(condition))COMMENT
LOWgpt_oss/metal/source/include/internal/macros.h61 #if defined(__GNUC__) && (__GNUC__ >= 9) && !defined(__INTEL_COMPILER)COMMENT
LOWgpt_oss/metal/source/include/internal/macros.h81 #define GPTOSS_ALIGN(alignment) __declspec(align(alignment))COMMENT
LOWgpt_oss/metal/source/include/internal/macros.h101 #define GPTOSS_INTERNAL_SYMBOL __attribute__((__visibility__("internal")))COMMENT
LOWgpt_oss/metal/source/include/internal/model.h1#pragma onceCOMMENT
LOWgpt_oss/metal/source/include/internal/kernel-args.h1#pragma onceCOMMENT
LOWgpt_oss/metal/source/include/internal/kernel-args.h21#define MLP_GATE_Bn 16COMMENT
LOWgpt_oss/metal/source/include/internal/metal-kernels.h1#pragma onceCOMMENT
LOWgpt_oss/responses_api/utils.py81# fake_tokens = [200005, 35644, 200008, 976, 1825, 31064, 25, 392, 25216, 29400, 290, 11122, 306, 52768, 2117, 16842, 14COMMENT
LOWgpt_oss/responses_api/utils.py101# 32455,COMMENT
LOWgpt_oss/responses_api/inference/stub.py81]COMMENT
LOWgpt_oss/responses_api/inference/stub.py101# 316,COMMENT
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMgpt_oss/generate.py2# Note: This script is for demonstration purposes only. It is not designed for production use.COMMENT
AI Structural Patterns3 hits · 3 pts
SeverityFileLineSnippetContext
LOWgpt_oss/tools/simple_browser/simple_browser_tool.py110CODE
LOWgpt_oss/triton/attention.py203CODE
LOWgpt_oss/responses_api/api_server.py118CODE
Modern Structural Boilerplate3 hits · 3 pts
SeverityFileLineSnippetContext
LOWgpt_oss/tools/simple_browser/backend.py33logger = logging.getLogger(__name__)CODE
LOWgpt_oss/tools/simple_browser/__init__.py4__all__ = [CODE
LOWgpt_oss/tools/simple_browser/page_contents.py22logger = logging.getLogger(__name__)CODE
Decorative Section Separators1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMgpt_oss/metal/CMakeLists.txt191# ------------------------------------------------------------------------COMMENT
Modern AI Meta-Vocabulary1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md14Welcome to the gpt-oss series, [OpenAI's open-weight models](https://openai.com/open-models/) designed for powerful reasCODE
Fake / Example Data2 hits · 2 pts
SeverityFileLineSnippetContext
LOWcompatibility-test/tools.ts149 '{"rows":[{"id":1,"email":"user@example.com"},{"id":2,"email":"foo@bar.com"}],"row_count":2}',CODE
LOWcompatibility-test/tools.ts149 '{"rows":[{"id":1,"email":"user@example.com"},{"id":2,"email":"foo@bar.com"}],"row_count":2}',CODE
Self-Referential Comments1 hit · 1 pts
SeverityFileLineSnippetContext
MEDIUMexamples/gradio/gradio_chat.py179# Create the Gradio interfaceSTRING