AI Slop Code Risk Monitor

catchorg/Catch2

SlopCodeMonitor badge for catchorg/Catch2 Adjusted legacy signal; badge bands: 25 / 50 / 75 (different from dashboard bands).

A modern, C++-native, test framework for unit-tests, TDD and BDD - using C++14, C++17 and later (C++11 support is in v2.x branch, and C++03 on the Catch1.x branch)

2.4 Low pattern signal View on GitHub

Open-Source Code Quality, Security and Technical Debt Review

This report summarizes scanner evidence for catchorg/Catch2, a C++ project with 21,536 GitHub stars. SynthScan examined 211,556 lines of code across 545 source files, recording 553 pattern matches distributed across 10 syntactic categories. The legacy adjusted pattern signal is 2.4 (Low pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

2.4
Adjusted Signal
2.4
Raw Pattern Score
100%
Time Factor
2026-10-30
Last Push
21.5K
Stars
C++
Language
211.6K
Lines of Code
545
Files
553
Pattern Hits
2026-10-31
Scan Date
0.01
HC Hit Rate

Risk Review · Payload v1

Use each vector to guide manual verification of the underlying findings.

Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.

Cognitive Ownership Risk 10.3/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 528 finding(s).

Hallucinated Dependency & Supply Chain Risk 0.4/100 · LOW

Are imports declared and package/API names verified? 15 finding(s).

Agent Over-Engineering Ratio 0.9/100 · LOW

Are wrappers, guards, and repeated structures necessary? 17 finding(s).

PR Review Velocity Impact 12.9/100 · LOW

Which changes need focused human review? 553 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 4MEDIUM 5LOW 544

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 553 distinct pattern matches across 10 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Over-Commented Block515 hits · 446 pts
SeverityFileLineSnippetContext
LOWtools/scripts/extractFeaturesFromReleaseNotes.py1#!/usr/bin/env python3COMMENT
LOWtools/scripts/updateDocumentSnippets.py1#!/usr/bin/env python3COMMENT
LOWtools/scripts/updateDocumentToC.py1#!/usr/bin/env python3COMMENT
LOWfuzzing/fuzz_textflow.cpp1COMMENT
LOWtests/SelfTest/TestRegistrations.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/ToString.tests.cpp1COMMENT
LOW…elfTest/IntrospectiveTests/InternalBenchmark.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/Json.tests.cpp1COMMENT
LOW…s/SelfTest/IntrospectiveTests/GeneratorsImpl.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/Details.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/Reporters.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/CmdLine.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/TestSpec.tests.cpp1COMMENT
LOW…st/IntrospectiveTests/RandomNumberGeneration.tests.cpp1COMMENT
LOWtests/SelfTest/IntrospectiveTests/Integer.tests.cpp21 CHECK( extendedMult( b, a ) ==COMMENT
LOWtests/SelfTest/IntrospectiveTests/Xml.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Exception.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Exception.tests.cpp201COMMENT
LOWtests/SelfTest/UsageTests/ToStringVariant.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Generators.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Generators.tests.cpp41 REQUIRE(x < z);COMMENT
LOWtests/SelfTest/UsageTests/Misc.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Message.tests.cpp241 return out;COMMENT
LOWtests/SelfTest/UsageTests/Message.tests.cpp281COMMENT
LOWtests/SelfTest/UsageTests/Compilation.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Compilation.tests.cpp81COMMENT
LOWtests/SelfTest/UsageTests/MatchersConstexpr.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/MatchersRanges.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Tricky.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Benchmark.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/ToStringWhich.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Matchers.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Condition.tests.cpp1COMMENT
LOWtests/SelfTest/UsageTests/Class.tests.cpp1COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt1##teamcity[testSuiteStarted name='<exe-name>']COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt21##teamcity[testFailed name='#1514: stderr/stdout is not captured in tests aborted by an exception' message='Tricky.testsCOMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt41##teamcity[testStarted name='#1938 - mixed sections and generates']COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt61##teamcity[testIgnored name='#748 - captures with unexpected exceptions' message='--------------------------------------COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt81##teamcity[testFailed name='|'Not|' checks that should fail' message='Condition.tests.cpp:<line number>|nexpression failCOMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt101##teamcity[testFinished name='A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>' duratioCOMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt121##teamcity[testFinished name='A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2>COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt141##teamcity[testFinished name='A TEMPLATE_TEST_CASE_METHOD based test run that fails - float' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt161##teamcity[testFinished name='A TEMPLATE_TEST_CASE_METHOD_SIG based test run that succeeds - 1' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt181##teamcity[testFinished name='A Template product test case - std::vector<float>' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt201##teamcity[testStarted name='Absolute margin']COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt221##teamcity[testFinished name='Approximate comparisons with floats' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt241##teamcity[testFinished name='Basic use of the Contains range matcher' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt261##teamcity[testFinished name='CaseInsensitiveLess is case insensitive' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt281##teamcity[testFinished name='Combining only templated matchers' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt301##teamcity[testFinished name='Comparisons with int literals don|'t warn when mixing signed/ unsigned' duration="{duratioCOMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt321##teamcity[testFinished name='Custom exceptions can be translated when testing for throwing as something else' duration=COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt341##teamcity[testStarted name='Enum backed by larger underlying type']COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt361##teamcity[testIgnored name='Equality checks that should fail' message='Condition.tests.cpp:<line number>|nexpression faCOMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt381##teamcity[testFinished name='Exception matchers that fail' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt401##teamcity[testIgnored name='FAIL can be nested in assertion' message='AssertionHandler.tests.cpp:<line number>|n.......COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt421##teamcity[testFinished name='GENERATE can combine literals and generators' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt441##teamcity[testFinished name='Hashing test case produces same hash across multiple calls' duration="{duration}"]COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt461##teamcity[testIgnored name='Inequality checks that should fail' message='Condition.tests.cpp:<line number>|n...........COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt481##teamcity[testStarted name='Less-than inequalities with different epsilons']COMMENT
LOWtests/SelfTest/Baselines/teamcity.sw.approved.txt501##teamcity[testFailed name='Matchers can be negated (Not) with the ! operator - failing' message='Matchers.tests.cpp:<liCOMMENT
455 more matches not shown…
Cross-File Repetition4 hits · 20 pts
SeverityFileLineSnippetContext
HIGHtests/TestScripts/testConfigureExperimentalRedirect.py0tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the caSTRING
HIGHtests/TestScripts/testConfigureDisable.py0tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the caSTRING
HIGHtests/TestScripts/testConfigureDefaultReporter.py0tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the caSTRING
HIGH…sts/TestScripts/testConfigureDisableStringification.py0tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the caSTRING
Unused Imports11 hits · 11 pts
SeverityFileLineSnippetContext
LOWtools/scripts/approve.py5CODE
LOWtools/scripts/releaseCommon.py3CODE
LOWtools/scripts/approvalTests.py11CODE
LOWtools/scripts/checkConvenienceHeaders.py19CODE
LOWtools/scripts/updateDocumentToC.py17CODE
LOWtests/TestScripts/testSharding.py23CODE
LOWtests/TestScripts/testConfigureExperimentalRedirect.py13CODE
LOWtests/TestScripts/testConfigureDisable.py13CODE
LOWtests/TestScripts/testBazelSharding.py11CODE
LOWtests/TestScripts/testConfigureDefaultReporter.py13CODE
LOW…sts/TestScripts/testConfigureDisableStringification.py13CODE
Decorative Section Separators2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMtools/scripts/updateDocumentSnippets.py7# ---------------------------------------------------COMMENT
MEDIUMtools/scripts/updateDocumentSnippets.py9# ---------------------------------------------------COMMENT
Excessive Try-Catch Wrapping4 hits · 6 pts
SeverityFileLineSnippetContext
LOWtests/TestScripts/testBazelExitGuardFile.py86 except Exception as ex:CODE
MEDIUMtests/TestScripts/DiscoverTests/VerifyRegistration.py65 print('Error when building the test project')CODE
MEDIUMtests/TestScripts/DiscoverTests/VerifyRegistration.py117 print('Error when getting output from CTest')CODE
MEDIUMtests/TestScripts/DiscoverTests/VerifyRegistration.py224 print('Error when calling CTest test extractor')STRING
Fake / Example Data4 hits · 6 pts
SeverityFileLineSnippetContext
LOW⚡tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp188 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n"CODE
LOW⚡tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp188 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n"CODE
LOW⚡tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp197 " Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n"CODE
LOW⚡tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp197 " Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n"CODE
Hyper-Verbose Identifiers6 hits · 6 pts
SeverityFileLineSnippetContext
LOWconanfile.py38 def _compilers_minimum_version(self):CODE
LOWtools/scripts/extractFeaturesFromReleaseNotes.py27def create_introduced_in_text(version, bug_number = None):CODE
LOWtools/scripts/extractFeaturesFromReleaseNotes.py36def link_to_changes_in_release(release, releases):CODE
LOWtools/scripts/extractFeaturesFromReleaseNotes.py54def write_recent_release_notes_with_introduced_text():CODE
LOWtools/scripts/checkConvenienceHeaders.py76def verify_convenience_header(folder):CODE
LOWtests/TestScripts/DiscoverTests/VerifyRegistration.py213def extract_tests_list_from_ctest_script(build_path: str) -> List[str]:STRING
Deep Nesting4 hits · 4 pts
SeverityFileLineSnippetContext
LOWtools/scripts/extractFeaturesFromReleaseNotes.py54CODE
LOWtools/scripts/fixWhitespace.py9CODE
LOWtools/scripts/updateDocumentToC.py109CODE
LOWbenchmarks/discover_tests/benchmark_discovery.py153CODE
Verbosity Indicators2 hits · 3 pts
SeverityFileLineSnippetContext
LOWsrc/catch2/internal/catch_run_context.cpp153 // No children have started. We need to check if theyCOMMENT
LOWextras/catch_amalgamated.cpp6155 // No children have started. We need to check if theyCOMMENT
AI Structural Patterns1 hit · 1 pts
SeverityFileLineSnippetContext
LOWtools/scripts/updateDocumentToC.py268CODE