A modern, C++-native, test framework for unit-tests, TDD and BDD - using C++14, C++17 and later (C++11 support is in v2.x branch, and C++03 on the Catch1.x branch)
This report summarizes scanner evidence for catchorg/Catch2, a C++ project with 21,536 GitHub stars. SynthScan examined 211,556 lines of code across 545 source files, recording 553 pattern matches distributed across 10 syntactic categories. The legacy adjusted pattern signal is 2.4 (Low pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.
Can maintainers explain intent, assumptions, and trade-offs? 528 finding(s).
Are imports declared and package/API names verified? 15 finding(s).
Are wrappers, guards, and repeated structures necessary? 17 finding(s).
Which changes need focused human review? 553 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 553 distinct pattern matches across 10 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/scripts/extractFeaturesFromReleaseNotes.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | tools/scripts/updateDocumentSnippets.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | tools/scripts/updateDocumentToC.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | fuzzing/fuzz_textflow.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/TestRegistrations.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/ToString.tests.cpp | 1 | COMMENT | |
| LOW | …elfTest/IntrospectiveTests/InternalBenchmark.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/Json.tests.cpp | 1 | COMMENT | |
| LOW | …s/SelfTest/IntrospectiveTests/GeneratorsImpl.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/Details.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/Reporters.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/CmdLine.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/TestSpec.tests.cpp | 1 | COMMENT | |
| LOW | …st/IntrospectiveTests/RandomNumberGeneration.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/IntrospectiveTests/Integer.tests.cpp | 21 | CHECK( extendedMult( b, a ) == | COMMENT |
| LOW | tests/SelfTest/IntrospectiveTests/Xml.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Exception.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Exception.tests.cpp | 201 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/ToStringVariant.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Generators.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Generators.tests.cpp | 41 | REQUIRE(x < z); | COMMENT |
| LOW | tests/SelfTest/UsageTests/Misc.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Message.tests.cpp | 241 | return out; | COMMENT |
| LOW | tests/SelfTest/UsageTests/Message.tests.cpp | 281 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Compilation.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Compilation.tests.cpp | 81 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/MatchersConstexpr.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/MatchersRanges.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Tricky.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Benchmark.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/ToStringWhich.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Matchers.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Condition.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/UsageTests/Class.tests.cpp | 1 | COMMENT | |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 1 | ##teamcity[testSuiteStarted name='<exe-name>'] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 21 | ##teamcity[testFailed name='#1514: stderr/stdout is not captured in tests aborted by an exception' message='Tricky.tests | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 41 | ##teamcity[testStarted name='#1938 - mixed sections and generates'] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 61 | ##teamcity[testIgnored name='#748 - captures with unexpected exceptions' message='-------------------------------------- | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 81 | ##teamcity[testFailed name='|'Not|' checks that should fail' message='Condition.tests.cpp:<line number>|nexpression fail | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 101 | ##teamcity[testFinished name='A TEMPLATE_PRODUCT_TEST_CASE_METHOD based test run that fails - Template_Foo<int>' duratio | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 121 | ##teamcity[testFinished name='A TEMPLATE_PRODUCT_TEST_CASE_METHOD_SIG based test run that fails - Template_Foo_2<int, 2> | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 141 | ##teamcity[testFinished name='A TEMPLATE_TEST_CASE_METHOD based test run that fails - float' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 161 | ##teamcity[testFinished name='A TEMPLATE_TEST_CASE_METHOD_SIG based test run that succeeds - 1' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 181 | ##teamcity[testFinished name='A Template product test case - std::vector<float>' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 201 | ##teamcity[testStarted name='Absolute margin'] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 221 | ##teamcity[testFinished name='Approximate comparisons with floats' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 241 | ##teamcity[testFinished name='Basic use of the Contains range matcher' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 261 | ##teamcity[testFinished name='CaseInsensitiveLess is case insensitive' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 281 | ##teamcity[testFinished name='Combining only templated matchers' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 301 | ##teamcity[testFinished name='Comparisons with int literals don|'t warn when mixing signed/ unsigned' duration="{duratio | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 321 | ##teamcity[testFinished name='Custom exceptions can be translated when testing for throwing as something else' duration= | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 341 | ##teamcity[testStarted name='Enum backed by larger underlying type'] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 361 | ##teamcity[testIgnored name='Equality checks that should fail' message='Condition.tests.cpp:<line number>|nexpression fa | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 381 | ##teamcity[testFinished name='Exception matchers that fail' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 401 | ##teamcity[testIgnored name='FAIL can be nested in assertion' message='AssertionHandler.tests.cpp:<line number>|n....... | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 421 | ##teamcity[testFinished name='GENERATE can combine literals and generators' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 441 | ##teamcity[testFinished name='Hashing test case produces same hash across multiple calls' duration="{duration}"] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 461 | ##teamcity[testIgnored name='Inequality checks that should fail' message='Condition.tests.cpp:<line number>|n........... | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 481 | ##teamcity[testStarted name='Less-than inequalities with different epsilons'] | COMMENT |
| LOW | tests/SelfTest/Baselines/teamcity.sw.approved.txt | 501 | ##teamcity[testFailed name='Matchers can be negated (Not) with the ! operator - failing' message='Matchers.tests.cpp:<li | COMMENT |
| 455 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/TestScripts/testConfigureExperimentalRedirect.py | 0 | tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the ca | STRING |
| HIGH | tests/TestScripts/testConfigureDisable.py | 0 | tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the ca | STRING |
| HIGH | tests/TestScripts/testConfigureDefaultReporter.py | 0 | tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the ca | STRING |
| HIGH | …sts/TestScripts/testConfigureDisableStringification.py | 0 | tests the cmake configure option for catch_config_disable_stringification requires 2 arguments, path folder where the ca | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/scripts/approve.py | 5 | CODE | |
| LOW | tools/scripts/releaseCommon.py | 3 | CODE | |
| LOW | tools/scripts/approvalTests.py | 11 | CODE | |
| LOW | tools/scripts/checkConvenienceHeaders.py | 19 | CODE | |
| LOW | tools/scripts/updateDocumentToC.py | 17 | CODE | |
| LOW | tests/TestScripts/testSharding.py | 23 | CODE | |
| LOW | tests/TestScripts/testConfigureExperimentalRedirect.py | 13 | CODE | |
| LOW | tests/TestScripts/testConfigureDisable.py | 13 | CODE | |
| LOW | tests/TestScripts/testBazelSharding.py | 11 | CODE | |
| LOW | tests/TestScripts/testConfigureDefaultReporter.py | 13 | CODE | |
| LOW | …sts/TestScripts/testConfigureDisableStringification.py | 13 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tools/scripts/updateDocumentSnippets.py | 7 | # --------------------------------------------------- | COMMENT |
| MEDIUM | tools/scripts/updateDocumentSnippets.py | 9 | # --------------------------------------------------- | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/TestScripts/testBazelExitGuardFile.py | 86 | except Exception as ex: | CODE |
| MEDIUM | tests/TestScripts/DiscoverTests/VerifyRegistration.py | 65 | print('Error when building the test project') | CODE |
| MEDIUM | tests/TestScripts/DiscoverTests/VerifyRegistration.py | 117 | print('Error when getting output from CTest') | CODE |
| MEDIUM | tests/TestScripts/DiscoverTests/VerifyRegistration.py | 224 | print('Error when calling CTest test extractor') | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp | 188 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n" | CODE |
| LOW⚡ | tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp | 188 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n" | CODE |
| LOW⚡ | tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp | 197 | " Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n" | CODE |
| LOW⚡ | tests/SelfTest/IntrospectiveTests/TextFlow.tests.cpp | 197 | " Lorem ipsum dolor sit amet, consectetur adipiscing elit. Pellentesque nisl \n" | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | conanfile.py | 38 | def _compilers_minimum_version(self): | CODE |
| LOW | tools/scripts/extractFeaturesFromReleaseNotes.py | 27 | def create_introduced_in_text(version, bug_number = None): | CODE |
| LOW | tools/scripts/extractFeaturesFromReleaseNotes.py | 36 | def link_to_changes_in_release(release, releases): | CODE |
| LOW | tools/scripts/extractFeaturesFromReleaseNotes.py | 54 | def write_recent_release_notes_with_introduced_text(): | CODE |
| LOW | tools/scripts/checkConvenienceHeaders.py | 76 | def verify_convenience_header(folder): | CODE |
| LOW | tests/TestScripts/DiscoverTests/VerifyRegistration.py | 213 | def extract_tests_list_from_ctest_script(build_path: str) -> List[str]: | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/scripts/extractFeaturesFromReleaseNotes.py | 54 | CODE | |
| LOW | tools/scripts/fixWhitespace.py | 9 | CODE | |
| LOW | tools/scripts/updateDocumentToC.py | 109 | CODE | |
| LOW | benchmarks/discover_tests/benchmark_discovery.py | 153 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | src/catch2/internal/catch_run_context.cpp | 153 | // No children have started. We need to check if they | COMMENT |
| LOW | extras/catch_amalgamated.cpp | 6155 | // No children have started. We need to check if they | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/scripts/updateDocumentToC.py | 268 | CODE |