Home / trailofbits / algo
AI Slop Code RIsk Monitor

trailofbits/algo

Set up a personal VPN in the cloud

17.6 Elevated pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for trailofbits/algo, a Python project with 30,412 GitHub stars. SynthScan examined 20,133 lines of code across 220 source files, recording 236 pattern matches distributed across 14 syntactic categories. The legacy adjusted pattern signal is 17.6 (Elevated pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

17.6
Adjusted Signal
17.6
Raw Pattern Score
100%
Time Factor
2026-10-08
Last Push
30.4K
Stars
Python
Language
20.1K
Lines of Code
220
Files
236
Pattern Hits
2026-10-12
Scan Date
0.03
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 38.2/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 162 finding(s).

Hallucinated Dependency & Supply Chain Risk 2.0/100 · LOW

Are imports declared and package/API names verified? 4 finding(s).

Agent Over-Engineering Ratio 47.2/100 · MEDIUM

Are wrappers, guards, and repeated structures necessary? 169 finding(s).

PR Review Velocity Impact 58.2/100 · HIGH

Which changes need focused human review? 236 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 7MEDIUM 40LOW 189

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 236 distinct pattern matches across 14 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers99 hits · 104 pts
SeverityFileLineSnippetContext
LOWCLAUDE.md348def test_regression_openssl_inline_comments():CODE
LOWtests/test_package_preinstall.py27 def test_preinstall_disabled_by_default(self):STRING
LOWtests/test_package_preinstall.py53 def test_preinstall_disabled_explicitly(self):CODE
LOWtests/test_cloud_init_template.py28def create_expected_cloud_init():CODE
LOWtests/test_cloud_init_template.py192 def test_indentation_consistency(self):CODE
LOWtests/validate_jinja2_templates.py34def check_inline_comments_in_expressions(template_content: str, template_path: Path) -> list[str]:CODE
LOWtests/validate_jinja2_templates.py69def check_undefined_variables(template_path: Path) -> list[str]:CODE
LOWtests/validate_jinja2_templates.py180def check_common_antipatterns(template_path: Path) -> list[str]:CODE
LOWtests/unit/test_comprehensive_boolean_scan.py98 def test_no_string_true_false_in_set_fact(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py113 def test_no_bare_false_in_jinja_else(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py129 def test_when_conditions_use_booleans(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py163 def test_template_files_boolean_usage(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py189 def test_all_when_conditions_would_work(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py218 def test_no_other_problematic_patterns(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py267 def test_verify_our_fixes_are_correct(self):CODE
LOWtests/unit/test_comprehensive_boolean_scan.py289 def test_templates_handle_booleans_correctly(self):CODE
LOWtests/unit/test_lightsail_boto3_fix.py42 def test_lightsail_region_facts_imports(self):CODE
LOW⚡tests/unit/test_destroy.py41def test_destroy_playbook_syntax():CODE
LOW⚡tests/unit/test_destroy.py51def test_destroy_playbook_has_rescue():CODE
LOW⚡tests/unit/test_destroy.py59def test_destroy_playbook_has_confirmation():CODE
LOW⚡tests/unit/test_destroy.py66def test_all_provider_destroy_files_exist():CODE
LOW⚡tests/unit/test_destroy.py73def test_all_provider_destroy_files_valid_yaml():CODE
LOW⚡tests/unit/test_destroy.py82def test_provider_destroy_uses_absent_state():CODE
LOW⚡tests/unit/test_destroy.py99def test_lightsail_destroy_uses_cloudformation():CODE
LOW⚡tests/unit/test_destroy.py107def test_gce_destroy_cleans_subsidiary_resources():CODE
LOW⚡tests/unit/test_destroy.py116def test_vultr_destroy_cleans_firewall_group():CODE
LOW⚡tests/unit/test_destroy.py123def test_openstack_destroy_cleans_security_group():CODE
LOW⚡tests/unit/test_destroy.py130def test_cloudstack_destroy_cleans_security_group():CODE
LOW⚡tests/unit/test_destroy.py137def test_subsidiary_cleanup_is_best_effort():CODE
LOW⚡tests/unit/test_destroy.py152def test_linode_uses_label_not_name():CODE
LOW⚡tests/unit/test_destroy.py159def test_azure_deletes_resource_group():CODE
LOW⚡tests/unit/test_destroy.py167def test_algo_script_has_destroy_command():CODE
LOW⚡tests/unit/test_destroy.py175def test_algo_script_destroy_requires_ip():CODE
LOW⚡tests/unit/test_destroy.py182def test_server_yml_stores_algo_region():CODE
LOW⚡tests/unit/test_destroy.py189def test_destroy_playbook_validates_region_for_required_providers():CODE
LOW⚡tests/unit/test_destroy.py197def test_destroy_playbook_loads_server_config():CODE
LOWtests/unit/test_destroy.py25def test_destroy_playbook_exists():CODE
LOWtests/unit/test_destroy.py30def test_destroy_playbook_valid_yaml():CODE
LOWtests/unit/test_cloud_provider_configs.py48def test_no_deprecated_instance_types():CODE
LOWtests/unit/test_cloud_provider_configs.py60def test_required_fields_present():CODE
LOWtests/unit/test_strongswan_templates.py50def get_strongswan_test_variables(scenario="default"):CODE
LOWtests/unit/test_strongswan_templates.py102def test_strongswan_templates():CODE
LOWtests/unit/test_strongswan_templates.py178def test_openssl_template_constraints():CODE
LOWtests/unit/test_strongswan_templates.py223def test_mobileconfig_template():CODE
LOWtests/unit/test_yaml_jinja2_expressions.py258def test_regression_openssl_inline_comments():CODE
LOWtests/unit/test_yaml_jinja2_expressions.py301def test_edge_cases_inline_comments():CODE
LOWtests/unit/test_yaml_jinja2_expressions.py364def test_yaml_files_no_inline_comments():CODE
LOWtests/unit/test_yaml_jinja2_expressions.py387def test_openssl_file_specifically():CODE
LOWtests/unit/test_iptables_rules.py118def test_alternative_ingress_snat():CODE
LOWtests/unit/test_iptables_rules.py148def test_ipsec_forward_rule_has_policy_match():CODE
LOWtests/unit/test_iptables_rules.py171def test_wireguard_forward_rule_no_policy_match():CODE
LOWtests/unit/test_iptables_rules.py197def test_output_interface_in_nat_rules():CODE
LOWtests/unit/test_iptables_rules.py225def test_dns_firewall_restricted_to_vpn():CODE
LOWtests/unit/test_user_management.py42def test_server_selection_format():STRING
LOWtests/unit/test_user_management.py71def test_ssh_key_preservation():CODE
LOWtests/unit/test_user_management.py98def test_ca_password_handling():CODE
LOWtests/unit/test_user_management.py127def test_user_config_generation():CODE
LOWtests/unit/test_user_management.py149def test_duplicate_user_handling():CODE
LOWtests/unit/test_basic_sanity.py19def test_pyproject_file_exists():CODE
LOWtests/unit/test_basic_sanity.py77def test_cloud_init_header_format():CODE
39 more matches not shown…
Decorative Section Separators24 hits · 76 pts
SeverityFileLineSnippetContext
MEDIUM⚡config.cfg3# ============================================COMMENT
MEDIUM⚡config.cfg5# ============================================COMMENT
MEDIUM⚡config.cfg10# ============================================COMMENT
MEDIUMserver.yml48 # ============================================================COMMENT
MEDIUMserver.yml52 # ============================================================COMMENT
MEDIUMtests/test-wireguard-real-async.yml3# ==================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh5# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh12# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh46# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh48# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh85# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh87# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh151# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh153# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh193# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh195# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh228# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh230# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh387# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh389# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh556# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh558# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh600# =============================================================================COMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh602# =============================================================================COMMENT
Redundant / Tautological Comments24 hits · 36 pts
SeverityFileLineSnippetContext
LOWconfig.cfg162 # Set use_existing_eip to "true" if you want to use a pre-allocated Elastic IPCOMMENT
LOWtests/validate_jinja2_templates.py57 # Check if it's likely a comment (has text after it)COMMENT
LOWtests/unit/test_comprehensive_boolean_scan.py150 # Check if it's a simple condition (good) or comparing to string (bad)COMMENT
LOWtests/unit/test_comprehensive_boolean_scan.py210 # Check if it's using one of our boolean variablesCOMMENT
LOWtests/unit/test_comprehensive_boolean_scan.py258 # Check if it's a known safe patternCOMMENT
LOWtests/unit/test_strongswan_templates.py206 # Check if the # is within {{ }}COMMENT
LOWtests/unit/test_yaml_jinja2_expressions.py78 # Check if the # is within a list or dict literalCOMMENT
LOWtests/unit/test_yaml_jinja2_expressions.py95 # Check if it's escapedCOMMENT
LOWtests/unit/test_yaml_jinja2_expressions.py140 # Check if the # is within a list or dict literalCOMMENT
LOWtests/unit/test_template_rendering.py170 # Check if main.yml defines theseCOMMENT
LOWtests/unit/test_template_rendering.py225 # Check if the expected endpoint format is in the outputCOMMENT
LOWtests/unit/test_template_rendering.py317 # Check if we have Jinja2 availableCOMMENT
LOWtests/unit/test_docker_localhost_deployment.py90 # Check if Dockerfile existsCOMMENT
LOWtests/unit/test_openssl_compatibility.py288 # Check if this looks like a client cert vs server certCOMMENT
LOWtests/integration/ansible-service-wrapper.py32# Check if it's a known serviceCOMMENT
LOWtests/integration/mock_modules/apt.py65 # Check if we need to install anythingCOMMENT
LOWtests/integration/mock_modules/apt.py82 # Check if we need to remove anythingCOMMENT
LOWtests/e2e/test-vpn-connectivity.sh501 # Check if IPsec service is running on hostCOMMENT
LOWroles/strongswan/handlers/main.yml13 # Check if StrongSwan is actually runningCOMMENT
LOWroles/common/tasks/ubuntu.yml21 # Check if kernel was updated (most critical reboot reason)COMMENT
LOWscripts/track-test-effectiveness.py92 # Check if PR was merged (indicating it fixed a real issue)COMMENT
LOW.github/workflows/integration-tests.yml200 # Check if interface has peersCOMMENT
LOW.github/workflows/test-effectiveness.yml44 # Check if we need to create an issueCOMMENT
LOW.github/workflows/test-effectiveness.yml46 # Check if issue already existsCOMMENT
Excessive Try-Catch Wrapping34 hits · 34 pts
SeverityFileLineSnippetContext
LOWtests/test_cloud_init_template.py253 except Exception as e:CODE
LOWtests/validate_jinja2_templates.py113 except Exception:CODE
LOWtests/validate_jinja2_templates.py141 except Exception:CODE
LOWtests/validate_jinja2_templates.py174 except Exception as e:CODE
LOWtests/validate_jinja2_templates.py204 except Exception:CODE
LOWtests/unit/test_lightsail_boto3_fix.py61 except Exception as e:CODE
LOWtests/unit/test_lightsail_boto3_fix.py92 except Exception:CODE
LOWtests/unit/test_strongswan_templates.py164 except Exception as e:CODE
LOWtests/unit/test_strongswan_templates.py218 except Exception as e:CODE
LOWtests/unit/test_strongswan_templates.py298 except Exception as e:CODE
LOWtests/unit/test_yaml_jinja2_expressions.py152 except Exception as e:CODE
LOWtests/unit/test_yaml_jinja2_expressions.py251 except Exception as e:CODE
LOWtests/unit/test_user_management.py196 except Exception as e:STRING
LOWtests/unit/test_basic_sanity.py117 except Exception as e:CODE
LOWtests/unit/test_generated_configs.py380 except Exception as e:STRING
LOWtests/unit/test_template_rendering.py87 except Exception as e:CODE
LOWtests/unit/test_template_rendering.py146 except Exception as e:CODE
LOWtests/unit/test_template_rendering.py235 except Exception as e:CODE
LOWtests/unit/test_template_rendering.py309 except Exception as e:CODE
LOWtests/unit/test_template_rendering.py340 except Exception as e:CODE
LOWtests/unit/test_config_validation.py144 except Exception as e:CODE
LOWtests/unit/test_wireguard_key_generation.py63 except Exception:CODE
LOWtests/unit/test_wireguard_key_generation.py122 except Exception as e:CODE
LOWtests/unit/test_wireguard_key_generation.py179 except Exception as e:CODE
LOWtests/unit/test_wireguard_key_generation.py341 except Exception as e:CODE
LOWtests/unit/test_scaleway_fix.py128 except Exception as e:CODE
LOWtests/unit/test_docker_localhost_deployment.py162 except Exception as e:CODE
LOWtests/unit/test_openssl_compatibility.py568 except Exception as e:CODE
LOWtests/unit/test_double_templating.py78 except Exception:CODE
LOWtests/integration/mock_modules/command.py65 except Exception as e:CODE
LOWtests/integration/mock_modules/shell.py60 except Exception as e:CODE
LOWlibrary/x25519_pubkey.py87 except Exception as e:CODE
LOWlibrary/x25519_pubkey.py120 except Exception as e:CODE
MEDIUMscripts/track-test-effectiveness.py19 print(f"Error fetching {endpoint}: {result.stderr}")CODE
Empty Error Handlers6 hits · 30 pts
SeverityFileLineSnippetContext
HIGHtests/validate_jinja2_templates.py113except Exception:CODE
HIGHtests/validate_jinja2_templates.py204except Exception:CODE
HIGHtests/validate_jinja2_templates.py141except Exception:CODE
HIGHtests/unit/test_lightsail_boto3_fix.py89except SystemExit:CODE
HIGHtests/unit/test_lightsail_boto3_fix.py92except Exception:CODE
HIGHlibrary/lightsail_region_facts.py59except ImportError:CODE
Deep Nesting26 hits · 26 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py98CODE
LOWtests/test_cloud_init_template.py192CODE
LOWtests/validate_jinja2_templates.py34CODE
LOWtests/unit/test_comprehensive_boolean_scan.py129CODE
LOWtests/unit/test_comprehensive_boolean_scan.py218CODE
LOWtests/unit/test_lightsail_boto3_fix.py64CODE
LOWtests/unit/test_strongswan_templates.py102CODE
LOWtests/unit/test_strongswan_templates.py178CODE
LOWtests/unit/test_yaml_jinja2_expressions.py68CODE
LOWtests/unit/test_yaml_jinja2_expressions.py209CODE
LOWtests/unit/test_yaml_jinja2_expressions.py301CODE
LOWtests/unit/test_generated_configs.py21CODE
LOWtests/unit/test_generated_configs.py96CODE
LOWtests/unit/test_generated_configs.py172CODE
LOWtests/unit/test_generated_configs.py298CODE
LOWtests/unit/test_template_rendering.py29CODE
LOWtests/unit/test_template_rendering.py187CODE
LOWtests/unit/test_template_rendering.py247CODE
LOWtests/unit/test_wireguard_key_generation.py70CODE
LOWtests/integration/mock_modules/command.py9CODE
LOWtests/integration/mock_modules/apt.py9CODE
LOWlibrary/scaleway_compute.py560CODE
LOWlibrary/scaleway_compute.py589CODE
LOWlibrary/x25519_pubkey.py32CODE
LOWscripts/track-test-effectiveness.py24CODE
LOWscripts/track-test-effectiveness.py85CODE
Self-Referential Comments6 hits · 18 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_package_preinstall.py11 # Create a simplified test template with just the packages sectionCOMMENT
MEDIUMtests/test-local-config.sh13# Create a minimal test configurationCOMMENT
MEDIUMtests/unit/test_wireguard_key_generation.py233 # Create a WireGuard config using our keysCOMMENT
MEDIUMtests/unit/test_docker_localhost_deployment.py23 # Create a test WireGuard configCOMMENT
MEDIUMtests/e2e/test-vpn-connectivity.sh462 # Create a minimal strongswan.confCOMMENT
MEDIUM.github/workflows/integration-tests.yml286 # Create a minimal valid configCOMMENT
Dead Code6 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMtests/unit/test_strongswan_templates.py237CODE
MEDIUMtests/unit/test_strongswan_templates.py256CODE
MEDIUMtests/unit/test_strongswan_templates.py257CODE
MEDIUMtests/unit/test_strongswan_templates.py302CODE
MEDIUMtests/unit/test_strongswan_templates.py305CODE
MEDIUMtests/unit/test_strongswan_templates.py306CODE
AI Slop Vocabulary4 hits · 6 pts
SeverityFileLineSnippetContext
LOWtests/unit/test_strongswan_templates.py30 # Simple mock - just return True for nowCOMMENT
MEDIUMtests/unit/test_yaml_jinja2_expressions.py162 """Get a comprehensive set of test variables for expression validation."""STRING
MEDIUMtests/unit/test_template_rendering.py43 """Get a comprehensive set of test variables for template rendering"""STRING
MEDIUMroles/dns/tasks/ubuntu.yml119 # Additional hardening on top of comprehensive AppArmorCOMMENT
Cross-Language Confusion1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHtests/test_cloud_init_template.py74 - sudo apt-get remove -y --purge sshguard || trueCODE
Over-Commented Block2 hits · 2 pts
SeverityFileLineSnippetContext
LOWconfig.cfg1---COMMENT
LOWtests/integration/mock-apparmor_status.sh1#!/bin/bashCOMMENT
Unused Imports2 hits · 2 pts
SeverityFileLineSnippetContext
LOWtests/unit/test_template_rendering.py319CODE
LOWlibrary/lightsail_region_facts.py58CODE
Fake / Example Data1 hit · 1 pts
SeverityFileLineSnippetContext
LOWroles/common/tasks/aip/main.yml9 file: "{{ algo_provider if algo_provider in aip_supported_providers else 'placeholder' }}.yml"CODE
Overly Generic Function Names1 hit · 0 pts
SeverityFileLineSnippetContext
LOWlibrary/scaleway_compute.py294def perform_action(compute_api, server, action):STRING