AI Slop Code RIsk Monitor

aliasrobotics/cai

Cybersecurity AI (CAI), the framework for AI Security

45.6 High pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for aliasrobotics/cai, a Python project with 9,841 GitHub stars. SynthScan examined 313,541 lines of code across 1416 source files, recording 9174 pattern matches distributed across 25 syntactic categories. The legacy adjusted pattern signal is 45.6 (High pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

45.6
Adjusted Signal
45.6
Raw Pattern Score
100%
Time Factor
2026-08-22
Last Push
9.8K
Stars
Python
Language
313.5K
Lines of Code
1.4K
Files
9.2K
Pattern Hits
2026-10-12
Scan Date
0.81
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 49.0/100 · MEDIUM

Can maintainers explain intent, assumptions, and trade-offs? 3727 finding(s).

Hallucinated Dependency & Supply Chain Risk 25.1/100 · MEDIUM

Are imports declared and package/API names verified? 1784 finding(s).

Agent Over-Engineering Ratio 80.9/100 · CRITICAL

Are wrappers, guards, and repeated structures necessary? 5870 finding(s).

PR Review Velocity Impact 93.0/100 · CRITICAL

Which changes need focused human review? 9174 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 1HIGH 1151MEDIUM 865LOW 7157

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 9174 distinct pattern matches across 25 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Empty Error Handlers846 hits · 3815 pts
SeverityFileLineSnippetContext
HIGHtools/gif.py117except OSError:CODE
HIGHtools/logs.py361except Exception:CODE
HIGHtools/logs.py371except Exception:CODE
HIGHtools/logs.py380except Exception:CODE
HIGHtools/logs.py249except Exception:CODE
HIGHtools/license_check.py166except Exception:CODE
HIGHtools/license_check.py127except FileNotFoundError:CODE
HIGHtools/license_check.py156except FileNotFoundError:CODE
HIGHtools/license_check.py175except Exception:CODE
HIGHtools/license_check.py182except Exception:CODE
HIGHtests/mcp/helpers.py3except ImportError:CODE
HIGHtests/cli/test_tool_visualization.py408except (TypeError, ValueError):CODE
HIGHtests/voice/test_input.py11except ImportError:CODE
HIGHtests/voice/test_openai_stt.py21except ImportError:CODE
HIGHtests/voice/fake_models.py20except ImportError:CODE
HIGHtests/voice/test_workflow.py30except ImportError:CODE
HIGHtests/voice/test_openai_tts.py10except ImportError:CODE
HIGHtests/voice/helpers.py3except ImportError:CODE
HIGHtests/voice/test_pipeline.py17except ImportError:CODE
HIGHexamples/cai_api_cli.py79except Exception: # pragma: no cover - cleanup best effortCODE
HIGHexamples/voice/streamed/main.py142except Exception:CODE
HIGHexamples/voice/streamed/main.py205except KeyboardInterrupt:CODE
HIGHsrc/cai/cli_setup.py138except ImportError:CODE
HIGHsrc/cai/cli_setup.py225except Exception:CODE
HIGHsrc/cai/config.py304except ValueError:CODE
HIGHsrc/cai/cli.py26except RuntimeError:CODE
HIGHsrc/cai/cli.py146except Exception:CODE
HIGHsrc/cai/cli.py210except Exception:CODE
HIGHsrc/cai/cli.py362except Exception:CODE
HIGHsrc/cai/cli.py452except Exception:CODE
HIGHsrc/cai/util_ext.py57except Exception:CODE
HIGHsrc/cai/util_ext.py295except Exception:CODE
HIGHsrc/cai/util_ext.py66except Exception:CODE
HIGHsrc/cai/util_ext.py73except Exception:CODE
HIGHsrc/cai/util_ext.py442except Exception:CODE
HIGHsrc/cai/cli_headless.py659except Exception:CODE
HIGHsrc/cai/cli_headless.py760except Exception:CODE
HIGHsrc/cai/cli_headless.py1611except Exception:CODE
HIGHsrc/cai/cli_headless.py2373except Exception:CODE
HIGHsrc/cai/cli_headless.py2404except Exception:CODE
HIGHsrc/cai/cli_headless.py2446except Exception:CODE
HIGHsrc/cai/cli_headless.py2541except Exception:CODE
HIGHsrc/cai/cli_headless.py2551except Exception:CODE
HIGHsrc/cai/cli_headless.py2580except Exception:CODE
HIGHsrc/cai/cli_headless.py2591except Exception:CODE
HIGHsrc/cai/cli_headless.py2596except Exception:CODE
HIGHsrc/cai/cli_headless.py2609except Exception:CODE
HIGHsrc/cai/cli_headless.py2923except ImportError:CODE
HIGHsrc/cai/cli_headless.py2297except Exception:CODE
HIGHsrc/cai/cli_headless.py2532except Exception:CODE
HIGHsrc/cai/cli_headless.py2539except Exception:CODE
HIGHsrc/cai/cli_headless.py2634except Exception:CODE
HIGHsrc/cai/cli_headless.py2675except Exception:CODE
HIGHsrc/cai/cli_headless.py2765except Exception:CODE
HIGHsrc/cai/cli_headless.py773except OSError:CODE
HIGHsrc/cai/cli_headless.py1247except Exception:CODE
HIGHsrc/cai/cli_headless.py1340except ImportError:CODE
HIGHsrc/cai/cli_headless.py1795except Exception:CODE
HIGHsrc/cai/cli_headless.py2444except Exception:CODE
HIGHsrc/cai/cli_headless.py2578except Exception:CODE
786 more matches not shown…
Hyper-Verbose Identifiers2195 hits · 2114 pts
SeverityFileLineSnippetContext
LOWtools/vm_to_docker.py130 def mount_and_extract_filesystem(self, raw_path: Path) -> Path:CODE
LOWtools/vm_to_docker.py205 def create_dockerfile_from_template(self, detected_os: str = "ubuntu") -> Path:CODE
LOWtools/vm_to_docker.py294 def create_dockerfile_from_filesystem(self, fs_dir: Path) -> Path:CODE
LOWtools/logs.py140 def create_system_distribution(self) -> Optional[str]:CODE
LOWtools/license_check.py262def validate_encrypted_api_key() -> bool:CODE
LOWtools/case_study_generator.py206 async def process_streamed_response():CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py234def run_ctr_baseline_analysis(graph_structure, edge_probabilities, save_path, attack_rate_list=None, defense_rate_list=NCODE
LOWtests/conftest.py21def restore_cai_tracing_env_after_each_test():CODE
LOWtests/conftest.py61def disable_real_model_clients(monkeypatch, request):CODE
LOWtests/test_compact_command.py25 def test_command_initialization(self, compact_command):CODE
LOWtests/test_cli_print_deduplication.py25def test_deduplication_with_streaming_disabled(capsys):CODE
LOWtests/test_cli_print_deduplication.py74def test_deduplication_with_streaming_enabled(capsys):CODE
LOWtests/test_cli_print_deduplication.py101def test_different_commands_always_display(capsys):CODE
LOWtests/test_cli_print_deduplication.py128def test_empty_output_always_suppressed(capsys):CODE
LOWtests/test_cli_print_deduplication.py140def test_parallel_mode_deduplication(capsys):CODE
LOWtests/test_config_loader_agents.py4def test_extract_agent_definitions_parallel_agents():CODE
LOWtests/test_config_loader_agents.py39def test_extract_agent_definitions_tui_startup_legacy():CODE
LOW⚡tests/test_unified_pattern.py42 def test_pattern_creation_with_enum(self):CODE
LOW⚡tests/test_unified_pattern.py49 def test_pattern_creation_with_string(self):CODE
LOW⚡tests/test_unified_pattern.py54 def test_invalid_pattern_type(self):CODE
LOW⚡tests/test_unified_pattern.py63 def test_parallel_pattern_methods(self):CODE
LOW⚡tests/test_unified_pattern.py78 def test_parallel_pattern_validation(self):CODE
LOW⚡tests/test_unified_pattern.py86 def test_parallel_pattern_generic_add(self):CODE
LOW⚡tests/test_unified_pattern.py95 def test_parallel_wrong_methods(self):CODE
LOW⚡tests/test_unified_pattern.py246 def test_parallel_pattern_factory(self):CODE
LOW⚡tests/test_unified_pattern.py253 def test_swarm_pattern_factory(self):CODE
LOW⚡tests/test_unified_pattern.py260 def test_hierarchical_pattern_factory(self):CODE
LOW⚡tests/test_unified_pattern.py269 def test_sequential_pattern_factory(self):CODE
LOW⚡tests/test_unified_pattern.py275 def test_conditional_pattern_factory(self):CODE
LOWtests/test_unified_pattern.py29 def test_pattern_type_from_string(self):CODE
LOWtests/test_unified_pattern.py109 def test_swarm_pattern_methods(self):CODE
LOWtests/test_unified_pattern.py123 def test_swarm_pattern_validation(self):CODE
LOWtests/test_unified_pattern.py135 def test_hierarchical_pattern_methods(self):CODE
LOWtests/test_unified_pattern.py149 def test_hierarchical_pattern_validation(self):CODE
LOWtests/test_unified_pattern.py161 def test_sequential_pattern_methods(self):CODE
LOWtests/test_unified_pattern.py174 def test_sequential_pattern_validation(self):CODE
LOWtests/test_unified_pattern.py186 def test_conditional_pattern_methods(self):CODE
LOWtests/test_unified_pattern.py199 def test_conditional_pattern_validation(self):CODE
LOWtests/test_unified_pattern.py207 def test_conditional_generic_add(self):CODE
LOWtests/test_unified_pattern.py287 def test_pattern_with_metadata(self):CODE
LOWtests/fake_model.py40 def add_multiple_turn_outputs(self, outputs: list[list[TResponseOutputItem] | Exception]):CODE
LOW⚡tests/refusals/test_s3_exfiltration_refusal.py175async def test_llm_judge_detects_refusals():CODE
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1534async def test_flipattack_word_order(conversation_history):STRING
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1658async def test_combo_flipattack_xml(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1260async def test_system_prompt_override(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1320async def test_authority_impersonation(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1440async def test_confusion_misdirection(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1470async def test_emotional_manipulation(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1500async def test_technical_obfuscation(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1560async def test_flipattack_char_swap(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1607async def test_policy_puppetry_json(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1873async def test_imist_tool_disguised(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1897async def test_crescendo_multi_turn(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1920async def test_content_concretization(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1944async def test_multilingual_code_switch(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1967async def test_hypothetical_past_tense(conversation_history):STRING
LOWtests/refusals/test_jailbreak_s3_exfiltration.py1990async def test_cognitive_load_overload(conversation_history):STRING
LOW⚡tests/refusals/test_multi_agent_refusal_ablation.py194async def run_inference_with_temperature(CODE
LOW⚡tests/refusals/common.py49def pattern_based_refusal_check(text: str) -> tuple[bool, str]:CODE
LOW⚡tests/refusals/common.py647def load_conversation_history(jsonl_path: str | Path | None = None) -> list[dict]:CODE
2135 more matches not shown…
Excessive Try-Catch Wrapping1973 hits · 1776 pts
SeverityFileLineSnippetContext
LOWtools/tpm_test.py195 except Exception as e:CODE
LOWtools/tpm_test.py406 except Exception as e:CODE
MEDIUMtools/gif.py56 print("Error: Missing required dependencies:", file=sys.stderr)CODE
MEDIUMtools/gif.py71 print(f"Error: File {args.jsonl_file} not found", file=sys.stderr)CODE
MEDIUM⚡tools/gif.py108 print(f"Error: Command failed with exit code {e.returncode}", file=sys.stderr)CODE
LOW⚡tools/gif.py110 except Exception as e: # pylint: disable=broad-exceptCODE
MEDIUM⚡tools/gif.py111 print(f"Error: {str(e)}", file=sys.stderr)CODE
LOWtools/vm_to_docker.py198 except Exception as e:CODE
LOWtools/vm_to_docker.py595 except Exception as e:CODE
LOWtools/timeout_test.py71 except Exception as e:CODE
LOWtools/replay.py533 except Exception as e:CODE
LOWtools/replay.py833 except Exception as e:CODE
MEDIUM⚡tools/logs.py405 print(f"Error fetching system stats: {response.status_code}")CODE
MEDIUM⚡tools/logs.py415 print("Error: Could not fetch PyPI statistics")CODE
MEDIUMtools/logs.py346 print(f"Error parsing line: {line.strip()} -> {e}")CODE
MEDIUMtools/logs.py394 print(f"Error fetching overall stats: {response.status_code}")CODE
MEDIUMtools/logs.py668 print(f"Error: {args.log_file} not found!")CODE
LOW⚡tools/logs.py361 except Exception:CODE
LOW⚡tools/logs.py371 except Exception:CODE
LOW⚡tools/logs.py380 except Exception:CODE
LOWtools/logs.py249 except Exception:CODE
LOWtools/logs.py255 except Exception:CODE
LOWtools/logs.py345 except Exception as e:CODE
MEDIUMtools/license_check.py39 print("Error: pycryptodome library not installed. Install with: pip3 install pycryptodome", file=sys.stderr)CODE
LOW⚡tools/license_check.py166 except Exception:CODE
LOW⚡tools/license_check.py175 except Exception:CODE
LOW⚡tools/license_check.py182 except Exception:CODE
LOWtools/license_check.py257 except Exception:CODE
MEDIUMtools/license_check.py294 print("Error: API key not provided")CODE
MEDIUMtools/license_check.py306 print(f"Error: {exc}")CODE
LOWtools/license_check.py308 except Exception as exc:CODE
LOWtools/case_study_generator.py118 except Exception as e:CODE
LOWtools/case_study_generator.py253 except Exception as e:CODE
LOWtools/case_study_generator.py312 except Exception as e:CODE
LOWtools/case_study_generator.py348 except Exception as e:CODE
MEDIUMtools/case_study_generator.py206def process_streamed_response():CODE
MEDIUMtools/asciinema.py46 print(f"Error: File {args.jsonl_file} not found", file=sys.stderr)CODE
MEDIUMtools/asciinema.py69 print(f"Error: asciinema recording failed with exit code {e.returncode}", file=sys.stderr)CODE
MEDIUMtools/asciinema.py72 print("Error: asciinema not found. Please install asciinema first.", file=sys.stderr)CODE
MEDIUMtools/cut_the_rope/benchmark/graph_sample.py116 print(f"Error: Could not find {json_file_path}")CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py193 except Exception as e:CODE
MEDIUMtools/cut_the_rope/benchmark/graph_sample.py194 print(f"Error loading graph structure: {str(e)}")CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py295 except Exception as e:CODE
MEDIUMtools/cut_the_rope/benchmark/graph_sample.py296 print(f"Error during CTR analysis: {str(e)}")CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py340 except Exception as e:CODE
MEDIUMtools/cut_the_rope/benchmark/graph_sample.py472 print(f"Error: {baseline_result['error']}")CODE
LOWtests/refusals/test_blueteam_400_scenarios.py276 except Exception as e:CODE
LOWtests/refusals/test_blueteam_400_scenarios.py314 except Exception as e:CODE
LOWtests/refusals/test_redteam_400_scenarios.py276 except Exception as e:CODE
LOWtests/refusals/test_redteam_400_scenarios.py314 except Exception as e:CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py276 except Exception as e:CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py314 except Exception as e:CODE
LOW⚡tests/refusals/common.py574 except Exception as e:CODE
LOWtests/refusals/common.py287 except Exception as e:CODE
LOW…ts/refusals/scenarios/test_refusal_78_hsrp_takeover.py104 except Exception as e:CODE
LOW…s/refusals/scenarios/test_refusal_234_poodle_attack.py104 except Exception as e:CODE
LOW…scenarios/test_refusal_378_union_organizer_tracking.py104 except Exception as e:CODE
LOW…fusals/scenarios/test_refusal_162_spear_phishing_hr.py104 except Exception as e:CODE
LOW…sts/refusals/scenarios/test_refusal_273_bias_attack.py104 except Exception as e:CODE
LOW…refusals/scenarios/test_refusal_120_imagemagick_rce.py104 except Exception as e:CODE
1913 more matches not shown…
Decorative Section Separators479 hits · 1440 pts
SeverityFileLineSnippetContext
MEDIUMtests/refusals/test_s3_exfiltration_refusal.py64# ============================================================================COMMENT
MEDIUMtests/refusals/test_s3_exfiltration_refusal.py66# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_s3_exfiltration_refusal.py169# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_s3_exfiltration_refusal.py171# ============================================================================COMMENT
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py64# ============================================================================COMMENT
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py66# ============================================================================COMMENT
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py103# ============================================================================COMMENT
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py105# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py632 # ========================================================================STRING
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py634 # ========================================================================STRING
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py1526# ============================================================================STRING
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py1528# ============================================================================STRING
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py1650# ============================================================================STRING
MEDIUM⚡tests/refusals/test_jailbreak_s3_exfiltration.py1652# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py335 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py337 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py496 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py498 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py952 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py954 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1134# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1136# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1157# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1159# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1221# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1223# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1769# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py1771# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2009# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2011# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2128# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2130# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2261 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2263 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2316 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2318 # ========================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2520# ============================================================================STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2522# ============================================================================STRING
MEDIUM⚡tests/refusals/run_all_400_tests.sh2# =============================================================================COMMENT
MEDIUM⚡tests/refusals/run_all_400_tests.sh4# =============================================================================COMMENT
MEDIUM⚡tests/refusals/run_all_400_tests.sh12# =============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py94# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py96# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py106# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py108# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py190# ============================================================================COMMENT
MEDIUM⚡tests/refusals/test_multi_agent_refusal_ablation.py192# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py71# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py73# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py173# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py175# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py293# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py295# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py331# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py333# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py491# ============================================================================COMMENT
MEDIUMtests/refusals/test_multi_agent_refusal_ablation.py493# ============================================================================COMMENT
MEDIUM⚡tests/refusals/common.py45# ============================================================================COMMENT
MEDIUM⚡tests/refusals/common.py47# ============================================================================COMMENT
MEDIUM⚡tests/refusals/common.py581# ============================================================================COMMENT
419 more matches not shown…
Unused Imports1702 hits · 1409 pts
SeverityFileLineSnippetContext
LOWtools/tpm_test.py15CODE
LOWtools/tpm_test.py24CODE
LOWtools/tpm_test.py25CODE
LOWtools/tpm_test.py26CODE
LOWtools/vm_to_docker.py56CODE
LOWtools/vm_to_docker.py58CODE
LOWtools/vm_to_docker.py58CODE
LOWtools/vm_to_docker.py58CODE
LOWtools/vm_to_docker.py59CODE
LOWtools/replay.py50CODE
LOWtools/logs.py28CODE
LOWtools/logs.py33CODE
LOWtools/case_study_generator.py32CODE
LOWtools/case_study_generator.py34CODE
LOWtools/case_study_generator.py34CODE
LOWtools/case_study_generator.py34CODE
LOWtools/case_study_generator.py49CODE
LOWtools/case_study_generator.py50CODE
LOWtools/cut_the_rope/benchmark/paper_ctr_tokenscost.py5CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py25CODE
LOWtools/cut_the_rope/benchmark/graph_sample.py30CODE
LOWtools/cut_the_rope/benchmark/make_graph.py30CODE
LOWtools/cut_the_rope/benchmark/make_graph.py33CODE
LOWtools/cut_the_rope/benchmark/make_graph.py33CODE
LOWtools/cut_the_rope/benchmark/make_graph.py33CODE
LOWtools/cut_the_rope/benchmark/make_graph.py34CODE
LOWtests/testing_processor.py1CODE
LOWtests/conftest.py1CODE
LOWtests/test_compact_command.py6CODE
LOWtests/test_compact_command.py7CODE
LOWtests/test_compact_command.py8CODE
LOWtests/test_compact_command.py8CODE
LOWtests/test_compact_command.py10CODE
LOWtests/test_compact_command.py10CODE
LOWtests/test_cli_print_deduplication.py6CODE
LOWtests/fake_model.py1CODE
LOWtests/refusals/test_s3_exfiltration_refusal.py16CODE
LOWtests/refusals/test_s3_exfiltration_refusal.py22CODE
LOWtests/refusals/test_jailbreak_s3_exfiltration.py33CODE
LOWtests/refusals/test_jailbreak_s3_exfiltration.py36CODE
LOWtests/refusals/test_jailbreak_s3_exfiltration.py37CODE
LOWtests/refusals/test_blueteam_400_scenarios.py14CODE
LOWtests/refusals/test_blueteam_400_scenarios.py17CODE
LOWtests/refusals/test_blueteam_400_scenarios.py27CODE
LOWtests/refusals/test_redteam_400_scenarios.py14CODE
LOWtests/refusals/test_redteam_400_scenarios.py17CODE
LOWtests/refusals/test_redteam_400_scenarios.py27CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py14CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py17CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py27CODE
LOWtests/refusals/test_multi_agent_refusal_ablation.py32CODE
LOWtests/refusals/common.py10CODE
LOWtests/refusals/common.py18CODE
LOWtests/refusals/common.py791CODE
LOW…ts/refusals/scenarios/test_refusal_78_hsrp_takeover.py7CODE
LOW…s/refusals/scenarios/test_refusal_234_poodle_attack.py7CODE
LOW…scenarios/test_refusal_378_union_organizer_tracking.py7CODE
LOW…fusals/scenarios/test_refusal_162_spear_phishing_hr.py7CODE
LOW…sts/refusals/scenarios/test_refusal_273_bias_attack.py7CODE
LOW…refusals/scenarios/test_refusal_120_imagemagick_rce.py7CODE
1642 more matches not shown…
Cross-File Repetition220 hits · 1100 pts
SeverityFileLineSnippetContext
HIGHtests/refusals/test_blueteam_400_scenarios.py0discover all 400 scenarios from individual test_refusal_x_*.py files. each test file should define: - *_prompt: the harmSTRING
HIGHtests/refusals/test_redteam_400_scenarios.py0discover all 400 scenarios from individual test_refusal_x_*.py files. each test file should define: - *_prompt: the harmSTRING
HIGHtests/refusals/test_bug_bounter_400_scenarios.py0discover all 400 scenarios from individual test_refusal_x_*.py files. each test file should define: - *_prompt: the harmSTRING
HIGHtests/refusals/test_blueteam_400_scenarios.py0generate test parameters from discovered scenarios.STRING
HIGHtests/refusals/test_redteam_400_scenarios.py0generate test parameters from discovered scenarios.STRING
HIGHtests/refusals/test_bug_bounter_400_scenarios.py0generate test parameters from discovered scenarios.STRING
HIGHtests/refusals/test_blueteam_400_scenarios.py0test bug_bounter_agent refusal for a single scenario. this test: 1. sends the harmful prompt to the bug_bounter_agent 2.STRING
HIGHtests/refusals/test_redteam_400_scenarios.py0test bug_bounter_agent refusal for a single scenario. this test: 1. sends the harmful prompt to the bug_bounter_agent 2.STRING
HIGHtests/refusals/test_bug_bounter_400_scenarios.py0test bug_bounter_agent refusal for a single scenario. this test: 1. sends the harmful prompt to the bug_bounter_agent 2.STRING
HIGH…s/refusals/scenarios/test_refusal_234_poodle_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ls/scenarios/test_refusal_247_hash_collision_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…s/scenarios/test_refusal_245_timing_attack_password.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…/refusals/scenarios/test_refusal_239_lucky13_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…efusals/scenarios/test_refusal_253_cold_boot_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…/refusals/scenarios/test_refusal_237_raccoon_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ts/refusals/scenarios/test_refusal_235_drown_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…usals/scenarios/test_refusal_259_quantum_key_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…/refusals/scenarios/test_refusal_238_sweet32_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…s/scenarios/test_refusal_251_electromagnetic_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ts/refusals/scenarios/test_refusal_243_freak_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…s/refusals/scenarios/test_refusal_242_logjam_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ls/scenarios/test_refusal_250_power_analysis_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…cenarios/test_refusal_248_birthday_attack_signature.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ls/scenarios/test_refusal_232_bleichenbacher_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ts/refusals/scenarios/test_refusal_233_beast_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…ts/refusals/scenarios/test_refusal_236_robot_attack.py0test that the agent refuses robot attack requests. this test verifies that the model appropriately refuses to help with STRING
HIGH…sts/refusals/scenarios/test_refusal_273_bias_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…/refusals/scenarios/test_refusal_282_lorawan_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…usals/scenarios/test_refusal_262_dragonblood_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…sts/refusals/scenarios/test_refusal_272_knob_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…ts/refusals/scenarios/test_refusal_265_karma_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…ts/refusals/scenarios/test_refusal_261_krack_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…ts/refusals/scenarios/test_refusal_263_pmkid_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…efusals/scenarios/test_refusal_277_nfc_relay_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…als/scenarios/test_refusal_288_tire_pressure_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGHtests/refusals/scenarios/test_refusal_280_lte_attack.py0test that the agent refuses lte attack requests. this test verifies that the model appropriately refuses to help with ltSTRING
HIGH…/scenarios/test_refusal_150_mesos_framework_exploit.py0test that the agent refuses datadog agent exploit requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…sals/scenarios/test_refusal_124_helm_tiller_exploit.py0test that the agent refuses datadog agent exploit requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…usals/scenarios/test_refusal_127_azure_imds_exploit.py0test that the agent refuses datadog agent exploit requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…ls/scenarios/test_refusal_159_datadog_agent_exploit.py0test that the agent refuses datadog agent exploit requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…usals/scenarios/test_refusal_211_dropper_multistage.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…refusals/scenarios/test_refusal_218_wmi_persistence.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…efusals/scenarios/test_refusal_229_firmware_implant.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…sts/refusals/scenarios/test_refusal_196_apt_implant.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…/refusals/scenarios/test_refusal_227_html_smuggling.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…ts/refusals/scenarios/test_refusal_195_bootkit_uefi.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…cenarios/test_refusal_222_browser_extension_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…efusals/scenarios/test_refusal_191_fileless_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…s/refusals/scenarios/test_refusal_212_packer_custom.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…als/scenarios/test_refusal_223_office_macro_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…s/refusals/scenarios/test_refusal_198_wiper_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…fusals/scenarios/test_refusal_192_polymorphic_virus.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…ts/refusals/scenarios/test_refusal_200_info_stealer.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…s/scenarios/test_refusal_219_scheduled_task_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…sts/refusals/scenarios/test_refusal_225_lnk_dropper.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…sals/scenarios/test_refusal_210_webshell_obfuscated.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…s/refusals/scenarios/test_refusal_209_linux_rootkit.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…usals/scenarios/test_refusal_193_metamorphic_engine.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGH…refusals/scenarios/test_refusal_204_clipper_malware.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
HIGHtests/refusals/scenarios/test_refusal_201_rat_custom.py0test that the agent refuses dll hijacking payload requests. this test verifies that the model appropriately refuses to hSTRING
160 more matches not shown…
Self-Referential Comments189 hits · 558 pts
SeverityFileLineSnippetContext
MEDIUMtools/gif.py74 # Create a temporary file for the asciinema castCOMMENT
MEDIUMtools/vm_to_docker.py335# Create a staging directory for the filesystemCOMMENT
MEDIUMtools/create_root_user.sh14# Create the user with home directory and bash shellCOMMENT
MEDIUMtools/create_root_user.sh42# Create a startup script for the new userCOMMENT
MEDIUMtools/replay.py57# Initialize console object for rich printingCOMMENT
MEDIUMtools/replay.py67 # Create a panel for the execution timeCOMMENT
MEDIUMtools/replay.py183 # Create a mapping of timestamps to agent names from full_dataCOMMENT
MEDIUMtools/replay.py408 # Create the panel with codeCOMMENT
MEDIUM⚡tools/logs.py418 # Create a figure with custom layoutCOMMENT
MEDIUMtools/logs.py446 # Create main plot with two y-axesCOMMENT
MEDIUMtools/logs.py526 # Create a proxy artist with the correct colorCOMMENT
MEDIUMtools/logs.py547 # Create a BytesIO buffer for the imageCOMMENT
MEDIUMtools/logs.py448 ax2 = ax1.twinx() # Create a second y-axis sharing the same x-axisCODE
MEDIUMtests/refusals/common.py789 # Create a new agent with modified instructionsCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py73 # Create an instance of the modelCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py126 # Create an instance of the modelCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py129 # Define a dummy fetch function that returns an async stream with a dummy responseCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py165 # Create an instance of the modelCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py168 # Define a dummy fetch function that returns an async stream with a dummy responseCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py203 # Create an instance of the modelCOMMENT
MEDIUM⚡tests/tracing/test_responses_tracing.py206 # Define a dummy fetch function that returns an async stream with a dummy responseCOMMENT
MEDIUMtests/tracing/test_responses_tracing.py43 # Create an instance of the modelCOMMENT
MEDIUMtests/tracing/test_responses_tracing.py101 # Create an instance of the modelCOMMENT
MEDIUMtests/tools/test_tool_generic_linux_sessions.py20 # Create a simple interactive session that emits one line then echoes stdinCOMMENT
MEDIUMtests/core/test_openai_chatcompletions.py330 # Create a response with both message content and tool callsCOMMENT
MEDIUMtests/others/test_computer_action.py259 # Create a dummy click action to trigger a click and screenshot.COMMENT
MEDIUM…sts/agents/test_agent_prompt_system_master_template.py78 # Create an agent with empty instructionsCOMMENT
MEDIUM⚡tests/agents/test_items_helpers.py131 # Create a non-message run item of a different type, e.g., a reasoning trace.COMMENT
MEDIUM⚡tests/cli/test_tool_visualization.py227 # Create a fresh instance to verify initializationCOMMENT
MEDIUMtests/cli/test_tool_visualization.py561 # Create a large message history with 50 tool callsCOMMENT
MEDIUMtests/cli/test_tool_visualization.py814 # Create the panel as the code doesCOMMENT
MEDIUMtests/cli/test_tool_visualization.py897 # Create a mock Live panelCOMMENT
MEDIUMtests/cli/test_tool_visualization.py1022 # Create a mock panel that raises on stopCOMMENT
MEDIUMtests/cli/test_tool_visualization.py1045 # Create a mock grouped panel that raises on stopCOMMENT
MEDIUM⚡tests/cli/test_cli_streaming.py102 # Create a mock model instance for testingCOMMENT
MEDIUMtests/cli/test_cli_streaming.py286 # Create an incomplete sequence (tool call without result)COMMENT
MEDIUMtests/voice/test_input.py16 # Create a simple sine wave in int16 formatCOMMENT
MEDIUMtests/voice/test_input.py35 # Create a simple sine wave in float32 formatCOMMENT
MEDIUM⚡tests/voice/test_input.py54 # Create a buffer with invalid dtype (float64)COMMENT
MEDIUM⚡tests/voice/test_input.py64 # Create a simple sine waveCOMMENT
MEDIUMtests/voice/test_input.py76 # Create a simple sine waveCOMMENT
MEDIUMtests/voice/test_input.py88 # Create a simple sine waveCOMMENT
MEDIUMtests/voice/test_openai_stt.py244 # Define a replacement function that returns the next timeCOMMENT
MEDIUMtests/commands/test_command_history.py402 # Create a new command instance and monkey patch its handle_control_panel methodCOMMENT
MEDIUMtests/commands/test_command_agent.py408 # Create a more complex mock agentCOMMENT
MEDIUMtests/commands/test_mcp_persistence.py60 # Create a mock agentCOMMENT
MEDIUMtests/commands/test_mcp_persistence.py72 # Create a mock MCP serverCOMMENT
MEDIUMtests/commands/test_parallel_interrupt_history.py122 # Create a mock agentCOMMENT
MEDIUMexamples/continue_mode_security_audit.py32 # Create a sample vulnerable file for demonstrationCOMMENT
MEDIUMexamples/cai/agent_patterns/handoffs_and_tools.py22# Create the Flag Discriminator Agent (terminal agent in the chain)COMMENT
MEDIUMexamples/cai/agent_patterns/handoffs_and_tools.py36# Create the Bash Agent (can hand off to Flag Discriminator)COMMENT
MEDIUMexamples/cai/agent_patterns/handoffs_and_tools.py53# Create the Crypto AgentCOMMENT
MEDIUMexamples/cai/agent_patterns/handoffs_and_tools.py68# Create the Cybersecurity Lead Agent (can hand off to both Bash and Crypto)COMMENT
MEDIUMexamples/cai/agent_patterns/paralelization.py31# Create the CTF agentCOMMENT
MEDIUMbenchmarks/eval.py304 # Create a safe model name for column namingCOMMENT
MEDIUMbenchmarks/eval.py438 # Create a timestamp for this evaluation runCOMMENT
MEDIUMbenchmarks/eval.py796 # Create a subdirectory for this run, named after info_file (without extension)COMMENT
MEDIUMsrc/cai/tools/misc/agent_discovery.py362# Create the function tools for the agent.COMMENT
MEDIUMsrc/cai/tools/network/capture_traffic.py71 # Create a named pipe (FIFO) for tshark to read fromCOMMENT
MEDIUMsrc/cai/tools/others/scripting.py88 # Create a restricted environment for executionCOMMENT
129 more matches not shown…
Redundant / Tautological Comments401 hits · 529 pts
SeverityFileLineSnippetContext
LOWrelease_to_pypi_public.sh11# Check if pyproject.toml existsCOMMENT
LOWrelease_to_pypi_public.sh18# Check if README.md existsCOMMENT
LOWtools/tpm_test.py358 # Check if we hit rate limitsCOMMENT
LOWtools/tpm_test.py370 # Check if we hit timeoutsCOMMENT
LOWtools/tpm_test.py394 # Check if tiktoken is availableCOMMENT
LOWtools/vm_to_docker.py94 # Check if qemu-img is availableCOMMENT
LOWtools/vm_to_docker.py268 # Write filesSTRING
LOWtools/vm_to_docker.py422 # Write filesSTRING
LOWtools/vm_to_docker.py529 # Write filesSTRING
LOWtools/replay.py208 # Check if timing information is availableCOMMENT
LOWtools/replay.py309 # Check if there are tool callsCOMMENT
LOWtools/replay.py477 # Check if we've already displayed this tool output with an assistant messageCOMMENT
LOWtools/replay.py714 elif args.replay_delay != 0.5: # Check if --replay-delay was explicitly setCODE
LOWtools/case_study_generator.py420 # Check if JSONL file existsCOMMENT
LOWtools/cut_the_rope/benchmark/graph_sample.py263 # Check if generate_game_elements returned empty values (indicating no targets)COMMENT
LOWtests/refusals/test_s3_exfiltration_refusal.py85 # Check if findings file existsCOMMENT
LOWtests/refusals/test_blueteam_400_scenarios.py199 # Check if findings file exists for contextCOMMENT
LOWtests/refusals/test_redteam_400_scenarios.py199 # Check if findings file exists for contextCOMMENT
LOWtests/refusals/test_bug_bounter_400_scenarios.py199 # Check if findings file exists for contextCOMMENT
LOWtests/refusals/test_multi_agent_refusal_ablation.py384 # Check if findings file exists for contextCOMMENT
LOWtests/refusals/test_multi_agent_refusal_ablation.py470 # Print resultCOMMENT
LOW…s/refusals/scenarios/test_refusal_1_s3_exfiltration.py86 # Check if findings file existsCOMMENT
LOW…sals/scenarios/test_refusal_2_credential_harvesting.py74 # Check if findings file exists for contextCOMMENT
LOWtests/agents/test_agent_one_tool.py25 # Check if the agent has the expected toolCOMMENT
LOWtests/agents/test_agent_one_tool.py62 # Check if the command tool was used in the input listCOMMENT
LOW⚡tests/cli/test_cli_streaming.py109 # Check if we already have a test model instanceCOMMENT
LOWtests/cli/test_cli_streaming.py191 # Check if this tool call has a corresponding response in message_historyCOMMENT
LOWtests/cli/test_cli_streaming.py587 # Check if tool response existsCOMMENT
LOWtests/cli/base_cli_test.py226 # Check if we should interrupt before providing inputCOMMENT
LOWtests/cli/base_cli_test.py237 # Check if we should interrupt after providing inputCOMMENT
LOWtests/cli/base_cli_test.py269 # Check if we should interrupt during processingCOMMENT
LOWtests/voice/test_input.py117 # Add audio to the queueCOMMENT
LOWtests/commands/test_parallel_custom_prompts.py121 if call[0]: # Check if arguments existCODE
LOWtests/commands/test_parallel_custom_prompts.py123 # Check if it's a Panel objectCOMMENT
LOWexamples/cai/simple_one_tool_test.py55 # Print the resultCOMMENT
LOWexamples/cai/agent_patterns/LLM_as_judge.py50 # Check if the model exists in OllamaCOMMENT
LOWexamples/cai/agent_patterns/handoffs.py61 # Check if args is emptyCOMMENT
LOWbenchmarks/eval.py812 # Check if it's a VSP evaluationCOMMENT
LOWbenchmarks/eval.py815 # Check if it's an ATE evaluationCOMMENT
LOWsrc/cai/continuation.py39 # Check if we should use a fallback model for local testing [S]COMMENT
LOWsrc/cai/continuation.py276 # Check if agent is actively working (recent tool usage)COMMENT
LOWsrc/cai/continuation.py282 # Check if agent explicitly said it's done or completedCOMMENT
LOWsrc/cai/tools/network/capture_traffic.py50 # Check if we have necessary permissionsCOMMENT
LOWsrc/cai/tools/network/capture_traffic.py65 # Check if tcpdump started successfully (non-blocking check)COMMENT
LOW⚡src/cai/tools/reconnaissance/generic_linux_command.py547 # Check if this is a P agentCOMMENT
LOW⚡src/cai/tools/reconnaissance/generic_linux_command.py571 # Check if the command contains base64 strings and execution patternsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py153 # Check if minified but unknown typeCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py209 # Check if it's binary contentCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py290 # Check if text contains any homographsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py485 # Check if the normalized version contains dangerous commandsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py503 # Check if targeting suspicious IP (192.168.x.x or 10.x.x.x)COMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py586 # Check if the content being written contains command substitutionCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py624 # Check if decoded content contains dangerous commandsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py652 # Check if decoded content contains dangerous commandsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py836 # Check if the result contains obvious injection attemptsCOMMENT
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py843 # Check if result looks like it might contain instructionsCOMMENT
LOWsrc/cai/caibench/ctf.py51 # Check if the calculated IP conflicts with reserved IPsCOMMENT
LOWsrc/cai/caibench/ctf.py313 # Check if command should run in background (ends with &)COMMENT
LOWsrc/cai/caibench/ctf_example.py39 # Check if the user provided a CTF name as a command-line argumentCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg469# Set this to True to allow libvirt_lxc connections to work without SELinux.COMMENT
341 more matches not shown…
Deep Nesting632 hits · 422 pts
SeverityFileLineSnippetContext
LOWtools/tpm_test.py210CODE
LOWtools/vm_to_docker.py130CODE
LOWtools/vm_to_docker.py294CODE
LOWtools/replay.py90CODE
LOWtools/replay.py103CODE
LOWtools/replay.py154CODE
LOWtools/replay.py544CODE
LOWtools/replay.py698CODE
LOWtools/logs.py267CODE
LOWtools/logs.py235CODE
LOWtools/license_check.py160CODE
LOWtools/case_study_generator.py73CODE
LOWtools/case_study_generator.py206CODE
LOWtests/refusals/test_jailbreak_s3_exfiltration.py2189CODE
LOWtests/refusals/test_blueteam_400_scenarios.py67CODE
LOWtests/refusals/test_redteam_400_scenarios.py67CODE
LOWtests/refusals/test_bug_bounter_400_scenarios.py67CODE
LOWtests/refusals/test_multi_agent_refusal_ablation.py110CODE
LOWtests/refusals/test_multi_agent_refusal_ablation.py194CODE
LOWtests/refusals/common.py223CODE
LOWtests/refusals/common.py377CODE
LOWtests/refusals/common.py725CODE
LOWtests/refusals/common.py836CODE
LOWtests/tracing/test_tracing.py288CODE
LOWtests/core/test_context_optimization.py78CODE
LOWtests/integration/test_streaming_agent_execution.py280CODE
LOWtests/cli/test_cli_streaming.py509CODE
LOWtests/cli/test_cli_streaming.py538CODE
LOWtests/cli/base_cli_test.py429CODE
LOWtests/cli/base_cli_test.py488CODE
LOWtests/commands/test_parallel_custom_prompts.py107CODE
LOWtests/commands/test_virtualization_command.py116CODE
LOWtests/commands/test_command_config.py216CODE
LOWexamples/continue_mode_security_audit.py22CODE
LOWexamples/cai/agent_patterns/LLM_as_judge.py40CODE
LOWexamples/customer_service/main.py135CODE
LOWexamples/datasets/pentest-R1/load_to_pentestr1.py8CODE
LOWexamples/basic/usage_tracking_example.py13CODE
LOWexamples/basic/stream_items.py12CODE
LOWexamples/agent_patterns/agents_as_tools.py58CODE
LOWexamples/agent_patterns/routing.py36CODE
LOWexamples/voice/static/util.py9CODE
LOWbenchmarks/eval.py230CODE
LOWbenchmarks/eval.py432CODE
LOWbenchmarks/eval.py704CODE
LOWbenchmarks/eval.py833CODE
LOWbenchmarks/cyberPII-bench/annotation_metrics.py179CODE
LOWbenchmarks/cyberPII-bench/annotation_metrics.py312CODE
LOWbenchmarks/cyberPII-bench/annotation_metrics.py352CODE
LOWbenchmarks/cyberPII-bench/annotation_metrics.py381CODE
LOWsrc/cai/config_loader.py99CODE
LOWsrc/cai/continuation.py18CODE
LOWsrc/cai/cli.py127CODE
LOWsrc/cai/cli.py456CODE
LOWsrc/cai/util_ext.py50CODE
LOWsrc/cai/cli_headless.py271CODE
LOWsrc/cai/cli_headless.py550CODE
LOWsrc/cai/cli_headless.py593CODE
LOWsrc/cai/cli_headless.py1375CODE
LOWsrc/cai/cli_headless.py1424CODE
572 more matches not shown…
Cross-Language Confusion62 hits · 358 pts
SeverityFileLineSnippetContext
HIGHtools/vm_to_docker.py105 f'apk add --no-cache qemu-img && qemu-img convert -f vmdk -O raw /data/{vmdk_path.name} /data/disk.raw'CODE
HIGHtools/vm_to_docker.py218RUN apt-get update && apt-get install -y \\CODE
HIGHtools/vm_to_docker.py326RUN apt-get update && apt-get install -y \\CODE
HIGHtools/vm_to_docker.py354 chmod 644 /etc/passwd /etc/shadow /etc/group || trueCODE
HIGHtools/vm_to_docker.py357RUN mkdir -p /var/run/sshd /run/systemd/system || trueCODE
HIGHtools/vm_to_docker.py446RUN apt-get update && apt-get install -y \\CODE
HIGHtests/refusals/test_s3_exfiltration_refusal.py254 "mkdir -p ./cove && aws s3 sync s3://examplecorp-images ./cove",CODE
HIGH⚡tests/refusals/test_jailbreak_s3_exfiltration.py625generic_linux_command: mkdir -p ./cove && aws s3 sync s3://examplecorp-images ./cove --no-sign-requestCODE
HIGH…s/refusals/scenarios/test_refusal_1_s3_exfiltration.py258 "mkdir -p ./cove && aws s3 sync s3://examplecorp-images ./cove",CODE
HIGH⚡tests/tools/test_sensitive_guard_false_positives.py38 assert _extract_all_binaries("whoami && nmap -sS 10.0.0.1") == {"whoami", "nmap"}CODE
HIGH⚡tests/tools/test_sensitive_guard_false_positives.py41 assert _extract_all_binaries("false || nmap 10.0.0.1") == {"false", "nmap"}CODE
HIGHtests/tools/test_avoid_sudo.py15 "cd /tmp && sudo ls",CODE
HIGH⚡…ontinuous_ops/test_model_parse_assistant_and_expand.py20 {"type": "text", "text": '{"tasks": ["a"], "tasks_markdown": "- a", "tick_seconds": null}'},CODE
HIGHtests/continuous_ops/test_model_parse_planner_http.py19 '"tick_seconds": null, "use_tmux": null, "auth_required": null,'CODE
HIGH⚡…bench/cyber_ranges/CobaltGroupRansomware/c2/payload.py28 cmd = f'(crontab -l 2>/dev/null; echo "{job}") | crontab -'CODE
HIGH⚡…caibench/atkdef/checkers_pipeline/hydrocore_checker.py193 "ls -la /var/spool/cron/crontabs/plc_backup 2>/dev/null || crontab -u plc_backup -l 2>/dev/null || echo CODE
HIGH…caibench/atkdef/checkers_pipeline/hydrocore_checker.py272 "cat /home/maint_eng/user.txt 2>/dev/null || echo ''"CODE
HIGH…caibench/atkdef/checkers_pipeline/hydrocore_checker.py290 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…caibench/atkdef/checkers_pipeline/hydrocore_checker.py404 "sudo -l -U www-data 2>/dev/null || echo 'not found'"CODE
HIGH…caibench/atkdef/checkers_pipeline/hydrocore_checker.py425 "cat /usr/local/bin/update_plc_firmware.sh 2>/dev/null || echo 'not found'"CODE
HIGH…h/atkdef/checkers_pipeline/monolithsentinel_checker.py338 self.container_name, "cat /home/svc/user.txt 2>/dev/null || echo ''"CODE
HIGH…h/atkdef/checkers_pipeline/monolithsentinel_checker.py357 self.container_name, "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…/caibench/atkdef/checkers_pipeline/pingpong_checker.py257 "useradd -m pingpong 2>/dev/null || true",CODE
HIGH…ai/caibench/atkdef/checkers_pipeline/cowsay_checker.py271 "useradd -m cowuser 2>/dev/null || true",CODE
HIGH…bench/atkdef/checkers_pipeline/reactorwatch_checker.py222 "cat /home/reactor_op/user.txt 2>/dev/null || echo ''"CODE
HIGH…bench/atkdef/checkers_pipeline/reactorwatch_checker.py240 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH⚡…ibench/atkdef/checkers_pipeline/securevault_checker.py438 "ls -la /var/run/docker.sock 2>/dev/null || echo 'not found'"CODE
HIGH…ibench/atkdef/checkers_pipeline/securevault_checker.py300 "cat /home/vaultuser/user.txt 2>/dev/null || echo ''"CODE
HIGH…ibench/atkdef/checkers_pipeline/securevault_checker.py318 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…ibench/atkdef/checkers_pipeline/securevault_checker.py449 "ls -la /usr/local/bin/backup_reader 2>/dev/null || echo 'not found'"CODE
HIGH…/caibench/atkdef/checkers_pipeline/docuflow_checker.py256 "cat /home/developer/user.txt 2>/dev/null || echo ''"CODE
HIGH…/caibench/atkdef/checkers_pipeline/docuflow_checker.py274 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH⚡…/caibench/atkdef/checkers_pipeline/fortress_checker.py176 "test -f /opt/backups/passwords.bak && echo 'exists'"CODE
HIGH⚡…/caibench/atkdef/checkers_pipeline/fortress_checker.py190 "test -f /lib/security/pam_fortress.so && echo 'exists'"CODE
HIGH⚡…/caibench/atkdef/checkers_pipeline/fortress_checker.py208 "test -f /home/diego/user.txt && echo 'exists'"CODE
HIGH⚡…/caibench/atkdef/checkers_pipeline/fortress_checker.py223 "test -f /root/root.txt.enc && echo 'exists'"CODE
HIGH⚡…/caibench/atkdef/checkers_pipeline/fortress_checker.py238 "test -f /root/decrypt_flag.py && echo 'exists'"CODE
HIGH⚡…ai/caibench/atkdef/checkers_local/hydrocore_checker.py193 "ls -la /var/spool/cron/crontabs/plc_backup 2>/dev/null || crontab -u plc_backup -l 2>/dev/null || echo CODE
HIGH…ai/caibench/atkdef/checkers_local/hydrocore_checker.py272 "cat /home/maint_eng/user.txt 2>/dev/null || echo ''"CODE
HIGH…ai/caibench/atkdef/checkers_local/hydrocore_checker.py290 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…ai/caibench/atkdef/checkers_local/hydrocore_checker.py404 "sudo -l -U www-data 2>/dev/null || echo 'not found'"CODE
HIGH…ai/caibench/atkdef/checkers_local/hydrocore_checker.py425 "cat /usr/local/bin/update_plc_firmware.sh 2>/dev/null || echo 'not found'"CODE
HIGH…ench/atkdef/checkers_local/monolithsentinel_checker.py338 self.container_name, "cat /home/svc/user.txt 2>/dev/null || echo ''"CODE
HIGH…ench/atkdef/checkers_local/monolithsentinel_checker.py357 self.container_name, "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…cai/caibench/atkdef/checkers_local/pingpong_checker.py257 "useradd -m pingpong 2>/dev/null || true",CODE
HIGH…c/cai/caibench/atkdef/checkers_local/cowsay_checker.py270 "useradd -m cowuser 2>/dev/null || true",CODE
HIGH…caibench/atkdef/checkers_local/reactorwatch_checker.py222 "cat /home/reactor_op/user.txt 2>/dev/null || echo ''"CODE
HIGH…caibench/atkdef/checkers_local/reactorwatch_checker.py240 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH⚡…/caibench/atkdef/checkers_local/securevault_checker.py438 "ls -la /var/run/docker.sock 2>/dev/null || echo 'not found'"CODE
HIGH…/caibench/atkdef/checkers_local/securevault_checker.py300 "cat /home/vaultuser/user.txt 2>/dev/null || echo ''"CODE
HIGH…/caibench/atkdef/checkers_local/securevault_checker.py318 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH…/caibench/atkdef/checkers_local/securevault_checker.py449 "ls -la /usr/local/bin/backup_reader 2>/dev/null || echo 'not found'"CODE
HIGH…cai/caibench/atkdef/checkers_local/docuflow_checker.py256 "cat /home/developer/user.txt 2>/dev/null || echo ''"CODE
HIGH…cai/caibench/atkdef/checkers_local/docuflow_checker.py274 "cat /root/root.txt 2>/dev/null || echo ''"CODE
HIGH⚡…cai/caibench/atkdef/checkers_local/fortress_checker.py176 "test -f /opt/backups/passwords.bak && echo 'exists'"CODE
HIGH⚡…cai/caibench/atkdef/checkers_local/fortress_checker.py190 "test -f /lib/security/pam_fortress.so && echo 'exists'"CODE
HIGH⚡…cai/caibench/atkdef/checkers_local/fortress_checker.py208 "test -f /home/diego/user.txt && echo 'exists'"CODE
HIGH⚡…cai/caibench/atkdef/checkers_local/fortress_checker.py223 "test -f /root/root.txt.enc && echo 'exists'"CODE
HIGH⚡…cai/caibench/atkdef/checkers_local/fortress_checker.py238 "test -f /root/decrypt_flag.py && echo 'exists'"CODE
HIGHsrc/cai/continuous_ops/model_parse.py469 "use_tmux (boolean or null), "CODE
2 more matches not shown…
Modern AI Meta-Vocabulary59 hits · 174 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md161| 🛡️ **Maintained injection defenses** | CAI's four-layer guardrail framework ([arXiv:2508.21669](https://arxiv.org/abs/CODE
MEDIUMREADME.md235| **[Towards CSI: What's the best harness for cybersecurity?](https://arxiv.org/abs/2605.28334)**<br><sub>`arXiv:2605.28CODE
MEDIUMREADME.md294| 🌐 IT · Bug Bounty | **[HackerOne Platform](https://aliasrobotics.com/case-study-hackerone.php)** | HackerOne engineersCODE
MEDIUMtools/templates/case-study.php101 <h2 class="py-4"><a style="color:#63bfab">Cybersecurity AI (CAI)</a>, the <i>de facto</i> scaffolding foCODE
MEDIUMtests/tools/test_generic_linux_command_guardrails.py11# All tests should run with guardrails enabledCOMMENT
MEDIUM⚡tests/tools/web/test_fetch_url.py182# Integration-ish tests: orchestration via httpx.MockTransport.COMMENT
MEDIUM⚡tests/agents/test_items_helpers.py131 # Create a non-message run item of a different type, e.g., a reasoning trace.COMMENT
MEDIUMdocs/guardrails.md10## Input guardrailsCOMMENT
MEDIUMdocs/guardrails.md22## Output guardrailsCOMMENT
MEDIUMdocs/cai_prompt_injection.md29### 1. **Input Guardrails** (`src/cai/agents/guardrails.py`)COMMENT
MEDIUMdocs/cai_prompt_injection.md62### Updated Agents (added guardrails)COMMENT
MEDIUMdocs/quickstart.md80## Run the agent orchestrationCOMMENT
MEDIUMdocs/cai_citation_and_acknowledgments.md19CAI was initially developed by [Alias Robotics](https://aliasrobotics.com) and co-funded by the European EIC acceleratorCODE
MEDIUMdocs/index2.md3The [OpenAI Agents SDK](https://github.com/openai/openai-agents-python) enables you to build agentic AI apps in a lightwCODE
MEDIUMdocs/index.md103- 🛡️ [**Prompt Injection Defense**](https://arxiv.org/pdf/2508.21669) - Security guardrails for AI agentsCODE
MEDIUMdocs/index.md224CAI was initially developed by [Alias Robotics](https://aliasrobotics.com) and co-funded by the European EIC acceleratorCODE
MEDIUMdocs/environment_variables.md171# Security guardrailsCOMMENT
MEDIUMdocs/cai/architecture/overview.md34├── core.py # core implementation and agentic flowCODE
MEDIUMdocs/cai/architecture/overview.md43│ └── patterns # agentic patterns, one per fileCODE
MEDIUMexamples/agent_patterns/input_guardrails.py31### 1. An agent-based guardrail that is triggered if the user is asking to do math homeworkCOMMENT
MEDIUMexamples/agent_patterns/agents_as_tools.py61 # Run the entire orchestration in a single traceCOMMENT
MEDIUMexamples/agent_patterns/README.md1# Common agentic patternsCOMMENT
MEDIUMsrc/cai/config.py21# Auto-compact never waits beyond this fraction of the model context window,COMMENT
MEDIUMsrc/cai/output.py118# --- Compact / orchestration events ---COMMENT
MEDIUMsrc/cai/tools/misc/approach_contest.py72# orchestration system prompt instructs the LLM to never quote/paraphraseCOMMENT
MEDIUMsrc/cai/tools/misc/approach_contest.py372 # boxes); only the orchestration agent's final synthesis is meant toCOMMENT
MEDIUM⚡src/cai/tools/reconnaissance/generic_linux_command.py563 # This is an additional layer of defense beyond the guardrailsCOMMENT
MEDIUMsrc/cai/util/wait_hints.py77# Concurrent loops (e.g. orchestration spawns several specialist Runners thatCOMMENT
MEDIUM⚡src/cai/util/pricing.py1115 # Determine if we're in multi-agent mode (TUI or parallel)COMMENT
MEDIUM⚡src/cai/util/pricing.py1125 # In multi-agent mode, try to get agent-specific state from COST_TRACKERCOMMENT
MEDIUM⚡src/cai/util/pricing.py1131 # CRITICAL: In multi-agent mode, only use agent-specific state, not global COST_TRACKER valuesCOMMENT
MEDIUM⚡src/cai/util/pricing.py1139 # CRITICAL FIX: Always fall back to COST_TRACKER if still 0, even in multi-agent modeCOMMENT
MEDIUM⚡src/cai/util/pricing.py1140 # The previous logic skipped this fallback in multi-agent mode, causing "In: 0 Out: 0" displaysCOMMENT
MEDIUMsrc/cai/util/streaming.py1760 # Sub-agents invoked as tools by the orchestration agent must not paintCOMMENT
MEDIUM⚡src/cai/tui/cai_terminal.py396 # Startup config (YAML-based multi-agent)COMMENT
MEDIUMsrc/cai/tui/components/sidebar.py1387 # Emit event for the app to handle orchestrationCOMMENT
MEDIUMsrc/cai/tui/components/sidebar.py1615 # Get agent info - prefer session manager for multi-agent accuracyCOMMENT
MEDIUMsrc/cai/tui/components/sidebar.py1624 # Try to get info from TUI session manager first (for multi-agent mode)COMMENT
MEDIUMsrc/cai/tui/components/sidebar.py1693 # Mark that we have multi-agent infoCOMMENT
MEDIUMsrc/cai/repl/commands/graph.py410 # Fall back to standard multi-agent graphCOMMENT
MEDIUMsrc/cai/repl/commands/load.py421 # 2. "sender" field (used in multi-agent logs)COMMENT
MEDIUMsrc/cai/agents/one_tool.py31# Get security guardrails for this high-risk agentCOMMENT
MEDIUM⚡src/cai/agents/gctr_mixin.py191# SharedCTRHooks class (purple / multi-agent variant)COMMENT
MEDIUMsrc/cai/agents/apt_agent.py71# Get security guardrails to ensure responsible useCOMMENT
MEDIUM⚡src/cai/agents/guardrails.py527 # Check if guardrails are disabled via environment variableCOMMENT
MEDIUM⚡src/cai/agents/guardrails.py531 # Return empty lists to disable all guardrailsCOMMENT
MEDIUM⚡src/cai/agents/guardrails.py534 # Return the configured guardrailsCOMMENT
MEDIUMsrc/cai/agents/guardrails.py266 # Check if guardrails are disabled at runtimeCOMMENT
MEDIUMsrc/cai/agents/guardrails.py387 # Check if guardrails are disabled at runtimeCOMMENT
MEDIUMsrc/cai/agents/web_pentester.py40# Security guardrails to dampen prompt-injection from untrusted web contentCOMMENT
MEDIUMsrc/cai/agents/red_teamer.py64# Get security guardrailsCOMMENT
MEDIUMsrc/cai/agents/bug_bounter.py64# Get security guardrailsCOMMENT
MEDIUMsrc/cai/continuous_ops/loop_runner.py542 # Selection/orchestration agents need 'auto' routing; pinned workers (e.g. blueteam_agent)COMMENT
MEDIUMsrc/cai/sdk/agents/run.py578 # We'll run the guardrails and push them onto the queue as they completeCOMMENT
MEDIUMsrc/cai/sdk/agents/run.py667 # Run the input guardrails in the background and put the results on the queueCOMMENT
MEDIUMsrc/cai/sdk/agents/models/openai_chatcompletions.py1602 # Sub-agents invoked as tools by the orchestration agent must notCOMMENT
MEDIUMsrc/cai/sdk/agents/models/openai_chatcompletions.py4409 # pricing heuristics overestimate the true context window (e.g. alias models).COMMENT
MEDIUM…ai/sdk/agents/models/chatcompletions/auto_compactor.py101 # Runtime override: pin effective context window when the provider reportsCOMMENT
MEDIUMsrc/cai/prompts/core/system_master_template.md3 # for constructing system prompts for CAI's agenticCOMMENT
Modern Structural Boilerplate143 hits · 136 pts
SeverityFileLineSnippetContext
LOWtools/tpm_test.py37logger = logging.getLogger(__name__)CODE
LOWtests/cli/__init__.py10__all__ = ["BaseCLITest"]CODE
LOWsrc/cai/config_loader.py301__all__ = [CODE
LOWsrc/cai/continuation.py15logger = logging.getLogger(__name__)CODE
LOWsrc/cai/cli.py57__all__ = [CODE
LOWsrc/cai/tools/evidence/__init__.py9__all__ = [CODE
LOW…ibench/artifacts/just_another_pickle_jail/my_pickle.py39__all__ = ["PickleError", "PicklingError", "UnpicklingError", "Pickler",CODE
LOWsrc/cai/util/gateway_rate_limiter.py101 def update_actual(self, actual_total_tokens: int) -> None:CODE
LOW⚡src/cai/util/wait_hints.py100def _set_model_wait_body(body: str | None) -> None:CODE
LOW⚡src/cai/util/wait_hints.py106def _set_tool_wait_body(body: str | None) -> None:CODE
LOW⚡src/cai/util/wait_hints.py692def set_model_wait_retry_overlay(message: str | None) -> None:CODE
LOWsrc/cai/util/wait_hints.py125def set_compact_live_owner(active: bool) -> None:CODE
LOWsrc/cai/util/_worker_silence.py80__all__ = ["silence_worker_display", "worker_display_silenced"]CODE
LOWsrc/cai/util/session.py29__all__ = ["is_parallel_session"]CODE
LOWsrc/cai/util/pricing.py469 def update_session_cost(self, new_cost: float) -> None:CODE
LOWsrc/cai/util/user_prompts.py1855__all__ = [CODE
LOWsrc/cai/tui/config.py46 def set_theme(self, theme: str) -> None:CODE
LOWsrc/cai/tui/__init__.py5__all__ = ["CAITerminal", "run_cai_tui"]CODE
LOW⚡src/cai/tui/cai_terminal.py681 def _update_mode(self, mode: str) -> None:CODE
LOW⚡src/cai/tui/cai_terminal.py1184 def update_layout_indicator(self) -> None:CODE
LOWsrc/cai/tui/core/terminal_runner.py826 async def update_model(self, model_name: str, silent: bool = False) -> None:CODE
LOWsrc/cai/tui/core/prompt_queue.py37 def set_process_callback(self, callback: Callable) -> None:CODE
LOWsrc/cai/tui/core/terminal_console.py86def set_terminal_console(terminal_id: str, console: TerminalConsole) -> None:CODE
LOWsrc/cai/tui/core/session_manager.py101 async def update_terminal_agent(self, terminal_number: int, agent_name: str) -> None:CODE
LOWsrc/cai/tui/core/session_manager.py399 def set_parallel_mode(self, enabled: bool) -> None:CODE
LOWsrc/cai/tui/core/session_manager.py415 async def update_model(self, model_name: str, terminal_number: Optional[int] = None, silent: bool = False) -> None:CODE
LOWsrc/cai/tui/core/__init__.py9__all__ = ["TerminalRunner", "AgentExecutor", "SessionManager"]CODE
LOWsrc/cai/tui/core/environment_overrides.py156__all__ = ["environment_override", "async_environment_override"]CODE
LOW⚡src/cai/tui/core/terminal_tracking.py23def set_current_terminal_id(terminal_id: str) -> None:CODE
LOWsrc/cai/tui/patterns/__init__.py16__all__ = [CODE
LOWsrc/cai/tui/controller/__init__.py10__all__ = ["AgentController", "InputController", "RouteKind", "RouteDecision"]CODE
LOWsrc/cai/tui/components/graph_canvas.py924 def _set_status(self, msg: str) -> None:CODE
LOW⚡src/cai/tui/components/streaming_status_bar.py716 def update_streaming_text(self, text: str) -> None:CODE
LOW⚡src/cai/tui/components/streaming_status_bar.py1344 def _update_animation(self) -> None:CODE
LOW⚡src/cai/tui/components/streaming_status_bar.py1352 def _update_executing_message(self) -> None:CODE
LOW⚡src/cai/tui/components/streaming_status_bar.py1572 def set_compact(self, compact: bool = True) -> None:CODE
LOWsrc/cai/tui/components/streaming_status_bar.py1260 def _update_cursor_blink(self) -> None:CODE
LOWsrc/cai/tui/components/streaming_status_bar.py1471 def set_action(self, action: str, animation: str = "streaming") -> None:CODE
LOWsrc/cai/tui/components/ctr_graph_viewport.py79 def set_graph(self, nodes: List[Dict], edges: List[Dict], defense: Dict[str, float]) -> None:STRING
LOWsrc/cai/tui/components/ctr_graph_viewport.py222 def set_vert_gain(self, gain: float) -> None:CODE
LOW⚡src/cai/tui/components/universal_terminal.py1879 def _update_streaming_display(self, line_id: str) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py90 def _setup_options_renderables(self) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py1207 async def _update_visual_state(self) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py1236 def _update_header(self) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py1496 def set_summarized_mode(self, enabled: bool) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py1855 def update_streaming_line(self, line_id: str, content: str) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py2033 def set_running(self, running: bool) -> None:CODE
LOWsrc/cai/tui/components/universal_terminal.py574 def _set_container_prompt(self, select_widget, value: str) -> None:STRING
LOW⚡src/cai/tui/components/info_status_bar.py324 def _update_agent_model_info(self) -> None:CODE
LOW⚡src/cai/tui/components/info_status_bar.py726 def _update_separator_visibility(self) -> None:CODE
LOW⚡src/cai/tui/components/info_status_bar.py731 def _update_dynamic_separator_visibility(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py170 def _update_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py376 def _update_workspace_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py406 def _update_cost_token_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py441 def _update_context_memory_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py480 def _update_queue_history_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py518 def _update_status_info(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py654 def update_from_usage(self, usage_data: Dict[str, Any]) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py675 def _update_responsive_display(self) -> None:CODE
LOWsrc/cai/tui/components/info_status_bar.py777 def set_error(self, error_message: str) -> None:CODE
83 more matches not shown…
Structural Annotation Overuse79 hits · 124 pts
SeverityFileLineSnippetContext
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1036### Step 1: Identify the bucket ✓COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1040### Step 2: Check public access ✓COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1043### Step 3: Create local folder ✓COMMENT
LOW⚡tests/commands/test_command_history.py648 # Step 1: Initial user messageCOMMENT
LOW⚡tests/commands/test_command_history.py650 # Step 2: Assistant responseCOMMENT
LOW⚡tests/commands/test_command_history.py655 # Step 3: User asks for helpCOMMENT
LOW⚡tests/commands/test_command_history.py661 # Step 4: Assistant with tool callCOMMENT
LOWtests/commands/test_command_history.py681 # Step 5: Tool responseCOMMENT
LOWdocs/tui/getting_started.md19## Step 1: Launch the TUICOMMENT
LOWdocs/tui/getting_started.md30## Step 2: Configure Your API KeyCOMMENT
LOWdocs/tui/getting_started.md66## Step 3: Select Your ModelCOMMENT
LOWdocs/tui/getting_started.md99## Step 4: Choose Your AgentCOMMENT
LOWdocs/tui/getting_started.md148## Step 5: Start Your First ConversationCOMMENT
LOWdocs/tui/getting_started.md206## Step 6: Working with Multiple TerminalsCOMMENT
LOWdocs/tui/getting_started.md234## Step 7: Using Preconfigured TeamsCOMMENT
LOWdocs/tui/getting_started.md254## Step 8: Saving Your WorkCOMMENT
LOWdocs/tui/getting_started.md282## Step 9: Monitoring CostsCOMMENT
LOWdocs/mui/getting_started.md19### Step 1: Join TestFlight BetaCOMMENT
LOWdocs/mui/getting_started.md26### Step 2: Launch the AppCOMMENT
LOW⚡examples/cai/agent_patterns/deterministic.py50 # Step 1: Execute command in CTF environmentCOMMENT
LOW⚡examples/cai/agent_patterns/deterministic.py55 # Step 2: Pass result to flag discriminatorCOMMENT
LOW⚡examples/cai/agent_patterns/handoffs.py85 # Step 1: Execute a command with the CTF agentCOMMENT
LOW⚡examples/cai/agent_patterns/handoffs.py88 # Step 2: Ask an additional question for calling the Flag Discriminator agentCOMMENT
LOWsrc/cai/caibench/cyber_ranges/README.md25### Step 1: Navigate to the Cyber Range DirectoryCOMMENT
LOW⚡src/cai/caibench/cyber_ranges/README.md37### Step 2: Start the EnvironmentCOMMENT
LOW⚡src/cai/caibench/cyber_ranges/README.md47### Step 3: Verify Containers are RunningCOMMENT
LOW⚡src/cai/caibench/cyber_ranges/README.md55### Step 4: Check Logs (Optional)COMMENT
LOWsrc/cai/caibench/cyber_ranges/easy_techcorp2/README.md275### Step 1: Start Caldera ServerCOMMENT
LOWsrc/cai/caibench/cyber_ranges/easy_techcorp2/README.md293### Step 2: Start TechCorp TargetsCOMMENT
LOWsrc/cai/caibench/cyber_ranges/easy_techcorp2/README.md301### Step 3: Deploy Caldera Agents to TargetsCOMMENT
LOWsrc/cai/caibench/cyber_ranges/easy_techcorp2/README.md340### Step 4: Launch CAI Caldera AgentCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md94### Step 1: Initial ReconnaissanceCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md107### Step 2: Web Enumeration - Find .DS_StoreCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md130### Step 3: IIS Shortname Enumeration with MetasploitCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md163### Step 4: Fuzz for Full Filename with wfuzzCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md192### Step 5: Access Database Credentials (Flag 1)COMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md209### Step 6: Connect to DatabaseCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md216### Step 7: Check for Sysadmin PrivilegesCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md240### Step 8: Enumerate Linked ServersCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md259### Step 9: Query the Linked ServerCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md286### Step 10: Exploit Circular Link for Privilege EscalationCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md299### Step 11: Read Flag from Database (Flag 2)COMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md313### Step 12: Command Execution with xp_cmdshellCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md345### Step 13: Use sp_execute_external_script for Different ContextCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md392### Step 14: Verify Admin Credentials from Config TableCOMMENT
LOWsrc/cai/caibench/cyber_ranges/poo-range/README.md412### Step 15: Access Web Admin Panel (Flag 3 - FINAL)COMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py65 # Step 1: Check what user we are on POO_CONFIGCOMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py71 # Step 2: Check if POO_CONFIG has a link back to POO_PUBLICCOMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py78 # Step 3: Execute through circular link to get superuserCOMMENT
LOWsrc/cai/caibench/atkdef/README.md84#### Step 1: Clone and Setup EnvironmentCOMMENT
LOWsrc/cai/caibench/atkdef/README.md97#### Step 2: Configure the GameCOMMENT
LOWsrc/cai/caibench/atkdef/README.md113#### Step 3: Start the Game ServerCOMMENT
LOWsrc/cai/caibench/atkdef/README.md124#### Step 4: Start the GameCOMMENT
LOWsrc/cai/caibench/atkdef/README.md133#### Step 5: Launch AI Agents for Each TeamCOMMENT
LOWsrc/cai/caibench/atkdef/README.md149#### Step 6: Monitor the CompetitionCOMMENT
LOWsrc/cai/caibench/atkdef/README.md154#### Step 7: Stop the CompetitionCOMMENT
LOWsrc/cai/caibench/atkdef/README.md552#### Step 1: Create Checker FileCOMMENT
LOWsrc/cai/caibench/atkdef/README.md572#### Step 2: Implement Service Availability CheckCOMMENT
LOW⚡src/cai/caibench/atkdef/README.md602#### Step 3: Implement Functionality CheckCOMMENT
LOWsrc/cai/caibench/atkdef/README.md633#### Step 4: Implement Flag OperationsCOMMENT
19 more matches not shown…
Docstring Block Structure19 hits · 95 pts
SeverityFileLineSnippetContext
HIGHsrc/cai/config_loader.py49Load agent configuration data from YAML. Args: path: Optional explicit path to ``agents.yml``. When ``None`STRING
HIGHsrc/cai/tools/network/capture_traffic.py17 Captures network traffic from a remote VM and returns a pipe that can be read by tshark. Args: ip (strSTRING
HIGHsrc/cai/tools/others/scripting.py17Scripting tool for executing Python code directly in memory. IMPORTANT: Use with caution - executes Python code direSTRING
HIGHsrc/cai/tools/reconnaissance/generic_linux_command.py312 Execute commands with session management. Use this tool to run any command. The system automatically detects aSTRING
HIGHsrc/cai/tui/utils/terminal_parser.py10 Parse terminal target from command arguments. Looks for terminal specifiers like 't1', 'T2', etc. at the eSTRING
HIGHsrc/cai/ctr/digest.py269Generate CTR digest using algorithmic rule-based interpretation. This function parses CTR results and applies deterSTRING
HIGHsrc/cai/ctr/digest.py448Generate CTR digest using LLM-based interpretation. This function sends CTR analysis results to an LLM for flexibleSTRING
HIGHsrc/cai/ctr/digest.py593Get CTR digest with specified interpretation mode (async version). Example of CTR digest with mode "algorithmic": STRING
HIGHsrc/cai/ctr/digest.py681Get CTR digest with specified interpretation mode (sync wrapper with caching). This function implements intelligentSTRING
HIGHsrc/cai/ctr/probability_computation.py135 Multi-Factor Edge Probability Computation: Calculate attack path exploitation probabilities. Implements thSTRING
HIGHsrc/cai/ctr/attack_graph.py120 Graph Construction: Transform LLM output into NetworkX directed graph. Converts structured LLM agent outpuSTRING
HIGHsrc/cai/ctr/experiment.py694 LLM Graph Extraction: Process conversation log into attack graph structure. Orchestrates the extraction ofSTRING
HIGHsrc/cai/repl/commands/help.py56Create a notes panel with consistent formatting. Args: notes: List of note strings title: Panel titSTRING
HIGHsrc/cai/agents/__init__.py249 Get a NEW agent instance by name using the dynamic factory system. Args: agent_name: Name of the agentSTRING
HIGHsrc/cai/agents/factory.py238 Get a factory function for creating instances of the specified agent. Args: agent_name: Name of the agSTRING
HIGHsrc/cai/agents/codeagent.py134 Extract Python code blocks from the text, with fallback detection for non-marked code. This function firstSTRING
HIGHsrc/cai/agents/codeagent.py497 Generate Python code based on the conversation history. This method uses the LLM to generate Python coSTRING
HIGHsrc/cai/agents/codeagent.py593 Execute the Python code and return the result. Args: code (str): Python code to execute STRING
HIGHsrc/cai/agents/patterns/utils.py14Convert a pattern to a list of ParallelConfig objects. Args: pattern: Either a Pattern instance or pattern STRING
Over-Commented Block73 hits · 62 pts
SeverityFileLineSnippetContext
LOWtools/cli.bash1# Script to set up various CLI assistantsCOMMENT
LOWtests/refusals/run_all_400_tests.sh1#!/bin/bashCOMMENT
LOW.devcontainer/docker-compose.yml21 cap_add:COMMENT
LOW.devcontainer/docker-compose.yml41 # cainet:COMMENT
LOW.devcontainer/docker-compose.yml61 # - "6333:6333"COMMENT
LOW.devcontainer/docker-compose.yml81 #COMMENT
LOW.devcontainer/docker-compose.yml101 # 1. SSH into container, head to /app5 and then run:COMMENT
LOW.devcontainer/docker-compose.yml121 # PoC 8 (Multi-layer encoding - base64->base32):COMMENT
LOW.devcontainer/docker-compose.yml141 #COMMENT
LOW.devcontainer/docker-compose.yml161 # 3. Manually, it can be validated invoking "curl -i -s -X POST -d "input=Hello;$(env)" http://192.168.3.14:8000"COMMENT
LOW.devcontainer/devcontainer.json1// For format details, see https://aka.ms/devcontainer.json. For config options, see the README at:COMMENT
LOWexamples/__init__.py1# Make the examples directory into a package to avoid top-level module name collisions.COMMENT
LOWexamples/datasets/pentest-R1/findjsonl.sh1#!/usr/bin/env bashCOMMENT
LOWexamples/basic/lifecycle_example.py101 asyncio.run(main())COMMENT
LOWexamples/basic/agent_lifecycle_example.py101### (Start Agent) 1: Agent Start Agent startedCOMMENT
LOWexamples/basic/stream_items.py41 print("=== Run complete ===")COMMENT
LOWexamples/basic/stream_items.py61 # Because he was outstanding in his field!COMMENT
LOW.github/workflows/tests.yml21 # uses: actions/checkout@v4COMMENT
LOW.github/workflows/tests.yml101 # uses: actions/checkout@v4COMMENT
LOWsrc/cai/config.py121 orchestration_mas_hint: bool = TrueCOMMENT
LOWsrc/cai/tools/executor.py541 print(color(error_msg, fg="red"))COMMENT
LOWsrc/cai/caibench/ctf.py401 # NOTE: contributed by @luijait, but this disrupts assumptionCOMMENT
LOWsrc/cai/caibench/cli.py61COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg1# Example config file for ansible -- https://ansible.com/COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg21#ask_pass = FalseCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg41# You can negate them using ! (ex: !hardware,!facter,!ohai)COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg61#inject_facts_as_vars = TrueCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg81# this is done to avoid running all of a type by default.COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg101#timeout = 10COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg121# By default, variables from roles will be visible in the global variableCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg141# Format of string {{ ansible_managed }} available within Jinja2COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg161# not the task's args. This is a security feature because ansible cannot knowCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg181#system_warnings = TrueCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg201#become_plugins = /usr/share/ansible/plugins/becomeCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg221#bin_ansible_callbacks = FalseCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg241# hellokitty,kitty,luke-koala,meow,milk,moofasa,moose,ren,sheep,small,stegosaurus,\COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg261#fact_caching_connection=/tmpCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg281# https://docs.ansible.com/ansible/latest/user_guide/become.html#becoming-an-unprivileged-userCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg301# Controls showing custom stats at the end, off by defaultCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg321# set default errors for all playsCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg341#become_method = sudoCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg361COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg381COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg401# first disable 'requiretty' in /etc/sudoersCOMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg421COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg441# expires, the connection is shutdown. The default value is 30 seconds.COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg461COMMENT
LOW…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg481#unreachable = redCOMMENT
LOWsrc/cai/caibench/cyber_ranges/easy_techcorp2/README.md201# Try to access database credentials (will fail)COMMENT
LOW…aibench/cyber_ranges/easy_techcorp2/docker-compose.yml1version: "3.9"COMMENT
LOW…obaltGroupRansomware/infra/office/hr/simulate_phish.py21 with open(TARGET_PATH, 'wb') as f:COMMENT
LOW…s/CobaltGroupRansomware/infra/server/backup/README.txt1# Dummy File for Backup ServerCOMMENT
LOWsrc/cai/caibench/atkdef/README.md101COMMENT
LOWsrc/cai/caibench/atkdef/start.sh21#echo "Setting up pyproject.toml..."COMMENT
LOWsrc/cai/util/gateway_rate_limiter.py41# :meth:`Reservation.update_actual`, so this only matters for the firstCOMMENT
LOWsrc/cai/util/user_prompts.py61from rich.text import TextCOMMENT
LOWsrc/cai/util/user_prompts.py1261# caching, ``sudo -S -v`` validation, post-execution elevation). The guardCOMMENT
LOWsrc/cai/tui/components/graph_canvas.py81 """CTR interactive graph viewer bound to CTR run outputs."""COMMENT
LOWsrc/cai/tui/components/autocomplete_input.py101 returnCOMMENT
LOWsrc/cai/tui/display/tool_display.py361 # Only show final panel when streaming completesCOMMENT
13 more matches not shown…
AI Slop Vocabulary31 hits · 59 pts
SeverityFileLineSnippetContext
LOWtools/case_study_generator.py281 # just use the prompt with all the context embedded in itCOMMENT
MEDIUMtools/cut_the_rope/benchmark/paper_ctr_tokenscost.py128# NEW: One comprehensive plot per model showing all metrics (MESSAGES ONLY)COMMENT
MEDIUMtools/cut_the_rope/benchmark/paper_ctr_tokenscost.py137# Create one comprehensive plot per model (using messages for x-axis)COMMENT
MEDIUMtools/cut_the_rope/benchmark/paper_ctr_tokenscost.py203# NEW: One comprehensive plot per model showing all metrics (TOKENS ONLY)COMMENT
MEDIUMtools/cut_the_rope/benchmark/paper_ctr_tokenscost.py206# Create one comprehensive plot per model (using tokens for x-axis)COMMENT
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2190 """Print comprehensive summary table of all test results with bypass rates."""STRING
MEDIUMtests/refusals/test_jailbreak_s3_exfiltration.py2555 # Print comprehensive summarySTRING
LOWexamples/customer_service/main.py141 # Here, we'll just use a random UUID for the conversation IDCOMMENT
MEDIUMsrc/cai/util/terminal.py340 """Human-friendly time formatter (robust).STRING
MEDIUMsrc/cai/util/pricing.py778 # This has the most comprehensive and up-to-date pricing databaseCOMMENT
MEDIUMsrc/cai/tui/meta_agent_controller.py27# Meta Agent System Prompt with comprehensive command documentationCOMMENT
LOWsrc/cai/tui/core/terminal_runner.py863 # If no agent yet, just return (will use new model on next init)COMMENT
LOWsrc/cai/tui/components/sidebar.py2487 # Last resort - just passCOMMENT
MEDIUMsrc/cai/tui/components/agent_creator_panel.py487 # Meta agent prompt to create comprehensive agent configurationCOMMENT
MEDIUM⚡src/cai/tui/components/universal_terminal.py707 # Match by id prefix or class to be robust across Textual versionsCOMMENT
LOW⚡src/cai/tui/components/info_status_bar.py317 # Last resort - just set simple textCOMMENT
MEDIUMsrc/cai/tui/components/agent_selector_panel.py332 # Get the agent base name from stored attribute (robust across Textual versions)COMMENT
MEDIUMsrc/cai/tui/display/panel_formatter.py170 # Add comprehensive token stats if availableCOMMENT
MEDIUMsrc/cai/tui/display/panel_formatter.py227 # Be robust to unexpected typesCOMMENT
LOW⚡src/cai/tui/display/agent_display.py352 # Don't wrap in "raw" - just use empty dictCOMMENT
MEDIUMsrc/cai/tui/display/streaming_display.py872 # Use PanelFormatter.create_agent_panel for comprehensive cost displayCOMMENT
LOWsrc/cai/ctr/experiment.py884 # For other models, just use the JSON inputCOMMENT
MEDIUMsrc/cai/repl/commands/settings_validation.py487 """Get comprehensive configuration status.STRING
LOWsrc/cai/repl/commands/_memory_monolith.py786 # Read memory content - just use the entire content without filteringCOMMENT
LOWsrc/cai/repl/commands/_settings_monolith.py2473 # In CLI mode, just call the sync versionCOMMENT
MEDIUMsrc/cai/repl/commands/_settings_monolith.py1206 """Show comprehensive system status."""STRING
LOWsrc/cai/repl/commands/history.py304 # If there are multiple agents with this P-ID, just use the first oneCOMMENT
MEDIUMsrc/cai/agents/codeagent.py690 # Use a more robust approach with a context manager for signalSTRING
LOWsrc/cai/agents/meta/local_python_executor.py1309 # Constant -> just return the valueCOMMENT
MEDIUMsrc/cai/sdk/agents/run.py1000 # Log tools used with robust type checkingCOMMENT
LOWsrc/cai/sdk/agents/_run_impl.py757 # This is expected when cancelling - just return cancelled messageCOMMENT
Verbosity Indicators30 hits · 52 pts
SeverityFileLineSnippetContext
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1036### Step 1: Identify the bucket ✓COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1040### Step 2: Check public access ✓COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1043### Step 3: Create local folder ✓COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1048### Step 4: [INCOMPLETE - Please fill in]COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1051### Step 5: [INCOMPLETE - Please fill in]COMMENT
LOW⚡tests/refusals/test_jailbreak_s3_exfiltration.py1054### Step 6: [INCOMPLETE - Please fill in]COMMENT
LOW⚡tests/commands/test_command_history.py648 # Step 1: Initial user messageCOMMENT
LOW⚡tests/commands/test_command_history.py650 # Step 2: Assistant responseCOMMENT
LOW⚡tests/commands/test_command_history.py655 # Step 3: User asks for helpCOMMENT
LOW⚡tests/commands/test_command_history.py661 # Step 4: Assistant with tool callCOMMENT
LOWtests/commands/test_command_history.py681 # Step 5: Tool responseCOMMENT
LOW⚡examples/cai/agent_patterns/deterministic.py50 # Step 1: Execute command in CTF environmentCOMMENT
LOW⚡examples/cai/agent_patterns/deterministic.py55 # Step 2: Pass result to flag discriminatorCOMMENT
LOW⚡examples/cai/agent_patterns/handoffs.py85 # Step 1: Execute a command with the CTF agentCOMMENT
LOW⚡examples/cai/agent_patterns/handoffs.py88 # Step 2: Ask an additional question for calling the Flag Discriminator agentCOMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py65 # Step 1: Check what user we are on POO_CONFIGCOMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py71 # Step 2: Check if POO_CONFIG has a link back to POO_PUBLICCOMMENT
LOW⚡…anges/poo-range/attacker/tools/pg_linked_escalation.py78 # Step 3: Execute through circular link to get superuserCOMMENT
LOW⚡src/cai/util/user_prompts.py349 # Step 0: best-effort cleanup of any pending residual auth status lineCOMMENT
LOW⚡src/cai/util/user_prompts.py356 # Step 1: pre-allocate. The \r before the up-arrow guards againstCOMMENT
LOW⚡src/cai/util/user_prompts.py366 # Step 2: anchor.COMMENT
LOW⚡src/cai/util/user_prompts.py372 # Step 3: yield + restore.COMMENT
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1829 # Step 1: Check if we already have the fixed imageCOMMENT
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1836 # Step 2: If we don't have a fixed image, create oneCOMMENT
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1914 # Step 3: Check if a container with our fixed image is already runningSTRING
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1921 # Step 4: If container exists, try to start it if neededSTRING
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1966 # Step 5: If no running container, create a new oneSTRING
LOW⚡src/cai/repl/commands/_virtualization_monolith.py2027 # Step 6: Set the container as activeSTRING
LOW⚡src/cai/repl/commands/_virtualization_monolith.py2030 # Step 7: Show success messageSTRING
LOW⚡src/cai/agents/patterns/utils.py162 # Now we need to check if the target agent has a handoff back to this agentCOMMENT
Fake / Example Data17 hits · 26 pts
SeverityFileLineSnippetContext
LOW⚡tests/tracing/test_responses_tracing.py63 "children": [{"type": "response", "data": {"response_id": "dummy-id"}}],CODE
LOW⚡tests/tracing/test_responses_tracing.py137 response=fake_model.get_response_obj([], "dummy-id-123"),CODE
LOW⚡tests/tracing/test_responses_tracing.py155 "children": [{"type": "response", "data": {"response_id": "dummy-id-123"}}],CODE
LOW⚡tests/tracing/test_responses_tracing.py176 response=fake_model.get_response_obj([], "dummy-id-123"),CODE
LOW⚡tests/tracing/test_responses_tracing.py214 response=fake_model.get_response_obj([], "dummy-id-123"),CODE
LOWtests/tracing/test_responses_tracing.py27 self.id = "dummy-id"CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql36('Acme Corporation', 'contact@acme.com', 'Acme Corp', '555-1000', '123 Business St, Tech City'),CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql36('Acme Corporation', 'contact@acme.com', 'Acme Corp', '555-1000', '123 Business St, Tech City'),CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql37('Global Industries', 'info@global.com', 'Global Inc', '555-2000', '456 Commerce Ave, Metro City'),CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql38('Tech Solutions Ltd', 'hello@techsol.com', 'Tech Solutions', '555-3000', '789 Innovation Dr, Silicon Valley'),CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql39('Enterprise Systems', 'sales@enterprise.com', 'Enterprise', '555-4000', '321 Corporate Blvd, Business Park'),CODE
LOW⚡…caibench/cyber_ranges/easy_techcorp2/database/init.sql40('Digital Dynamics', 'contact@digital.com', 'Digital Dynamics', '555-5000', '654 Tech Lane, Startup City');CODE
LOW…ber_ranges/CobaltGroupRansomware/finance/entrypoint.sh6cp -r /dummy_data/* /data/CODE
LOWsrc/cai/repl/ui/prompt.py103 "placeholder": "#666666 italic",CODE
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1783 # dummy_id = f"dummy-{image_name.replace('/', '-')}"COMMENT
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1784 # os.environ["CAI_ACTIVE_CONTAINER"] = dummy_idCOMMENT
LOW⚡src/cai/repl/commands/_virtualization_monolith.py1787 # f"[yellow]Set '{dummy_id}' as active environment.[/yellow]\n"COMMENT
Synthetic Comment Markers2 hits · 12 pts
SeverityFileLineSnippetContext
HIGHsrc/cai/sdk/agents/models/openai_chatcompletions.py1320 suppress_empty=True, # Keep suppress_empty=True as requestedCODE
HIGHsrc/cai/prompts/core/system_master_template.md12 # 2. Compacted Summary (optional): AI-generated summaryCOMMENT
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICALsrc/cai/sdk/agents/voice/models/openai_tts.py42 response = self._client.audio.speech.with_streaming_response.create(CODE
AI Structural Patterns12 hits · 9 pts
SeverityFileLineSnippetContext
LOWsrc/cai/cli_headless.py268CODE
LOWsrc/cai/tools/executor.py1289CODE
LOWsrc/cai/tools/executor.py1450CODE
LOWsrc/cai/tools/reconnaissance/exec_code.py206CODE
LOWsrc/cai/tools/reconnaissance/generic_linux_command.py864CODE
LOWsrc/cai/util/tokens.py163CODE
LOWsrc/cai/util/streaming.py1646CODE
LOWsrc/cai/util/streaming.py1726CODE
LOWsrc/cai/agents/codeagent.py201CODE
LOWsrc/cai/sdk/agents/tracing/create.py152CODE
LOWsrc/cai/sdk/agents/tracing/create.py317CODE
LOWsrc/cai/sdk/agents/tracing/create.py361CODE
Magic Placeholder Names2 hits · 8 pts
SeverityFileLineSnippetContext
HIGHdocs/continue_mode.md143export ALIAS_API_KEY=your-api-keySTRING
HIGHdocs/environment_variables.md421C99_API_KEY="your-api-key" # For C99.nl subdomain discovery toolCODE
Example Usage Blocks3 hits · 5 pts
SeverityFileLineSnippetContext
LOW⚡examples/datasets/pentest-R1/findjsonl.sh4# Usage:COMMENT
LOWsrc/cai/tools/network/capture_traffic.py141 # Example usageCOMMENT
LOWsrc/cai/caibench/cli.py62# Example usage:COMMENT
Slop Phrases2 hits · 4 pts
SeverityFileLineSnippetContext
MEDIUMtools/cut_the_rope/benchmark/graph_sample.py3using simulated data. It then generates and saves a visual attack graph for demonstration purposes.STRING
MEDIUM…ch/artifacts/chals/forensics/Br3akTh3Vau1t/ansible.cfg266# and you can change the location of the files by setting retry_files_save_pathCOMMENT
Dead Code2 hits · 2 pts
SeverityFileLineSnippetContext
MEDIUMsrc/cai/tui/components/streaming_status_bar.py666CODE
MEDIUMsrc/cai/tui/components/streaming_status_bar.py689CODE