Repository Analysis

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

59.0 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of MakazhanAlpamys/Soup, a Python project with 3,531 GitHub stars. SynthScan v2.0 examined 409,702 lines of code across 1047 source files, recording 16524 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 59.0 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

59.0
Adjusted Score
59.0
Raw Score
100%
Time Factor
2026-08-29
Last Push
3.5K
Stars
Python
Language
409.7K
Lines of Code
1.0K
Files
16.5K
Pattern Hits
2026-08-29
Scan Date
0.21
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 217MEDIUM 3305LOW 13002

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 16524 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Decorative Section Separators3216 hits · 11616 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_v0403_part_c.py26# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0403_part_c.py28# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0403_part_c.py267# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0403_part_c.py269# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py80# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py82# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py318# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py320# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py5# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py7# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py190# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_training_intelligence.py192# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py71# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py160# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py162# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py13# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py15# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py202# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_cans.py204# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py75# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py77# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py139# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py141# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py210# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py212# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py362# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py364# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py417# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py419# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py464# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py466# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py542# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py544# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py36# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0660_part_a.py38# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py34# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py36# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py419# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py421# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py676# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py678# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py872# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py874# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py1215# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v07133.py1217# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py21# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py23# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py86# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py88# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py247# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py249# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py356# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py358# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py401# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py403# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py606# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py608# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py468# ----------------------------------------------------------------------COMMENT
MEDIUMtests/test_v0538.py470# ----------------------------------------------------------------------COMMENT
3156 more matches not shown…
Hyper-Verbose Identifiers11208 hits · 9480 pts
SeverityFileLineSnippetContext
LOWtests/test_v0403_part_c.py60 def test_kept_when_chosen_clearly_wins(self):CODE
LOWtests/test_v0403_part_c.py67 def test_dropped_when_diff_below_threshold(self):CODE
LOWtests/test_v0403_part_c.py74 def test_dropped_when_rejected_wins(self):CODE
LOWtests/test_v0403_part_c.py80 def test_judge_exception_counts_as_error(self):CODE
LOWtests/test_v0403_part_c.py88 def test_lower_threshold_keeps_borderline(self):CODE
LOWtests/test_v0403_part_c.py96 def test_threshold_zero_keeps_ties(self):CODE
LOWtests/test_v0403_part_c.py101 def test_rejects_non_numeric_threshold(self):CODE
LOWtests/test_v0403_part_c.py106 def test_rejects_bool_threshold(self):CODE
LOWtests/test_v0403_part_c.py111 def test_rejects_threshold_above_one(self):CODE
LOWtests/test_v0403_part_c.py116 def test_rejects_threshold_below_zero(self):CODE
LOWtests/test_v0403_part_c.py121 def test_rejects_nan_threshold(self):CODE
LOWtests/test_v0403_part_c.py126 def test_too_many_pairs_rejected(self):CODE
LOWtests/test_v0403_part_c.py132 def test_empty_pairs_returns_empty(self):CODE
LOWtests/test_v0403_part_c.py138 def test_uses_judge_rubric_scale(self):CODE
LOWtests/test_v0403_part_c.py144 def test_report_is_frozen_dataclass(self):CODE
LOWtests/test_v0403_part_c.py154 def test_degenerate_scale_drops_all_at_positive_threshold(self):CODE
LOWtests/test_v0403_part_c.py162 def test_degenerate_scale_keeps_all_at_zero_threshold(self):CODE
LOWtests/test_v0403_part_c.py169 def test_lazy_materialisation_does_not_buffer_full_generator(self):CODE
LOWtests/test_v0403_part_c.py292 def test_appends_multiple_lines(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py300 def test_outside_cwd_rejected(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py307 def test_null_byte_path_rejected(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py317 def test_cap_below_min_rejected(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py322 def test_cap_above_max_rejected(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py332 def test_non_string_path_rejected(self):CODE
LOWtests/test_v0403_part_c.py336 def test_rotation_when_cap_exceeded(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py198 def test_judge_flag_filters_pairs(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py244 def test_judge_provider_invalid_rejected_early(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py362 def test_secret_redaction_in_prompt(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py376 def test_secret_redaction_in_response(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py390 def test_secret_redaction_preserves_trailing_period(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py406 def test_secret_redaction_in_extra_dict(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py419 def test_secret_redaction_redacts_sk_keys(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py433 def test_rotation_refuses_symlink_backup(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py453 def test_unserialisable_entry_dropped_silently(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py488 def test_extra_does_not_override_core_fields(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py527 def test_serve_help_lists_trace_log(self):CODE
LOWtests/test_v0403_part_c.py536 def test_serve_help_lists_trace_log_cap_mb(self):CODE
LOWtests/test_v0403_part_c.py547 def test_create_app_accepts_trace_log_writer(self, tmp_path, monkeypatch):CODE
LOWtests/test_v0403_part_c.py571 def test_create_app_default_writer_is_none(self, tmp_path, monkeypatch):CODE
LOWtests/test_training_intelligence.py85 def test_built_in_benchmarks_exist(self):CODE
LOWtests/test_training_intelligence.py130 def test_check_forgetting_level_yellow(self):CODE
LOWtests/test_training_intelligence.py140 def test_check_forgetting_level_red(self):CODE
LOWtests/test_training_intelligence.py150 def test_check_forgetting_integration(self):CODE
LOWtests/test_training_intelligence.py210 def test_record_better_replaces_best(self):CODE
LOWtests/test_training_intelligence.py219 def test_record_worse_keeps_best(self):CODE
LOWtests/test_training_intelligence.py228 def test_should_early_stop_no_regression(self):CODE
LOWtests/test_training_intelligence.py237 def test_should_early_stop_on_patience(self):CODE
LOWtests/test_training_intelligence.py305 def test_composite_missing_metrics(self):CODE
LOWtests/test_training_intelligence.py312 def test_composite_all_none_returns_zero(self):CODE
LOWtests/test_training_intelligence.py323 def test_checkpoint_quality_table_created(self, tmp_path):CODE
LOWtests/test_training_intelligence.py118 def test_check_forgetting_level_green(self):CODE
LOWtests/test_training_intelligence.py170 def test_unknown_benchmark_rejected(self):CODE
LOWtests/test_training_intelligence.py179 def test_forgetting_stop_schema(self):CODE
LOWtests/test_training_intelligence.py270 def test_prune_refuses_non_checkpoint_dirs(self, tmp_path):CODE
LOWtests/test_training_intelligence.py289 def test_composite_metric_weights(self):CODE
LOWtests/test_training_intelligence.py340 def test_forgetting_eval_table_created(self, tmp_path):CODE
LOWtests/test_data_sample.py62 def test_sample_n_larger_than_dataset(self, tmp_path, monkeypatch):CODE
LOWtests/test_data_sample.py166 def test_must_specify_n_or_pct(self, tmp_path):CODE
LOWtests/test_data_sample.py187 def test_sample_output_path_traversal(self, tmp_path):CODE
LOWtests/test_cans.py30 def test_unknown_format_version_rejected(self):CODE
11148 more matches not shown…
Unused Imports870 hits · 760 pts
SeverityFileLineSnippetContext
LOWtests/test_v0403_part_c.py3CODE
LOWtests/test_v0403_part_c.py521CODE
LOWtests/test_cans.py3CODE
LOWtests/test_peft_patches.py8CODE
LOWtests/test_v0660_part_a.py20CODE
LOWtests/test_v07133.py12CODE
LOWtests/test_v0538.py11CODE
LOWtests/test_refusal_multilingual.py11CODE
LOWtests/test_issue359_deepspeed_guard_coverage.py16CODE
LOWtests/test_batch_probe.py8CODE
LOWtests/test_recipe_count_is_synced.py19CODE
LOWtests/test_issue549_bon_resume.py3CODE
LOWtests/test_v07117.py15CODE
LOWtests/test_ui_metrics.py87CODE
LOWtests/test_issue533_offline_hf_materialization.py3CODE
LOWtests/test_v0570_part_c.py3CODE
LOWtests/test_v0600_part_c.py10CODE
LOWtests/test_v07123.py21CODE
LOWtests/test_registry.py3CODE
LOWtests/test_windows_encoding.py11CODE
LOWtests/test_v0650_part_b.py6CODE
LOWtests/test_part_a_wave1.py12CODE
LOWtests/test_v0640_followups.py20CODE
LOWtests/test_v0430_part_b.py2CODE
LOWtests/test_code_review_medium_low.py3CODE
LOWtests/test_v0660_part_e.py25CODE
LOWtests/test_replay.py3CODE
LOWtests/test_issue459_interleave_streaming_hub.py32CODE
LOWtests/test_v0630_part_d.py3CODE
LOWtests/test_v0680_part_b.py8CODE
LOWtests/test_v05311.py7CODE
LOWtests/test_v07127.py15CODE
LOWtests/test_v07127.py29CODE
LOWtests/test_issue573_qwen4_expert_lora.py3CODE
LOWtests/test_issue330_mix_recipe_train_loadable.py17CODE
LOWtests/test_v07113.py9CODE
LOWtests/test_v0430_part_c.py2CODE
LOWtests/test_v0430_part_c.py115CODE
LOWtests/test_v0660_part_d.py17CODE
LOWtests/test_contributing_test_counts_are_digit_free.py19CODE
LOWtests/test_v0670_followups.py16CODE
LOWtests/test_code_review_recurring.py9CODE
LOWtests/test_v0630_part_e.py3CODE
LOWtests/test_v0460_part_b.py3CODE
LOWtests/test_v07136.py3CODE
LOWtests/test_multi_adapter.py100CODE
LOWtests/test_multi_adapter.py194CODE
LOWtests/test_v05310.py16CODE
LOWtests/test_v0680_part_c.py8CODE
LOWtests/test_v0630_followups.py13CODE
LOWtests/test_issue565_grpo_reward_metadata.py3CODE
LOWtests/test_v0600_part_f.py10CODE
LOWtests/test_code_review_deferred.py6CODE
LOWtests/test_v07126.py15CODE
LOWtests/test_v07112.py13CODE
LOWtests/test_issue443_interleave_wiring.py22CODE
LOWtests/test_issue350_fsdp_qlora.py8CODE
LOWtests/test_v0403_part_b.py3CODE
LOWtests/test_ui_chat.py20CODE
LOWtests/test_issue563_mps_bf16_training.py3CODE
810 more matches not shown…
Cross-Language Confusion117 hits · 622 pts
SeverityFileLineSnippetContext
HIGHtests/test_cans.py80 eid = store.push(CODE
HIGHtests/test_cans.py172 eid = store.push(CODE
HIGHtests/test_cans.py215 eid = store.push(CODE
HIGHtests/test_cans.py269 eid = store.push(name="recipe", tag="v1", base_model="llama",CODE
HIGHtests/test_issue549_bon_resume.py364 '{"index":1,"sft":{},"dpo":null}\n',CODE
HIGHtests/test_registry.py215 e1 = store.push(name="model-a", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py217 e2 = store.push(name="model-a", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py232 store.push(name=f"m{i}", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py240 store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py242 store.push(name="m2", tag="v2", base_model="b", task="sft",CODE
HIGHtests/test_registry.py249 store.push(name="m1", tag="v1", base_model="llama-3.1-8b", task="sft",CODE
HIGHtests/test_registry.py251 store.push(name="m2", tag="v1", base_model="qwen-3-8b", task="sft",CODE
HIGHtests/test_registry.py259 store.push(name="medical-chat", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py261 store.push(name="legal-chat", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py269 store.push(name="Medical-Chat", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py276 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py284 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py290 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py296 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py320 store.push(name="m1", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py322 store.push(name="m2", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py333 store.push(name="m1", tag="v1", base_model="",CODE
HIGHtests/test_registry.py340 store.push(name="m1", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py348 eid = store.push(CODE
HIGHtests/test_registry.py360 store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py362 store.push(name="m2", tag="v1", base_model="b", task="dpo",CODE
HIGHtests/test_registry.py372 store.push(name=f"m{i}", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py380 store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py399 parent = store.push(name="parent", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py401 child = store.push(name="child", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py437 eid = store.push(name="m1", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py451 store.push(name="m1", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py468 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py487 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py501 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py520 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py533 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py553 parent = store.push(name="base", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py555 child = store.push(name="fork", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py570 a = store.push(name="a", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py572 b = store.push(name="b", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py582 a = store.push(name="a", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py593 a = store.push(name="a", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py595 b = store.push(name="b", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py607 parent = store.push(name="p", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py618 child = store.push(name="c", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py860 eid = store.push(name="m1", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py875 eid = store.push(name="m1", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py911 eid = store.push(name="m1", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py953 parent = store.push(name="base", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py955 child = store.push(name="base", tag="v2", base_model="llama",CODE
HIGHtests/test_registry.py986 eid = store.push(name="m1", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py1005 store.push(name="clean", tag="v1", base_model="b", task="sft",CODE
HIGHtests/test_registry.py1020 store.push(name="alpha", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py1022 store.push(name="beta", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py1034 store.push(name="m1", tag="v1", base_model="b",CODE
HIGHtests/test_registry.py193 entry_id = store.push(CODE
HIGHtests/test_registry.py809 eid = store.push(name="m1", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py830 store.push(name="medical-chat", tag="v1", base_model="llama",CODE
HIGHtests/test_registry.py843 a = store.push(name="m1", tag="v1", base_model="llama",CODE
57 more matches not shown…
Cross-File Repetition75 hits · 375 pts
SeverityFileLineSnippetContext
HIGHtests/test_eval_platform.py0remove ansi escape codes from rich-formatted output.STRING
HIGHtests/test_speculative_decoding.py0remove ansi escape codes from rich-formatted output.STRING
HIGHtests/test_synth_data_pro.py0remove ansi escape codes from rich-formatted output.STRING
HIGHtests/test_inference_advanced.py0remove ansi escape codes from rich-formatted output.STRING
HIGHtests/test_pretrain.py0test the runtimeerror guard when train() is called before setup().STRING
HIGHtests/test_kto.py0test the runtimeerror guard when train() is called before setup().STRING
HIGHtests/test_orpo.py0test the runtimeerror guard when train() is called before setup().STRING
HIGHtests/test_embedding.py0test the runtimeerror guard when train() is called before setup().STRING
HIGHtests/test_pretrain.py0calling train() before setup() should raise runtimeerror.STRING
HIGHtests/test_kto.py0calling train() before setup() should raise runtimeerror.STRING
HIGHtests/test_embedding.py0calling train() before setup() should raise runtimeerror.STRING
HIGHtests/test_pretrain.py0test the result dict returned by train() using a mocked trainer.STRING
HIGHtests/test_kto.py0test the result dict returned by train() using a mocked trainer.STRING
HIGHtests/test_orpo.py0test the result dict returned by train() using a mocked trainer.STRING
HIGHtests/test_embedding.py0test the result dict returned by train() using a mocked trainer.STRING
HIGHtests/test_pretrain.py0train() result dict must contain all expected keys.STRING
HIGHtests/test_kto.py0train() result dict must contain all expected keys.STRING
HIGHtests/test_embedding.py0train() result dict must contain all expected keys.STRING
HIGHtests/test_pretrain.py0initial_loss and final_loss should come from trainer log_history.STRING
HIGHtests/test_kto.py0initial_loss and final_loss should come from trainer log_history.STRING
HIGHtests/test_embedding.py0initial_loss and final_loss should come from trainer log_history.STRING
HIGHtests/test_pretrain.py0when log_history has no 'loss' entries, losses should be 0.STRING
HIGHtests/test_kto.py0when log_history has no 'loss' entries, losses should be 0.STRING
HIGHtests/test_embedding.py0when log_history has no 'loss' entries, losses should be 0.STRING
HIGHtests/test_pretrain.py0total_steps should match trainer.state.global_step.STRING
HIGHtests/test_kto.py0total_steps should match trainer.state.global_step.STRING
HIGHtests/test_embedding.py0total_steps should match trainer.state.global_step.STRING
HIGHtests/test_pretrain.py0output_dir in result should match wrapper._output_dir.STRING
HIGHtests/test_kto.py0output_dir in result should match wrapper._output_dir.STRING
HIGHtests/test_embedding.py0output_dir in result should match wrapper._output_dir.STRING
HIGHtests/test_pretrain.py0train() should call trainer.save_model with output_dir.STRING
HIGHtests/test_kto.py0train() should call trainer.save_model with output_dir.STRING
HIGHtests/test_embedding.py0train() should call trainer.save_model with output_dir.STRING
HIGHtests/test_pretrain.py0train() should call tokenizer.save_pretrained with output_dir.STRING
HIGHtests/test_kto.py0train() should call tokenizer.save_pretrained with output_dir.STRING
HIGHtests/test_embedding.py0train() should call tokenizer.save_pretrained with output_dir.STRING
HIGHtests/test_pretrain.py0train() should forward resume_from_checkpoint to trainer.train().STRING
HIGHtests/test_kto.py0train() should forward resume_from_checkpoint to trainer.train().STRING
HIGHtests/test_embedding.py0train() should forward resume_from_checkpoint to trainer.train().STRING
HIGHtests/test_pretrain.py0long durations (>=1h) should produce 'xh ym' format.STRING
HIGHtests/test_kto.py0long durations (>=1h) should produce 'xh ym' format.STRING
HIGHtests/test_embedding.py0long durations (>=1h) should produce 'xh ym' format.STRING
HIGHtests/test_v0500_part_b.py0base: test-llama task: grpo data: train: ./data.jsonl format: chatml output: ./out training: epochs: 1 lr: 1e-4 reward_fSTRING
HIGHtests/test_v0500_part_c.py0base: test-llama task: grpo data: train: ./data.jsonl format: chatml output: ./out training: epochs: 1 lr: 1e-4 reward_fSTRING
HIGHtests/test_v0500_part_d.py0base: test-llama task: grpo data: train: ./data.jsonl format: chatml output: ./out training: epochs: 1 lr: 1e-4 reward_fSTRING
HIGHtests/test_v0500_part_a.py0base: test-llama task: grpo data: train: ./data.jsonl format: chatml output: ./out training: epochs: 1 lr: 1e-4 reward_fSTRING
HIGHtests/test_v0500_part_e.py0base: test-llama task: grpo data: train: ./data.jsonl format: chatml output: ./out training: epochs: 1 lr: 1e-4 reward_fSTRING
HIGHsrc/soup_cli/utils/relora.py0return hf ``trainercallback`` (or ``object`` when transformers is absent). imported inside the function so the module haSTRING
HIGHsrc/soup_cli/monitoring/hf_push.py0return hf ``trainercallback`` (or ``object`` when transformers is absent). imported inside the function so the module haSTRING
HIGHsrc/soup_cli/utils/lisa.py0return hf ``trainercallback`` (or ``object`` when transformers is absent). imported inside the function so the module haSTRING
HIGHsrc/soup_cli/commands/merge.py0read base_model_name_or_path from adapter_config.json.STRING
HIGHsrc/soup_cli/commands/serve.py0read base_model_name_or_path from adapter_config.json.STRING
HIGHsrc/soup_cli/commands/export.py0read base_model_name_or_path from adapter_config.json.STRING
HIGHsrc/soup_cli/commands/chat.py0read base_model_name_or_path from adapter_config.json.STRING
HIGHsrc/soup_cli/trainer/pretrain.py0load model via standard transformers + peft pipeline.STRING
HIGHsrc/soup_cli/trainer/kto.py0load model via standard transformers + peft pipeline.STRING
HIGHsrc/soup_cli/trainer/embedding.py0load model via standard transformers + peft pipeline.STRING
HIGHsrc/soup_cli/trainer/orpo.py0load model via standard transformers + peft pipeline.STRING
HIGHsrc/soup_cli/trainer/bco.py0load model via standard transformers + peft pipeline.STRING
HIGHsrc/soup_cli/trainer/grpo.py0load model via standard transformers + peft pipeline.STRING
15 more matches not shown…
Excessive Try-Catch Wrapping365 hits · 374 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_v07200.py1188def _cuda_available():CODE
LOWtests/test_v07200.py1193 except Exception:CODE
LOWtests/test_v07200.py1213 except Exception:CODE
MEDIUMtests/test_v07204.py27def _cuda_available():CODE
MEDIUMtests/test_v07204.py48def _mps_is_the_accelerator():CODE
LOWtests/test_v07204.py32 except Exception: # pragma: no cover - torch always present in CICODE
LOWtests/test_v07204.py44 except Exception: # pragma: no cover - torch always present in CICODE
LOWtests/test_v07204.py57 except Exception: # pragma: no coverCODE
LOWtests/test_trl_preference_config_contract.py298 except Exception as exc: # noqa: BLE001 - reported, not swallowedCODE
MEDIUMtests/test_v07300.py203def _cuda_available():CODE
LOWtests/test_v07300.py206 except Exception:CODE
MEDIUMtests/test_issue349_measured_fit.py435def _cuda() -> bool:CODE
LOWtests/test_issue349_measured_fit.py440 except Exception:CODE
MEDIUMtests/test_v0532.py256def _torch_or_skip():CODE
LOWtests/test_v0532.py261 except Exception: # pragma: no cover - CI without torchCODE
LOWtests/test_why.py101 except Exception:CODE
LOWtests/test_issue385_stream_dtype.py387 except Exception:CODE
MEDIUMtests/test_issue385_stream_dtype.py382def _cuda_available() -> bool:CODE
LOWtests/test_v0712.py474 except Exception as exc: # noqa: BLE001CODE
LOWtests/test_part_d.py113 except Exception: # tokenizer mock approximation may explode in decodeCODE
LOWtests/test_recipes.py84 except Exception as exc:CODE
LOWtests/test_v0540.py974 except Exception as exc: # noqa: BLE001CODE
LOWtests/test_trl_version_compat.py244 except Exception as exc: # noqa: BLE001 - reported, not swallowedCODE
MEDIUMtests/test_v07202.py32def _cuda() -> bool:CODE
LOWtests/test_v07202.py61 except Exception:CODE
LOWtests/test_issue336_deepspeed_lora.py363 except Exception: # noqa: BLE001 - any other refusal still counts as strictCODE
LOW.github/workflows/dependency-drift.yml98 except Exception:CODE
LOW.github/workflows/ci.yml227 except Exception as exc: # noqa: BLE001 — best effort, never fail the jobCODE
LOWsrc/soup_cli/cli.py800 except Exception: # noqa: BLE001 — audit must never crash the CLICODE
LOWsrc/soup_cli/cli.py831 except Exception as exc:CODE
LOWsrc/soup_cli/ui/app.py269 except Exception as exc:CODE
LOWsrc/soup_cli/ui/app.py289 except Exception as exc:CODE
LOWsrc/soup_cli/ui/app.py362 except Exception as exc:CODE
LOWsrc/soup_cli/ui/app.py741 except Exception as exc:CODE
LOWsrc/soup_cli/ui/plugins/__init__.py114 except Exception: # noqa: BLE001 — plugin failure must not crash UICODE
LOWsrc/soup_cli/plugins/__init__.py298 except Exception: # noqa: BLE001 — plugin failure must not crash CLICODE
LOWsrc/soup_cli/utils/liger.py96 except Exception: # noqa: BLE001 — detection is best-effort by designCODE
LOWsrc/soup_cli/utils/structured_output.py123 except Exception: # noqa: BLE001 — degrade to free-form rather than 500CODE
LOWsrc/soup_cli/utils/structured_output.py128 except Exception: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/v028_features.py61 except Exception: # noqa: BLE001 — degrade gracefullyCODE
LOWsrc/soup_cli/utils/v028_features.py75 except Exception: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/v028_features.py155 except Exception: # noqa: BLE001 — picker is best-effortCODE
LOWsrc/soup_cli/utils/prune_prompt.py251 except Exception as exc: # noqa: BLE001 — surface a friendly message.CODE
LOWsrc/soup_cli/utils/ci_workflow.py208 except Exception:CODE
LOWsrc/soup_cli/utils/data_forge.py392 except Exception as exc: # noqa: BLE001 — judge backends varyCODE
LOWsrc/soup_cli/utils/data_forge.py462 except Exception:CODE
LOWsrc/soup_cli/utils/data_forge.py610 except Exception as exc: # noqa: BLE001 — httpx error varietyCODE
LOWsrc/soup_cli/utils/data_forge.py654 except Exception as exc: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/data_forge.py695 except Exception as exc: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/advise.py797 except Exception: # noqa: BLE001 — torch/transformers missing → heuristicCODE
LOWsrc/soup_cli/utils/advise.py819 except Exception: # noqa: BLE001 — any live failure → heuristic fallbackCODE
LOWsrc/soup_cli/utils/advise.py845 except Exception: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/advise.py857 except Exception: # noqa: BLE001 — any live failure → heuristic fallbackCODE
LOWsrc/soup_cli/utils/advise.py882 except Exception: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/advise.py892 except Exception: # noqa: BLE001CODE
LOWsrc/soup_cli/utils/ra_dit_run.py90 except Exception: # noqa: BLE001 — Registry is optional.CODE
LOWsrc/soup_cli/utils/ra_dit_run.py94 except Exception: # noqa: BLE001 — degrade to "no retriever".CODE
LOWsrc/soup_cli/utils/ra_dit_run.py131 except Exception: # noqa: BLE001 — best-effort cleanup.CODE
LOWsrc/soup_cli/utils/ra_dit_run.py248 except Exception:CODE
LOWsrc/soup_cli/utils/mole_routing.py461 except Exception: # noqa: BLE001 — probe must never raiseCODE
305 more matches not shown…
Deep Nesting234 hits · 217 pts
SeverityFileLineSnippetContext
LOWtests/test_v07133.py939CODE
LOWtests/test_v0538.py503CODE
LOWtests/test_v07132.py160CODE
LOWtests/test_v07201.py87CODE
LOWtests/test_awq_gptq_export.py196CODE
LOWtests/test_awq_gptq_export.py360CODE
LOWtests/test_awq_gptq_export.py508CODE
LOWtests/test_build_dag.py21CODE
LOWtests/test_onnx_tensorrt_export.py80CODE
LOWtests/test_trainer_coverage_v035.py42CODE
LOWtests/test_trainer_coverage_v035.py202CODE
LOWtests/test_issue550_bon_offline.py446CODE
LOWtests/test_issue341_seed_and_fullft.py684CODE
LOWtests/test_cli_help_assertions_are_ansi_safe.py81CODE
LOWtests/test_ui_live_monitor.py31CODE
LOWscripts/assemble_changelog.py240CODE
LOWsrc/soup_cli/cli.py605CODE
LOWsrc/soup_cli/ui/app.py76CODE
LOWsrc/soup_cli/ui/app.py145CODE
LOWsrc/soup_cli/ui/app.py540CODE
LOWsrc/soup_cli/ui/app.py653CODE
LOWsrc/soup_cli/ui/app.py549CODE
LOWsrc/soup_cli/ui/app.py701CODE
LOWsrc/soup_cli/config/schema.py5507CODE
LOWsrc/soup_cli/utils/liger.py101CODE
LOWsrc/soup_cli/utils/advise_history.py195CODE
LOWsrc/soup_cli/utils/prune_prompt.py392CODE
LOWsrc/soup_cli/utils/data_forge.py231CODE
LOWsrc/soup_cli/utils/advise.py227CODE
LOWsrc/soup_cli/utils/mole_routing.py676CODE
LOWsrc/soup_cli/utils/data_doctor.py205CODE
LOWsrc/soup_cli/utils/reward_hack_control.py499CODE
LOWsrc/soup_cli/utils/prompt_compile.py248CODE
LOWsrc/soup_cli/utils/adapter_arithmetic.py75CODE
LOWsrc/soup_cli/utils/adapter_arithmetic.py405CODE
LOWsrc/soup_cli/utils/layer_shard.py650CODE
LOWsrc/soup_cli/utils/deploy_measure.py141CODE
LOWsrc/soup_cli/utils/deploy_measure.py196CODE
LOWsrc/soup_cli/utils/deploy_measure.py548CODE
LOWsrc/soup_cli/utils/ingest_sources.py156CODE
LOWsrc/soup_cli/utils/ingest_sources.py247CODE
LOWsrc/soup_cli/utils/ingest_sources.py293CODE
LOWsrc/soup_cli/utils/_eval_text.py27CODE
LOWsrc/soup_cli/utils/crash.py95CODE
LOWsrc/soup_cli/utils/vllm.py44CODE
LOWsrc/soup_cli/utils/kernel_picker.py204CODE
LOWsrc/soup_cli/utils/lr_groups.py41CODE
LOWsrc/soup_cli/utils/shrink.py257CODE
LOWsrc/soup_cli/utils/paths.py154CODE
LOWsrc/soup_cli/utils/annex_xi.py232CODE
LOWsrc/soup_cli/utils/annex_xi.py347CODE
LOWsrc/soup_cli/utils/annex_xi.py416CODE
LOWsrc/soup_cli/utils/annex_xi.py461CODE
LOWsrc/soup_cli/utils/irt.py404CODE
LOWsrc/soup_cli/utils/reward_hacking.py437CODE
LOWsrc/soup_cli/utils/drift_alarm.py179CODE
LOWsrc/soup_cli/utils/anthropic_messages.py54CODE
LOWsrc/soup_cli/utils/deploy_autopilot.py244CODE
LOWsrc/soup_cli/utils/batch_probe.py115CODE
LOWsrc/soup_cli/utils/reward_synth.py107CODE
174 more matches not shown…
Modern Structural Boilerplate142 hits · 142 pts
SeverityFileLineSnippetContext
LOWsrc/soup_cli/ui/app.py18logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/ui/app.py62def set_auth_token(token: str) -> None:CODE
LOWsrc/soup_cli/ui/plugins/__init__.py32logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/plugins/__init__.py35logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/plugins/__init__.py305__all__ = [CODE
LOWsrc/soup_cli/utils/tool_outputs.py138 def set_output(self, text: str) -> None:CODE
LOWsrc/soup_cli/utils/tool_outputs.py143 def set_error(self, text: str) -> None:CODE
LOWsrc/soup_cli/utils/prune_prompt.py440__all__ = [CODE
LOWsrc/soup_cli/utils/seeding.py39logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/ci_workflow.py217__all__ = ["render_soup_gate_workflow", "write_soup_gate_workflow"]CODE
LOWsrc/soup_cli/utils/data_forge.py712__all__ = [CODE
LOWsrc/soup_cli/utils/local_rl_scheduler.py267__all__ = [CODE
LOWsrc/soup_cli/utils/ra_dit_run.py46__all__ = [CODE
LOWsrc/soup_cli/utils/prompt_distill.py316__all__ = [CODE
LOWsrc/soup_cli/utils/data_doctor.py913__all__ = [CODE
LOWsrc/soup_cli/utils/reward_hack_control.py47logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/prompt_compile.py478__all__ = [CODE
LOWsrc/soup_cli/utils/tracing.py13logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/persona_hub.py268__all__ = [CODE
LOWsrc/soup_cli/utils/layer_shard.py37logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/mix_proxy.py43__all__ = [CODE
LOWsrc/soup_cli/utils/curriculum_dynamic.py35__all__ = [CODE
LOWsrc/soup_cli/utils/vllm.py10logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/magpie.py579__all__ = [CODE
LOWsrc/soup_cli/utils/data_pipeline.py803__all__ = [CODE
LOWsrc/soup_cli/utils/embed.py18logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/apple_adapter.py56logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/apple_adapter.py564__all__ = [CODE
LOWsrc/soup_cli/utils/drift_alarm.py243__all__ = [CODE
LOWsrc/soup_cli/utils/anthropic_messages.py210__all__ = [CODE
LOWsrc/soup_cli/utils/deploy_autopilot.py384__all__ = [CODE
LOWsrc/soup_cli/utils/prm_reward.py435__all__ = [CODE
LOWsrc/soup_cli/utils/hardware_fit.py347__all__ = [CODE
LOWsrc/soup_cli/utils/multipack_trainer.py34logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/server_tools.py169__all__ = [CODE
LOWsrc/soup_cli/utils/license_advisor.py321__all__ = [CODE
LOWsrc/soup_cli/utils/tunability.py620__all__ = [CODE
LOWsrc/soup_cli/utils/interference_live.py163__all__ = ["measure_interference_losses"]CODE
LOWsrc/soup_cli/utils/terraform_plan.py413__all__ = [CODE
LOWsrc/soup_cli/utils/grpo_long_context.py27logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/peft_wiring.py19logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/ngram_spec.py65__all__ = [CODE
LOWsrc/soup_cli/utils/fsdp_consolidate.py30logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/completions.py294__all__ = [CODE
LOWsrc/soup_cli/utils/build_dag.py1025__all__ = [CODE
LOWsrc/soup_cli/utils/brain_rot.py363__all__ = [CODE
LOWsrc/soup_cli/utils/brain_rot_lang.py267__all__ = [CODE
LOWsrc/soup_cli/utils/lisa.py35logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/recipe_run.py668__all__ = ["run_recipe"]CODE
LOWsrc/soup_cli/utils/expectations.py537__all__ = [CODE
LOWsrc/soup_cli/utils/agent_forge.py563__all__ = [CODE
LOWsrc/soup_cli/utils/data_mix.py47__all__ = [CODE
LOWsrc/soup_cli/utils/ab_test.py307__all__ = [CODE
LOWsrc/soup_cli/utils/layer_stream_runtime.py27logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/layer_stream_runtime.py70def _set_module_param(root: Any, full_name: str, tensor: Any) -> None:CODE
LOWsrc/soup_cli/utils/freeze.py9logger = logging.getLogger(__name__)CODE
LOWsrc/soup_cli/utils/echo_trap.py478__all__ = [CODE
LOWsrc/soup_cli/utils/compile_tools.py234__all__ = [CODE
LOWsrc/soup_cli/utils/webhooks.py164__all__ = [CODE
LOWsrc/soup_cli/utils/local_rl.py351def set_state(db_path: str, key: str, value: str) -> None:CODE
82 more matches not shown…
Docstring Block Structure25 hits · 125 pts
SeverityFileLineSnippetContext
HIGHsrc/soup_cli/utils/fsdp.py64Get FSDP config dict by preset name. Args: preset: One of 'full_shard', 'shard_grad', 'full_offload'. STRING
HIGHsrc/soup_cli/utils/fsdp.py104Mutate and return ``training_kwargs`` with FSDP + optional torch.compile. Centralizes the "FSDP-block" logic from tSTRING
HIGHsrc/soup_cli/utils/data_forge.py534Build a ``judge(prompt) -> {'text': str}`` callable for ``provider``. Args: provider: one of ``"ollama"`` /STRING
HIGHsrc/soup_cli/utils/ra_dit_run.py300Chain the two RA-DIT stages: retriever → auto-link → generator. Args: retriever_config: Path (under cwd) toSTRING
HIGHsrc/soup_cli/utils/mix_proxy.py264Run one short proxy training and return the observed eval loss. Args: weights: Per-dataset interleave probaSTRING
HIGHsrc/soup_cli/utils/kernel_picker.py262Pick the fastest kernel combo given benchmarked timings. Args: candidates: List of dicts each with ``name``STRING
HIGHsrc/soup_cli/utils/multipack_sampler.py86First-Fit-Decreasing bin packing. Args: lengths: per-sample sequence lengths. max_len: maximum sum STRING
HIGHsrc/soup_cli/utils/ebft_gdpo.py307Energy-Based Fine-Tuning loss kernel (v0.53.2 #135). EBFT treats per-token logits as energies (lower = more probablSTRING
HIGHsrc/soup_cli/utils/lr_finder.py136Run an in-process LR-sweep training loop (#56, v0.33.0). For each LR in ``schedule``, pulls the next batch from ``dSTRING
HIGHsrc/soup_cli/utils/gradient_ckpt.py94Install selective / medium gradient-checkpoint hooks on transformer blocks (#44, v0.33.0). Iterates the model'sSTRING
HIGHsrc/soup_cli/utils/hubs.py652Snapshot ``base`` from ``hub`` into a cwd-contained cache + return path. v0.53.10 #152 — shared helper extracted frSTRING
HIGHsrc/soup_cli/utils/jinja_analyzer.py55Walk ``template``'s Jinja AST and return the set of message fields. Detects both attribute-style ``{{ m.role }}`` aSTRING
HIGHsrc/soup_cli/utils/recipe_run.py532Execute a validated :class:`RecipeDAG` end-to-end (v0.53.7 live). Per-node handlers dispatch on ``RecipeNode.kind``STRING
HIGHsrc/soup_cli/utils/longlora.py264Apply the LongLoRA S² shift to half the attention heads. Pure math kernel used by :func:`apply_longlora_forward_oveSTRING
HIGHsrc/soup_cli/utils/strict_safetensors.py216Refuse pickle / PyTorch-classic weights when ``strict=True``. Args: model_dir: cwd-contained model / adapteSTRING
HIGHsrc/soup_cli/utils/neat_packing.py37Convert document boundaries into per-token 1-indexed segment IDs. Example: ``[0, 3, 5, 9]`` (3 docs of length 3, 2,STRING
HIGHsrc/soup_cli/utils/neat_packing.py107Build a ``(B, 1, S, S)`` additive attention mask from segment IDs. Args: seq_pos_ids: integer array of shapSTRING
HIGHsrc/soup_cli/utils/data_mix.py190Validate dataset paths: containment + dedup + bounds. Args: raw: Sequence of dataset paths (relative or absSTRING
HIGHsrc/soup_cli/utils/freeze.py77Freeze every parameter, then unfreeze those matching ``patterns``. This is the Spectrum (#266) targeted-training meSTRING
HIGHsrc/soup_cli/utils/trust_remote.py94Decide whether to pass ``trust_remote_code=True`` to HF loaders. Args: model_name: HF repo id or local pathSTRING
HIGHsrc/soup_cli/utils/multipack.py47Build a :class:`MultipackBatchSampler` from per-sample token lengths. Args: lengths: token counts for each STRING
HIGHsrc/soup_cli/utils/ollama.py160Generate Ollama Modelfile content. Args: gguf_path: Path to the GGUF model file. template: TemplateSTRING
HIGHsrc/soup_cli/utils/cross_doc_attn.py26Build a block-diagonal causal attention mask. Args: boundaries: Sorted document boundary indices in ``[0, sSTRING
HIGHsrc/soup_cli/data/loss_mask.py257Build labels where only assistant tokens contribute to loss. Args: messages: Chat messages list (``{"role":STRING
HIGHsrc/soup_cli/data/providers/anthropic.py24Generate examples using Anthropic Claude API. Args: prompt: User-provided topic/instructions. countSTRING
Modern AI Meta-Vocabulary36 hits · 110 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_v07129.py439# Task 4 — commands/shrink.py prune orchestration + CLI registrationCOMMENT
MEDIUMtests/test_v0580.py498# Part C — budget guardrailsCOMMENT
MEDIUMtests/test_v0715.py187 profile = self._profile() # factual_lookup + high variance → RAGCODE
MEDIUMtests/test_v0715.py196 profile = self._profile() # would be RAG by defaultCODE
MEDIUMtests/test_v0535.py511 # `subprocess.run` and asserts orchestration instead.)COMMENT
MEDIUMtests/test_v0680_part_e.py434 # scaffold and exits 0 (no systemctl call).COMMENT
MEDIUMdocs/training.md42- [RAFT — Retrieval-Augmented Fine-Tuning](#raft--retrieval-augmented-fine-tuning)CODE
MEDIUMdocs/training.md43- [RA-DIT — Retrieval-Augmented Dual Instruction Tuning](#ra-dit--retrieval-augmented-dual-instruction-tuning)CODE
MEDIUMdocs/evaluation.md73# Choice: SFT (or PROMPT_ENG / RAG / DPO / GRPO)COMMENT
MEDIUMdocs/evaluation.md78# Optional ROI probe (offline heuristic: zero/few-shot + RAG + LoRA estimate).COMMENT
MEDIUMdocs/evaluation.md78# Optional ROI probe (offline heuristic: zero/few-shot + RAG + LoRA estimate).COMMENT
MEDIUMdocs/evaluation.md81# LIVE ROI probe (v0.71.7): loads the model for zero/few-shot token-F1, a shortCOMMENT
MEDIUMsrc/soup_cli/config/schema.py3773 # so a recipe locks the right pairing; live two-stage orchestrationCOMMENT
MEDIUMsrc/soup_cli/config/schema.py6549# Fine-tune a model for chain-of-thought reasoning with GRPOCOMMENT
MEDIUMsrc/soup_cli/config/schema.py6844# Extend model context window for long-document understandingCOMMENT
MEDIUMsrc/soup_cli/config/schema.py6878# Fine-tune a sentence embedding model (BGE, E5, GTE, etc.)COMMENT
MEDIUMsrc/soup_cli/utils/advise.py944 # Heuristic: shorter outputs → easier zero-shot; long-form → harder.COMMENT
MEDIUMsrc/soup_cli/utils/advise.py946 # Few-shot beats zero-shot by a small margin when input length is moderate.COMMENT
MEDIUMsrc/soup_cli/utils/advise.py948 # RAG only helps when there's lookup-style variance.COMMENT
MEDIUMsrc/soup_cli/utils/advise.py719 # Marginal RAG → SFT flip: strong SFT track record, no comparable RAGCOMMENT
MEDIUMsrc/soup_cli/utils/advise.py720 # track record. RAG is the marginal call (it fired on a heuristicCOMMENT
MEDIUMsrc/soup_cli/utils/advise.py1063 "# RAG is outside Soup core — wire your data into a vector store "CODE
MEDIUMsrc/soup_cli/utils/advise.py910 a LIVE probe (#161): it generates zero-shot and few-shot completions on aSTRING
MEDIUMsrc/soup_cli/utils/ra_dit_run.py1"""v0.71.10 #200 — live RA-DIT two-stage orchestration + retriever auto-link.STRING
MEDIUMsrc/soup_cli/utils/prm_reward.py225 # Cap the assembled length to the PRM's own context window (bounded by aCOMMENT
MEDIUMsrc/soup_cli/utils/asr_metrics.py154 # pure insertions so a hallucination on an empty-ref row is NOTCOMMENT
MEDIUMsrc/soup_cli/utils/compile_tools.py33# -> str`` callable so the parse -> iterate -> write orchestration isCOMMENT
MEDIUMsrc/soup_cli/utils/spectrum_scan.py564# Resolve + scan orchestrationCOMMENT
MEDIUMsrc/soup_cli/templates/embedding.yaml2# Fine-tune a sentence embedding model (BGE, E5, GTE, etc.)COMMENT
MEDIUMsrc/soup_cli/templates/reasoning.yaml2# Fine-tune a model for chain-of-thought reasoning with GRPOCOMMENT
MEDIUMsrc/soup_cli/templates/longcontext.yaml2# Extend model context window for long-document understandingCOMMENT
MEDIUMsrc/soup_cli/commands/advise.py298 # Pick the best of zero-shot vs few-shot as the "prompt_eng" baseline.COMMENT
MEDIUMsrc/soup_cli/commands/eval.py1341 # so CI without GPUs can still smoke-test the orchestration layer.COMMENT
MEDIUMsrc/soup_cli/commands/local_rl.py211 # Render the scheduler scaffold; never run systemctl / launchctl.COMMENT
MEDIUMsrc/soup_cli/data/formats.py492_MAX_RAFT_FIELD_LEN = 65_536 # 64 KiB per document — generous for legal/RAG corpora.CODE
MEDIUMsrc/soup_cli/trainer/asr.py272 # teaches hallucination), so count both and warn once after the map.COMMENT
Self-Referential Comments22 hits · 73 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_registry.py755 # Create a finished run firstCOMMENT
MEDIUMtests/test_sweep.py269 # Create a minimal configCOMMENT
MEDIUMtests/test_v0620_part_c.py344 # Create a tiny pairs JSONL to pass the path-containment check.COMMENT
MEDIUMtests/test_v0580.py1311 # Create the dir then monkeypatch os.listdir to raise — simulates aCOMMENT
MEDIUMtests/test_vllm_serve.py71 # Create a fake model dirCOMMENT
MEDIUMtests/test_v0537.py293 # Create a tiny module with an upper-casing transformCOMMENT
MEDIUMtests/test_ui.py315 # Create a runCOMMENT
MEDIUMtests/test_sglang_serve.py213 # Create a dummy model pathCOMMENT
MEDIUMtests/test_templates_yaml.py115 # Create a file OUTSIDE the templates dirCOMMENT
MEDIUMtests/test_adapters.py28 # Create a small dummy safetensors file (just for size detection)COMMENT
MEDIUMtests/test_bugfixes.py823 # Create a real callable with no params (like experimental PPOTrainer.train)COMMENT
MEDIUMtests/test_bugfixes.py861 # Create a real callable that accepts resume_from_checkpointCOMMENT
MEDIUMtests/test_part_f_hardening.py90 # Create a broken symlink as 'checkpoint-300'COMMENT
MEDIUMtests/test_v0660_followups.py237 # Create a real adapter dirCOMMENT
MEDIUMtests/test_dataset_registry.py133 # Create a dummy data fileCOMMENT
MEDIUMtests/test_cli.py59 # Create a file (not a directory)COMMENT
MEDIUMtests/test_cli.py69 # Create an empty directory (no adapter_config.json or config.json)COMMENT
MEDIUMsrc/soup_cli/templates/eu-ai-act.yaml4# This file is a normal training config — the compliance controls are SoupCOMMENT
MEDIUMsrc/soup_cli/templates/hipaa.yaml4# This file is a normal training config — the compliance controls are SoupCOMMENT
MEDIUMsrc/soup_cli/templates/soc2.yaml4# This file is a normal training config — the compliance controls are SoupCOMMENT
MEDIUMsrc/soup_cli/templates/sr-11-7.yaml4# This file is a normal training config — the compliance controls are SoupCOMMENT
MEDIUMsrc/soup_cli/trainer/embedding.py412 # Create a custom Trainer subclass dynamically to inject compute_lossCOMMENT
Over-Commented Block75 hits · 63 pts
SeverityFileLineSnippetContext
LOW.pre-commit-config.yaml1# Pre-commit hooks for Soup CLI.COMMENT
LOW.pre-commit-config.yaml21# 2. run `ruff format src/soup_cli/ tests/` and commit the result alone,COMMENT
LOWpyproject.toml41 # Soup supports both the 5.x and 6.x surfaces through plotext_compat (#522).COMMENT
LOWpyproject.toml61 # explicit qwen3_5_text target policy below the automatic PEFT mapping layer.COMMENT
LOWpyproject.toml81 # the config class whether it accepts the keyword (trainer/_trl_compat.py)COMMENT
LOWpyproject.toml141 "mlx-lm>=0.31.3",COMMENT
LOWpyproject.toml161# stays infra-blocked and is NOT bundled here.COMMENT
LOWpyproject.toml181# `mcp.shared.memory.create_connected_server_and_client_session` and droppedCOMMENT
LOWtests/test_issue459_interleave_streaming_hub.py561 streaming=True,COMMENT
LOWtests/test_issue443_interleave_wiring.py301 cfg = load_config_from_string(yaml_text)COMMENT
LOWtests/test_v0640_part_c.py721 monkeypatch.chdir(tmp_path)COMMENT
LOWtests/test_v0535.py501 # but `DataConfig.train` was typed `str`, so every `--live` candidateCOMMENT
LOWtests/test_v07202.py1261#: BY CONSTRUCTION, and the construction is worth stating precisely because it wasCOMMENT
LOWtests/test_v07202.py1281#:COMMENT
LOWtests/test_v07203.py481COMMENT
LOWtests/test_v07203.py1401#: Free RAM to report so the tiny base comfortably takes the RAM tier.COMMENT
LOWexamples/configs/rlhf_step3_ppo.yaml1# RLHF Step 3: PPO TrainingCOMMENT
LOWexamples/configs/sft_basic.yaml1# SFT Basic ExampleCOMMENT
LOWexamples/configs/rlhf_step1_sft.yaml1# RLHF Step 1: Supervised Fine-Tuning (SFT)COMMENT
LOWexamples/configs/grpo_reasoning.yaml1# GRPO Reasoning ExampleCOMMENT
LOWexamples/configs/vision_llama.yaml1# TEMPLATE — NOT runnable as-is. Bring your own images and JSONL.COMMENT
LOWexamples/configs/rlhf_step2_reward.yaml1# RLHF Step 2: Train Reward ModelCOMMENT
LOW.github/FUNDING.yml1# Sponsor button shown in the repo sidebar and on every issue / PR.COMMENT
LOW.github/constraints/transformers-floor.txt1# #571 — exact pins for the dedicated dependency-floor CI job.COMMENT
LOW.github/workflows/dependency-drift.yml1# Dependency drift (#323).COMMENT
LOW.github/workflows/ci.yml21 # reject: 195d60b used the `runner` context in a job-level `env:` block,COMMENT
LOW.github/workflows/ci.yml161 restore-keys: hf-${{ runner.os }}-COMMENT
LOW.github/workflows/ci.yml241 - name: Save HF Hub cacheCOMMENT
LOWsrc/soup_cli/config/schema.py41# names in apply_unfrozen_parameters. soup.yaml is shareable config, so theCOMMENT
LOWsrc/soup_cli/config/schema.py5201 # model, and under streaming that model never loads, so the probe wouldCOMMENT
LOWsrc/soup_cli/config/schema.py5581 # literally (not imported — that would import loader.py, whichCOMMENT
LOWsrc/soup_cli/config/schema.py6941 alpha: 16COMMENT
LOWsrc/soup_cli/utils/liger.py61 # model name. That private classmethod does not exist in liger-kernel 0.8.1COMMENT
LOWsrc/soup_cli/utils/ship_verdict.py101#COMMENT
LOWsrc/soup_cli/utils/deepspeed.py81# `offload_optimizer` stays "none" deliberately. Turning it on makes DeepSpeedCOMMENT
LOWsrc/soup_cli/utils/deepspeed.py121# real hardware in #336:COMMENT
LOWsrc/soup_cli/utils/lr_finder.py221 # but ``smoothed_losses`` could carry a non-finite if the input lossCOMMENT
LOWsrc/soup_cli/utils/multipack_trainer.py141 class MultipackTrainer(base_cls): # type: ignore[misc, valid-type]COMMENT
LOWsrc/soup_cli/utils/multipack_trainer.py221 data_collator = getattr(self, "data_collator", None)COMMENT
LOWsrc/soup_cli/utils/multipack_trainer.py241 # Full multi-GPU validation is a QA issue (no multi-GPU box here);COMMENT
LOWsrc/soup_cli/utils/tts.py201 "task='tts' is not supported on backend=mlx in v0.52.0"COMMENT
LOWsrc/soup_cli/utils/longlora.py21import reCOMMENT
LOWsrc/soup_cli/utils/layer_stream_runtime.py881COMMENT
LOWsrc/soup_cli/utils/layer_stream_runtime.py901 # match no child and are inert) and nothing is double-added.COMMENT
LOWsrc/soup_cli/utils/layer_stream_runtime.py961 # `...layers.0.inner.self_attn.q_proj.lora_A.weight`. That fileCOMMENT
LOWsrc/soup_cli/utils/layer_stream.py41# Measured throughput a page-locked RAM store buys over a pageable oneCOMMENT
LOWsrc/soup_cli/utils/layer_stream.py61COMMENT
LOWsrc/soup_cli/utils/layer_stream.py101 "qwen3_5_moe": "qwen3",COMMENT
LOWsrc/soup_cli/utils/layer_stream.py121COMMENT
LOWsrc/soup_cli/utils/layer_stream.py141#: it sees only its own reference — this stays charged: dropping it under-COMMENT
LOWsrc/soup_cli/utils/layer_stream.py161#: rounding, small per-run buffers). It came out at ~13.3 MB for a 135M modelCOMMENT
LOWsrc/soup_cli/utils/layer_stream.py301 kind: strCOMMENT
LOWsrc/soup_cli/utils/layer_stream.py1461 if tier == TIER_DISK:COMMENT
LOWsrc/soup_cli/utils/gpu.py401 if not torch.cuda.is_available():COMMENT
LOWsrc/soup_cli/utils/uld.py321 )COMMENT
LOWsrc/soup_cli/utils/env_lock.py261 for raw in requirements:COMMENT
LOWsrc/soup_cli/utils/active_sampler.py141 # 1 - |2*s - 1| -> peak at s=0.5COMMENT
LOWsrc/soup_cli/templates/eu-ai-act.yaml1# Soup compliance template: EU AI Act (Annex XI/XII technical documentation)COMMENT
LOWsrc/soup_cli/templates/hipaa.yaml1# Soup compliance template: HIPAA (Protected Health Information)COMMENT
LOWsrc/soup_cli/templates/rlhf.yaml1# Soup template: Full RLHF Pipeline (SFT + Reward Model + PPO)COMMENT
15 more matches not shown…
AI Slop Vocabulary23 hits · 60 pts
SeverityFileLineSnippetContext
MEDIUMpyproject.toml113# Aider's normal CLI. Its Polyglot harness is source-only, so `soup eval aider`COMMENT
LOWtests/test_registry.py1007 # SQL injection attempt — should simply return 0 hits, not crashCOMMENT
LOWtests/test_issue443_interleave_wiring.py358 # the real process cwd — must actually chdir, not just pass tmp_path.COMMENT
LOWtests/test_doctor.py160 # We mock mp.spawn to just set a value in the return_dict instead of actually running processes.COMMENT
MEDIUMtests/test_v0401_part_d.py1"""v0.40.1 Part D — CLI UX consistency tests (highest-leverage subset).STRING
LOWtests/test_inference_advanced.py482 # Should not raise, just return None + logCOMMENT
MEDIUMtests/test_v0713.py33# Rich's FORCE_COLOR splitting on CI (mirrors the v0.71.1 ANSI-robust fix:COMMENT
LOWtests/test_bugfixes.py914 # resume is None/falsy so it should just call train()COMMENT
MEDIUMtests/test_v0404_part_a.py27# Strip ANSI so substring assertions are robust. Mirrors the helper inCOMMENT
MEDIUMtests/test_trust_remote_code.py19# ANSI so substring assertions are robust. Mirrors the helper inCOMMENT
MEDIUMtests/test_log_level.py23# substring assertions are robust across all CI matrix jobs.COMMENT
MEDIUMtests/test_v0718.py45# Tiny real-torch harness for activation capture (#215 / #217 / #219).COMMENT
MEDIUMtests/test_v07141.py179 # zip short-circuits) — must be a hard error, never a silent 0/1=robust.COMMENT
MEDIUMtests/test_v07141.py345 # false "robust" exit 0.STRING
MEDIUMbenchmarks/harness/bnb_repro.py263 # A successful reproduction here would mean the harness is notCOMMENT
MEDIUMbenchmarks/harness/bnb_repro.py282 # is removed or bypassed, the comparison becomes equal and the harnessCOMMENT
MEDIUMsrc/soup_cli/cli.py347# v0.63.0 Part D — mSPRT A/B harness.COMMENT
MEDIUMsrc/soup_cli/utils/curriculum_dynamic.py263 # Median is robust to outliers; matches Axolotl curriculum policy.COMMENT
MEDIUMsrc/soup_cli/utils/capability_suite.py249 # Lazy-load the harness via importlib so the module has no heavyCOMMENT
MEDIUMsrc/soup_cli/utils/freeze.py117 # (quantization='none') normally prevents this, but stay robust.COMMENT
MEDIUMsrc/soup_cli/commands/reward.py287 """Adversarially probe a reward verifier for gameability (exit 0 robust / 2 gameable)."""STRING
MEDIUMsrc/soup_cli/commands/doctor.py576_NCCL_BENCHMARK_TIMED_ITERS = 10 # 10 timed runs; report the median (robust to outliers)CODE
MEDIUMsrc/soup_cli/commands/doctor.py608 # Per-iteration timing (10 samples). Median is more robust toCOMMENT
AI Structural Patterns61 hits · 56 pts
SeverityFileLineSnippetContext
LOWtests/test_v07127.py59CODE
LOWtests/test_v07122.py626CODE
LOWtests/test_v07203.py2015CODE
LOWsrc/soup_cli/utils/reward_hack_control.py804CODE
LOWsrc/soup_cli/utils/layer_shard.py650CODE
LOWsrc/soup_cli/utils/vllm.py144CODE
LOWsrc/soup_cli/utils/magpie.py475CODE
LOWsrc/soup_cli/utils/long_context.py281CODE
LOWsrc/soup_cli/utils/adapter_pr.py243CODE
LOWsrc/soup_cli/utils/layer_stream_runtime.py2256CODE
LOWsrc/soup_cli/utils/launcher.py118CODE
LOWsrc/soup_cli/commands/distill_prompt.py22CODE
LOWsrc/soup_cli/commands/data_forge.py25CODE
LOWsrc/soup_cli/commands/data_doctor.py138CODE
LOWsrc/soup_cli/commands/merge.py14CODE
LOWsrc/soup_cli/commands/steer.py57CODE
LOWsrc/soup_cli/commands/deploy.py202CODE
LOWsrc/soup_cli/commands/deploy.py571CODE
LOWsrc/soup_cli/commands/shrink.py234CODE
LOWsrc/soup_cli/commands/generate.py22CODE
LOWsrc/soup_cli/commands/generate.py494CODE
LOWsrc/soup_cli/commands/ci.py24CODE
LOWsrc/soup_cli/commands/tunability.py47CODE
LOWsrc/soup_cli/commands/serve.py68CODE
LOWsrc/soup_cli/commands/serve.py1486CODE
LOWsrc/soup_cli/commands/serve.py1578CODE
LOWsrc/soup_cli/commands/serve.py2264CODE
LOWsrc/soup_cli/commands/edit.py127CODE
LOWsrc/soup_cli/commands/edit.py326CODE
LOWsrc/soup_cli/commands/export.py35CODE
LOWsrc/soup_cli/commands/bench.py15CODE
LOWsrc/soup_cli/commands/diagnose.py232CODE
LOWsrc/soup_cli/commands/chat.py14CODE
LOWsrc/soup_cli/commands/chat.py306CODE
LOWsrc/soup_cli/commands/bom.py30CODE
LOWsrc/soup_cli/commands/data_mix.py44CODE
LOWsrc/soup_cli/commands/train.py190CODE
LOWsrc/soup_cli/commands/infer.py54CODE
LOWsrc/soup_cli/commands/diff.py16CODE
LOWsrc/soup_cli/commands/sweep.py18CODE
LOWsrc/soup_cli/commands/ship.py1144CODE
LOWsrc/soup_cli/commands/eval.py138CODE
LOWsrc/soup_cli/commands/attest.py35CODE
LOWsrc/soup_cli/commands/local_rl.py160CODE
LOWsrc/soup_cli/commands/reward.py111CODE
LOWsrc/soup_cli/commands/reward.py258CODE
LOWsrc/soup_cli/commands/draft.py476CODE
LOWsrc/soup_cli/commands/draft.py653CODE
LOWsrc/soup_cli/commands/_eval_v0650.py251CODE
LOWsrc/soup_cli/commands/data.py882CODE
LOWsrc/soup_cli/commands/data.py1582CODE
LOWsrc/soup_cli/commands/data.py1893CODE
LOWsrc/soup_cli/commands/data.py2817CODE
LOWsrc/soup_cli/commands/data.py3021CODE
LOWsrc/soup_cli/commands/data.py3577CODE
LOWsrc/soup_cli/commands/push.py22CODE
LOWsrc/soup_cli/commands/adapters.py343CODE
LOWsrc/soup_cli/commands/adapters.py955CODE
LOWsrc/soup_cli/commands/adapters.py1420CODE
LOWsrc/soup_cli/monitoring/callback.py32CODE
1 more matches not shown…
Verbosity Indicators9 hits · 18 pts
SeverityFileLineSnippetContext
LOWsrc/soup_cli/config/schema.py6991# Step 1: soup train --config soup_sft.yaml # SFT warmupCOMMENT
LOWsrc/soup_cli/config/schema.py6992# Step 2: soup train --config soup_rm.yaml # Train reward modelCOMMENT
LOWsrc/soup_cli/config/schema.py6993# Step 3: soup train --config soup_ppo.yaml # PPO with reward modelCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml5# Step 1: soup train --config soup_sft.yaml # SFT warmupCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml6# Step 2: soup train --config soup_rm.yaml # Train reward modelCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml7# Step 3: soup train --config soup_ppo.yaml # PPO with reward modelCOMMENT
LOWsrc/soup_cli/commands/export.py289 # Step 1: Convert HF model to GGUF (f16)COMMENT
LOWsrc/soup_cli/commands/export.py757 # Step 1: Convert HF model to TensorRT-LLM checkpointCOMMENT
LOWsrc/soup_cli/commands/export.py783 # Step 2: Build TensorRT engineCOMMENT
Structural Annotation Overuse9 hits · 18 pts
SeverityFileLineSnippetContext
LOWsrc/soup_cli/config/schema.py6991# Step 1: soup train --config soup_sft.yaml # SFT warmupCOMMENT
LOWsrc/soup_cli/config/schema.py6992# Step 2: soup train --config soup_rm.yaml # Train reward modelCOMMENT
LOWsrc/soup_cli/config/schema.py6993# Step 3: soup train --config soup_ppo.yaml # PPO with reward modelCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml5# Step 1: soup train --config soup_sft.yaml # SFT warmupCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml6# Step 2: soup train --config soup_rm.yaml # Train reward modelCOMMENT
LOWsrc/soup_cli/templates/rlhf.yaml7# Step 3: soup train --config soup_ppo.yaml # PPO with reward modelCOMMENT
LOWsrc/soup_cli/commands/export.py289 # Step 1: Convert HF model to GGUF (f16)COMMENT
LOWsrc/soup_cli/commands/export.py757 # Step 1: Convert HF model to TensorRT-LLM checkpointCOMMENT
LOWsrc/soup_cli/commands/export.py783 # Step 2: Build TensorRT engineCOMMENT
Fake / Example Data16 hits · 16 pts
SeverityFileLineSnippetContext
LOWtests/test_issue459_interleave_streaming_hub.py540 (tmp_path / f"a{suffix}").write_text("placeholder", encoding="utf-8")CODE
LOWtests/test_issue459_interleave_streaming_hub.py541 (tmp_path / f"b{suffix}").write_text("placeholder", encoding="utf-8")CODE
LOWtests/test_v07127.py1388 prompt = "Please summarize the following article: " + ("lorem ipsum " * 5)CODE
LOWtests/test_v07127.py1396 prompt = "Please summarize the following article: " + ("lorem ipsum " * 5)CODE
LOWtests/test_v07127.py1523 leak_prompt = "Please summarize the following unique article: " + ("lorem ipsum " * 5)CODE
LOWtests/test_v05310.py117 presidio_hits = [{"kind": "email", "snippet": "user@example.com"}]CODE
LOWtests/test_v07116.py236 "lorem ipsum dolor sit amet consectetur",CODE
LOWtests/test_v07116.py236 "lorem ipsum dolor sit amet consectetur",CODE
LOWtests/test_v07122.py1207 assert original_assistant["content"] == "placeholder"CODE
LOWtests/test_v07122.py1194 original_assistant = {"role": "assistant", "content": "placeholder"}CODE
LOWtests/test_v0537.py1797 target = self._write_arrow_dir(tmp_path, cache_key="placeholder")CODE
LOWtests/test_v0537.py1838 target = self._write_arrow_dir(tmp_path, cache_key="placeholder")CODE
LOWtests/test_v0712.py1502 existing.write_text("placeholder", encoding="utf-8")CODE
LOWtests/test_v0430_part_d.py82 target.write_text("placeholder", encoding="utf-8")CODE
LOWtests/test_v0430_part_d.py108 outside.write_text("placeholder", encoding="utf-8")CODE
LOWdocs/adapters-and-governance.md203 --subject "The CEO of Acme is" --target "Jane Doe"CODE
Redundant / Tautological Comments10 hits · 16 pts
SeverityFileLineSnippetContext
LOWtests/test_awq_gptq_export.py881 # Set cwd to a subdirectory so ../evil is outsideCOMMENT
LOWsrc/soup_cli/ui/app.py478 # Check if training is still runningCOMMENT
LOWsrc/soup_cli/commands/export.py603 # Check if it's in PATHCOMMENT
LOWsrc/soup_cli/commands/export.py627 # Check if LoRA adapterCOMMENT
LOWsrc/soup_cli/commands/export.py726 # Check if LoRA adapterCOMMENT
LOWsrc/soup_cli/commands/export.py934 # Check if LoRA adapter — merge firstCOMMENT
LOWsrc/soup_cli/commands/export.py1080 # Check if LoRA adapter — merge firstCOMMENT
LOWsrc/soup_cli/commands/eval.py393 # Display resultsCOMMENT
LOWsrc/soup_cli/commands/data.py652 # Check if this is a vision datasetCOMMENT
LOWsrc/soup_cli/data/loader.py368 # Check if it's a HuggingFace datasetCOMMENT
Example Usage Blocks9 hits · 15 pts
SeverityFileLineSnippetContext
LOWexamples/configs/dpo_example.yaml5# Usage:COMMENT
LOWexamples/configs/rlhf_step3_ppo.yaml9# Usage:COMMENT
LOWexamples/configs/sft_basic.yaml9# Usage:COMMENT
LOWexamples/configs/rlhf_step1_sft.yaml8# Usage:COMMENT
LOWexamples/configs/grpo_reasoning.yaml10# Usage:COMMENT
LOWexamples/configs/rlhf_step2_reward.yaml8# Usage:COMMENT
LOWexamples/configs/dpo_chat.yaml9# Usage:COMMENT
LOWsrc/soup_cli/config/schema.py6990# Usage:COMMENT
LOWsrc/soup_cli/templates/rlhf.yaml4# Usage:COMMENT
Slop Phrases2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMtests/test_refusal_multilingual.py68 assert looks_like_refusal("As an AI language model, I refuse to answer.")CODE
MEDIUMtests/test_v0560.py280 assert looks_like_refusal("As an AI language model, I refuse to answer.")CODE