Repository Analysis

TransformerLensOrg/TransformerLens

A library for mechanistic interpretability of GPT-style language models

44.7 Strong AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of TransformerLensOrg/TransformerLens, a Python project with 3,764 GitHub stars. SynthScan v2.0 examined 212,279 lines of code across 925 source files, recording 6001 pattern matches distributed across 22 syntactic categories. The overall adjusted score of 44.7 places this repository in the Strong AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

44.7
Adjusted Score
44.7
Raw Score
100%
Time Factor
2026-08-08
Last Push
3.8K
Stars
Python
Language
212.3K
Lines of Code
925
Files
6.0K
Pattern Hits
2026-08-09
Scan Date
0.32
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 295MEDIUM 765LOW 4941

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 6001 distinct pattern matches across 22 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers3845 hits · 4158 pts
SeverityFileLineSnippetContext
LOWtests/conftest.py62def _enable_hf_retry_for_tests():CODE
LOWtests/unit/test_key_value_cache_entry.py45def test_init_cache_entry_dtype_independent_of_global_default():CODE
LOWtests/unit/test_key_value_cache_entry.py64def test_append_preserves_cfg_dtype():CODE
LOWtests/unit/test_key_value_cache_entry.py77def test_init_cache_entry_handles_grouped_query_attention():CODE
LOWtests/unit/test_utils.py154def test_override_or_use_default_value():CODE
LOWtests/unit/test_utils.py170def test_is_library_available():CODE
LOWtests/unit/test_utils.py306 def test_init_kaiming_uniform(self, d_model, d_mlp, nonlinearity):CODE
LOWtests/unit/test_utils.py443 def test_no_split_tokens_across_chunks(self):CODE
LOWtests/unit/test_utils.py486 def test_no_split_tokens_in_no_whitespace_text(self):CODE
LOWtests/unit/test_utils.py520 def test_single_document_batch_does_not_crash(self):CODE
LOWtests/unit/test_utils.py541 def test_iterable_dataset_with_set_format_false(self, gpt2_tokenizer):CODE
LOWtests/unit/test_utils.py573def test_tokenize_and_concatenate_no_spurious_sequence_length_warning():CODE
LOWtests/unit/test_utils.py611def test_tokenize_and_concatenate_short_sequence_no_invalid_tokens():CODE
LOWtests/unit/test_evals_ioi.py19def test_ioi_dataset_produces_diverse_samples():CODE
LOWtests/unit/test_evals_ioi.py34def test_ioi_dataset_reproducible_with_seed():CODE
LOWtests/unit/test_evals_ioi.py44def test_ioi_dataset_different_seeds_differ():CODE
LOWtests/unit/test_evals_ioi.py54def test_ioi_dataset_no_seed_is_valid():CODE
LOWtests/unit/test_evals_ioi.py61def test_ioi_dataset_symmetric():CODE
LOWtests/unit/test_lit.py130 def test_tensor_to_numpy_tensor(self):CODE
LOWtests/unit/test_lit.py141 def test_tensor_to_numpy_array(self):CODE
LOWtests/unit/test_lit.py151 def test_tensor_to_numpy_none(self):CODE
LOWtests/unit/test_lit.py168 def test_numpy_to_tensor_with_device(self):CODE
LOWtests/unit/test_lit.py249 def test_input_field_names_drive_input_spec(self, mock_hooked_transformer):CODE
LOWtests/unit/test_lit.py289 def test_no_tokenizer_error_is_raised(self, mock_hooked_transformer):CODE
LOWtests/unit/test_lit.py308 def test_simple_text_dataset_init(self, sample_examples):CODE
LOWtests/unit/test_lit.py318 def test_simple_text_dataset_from_strings(self, sample_texts):CODE
LOWtests/unit/test_lit.py328 def test_simple_text_dataset_spec(self, sample_examples):CODE
LOWtests/unit/test_lit.py339 def test_simple_text_dataset_missing_text(self):CODE
LOWtests/unit/test_lit.py347 def test_prompt_completion_dataset(self):CODE
LOWtests/unit/test_lit.py363 def test_prompt_completion_from_pairs(self):CODE
LOWtests/unit/test_lit.py373 def test_ioi_dataset_generate(self):CODE
LOWtests/unit/test_lit.py388 def test_induction_dataset_generate(self):CODE
LOWtests/unit/test_lit.py407 def test_default_config_drives_wrapper_behavior(self, mock_hooked_transformer):CODE
LOWtests/unit/test_lit.py454 def test_model_wrapper_invalid_model(self):CODE
LOWtests/unit/test_lit.py488 def test_model_output_spec_no_embeddings(self, mock_hooked_transformer):CODE
LOWtests/unit/test_lit.py560 def test_full_prediction_flow(self, mock_hooked_transformer):CODE
LOWtests/unit/test_lit.py575 def test_dataset_model_compatibility(self):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py21def _config_with_architecture(architecture: str) -> HookedTransformerConfig:CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py50 def test_object_style_quantization_config(self, mock_auto_config: mock.MagicMock):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py61 def test_unquantized_gpt_oss_finetune_untouched(self, mock_auto_config: mock.MagicMock):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py69 def test_non_gpt_oss_skips_config_fetch(self, mock_auto_config: mock.MagicMock):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py103def test_fill_missing_keys_raises_on_missing_attention_weights():CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py118def test_fill_missing_keys_with_hf_model_keys():CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py133def test_fill_missing_keys_no_missing_keys():CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py143def test_n_ctx_override_reduces_context():CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py156def test_n_ctx_override_larger_than_default_warns(mock_warning: mock.MagicMock):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py196def test_qwen_uses_hf_seq_length_for_n_ctx(mock_from_pretrained: mock.MagicMock):CODE
LOWtests/unit/test_loading_from_pretrained_utilities.py272 def test_apertus_instruct_config(self):CODE
LOWtests/unit/test_patching.py27def test_get_act_patch_attn_head_all_pos_every_shape(model, corrupted_tokens, clean_cache):CODE
LOWtests/unit/test_patching.py38def test_get_act_patch_attn_head_all_pos_every_values_vary(model, corrupted_tokens, clean_cache):CODE
LOWtests/unit/test_deprecation_warnings.py28def _assert_single_deprecation(constructor, class_name: str) -> None:CODE
LOWtests/unit/test_deprecation_warnings.py37def test_importing_transformer_lens_emits_no_deprecation_warning():CODE
LOWtests/unit/test_deprecation_warnings.py60def test_hooked_transformer_constructor_warns_once():CODE
LOWtests/unit/test_deprecation_warnings.py66def test_hooked_encoder_constructor_warns_once():CODE
LOWtests/unit/test_deprecation_warnings.py72def test_hooked_encoder_from_pretrained_warning_reaches_external_caller():CODE
LOWtests/unit/test_deprecation_warnings.py100def test_bert_next_sentence_prediction_constructor_warns_once():CODE
LOWtests/unit/test_deprecation_warnings.py108def test_direct_hooked_root_module_construction_warns_once():CODE
LOWtests/unit/test_optional_submodule.py223 def test_prunes_hook_aliases_for_skipped_ssm(self):CODE
LOWtests/unit/test_optional_submodule.py229 def test_keeps_mlp_alias_fallback_after_skipped_post_norm(self):CODE
LOWtests/unit/test_optional_submodule.py235 def test_pruned_aliases_do_not_warn_on_register(self):CODE
3785 more matches not shown…
Decorative Section Separators707 hits · 2763 pts
SeverityFileLineSnippetContext
MEDIUMtests/unit/test_direct_path_patching.py67# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py69# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py198# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py200# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py269# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py271# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py375# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py377# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py22# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py24# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py142# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/test_direct_path_patching.py144# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_model_registry.py404# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py406# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py490# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py492# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py588# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py590# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py754# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py756# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py18# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py20# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py105# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py107# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py290# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py292# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py552# ============================================================COMMENT
MEDIUMtests/unit/tools/test_model_registry.py554# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py66# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py68# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py97# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py99# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py167# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py169# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py18# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py20# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py40# ============================================================COMMENT
MEDIUMtests/unit/tools/test_relevancy.py42# ============================================================COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens.py1074# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens.py1076# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py98# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py100# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py242# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py244# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py11# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py13# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py57# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/tools/test_jacobian_lens_import.py59# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py109# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py111# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py194# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py196# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py236# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py238# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py298# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_gemma.py300# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_olmo3.py88# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_olmo3.py90# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_olmo3.py152# ============================================================================COMMENT
MEDIUMtests/unit/pretrained_weight_conversions/test_olmo3.py154# ============================================================================COMMENT
647 more matches not shown…
Cross-File Repetition190 hits · 950 pts
SeverityFileLineSnippetContext
HIGH…ge/supported_architectures/test_deepseek_v2_adapter.py0tests that the adapter sets the correct config flags.STRING
HIGH…bridge/supported_architectures/test_granite_adapter.py0tests that the adapter sets the correct config flags.STRING
HIGH…el_bridge/supported_architectures/test_phi3_adapter.py0tests that the adapter sets the correct config flags.STRING
HIGH…ge/supported_architectures/test_deepseek_v3_adapter.py0tests that the adapter sets the correct config flags.STRING
HIGH…ge/supported_architectures/test_deepseek_v2_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…del_bridge/supported_architectures/test_neo_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…el_bridge/supported_architectures/test_gpt2_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…bridge/supported_architectures/test_openelm_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…bridge/supported_architectures/test_granite_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…el_bridge/supported_architectures/test_phi3_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…ge/supported_architectures/test_deepseek_v3_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…el_bridge/supported_architectures/test_neox_adapter.py0tests that component_mapping has the correct bridge types and hf module names.STRING
HIGH…idge/supported_architectures/test_internlm2_adapter.py0guards against drift toward neighbouring adapter patterns.STRING
HIGH…idge/supported_architectures/test_falcon_h1_adapter.py0guards against drift toward neighbouring adapter patterns.STRING
HIGH…dge/supported_architectures/test_nemotron_h_adapter.py0guards against drift toward neighbouring adapter patterns.STRING
HIGH…el_bridge/supported_architectures/test_xglm_adapter.py0guards against drift toward neighbouring adapter patterns.STRING
HIGH…_bridge/supported_architectures/test_cohere_adapter.py0guards against drift toward neighbouring adapter patterns.STRING
HIGH…dge/supported_architectures/test_blenderbot_adapter.py0unit tests for the pegasusarchitectureadapter. download-free: tiny synthetic configs and structural assertions only.STRING
HIGH…l_bridge/supported_architectures/test_mbart_adapter.py0unit tests for the pegasusarchitectureadapter. download-free: tiny synthetic configs and structural assertions only.STRING
HIGH…bridge/supported_architectures/test_pegasus_adapter.py0unit tests for the pegasusarchitectureadapter. download-free: tiny synthetic configs and structural assertions only.STRING
HIGH…_bridge/supported_architectures/test_gemma3_adapter.py0component bridge classes — guards against silent type substitution.STRING
HIGH…ported_architectures/test_gemma3_multimodal_adapter.py0component bridge classes — guards against silent type substitution.STRING
HIGH…l_bridge/supported_architectures/test_llava_adapter.py0component bridge classes — guards against silent type substitution.STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0minimal hf model exposing only model.rotary_emb (no config/layers).STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0minimal hf model exposing only model.rotary_emb (no config/layers).STRING
HIGH…ridge/supported_architectures/test_glm4_moe_adapter.py0minimal hf model exposing only model.rotary_emb (no config/layers).STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0minimal hf model exposing only model.rotary_emb (no config/layers).STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0weight_processing_conversions is optional on the base class; assert it is populated.STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0weight_processing_conversions is optional on the base class; assert it is populated.STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0weight_processing_conversions is optional on the base class; assert it is populated.STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0adapter-owned config defaults that downstream bridge code relies on.STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0adapter-owned config defaults that downstream bridge code relies on.STRING
HIGH…l_bridge/supported_architectures/test_qwen2_adapter.py0adapter-owned config defaults that downstream bridge code relies on.STRING
HIGH…el_bridge/supported_architectures/test_ouro_adapter.py0adapter-owned config defaults that downstream bridge code relies on.STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0adapter-owned config defaults that downstream bridge code relies on.STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0wire a fake attention module into the bridge and verify gqa hook shapes. spec assertions cannot prove the bridge reshapeSTRING
HIGH…ridge/supported_architectures/test_stablelm_adapter.py0wire a fake attention module into the bridge and verify gqa hook shapes. spec assertions cannot prove the bridge reshapeSTRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0wire a fake attention module into the bridge and verify gqa hook shapes. spec assertions cannot prove the bridge reshapeSTRING
HIGH…bridge/supported_architectures/test_gpt_oss_adapter.py0wire a fake attention module into the bridge and verify gqa hook shapes. spec assertions cannot prove the bridge reshapeSTRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0setup_component_testing wires the shared rotary embedding and forces eager attention.STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0setup_component_testing wires the shared rotary embedding and forces eager attention.STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0setup_component_testing wires the shared rotary embedding and forces eager attention.STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0bridge attention only matches hf under eager attention, so it is forced on.STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0bridge attention only matches hf under eager attention, so it is forced on.STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0bridge attention only matches hf under eager attention, so it is forced on.STRING
HIGH…bridge/supported_architectures/test_smollm3_adapter.py0the defensive hasattr branches must not raise when config/layers are absent.STRING
HIGH…ridge/supported_architectures/test_stablelm_adapter.py0the defensive hasattr branches must not raise when config/layers are absent.STRING
HIGH…l_bridge/supported_architectures/test_olmo2_adapter.py0the defensive hasattr branches must not raise when config/layers are absent.STRING
HIGH…bridge/supported_architectures/test_mixtral_adapter.py0the defensive hasattr branches must not raise when config/layers are absent.STRING
HIGH…l_bridge/supported_architectures/test_olmoe_adapter.py0the defensive hasattr branches must not raise when config/layers are absent.STRING
HIGH…el_bridge/supported_architectures/test_bert_adapter.py0component mapping has the correct slots, bridge types, and hf module paths.STRING
HIGH…_bridge/supported_architectures/test_falcon_adapter.py0component mapping has the correct slots, bridge types, and hf module paths.STRING
HIGH…l_bridge/supported_architectures/test_llama_adapter.py0component mapping has the correct slots, bridge types, and hf module paths.STRING
HIGH…bridge/supported_architectures/test_mistral_adapter.py0component mapping has the correct slots, bridge types, and hf module paths.STRING
HIGH…_bridge/supported_architectures/test_hubert_adapter.py0component mapping has the correct slots, bridge types, and hf module paths.STRING
HIGH…el_bridge/supported_architectures/test_gpt2_adapter.py0tests that weight_processing_conversions has exactly the expected keys.STRING
HIGH…bridge/supported_architectures/test_granite_adapter.py0tests that weight_processing_conversions has exactly the expected keys.STRING
HIGH…el_bridge/supported_architectures/test_phi3_adapter.py0tests that weight_processing_conversions has exactly the expected keys.STRING
HIGH…bridge/supported_architectures/test_qwen3_5_adapter.py0top-level bridge classes — guards against silent type substitution.STRING
HIGH…dge/supported_architectures/test_qwen3_next_adapter.py0top-level bridge classes — guards against silent type substitution.STRING
130 more matches not shown…
Unused Imports561 hits · 438 pts
SeverityFileLineSnippetContext
LOWeasy_transformer/__init__.py4CODE
LOWtests/unit/test_lit.py15CODE
LOWtests/unit/test_deprecation_warnings.py3CODE
LOWtests/unit/test_tracr_conversion.py1CODE
LOWtests/unit/model_bridge/test_boot_native.py2CODE
LOWtests/unit/model_bridge/test_component_hooks_fire.py9CODE
LOWtests/unit/model_bridge/test_mistral_attn_in_fork.py9CODE
LOW…sts/unit/model_bridge/test_per_head_hooks_component.py16CODE
LOW…e/test_bridge_vs_hooked_transformer_mlp_in_patching.py6CODE
LOWtests/unit/model_bridge/test_hook_alias_resolution.py8CODE
LOW…s/unit/model_bridge/test_benchmark_gated_hooks_fire.py12CODE
LOW…nit/model_bridge/test_bridge_train_mode_propagation.py9CODE
LOWtests/unit/model_bridge/test_native_features.py10CODE
LOW…sts/unit/model_bridge/test_build_bridge_from_module.py6CODE
LOW…l_bridge/test_bridge_vs_hooked_transformer_patching.py6CODE
LOW…odel_bridge/supported_architectures/_pretrain_mocks.py12CODE
LOW…ridge/supported_architectures/test_pretrain_adapter.py12CODE
LOW…pported_architectures/test_pretrain_model_container.py15CODE
LOW…el_bridge/supported_architectures/test_olmo_adapter.py13CODE
LOW…generalized_components/test_moe_bridge_tuple_output.py10CODE
LOWtests/unit/utilities/test_hf_utils.py3CODE
LOWtests/integration/test_hook_shape_compatibility.py131CODE
LOWtests/integration/test_hooked_encoder_properties.py11CODE
LOWtests/integration/model_bridge/test_pretrain_adapter.py27CODE
LOWtests/integration/model_bridge/test_native_training.py8CODE
LOWtests/integration/model_bridge/test_llada_adapter.py3CODE
LOW…sts/acceptance/model_bridge/_bridge_multigpu_common.py8CODE
LOWtests/acceptance/model_bridge/test_bridge_multigpu.py13CODE
LOW…ptance/model_bridge/test_bridge_multigpu_device_map.py13CODE
LOWscripts/bridge_multi_device_parity.py18CODE
LOWtransformer_lens/HookedEncoderDecoder.py7CODE
LOWtransformer_lens/hook_points.py1CODE
LOWtransformer_lens/loading_from_pretrained.py6CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py1CODE
LOWtransformer_lens/__init__.py13CODE
LOWtransformer_lens/__init__.py14CODE
LOWtransformer_lens/__init__.py15CODE
LOWtransformer_lens/__init__.py16CODE
LOWtransformer_lens/__init__.py17CODE
LOWtransformer_lens/__init__.py18CODE
LOWtransformer_lens/__init__.py19CODE
LOWtransformer_lens/__init__.py19CODE
LOWtransformer_lens/__init__.py20CODE
LOWtransformer_lens/__init__.py21CODE
LOWtransformer_lens/__init__.py22CODE
LOWtransformer_lens/__init__.py23CODE
LOWtransformer_lens/__init__.py24CODE
LOWtransformer_lens/__init__.py25CODE
LOWtransformer_lens/__init__.py34CODE
LOWtransformer_lens/HookedAudioEncoder.py7CODE
LOWtransformer_lens/HookedRootModule.py9CODE
501 more matches not shown…
Cross-Language Confusion56 hits · 268 pts
SeverityFileLineSnippetContext
HIGHtests/integration/model_bridge/test_exaone4_adapter.py114 The 1.2B fixture above is non-hybrid (sliding_window=null, RoPE everywhere)STRING
HIGHdocs/make_docs.py975 if (n === null || n === undefined) return null;CODE
HIGHdocs/make_docs.py975 if (n === null || n === undefined) return null;CODE
HIGHdocs/make_docs.py984 const d = cfg.hidden_size || cfg.n_embd || cfg.d_model;CODE
HIGHdocs/make_docs.py985 const L = cfg.num_hidden_layers || cfg.n_layer || cfg.num_layers;CODE
HIGHdocs/make_docs.py987 const dff = cfg.intermediate_size || cfg.d_ff;CODE
HIGHdocs/make_docs.py988 if (!d || !L) return null;CODE
HIGHdocs/make_docs.py996 if (cfg.rms_norm_eps !== undefined) return 'RMSNorm';CODE
HIGHdocs/make_docs.py997 if (cfg.layer_norm_epsilon !== undefined || cfg.layer_norm_eps !== undefined) return 'LayerNorm';CODE
HIGHdocs/make_docs.py997 if (cfg.layer_norm_epsilon !== undefined || cfg.layer_norm_eps !== undefined) return 'LayerNorm';CODE
HIGHdocs/make_docs.py998 if (cfg.norm_eps !== undefined) return 'LayerNorm';CODE
HIGHdocs/make_docs.py999 return null;CODE
HIGHdocs/make_docs.py1004 if (cfg.rope_theta || cfg.rope_parameters || cfg.rope_scaling ||CODE
HIGHdocs/make_docs.py1005 cfg.rotary_pct || cfg.rotary_dim || cfg.rotary_emb_base) return 'Rotary (RoPE)';CODE
HIGHdocs/make_docs.py1006 if (cfg.partial_rotary_factor !== undefined) return 'Partial Rotary (RoPE)';CODE
HIGHdocs/make_docs.py1008 if (cfg.alibi || cfg.position_embedding_type === 'alibi') return 'ALiBi';CODE
HIGHdocs/make_docs.py1010 if (cfg.relative_attention_num_buckets !== undefined) return 'Relative Bias (T5)';CODE
HIGHdocs/make_docs.py1014 if (cfg.max_position_embeddings || cfg.n_positions) return 'Learned';CODE
HIGHdocs/make_docs.py1015 return null;CODE
HIGHdocs/make_docs.py1020 if (cfg.parallel_attn !== undefined) return cfg.parallel_attn;CODE
HIGHdocs/make_docs.py1025 return null;CODE
HIGHdocs/make_docs.py1040 if (cfg.feed_forward_proj && cfg.feed_forward_proj.includes('gated')) return true;CODE
HIGHdocs/make_docs.py1044 return null;CODE
HIGHdocs/make_docs.py1050 if (t === null || t === undefined) return null;CODE
HIGHdocs/make_docs.py1050 if (t === null || t === undefined) return null;CODE
HIGHdocs/make_docs.py1053 return null;CODE
HIGHdocs/make_docs.py1131 if (def !== null) return def;CODE
HIGHdocs/make_docs.py1133 return null;CODE
HIGHdocs/make_docs.py1140 return est ? fmtParam(est) + ' (est.)' : null;CODE
HIGHdocs/make_docs.py1147 if (cfg[k] !== undefined && cfg[k] !== null) return cfg[k];CODE
HIGHdocs/make_docs.py1147 if (cfg[k] !== undefined && cfg[k] !== null) return cfg[k];CODE
HIGHdocs/make_docs.py1149 return null;CODE
HIGHdocs/make_docs.py1193 if (raw === null || raw === undefined) continue;CODE
HIGHdocs/make_docs.py1193 if (raw === null || raw === undefined) continue;CODE
HIGHdocs/make_docs.py1199 if (raw && typeof raw === 'object') {CODE
HIGHdocs/make_docs.py1376 const aN = (va === null || va === undefined || va === '');CODE
HIGHdocs/make_docs.py1377 const bN = (vb === null || vb === undefined || vb === '');CODE
HIGHdocs/make_docs.py1378 if (aN && bN) return 0;CODE
HIGHdocs/make_docs.py935 let all=[], filt=[], pg=1, dt=null, sortCol='', sortDir='asc';CODE
HIGHdocs/make_docs.py1096 const classDefaults = (cls && TOKENIZER_CLASS_DEFAULTS[cls]) || {};CODE
HIGHdocs/make_docs.py1101 return null;CODE
HIGHdocs/make_docs.py1118 if (tok[k] !== undefined && tok[k] !== null) {CODE
HIGHdocs/make_docs.py1118 if (tok[k] !== undefined && tok[k] !== null) {CODE
HIGHdocs/make_docs.py1180 if (val === null || val === undefined) continue;CODE
HIGHdocs/make_docs.py1180 if (val === null || val === undefined) continue;CODE
HIGHdocs/make_docs.py1236 if (nextRow && nextRow.classList.contains('bt-detail-row')) {CODE
HIGHdocs/make_docs.py1254 const tok = tokResult.ok ? tokResult.tok : null;CODE
HIGHdocs/make_docs.py1295 if (pinned.length && rest.length) {CODE
HIGHdocs/make_docs.py1301 if (cur && pc[cur]) sel.value = cur; else sel.value = '';CODE
HIGHdocs/make_docs.py1341 if (a && m.architecture_id !== a) return false;CODE
HIGHdocs/make_docs.py1342 if (pf && getPrefix(m.model_id) !== pf) return false;CODE
HIGHdocs/make_docs.py1404 const qs = p.toString();CODE
HIGHdocs/make_docs.py1405 history.replaceState(null, '', qs ? '?' + qs : location.pathname);CODE
HIGHdocs/make_docs.py1473 const pages=[1]; if(tp>1) pages.push(tp);CODE
HIGHdocs/make_docs.py1474 for(let i=Math.max(2,pg-1);i<=Math.min(tp-1,pg+1);i++) if(!pages.includes(i)) pages.push(i);CODE
HIGHtransformer_lens/model_bridge/bridge.py3031 # reject the paths whose cache would be wrong/undefined, with a clear pointer to theCOMMENT
Docstring Block Structure47 hits · 235 pts
SeverityFileLineSnippetContext
HIGHdocs/source/content/contributing.md190Title In Title Case. A description of what the function/class does, including as much detail as is necessary to fully uSTRING
HIGHtransformer_lens/evals.py158 Load MMLU (Massive Multitask Language Understanding) dataset. MMLU tests model performance on 57 subjects acroSTRING
HIGHtransformer_lens/evals.py523Evaluate a model on the MMLU benchmark. MMLU (Massive Multitask Language Understanding) is a benchmark for evaluatiSTRING
HIGHtransformer_lens/BertNextSentencePrediction.py149Forward pass through the NextSentencePrediction module. Performs Next Sentence Prediction on a pair of sentences. STRING
HIGHtransformer_lens/HookedEncoder.py159Processes input through the encoder layers and returns the resulting residual stream. Args: input: STRING
HIGHtransformer_lens/HookedEncoder.py240Forward pass through the HookedEncoder. Performs Masked Language Modelling on the given input. Args: STRING
HIGHtransformer_lens/ActivationCache.py358Accumulated Residual Stream. Returns the accumulated residual stream at each layer/sub-layer. This is useful foSTRING
HIGHtransformer_lens/ActivationCache.py823Materialize SSM effective attention for one or all SSM layers, any family. The single discovery surface for effSTRING
HIGHtransformer_lens/ActivationCache.py883Reconstruct the recurrent SSM state ``S`` from this cache. The single discovery surface for recurrent state acrSTRING
HIGHtransformer_lens/weight_processing.py170Safely get a tensor from state_dict, handling optional parameters. This is the recommended way to access parameSTRING
HIGH…former_lens/tools/analysis/direct_logit_attribution.py175Compute Direct Logit Attribution for a prompt. Decomposes the contribution of model components to the logit of STRING
HIGHtransformer_lens/tools/analysis/jacobian_lens.py431Load a lens from a local path, a short model name, or a Hub repo. Resolution order ---------------- STRING
HIGHtransformer_lens/tools/analysis/jacobian_lens.py574Check that ``model`` matches this lens; raise loudly if not. Requires a raw causal ``TransformerBridge`` with tSTRING
HIGHtransformer_lens/tools/analysis/jacobian_lens.py682Read per-layer vocabulary logits for a prompt. Runs the model once with caching, transports the residual streamSTRING
HIGHtransformer_lens/tools/analysis/jacobian_lens.py1029Fit a Jacobian lens on a hooked model. Implements the reference estimator exactly. For each prompt: one forwardSTRING
HIGHtransformer_lens/tools/model_registry/api.py42Load a JSON file from the data directory. Args: filename: Name of the JSON file Returns: ParseSTRING
HIGHtransformer_lens/tools/model_registry/api.py135Get a list of supported models. Args: architecture: Filter by architecture ID (e.g., "GPT2LMHeadModel"). STRING
HIGHtransformer_lens/tools/model_registry/api.py169Get a list of unsupported architectures sorted by model count. Args: min_models: Minimum number of models fSTRING
HIGHtransformer_lens/tools/model_registry/api.py202Check if a model is supported by TransformerLens. Args: model_id: The HuggingFace model ID to check (e.g., STRING
HIGHtransformer_lens/tools/model_registry/api.py224Get the architecture ID for a given model. Args: model_id: The HuggingFace model ID to look up ReturnsSTRING
HIGHtransformer_lens/tools/model_registry/api.py248Get all model IDs for a given architecture. Args: architecture_id: The architecture to get models for (e.g.STRING
HIGHtransformer_lens/tools/model_registry/api.py269Suggest a similar supported model for an unsupported model ID. This function attempts to find a supported model thaSTRING
HIGHtransformer_lens/tools/model_registry/api.py332Get full information about a specific model. Args: model_id: The HuggingFace model ID to look up ReturSTRING
HIGHtransformer_lens/tools/model_registry/api.py431Check if an architecture is supported by TransformerLens. Args: architecture_id: The architecture ID to cheSTRING
HIGHtransformer_lens/tools/model_registry/validate.py562Validate a JSON file against its expected schema. This function reads a JSON file and validates it against one of tSTRING
HIGHtransformer_lens/tools/model_registry/verify_models.py232Estimate parameter count using AutoConfig (lightweight, no model download). Fetches only the config JSON (~KB) and STRING
HIGHtransformer_lens/lit/dataset.py177Load a dataset from a text file. Each line in the file becomes one example. Args: filepathSTRING
HIGHtransformer_lens/lit/dataset.py463Generate random IOI examples. Args: n_examples: Number of examples to generate. seed: RSTRING
HIGHtransformer_lens/lit/dataset.py577Generate simple induction examples. Args: n_examples: Number of examples to generate. sSTRING
HIGHtransformer_lens/lit/utils.py95Get tokens and token IDs from a HookedTransformer model. Args: model: HookedTransformer model with tokenizeSTRING
HIGHtransformer_lens/lit/utils.py344Split examples into batches. Args: examples: List of example dictionaries. batch_size: Size of eachSTRING
HIGHtransformer_lens/model_bridge/architecture_adapter.py317Get a component from a remote model by its path. This method should be overridden by subclasses to provide the STRING
HIGHtransformer_lens/model_bridge/architecture_adapter.py441Get the generalized component (bridge component) for a given TransformerLens path. Args: path: The STRING
HIGHtransformer_lens/model_bridge/architecture_adapter.py514Get a component from the model using the component_mapping. Args: model: The model to extract compoSTRING
HIGHtransformer_lens/model_bridge/architecture_adapter.py571Translate a TransformerLens path to a remote model path. Args: path: The TransformerLens path to trSTRING
HIGHtransformer_lens/model_bridge/bridge.py1189Map a string that makes up a single token to the id for that token. Args: string: The string to conSTRING
HIGHtransformer_lens/model_bridge/bridge.py3784Prepare multimodal inputs using the model's processor. Converts text and images into model-ready tensors (inputSTRING
HIGHtransformer_lens/model_bridge/sources/transformers.py247Determine the architecture name from HuggingFace config. Args: hf_config: The HuggingFace config object STRING
HIGH…l_bridge/generalized_components/joint_qkv_attention.py399Apply attention input hook to the input tensor. This method extracts the input tensor from args/kwargs and applSTRING
HIGH…rmer_lens/model_bridge/generalized_components/block.py179Forward pass through the block bridge. Args: *args: Input arguments **kwargs: Input keySTRING
HIGHtransformer_lens/utilities/exploratory_utils.py23Test if the Model Can Give the Correct Answer to a Prompt. Intended for exploratory analysis. Prints out the perforSTRING
HIGHtransformer_lens/utilities/slice.py120 Returns the indices when this slice is applied to an axis of size max_ctx. Returns them as a numpy array, for iSTRING
HIGHtransformer_lens/components/abstract_attention.py860Create an ALiBi Slope Matrix. Create the slope matrix used in ALiBi, before it is multiplied by the head-specifSTRING
HIGHtransformer_lens/components/abstract_attention.py902Create the ALiBi Scalar Multipliers for each Head. For n heads, the set of multipliers (m) is the geometric seqSTRING
HIGHtransformer_lens/components/abstract_attention.py941Create the ALiBi Bias for all Heads. Calculate the ALiBi bias (https://arxiv.org/pdf/2108.12409.pdf) for all heSTRING
HIGH…sformer_lens/factories/architecture_adapter_factory.py407Select the appropriate architecture adapter for the given config. Args: cfg: The TransformerBridgeCSTRING
HIGH…nsformer_lens/factories/activation_function_factory.py17Use this to select what activation function is needed based on configuration. Args: cfg (HookedTranSTRING
Excessive Try-Catch Wrapping171 hits · 145 pts
SeverityFileLineSnippetContext
LOWtests/unit/model_bridge/test_component_hooks_fire.py47 except Exception:CODE
LOWtests/unit/model_bridge/test_hook_alias_resolution.py101 except Exception as exc:CODE
LOWtests/integration/model_bridge/test_ssm_real_weights.py64 except Exception as e: # availability gate: network / missing arch / OOM / gated repoCODE
LOW…ts/integration/model_bridge/test_bridge_integration.py349 except Exception as e:CODE
LOW…ts/integration/model_bridge/test_bridge_integration.py747 except Exception:CODE
LOW…ce/model_bridge/compatibility/test_activation_cache.py118 except Exception as e:CODE
LOW…ce/model_bridge/compatibility/test_activation_cache.py168 except Exception as e:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py38 except Exception as e:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py100 except Exception:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py143 except Exception as e:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py202 except Exception:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py267 except Exception as e:CODE
LOW…mpatibility/test_legacy_hooked_transformer_coverage.py308 except Exception as e:CODE
LOWtests/benchmarks/test_boot_memory.py37 except Exception:CODE
LOWdocs/make_docs.py48except Exception as e:CODE
LOWdocs/make_docs.py191 except Exception as e:CODE
LOWdocs/make_docs.py206 except Exception:CODE
LOWdocs/make_docs.py355 except Exception as e:CODE
LOWdocs/make_docs.py367 except Exception as e:CODE
LOWdocs/make_docs.py378 except Exception as e:CODE
LOWdocs/make_docs.py396 except Exception as e:CODE
LOWdocs/make_docs.py450 except Exception as e:CODE
LOWdocs/make_docs.py527 except Exception as e:CODE
LOWscripts/bridge_multi_device_parity.py112 except Exception as exc: # gated repo, OOM, unsupported arch -> SKIP with reasonCODE
LOWtransformer_lens/evals.py235 except Exception as e:CODE
LOWtransformer_lens/tools/model_registry/registry_io.py178 except Exception:CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py205 except Exception as exc: # pragma: no cover — network/transientCODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py228 except Exception as exc: # pragma: no cover — network/transientCODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py483 except Exception as exc:CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py520 except Exception as e:CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py544 except Exception as exc:CODE
LOW…er_lens/tools/model_registry/discover_architectures.py76 except Exception:CODE
LOWtransformer_lens/tools/model_registry/verify_models.py942 except Exception as e:CODE
LOWtransformer_lens/tools/model_registry/verify_models.py461 except Exception:CODE
LOWtransformer_lens/tools/model_registry/verify_models.py873 except Exception as e:CODE
LOWtransformer_lens/tools/model_registry/verify_models.py995 except Exception as e:CODE
LOWtransformer_lens/tools/model_registry/verify_models.py1317 except Exception as e:CODE
LOWtransformer_lens/lit/model.py625 except Exception:CODE
LOWtransformer_lens/model_bridge/architecture_adapter.py759 except Exception:CODE
LOWtransformer_lens/model_bridge/architecture_adapter.py812 except Exception:CODE
LOWtransformer_lens/model_bridge/compat.py34 except Exception:CODE
LOWtransformer_lens/model_bridge/bridge.py488 except Exception:CODE
LOWtransformer_lens/model_bridge/bridge.py2217 except Exception:CODE
LOWtransformer_lens/model_bridge/bridge.py2310 except Exception as e:CODE
LOWtransformer_lens/model_bridge/bridge.py3740 except Exception:CODE
LOWtransformer_lens/model_bridge/bridge.py4118 except Exception:CODE
LOWtransformer_lens/model_bridge/bridge.py4143 except Exception:CODE
LOWtransformer_lens/model_bridge/buffer_restore.py66 except Exception:CODE
LOW…r_lens/model_bridge/supported_architectures/openelm.py117 except Exception:CODE
LOW…mer_lens/model_bridge/supported_architectures/raven.py272 except Exception:CODE
LOW…rmer_lens/model_bridge/supported_architectures/ouro.py181 except Exception:CODE
LOW…rmer_lens/model_bridge/supported_architectures/gidd.py151 except Exception:CODE
LOW…mer_lens/model_bridge/supported_architectures/bd3lm.py148 except Exception:CODE
LOW…lens/model_bridge/supported_architectures/internlm2.py240 except Exception:CODE
LOW…mer_lens/model_bridge/supported_architectures/rwkv7.py190 except Exception:CODE
LOW…mer_lens/model_bridge/supported_architectures/rwkv7.py200 except Exception:CODE
LOW…mer_lens/model_bridge/supported_architectures/dream.py144 except Exception:CODE
LOW…_lens/model_bridge/supported_architectures/baichuan.py297 except Exception as exc:CODE
LOW…_lens/model_bridge/supported_architectures/baichuan.py310 except Exception:CODE
LOWtransformer_lens/model_bridge/sources/transformers.py906 except Exception:CODE
111 more matches not shown…
Self-Referential Comments46 hits · 140 pts
SeverityFileLineSnippetContext
MEDIUMtests/unit/test_hook_points.py128 # Create a test hook conversionCOMMENT
MEDIUMtests/unit/test_hook_points.py136 # Create a simple test module that uses HookPointCOMMENT
MEDIUMtests/unit/test_hook_points.py177 # Create a test hook conversionCOMMENT
MEDIUMtests/unit/test_hook_points.py366 # Create a complex setup with multiple hooksCOMMENT
MEDIUMtests/unit/test_weight_processing.py749 # Create a state dict with known values for deterministic testingCOMMENT
MEDIUMtests/unit/model_bridge/test_gpt_oss_moe.py144 # Create a small GPT-OSS config with random weightsCOMMENT
MEDIUMtests/unit/model_bridge/test_component_setup.py65 # Create a component with submodulesCOMMENT
MEDIUMtests/unit/model_bridge/test_component_setup.py94 # Create a component with nested submodulesCOMMENT
MEDIUMtests/unit/model_bridge/test_component_setup.py267 # Create a simpler adapter without outer_blocks for this testCOMMENT
MEDIUMtests/unit/model_bridge/test_get_params_util.py16 # Create a mock bridge with basic componentsCOMMENT
MEDIUMtests/unit/model_bridge/test_get_params_util.py49 # Create a mock bridge with missing componentsCOMMENT
MEDIUMtests/unit/model_bridge/test_end_to_end_bridge.py21 # Create a mock model with different naming conventionsCOMMENT
MEDIUMtests/unit/model_bridge/test_end_to_end_bridge.py44 # Create the bridgeCOMMENT
MEDIUM…l_bridge/supported_architectures/test_bd3lm_adapter.py179 # Create a mock model matching the real BD3LM structureCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py99 # Create a mock linear layer for testingCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py118 # Create a mock attention layer for testing, doesn't do anything because we're only interested in the QKV componCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py140 # Create a hook that returns the inputCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py183 # Create a mock linear layer for testingCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py202 # Create a mock attention layer for testing, doesn't do anything because we're only interested in the QKV componCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py225 # Create a hook that returns the inputCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py270 # Create a mock linear layer for testingCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py289 # Create a mock attention layer for testing, doesn't do anything because we're only interested in the QKV componCOMMENT
MEDIUM…dge/generalized_components/test_joint_qkv_attention.py312 # Create a hook that returns the inputCOMMENT
MEDIUMtests/unit/utilities/test_aliases.py203 # Create a mock module structureCOMMENT
MEDIUMtests/unit/utilities/test_aliases.py241 # Create a mock module structure that mimics real bridge componentsCOMMENT
MEDIUMtests/unit/utilities/test_aliases.py320 # Create a class that will actually raise AttributeErrorCOMMENT
MEDIUMtests/unit/utilities/test_cache.py28 # Create a real cache entry with 0 positionsCOMMENT
MEDIUMtests/unit/utilities/test_cache.py43 # Create a real cache entry with 1 positionCOMMENT
MEDIUMtests/unit/utilities/test_cache.py58 # Create a real cache entry with multiple positionsCOMMENT
MEDIUMtests/unit/utilities/test_cache.py73 # Create a real cache entry with many positionsCOMMENT
MEDIUMtests/integration/test_only_tokenizer.py83 # Create the HookedTransformer objectCOMMENT
MEDIUM…ts/integration/model_bridge/test_bridge_integration.py202 # Create a custom QKV conversion ruleCOMMENT
MEDIUM…ts/integration/model_bridge/test_bridge_integration.py654 # Create a simple backward hook that tracks if it was calledCOMMENT
MEDIUM…mpatibility/test_legacy_hooked_transformer_coverage.py289 # Create a longer prompt (but not too long to avoid timeouts)COMMENT
MEDIUMtransformer_lens/hook_points.py218 # Create a simple wrapper that acts like a HookPoint but with a different nameCOMMENT
MEDIUMtransformer_lens/hook_points.py221 # Create a view of this HookPoint with the alias nameCOMMENT
MEDIUMtransformer_lens/patching.py197 # Create an empty tensor to show the patched metric for each patchCOMMENT
MEDIUMtransformer_lens/HookedTransformer.py1453 # Create the HookedTransformer objectCOMMENT
MEDIUMtransformer_lens/lit/__init__.py15 >>> # Create a datasetSTRING
MEDIUMtransformer_lens/lit/dataset.py10 >>> # Create a dataset from examplesSTRING
MEDIUMtransformer_lens/lit/dataset.py559 # Create the full text: pattern + separator + repeated startCOMMENT
MEDIUM…ormer_lens/model_bridge/generalized_components/base.py270 # Create a new parameter from the weight tensorCOMMENT
MEDIUMtransformer_lens/components/abstract_attention.py732 # Create a n_ctx x rotary_dim tensor, where each column is an arithmetic sequence of angles in that frequencyCOMMENT
MEDIUMtransformer_lens/components/abstract_attention.py971 # Create the slope matrixCOMMENT
MEDIUMtransformer_lens/components/abstract_attention.py976 # Create the scalar multiplier for each head.COMMENT
MEDIUMtransformer_lens/benchmarks/encoder_common.py249 # Create a slightly perturbed versionCOMMENT
Deep Nesting161 hits · 126 pts
SeverityFileLineSnippetContext
LOWtests/unit/tools/test_jacobian_lens.py166CODE
LOWtests/unit/model_bridge/test_component_hooks_fire.py123CODE
LOWtests/unit/model_bridge/test_hook_alias_resolution.py96CODE
LOW…tils/conversion_steps/test_repeat_tensor_conversion.py35CODE
LOWtests/integration/test_hook_shape_compatibility.py124CODE
LOW…tegration/model_bridge/test_optimizer_compatibility.py118CODE
LOW…n/model_bridge/test_weight_processing_perfect_match.py14CODE
LOWtests/acceptance/test_hooked_transformer.py636CODE
LOW…ce/model_bridge/compatibility/test_activation_cache.py61CODE
LOWtests/benchmarks/test_boot_memory.py16CODE
LOWdocs/make_docs.py240CODE
LOWdocs/make_docs.py401CODE
LOWdocs/make_docs.py505CODE
LOWdocs/make_docs.py571CODE
LOWscripts/bridge_multi_device_parity.py53CODE
LOWtransformer_lens/loading_from_pretrained.py128CODE
LOWtransformer_lens/loading_from_pretrained.py1832CODE
LOWtransformer_lens/loading_from_pretrained.py1892CODE
LOWtransformer_lens/HookedRootModule.py445CODE
LOWtransformer_lens/HookedTransformer.py145CODE
LOWtransformer_lens/HookedTransformer.py331CODE
LOWtransformer_lens/HookedTransformer.py538CODE
LOWtransformer_lens/HookedTransformer.py901CODE
LOWtransformer_lens/HookedTransformer.py1064CODE
LOWtransformer_lens/HookedTransformer.py1508CODE
LOWtransformer_lens/HookedTransformer.py1557CODE
LOWtransformer_lens/HookedTransformer.py1575CODE
LOWtransformer_lens/HookedTransformer.py1597CODE
LOWtransformer_lens/HookedTransformer.py1624CODE
LOWtransformer_lens/HookedTransformer.py1889CODE
LOWtransformer_lens/HookedTransformer.py2277CODE
LOWtransformer_lens/ActivationCache.py186CODE
LOWtransformer_lens/ActivationCache.py1180CODE
LOWtransformer_lens/ActivationCache.py1401CODE
LOWtransformer_lens/weight_processing.py108CODE
LOWtransformer_lens/weight_processing.py319CODE
LOWtransformer_lens/weight_processing.py422CODE
LOWtransformer_lens/weight_processing.py566CODE
LOWtransformer_lens/weight_processing.py1016CODE
LOWtransformer_lens/weight_processing.py1116CODE
LOWtransformer_lens/weight_processing.py1391CODE
LOWtransformer_lens/weight_processing.py1564CODE
LOWtransformer_lens/weight_processing.py1869CODE
LOWtransformer_lens/weight_processing.py2003CODE
LOWtransformer_lens/weight_processing.py2087CODE
LOWtransformer_lens/tools/model_registry/registry_io.py182CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py63CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py109CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py180CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py236CODE
LOWtransformer_lens/tools/model_registry/validate.py207CODE
LOWtransformer_lens/tools/model_registry/validate.py561CODE
LOW…ansformer_lens/tools/model_registry/generate_report.py187CODE
LOW…ansformer_lens/tools/model_registry/generate_report.py212CODE
LOW…er_lens/tools/model_registry/discover_architectures.py31CODE
LOWtransformer_lens/tools/model_registry/verify_models.py384CODE
LOWtransformer_lens/tools/model_registry/verify_models.py442CODE
LOWtransformer_lens/tools/model_registry/verify_models.py474CODE
LOWtransformer_lens/tools/model_registry/verify_models.py823CODE
LOWtransformer_lens/tools/model_registry/verify_models.py1278CODE
101 more matches not shown…
Modern Structural Boilerplate72 hits · 69 pts
SeverityFileLineSnippetContext
LOW…bridge/supported_architectures/test_smollm3_adapter.py131 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…ridge/supported_architectures/test_stablelm_adapter.py144 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…el_bridge/supported_architectures/test_lfm2_adapter.py115 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…del_bridge/supported_architectures/test_phi_adapter.py78 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…l_bridge/supported_architectures/test_olmo2_adapter.py113 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…bridge/supported_architectures/test_mixtral_adapter.py126 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…bridge/supported_architectures/test_apertus_adapter.py273 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…pported_architectures/test_hunyuan_v1_dense_adapter.py102 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…bridge/supported_architectures/test_gpt_oss_adapter.py113 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…l_bridge/supported_architectures/test_llama_adapter.py207 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…l_bridge/supported_architectures/test_qwen2_adapter.py97 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…el_bridge/supported_architectures/test_ouro_adapter.py77 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…ridge/supported_architectures/test_glm4_moe_adapter.py64 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…el_bridge/supported_architectures/test_neox_adapter.py75 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOW…l_bridge/supported_architectures/test_olmoe_adapter.py129 def set_rotary_emb(self, rotary_emb: object) -> None:CODE
LOWtransformer_lens/__init__.py43__all__ = [CODE
LOWtransformer_lens/utils.py18__all__ = [CODE
LOWtransformer_lens/tools/__init__.py13__all__ = ["analysis", "model_registry"]CODE
LOWtransformer_lens/tools/analysis/__init__.py30__all__ = [CODE
LOWtransformer_lens/tools/model_registry/registry_io.py16logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/tools/model_registry/hf_scraper.py43logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/tools/model_registry/__init__.py351__all__ = [CODE
LOWtransformer_lens/tools/model_registry/api.py31logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/tools/model_registry/validate.py15logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/tools/model_registry/verify_models.py60logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/lit/__init__.py63__all__ = [CODE
LOWtransformer_lens/lit/__init__.py84logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/lit/model.py73logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/lit/dataset.py58logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/lit/utils.py19logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/config/__init__.py7__all__ = ["HookedTransformerConfig", "TransformerBridgeConfig", "TransformerLensConfig"]CODE
LOWtransformer_lens/model_bridge/architecture_adapter.py204 def _set_rms_rotary_defaults(self, *, final_rms: bool = True) -> None:CODE
LOWtransformer_lens/model_bridge/bridge.py423 def _set_processed_weight_attributes(self) -> None:CODE
LOWtransformer_lens/model_bridge/bridge.py853 def set_compatibility_mode(component: Any) -> None:CODE
LOWtransformer_lens/model_bridge/bridge.py880 def _setup_hook_compatibility(self) -> None:CODE
LOWtransformer_lens/model_bridge/bridge.py4105 def set_use_hook_mlp_in(self, use_hook_mlp_in: bool) -> None:CODE
LOWtransformer_lens/model_bridge/__init__.py37__all__ = [CODE
LOWtransformer_lens/model_bridge/component_setup.py8logger = logging.getLogger(__name__)CODE
LOWtransformer_lens/model_bridge/get_params_util.py7logger = logging.getLogger(__name__)CODE
LOW…_lens/model_bridge/supported_architectures/pretrain.py97 def set_original_component(self, component: torch.nn.Module) -> None:CODE
LOW…r_lens/model_bridge/supported_architectures/apertus.py20logger = logging.getLogger(__name__)CODE
LOW…mer_lens/model_bridge/supported_architectures/llada.py45 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…mer_lens/model_bridge/supported_architectures/llada.py225 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…_lens/model_bridge/supported_architectures/__init__.py271__all__ = [CODE
LOW…mer_lens/model_bridge/supported_architectures/qwen3.py48 def _setup_qwen3_config(self, cfg: Any) -> None:CODE
LOW…r_lens/model_bridge/supported_architectures/granite.py51 def _setup_common_config(self, cfg: Any) -> None:CODE
LOWtransformer_lens/model_bridge/sources/__init__.py17__all__ = [CODE
LOW…ansformer_lens/model_bridge/sources/native/__init__.py10__all__ = [CODE
LOW…eneralized_components/position_embeddings_attention.py63def _setup_eager_attention_hook_wrapper() -> None:CODE
LOW…eneralized_components/position_embeddings_attention.py183 def set_original_component(self, component: torch.nn.Module) -> None:CODE
LOW…_lens/model_bridge/generalized_components/attention.py12logger = logging.getLogger(__name__)CODE
LOW…_lens/model_bridge/generalized_components/attention.py144 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…_lens/model_bridge/generalized_components/attention.py265 def _setup_qkv_hook_reshaping(self) -> None:CODE
LOW…l_bridge/generalized_components/clip_vision_encoder.py177 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…bridge/generalized_components/t5gemma_decoder_block.py49 def set_original_component(self, component: torch.nn.Module) -> None:CODE
LOW…neralized_components/position_embedding_hooks_mixin.py22 def set_rotary_emb(self, rotary_emb: Any) -> None:CODE
LOW…ridge/generalized_components/t5gemma2_decoder_block.py54 def set_original_component(self, component: torch.nn.Module) -> None:CODE
LOW…del_bridge/generalized_components/joint_gate_up_mlp.py107 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…l_bridge/generalized_components/joint_qkv_attention.py274 def set_original_component(self, original_component: torch.nn.Module) -> None:CODE
LOW…r_lens/model_bridge/generalized_components/__init__.py147__all__ = [CODE
12 more matches not shown…
Redundant / Tautological Comments37 hits · 55 pts
SeverityFileLineSnippetContext
LOWtests/unit/model_bridge/test_optimizer_compatibility.py183 # Check if parameter changedCOMMENT
LOWtests/unit/components/test_attention.py476 # Check if new implementation without einsum produces correct shapeCOMMENT
LOWtests/unit/components/test_abstract_attention.py29 # Check if upper triangle is all zerosCOMMENT
LOWtests/unit/components/test_abstract_attention.py37 # Check if the lower triangle is decreasing by a constant slope (towards the bottom left corner).COMMENT
LOWtests/integration/test_fold_layer_integration.py66 # Check if LayerNorm parameters exist (they shouldn't for processed models)COMMENT
LOWtests/integration/test_fold_layer_integration.py195 # Check if LayerNorm parameters exist (they shouldn't for processed models)COMMENT
LOWtransformer_lens/hook_points.py308 # Check if this hook matches our criteriaCOMMENT
LOWtransformer_lens/evals.py627 # Check if correctCOMMENT
LOWtransformer_lens/weight_processing.py344 # Check if standard keys exist, otherwise update to use underscore-prefixed versionsCOMMENT
LOWtransformer_lens/weight_processing.py533 # Check if a separate ln2 exists for this layerCOMMENT
LOWtransformer_lens/weight_processing.py1906 # Check if we have a conversion for this parameter.COMMENT
LOWtransformer_lens/weight_processing.py2041 # Check if we have a conversion for this parameter.COMMENT
LOWtransformer_lens/lit/__init__.py60# Check if LIT is availableCOMMENT
LOWtransformer_lens/model_bridge/bridge.py969 # Check if they point to the same tensor (weight tying)COMMENT
LOWtransformer_lens/model_bridge/bridge.py3735 # Check if output is a ModelOutputCOMMENT
LOWtransformer_lens/model_bridge/bridge.py4266 # Check if this part is a registered submoduleCOMMENT
LOWtransformer_lens/model_bridge/bridge.py4278 # Check if next is weight/biasCOMMENT
LOWtransformer_lens/model_bridge/bridge.py4379 # Check if this is a valid bridge path (not a nested HF component)COMMENT
LOW…r_lens/model_bridge/supported_architectures/apertus.py115 # Check if upstream already defers scalar computation (fix landed)COMMENT
LOW…odel_bridge/supported_architectures/llava_onevision.py32 # Check if text config expects tied weights but top-level config doesn'tCOMMENT
LOW…mer_lens/model_bridge/supported_architectures/bd3lm.py197 # Check if VAR_KEYWORD (like **kwargs) is acceptedCOMMENT
LOW…rmer_lens/model_bridge/generalized_components/block.py324 # Check if the signature accepts **kwargs (VAR_KEYWORD)COMMENT
LOW…conversion_utils/helpers/merge_quantiziation_fields.py22 # Check if existing field is None and raise error as expected by testsCOMMENT
LOW…conversion_utils/helpers/merge_quantiziation_fields.py37 # Check if the second element is a TensorConversionSet-like objectCOMMENT
LOWtransformer_lens/utilities/aliases.py47 # Check if the final attribute existsCOMMENT
LOWtransformer_lens/utilities/aliases.py55 # Check if the target attribute exists before getting itCOMMENT
LOWtransformer_lens/benchmarks/main_benchmark.py245 # Check if we have a same-architecture referenceCOMMENT
LOWtransformer_lens/benchmarks/backward_gradients.py159 # Check if mismatches are acceptable patternsCOMMENT
LOW…nsformer_lens/benchmarks/granular_weight_processing.py216 # Check if HookedTransformer supports this model using a lightweight config-onlyCOMMENT
LOWtransformer_lens/benchmarks/component_outputs.py829 # Check if shared_inputs contains positional argsCOMMENT
LOWtransformer_lens/benchmarks/component_outputs.py1007 # Check if within toleranceCOMMENT
LOWtransformer_lens/benchmarks/component_outputs.py1053 # Set models to eval mode (disable dropout, etc.)COMMENT
LOWtransformer_lens/benchmarks/weight_processing.py167 # Check if models have GQA (different head counts for K/V vs Q)COMMENT
LOWtransformer_lens/benchmarks/weight_processing.py679 # Check if W_out exists and is accessible (HT format or bridge format)COMMENT
LOWtransformer_lens/benchmarks/weight_processing.py839 # Check if b_V existsCOMMENT
LOWtransformer_lens/benchmarks/weight_processing.py858 # Check if b_V is approximately zeroCOMMENT
LOWtransformer_lens/pretrained/weight_conversions/gemma.py13 # Check if this is a multimodal model (Gemma3ForConditionalGeneration)COMMENT
AI Structural Patterns50 hits · 41 pts
SeverityFileLineSnippetContext
LOW…odel_bridge/supported_architectures/_pretrain_mocks.py108CODE
LOW…l_bridge/supported_architectures/test_raven_adapter.py34CODE
LOW…idge/supported_architectures/test_falcon_h1_adapter.py35CODE
LOW…el_bridge/supported_architectures/test_lfm2_adapter.py41CODE
LOW…del_bridge/supported_architectures/test_opt_adapter.py33CODE
LOW…dge/supported_architectures/test_nemotron_h_adapter.py31CODE
LOW…_bridge/supported_architectures/test_falcon_adapter.py40CODE
LOW…bridge/supported_architectures/test_cohere2_adapter.py41CODE
LOW…_bridge/supported_architectures/test_cohere_adapter.py23CODE
LOW…_bridge/supported_architectures/test_mamba2_adapter.py32CODE
LOW…l_bridge/supported_architectures/test_bd3lm_adapter.py30CODE
LOW…l_bridge/supported_architectures/test_jamba_adapter.py27CODE
LOWtests/integration/test_only_tokenizer.py47CODE
LOWtransformer_lens/HookedEncoderDecoder.py303CODE
LOWtransformer_lens/loading_from_pretrained.py1636CODE
LOWtransformer_lens/HookedTransformer.py471CODE
LOWtransformer_lens/HookedTransformer.py488CODE
LOWtransformer_lens/HookedTransformer.py505CODE
LOWtransformer_lens/HookedTransformer.py522CODE
LOWtransformer_lens/HookedTransformer.py538CODE
LOWtransformer_lens/HookedTransformer.py1158CODE
LOWtransformer_lens/HookedTransformer.py1477CODE
LOWtransformer_lens/HookedTransformer.py1889CODE
LOWtransformer_lens/HookedTransformer.py2277CODE
LOWtransformer_lens/tools/model_registry/api.py427CODE
LOWtransformer_lens/tools/model_registry/verify_models.py823CODE
LOWtransformer_lens/config/transformer_bridge_config.py21CODE
LOWtransformer_lens/model_bridge/bridge.py218CODE
LOWtransformer_lens/model_bridge/bridge.py1735CODE
LOWtransformer_lens/model_bridge/bridge.py2351CODE
LOWtransformer_lens/model_bridge/bridge.py2820CODE
LOWtransformer_lens/model_bridge/bridge.py3374CODE
LOWtransformer_lens/model_bridge/bridge.py3603CODE
LOWtransformer_lens/model_bridge/sources/transformers.py473CODE
LOW…_lens/model_bridge/generalized_components/attention.py57CODE
LOW…model_bridge/generalized_components/bloom_attention.py129CODE
LOW…odel_bridge/generalized_components/depthwise_conv1d.py35CODE
LOW…_lens/model_bridge/generalized_components/bloom_mlp.py75CODE
LOW…_lens/model_bridge/generalized_components/embedding.py94CODE
LOW…_lens/model_bridge/generalized_components/gated_mlp.py141CODE
LOW…mer_lens/model_bridge/generalized_components/linear.py39CODE
LOW…l_bridge/generalized_components/joint_qkv_attention.py315CODE
LOW…_lens/model_bridge/generalized_components/pos_embed.py94CODE
LOW…mer_lens/model_bridge/generalized_components/conv1d.py39CODE
LOW…ens/model_bridge/generalized_components/unembedding.py104CODE
LOW…del_bridge/generalized_components/codegen_attention.py267CODE
LOW…r_lens/model_bridge/generalized_components/t5_block.py187CODE
LOW…r_lens/model_bridge/generalized_components/t5_block.py71CODE
LOW…s/model_bridge/generalized_components/normalization.py105CODE
LOWtransformer_lens/benchmarks/main_benchmark.py575CODE
AI Slop Vocabulary19 hits · 36 pts
SeverityFileLineSnippetContext
MEDIUM…ation/model_bridge/test_bridge_vs_hooked_comparison.py1"""Test comprehensive comparison between Bridge and HookedTransformer."""STRING
MEDIUMtests/benchmarks/test_benchmarks.py19 """Test suite that runs comprehensive benchmarks for each model."""STRING
LOWtransformer_lens/hook_points.py283 # we could just pass this as an argument in PyTorch 2.0, but for now we manually do this...COMMENT
LOWtransformer_lens/FactoredMatrix.py127 # It's a vector, so we collapse the factorisation and just return a vectorCOMMENT
LOWtransformer_lens/FactoredMatrix.py174 # It's a vector, so we collapse the factorisation and just return a vectorCOMMENT
LOWtransformer_lens/weight_processing.py1925 # Legacy string mapping - just return the tensor as-isCOMMENT
LOWtransformer_lens/weight_processing.py2056 # Legacy string mapping - just return the tensor as-isCOMMENT
MEDIUMtransformer_lens/model_bridge/architecture_adapter.py81 # component harness's synthesized probes — e.g. fused top-k routers whoseCOMMENT
MEDIUM…rmer_lens/model_bridge/supported_architectures/rwkv.py110 # MLPBridge so the component harness sizes inputs by theCOMMENT
MEDIUM…ns/model_bridge/supported_architectures/deepseek_v4.py165 # The isolated component harness assumes a three-dimensional residual. V4'sCOMMENT
MEDIUM…er_lens/model_bridge/supported_architectures/jetmoe.py46 # the harness's isolated probes; routers stay hookable at runtime.COMMENT
LOW…_lens/model_bridge/generalized_components/bloom_mlp.py68 # The original BLOOM block passes it, so we just pass everything throughCOMMENT
LOW…odel_bridge/generalized_components/rotary_embedding.py140 # For unexpected tuple lengths, just pass throughCOMMENT
LOWtransformer_lens/utilities/components_utils.py51 # If this was called on a full name, just return itCOMMENT
MEDIUMtransformer_lens/benchmarks/main_benchmark.py591 """Run comprehensive benchmark suite for TransformerBridge.STRING
MEDIUMtransformer_lens/benchmarks/component_benchmark.py65 # Run comprehensive benchmarkCOMMENT
MEDIUMtransformer_lens/benchmarks/generation.py194 """Benchmark multiple generation calls to ensure KV cache handling is robust.STRING
MEDIUMtransformer_lens/benchmarks/text_quality.py31# Diverse prompts used alongside the caller-provided test_text to get a robustCOMMENT
LOWtransformer_lens/benchmarks/component_outputs.py887 # Some pos embeds just return their embeddings directlyCOMMENT
Verbosity Indicators9 hits · 19 pts
SeverityFileLineSnippetContext
LOWtests/integration/test_cross_entropy_loss.py11 # Step 1: Get the default loss on a promptCOMMENT
LOWtests/integration/test_cross_entropy_loss.py21 # Step 2: Get the loss when we add some extra tokens to the input and set their attention maskCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py216 # Step 1: Fold biasesCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py221 # Step 2: Fold weightsCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py226 # Step 3: Center weightsCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py936 # Step 1: Estimate parametersCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py946 # Step 2: Check memoryCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py901 # Step 0: Skip formats with no HF loader path (GGUF / MLX / FP4 / FP8).COMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py961 # Step 3: Run benchmarks (all phases in a single call to share models)COMMENT
Structural Annotation Overuse9 hits · 19 pts
SeverityFileLineSnippetContext
LOWtests/integration/test_cross_entropy_loss.py11 # Step 1: Get the default loss on a promptCOMMENT
LOWtests/integration/test_cross_entropy_loss.py21 # Step 2: Get the loss when we add some extra tokens to the input and set their attention maskCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py216 # Step 1: Fold biasesCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py221 # Step 2: Fold weightsCOMMENT
LOWtests/integration/test_tensor_extraction_consistency.py226 # Step 3: Center weightsCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py936 # Step 1: Estimate parametersCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py946 # Step 2: Check memoryCOMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py901 # Step 0: Skip formats with no HF loader path (GGUF / MLX / FP4 / FP8).COMMENT
LOWtransformer_lens/tools/model_registry/verify_models.py961 # Step 3: Run benchmarks (all phases in a single call to share models)COMMENT
Fake / Example Data7 hits · 9 pts
SeverityFileLineSnippetContext
LOW…sts/unit/factories/test_activation_function_factory.py18 dummy_data = torch.zeros((1, 4, 32))CODE
LOW…sts/unit/factories/test_activation_function_factory.py19 result = function(dummy_data)CODE
LOWtests/integration/test_cache_pos_slice.py11prompt = "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor."CODE
LOWtests/integration/test_cache_pos_slice.py11prompt = "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor."CODE
LOWtests/integration/test_cross_entropy_loss.py23 extra_prompt = ["Lorem ipsum dolor sit amet, consectetur adipiscing elit."]CODE
LOWtests/integration/test_cross_entropy_loss.py23 extra_prompt = ["Lorem ipsum dolor sit amet, consectetur adipiscing elit."]CODE
LOWtests/acceptance/test_evals.py58 names=["John Smith", "John Doe"],CODE
Over-Commented Block9 hits · 8 pts
SeverityFileLineSnippetContext
LOWdocs/make_docs.py821#bt-root tbody td a:hover { text-decoration: underline; }COMMENT
LOWdocs/make_docs.py881 background: var(--color-background-primary, #fff); color: var(--color-foreground-primary, #333);COMMENT
LOWdocs/source/_static/adapter-template.py81 }COMMENT
LOWtransformer_lens/model_bridge/architecture_adapter.py41 """COMMENT
LOW…mer_lens/model_bridge/supported_architectures/bd3lm.py81 # of the SSM-specific hook_mixer_in alias that SSMBlockBridge wouldCOMMENT
LOW…er_lens/model_bridge/supported_architectures/gemma3.py41 # Gemma models use (1.0 + weight) in RMSNorm instead of just weightCOMMENT
LOW…er_lens/model_bridge/supported_architectures/cohere.py81COMMENT
LOWtransformer_lens/model_bridge/sources/transformers.py761 f"weight mismatch."COMMENT
LOWtransformer_lens/benchmarks/main_benchmark.py1421 if ht_model_unprocessed is not None:COMMENT
Synthetic Comment Markers1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHdocs/source/content/news/release-3.0.md18Additionally, I am working on an automated Claude tool for TransformerBridge architecture adapters. It will allow contriCODE
AI Response Leakage1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHtransformer_lens/HookedRootModule.py163 ) # TODO does adding assert meaningfully slow down performance? I've added them for type checking purposes.CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMtransformer_lens/head_detector.py270CODE
Modern AI Meta-Vocabulary1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMdocs/make_docs.py167 # input shape for activations -- "847"~="bat", subtract 7 for the context window to make it uniqueCOMMENT
Slop Phrases1 hit · 2 pts
SeverityFileLineSnippetContext
LOWtransformer_lens/components/mlps/moe.py103 # the current expert. We need to make sure to multiply the output hiddenCOMMENT