🚀 Efficient implementations for emerging model architectures
This report presents the forensic synthetic code analysis of fla-org/flash-linear-attention, a Python project with 5,337 GitHub stars. SynthScan v2.0 examined 164,321 lines of code across 655 source files, recording 2027 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 17.6 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 2027 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/conftest.py | 29 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/conftest.py | 31 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/models/test_modeling_deltaformer.py | 22 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltaformer.py | 24 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltaformer.py | 61 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltaformer.py | 63 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_log_linear_mamba2.py | 17 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_log_linear_mamba2.py | 19 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_yoco.py | 86 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_yoco.py | 88 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_yoco.py | 137 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_yoco.py | 139 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_wall_transformer.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_wall_transformer.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_wall_transformer.py | 54 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_wall_transformer.py | 56 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_path_attn.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_path_attn.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_path_attn.py | 53 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_path_attn.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_lightnet.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_lightnet.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_lightnet.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_lightnet.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gsa.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gsa.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gsa.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gsa.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_hgrn.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_hgrn.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_hgrn.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_hgrn.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_mom.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_mom.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_mom.py | 56 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_mom.py | 58 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_kda.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_kda.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_kda.py | 54 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_kda.py | 56 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltanet.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltanet.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltanet.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_deltanet.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_forgetting_transformer.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_forgetting_transformer.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_forgetting_transformer.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_forgetting_transformer.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gated_deltaproduct.py | 19 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gated_deltaproduct.py | 21 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gated_deltaproduct.py | 58 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_gated_deltaproduct.py | 60 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_retnet.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_retnet.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_retnet.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_retnet.py | 57 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_comba.py | 16 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_comba.py | 18 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_comba.py | 55 | # =================================================================================== | COMMENT |
| MEDIUM | tests/models/test_modeling_comba.py | 57 | # =================================================================================== | COMMENT |
| 147 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_utils.py | 16 | def test_assert_close_accepts_close_tensors_and_rejects_mismatch(): | CODE |
| LOW | tests/test_utils.py | 26 | def test_tensor_cache_uses_identity_until_disabled(monkeypatch): | CODE |
| LOW | tests/test_utils.py | 49 | def test_input_guard_makes_tensors_contiguous_except_skipped(): | CODE |
| LOW | tests/test_utils.py | 78 | def test_deprecate_kwarg_renames_old_keyword_and_warns(): | CODE |
| LOW | tests/test_utils.py | 92 | def test_deprecate_kwarg_can_raise_when_both_names_are_set(): | CODE |
| LOW | tests/test_utils.py | 101 | def test_public_utils_are_reexported(): | CODE |
| LOW | tests/test_split_package_release.py | 112 | def test_split_wheels_match_release_contract(tmp_path: Path) -> None: | CODE |
| LOW | tests/test_split_package_release.py | 150 | def test_core_then_extension_install_sequence_without_runtime_deps(tmp_path: Path) -> None: | CODE |
| LOW | tests/test_split_package_release.py | 203 | def test_core_only_import_with_repo_root_on_path(tmp_path: Path) -> None: | STRING |
| LOW | tests/test_split_package_release.py | 247 | def test_split_namespace_across_sys_path_entries_without_runtime_deps(tmp_path: Path) -> None: | STRING |
| LOW | tests/test_split_package_release.py | 273 | def test_full_split_import_contract_when_runtime_dependencies_available(tmp_path: Path) -> None: | STRING |
| LOW | tests/test_public_api.py | 13 | def test_top_level_exports_layers_and_non_config_models(): | CODE |
| LOW | tests/layers/test_attn_varlen_pack_layout.py | 22 | def test_attention_varlen_accepts_batched_layout_with_cu_seqlens(B: int, T: int, H: int, D: int): | CODE |
| LOW | tests/layers/test_gated_deltanet.py | 28 | def test_gated_deltanet_fused_qkv_conv_matches_fallback(B: int, T: int, D: int, dtype: torch.dtype): | CODE |
| LOW | tests/layers/test_layer_cache_layer_idx.py | 182 | def test_cache_requires_layer_idx(builder, hidden_states): | CODE |
| LOW | tests/layers/test_layer_cache_layer_idx.py | 218 | def test_layers_without_cache_still_work_with_layer_idx_none(builder, hidden_states): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 53 | def test_normalize_tiling_dims_int_and_tuple(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 59 | def test_default_strategy_empty_inputs(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 67 | def test_default_strategy_invalid_tiling_dim(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 77 | def test_default_strategy_power_of_two_block(self, ub_capacity_bits): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 93 | def test_explicit_capacity_properties(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 103 | def test_invalid_env_var_falls_back(self, monkeypatch): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 112 | def test_npu_unavailable_fallback(self, monkeypatch): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 121 | def test_get_ub_manager_singleton(self, monkeypatch): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 130 | def test_returns_none_for_invalid_inputs(self, monkeypatch): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 194 | def test_compute_ub_block_size_respects_bounds(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 203 | def test_compute_ub_block_size_uses_desired_override(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 212 | def test_compute_vocab_block_size_respects_grid_limit(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 224 | def test_compute_elementwise_block_size(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 230 | def test_compute_activation_block_size_forward_and_backward(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 239 | def test_compute_row_tile_block_size_row_and_col(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 257 | def test_compute_grid_limited_tile_size(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 264 | def test_max_grid_axis_chunks(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 269 | def test_iter_axis_launch_chunks_covers_axis(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 279 | def test_iter_axis_launch_chunks_single_chunk(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 285 | def test_returns_bool_without_crashing(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 295 | def test_is_npu_available_on_device(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 299 | def test_ub_manager_detects_soc_ub_size(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 311 | def test_ub_manager_detects_npu_model(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 317 | def test_get_ub_manager_singleton_uses_detected_capacity(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 327 | def test_env_var_overrides_soc_detection(self, monkeypatch): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 333 | def test_compute_default_tiling_strategy_with_real_ub(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 352 | def test_compute_ub_block_size_with_real_ub(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 356 | def test_compute_activation_block_size_with_real_ub(self): | CODE |
| LOW⚡ | tests/utils/test_ascend_ub_manager.py | 364 | def test_real_ub_exceeds_fallback_capacity(self): | CODE |
| LOW | tests/utils/test_ascend_ub_manager.py | 41 | def reset_ub_manager_singleton(): | CODE |
| LOW | tests/utils/test_ascend_ub_manager.py | 167 | def test_non_tiling_dims_padded_to_power_of_two(self, monkeypatch): | CODE |
| LOW | tests/utils/test_ascend_ub_manager.py | 180 | def test_invalid_tiling_dim_raises(self, monkeypatch): | CODE |
| LOW | tests/models/test_modeling_yoco.py | 22 | def _create_yoco_config_kwargs( | CODE |
| LOW | tests/models/test_modeling_utils.py | 54 | def init_weights_with_asymmetric_pattern(module): | CODE |
| LOW | tests/models/test_modeling_mamba.py | 137 | def test_mamba_layer_vs_official_inference(B, T, d_model, d_state, expand, dtype, atol): | CODE |
| LOW | tests/models/test_modeling_mamba.py | 189 | def test_mamba_layer_vs_official_train(B, T, d_model, d_state, expand, dtype, atol): | CODE |
| LOW | tests/models/test_modeling_mamba.py | 223 | def test_mamba_layer_vs_official_eval(B, T, d_model, d_state, expand, dtype, atol): | CODE |
| LOW | tests/models/test_modeling_mamba.py | 258 | def test_mamba_layer_gradient_vs_official(B, T, d_model, d_state, expand, dtype, atol): | CODE |
| LOW⚡ | tests/models/test_modeling_base.py | 32 | def run_test_model_forward_backward( | CODE |
| LOW | tests/models/test_cache.py | 23 | def _assert_attn_state_tokens(attn_state, expected_tokens: torch.Tensor): | CODE |
| LOW | tests/models/test_cache.py | 59 | def test_cache_per_layer_seq_length( | CODE |
| LOW | tests/models/test_cache.py | 117 | def test_cache_incremental_update( | CODE |
| LOW | tests/models/test_cache.py | 153 | def test_cache_get_seq_length_nonexistent_layer(): | CODE |
| LOW | tests/models/test_cache.py | 175 | def test_cache_window_size_does_not_undercount(): | CODE |
| 501 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | evals/harness.py | 8 | CODE | |
| LOW | evals/harness.py | 10 | CODE | |
| LOW | tests/layers/test_attn_varlen_pack_layout.py | 15 | CODE | |
| LOW | tests/models/test_modeling_yoco.py | 16 | CODE | |
| LOW | legacy/training/run.py | 14 | CODE | |
| LOW | legacy/training/preprocess.py | 8 | CODE | |
| LOW | legacy/training/flame/parser.py | 8 | CODE | |
| LOW | legacy/training/flame/data.py | 8 | CODE | |
| LOW | utils/convert_from_llama.py | 37 | CODE | |
| LOW | utils/convert_from_rwkv7.py | 17 | CODE | |
| LOW | utils/convert_from_rwkv6.py | 35 | CODE | |
| LOW | benchmarks/benchmark_generation.py | 15 | CODE | |
| LOW | benchmarks/ops/run.py | 128 | CODE | |
| LOW | benchmarks/ops/registry.py | 14 | CODE | |
| LOW | benchmarks/ops/verify.py | 52 | CODE | |
| LOW | scripts/utils/__init__.py | 8 | CODE | |
| LOW | scripts/utils/__init__.py | 9 | CODE | |
| LOW | scripts/utils/__init__.py | 9 | CODE | |
| LOW | fla/layers/hgrn.py | 10 | CODE | |
| LOW | fla/layers/raven.py | 11 | CODE | |
| LOW | fla/layers/hgrn2.py | 10 | CODE | |
| LOW | fla/layers/deltaformer.py | 8 | CODE | |
| LOW | fla/layers/mom.py | 8 | CODE | |
| LOW | fla/layers/delta_net.py | 8 | CODE | |
| LOW | fla/layers/mamba.py | 8 | CODE | |
| LOW | fla/layers/kda.py | 8 | CODE | |
| LOW | fla/layers/bitattn.py | 8 | CODE | |
| LOW | fla/layers/mamba2.py | 8 | CODE | |
| LOW | fla/layers/rwkv7.py | 8 | CODE | |
| LOW | fla/layers/yoco.py | 8 | CODE | |
| LOW | fla/layers/gsa.py | 8 | CODE | |
| LOW | fla/layers/parallax.py | 11 | CODE | |
| LOW | fla/layers/mamba3.py | 8 | CODE | |
| LOW | fla/layers/rwkv6.py | 10 | CODE | |
| LOW | fla/layers/__init__.py | 8 | CODE | |
| LOW | fla/layers/__init__.py | 9 | CODE | |
| LOW | fla/layers/__init__.py | 10 | CODE | |
| LOW | fla/layers/__init__.py | 11 | CODE | |
| LOW | fla/layers/__init__.py | 12 | CODE | |
| LOW | fla/layers/__init__.py | 13 | CODE | |
| LOW | fla/layers/__init__.py | 14 | CODE | |
| LOW | fla/layers/__init__.py | 15 | CODE | |
| LOW | fla/layers/__init__.py | 16 | CODE | |
| LOW | fla/layers/__init__.py | 17 | CODE | |
| LOW | fla/layers/__init__.py | 18 | CODE | |
| LOW | fla/layers/__init__.py | 19 | CODE | |
| LOW | fla/layers/__init__.py | 20 | CODE | |
| LOW | fla/layers/__init__.py | 21 | CODE | |
| LOW | fla/layers/__init__.py | 22 | CODE | |
| LOW | fla/layers/__init__.py | 23 | CODE | |
| LOW | fla/layers/__init__.py | 24 | CODE | |
| LOW | fla/layers/__init__.py | 25 | CODE | |
| LOW | fla/layers/__init__.py | 26 | CODE | |
| LOW | fla/layers/__init__.py | 27 | CODE | |
| LOW | fla/layers/__init__.py | 28 | CODE | |
| LOW | fla/layers/__init__.py | 29 | CODE | |
| LOW | fla/layers/__init__.py | 30 | CODE | |
| LOW | fla/layers/__init__.py | 31 | CODE | |
| LOW | fla/layers/__init__.py | 32 | CODE | |
| LOW | fla/layers/__init__.py | 33 | CODE | |
| 490 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/models/test_modeling_mamba2.py | 142 | CODE | |
| LOW | legacy/training/preprocess.py | 69 | CODE | |
| LOW | benchmarks/benchmark_training_throughput.py | 88 | CODE | |
| LOW | benchmarks/cp/test_gdn_with_cp.py | 257 | CODE | |
| LOW | benchmarks/cp/test_gdn_with_cp.py | 269 | CODE | |
| LOW | benchmarks/cp/test_gdn_with_cp.py | 351 | CODE | |
| LOW | benchmarks/cp/test_gdn_with_cp.py | 503 | CODE | |
| LOW | fla/layers/hgrn.py | 31 | CODE | |
| LOW | fla/layers/raven.py | 44 | CODE | |
| LOW | fla/layers/hgrn2.py | 33 | CODE | |
| LOW | fla/layers/deltaformer.py | 63 | CODE | |
| LOW | fla/layers/mom.py | 285 | CODE | |
| LOW | fla/layers/delta_net.py | 77 | CODE | |
| LOW | fla/layers/mamba.py | 54 | CODE | |
| LOW | fla/layers/kda.py | 83 | CODE | |
| LOW | fla/layers/bitattn.py | 40 | CODE | |
| LOW | fla/layers/mamba2.py | 113 | CODE | |
| LOW | fla/layers/rwkv7.py | 34 | CODE | |
| LOW | fla/layers/yoco.py | 86 | CODE | |
| LOW | fla/layers/yoco.py | 228 | CODE | |
| LOW | fla/layers/yoco.py | 318 | CODE | |
| LOW | fla/layers/gsa.py | 32 | CODE | |
| LOW | fla/layers/parallax.py | 64 | CODE | |
| LOW | fla/layers/mamba3.py | 65 | CODE | |
| LOW | fla/layers/rwkv6.py | 32 | CODE | |
| LOW | fla/layers/wall_attn.py | 69 | CODE | |
| LOW | fla/layers/rebased.py | 25 | CODE | |
| LOW | fla/layers/path_attn.py | 31 | CODE | |
| LOW | fla/layers/simple_gla.py | 68 | CODE | |
| LOW | fla/layers/gla.py | 75 | CODE | |
| LOW | fla/layers/comba.py | 82 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 43 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 269 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 130 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 280 | CODE | |
| LOW | fla/layers/rodimus.py | 64 | CODE | |
| LOW | fla/layers/rodimus.py | 257 | CODE | |
| LOW | fla/layers/forgetting_attn.py | 32 | CODE | |
| LOW | fla/layers/gated_deltaproduct.py | 35 | CODE | |
| LOW | fla/layers/moba.py | 92 | CODE | |
| LOW | fla/layers/lightnet.py | 32 | CODE | |
| LOW | fla/layers/linear_attn.py | 28 | CODE | |
| LOW | fla/layers/mesa_net.py | 59 | CODE | |
| LOW | fla/layers/mla.py | 55 | CODE | |
| LOW | fla/layers/multiscale_retention.py | 70 | CODE | |
| LOW | fla/layers/nsa.py | 30 | CODE | |
| LOW | fla/layers/attn.py | 39 | CODE | |
| LOW | fla/layers/gated_deltanet.py | 88 | CODE | |
| LOW | fla/layers/abc.py | 28 | CODE | |
| LOW | fla/layers/gdn2.py | 88 | CODE | |
| LOW | fla/models/kda/configuration_kda.py | 15 | CODE | |
| LOW | fla/models/kda/modeling_kda.py | 286 | CODE | |
| LOW | fla/models/kda/modeling_kda.py | 419 | CODE | |
| LOW | fla/models/abc/modeling_abc.py | 260 | CODE | |
| LOW | fla/models/abc/modeling_abc.py | 390 | CODE | |
| LOW | fla/models/abc/configuration_abc.py | 18 | CODE | |
| LOW | fla/models/delta_net/modeling_delta_net.py | 260 | CODE | |
| LOW | fla/models/delta_net/modeling_delta_net.py | 390 | CODE | |
| LOW | fla/models/delta_net/configuration_delta_net.py | 18 | CODE | |
| LOW | …dels/gated_deltaproduct/modeling_gated_deltaproduct.py | 262 | CODE | |
| 179 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/models/test_modeling_log_linear_mamba2.py | 0 | test the forward and backward pass of the mamba3 model by manually instantiating the configuration and the model. | STRING |
| HIGH | tests/models/test_modeling_mamba2.py | 0 | test the forward and backward pass of the mamba3 model by manually instantiating the configuration and the model. | STRING |
| HIGH | tests/models/test_modeling_mamba3.py | 0 | test the forward and backward pass of the mamba3 model by manually instantiating the configuration and the model. | STRING |
| HIGH | tests/context_parallel/test_cp_conv.py | 0 | initialize distributed environment for a single process. | STRING |
| HIGH | tests/context_parallel/test_cp_token_shift.py | 0 | initialize distributed environment for a single process. | STRING |
| HIGH | tests/context_parallel/test_cp_dplr.py | 0 | initialize distributed environment for a single process. | STRING |
| HIGH | tests/context_parallel/test_cp_kda.py | 0 | initialize distributed environment for a single process. | STRING |
| HIGH | tests/context_parallel/test_cp_gdn.py | 0 | initialize distributed environment for a single process. | STRING |
| HIGH | tests/context_parallel/test_cp_conv.py | 0 | worker function for cp gdn test. runs in a spawned process with the given rank. | STRING |
| HIGH | tests/context_parallel/test_cp_dplr.py | 0 | worker function for cp gdn test. runs in a spawned process with the given rank. | STRING |
| HIGH | tests/context_parallel/test_cp_kda.py | 0 | worker function for cp gdn test. runs in a spawned process with the given rank. | STRING |
| HIGH | tests/context_parallel/test_cp_gdn.py | 0 | worker function for cp gdn test. runs in a spawned process with the given rank. | STRING |
| HIGH | tests/context_parallel/test_cp_conv.py | 0 | run cp test using torch.multiprocessing.spawn. this allows running the test directly with pytest. | STRING |
| HIGH | tests/context_parallel/test_cp_dplr.py | 0 | run cp test using torch.multiprocessing.spawn. this allows running the test directly with pytest. | STRING |
| HIGH | tests/context_parallel/test_cp_kda.py | 0 | run cp test using torch.multiprocessing.spawn. this allows running the test directly with pytest. | STRING |
| HIGH | tests/context_parallel/test_cp_gdn.py | 0 | run cp test using torch.multiprocessing.spawn. this allows running the test directly with pytest. | STRING |
| HIGH | tests/context_parallel/test_cp_token_shift.py | 0 | cp2: sequence boundaries aligned with rank boundaries. | STRING |
| HIGH | tests/context_parallel/test_cp_dplr.py | 0 | cp2: sequence boundaries aligned with rank boundaries. | STRING |
| HIGH | tests/context_parallel/test_cp_kda.py | 0 | cp2: sequence boundaries aligned with rank boundaries. | STRING |
| HIGH | tests/context_parallel/test_cp_gdn.py | 0 | cp2: sequence boundaries aligned with rank boundaries. | STRING |
| HIGH | tests/context_parallel/test_cp_dplr.py | 0 | cp4: complex sequence distribution, first sequence spans 3 ranks. | STRING |
| HIGH | tests/context_parallel/test_cp_kda.py | 0 | cp4: complex sequence distribution, first sequence spans 3 ranks. | STRING |
| HIGH | tests/context_parallel/test_cp_gdn.py | 0 | cp4: complex sequence distribution, first sequence spans 3 ranks. | STRING |
| HIGH | fla/layers/mamba.py | 0 | compute ∆, a, b, c, and d the state space parameters and compute the `contextualized_states`. a, d are input independent | STRING |
| HIGH | fla/layers/mamba2.py | 0 | compute ∆, a, b, c, and d the state space parameters and compute the `contextualized_states`. a, d are input independent | STRING |
| HIGH | fla/layers/log_linear_mamba2.py | 0 | compute ∆, a, b, c, and d the state space parameters and compute the `contextualized_states`. a, d are input independent | STRING |
| HIGH | …models/log_linear_mamba2/modeling_log_linear_mamba2.py | 0 | an abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models. | STRING |
| HIGH | fla/models/mamba/modeling_mamba.py | 0 | an abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models. | STRING |
| HIGH | fla/models/mamba2/modeling_mamba2.py | 0 | an abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models. | STRING |
| HIGH | fla/models/samba/modeling_samba.py | 0 | an abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models. | STRING |
| HIGH | fla/ops/retention/chunk.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/ops/retention/fused_chunk.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/ops/generalized_delta_rule/iplr/chunk.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/ops/linear_attn/chunk.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/ops/linear_attn/fused_chunk.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/ops/linear_attn/fused_recurrent.py | 0 | args: q (torch.tensor): queries of shape `[b, t, h, k]`. k (torch.tensor): keys of shape `[b, t, h, k]`. v (torch.tensor | STRING |
| HIGH | fla/modules/backends/triton_ascend/l2norm.py | 0 | return power-of-2 block size for feature dim d under ub constraints. | STRING |
| HIGH | fla/modules/backends/triton_ascend/layernorm.py | 0 | return power-of-2 block size for feature dim d under ub constraints. | STRING |
| HIGH | fla/modules/backends/triton_ascend/fused_norm_gate.py | 0 | return power-of-2 block size for feature dim d under ub constraints. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | utils/convert_from_llama.py | 170 | model.model.norm.weight.data.copy_(llama.model.norm.weight) | CODE |
| CRITICAL | utils/convert_from_llama.py | 174 | model.model.norm.bias.data.copy_(llama.model.norm.bias) | CODE |
| CRITICAL | utils/convert_from_rwkv6.py | 65 | model.model.embeddings.weight.data.copy_(rwkv6.rwkv.embeddings.weight) | CODE |
| CRITICAL | utils/convert_from_rwkv6.py | 114 | model.model.layers[i].attn.r_proj.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].attention.receptance.weight) | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 131 | model.model.layers[i].attn.k_proj.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].attention.key.weight) | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 135 | model.model.layers[i].attn.v_proj.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].attention.value.weight) | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 139 | model.model.layers[i].attn.g_proj.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].attention.gate.weight) | CODE |
| CRITICAL | utils/convert_from_rwkv6.py | 172 | model.model.layers[i].ffn.key.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].feed_forward.key.weight) | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 186 | model.model.layers[i].ffn.receptance.linear.weight.data.copy_(rwkv6.rwkv.blocks[i].feed_forward.receptance.weigh | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 196 | model.model.norm.weight.data.copy_(rwkv6.rwkv.ln_out.weight) | CODE |
| CRITICAL⚡ | utils/convert_from_rwkv6.py | 200 | model.model.norm.bias.data.copy_(rwkv6.rwkv.ln_out.bias) | CODE |
| CRITICAL⚡ | fla/utils/_device.py | 84 | return triton.runtime.driver.active.utils.get_device_properties(tensor_idx)['multiprocessor_count'] | CODE |
| CRITICAL⚡ | fla/utils/_device.py | 89 | return triton.runtime.driver.active.utils.get_device_properties(tensor_idx)['num_vectorcore'] | CODE |
| CRITICAL | fla/utils/_device.py | 173 | triton.runtime.driver.active.utils.get_device_properties(i)['max_shared_mem'] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/conftest.py | 38 | CODE | |
| LOW | tests/models/test_modeling_utils.py | 54 | CODE | |
| LOW | tests/ops/utils/test_csr.py | 47 | CODE | |
| LOW | tests/context_parallel/test_cp_dplr.py | 74 | CODE | |
| LOW | tests/context_parallel/test_cp_kda.py | 103 | CODE | |
| LOW | tests/context_parallel/test_cp_gdn.py | 100 | CODE | |
| LOW | legacy/training/flame/data.py | 186 | CODE | |
| LOW | benchmarks/benchmark_training_throughput.py | 88 | CODE | |
| LOW | benchmarks/ops/run.py | 235 | CODE | |
| LOW | benchmarks/ops/registry.py | 214 | CODE | |
| LOW | benchmarks/modules/benchmark_cross_entropy.py | 37 | CODE | |
| LOW | benchmarks/modules/benchmark_conv.py | 36 | CODE | |
| LOW | benchmarks/modules/benchmark_activations.py | 68 | CODE | |
| LOW | scripts/find_dependent_tests.py | 39 | CODE | |
| LOW | scripts/find_dependent_tests.py | 81 | CODE | |
| LOW | scripts/find_dependent_tests.py | 102 | CODE | |
| LOW | scripts/find_dependent_tests.py | 204 | CODE | |
| LOW | scripts/run_benchmark_compare.py | 79 | CODE | |
| LOW | scripts/run_benchmark_compare.py | 209 | CODE | |
| LOW | scripts/utils/autotune_export.py | 241 | CODE | |
| LOW | scripts/utils/autotune_export.py | 192 | CODE | |
| LOW | fla/layers/delta_net.py | 170 | CODE | |
| LOW | fla/layers/mamba2.py | 275 | CODE | |
| LOW | fla/layers/rwkv6.py | 213 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 43 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 130 | CODE | |
| LOW | fla/layers/log_linear_mamba2.py | 439 | CODE | |
| LOW | fla/layers/linear_attn.py | 28 | CODE | |
| LOW | fla/layers/multiscale_retention.py | 171 | CODE | |
| LOW | fla/utils/ascend_ub_manager.py | 72 | CODE | |
| LOW | fla/models/utils.py | 42 | CODE | |
| LOW | fla/models/utils.py | 223 | CODE | |
| LOW | fla/models/utils.py | 455 | CODE | |
| LOW | fla/models/utils.py | 485 | CODE | |
| LOW | fla/models/kda/modeling_kda.py | 196 | CODE | |
| LOW | fla/models/kda/modeling_kda.py | 419 | CODE | |
| LOW | fla/models/abc/modeling_abc.py | 186 | CODE | |
| LOW | fla/models/abc/modeling_abc.py | 390 | CODE | |
| LOW | fla/models/delta_net/modeling_delta_net.py | 186 | CODE | |
| LOW | fla/models/delta_net/modeling_delta_net.py | 390 | CODE | |
| LOW | …dels/gated_deltaproduct/modeling_gated_deltaproduct.py | 185 | CODE | |
| LOW | …dels/gated_deltaproduct/modeling_gated_deltaproduct.py | 392 | CODE | |
| LOW | fla/models/gsa/modeling_gsa.py | 189 | CODE | |
| LOW | fla/models/gsa/modeling_gsa.py | 394 | CODE | |
| LOW | fla/models/moba/modeling_moba.py | 172 | CODE | |
| LOW | fla/models/moba/modeling_moba.py | 359 | CODE | |
| LOW | …models/log_linear_mamba2/modeling_log_linear_mamba2.py | 162 | CODE | |
| LOW | …models/log_linear_mamba2/modeling_log_linear_mamba2.py | 434 | CODE | |
| LOW | fla/models/deltaformer/modeling_deltaformer.py | 348 | CODE | |
| LOW | fla/models/hgrn/modeling_hgrn.py | 182 | CODE | |
| LOW | fla/models/hgrn/modeling_hgrn.py | 394 | CODE | |
| LOW | fla/models/transformer/modeling_transformer.py | 379 | CODE | |
| LOW | fla/models/yoco/modeling_yoco.py | 333 | CODE | |
| LOW | fla/models/yoco/modeling_yoco.py | 677 | CODE | |
| LOW | fla/models/mamba/modeling_mamba.py | 110 | CODE | |
| LOW | fla/models/mamba/modeling_mamba.py | 289 | CODE | |
| LOW | fla/models/nsa/modeling_nsa.py | 183 | CODE | |
| LOW | fla/models/nsa/modeling_nsa.py | 394 | CODE | |
| LOW | fla/models/lightnet/modeling_lightnet.py | 180 | CODE | |
| LOW | fla/models/lightnet/modeling_lightnet.py | 385 | CODE | |
| 67 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | legacy/training/preprocess.py | 29 | Tokenize the input text and split into chunks of specified context length. Args: examples: | STRING |
| HIGH | fla/utils/_decorators.py | 195 | Decorator to notify users about deprecated keyword arguments, replacing them with a new name if specified. Thi | STRING |
| HIGH | fla/utils/ascend_ub_manager.py | 283 | Compute tiling strategy using the default strategy function. This function directly calls the default strategy | STRING |
| HIGH | fla/ops/kda/chunk.py | 201 | Args: q (torch.Tensor): queries of shape ``[B, T, H, K]``. k (torch.Tensor): | STRING |
| HIGH | fla/ops/kda/fused_recurrent.py | 356 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/delta_rule/chunk.py | 240 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/delta_rule/fused_recurrent.py | 450 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gated_delta_rule/chunk.py | 415 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gated_delta_rule/fused_recurrent.py | 328 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gsa/chunk.py | 1098 | Args: q (torch.Tensor): queries of shape `[B, T, HQ, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gsa/fused_recurrent.py | 445 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/moba/parallel.py | 305 | Flash-attn based MoBA implementation. MoBA (Mixture of Block Attention, https://arxiv.org/abs/2502.13189) makes | STRING |
| HIGH | fla/ops/hgrn/fused_recurrent.py | 265 | Args: x (torch.Tensor): inputs of shape `[B, T, D]. g (torch.Tensor): Forge | STRING |
| HIGH | fla/ops/gated_delta_product/chunk.py | 273 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/simple_gla/chunk.py | 252 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/simple_gla/fused_chunk.py | 24 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/simple_gla/fused_recurrent.py | 29 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gla/chunk.py | 1370 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/gla/fused_recurrent.py | 29 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/mesa_net/chunk.py | 322 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]` k (torch.Tensor): k | STRING |
| HIGH | fla/ops/gdn2/chunk.py | 216 | Chunkwise forward for Gated DeltaNet 2 (GDN-2). The matrix-state recurrence on ``S in R^{K x V}`` is | STRING |
| HIGH | fla/ops/comba/chunk.py | 308 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/comba/fused_recurrent.py | 236 | Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/rwkv6/chunk.py | 1247 | Args: r (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): | STRING |
| HIGH | fla/ops/rwkv6/fused_recurrent.py | 573 | Args: r (torch.Tensor): reception of shape `[B, T, H, K]`. Alias: q, query in linea | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmarks/ops/run.py | 155 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | benchmarks/ops/registry.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | scripts/utils/__init__.py | 11 | __all__ = [ | CODE |
| LOW | scripts/utils/autotune_export.py | 137 | def update_default_config(self) -> None: | CODE |
| LOW | fla/layers/__init__.py | 46 | __all__ = [ | CODE |
| LOW | fla/utils/_device.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW | fla/utils/_testing.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | fla/models/__init__.py | 48 | __all__ = [ | CODE |
| LOW | fla/models/kda/__init__.py | 17 | __all__ = ['KDAConfig', 'KDAForCausalLM', 'KDAModel'] | CODE |
| LOW | fla/models/abc/__init__.py | 18 | __all__ = ['ABCConfig', 'ABCForCausalLM', 'ABCModel'] | CODE |
| LOW | fla/models/delta_net/__init__.py | 17 | __all__ = ['DeltaNetConfig', 'DeltaNetForCausalLM', 'DeltaNetModel'] | CODE |
| LOW | fla/models/gated_deltaproduct/__init__.py | 17 | __all__ = [ | CODE |
| LOW | fla/models/gsa/__init__.py | 18 | __all__ = ['GSAConfig', 'GSAForCausalLM', 'GSAModel'] | CODE |
| LOW | fla/models/moba/__init__.py | 18 | __all__ = ['MoBAConfig', 'MoBAForCausalLM', 'MoBAModel'] | CODE |
| LOW | fla/models/log_linear_mamba2/__init__.py | 18 | __all__ = ['LogLinearMamba2Config', 'LogLinearMamba2ForCausalLM', 'LogLinearMamba2Model'] | CODE |
| LOW | fla/models/deltaformer/__init__.py | 17 | __all__ = ['DeltaFormerConfig', 'DeltaFormerForCausalLM', 'DeltaFormerModel'] | CODE |
| LOW | fla/models/hgrn/__init__.py | 18 | __all__ = ['HGRNConfig', 'HGRNForCausalLM', 'HGRNModel'] | CODE |
| LOW | fla/models/transformer/__init__.py | 18 | __all__ = ['TransformerConfig', 'TransformerForCausalLM', 'TransformerModel'] | CODE |
| LOW | fla/models/yoco/__init__.py | 17 | __all__ = ['YOCOConfig', 'YOCOForCausalLM', 'YOCOModel'] | CODE |
| LOW | fla/models/mamba/__init__.py | 18 | __all__ = ['MambaConfig', 'MambaForCausalLM', 'MambaModel'] | CODE |
| LOW | fla/models/nsa/__init__.py | 18 | __all__ = ['NSAConfig', 'NSAForCausalLM', 'NSAModel'] | CODE |
| LOW | fla/models/lightnet/__init__.py | 18 | __all__ = ['LightNetConfig', 'LightNetForCausalLM', 'LightNetModel'] | CODE |
| LOW | fla/models/path_attn/__init__.py | 18 | __all__ = ['PaTHAttentionConfig', 'PaTHAttentionForCausalLM', 'PaTHAttentionModel'] | CODE |
| LOW | fla/models/parallax/__init__.py | 24 | __all__ = ['ParallaxConfig', 'ParallaxForCausalLM', 'ParallaxModel'] | CODE |
| LOW | fla/models/gla/__init__.py | 18 | __all__ = ['GLAConfig', 'GLAForCausalLM', 'GLAModel'] | CODE |
| LOW | fla/models/mla/__init__.py | 18 | __all__ = ['MLAConfig', 'MLAForCausalLM', 'MLAModel'] | CODE |
| LOW | fla/models/raven/__init__.py | 18 | __all__ = ['RavenConfig', 'RavenForCausalLM', 'RavenModel'] | CODE |
| LOW | fla/models/mamba2/__init__.py | 18 | __all__ = ['Mamba2Config', 'Mamba2ForCausalLM', 'Mamba2Model'] | CODE |
| LOW | fla/models/mamba3/__init__.py | 18 | __all__ = ['Mamba3Config', 'Mamba3ForCausalLM', 'Mamba3Model'] | CODE |
| LOW | fla/models/samba/__init__.py | 18 | __all__ = ['SambaConfig', 'SambaForCausalLM', 'SambaModel'] | CODE |
| LOW | fla/models/mesa_net/__init__.py | 17 | __all__ = ['MesaNetConfig', 'MesaNetForCausalLM', 'MesaNetModel'] | CODE |
| LOW | fla/models/linear_attn/__init__.py | 17 | __all__ = ['LinearAttentionConfig', 'LinearAttentionForCausalLM', 'LinearAttentionModel'] | CODE |
| LOW | fla/models/wall_transformer/__init__.py | 23 | __all__ = ['WallTransformerConfig', 'WallTransformerForCausalLM', 'WallTransformerModel'] | CODE |
| LOW | fla/models/retnet/__init__.py | 18 | __all__ = ['RetNetConfig', 'RetNetForCausalLM', 'RetNetModel'] | CODE |
| LOW | fla/models/gated_deltanet/__init__.py | 17 | __all__ = ['GatedDeltaNetConfig', 'GatedDeltaNetForCausalLM', 'GatedDeltaNetModel'] | CODE |
| LOW | fla/models/forgetting_transformer/__init__.py | 21 | __all__ = ['ForgettingTransformerConfig', 'ForgettingTransformerForCausalLM', 'ForgettingTransformerModel'] | CODE |
| LOW | fla/models/hgrn2/__init__.py | 18 | __all__ = ['HGRN2Config', 'HGRN2ForCausalLM', 'HGRN2Model'] | CODE |
| LOW | fla/models/rodimus/__init__.py | 18 | __all__ = ['RodimusConfig', 'RodimusForCausalLM', 'RodimusModel'] | CODE |
| LOW | fla/models/comba/__init__.py | 17 | __all__ = ['CombaConfig', 'CombaForCausalLM', 'CombaModel'] | CODE |
| LOW | fla/models/rwkv7/__init__.py | 18 | __all__ = ['RWKV7Config', 'RWKV7ForCausalLM', 'RWKV7Model'] | CODE |
| LOW | fla/models/bitnet/__init__.py | 18 | __all__ = ['BitNetConfig', 'BitNetForCausalLM', 'BitNetModel'] | CODE |
| LOW | fla/models/mom/__init__.py | 17 | __all__ = ['MomConfig', 'MomForCausalLM', 'MomModel'] | CODE |
| LOW | fla/models/rwkv6/__init__.py | 18 | __all__ = ['RWKV6Config', 'RWKV6ForCausalLM', 'RWKV6Model'] | CODE |
| LOW | fla/ops/__init__.py | 39 | __all__ = [ | CODE |
| LOW | fla/ops/kda/__init__.py | 11 | __all__ = [ | CODE |
| LOW | fla/ops/kda/backends/__init__.py | 19 | __all__ = ['dispatch', 'kda_registry'] | CODE |
| LOW | fla/ops/abc/__init__.py | 10 | __all__ = [ | CODE |
| LOW | fla/ops/delta_rule/__init__.py | 12 | __all__ = [ | CODE |
| LOW | fla/ops/gated_delta_rule/__init__.py | 12 | __all__ = [ | CODE |
| LOW | fla/ops/gated_delta_rule/backends/__init__.py | 20 | __all__ = ['dispatch', 'gdr_registry'] | CODE |
| LOW | fla/ops/gsa/__init__.py | 11 | __all__ = [ | CODE |
| LOW | fla/ops/titans/__init__.py | 10 | __all__ = [ | CODE |
| LOW | fla/ops/moba/__init__.py | 10 | __all__ = ['parallel_moba'] | CODE |
| LOW | fla/ops/wall_attn/__init__.py | 14 | __all__ = [ | CODE |
| LOW | fla/ops/retention/__init__.py | 13 | __all__ = [ | CODE |
| LOW | fla/ops/deltaformer/__init__.py | 11 | __all__ = [ | CODE |
| LOW | fla/ops/deltaformer/naive.py | 152 | __all__ = [ | CODE |
| LOW | fla/ops/deltaformer/parallel.py | 1000 | __all__ = [ | CODE |
| LOW | fla/ops/hgrn/__init__.py | 11 | __all__ = [ | CODE |
| LOW | fla/ops/generalized_delta_rule/__init__.py | 11 | __all__ = [ | CODE |
| 48 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/context_parallel/test_cp_conv.py | 116 | # Step 1: Prepare Global Data | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 134 | # Step 2: Reference Run | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 158 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 190 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 94 | # Step 1: Prepare Global Data | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 104 | # Step 2: Reference Run | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 114 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_token_shift.py | 141 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 104 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to all) | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 144 | # Step 2: Reference Run using dplr_recurrence (ground truth) | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 221 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 261 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 137 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to other ranks) | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 207 | # Step 2: Reference Run using naive_recurrent_kda (ground truth) | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 305 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 349 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 130 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to all) | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 163 | # Step 2: Reference Run (single GPU, varlen, no CP) | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 193 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 229 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | scripts/run_benchmark_compare.py | 362 | # Step 1: HEAD | COMMENT |
| LOW | scripts/run_benchmark_compare.py | 385 | # Step 2: BASE | COMMENT |
| LOW⚡ | scripts/run_benchmark_compare.py | 400 | # Step 3: Restore original ref | COMMENT |
| LOW⚡ | scripts/run_benchmark_compare.py | 404 | # Step 4: Print comparison | COMMENT |
| LOW⚡ | fla/ops/kda/chunk_intra.py | 793 | # Step 1: Run token_parallel first to compute diagonal blocks into Akkd (fp32) | COMMENT |
| LOW⚡ | fla/ops/kda/chunk_intra.py | 794 | # Step 1: compute diagonal blocks into Akk_diag (fp32) | COMMENT |
| LOW | fla/ops/kda/chunk_intra.py | 831 | # Step 2: Fused inter + solve_tril (works for both fixed-len and varlen) | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 120 | # Step 1: compute all 10 lower-triangular [BC, BC] blocks of K @ K^T | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 171 | # Step 2: apply gate and beta scaling | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 214 | # Step 3: forward substitution on diagonal blocks -> (I + A_diag)^{-1} | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 253 | # Step 4: block merge -> full (I + A)^{-1} | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 293 | # Step 5: store full (I + A)^{-1} to output A | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 367 | # Step 1: fused kkt + solve_tril | STRING |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 386 | # Step 1: mathematically equivalent unfused kkt + solve_tril for non-64 chunks | STRING |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 403 | # Step 2: recompute_w_u | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/context_parallel/test_cp_conv.py | 116 | # Step 1: Prepare Global Data | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 134 | # Step 2: Reference Run | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 158 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_conv.py | 190 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 94 | # Step 1: Prepare Global Data | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 104 | # Step 2: Reference Run | COMMENT |
| LOW⚡ | tests/context_parallel/test_cp_token_shift.py | 114 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_token_shift.py | 141 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 104 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to all) | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 144 | # Step 2: Reference Run using dplr_recurrence (ground truth) | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 221 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_dplr.py | 261 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 137 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to other ranks) | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 207 | # Step 2: Reference Run using naive_recurrent_kda (ground truth) | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 305 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_kda.py | 349 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 130 | # Step 1: Prepare Global Data (all generated on rank 0, broadcast to all) | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 163 | # Step 2: Reference Run (single GPU, varlen, no CP) | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 193 | # Step 3: Context Parallel Run | COMMENT |
| LOW | tests/context_parallel/test_cp_gdn.py | 229 | # Step 4: Result Aggregation and Verification | COMMENT |
| LOW | scripts/run_benchmark_compare.py | 362 | # Step 1: HEAD | COMMENT |
| LOW | scripts/run_benchmark_compare.py | 385 | # Step 2: BASE | COMMENT |
| LOW⚡ | scripts/run_benchmark_compare.py | 400 | # Step 3: Restore original ref | COMMENT |
| LOW⚡ | scripts/run_benchmark_compare.py | 404 | # Step 4: Print comparison | COMMENT |
| LOW⚡ | fla/ops/kda/chunk_intra.py | 793 | # Step 1: Run token_parallel first to compute diagonal blocks into Akkd (fp32) | COMMENT |
| LOW⚡ | fla/ops/kda/chunk_intra.py | 794 | # Step 1: compute diagonal blocks into Akk_diag (fp32) | COMMENT |
| LOW | fla/ops/kda/chunk_intra.py | 831 | # Step 2: Fused inter + solve_tril (works for both fixed-len and varlen) | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 120 | # Step 1: compute all 10 lower-triangular [BC, BC] blocks of K @ K^T | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 171 | # Step 2: apply gate and beta scaling | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 214 | # Step 3: forward substitution on diagonal blocks -> (I + A_diag)^{-1} | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 253 | # Step 4: block merge -> full (I + A)^{-1} | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 293 | # Step 5: store full (I + A)^{-1} to output A | COMMENT |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 367 | # Step 1: fused kkt + solve_tril | STRING |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 386 | # Step 1: mathematically equivalent unfused kkt + solve_tril for non-64 chunks | STRING |
| LOW | fla/ops/gated_delta_rule/chunk_fwd.py | 403 | # Step 2: recompute_w_u | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/context_parallel/test_cp_conv.py | 223 | except Exception as e: | CODE |
| LOW | tests/context_parallel/test_cp_token_shift.py | 167 | except Exception as e: | CODE |
| LOW | tests/context_parallel/test_cp_dplr.py | 326 | except Exception as e: | CODE |
| LOW | tests/context_parallel/test_cp_kda.py | 407 | except Exception as e: | CODE |
| LOW | tests/context_parallel/test_cp_gdn.py | 281 | except Exception as e: | CODE |
| LOW | benchmarks/benchmark_training_throughput.py | 48 | except Exception: | CODE |
| MEDIUM | benchmarks/benchmark_training_throughput.py | 36 | def _git_describe() -> str: | CODE |
| LOW | benchmarks/ops/run.py | 183 | except Exception: | CODE |
| LOW | benchmarks/ops/run.py | 198 | except Exception: | CODE |
| LOW | benchmarks/ops/run.py | 318 | except Exception as e: | CODE |
| LOW | benchmarks/ops/run.py | 333 | except Exception as e: | CODE |
| LOW | benchmarks/ops/run.py | 355 | except Exception as e: | CODE |
| LOW | benchmarks/ops/run.py | 566 | except Exception as e: | CODE |
| LOW | benchmarks/ops/run.py | 671 | except Exception as e: | CODE |
| LOW | benchmarks/cp/test_gdn_with_cp.py | 57 | except Exception: | CODE |
| LOW | scripts/utils/autotune_export.py | 62 | except Exception as e: | CODE |
| MEDIUM | scripts/utils/autotune_export.py | 63 | print(f"Error processing {autotune_file}: {e}") | CODE |
| LOW | scripts/utils/autotune_export.py | 107 | except Exception: | CODE |
| LOW | scripts/utils/autotune_export.py | 206 | except Exception: | CODE |
| LOW | scripts/utils/autotune_export.py | 303 | except Exception as e: | CODE |
| MEDIUM | scripts/utils/autotune_export.py | 304 | print(f"Error saving {output_file}: {e}") | CODE |
| LOW⚡ | fla/utils/_device.py | 85 | except Exception: | CODE |
| LOW⚡ | fla/utils/_device.py | 90 | except Exception: | CODE |
| LOW⚡ | fla/utils/_device.py | 99 | except Exception: | CODE |
| LOW | fla/utils/_device.py | 176 | except Exception: | CODE |
| LOW | fla/utils/_device.py | 201 | except Exception: | CODE |
| MEDIUM | fla/utils/_device.py | 96 | def get_available_device() -> str: | CODE |
| MEDIUM | fla/utils/_device.py | 170 | def get_all_max_shared_mem(): | CODE |
| LOW | fla/utils/ascend_ub_manager.py | 36 | except Exception: | CODE |
| LOW | fla/utils/ascend_ub_manager.py | 205 | except Exception: | CODE |
| LOW | fla/utils/ascend_ub_manager.py | 253 | except Exception as e: | CODE |
| LOW | fla/ops/backends/__init__.py | 87 | except Exception as e: | CODE |
| LOW | fla/ops/utils/cache.py | 259 | except Exception as e: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/ops/test_gdn2.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | tests/ops/test_gdn2.py | 21 | # * use_qk_l2norm_in_kernel | COMMENT |
| LOW | tests/modules/test_layernorm.py | 221 | assert_close(' dw', ref_dw, tri_dw, 1e-3) | COMMENT |
| LOW | utils/convert_from_llama.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | utils/convert_from_rwkv6.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | .github/workflows/oj.yml | 1 | name: oj | COMMENT |
| LOW | fla/layers/gdn2.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/models/mamba/modeling_mamba.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/models/mamba/configuration_mamba.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/models/mamba2/configuration_mamba2.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/models/mamba2/modeling_mamba2.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/models/mamba2/modeling_mamba2.py | 221 | # Reinitialize selected weights subject to the OpenAI GPT-2 Paper Scheme: | COMMENT |
| LOW | fla/ops/titans/naive.py | 81 | # Calculate n_{i,j} | COMMENT |
| LOW | fla/ops/titans/naive.py | 101 | # f[..., t] += (beta[..., t] / beta[..., i]) * m[..., i] | COMMENT |
| LOW | fla/ops/titans/log_impl.py | 41 | # f[..., t] += torch.exp(log_beta[..., t] - log_beta[..., i] + log_m[..., i]) | COMMENT |
| LOW | fla/ops/moba/__init__.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/hgrn/chunk.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/utils/constant.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/gdn2/chunk_intra_token_parallel.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/gdn2/chunk_intra.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/gdn2/naive.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/ops/gdn2/wy_fast.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/modules/fused_linear_cross_entropy.py | 201 | b_p = (exp(b_capped - b_lse) - eps) * logit_scale | COMMENT |
| LOW | fla/modules/layernorm.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/modules/grpo.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/modules/layernorm_gated.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| LOW | fla/modules/fused_bitlinear.py | 1 | # Copyright (c) 2023-2026, Songlin Yang, Yu Zhang, Zhiyuan Li | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/modules/test_conv.py | 733 | # Create a larger tensor and take a non-contiguous slice | COMMENT |
| MEDIUM | fla/ops/kda/gate.py | 8 | # This file is modified and supported by the Moonshot AI Team | COMMENT |
| MEDIUM⚡ | fla/ops/titans/naive.py | 30 | # Create a matrix filled with 1s for cumulative product | COMMENT |
| MEDIUM⚡ | fla/ops/titans/naive.py | 37 | # Create an expanded version of theta | COMMENT |
| MEDIUM⚡ | fla/ops/titans/naive.py | 39 | # Create a mask to keep only the upper triangular part (excluding the diagonal) | COMMENT |
| MEDIUM | fla/modules/grpo.py | 404 | # Create a completion mask. It checks which positions are valid based on logits_to_keep | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | evals/ppl.py | 227 | # Print results | COMMENT |
| LOW | tests/conftest.py | 53 | # Check if this frame is from a test file | COMMENT |
| LOW | legacy/training/flame/data.py | 210 | # Check if padding is necessary. | COMMENT |
| LOW | benchmarks/cp/benchmark_kda_cp8_vs_cp2tp.py | 420 | # Print results | COMMENT |
| LOW | scripts/find_dependent_tests.py | 241 | # Check if any import matches both: | COMMENT |
| LOW | scripts/find_dependent_tests.py | 292 | # Check if test imports any affected symbol from affected module | COMMENT |
| LOW | fla/utils/_device.py | 34 | # Check if triton-windows is installed | COMMENT |
| LOW | fla/models/rwkv7/modeling_rwkv7.py | 338 | # Check if the layer contains the old 'x_x' parameter | COMMENT |
| LOW | fla/ops/utils/cache.py | 80 | # Check if GPU name is overridden via environment variable | COMMENT |
| LOW | fla/ops/utils/cache.py | 82 | # Check if GPU name is overridden via environment variable | COMMENT |
| LOW | fla/ops/utils/cache.py | 106 | # Check if custom config dir is set via environment variable | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | fla/layers/moba.py | 208 | # defines a seamless switch from block-sparse to full attention for the | COMMENT |
| MEDIUM | fla/ops/cp/context.py | 75 | # 2. Operate on CPU to avoid D2H sync and leverage vectorization (int64/long) | COMMENT |
| LOW | fla/modules/layernorm.py | 1435 | # us to simply just use from_local | COMMENT |
| LOW | fla/modules/feature_map.py | 183 | # currently we simply use linear layers without any non-linear activations | STRING |
| LOW | fla/modules/conv/cuda/ops.py | 118 | # Here we just pass in None and dx will be allocated in the C++ code. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/ops/test_gdn_kernels.py | 692 | # compensated by the orchestration's reverse cumsum (see chunk_gated_delta_rule_bwd), | COMMENT |
| MEDIUM | fla/ops/gdn2/chunk_fwd.py | 8 | # Forward orchestration for GDN-2 chunkwise training. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | fla/utils/_decorators.py | 236 | def my_function(do_reduce_labels): | STRING |
| LOW | fla/utils/_decorators.py | 246 | def my_function(max_size): | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | fla/ops/abc/naive.py | 82 | This is just for demonstration purposes, with no numerical stabilities guaranteed. | STRING |