Repository Analysis

dask/dask

Parallel computing with task scheduling

15.6 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of dask/dask, a Python project with 13,856 GitHub stars. SynthScan v2.0 examined 198,016 lines of code across 413 source files, recording 3416 pattern matches distributed across 16 syntactic categories. The overall adjusted score of 15.6 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

15.6
Adjusted Score
15.6
Raw Score
100%
Time Factor
2026-07-13
Last Push
13.9K
Stars
Python
Language
198.0K
Lines of Code
413
Files
3.4K
Pattern Hits
2026-07-14
Scan Date
0.04
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 1HIGH 15MEDIUM 37LOW 3363

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 3416 distinct pattern matches across 16 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers2045 hits · 1768 pts
SeverityFileLineSnippetContext
LOWconftest.py72def pytest_assertrepr_compare(op, left, right):CODE
LOWconftest.py102def allow_distributed_async_clients():CODE
LOWdask/conftest.py23def pytest_collection_modifyitems(config, items):CODE
LOWdask/_expr.py96 def _tree_repr_argument_construction(self, i, op, header):CODE
LOWdask/system.py17def _try_extract_cgroup_cpu_quota():CODE
LOWdask/config.py700def expand_environment_variables(config: Any) -> Any:CODE
LOWdask/utils_test.py76 def test_data_not_in_dict_is_ok(self):CODE
LOWdask/utils_test.py86 def test_get_with_list_top_level(self):CODE
LOWdask/utils_test.py102 def test_get_with_nested_list(self):CODE
LOWdask/utils_test.py108 def test_get_works_with_unhashables_in_values(self):CODE
LOWdask/optimization.py71def default_fused_linear_keys_renamer(keys):CODE
LOWdask/optimization.py409def default_fused_keys_renamer(keys, max_fused_key_length=120):CODE
LOWdask/_pandas_compat.py96def check_groupby_axis_deprecation():CODE
LOWdask/_pandas_compat.py110def check_observed_deprecation():CODE
LOWdask/_pandas_compat.py124def check_convert_dtype_deprecation():CODE
LOWdask/_pandas_compat.py138def check_apply_dataframe_deprecation():CODE
LOWdask/_pandas_compat.py154def is_any_real_numeric_dtype(arr_or_dtype) -> bool:CODE
LOWdask/delayed.py77def _finalize_args_collections(args, collections):CODE
LOWdask/utils.py2222def get_default_shuffle_method() -> str:CODE
LOWdask/blockwise.py1423def zero_broadcast_dimensions(lol, nblocks):CODE
LOWdask/highlevelgraph.py34def compute_layer_dependencies(layers):CODE
LOWdask/highlevelgraph.py37 def _find_layer_containing_key(key):CODE
LOWdask/_compatibility.py50def import_optional_dependency(CODE
LOWdask/_compatibility.py60def import_optional_dependency(CODE
LOWdask/_compatibility.py69def import_optional_dependency(CODE
LOWdask/layers.py110def normalize_array_slice_dep(dep):CODE
LOWdask/layers.py115def normalize_array_block_id_dep(dep):CODE
LOWdask/layers.py120def normalize_array_values_dep(dep):CODE
LOWdask/layers.py256def _expand_keys_around_center(k, dims, name=None, axes=None):CODE
LOWdask/sizeof.py115 def sizeof_numba_devicendarray(x):CODE
LOWdask/sizeof.py255 def sizeof_pyarrow_chunked_array(data):CODE
LOWdask/sizeof.py304def _register_entry_point_plugins():CODE
LOWdask/tokenize.py83def _maybe_raise_nondeterministic(msg: str) -> None:CODE
LOWdask/tokenize.py185def normalize_builtin_function_or_method(func):CODE
LOWdask/tokenize.py350 def normalize_extension_array(arr):CODE
LOWdask/tokenize.py357 def normalize_extension_array(arr):CODE
LOWdask/tokenize.py364 def normalize_categorical_dtype(dtype):CODE
LOWdask/multiprocessing.py25def _reduce_method_descriptor(m):CODE
LOWdask/multiprocessing.py263def initialize_worker_process(user_initializer=None):CODE
LOWdask/base.py483def _rebuild_composite_collection(CODE
LOWdask/dataframe/accessor.py105def register_dataframe_accessor(name):CODE
LOWdask/dataframe/_pyarrow.py42def is_object_string_dataframe(x) -> bool:CODE
LOWdask/dataframe/methods.py191def describe_numeric_aggregate(CODE
LOWdask/dataframe/methods.py238def describe_nonnumeric_aggregate(stats, name):CODE
LOWdask/dataframe/multi.py254 def _is_index_level_reference(x, key):CODE
LOWdask/dataframe/multi.py278 def _is_column_label_reference(df, key):CODE
LOWdask/dataframe/core.py64def _get_divisions_map_partitions(CODE
LOWdask/dataframe/core.py271def _map_freq_to_period_start(freq):CODE
LOWdask/dataframe/core.py445def _sqrt_and_convert_to_timedelta(partition, axis, dtype=None, *args, **kwargs):CODE
LOWdask/dataframe/shuffle.py216def ensure_cleanup_on_exception(p):CODE
LOWdask/dataframe/backends.py237def get_pyarrow_schema_pandas(obj, preserve_index=None):CODE
LOWdask/dataframe/backends.py242def get_pyarrow_table_from_pandas(obj, **kwargs):CODE
LOWdask/dataframe/backends.py248def get_pandas_dataframe_from_pyarrow(meta, table, **kwargs):CODE
LOWdask/dataframe/backends.py274def make_meta_pandas_datetime_tz(x, index=None):CODE
LOWdask/dataframe/backends.py502def _meta_lib_from_array_numpy(x):CODE
LOWdask/dataframe/backends.py510def union_categoricals_pandas(to_union, sort_categories=False, ignore_order=False):CODE
LOWdask/dataframe/backends.py524def get_parallel_type_dataframe(_):CODE
LOWdask/dataframe/backends.py586def _union_categoricals_wrapper(CODE
LOWdask/dataframe/backends.py782def is_categorical_dtype_pandas(obj):CODE
LOWdask/dataframe/backends.py803def to_pandas_dispatch_from_pandas(data, **kwargs):CODE
1985 more matches not shown…
Unused Imports902 hits · 714 pts
SeverityFileLineSnippetContext
LOWconftest.py1CODE
LOWconftest.py27CODE
LOWconftest.py32CODE
LOWconftest.py37CODE
LOWconftest.py42CODE
LOWconftest.py47CODE
LOWconftest.py52CODE
LOWdask/threaded.py7CODE
LOWdask/conftest.py1CODE
LOWdask/system.py1CODE
LOWdask/config.py1CODE
LOWdask/utils_test.py1CODE
LOWdask/local.py110CODE
LOWdask/order.py1CODE
LOWdask/optimization.py1CODE
LOWdask/_pandas_compat.py7CODE
LOWdask/datasets.py1CODE
LOWdask/cache.py1CODE
LOWdask/__init__.py1CODE
LOWdask/__init__.py3CODE
LOWdask/__init__.py3CODE
LOWdask/__init__.py4CODE
LOWdask/__init__.py4CODE
LOWdask/__init__.py4CODE
LOWdask/__init__.py4CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py13CODE
LOWdask/__init__.py22CODE
LOWdask/__init__.py23CODE
LOWdask/__init__.py24CODE
LOWdask/core.py1CODE
LOWdask/_dispatch.py1CODE
LOWdask/ml.py1CODE
LOWdask/_collections.py1CODE
LOWdask/backends.py1CODE
LOWdask/distributed.py1CODE
LOWdask/distributed.py11CODE
LOWdask/context.py5CODE
LOWdask/delayed.py1CODE
LOWdask/cli.py1CODE
LOWdask/utils.py1CODE
LOWdask/callbacks.py1CODE
LOWdask/task_spec.py1CODE
LOWdask/task_spec.py3CODE
LOWdask/task_spec.py3CODE
LOWdask/task_spec.py3CODE
LOWdask/task_spec.py3CODE
LOWdask/task_spec.py3CODE
LOWdask/task_spec.py3CODE
LOWdask/graph_manipulation.py6CODE
LOWdask/dot.py1CODE
LOWdask/_compatibility.py1CODE
LOWdask/typing.py1CODE
LOWdask/sizeof.py1CODE
LOWdask/rewrite.py1CODE
842 more matches not shown…
Deep Nesting226 hits · 214 pts
SeverityFileLineSnippetContext
LOWdask/threaded.py62CODE
LOWdask/_expr.py299CODE
LOWdask/_expr.py367CODE
LOWdask/_expr.py612CODE
LOWdask/_expr.py1161CODE
LOWdask/_expr.py1237CODE
LOWdask/config.py209CODE
LOWdask/config.py499CODE
LOWdask/config.py439CODE
LOWdask/local.py144CODE
LOWdask/local.py382CODE
LOWdask/order.py81CODE
LOWdask/order.py618CODE
LOWdask/order.py226CODE
LOWdask/order.py299CODE
LOWdask/order.py446CODE
LOWdask/optimization.py20CODE
LOWdask/optimization.py86CODE
LOWdask/optimization.py378CODE
LOWdask/optimization.py458CODE
LOWdask/core.py111CODE
LOWdask/core.py323CODE
LOWdask/core.py362CODE
LOWdask/delayed.py414CODE
LOWdask/utils.py147CODE
LOWdask/utils.py334CODE
LOWdask/utils.py379CODE
LOWdask/utils.py465CODE
LOWdask/utils.py225CODE
LOWdask/utils.py2269CODE
LOWdask/utils.py227CODE
LOWdask/blockwise.py914CODE
LOWdask/blockwise.py1109CODE
LOWdask/blockwise.py1262CODE
LOWdask/blockwise.py657CODE
LOWdask/blockwise.py746CODE
LOWdask/highlevelgraph.py127CODE
LOWdask/highlevelgraph.py201CODE
LOWdask/highlevelgraph.py238CODE
LOWdask/dot.py64CODE
LOWdask/dot.py126CODE
LOWdask/dot.py318CODE
LOWdask/_compatibility.py69CODE
LOWdask/layers.py323CODE
LOWdask/base.py90CODE
LOWdask/base.py428CODE
LOWdask/base.py515CODE
LOWdask/base.py877CODE
LOWdask/base.py1225CODE
LOWdask/base.py547CODE
LOWdask/_task_spec.py117CODE
LOWdask/_task_spec.py203CODE
LOWdask/_task_spec.py276CODE
LOWdask/_task_spec.py620CODE
LOWdask/_task_spec.py647CODE
LOWdask/_task_spec.py938CODE
LOWdask/dataframe/multi.py77CODE
LOWdask/dataframe/multi.py296CODE
LOWdask/dataframe/backends.py279CODE
LOWdask/dataframe/backends.py378CODE
166 more matches not shown…
Cross-Language Confusion15 hits · 92 pts
SeverityFileLineSnippetContext
HIGHdask/base.py1273 # If undefined, fallback to `config` or worst case CPU_COUNT.STRING
HIGHdask/dataframe/core.py146 and columns.equals(df.columns)CODE
HIGHdask/dataframe/groupby.py50 return df.index.equals(by.index)CODE
HIGHdask/dataframe/dask_expr/io/parquet.py133 if part_expr.equals(pc.scalar(True)):CODE
HIGHdask/dataframe/dask_expr/io/parquet.py136 if pqformat.read_options.equals(pa_ds.ParquetFileFormat().read_options):CODE
HIGHdask/dataframe/dask_expr/io/parquet.py140 assert fs.equals(self._fragment.filesystem)CODE
HIGHdask/dataframe/io/parquet/core.py531 # Start conventional (non-null) filteringCOMMENT
HIGHdask/dataframe/tests/test_groupby.py1460 assert res0_a.equals(res0_b)CODE
HIGHdask/dataframe/tests/test_groupby.py1461 assert res1_a.equals(res1_b)CODE
HIGHdask/dataframe/tests/test_dataframe.py4467 assert res.dtypes.equals(ddf2.dtypes)CODE
HIGHdask/dataframe/tests/test_dataframe.py5214 assert schema.equals(table.schema)CODE
HIGHdask/dataframe/tests/test_dataframe.py5231 assert schema.equals(table.schema)CODE
HIGHdask/array/stats.py440 # If df is undefined, variances are zero (assumes n1 > 0 & n2 > 0).COMMENT
HIGHdask/array/overlap.py943 return bn.push(array, limit, axis)CODE
HIGHdask/array/tests/test_overlap.py769 expected = bottleneck.push(array, axis=0, n=n)CODE
Excessive Try-Catch Wrapping55 hits · 62 pts
SeverityFileLineSnippetContext
LOWdask/system.py27 except Exception:CODE
LOWdask/system.py39 except Exception:CODE
LOWdask/config.py184 except Exception as exc:CODE
LOWdask/core.py339 except Exception:CODE
LOWdask/backends.py141 except Exception as e:CODE
LOWdask/cli.py178 except Exception as e:CODE
LOWdask/utils.py685 except Exception:CODE
LOWdask/utils.py690 except Exception:CODE
LOWdask/utils.py753 except Exception:CODE
LOWdask/utils.py1116 except Exception as e:CODE
LOWdask/utils.py1137 except Exception as e:CODE
LOWdask/utils.py1900 except Exception:CODE
LOWdask/utils.py1998 except Exception:CODE
MEDIUMdask/utils.py785def __doc__(self):CODE
MEDIUMdask/utils.py1897def has_keyword(func, keyword):CODE
LOWdask/sizeof.py310 except Exception:CODE
LOWdask/rewrite.py408 except Exception:CODE
LOWdask/tokenize.py211 except Exception:CODE
LOWdask/tokenize.py247 except Exception:CODE
LOWdask/tokenize.py253 except Exception:CODE
LOWdask/tokenize.py474 except Exception:CODE
MEDIUMdask/tokenize.py350def normalize_extension_array(arr):CODE
LOWdask/multiprocessing.py120 except Exception as e:CODE
LOWdask/_task_spec.py787 except Exception:CODE
LOWdask/dataframe/accessor.py20 except Exception:CODE
LOWdask/dataframe/accessor.py41 except Exception:CODE
LOWdask/dataframe/core.py44 except Exception:CODE
LOWdask/dataframe/core.py85 except Exception:CODE
LOWdask/dataframe/shuffle.py225 except Exception:CODE
LOWdask/dataframe/shuffle.py230 except Exception:CODE
MEDIUMdask/dataframe/shuffle.py110def set_partitions_pre(s, divisions, ascending=True, na_position="last"):CODE
LOWdask/dataframe/backends.py334 except Exception:CODE
LOWdask/dataframe/backends.py659 except Exception:CODE
LOWdask/dataframe/utils.py150 except Exception as e:CODE
LOWdask/dataframe/groupby.py571 except Exception:CODE
LOWdask/dataframe/partitionquantiles.py322 except Exception:CODE
MEDIUMdask/dataframe/dask_expr/_expr.py153def __getattr__(self, key):CODE
LOWdask/dataframe/dask_expr/_expr.py456 except Exception:CODE
LOWdask/dataframe/dask_expr/_expr.py871 except Exception:CODE
LOWdask/dataframe/io/csv.py119 except Exception as e:CODE
LOWdask/dataframe/tests/test_utils_dataframe.py388 except Exception as e:CODE
LOWdask/dataframe/tests/test_utils_dataframe.py397 except Exception as e:CODE
MEDIUMdask/dataframe/tests/test_utils_dataframe.py384def test_raise_on_meta_error():CODE
LOWdask/dataframe/tests/test_dataframe.py4515 except Exception:CODE
LOWdask/array/core.py489 except Exception as e:CODE
LOWdask/array/core.py841 except Exception:CODE
LOWdask/array/core.py5180 except Exception:CODE
LOWdask/array/utils.py97 except Exception:CODE
LOWdask/array/utils.py163 except Exception:CODE
LOWdask/array/_array_expr/_map_blocks.py310 except Exception:CODE
LOWdask/array/_array_expr/_blockwise.py280 except Exception:CODE
LOWdask/array/_array_expr/_utils.py64 except Exception:CODE
LOWdask/tests/test_callbacks.py53 except Exception as e:CODE
LOWdask/tests/test_callbacks.py62 except Exception as e:CODE
LOWdask/diagnostics/profile.py279 except Exception: # could be a few different exceptionsCODE
AI Structural Patterns51 hits · 50 pts
SeverityFileLineSnippetContext
LOWdask/local.py382CODE
LOWdask/utils.py2122CODE
LOWdask/dot.py126CODE
LOWdask/dot.py421CODE
LOWdask/dataframe/groupby.py593CODE
LOWdask/dataframe/dask_expr/_reductions.py1219CODE
LOWdask/dataframe/dask_expr/_collection.py5140CODE
LOWdask/dataframe/dask_expr/_collection.py5594CODE
LOWdask/dataframe/dask_expr/_collection.py5687CODE
LOWdask/dataframe/dask_expr/_collection.py1636CODE
LOWdask/dataframe/dask_expr/_collection.py1801CODE
LOWdask/dataframe/dask_expr/_collection.py2132CODE
LOWdask/dataframe/dask_expr/_collection.py2407CODE
LOWdask/dataframe/dask_expr/_collection.py2859CODE
LOWdask/dataframe/dask_expr/_collection.py3342CODE
LOWdask/dataframe/dask_expr/_collection.py3534CODE
LOWdask/dataframe/dask_expr/io/parquet.py337CODE
LOWdask/dataframe/io/csv.py418CODE
LOWdask/dataframe/io/csv.py764CODE
LOWdask/dataframe/io/csv.py715CODE
LOWdask/dataframe/io/sql.py195CODE
LOWdask/dataframe/io/sql.py422CODE
LOWdask/dataframe/io/json.py20CODE
LOWdask/dataframe/io/json.py108CODE
LOWdask/dataframe/io/parquet/core.py226CODE
LOWdask/array/numpy_compat.py170CODE
LOWdask/array/creation.py857CODE
LOWdask/array/creation.py1144CODE
LOWdask/array/creation.py1210CODE
LOWdask/array/core.py551CODE
LOWdask/array/core.py3468CODE
LOWdask/array/gufunc.py172CODE
LOWdask/array/gufunc.py647CODE
LOWdask/array/utils.py299CODE
LOWdask/array/blockwise.py17CODE
LOWdask/array/reductions.py83CODE
LOWdask/array/reductions.py1517CODE
LOWdask/array/reductions.py1561CODE
LOWdask/array/reductions.py1640CODE
LOWdask/array/reductions.py1839CODE
LOWdask/array/routines.py538CODE
LOWdask/array/routines.py1958CODE
LOWdask/array/_reductions_generic.py25CODE
LOWdask/array/_array_expr/_map_blocks.py16CODE
LOWdask/array/_array_expr/_gufunc.py173CODE
LOWdask/array/_array_expr/_gufunc.py683CODE
LOWdask/array/_array_expr/_reductions.py199CODE
LOWdask/array/_array_expr/_reductions.py25CODE
LOWdask/array/_array_expr/_collection.py694CODE
LOWdask/array/_array_expr/_collection.py1005CODE
LOWdask/bag/text.py17CODE
AI Slop Vocabulary20 hits · 40 pts
SeverityFileLineSnippetContext
MEDIUMdask/local.py635 """Sorting key function that is robust to different typesSTRING
MEDIUMdask/utils.py1974 # If we convert the key, recurse to utilize LRU cache betterCOMMENT
LOWdask/blockwise.py1282 # Fast path: if there's only one input we can just use it as-is.COMMENT
LOWdask/dot.py228 # IPython can't display this format natively, so just return None.COMMENT
MEDIUMdask/dataframe/dask_expr/_quantile.py111 # Add 0 and 100 during calculation for more robust behavior (hopefully)COMMENT
MEDIUMdask/dataframe/dask_expr/_merge.py303 # 1. Add/leverage partition statisticsCOMMENT
LOWdask/dataframe/dask_expr/_reductions.py1071 # Drop all of the columns, just pass through the indexCOMMENT
LOWdask/dataframe/dask_expr/io/parquet.py1432 # empty dataframe - just use metaCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1327 # Check if this is a very simple case where we can just returnCOMMENT
LOWdask/dataframe/tests/test_groupby.py2225 # just pass the pandas result as meta for convenienceCOMMENT
LOWdask/array/slicing.py257 # No lists, hooray! just use slice_slices_and_integersCOMMENT
LOWdask/array/core.py6001 # output has a zero dimension, just create a new zero-shape array with theCOMMENT
LOWdask/array/gufunc.py479 # NOTE: we likely could just use `meta` instead of `tmp._meta`,COMMENT
LOWdask/array/utils.py156 # min/max functions have no identity, just use the same input type when there's only oneCOMMENT
MEDIUMdask/array/percentile.py177 # Add 0 and 100 during calculation for more robust behavior (hopefully)COMMENT
MEDIUMdask/array/tests/test_array_core.py2349 # disabled things are nuanced and hardware-dependent. Don't risk it.COMMENT
MEDIUMdask/array/tests/test_array_core.py2330 # disabled things are nuanced and hardware-dependent. Don't risk it.COMMENT
LOWdask/array/_array_expr/_slicing.py299 # No lists, hooray! just use slice_slices_and_integersCOMMENT
LOWdask/array/_array_expr/_gufunc.py457 # NOTE: we likely could just use `meta` instead of `tmp._meta`,COMMENT
LOWdask/array/_array_expr/_utils.py57 # min/max functions have no identity, just use the same input type when there's only oneCOMMENT
Redundant / Tautological Comments24 hits · 38 pts
SeverityFileLineSnippetContext
LOWdask/_expr.py386 # Check if we've already simplified for these dependentsCOMMENT
LOWdask/_expr.py615 # Check if we are replacing a literalCOMMENT
LOWdask/dataframe/dask_expr/_collection.py3098 # Check if key is in columns if keyCOMMENT
LOWdask/dataframe/dask_expr/_collection.py5936 # Check if `func` supports column projectionCOMMENT
LOWdask/dataframe/dask_expr/_groupby.py1536 # Check if we can project columnsCOMMENT
LOWdask/dataframe/io/utils.py188 # Check if we are using `fsspec.parquet`.COMMENT
LOWdask/dataframe/io/tests/test_parquet.py3040 # Check if we can avoid writing an actual fileCOMMENT
LOWdask/dataframe/io/orc/arrow.py73 # Check if we can aggregate adjacent parts togetherCOMMENT
LOWdask/dataframe/io/parquet/arrow.py326 # Check if we need to generate a fragment for filtering.COMMENT
LOWdask/dataframe/io/parquet/arrow.py454 # Check if filesystem was specified as a dataset optionCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1327 # Check if this is a very simple case where we can just returnCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1449 # Check if we are using a simple file-partition mapCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1583 # Check if we have empty parts to returnCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1646 # Check if we have partitioning information.COMMENT
LOWdask/dataframe/io/parquet/arrow.py1649 # Check if we need to generate a fragment.COMMENT
LOWdask/dataframe/io/parquet/utils.py59 # Check if fs was specified as a dataset optionCOMMENT
LOWdask/array/core.py3409 # Check if dtype.itemsize is greater than 0COMMENT
LOWdask/array/gufunc.py429 #### Check if core dimensions consist of only one chunkCOMMENT
LOWdask/array/gufunc.py436 #### Check if loop dimensions consist of same chunksizes, when they have sizes > 1COMMENT
LOWdask/array/tests/test_array_function.py169 # Check if it's an equivalent arrayCOMMENT
LOWdask/array/tests/test_routines.py765 # Check if the sum of the bins equals the number of samplesCOMMENT
LOWdask/array/tests/test_routines.py792 # Check if return type is same as histCOMMENT
LOWdask/array/_array_expr/_gufunc.py431 #### Check if core dimensions consist of only one chunkCOMMENT
LOWdask/array/_array_expr/_gufunc.py438 #### Check if loop dimensions consist of same chunksizes, when they have sizes > 1COMMENT
Over-Commented Block37 hits · 36 pts
SeverityFileLineSnippetContext
LOWcontinuous_integration/pixi-recipes/s3fs/recipe.yaml1package:COMMENT
LOWdask/order.py401 known_runnable_paths[current] = [path]COMMENT
LOWdask/order.py461 return TrueCOMMENT
LOWdask/order.py481 # dependencies are in resultCOMMENT
LOWdask/order.py501 # 1. Determine the target node by calling ``get_target`` and append theCOMMENT
LOWdask/order.py521 # Given this, the algorithm is as follows:COMMENT
LOWdask/multiprocessing.py41# By default, tracebacks can't be serialized using pickle. However, theCOMMENT
LOWdask/_task_spec.py301 # user is requesting and by collapsing we'd no longer be able toCOMMENT
LOWdask/dataframe/_pyarrow_compat.py1from __future__ import annotationsCOMMENT
LOWdask/dataframe/partitionquantiles.py321 return np.array(None, dtype=dtype)COMMENT
LOWdask/dataframe/dask_expr/_expr.py2141 # anymore. Otherwise, a chain of Filters might block ProjectionsCOMMENT
LOWdask/dataframe/io/parquet/arrow.py1001 except StopIteration:COMMENT
LOWdask/dataframe/io/parquet/arrow.py1021 # | F | True | None | 1 row-group per partition |COMMENT
LOWdask/dataframe/io/parquet/core.py301 agg_name = f"agg-{name}"COMMENT
LOWdask/array/reshape.py141 # The previous step squashed the whole dimension into a singleCOMMENT
LOWdask/array/slicing.py1341 # of the result of the original slice.COMMENT
LOWdask/array/slicing.py1561 """COMMENT
LOWdask/array/slicing.py1681 if is_dask_collection(index):COMMENT
LOWdask/array/slicing.py1721 f"of shape {tuple(implied_shape)}"COMMENT
LOWdask/array/slicing.py1741 # For example:COMMENT
LOWdask/array/slicing.py1761 # array. An element of `None` will end upCOMMENT
LOWdask/array/slicing.py1841 in_keys = list(flatten(array.__dask_keys__()))COMMENT
LOWdask/array/rechunk.py81 indicator with a corresponding cumulative sum,COMMENT
LOWdask/array/stats.py21#COMMENT
LOWdask/array/routines.py1461 # This tuple of zeros represents the chunk index along the columnsCOMMENT
LOWdask/array/tests/test_reshape.py201 (2, 2, 3, 4),COMMENT
LOWdask/array/_array_expr/_gufunc.py501 # output_shape = loop_output_shape + core_output_shapeCOMMENT
LOWdocs/source/conf.py1#COMMENT
LOWdocs/source/conf.py81# General information about the project.COMMENT
LOWdocs/source/conf.py101# default_role = NoneCOMMENT
LOWdocs/source/conf.py121COMMENT
LOWdocs/source/conf.py141COMMENT
LOWdocs/source/conf.py161COMMENT
LOWdocs/source/conf.py181# If true, "Created using Sphinx" is shown in the HTML footer. Default is True.COMMENT
LOWdocs/source/conf.py201latex_elements: dict[str, str] = {COMMENT
LOWdocs/source/conf.py221# not chapters.COMMENT
LOWdocs/source/conf.py281COMMENT
Self-Referential Comments15 hits · 33 pts
SeverityFileLineSnippetContext
MEDIUMdask/dataframe/io/io.py173 # Create a mapping of chunk number in the incoming array toCOMMENT
MEDIUMdask/dataframe/io/tests/test_parquet.py3059 # Create a Dask DataFrame if size (100, 10) with 5 partitions and write to localCOMMENT
MEDIUMdask/dataframe/io/tests/test_parquet.py3088 # Create a Dask DataFrame with 5 partitions and write to local, partitioning on the column A and column BCOMMENT
MEDIUMdask/dataframe/io/tests/test_parquet.py3903 # Create a pandas-metadata-free partitioned parquet. By default it willCOMMENT
MEDIUMdask/dataframe/io/tests/test_sql.py131 # Create an empty table in a different schema.STRING
MEDIUMdask/dataframe/io/tests/test_sql.py143 # Create the schema and the table.STRING
MEDIUMdask/array/slicing.py1319 # Initialize output variablesSTRING
MEDIUMdask/array/slicing.py1843 # Create a new "setitem" dask entry for each block in the arraySTRING
MEDIUMdask/array/slicing.py2006 # Create the part of the full assignment value that is to beSTRING
MEDIUMdask/array/slicing.py2019 # Define the assignment function for this block.STRING
MEDIUMdask/array/tests/test_array_core.py5207 # Create a dask array with chunks that don't align with shardsCOMMENT
MEDIUMdask/array/tests/test_array_core.py5228 # Create a sharded zarr arrayCOMMENT
MEDIUMdask/tests/test_spark_compat.py37 # Create a spark session. Note that we set the timezone to UTC to avoidCOMMENT
MEDIUMdask/tests/test_delayed.py394 # Create a list with a dask value, and test that it's not computedCOMMENT
MEDIUMdocs/source/conf.py5# This file is execfile()d with the current directory set to its containing dir.COMMENT
Decorative Section Separators8 hits · 24 pts
SeverityFileLineSnippetContext
MEDIUMdask/dataframe/methods.py38# ---------------------------------COMMENT
MEDIUMdask/dataframe/methods.py40# ---------------------------------COMMENT
MEDIUMdask/dataframe/methods.py428# ---------------------------------COMMENT
MEDIUMdask/dataframe/methods.py430# ---------------------------------COMMENT
MEDIUMdask/dataframe/io/tests/test_parquet.py268 # ----------COMMENT
MEDIUMdask/dataframe/io/parquet/core.py20# ----------------------------------------------------------------------COMMENT
MEDIUMdask/array/stats.py85# -----------------COMMENT
MEDIUMdask/array/stats.py87# -----------------COMMENT
Modern Structural Boilerplate14 hits · 14 pts
SeverityFileLineSnippetContext
LOWdask/delayed.py48__all__ = ["Delayed", "delayed"]CODE
LOWdask/callbacks.py7__all__ = ["Callback", "add_callbacks"]CODE
LOWdask/task_spec.py5__all__ = [CODE
LOWdask/sizeof.py16logger = logging.getLogger(__name__)CODE
LOWdask/dataframe/__init__.py75__all__ = [CODE
LOWdask/dataframe/shuffle.py13logger = logging.getLogger(__name__)CODE
LOWdask/dataframe/extensions.py20__all__ = [CODE
LOWdask/dataframe/_compat.py50__all__ = [CODE
LOWdask/dataframe/dask_expr/datasets.py16__all__ = ["timeseries"]CODE
LOWdask/dataframe/dask_expr/diagnostics/__init__.py6__all__ = ["analyze", "explain"]CODE
LOWdask/dataframe/io/demo.py18__all__ = [CODE
LOWdask/array/__init__.py46__all__ = [CODE
LOWdask/array/stats.py70__all__ = [CODE
LOWdask/bag/__init__.py3__all__ = [CODE
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICALdask/dataframe/dask_expr/tests/test_merge.py282 assert sorted(result.expr.frame.frame.left.operand("columns")) == ["b", "x"]CODE
Dead Code1 hit · 2 pts
SeverityFileLineSnippetContext
MEDIUMdask/_task_spec.py913CODE
Slop Phrases1 hit · 2 pts
SeverityFileLineSnippetContext
LOWdask/dataframe/tests/test_accessors.py161 # make sure to pass through args & kwargsCOMMENT
Overly Generic Function Names1 hit · 1 pts
SeverityFileLineSnippetContext
LOWdask/local.py246def execute_task(key, task_info, dumps, loads, get_id, pack_exception):CODE