Apache DataFusion SQL Query Engine
This report summarizes scanner evidence for apache/datafusion, a Rust project with 9,432 GitHub stars. SynthScan examined 1,113,214 lines of code across 2704 source files, recording 6229 pattern matches distributed across 17 syntactic categories. The legacy adjusted pattern signal is 7.8 (Moderate pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 5265 finding(s).
Are imports declared and package/API names verified? 11 finding(s).
Are wrappers, guards, and repeated structures necessary? 959 finding(s).
Which changes need focused human review? 6229 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 6229 distinct pattern matches across 17 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .asf.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | Cargo.toml | 341 | # - Runtime performance: how fast the resulting binaries execute | COMMENT |
| LOW | Cargo.toml | 361 | # - ci-optimized: derived from `release` but enables debug assertions and uses | COMMENT |
| LOW | lychee.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | rustfmt.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | rustfmt.toml | 21 | # ignore generated files | COMMENT |
| LOW | taplo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | pre-commit.sh | 1 | #!/bin/bash | COMMENT |
| LOW | licenserc.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | rust-toolchain.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/tpch.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/data_gen.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/data_gen.rs | 241 | /// use cases. | COMMENT |
| LOW | test-utils/src/lib.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/lib.rs | 81 | /// multiple batches | COMMENT |
| LOW | test-utils/src/string_gen.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/tpcds.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/decimal.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/boolean.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/binary.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/mod.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/string.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/random_data.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | test-utils/src/array_gen/primitive.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/tests/cli_integration.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/tests/cli_integration.rs | 61 | /// How many times to try bringing up the RustFS container before failing. | COMMENT |
| LOW | datafusion-cli/examples/cli-session-context.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/print_format.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/exec.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/exec.rs | 441 | false, | COMMENT |
| LOW | datafusion-cli/src/exec.rs | 461 | /// * `location`: A string reference representing the location of the object store. | COMMENT |
| LOW | datafusion-cli/src/command.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/lib.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/functions.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/functions.rs | 901 | /// | COMMENT |
| LOW | datafusion-cli/src/object_storage.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/cli_context.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/catalog.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/pool_type.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/main.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/highlighter.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/helper.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/print_options.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/object_storage/instrumented.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/object_storage/instrumented.rs | 581 | } | COMMENT |
| LOW | datafusion-cli/src/object_storage/stdin.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | datafusion-cli/src/object_storage/stdin.rs | 41 | /// [`SessionConfig`]: datafusion::execution::context::SessionConfig | COMMENT |
| LOW | datafusion-cli/src/object_storage/stdin.rs | 61 | /// Utilities for exposing the process's standard input as an object store. | COMMENT |
| LOW | datafusion-cli/src/object_storage/stdin.rs | 101 | COMMENT | |
| LOW | datafusion-cli/src/object_storage/stdin.rs | 261 | .await?; | COMMENT |
| LOW | ci/scripts/release_version_labeler.js | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | ci/scripts/check_generated_docs.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | ci/scripts/rust_fmt.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | ci/scripts/check_asf_yaml_status_checks.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | ci/scripts/check_circular_dependencies.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | ci/scripts/typos_check.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | ci/scripts/check_large_files.sh | 1 | #!/usr/bin/env bash | COMMENT |
| 4985 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | Cargo.toml | 336 | # -------------------- | COMMENT |
| MEDIUM | Cargo.toml | 338 | # -------------------- | COMMENT |
| MEDIUM | ci/scripts/changed_crates.sh | 34 | # ── changed-crates ────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ci/scripts/changed_crates.sh | 62 | # ── semver-check ──────────────────────────────────────────────────── | COMMENT |
| MEDIUM | ci/scripts/changed_crates.sh | 75 | # ── main ──────────────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 81 | /// ┌─────────────────────┐ -----► execute path | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 82 | /// │ │ ┄┄┄┄┄► init path | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 85 | /// └───────▲─────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 88 | /// ┌──────────▼──────────┐ ┌──────────-──────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 92 | /// └───────▲─────────────┘ └─────────────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 94 | /// ┌───────────────┿──┴────────────────┐ ┊ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 95 | /// | ┌┄┄┄┄┄┄┄┄┄┄┄┘ | ┊ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 97 | /// ┌──────────▼──────────┐ ┌──────────▼──────────┐ ┊ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 98 | /// │ │ │ │ ┌──────────▼──────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 101 | /// └──────────────▲──────┘ └─────────────────────┘ | | | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 102 | /// │ ┊ └─────────────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 105 | /// ┌──────────▼──────────┐ ┌──────────▼──────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 107 | /// │ FileSource(trait) ◄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄│ ... │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 109 | /// └─────────────────────┘ └─────────────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 114 | /// ┌──────────▼──────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 118 | /// └─────────────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 122 | /// ┌──────────▼──────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/source.rs | 126 | /// └─────────────────────┘ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 48 | /// ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 53 | /// │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 55 | /// ┌─────────────────┐ ┌ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 56 | /// │ │ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 61 | /// │ │ │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 62 | /// │ File A (7MB) │ ────────▶ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 64 | /// │ │ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 69 | /// │ │ │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 70 | /// └─────────────────┘ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 71 | /// ┌─────────────────┐ ┌ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 72 | /// │ File B (1MB) │ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 74 | /// └─────────────────┘ │ Range: 6-7MB │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 75 | /// │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 76 | /// ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 79 | /// │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 97 | /// ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 102 | /// ┌─────────────────┐ │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 105 | /// │ │ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 109 | /// │ File A (6MB) │ ────────▶ │ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 110 | /// │ (ordered) │ │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 113 | /// │ │ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 117 | /// └─────────────────┘ │ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 118 | /// ┌─────────────────┐ │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 121 | /// └─────────────────┘ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/file_groups.rs | 124 | /// │ └─────────────────┘ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 91 | /// ┌───────────┐ ┌────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 92 | /// ┌──────▶ │ batch 1 ├────▶...──────▶│ Batch a | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 93 | /// │ └───────────┘ └────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 95 | /// ┌──────────┐ │ ┌───────────┐ ┌────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 96 | /// ┌───────────┐ ┌────────────┐ │ │ ├──────▶ │ batch a+1├────▶...──────▶│ Batch b | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 97 | /// │ batch 1 ├────▶...──────▶│ Batch N ├─────▶│ Demux ├────────┤ ... └───────────┘ └────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 98 | /// └───────────┘ └────────────┘ │ │ │ | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 99 | /// └──────────┘ │ ┌───────────┐ ┌────────── | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 100 | /// └──────▶ │ batch d ├────▶...──────▶│ Batch n | COMMENT |
| MEDIUM⚡ | datafusion/datasource/src/write/demux.rs | 101 | /// └───────────┘ └────────── | COMMENT |
| MEDIUM | …usion/datasource/src/file_scan_config/sort_pushdown.rs | 57 | /// ┌─────────────────────────────────────────────────────────────┐ | COMMENT |
| MEDIUM | …usion/datasource/src/file_scan_config/sort_pushdown.rs | 65 | /// └─────────────────────────────────────────────────────────────┘ | COMMENT |
| 882 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | datafusion/physical-plan/src/aggregates/spill.rs | 67 | /// Step 1: OOM round 1 | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/spill.rs | 79 | /// Step 2: OOM round 2 | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/spill.rs | 89 | /// Step 3: Global sort and final aggregation | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 397 | // Step 1: Aggregate the input batch | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 404 | // Step 2: Soft limit optimization | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 411 | // Step 3: Skip partial aggregation optimization | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 421 | // Step 4: Larger-than-memory execution (early emit) | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8927 | // Step 1: Partial aggregation on partition 1 | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8939 | // Step 2: Partial aggregation on partition 2 | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8961 | // Step 3: PartialReduce — combine partial results, still producing state | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8988 | // Step 4: Final aggregation on the PartialReduce output | COMMENT |
| LOW | …usion/physical-plan/src/aggregates/aggregate_stream.rs | 171 | // Step 1: Update each partition's current bound | COMMENT |
| LOW | …usion/physical-plan/src/aggregates/aggregate_stream.rs | 208 | // Step 2: Sync the dynamic filter physical expression with reader, | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1612 | // Step 1: Create a test batch and measure its size | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1616 | // Step 2: Configure file rotation to approximately 1 batch per file | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1640 | // Step 4: Verify initial disk usage reflects all files | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1647 | // Step 5: Read NUM_BATCHES - 1 batches (all but 1) | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1673 | // Step 7: Read the final batch | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1677 | // Step 8: Drop writer first to signal no more data will be written | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1688 | // Step 9: Drop reader to release all references | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1691 | // Step 10: Verify complete cleanup - disk usage should be 0 | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 600 | // Step 1: Lock shared state and check coordination | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 624 | // Step 2: Lazy-create reader stream if needed | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 649 | // Step 3: Poll the reader stream (no lock held) | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 1627 | // Step 3: Write NUM_BATCHES batches to create approximately NUM_BATCHES files | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 1661 | // Step 6: Verify disk usage decreased but is not zero (at least 1 batch remains) | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 474 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 508 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 542 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 553 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 564 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 769 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 1405 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 2187 | /// NOTE: This function only works with intervals of the same data type. | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 675 | // Step 1: Count entries per group. For EmitTo::First(n), only groups | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 687 | // Step 2: Do a prefix sum over the counts and use it to build ListArray | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 706 | // Step 3: Scatter entries into group order using the counting sort. The | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 728 | // Step 4: Release state for emitted groups. | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 142 | // Step 1: Match FilterExec at the top | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 150 | // Step 2: Extract limit from predicate (rn <= K, rn < K, etc.) | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 162 | // Step 3: Walk through optional ProjectionExec and RepartitionExec to find BoundedWindowAggExec | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 166 | // Step 4: Verify col_idx references a supported window function output column | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 201 | // Step 5: Validate PARTITION BY / ORDER BY and collect sort keys from the window expr | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 211 | // Step 6: Build PartitionedTopKExec from the window's partition/order keys | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 245 | // Step 7: Rebuild window with PartitionedTopKExec as its child | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 250 | // Step 8: Rebuild intermediate nodes (ProjectionExec/RepartitionExec) | COMMENT |
| LOW | …physical-optimizer/src/limited_distinct_aggregation.rs | 98 | // Step 1: Identify the plan shape, | COMMENT |
| LOW | …physical-optimizer/src/limited_distinct_aggregation.rs | 129 | // Step 2: Verify partial/final aggregate is compatible, then apply optimization | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 448 | // Step 1: drain a batch from the active reader if any. | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 467 | // Step 2: when the decoder is sitting on a row-group boundary, | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 511 | // Step 3: drive the decoder. | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 122 | // Step 1: Check for NULL mask in incoming args | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 133 | // Step 2: Delegate to DataFusion's concat | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 145 | // Step 3: Apply NULL mask to result | COMMENT |
| LOW | datafusion/sql/src/expr/mod.rs | 403 | // NOTE: This function is called recursively, so each match arm body should be as | COMMENT |
| LOW | docs/source/contributor-guide/inviting.md | 49 | ### Step 1: Start a Discussion Thread | COMMENT |
| LOW | docs/source/contributor-guide/inviting.md | 75 | ### Step 2: Formal Vote | COMMENT |
| LOW | docs/source/contributor-guide/inviting.md | 108 | ### Step 3: Send Invitation to the Candidate | COMMENT |
| LOW | docs/source/contributor-guide/inviting.md | 126 | ### Step 4: Announce and Celebrate the New Committer | COMMENT |
| LOW | docs/source/contributor-guide/inviting.md | 289 | ### Step 1: Start a Discussion Thread | COMMENT |
| 25 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | datafusion/physical-plan/src/aggregates/spill.rs | 67 | /// Step 1: OOM round 1 | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/spill.rs | 79 | /// Step 2: OOM round 2 | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/spill.rs | 89 | /// Step 3: Global sort and final aggregation | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 397 | // Step 1: Aggregate the input batch | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 404 | // Step 2: Soft limit optimization | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 411 | // Step 3: Skip partial aggregation optimization | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/aggregates/hash_stream.rs | 421 | // Step 4: Larger-than-memory execution (early emit) | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8927 | // Step 1: Partial aggregation on partition 1 | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8939 | // Step 2: Partial aggregation on partition 2 | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8961 | // Step 3: PartialReduce — combine partial results, still producing state | COMMENT |
| LOW | datafusion/physical-plan/src/aggregates/mod.rs | 8988 | // Step 4: Final aggregation on the PartialReduce output | COMMENT |
| LOW | …usion/physical-plan/src/aggregates/aggregate_stream.rs | 171 | // Step 1: Update each partition's current bound | COMMENT |
| LOW | …usion/physical-plan/src/aggregates/aggregate_stream.rs | 208 | // Step 2: Sync the dynamic filter physical expression with reader, | COMMENT |
| LOW | …plan/src/aggregates/group_values/multi_group_by/mod.rs | 1146 | // In non-streaming case, we need to check if the `group index view` | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1612 | // Step 1: Create a test batch and measure its size | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1616 | // Step 2: Configure file rotation to approximately 1 batch per file | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1640 | // Step 4: Verify initial disk usage reflects all files | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1647 | // Step 5: Read NUM_BATCHES - 1 batches (all but 1) | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1673 | // Step 7: Read the final batch | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1677 | // Step 8: Drop writer first to signal no more data will be written | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1688 | // Step 9: Drop reader to release all references | COMMENT |
| LOW⚡ | datafusion/physical-plan/src/spill/spill_pool.rs | 1691 | // Step 10: Verify complete cleanup - disk usage should be 0 | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 600 | // Step 1: Lock shared state and check coordination | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 624 | // Step 2: Lazy-create reader stream if needed | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 649 | // Step 3: Poll the reader stream (no lock held) | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 1627 | // Step 3: Write NUM_BATCHES batches to create approximately NUM_BATCHES files | COMMENT |
| LOW | datafusion/physical-plan/src/spill/spill_pool.rs | 1661 | // Step 6: Verify disk usage decreased but is not zero (at least 1 batch remains) | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 675 | // Step 1: Count entries per group. For EmitTo::First(n), only groups | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 687 | // Step 2: Do a prefix sum over the counts and use it to build ListArray | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 706 | // Step 3: Scatter entries into group order using the counting sort. The | COMMENT |
| LOW | datafusion/functions-aggregate/src/array_agg.rs | 728 | // Step 4: Release state for emitted groups. | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 142 | // Step 1: Match FilterExec at the top | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 150 | // Step 2: Extract limit from predicate (rn <= K, rn < K, etc.) | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 162 | // Step 3: Walk through optional ProjectionExec and RepartitionExec to find BoundedWindowAggExec | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 166 | // Step 4: Verify col_idx references a supported window function output column | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 201 | // Step 5: Validate PARTITION BY / ORDER BY and collect sort keys from the window expr | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 211 | // Step 6: Build PartitionedTopKExec from the window's partition/order keys | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 245 | // Step 7: Rebuild window with PartitionedTopKExec as its child | COMMENT |
| LOW⚡ | datafusion/physical-optimizer/src/window_topn.rs | 250 | // Step 8: Rebuild intermediate nodes (ProjectionExec/RepartitionExec) | COMMENT |
| LOW | …physical-optimizer/src/limited_distinct_aggregation.rs | 98 | // Step 1: Identify the plan shape, | COMMENT |
| LOW | …physical-optimizer/src/limited_distinct_aggregation.rs | 129 | // Step 2: Verify partial/final aggregate is compatible, then apply optimization | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 448 | // Step 1: drain a batch from the active reader if any. | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 467 | // Step 2: when the decoder is sitting on a row-group boundary, | COMMENT |
| LOW | datafusion/datasource-parquet/src/push_decoder.rs | 511 | // Step 3: drive the decoder. | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 122 | // Step 1: Check for NULL mask in incoming args | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 133 | // Step 2: Delegate to DataFusion's concat | COMMENT |
| LOW | datafusion/spark/src/function/string/concat.rs | 145 | // Step 3: Apply NULL mask to result | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 87 | // Step 1: Create sample Parquet data in memory | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 94 | // Step 2: Set up session with custom adapter | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 120 | // Step 3: Create physical plan with filter | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 129 | // Step 4: Serialize with our custom codec | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 140 | // Step 5: Deserialize with our custom codec | COMMENT |
| LOW⚡ | …s/examples/custom_data_source/adapter_serialization.rs | 150 | // Step 6: Execute and compare results | COMMENT |
| LOW | benchmarks/bench.sh | 1581 | # Step 1: Write a single sorted file with small (100K-row) RGs | COMMENT |
| LOW | benchmarks/bench.sh | 1594 | # Step 2: Redistribute RGs into 3 files with scrambled RG order. | COMMENT |
| LOW | benchmarks/bench.sh | 1644 | # Step 1: Write a single sorted file with small (100K-row) RGs | COMMENT |
| LOW | benchmarks/bench.sh | 1657 | # Step 2: Redistribute into 5 files with scrambled RG order. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …afusion/physical-plan/src/joins/symmetric_hash_join.rs | 124 | /// Prune build side when the new RecordBatch comes to the probe side. We utilize interval arithmetic | COMMENT |
| MEDIUM | datafusion/physical-plan/src/joins/stream_join_utils.rs | 400 | /// we can utilize sorting information while traversing the filter expression | COMMENT |
| MEDIUM | datafusion/physical-plan/src/windows/mod.rs | 485 | // we might be able to leverage this property. | COMMENT |
| MEDIUM | datafusion/physical-plan/src/windows/mod.rs | 489 | // monotonicity, we can utilize it to introduce new orderings. | COMMENT |
| MEDIUM | datafusion/physical-plan/src/windows/mod.rs | 515 | // utilize set-monotonicity since the set shrinks as the frame | COMMENT |
| MEDIUM | datafusion/physical-plan/src/sorts/partitioned_topk.rs | 185 | /// cases, the sort-based plan is more robust. Therefore, this optimization | COMMENT |
| MEDIUM | datafusion/physical-expr-common/src/physical_expr.rs | 270 | /// Expressions (should) implement this function and utilize the independence | COMMENT |
| MEDIUM | datafusion/core/tests/parquet/page_pruning.rs | 1311 | // to be robust against future changes in defaults as requested by reviewers. | COMMENT |
| MEDIUM | datafusion/core/src/lib.rs | 560 | //! If your system does not fully utilize either the CPU or network bandwidth | COMMENT |
| MEDIUM | datafusion/expr/src/udwf.rs | 233 | /// implemented directly. Instead, implement [`Eq`] and [`Hash`] and leverage the | COMMENT |
| MEDIUM | datafusion/expr/src/type_coercion/functions.rs | 828 | // f64 is chosen since most of the math functions utilize Signature::numeric, | COMMENT |
| MEDIUM | datafusion/common/src/config.rs | 1656 | /// repartitioning to increase parallelism to leverage more CPU cores | COMMENT |
| MEDIUM | datafusion/physical-optimizer/src/join_selection.rs | 19 | //! accommodate infinite sources and utilize statistical information (if there | COMMENT |
| MEDIUM | …imizer/src/ensure_requirements/enforce_distribution.rs | 944 | /// i.e. the operator can actually utilize parallelism. | COMMENT |
| MEDIUM | datafusion/ffi/src/tests/utils.rs | 54 | /// actual output directory and is robust to the active profile and a custom | COMMENT |
| MEDIUM | datafusion/functions/src/regex/regexpreplace.rs | 609 | // leverage it in order to determine whether the scalarity | COMMENT |
| MEDIUM | datafusion/sql/src/planner.rs | 244 | /// Struct to store the states used by the Planner. The Planner will leverage the states | COMMENT |
| MEDIUM | datafusion-examples/examples/query_planning/expr_api.rs | 362 | /// This function shows how to think about and leverage the analysis API | COMMENT |
| MEDIUM | datafusion-examples/examples/dataframe/cache_factory.rs | 45 | /// This example demonstrates how to leverage [CacheFactory] to implement custom caching strategies for dataframes in Da | COMMENT |
| MEDIUM | …xamples/examples/builtin_functions/function_factory.rs | 37 | /// This example shows how to utilize [FunctionFactory] to implement simple | COMMENT |
| MEDIUM | benchmarks/bench.sh | 823 | # Path of the results JSON the Criterion SQL harness ($SQL_CARGO_COMMAND) | COMMENT |
| MEDIUM | benchmarks/bench.sh | 948 | # its native DATAFUSION_* config before invoking bench.sh -- the harness reads | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ci/scripts/check_asf_yaml_status_checks.py | 122 | # Check if pull_request trigger has path filters | COMMENT |
| LOW | ci/scripts/check_asf_yaml_status_checks.py | 250 | # Check if ALL workflows providing this job have path filters | COMMENT |
| LOW | datafusion/optimizer/src/common_subexpr_eliminate.rs | 446 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/udwf.rs | 407 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/udaf.rs | 847 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/higher_order_function.rs | 740 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/higher_order_function.rs | 868 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/udf.rs | 1020 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/utils.rs | 1462 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/utils.rs | 1489 | /// # Return value | COMMENT |
| LOW | datafusion/expr/src/logical_plan/plan.rs | 643 | /// # Return value | COMMENT |
| LOW | benchmarks/bench.sh | 807 | # Check if `web_site.parquet` exists in the TPCDS data directory to verify data presence | COMMENT |
| LOW | benchmarks/bench.sh | 1070 | # Check if TPCDS data directory and representative file exists | COMMENT |
| LOW | benchmarks/bench.sh | 1233 | # Check if required files exist | COMMENT |
| LOW | benchmarks/queries/clickbench/update_queries.sh | 47 | # Check if download was successful | COMMENT |
| LOW | benchmarks/queries/clickbench/update_queries.sh | 61 | # Read the file line by line and create individual query files | COMMENT |
| LOW | benchmarks/queries/clickbench/update_queries.sh | 74 | # Increment counter | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 40 | # Check if release number is provided | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 60 | # Check if .asf.yaml exists | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 67 | # Check if the branch exists in the official Apache DataFusion repository | COMMENT |
| LOW⚡ | dev/release/add-branch-protection.sh | 80 | # Check if branch protection already exists for this release | COMMENT |
| LOW⚡ | dev/release/add-branch-protection.sh | 89 | # Read the file and insert the new branch protection block | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 115 | # Check if this belongs to the last branch block by looking ahead | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 137 | # Check if awk succeeded | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | pre-commit.sh | 20 | # This file is git pre-commit hook. | COMMENT |
| MEDIUM | ci/scripts/utils/tool_versions.sh | 20 | # This file defines centralized tool versions used by CI and development scripts. | COMMENT |
| MEDIUM⚡ | datafusion/expr/src/logical_plan/plan.rs | 99 | /// ## Creating a LogicalPlan from SQL: | COMMENT |
| MEDIUM⚡ | datafusion/expr/src/logical_plan/plan.rs | 103 | /// ## Creating a LogicalPlan from the DataFrame API: | COMMENT |
| MEDIUM⚡ | datafusion/expr/src/logical_plan/plan.rs | 107 | /// ## Creating a LogicalPlan programmatically: | COMMENT |
| MEDIUM | docs/scripts/update_committer_list.py | 163 | # Create a map of existing committers by apache id | COMMENT |
| MEDIUM | benchmarks/bench.sh | 67 | # Create the datasets for all benchmarks in $DATA_DIR | COMMENT |
| MEDIUM⚡ | dev/release/add-branch-protection.sh | 86 | # Create a temporary file | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docs/scripts/update_committer_list.py | 61 | except Exception as e: | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 62 | print(f"Error fetching ASF roster: {e}") | CODE |
| LOW | docs/scripts/update_committer_list.py | 88 | except Exception as e: | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 89 | print(f"Error fetching ASF people: {e}") | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 151 | print(f"Error: File {file_path} not found") | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 217 | print("Error: Could not find table markers in file") | CODE |
| LOW | docs/scripts/update_committer_list.py | 235 | except Exception as e: | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 236 | print(f"Error writing file: {e}") | CODE |
| MEDIUM | docs/scripts/update_committer_list.py | 251 | print(f"Error: Governance file not found at {governance_file}") | CODE |
| LOW | .ai/skills/audit-datafusion-spark-expression/SKILL.md | 631 | except Exception as exc: # noqa: BLE001 - any failure is a result here | CODE |
| MEDIUM | .ai/skills/audit-datafusion-spark-expression/SKILL.md | 628 | def run_query(spark, sql): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | datafusion/core/tests/parquet/page_pruning.rs | 1311 | // to be robust against future changes in defaults as requested by reviewers. | COMMENT |
| HIGH | datafusion/common/src/scalar/consts.rs | 84 | // This code was generated by codex and frankly I don't know how it works, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …ples/examples/custom_data_source/custom_file_format.rs | 94 | /// for demonstration purposes. | COMMENT |
| MEDIUM | …ples/examples/custom_data_source/custom_file_format.rs | 175 | /// for demonstration purposes. | COMMENT |
| MEDIUM | datafusion-examples/examples/udf/advanced_udf.rs | 110 | // For demonstration purposes we also implement the scalar / scalar | COMMENT |
| MEDIUM | datafusion-examples/examples/udf/advanced_udf.rs | 237 | // we will return an error for demonstration purposes | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | ci/scripts/check_asf_yaml_status_checks.py | 158 | def check_post_merge_conditions(workflow): | CODE |
| LOW | docs/rustdoc_trim.py | 25 | def remove_hashtag_lines_in_rust_blocks(markdown_content): | CODE |
| LOW | dev/update_arrow_deps.py | 57 | def update_commit_dependencies(dependencies, new_sha): | CODE |
| LOW | dev/update_arrow_deps.py | 81 | def update_version_cargo_toml(cargo_toml, new_version): | CODE |
| LOW | dev/update_datafusion_versions.py | 78 | def update_datafusion_version(cargo_toml: str, new_version: str): | CODE |
| LOW | dev/update_datafusion_versions.py | 91 | def update_downstream_versions(cargo_toml: str, new_version: str): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docs/scripts/update_committer_list.py | 24 | CODE | |
| LOW | docs/scripts/update_committer_list.py | 28 | CODE | |
| LOW | docs/scripts/update_committer_list.py | 28 | CODE | |
| LOW | benchmarks/compile_profile.py | 29 | CODE | |
| LOW | benchmarks/compare.py | 19 | CODE | |
| LOW | benchmarks/lineprotocol.py | 78 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | benchmarks/bench.sh | 21 | # etc and orchestrates gathering data and run the benchmark binary in | COMMENT |
| MEDIUM | benchmarks/queries/clickbench/update_queries.sh | 21 | # etc and orchestrates gathering data and run the benchmark binary in | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | datafusion/catalog-listing/src/helpers.rs | 601 | "John Doe", | CODE |
| LOW | datafusion/catalog-listing/src/helpers.rs | 875 | evaluate_partition_prefix(partitions, &[col("a").eq(lit("John Doe"))]), | CODE |
| LOW | datafusion/catalog-listing/src/helpers.rs | 882 | &[col("a").eq(lit("foo")).and(col("b").eq(lit("John Doe")))], | CODE |
| LOW | benchmarks/src/sql_benchmark_suite.rs | 644 | "placeholder", | CODE |
| LOW | dev/release/README.md | 68 | (gpg --list-sigs "John Doe" && gpg --armor --export "John Doe") >> KEYS | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | datafusion/physical-expr/src/async_scalar_function.rs | 216 | // TODO: implement this for scalar value input | COMMENT |
| LOW | datafusion/expr-common/src/signature.rs | 1130 | // TODO: implement for nested types | COMMENT |
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 4465 | // TODO: Add tests for non-exponential boundary aligned intervals too. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | datafusion/expr-common/src/interval_arithmetic.rs | 1387 | /// Example usage: | COMMENT |
| LOW | datafusion/common/src/metadata.rs | 212 | /// # Example usage | COMMENT |
| LOW | dev/release/add-branch-protection.sh | 27 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docs/scripts/update_committer_list.py | 96 | CODE | |
| LOW | dev/update_arrow_deps.py | 81 | CODE | |
| LOW | dev/release/download-python-wheels.py | 35 | CODE | |
| LOW | dev/release/generate-changelog.py | 36 | CODE |