Official Rust implementation of Apache Arrow
This report summarizes scanner evidence for apache/arrow-rs, a Rust project with 3,635 GitHub stars. SynthScan examined 535,559 lines of code across 894 source files, recording 3314 pattern matches distributed across 13 syntactic categories. The legacy adjusted pattern signal is 7.7 (Moderate pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 3030 finding(s).
Are imports declared and package/API names verified? 23 finding(s).
Are wrappers, guards, and repeated structures necessary? 280 finding(s).
Which changes need focused human review? 3314 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 3314 distinct pattern matches across 13 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .asf.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | typos.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | rustfmt.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | rust-toolchain.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/benches/variant_kernels.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/benches/variant_kernels.rs | 901 | /// | COMMENT |
| LOW | parquet-variant-compute/src/shred_variant.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/shred_variant.rs | 41 | /// ```text | COMMENT |
| LOW | parquet-variant-compute/src/shred_variant.rs | 541 | /// | COMMENT |
| LOW | parquet-variant-compute/src/shred_variant.rs | 561 | /// // pass a FieldRef directly | COMMENT |
| LOW | parquet-variant-compute/src/shred_variant.rs | 581 | root: VariantSchemaNode, | COMMENT |
| LOW | parquet-variant-compute/src/variant_to_arrow.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/lib.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/lib.rs | 21 | //! - [`VariantArray`] : Represents an array of `Variant` values. | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 101 | /// | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 421 | /// Returns an array with the specified path extracted from the variant values. | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 441 | /// boolean and numeric variants (integers, floating-point, and decimals). | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 1881 | /// null | COMMENT |
| LOW | parquet-variant-compute/src/variant_get.rs | 3081 | } | COMMENT |
| LOW | parquet-variant-compute/src/unshred_variant.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/unshred_variant.rs | 41 | use std::marker::PhantomData; | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 181 | /// | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 201 | /// # use parquet_variant::Variant; | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 221 | /// is stored on a [`Field`]. Thus, you must have access to the [`Schema`] or | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 241 | /// assert!(!schema.field(0).has_valid_extension_type::<VariantType>()); | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 261 | /// // call VariantArray::field to get the correct Field | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 281 | /// // Add extension metadata to the field using `VariantType` | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 301 | /// # use parquet_variant::Variant; | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 321 | shredding_state: ShreddingState, | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 461 | /// * the index is out of bounds, | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 481 | /// # Panics | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 641 | Self::from_iter(iter.into_iter().map(Some)) | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 721 | COMMENT | |
| LOW | parquet-variant-compute/src/variant_array.rs | 741 | /// a: SHREDDED_VARIANT_FIELD { | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 761 | /// variant value (which could be `Variant::Null`). | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 901 | } | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 921 | /// | COMMENT |
| LOW | parquet-variant-compute/src/variant_array.rs | 941 | pub struct ShreddingState { | COMMENT |
| LOW | parquet-variant-compute/src/to_json.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/arrow_to_variant.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/arrow_to_variant.rs | 281 | run_ends.data_type() | COMMENT |
| LOW | parquet-variant-compute/src/arrow_to_variant.rs | 301 | // us to "use" captured tokens without emitting them: | COMMENT |
| LOW | parquet-variant-compute/src/cast_to_variant.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/cast_to_variant.rs | 21 | use arrow::compute::CastOptions; | COMMENT |
| LOW | parquet-variant-compute/src/cast_to_variant.rs | 41 | /// let result = cast_to_variant(&input).unwrap(); | COMMENT |
| LOW | parquet-variant-compute/src/from_json.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 41 | /// | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 61 | /// // append variant values | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 81 | /// // row 1 is null | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 261 | /// The builder produces a [`BinaryViewArray`] that can be combined with existing | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 321 | self.nulls.append_null(); | COMMENT |
| LOW | parquet-variant-compute/src/variant_array_builder.rs | 341 | pub fn append_value(&mut self, value: Variant<'_, '_>) { | COMMENT |
| LOW | parquet-variant-compute/src/type_conversion.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | arrow-schema/Cargo.toml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | arrow-schema/benches/ffi.rs | 1 | // Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| 2871 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | arrow-data/src/data.rs | 189 | /// │ ] │ └───────┘ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 193 | /// └───────────────────┘ actual data values | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 197 | /// ┌───────────────────┐ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 202 | /// └───────────────────┘ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 497 | /// ◀───────────▶◀────────────────▶ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 498 | /// ┌─────┬─────┬─────┬─────┬─────┬─────┐ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 500 | /// └─────┴─────┴─────┴─────┴─────┴─────┘ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 519 | /// ◀───────────▶◀────────────────▶ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 520 | /// child offset: 1 ◀─────▶ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 521 | /// ┌─────┬─────┬─────┬─────┬─────┬─────┬─────┐ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 523 | /// ├─────┼─────┼─────┼─────┼─────┼─────┼─────┤ | COMMENT |
| MEDIUM⚡ | arrow-data/src/data.rs | 525 | /// └─────┴─────┴─────┴─────┴─────┴─────┴─────┘ | COMMENT |
| MEDIUM | arrow-data/src/data.rs | 178 | /// ┌───────────────────┐ start of ┌───────┐ Different | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 33 | /// ┌─────────────────┐ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 35 | /// ├─────────────────┤ ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 37 | /// ├─────────────────┤ union_extract(values, 'A') ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 38 | /// │ B='t' │ ────────────────────────────▶ │ NULL │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 39 | /// ├─────────────────┤ ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 41 | /// ├─────────────────┤ ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/union_extract.rs | 43 | /// └─────────────────┘ └─────────────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 122 | /// ┌────────────────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 125 | /// └────────────────────┘ ┌────────────────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 127 | /// ┌────────────────────┐ Coalesce │ │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 133 | /// └────────────────────┘ │ │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 135 | /// ┌────────────────────┐ │ │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 138 | /// │ num_rows = 100 │ └────────────────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/coalesce.rs | 140 | /// └────────────────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 93 | /// ┌───────────┐ ┌─────────┐ ┌─────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 94 | /// │┌─────────┐│ │ None │ │ NULL │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 95 | /// ││ A ││ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 96 | /// │└─────────┘│ │ 1 │ │ B │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 97 | /// │┌─────────┐│ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 99 | /// │└─────────┘│ ├─────────┤ ─────────────────────────▶ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 100 | /// │┌─────────┐│ │ None │ │ NULL │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 101 | /// ││ C ││ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 102 | /// │├─────────┤│ │ 2 │ │ C │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 103 | /// ││ D ││ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 104 | /// │└─────────┘│ │ 2 │ │ D │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 105 | /// └───────────┘ └─────────┘ └─────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 197 | /// ┌─────────┐ mask | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 198 | /// │ A │ ┌─────────┐ ┌─────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 199 | /// ├─────────┤ │ true │ │ A │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 200 | /// │ C │ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 201 | /// ├─────────┤ │ true │ │ C │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 202 | /// │ NULL │ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 203 | /// ├─────────┤ │ false │ merge(mask, truthy, falsy) │ B │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 204 | /// │ D │ ├─────────┤ ─────────────────────────▶ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 205 | /// └─────────┘ │ true │ │ NULL │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 206 | /// falsy ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 207 | /// ┌─────────┐ │ false │ │ E │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 208 | /// │ B │ ├─────────┤ ├─────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 209 | /// ├─────────┤ │ true │ │ D │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 210 | /// │ E │ └─────────┘ └─────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/merge.rs | 211 | /// └─────────┘ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 57 | /// ┌─────────────────┐ ┌─────────┐ ┌─────────────────┐ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 59 | /// ├─────────────────┤ ├─────────┤ [values0, values1], ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 61 | /// └─────────────────┘ ├─────────┤ ) ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 62 | /// values array 0 │ (1, 1) │ ─────────────────────────▶ │ C │ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 63 | /// ├─────────┤ ├─────────────────┤ | COMMENT |
| MEDIUM⚡ | arrow-select/src/interleave.rs | 65 | /// └─────────┘ └─────────────────┘ | COMMENT |
| 201 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | parquet-variant-compute/src/variant_get.rs | 2205 | // Step 2: If field not in shredding schema, check value field | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 569 | // Step 1: Try unvalidated construction - should not panic | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 574 | // Step 2: Try validation | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 664 | // Step 1: Try unvalidated construction - should not panic | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 669 | // Step 2: Try validation | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 402 | // Step 1: push_batch([350]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 406 | // Step 2: push_batch([200]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 410 | // Step 3: push_batch([800]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 440 | // Step 1: push_batch([300]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 444 | // Step 2: push_batch([1200]) | COMMENT |
| LOW | arrow-select/src/coalesce.rs | 426 | // Step 4: push_batch([900]) | COMMENT |
| LOW | arrow-select/src/interleave.rs | 510 | // Step 1: compute output offsets and total child capacity | COMMENT |
| LOW | arrow-select/src/interleave.rs | 523 | // Step 2: build child values. | COMMENT |
| LOW | arrow-avro/src/reader/async_reader/builder.rs | 268 | // so we need to check if range.end == header_len to see if there's no data after the header | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 132 | // Step 1: Write a parquet file with page indexes | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 135 | // Step 2: Load metadata WITHOUT page indexes initially | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 147 | // Step 3: Create a custom provider and populate it selectively | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 159 | // Step 4: Install the custom provider into metadata | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 166 | // Step 5: Create ArrowReaderMetadata with the custom page index | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 173 | // Step 6: Read data with RowSelection that triggers page skipping | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 204 | // Step 7: Check statistics | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 235 | // Step 8: Verify correct results | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2466 | // Step 1: Peek and ensure dictionary page is correctly identified | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2470 | // Step 2: Call skip_next_page to skip the dictionary page | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2473 | // Step 3: Read the next data page after skipping the dictionary page | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2477 | // Step 4: Continue reading remaining data pages and verify correctness | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2488 | // Step 5: Check if all pages are read | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2492 | // Step 6: Verify the number of data pages read (should be 351 data pages) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | parquet-variant-compute/src/variant_get.rs | 2205 | // Step 2: If field not in shredding schema, check value field | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 569 | // Step 1: Try unvalidated construction - should not panic | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 574 | // Step 2: Try validation | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 664 | // Step 1: Try unvalidated construction - should not panic | COMMENT |
| LOW⚡ | parquet-variant/tests/variant_interop.rs | 669 | // Step 2: Try validation | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 402 | // Step 1: push_batch([350]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 406 | // Step 2: push_batch([200]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 410 | // Step 3: push_batch([800]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 440 | // Step 1: push_batch([300]) | COMMENT |
| LOW⚡ | arrow-select/src/coalesce.rs | 444 | // Step 2: push_batch([1200]) | COMMENT |
| LOW | arrow-select/src/coalesce.rs | 426 | // Step 4: push_batch([900]) | COMMENT |
| LOW | arrow-select/src/interleave.rs | 510 | // Step 1: compute output offsets and total child capacity | COMMENT |
| LOW | arrow-select/src/interleave.rs | 523 | // Step 2: build child values. | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 132 | // Step 1: Write a parquet file with page indexes | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 135 | // Step 2: Load metadata WITHOUT page indexes initially | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 147 | // Step 3: Create a custom provider and populate it selectively | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 159 | // Step 4: Install the custom provider into metadata | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 166 | // Step 5: Create ArrowReaderMetadata with the custom page index | COMMENT |
| LOW⚡ | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 173 | // Step 6: Read data with RowSelection that triggers page skipping | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 204 | // Step 7: Check statistics | COMMENT |
| LOW | …rquet/tests/arrow_reader/custom_page_index_provider.rs | 235 | // Step 8: Verify correct results | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2466 | // Step 1: Peek and ensure dictionary page is correctly identified | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2470 | // Step 2: Call skip_next_page to skip the dictionary page | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2473 | // Step 3: Read the next data page after skipping the dictionary page | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2477 | // Step 4: Continue reading remaining data pages and verify correctness | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2488 | // Step 5: Check if all pages are read | COMMENT |
| LOW⚡ | parquet/src/file/serialized_reader.rs | 2492 | // Step 6: Verify the number of data pages read (should be 351 data pages) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | arrow-arith/src/boolean.rs | 20 | //! These kernels can leverage SIMD if available on your system. Currently no runtime | COMMENT |
| MEDIUM | arrow-arith/src/arithmetic.rs | 20 | //! These kernels can leverage SIMD if available on your system. Currently no runtime | COMMENT |
| MEDIUM | arrow-ord/src/cmp.rs | 20 | //! These kernels can leverage SIMD if available on your system. Currently no runtime | COMMENT |
| MEDIUM | arrow-ord/src/comparison.rs | 20 | //! These kernels can leverage SIMD if available on your system. Currently no runtime | COMMENT |
| MEDIUM | arrow-ipc/src/writer.rs | 2432 | // but pruning unneeded data buffers is much more nuanced since it's complicated to prove that no views referenc | COMMENT |
| MEDIUM | arrow-avro/src/schema.rs | 867 | /// Note: Confluent wire format implementations should leverage this method. | COMMENT |
| MEDIUM | arrow-avro/src/schema.rs | 908 | /// method will return an error. Confluent wire format implementations should leverage the | COMMENT |
| MEDIUM | parquet/tests/arrow_writer/mod.rs | 360 | // (well under the ~16 MiB row group) to stay robust across platforms. | COMMENT |
| MEDIUM | parquet/src/data_type.rs | 346 | /// big hit on the CPU pipeline. Essentially the previous version stalls awaiting the result of | COMMENT |
| MEDIUM | parquet/src/lib.rs | 59 | //! to leverage the wide range of data transforms provided by the [arrow] crate, and by the | COMMENT |
| MEDIUM | parquet/src/file/page_index/index_reader.rs | 92 | // Try to read fast-path first. If that fails, fall back to slower but more robust | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | CONTRIBUTING.md | 332 | [guidance](https://www.apache.org/legal/generative-tooling.html) on AI-generated code for further | CODE |
| HIGH | parquet/src/file/writer.rs | 2199 | // Column "a" has both offset and column index, as requested | COMMENT |
| HIGH | parquet/src/file/metadata/push_decoder.rs | 48 | /// as requested as shown below. This minimizes the number of bytes read, but | COMMENT |
| HIGH | parquet/src/arrow/arrow_writer/mod.rs | 3441 | // Column "a" has both offset and column index, as requested | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | arrow/benches/csv_writer.rs | 37 | "Lorem ipsum dolor sit amet", | CODE |
| LOW | arrow/benches/csv_writer.rs | 37 | "Lorem ipsum dolor sit amet", | CODE |
| LOW | arrow/src/util/string_writer.rs | 42 | //! "Lorem ipsum dolor sit amet", | COMMENT |
| LOW | arrow/src/util/string_writer.rs | 42 | //! "Lorem ipsum dolor sit amet", | COMMENT |
| LOW | parquet-variant/src/builder.rs | 1677 | address.insert("street", "123 Main St"); | CODE |
| LOW | arrow-csv/src/writer.rs | 38 | //! "Lorem ipsum dolor sit amet", | COMMENT |
| LOW | arrow-csv/src/writer.rs | 38 | //! "Lorem ipsum dolor sit amet", | COMMENT |
| LOW⚡ | arrow-csv/src/writer.rs | 743 | Lorem ipsum dolor sit amet,123.564532,3,true,,00:20:34,cupcakes | CODE |
| LOW⚡ | arrow-csv/src/writer.rs | 743 | Lorem ipsum dolor sit amet,123.564532,3,true,,00:20:34,cupcakes | CODE |
| LOW⚡ | arrow-csv/src/writer.rs | 746 | Lorem ipsum dolor sit amet,123.564532,3,true,,00:20:34,cupcakes | CODE |
| LOW⚡ | arrow-csv/src/writer.rs | 746 | Lorem ipsum dolor sit amet,123.564532,3,true,,00:20:34,cupcakes | CODE |
| LOW | arrow-csv/src/writer.rs | 700 | "Lorem ipsum dolor sit amet", | CODE |
| LOW | arrow-csv/src/writer.rs | 700 | "Lorem ipsum dolor sit amet", | CODE |
| LOW | arrow-csv/src/writer.rs | 827 | "Lorem ipsum \ndolor sit amet", | CODE |
| LOW | arrow-csv/src/writer.rs | 827 | "Lorem ipsum \ndolor sit amet", | CODE |
| LOW | arrow-csv/src/writer.rs | 870 | "'Lorem ipsum \ndolor sit amet'|123.564532|3|true|12:20:34 AM\nconsectetur \"adipiscing\" elit|NULL|2|false| | CODE |
| LOW | arrow-csv/src/writer.rs | 870 | "'Lorem ipsum \ndolor sit amet'|123.564532|3|true|12:20:34 AM\nconsectetur \"adipiscing\" elit|NULL|2|false| | CODE |
| LOW | arrow-csv/src/writer.rs | 893 | "c1,c2,c3,c4,c6\n\"Lorem ipsum \ndolor sit amet\",123.564532,3,true,00:20:34\n\"consectetur $\"adipiscing$\" | CODE |
| LOW | arrow-csv/src/writer.rs | 893 | "c1,c2,c3,c4,c6\n\"Lorem ipsum \ndolor sit amet\",123.564532,3,true,00:20:34\n\"consectetur $\"adipiscing$\" | CODE |
| LOW | arrow-avro/src/reader/mod.rs | 7278 | "default": "lorem ipsum" | CODE |
| LOW | arrow-avro/src/reader/mod.rs | 7376 | Some(&"\"lorem ipsum\"".to_string()), | CODE |
| LOW | arrow-avro/src/reader/mod.rs | 7377 | "f3_0 should have \"lorem ipsum\" default value in metadata" | CODE |
| LOW | arrow-avro/src/reader/mod.rs | 7431 | assert_eq!(f3_0_array.value(i), "lorem ipsum"); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 188 | def test_type_roundtrip_pycapsule(pyarrow_type): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 208 | def test_field_roundtrip_pycapsule(pyarrow_type): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 220 | def test_field_metadata_roundtrip(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 247 | def test_primitive_python_pycapsule(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 343 | def test_fixed_len_binary_array(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 398 | def test_fixed_len_list_array(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 522 | def test_empty_recordbatch_with_row_count(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 570 | def test_record_batch_reader_pycapsule(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 598 | def test_record_batch_reader_error(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 620 | def test_record_batch_pycapsule(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 709 | def test_table_error_inconsistent_schema(): | CODE |
| LOW | arrow-pyarrow-integration-testing/tests/test_sql.py | 723 | def test_reject_other_classes(): | CODE |
| LOW | .github/ci/scripts/check-ci-config.py | 231 | def test_current_configuration(self): | CODE |
| LOW | .github/ci/scripts/check-ci-config.py | 235 | def test_configuration_regressions(self): | CODE |
| LOW | parquet/pytest/test_parquet_integration.py | 52 | def create_spark_df_with_arrays(n): | CODE |
| LOW | parquet/pytest/test_parquet_integration.py | 73 | def create_data_and_pandas_df(n): | CODE |
| LOW | parquet/pytest/test_parquet_integration.py | 104 | def get_show_filter_cli_output(output_dir, col_name, test_values): | CODE |
| LOW | parquet/pytest/test_parquet_integration.py | 133 | def test_pyspark_bloom_filter(self, n): | CODE |
| LOW | parquet/pytest/test_parquet_integration.py | 139 | def test_bloom_filter_round_trip(self, n): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | arrow-array/src/array/union_array.rs | 46 | /// ## Create a dense UnionArray `[1, 3.2, 34]` | COMMENT |
| MEDIUM | arrow-array/src/array/union_array.rs | 85 | /// ## Create a sparse UnionArray `[1, 3.2, 34]` | COMMENT |
| MEDIUM | arrow-pyarrow-integration-testing/tests/test_sql.py | 529 | # Create an empty schema with no fields | COMMENT |
| MEDIUM | arrow-flight/examples/data/gen_certs.sh | 17 | # Create a self-signed root CA | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …chema/src/extension/canonical/timestamp_with_offset.rs | 48 | /// It's worth noting that the data source needs to resolve timezone strings such as `UTC` or | COMMENT |
| MEDIUM | arrow-row/src/lib.rs | 1179 | /// // into convert_rows, this is done for demonstration purposes only | COMMENT |
| MEDIUM | parquet/src/arrow/arrow_writer/mod.rs | 1032 | /// // Note: This is for demonstration purposes, a thread-pool e.g. rayon or tokio, would be better. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | arrow-array/src/array/list_array.rs | 1209 | // test scaffold | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | arrow-array/src/record_batch.rs | 738 | // TODO: implement `TryFrom` trait, once | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .github/ci/scripts/check-ci-config.py | 80 | CODE |