Repository Analysis

lance-format/lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

3.6 Likely human-written View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of lance-format/lance, a Rust project with 6,788 GitHub stars. SynthScan v2.0 examined 770,268 lines of code across 1414 source files, recording 2390 pattern matches distributed across 21 syntactic categories. The overall adjusted score of 3.6 places this repository in the Likely human-written band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

3.6
Adjusted Score
3.6
Raw Score
100%
Time Factor
2026-07-14
Last Push
6.8K
Stars
Rust
Language
770.3K
Lines of Code
1.4K
Files
2.4K
Pattern Hits
2026-07-14
Scan Date
0.02
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 6HIGH 24MEDIUM 141LOW 2219

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 2390 distinct pattern matches across 21 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Over-Commented Block1044 hits · 1010 pts
SeverityFileLineSnippetContext
LOWdeny.toml1# This template contains all of the possible sections and their default valuesCOMMENT
LOWdeny.toml21# `target_family = "unix"` configuration, that only having windows targets inCOMMENT
LOWdeny.toml41# executed, this field can be used to prune crates from the graph, removing themCOMMENT
LOWdeny.toml61# When outputting inclusion graphs in diagnostics that include features, thisCOMMENT
LOWdeny.toml81 #"a-crate-that-is-yanked@0.1.1", # you can also ignore yanked crate versions if you wishCOMMENT
LOWdeny.toml121# canonical license text of a valid SPDX license file.COMMENT
LOWdeny.toml141# One or more files in the crate's source used as the "source of truth" forCOMMENT
LOWdeny.toml161 #"https://sekretz.com/registryCOMMENT
LOWdeny.toml181workspace-default-features = "allow"COMMENT
LOWdeny.toml201# Each entry the name of a crate and a version range. If version isCOMMENT
LOWdeny.toml221#exact = trueCOMMENT
LOWprotos/license_header.txt1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/license_header.txt1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/python/tests/test_optimize.py161 return tblCOMMENT
LOWpython/python/tests/test_dataset.py3041 .when_not_matched_insert_all()COMMENT
LOWpython/python/tests/test_dataset.py3721COMMENT
LOWpython/python/tests/compat/__init__.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/python/lance/sampler.py501 yield from shard_scanCOMMENT
LOWpython/python/lance/_arrow/__init__.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/python/ci_benchmarks/__init__.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOW…hon/python/ci_benchmarks/benchmarks/test_fts_search.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/python/ci_benchmarks/datagen/__init__.py1# SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/src/arrow.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/error.rs1// Copyright 2024 Lance Developers.COMMENT
LOWpython/src/lib.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/lib.rs341 register_datagen(py, m)?;COMMENT
LOWpython/src/lib.rs361/// "target_arch": str, # e.g. "x86_64", "aarch64", "loongarch64"COMMENT
LOWpython/src/scanner.rs1// Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpython/src/tracing.rs1// Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpython/src/otel.rs1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWpython/src/otel.rs21//! OpenTelemetry collects on its own schedule and invokes observable-instrumentCOMMENT
LOWpython/src/executor.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/namespace.rs121 pub(crate) inner: Arc<DirectoryNamespace>,COMMENT
LOWpython/src/namespace.rs821/// Python wrapper for RestNamespaceCOMMENT
LOWpython/src/indices.rs301 codebook.to_pyarrow(py)COMMENT
LOWpython/src/indices.rs321/// # Mint one model and broadcast `model` to every worker.COMMENT
LOWpython/src/reader.rs1// Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpython/src/dataset.rs3641 /// This function loads a specific partition from every segment of an IVF_FLATCOMMENT
LOWpython/src/dataset.rs3701 }COMMENT
LOWpython/src/dataset.rs3761COMMENT
LOWpython/src/dataset.rs3801COMMENT
LOWpython/src/dataset.rs3821 /// num_rows : intCOMMENT
LOWpython/src/utils.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/fragment.rs1// Copyright 2024 Lance Developers.COMMENT
LOWpython/src/file.rs1// Copyright 2024 Lance Developers.COMMENT
LOWpython/src/file.rs701 .awaitCOMMENT
LOWpython/src/dataset/commit.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/dataset/cleanup.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/dataset/optimize.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/dataset/optimize.rs181 ///COMMENT
LOWpython/src/dataset/optimize.rs301 errCOMMENT
LOWpython/src/dataset/optimize.rs461}COMMENT
LOWpython/src/dataset/optimize.rs481 /// ----------COMMENT
LOWpython/src/dataset/optimize.rs501 let mut new_ds = dataset.ds.as_ref().clone();COMMENT
LOWpython/src/dataset/optimize.rs541 }COMMENT
LOWpython/src/dataset/blob.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/dataset/stats.rs1// Copyright 2023 Lance Developers.COMMENT
LOWpython/src/dataset/io_stats.rs1// SPDX-License-Identifier: Apache-2.0COMMENT
LOWci/create_release_branch.sh1#!/bin/bashCOMMENT
LOWci/release_common.sh41# Args: MAJOR MINOR PATCH [TAG_PREFIX]COMMENT
984 more matches not shown…
Hyper-Verbose Identifiers711 hits · 546 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_table_ops.py33def test_index_after_replacement(tmp_path: str):CODE
LOWpython/python/tests/test_table_ops.py70def test_replacement_after_index(tmp_path: str):CODE
LOWpython/python/tests/test_table_ops.py111def test_data_file_create_basic(tmp_path: str):CODE
LOWpython/python/tests/test_table_ops.py134def test_data_file_create_subset_columns(tmp_path: str):CODE
LOWpython/python/tests/test_table_ops.py158def test_data_file_create_end_to_end(tmp_path: str):CODE
LOWpython/python/tests/test_table_ops.py188def test_data_file_create_unknown_column(tmp_path: str):CODE
LOWpython/python/tests/test_coerce_query_vector.py16 def test_string_raises_typeerror(self):CODE
LOWpython/python/tests/test_coerce_query_vector.py20 def test_integer_raises_typeerror(self):CODE
LOWpython/python/tests/test_coerce_query_vector.py26 def test_object_raises_typeerror(self):CODE
LOWpython/python/tests/test_coerce_query_vector.py37 def test_none_raises_typeerror(self):CODE
LOWpython/python/tests/test_coerce_query_vector.py67 def test_pa_int_array_cast_to_float(self):CODE
LOWpython/python/tests/test_ivf_centroids.py8def test_ivf_centroids_exposed(tmp_path):CODE
LOWpython/python/tests/conftest.py106def pytest_collection_modifyitems(config, items):CODE
LOWpython/python/tests/test_namespace_integration.py204def create_tracking_namespace(CODE
LOWpython/python/tests/test_namespace_integration.py274def test_namespace_open_dataset(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py324def test_namespace_with_refresh(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py379def test_namespace_append_through_namespace(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py436def test_namespace_write_create_mode(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py470def test_namespace_write_append_mode(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py523def test_namespace_write_overwrite_mode(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py578def test_namespace_managed_branches(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py659def test_namespace_distributed_write(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py754def test_file_writer_with_namespace_client(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py867def test_file_reader_with_namespace_client(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_namespace_integration.py973def test_file_session_with_namespace_client(s3_bucket: str, use_custom: bool):CODE
LOWpython/python/tests/test_multi_base.py54 def test_multi_base_create_and_read(self):CODE
LOWpython/python/tests/test_multi_base.py85 def test_write_target_all_bases(self):CODE
LOWpython/python/tests/test_multi_base.py105 def test_base_scoped_storage_options(self):CODE
LOWpython/python/tests/test_multi_base.py139 def test_multi_base_append_mode(self):CODE
LOWpython/python/tests/test_multi_base.py177 def test_multi_base_overwrite_mode_inherits_bases(self):CODE
LOWpython/python/tests/test_multi_base.py222 def test_multi_base_overwrite_mode_primary_path_default(self):CODE
LOWpython/python/tests/test_multi_base.py291 def test_multi_base_append_mode_primary_path_default(self):CODE
LOWpython/python/tests/test_multi_base.py359 def test_multi_base_is_dataset_root_flag(self):CODE
LOWpython/python/tests/test_multi_base.py404 def test_multi_base_target_by_path_uri(self):CODE
LOWpython/python/tests/test_multi_base.py517 def test_fragment_distribution(self):CODE
LOWpython/python/tests/test_multi_base.py687 def test_add_bases_persistence(self):CODE
LOWpython/python/tests/test_multi_base.py723 def test_add_bases_duplicate_name_error(self):CODE
LOWpython/python/tests/test_multi_base.py753 def test_add_bases_multiple_rounds(self):CODE
LOWpython/python/tests/test_multi_base.py790 def test_add_bases_empty_list(self):CODE
LOWpython/python/tests/test_multi_base.py844 def test_add_bases_verify_base_paths(self):CODE
LOWpython/python/tests/test_multi_base.py877 def test_add_bases_large_data_distribution(self):CODE
LOWpython/python/tests/test_multi_base.py966 def test_add_bases_with_transaction_properties(self):CODE
LOWpython/python/tests/test_multi_base.py1049 def test_write_fragments_with_target_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1112 def test_write_fragments_with_base_store_params(self):CODE
LOWpython/python/tests/test_multi_base.py1148 def test_write_fragments_transaction_with_target_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1187 def test_write_fragments_overwrite_mode_with_target_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1249 def test_write_fragments_create_mode_with_initial_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1359 def test_data_replacement_new_column_into_base(self):CODE
LOWpython/python/tests/test_multi_base.py1396 def test_data_replacement_replace_existing_file_in_base(self):CODE
LOWpython/python/tests/test_multi_base.py1472 def test_merge_insert_without_target_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1505 def test_merge_insert_with_target_bases(self):CODE
LOWpython/python/tests/test_multi_base.py1544 def test_merge_insert_with_unknown_target_base(self):CODE
LOWpython/python/tests/test_multi_base.py1558 def test_merge_insert_target_primary_via_uri(self):CODE
LOWpython/python/tests/test_multi_base.py1577 def test_merge_insert_target_all_bases(self):CODE
LOWpython/python/tests/test_delta.py9def test_delta_get_inserted_rows():CODE
LOWpython/python/tests/test_delta.py41def test_delta_get_updated_rows():CODE
LOWpython/python/tests/test_delta.py82def test_delta_with_explicit_version_range():CODE
LOWpython/python/tests/test_delta.py114def test_delta_validation_errors():CODE
LOWpython/python/tests/test_filter.py231def test_negative_expressions(tmp_path: Path):CODE
LOWpython/python/tests/test_filter.py326def test_filter_on_column_beside_struct_with_extension_type(tmp_path):CODE
651 more matches not shown…
Decorative Section Separators67 hits · 256 pts
SeverityFileLineSnippetContext
MEDIUMpython/python/tests/test_count_pushdown.py40# --------------------------------------------------------------------------COMMENT
MEDIUMpython/python/tests/test_count_pushdown.py42# --------------------------------------------------------------------------COMMENT
MEDIUMpython/python/tests/test_count_pushdown.py83# --------------------------------------------------------------------------COMMENT
MEDIUMpython/python/tests/test_count_pushdown.py85# --------------------------------------------------------------------------COMMENT
MEDIUMpython/python/tests/test_vector_index.py2474# =============================================================================COMMENT
MEDIUMpython/python/tests/test_vector_index.py2476# =============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3034# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3036# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3430# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3432# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3593# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3595# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3863# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py3865# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py4003# ============================================================================COMMENT
MEDIUMpython/python/tests/test_scalar_index.py4005# ============================================================================COMMENT
MEDIUMpython/python/lance/vector.py755# =============================================================================COMMENT
MEDIUMpython/python/lance/vector.py757# =============================================================================COMMENT
MEDIUMpython/python/lance/mem_wal.py53# ---------------------------------------------------------------------------COMMENT
MEDIUMpython/python/lance/mem_wal.py55# ---------------------------------------------------------------------------COMMENT
MEDIUMpython/python/lance/namespace.py127# =============================================================================COMMENT
MEDIUMpython/python/lance/namespace.py129# =============================================================================COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py36# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py38# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py52# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py54# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py68# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py70# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py90# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/python/ci_benchmarks/benchmarks/test_count_rows.py92# ---------------------------------------------------------------------------COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs117//! Requests ┌─────────────────┐COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs119//! ┌──────────► I/O Service ├─────► Enough I/O ◄─┐COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs121//! │ └─────────────────┘ │3 │COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs124//! ┌─────────────────────┴─┐ ┌─────────▼───────┴┐COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs127//! │ Scheduler ├─────────────────────────────►│ Stream ◄─────COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs129//! └─────▲─────────────┬───┘ └─────────┬────────┘COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs132//! └─────────────┘ ┌────────┴────────┐COMMENT
MEDIUMrust/lance-encoding/src/decoder.rs137//! per logical page batch) └─────────────────┘COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6849 // ── Step 3: concurrent DELETE commits at V=2 ─────────────────────────────COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6854 // ── Step 4: the Spark driver opens a *fresh* dataset (latest = V=2) ──────COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6862 // ── Step 5: commit_compaction with the stale results ─────────────────────COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6871 // ── Step 6: assert correct behaviour ─────────────────────────────────────COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6821 // ── Step 1: plan compaction at version V=1 ───────────────────────────────COMMENT
MEDIUMrust/lance/src/dataset/optimize.rs6829 // ── Step 2: execute tasks (simulating distributed executors at V=1) ──────COMMENT
MEDIUMrust/lance/src/dataset/mem_wal/memtable/batch_store.rs37//! ─────────────────────────────────► synchronizes-withCOMMENT
MEDIUMrust/lance/src/dataset/mem_wal/scanner/flushed_cache.rs16//! cache.is_some() ──────┤────── cache.is_none()COMMENT
MEDIUMrust/lance-namespace-impls/examples/manifest_bench.rs197// ──────────────────── seed-large mode ────────────────────COMMENT
MEDIUMrust/lance-namespace-impls/examples/manifest_bench.rs322// ──────────────────── worker mode ────────────────────COMMENT
MEDIUMrust/lance-namespace-impls/examples/manifest_bench.rs444// ──────────────────── run mode (coordinator) ────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs169// ── Bitvector with O(1) rank ─────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs242// ── Huffman-shaped Wavelet Tree ──────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs484// ── Suffix Array ─────────────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs502// ── Lazy Block Loading ───────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs987// ── FM-Index (in-memory, build-time) ─────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs1316// ── Lazy FM-Index ────────────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs1595// ── FMIndexScalarIndex ───────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs1858// ── Helpers ──────────────────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-index/src/scalar/fmindex.rs2426// ── Plugin ───────────────────────────────────────────────────────────────────COMMENT
MEDIUMrust/lance-table/src/rowids/segment.rs27/// │ Dense?─────► Yes─► RangeWithBitmap/RangeWithHolesCOMMENT
MEDIUMrust/lance-table/src/rowids/segment.rs29/// │ No─────────────► SortedArrayCOMMENT
7 more matches not shown…
Self-Referential Comments62 hits · 184 pts
SeverityFileLineSnippetContext
MEDIUMpython/python/tests/test_table_ops.py39 # Create a dataset with columns a and b in separate data filesCOMMENT
MEDIUMpython/python/tests/test_table_ops.py62 # Creating an index on column b should conflictCOMMENT
MEDIUMpython/python/tests/test_table_ops.py83 # Create an index on column aCOMMENT
MEDIUMpython/python/tests/test_multi_base.py1251 # Create a new dataset URI (doesn't exist yet)COMMENT
MEDIUMpython/python/tests/test_optimize.py562 # Create a small dataset with multiple fragmentsCOMMENT
MEDIUMpython/python/tests/test_commit_index.py57 # Create a new dataset without indexCOMMENT
MEDIUMpython/python/tests/test_commit_index.py71 # Create an Index objectCOMMENT
MEDIUMpython/python/tests/test_commit_index.py122 # Create a new dataset without indexCOMMENT
MEDIUMpython/python/tests/test_commit_index.py141 # Create an Index object with the files fieldCOMMENT
MEDIUMpython/python/tests/test_namespace_dir.py388 # Create a tableCOMMENT
MEDIUMpython/python/tests/test_namespace_dir.py423 # Create a tableCOMMENT
MEDIUMpython/python/tests/test_dataset.py5240 # Create a test dataset without propertiesCOMMENT
MEDIUMpython/python/tests/test_dataset.py5246 # Create the dataset without propertiesCOMMENT
MEDIUMpython/python/tests/test_dataset.py495 # Create a dataset with v1 manifest pathsCOMMENT
MEDIUMpython/python/tests/test_dataset.py2314 # Create a schema with some metadata to regress an issue where the metadataCOMMENT
MEDIUMpython/python/tests/test_dataset.py3128 # Create a simple test datasetCOMMENT
MEDIUMpython/python/tests/test_dataset.py3552 # Create a lance dataset with binary fieldsCOMMENT
MEDIUMpython/python/tests/test_dataset.py5111 # Create a dataset with large repetitive strings to test cache_repetition_indexCOMMENT
MEDIUMpython/python/tests/test_dataset.py5193 # Create the first version with propertiesCOMMENT
MEDIUMpython/python/tests/test_dataset.py5209 # Create a second batch with different propertiesCOMMENT
MEDIUMpython/python/tests/test_dataset.py5761 # Create a tag pointing to version 1COMMENT
MEDIUMpython/python/tests/test_file.py264 # Create a fixed-size list of float64 with dimension 8COMMENT
MEDIUMpython/python/tests/test_s3_ddb.py327 # Create a local file to uploadCOMMENT
MEDIUMpython/python/tests/test_json.py275 # Create a Lance dataset with JSON dataCOMMENT
MEDIUMpython/python/tests/test_json.py775 # Create a dataset without a JSON columnCOMMENT
MEDIUMpython/python/tests/test_map_type.py305 # Create a map with 100 entriesCOMMENT
MEDIUMpython/python/tests/test_map_type.py468 # Create a dataset with multiple columns including Map typesCOMMENT
MEDIUMpython/python/tests/test_fragment.py463 # Create a deletion fileCOMMENT
MEDIUMpython/python/tests/test_fragment.py490 # Create a DeletionFile with base_idCOMMENT
MEDIUMpython/python/tests/test_fragment.py503 # Create a FragmentMetadata with the deletion fileCOMMENT
MEDIUMpython/python/tests/test_vector_index.py2219 # Create a dataset with nested vector fieldCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py2340 # Create a dataset with 5 fragments by writing data in chunksCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py2542 # Create a test dataframe with 50% null values.COMMENT
MEDIUMpython/python/tests/test_scalar_index.py2740 # Creating an index on an empty dataset is (currently) not terribly useful butCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py3781 # Create a dataset with known content for scoring testsCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py4047 # Create an Index object using the new dataclass formatCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py4063 # Create the index operationCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py4644 # Create a simple datasetCOMMENT
MEDIUMpython/python/tests/test_scalar_index.py4684 # Create a dataset with nested structureCOMMENT
MEDIUMpython/python/tests/test_namespace_rest.py190 # Create a tableCOMMENT
MEDIUMpython/python/tests/test_namespace_rest.py228 # Create a tableCOMMENT
MEDIUMpython/python/lance/namespace.py241 # Create the provider instanceCOMMENT
MEDIUMpython/python/lance/namespace.py382 # Create the underlying Rust namespaceCOMMENT
MEDIUMpython/python/lance/namespace.py973 # Create the underlying Rust namespaceCOMMENT
MEDIUMpython/python/lance/namespace.py1563 # Create the underlying Rust adapterCOMMENT
MEDIUMpython/python/lance/namespace.py145 >>> # Define a provider classSTRING
MEDIUMpython/python/lance/dependencies.py4# The following code is originally from https://github.com/pola-rs/polars/blob/ea4389c31b0e87ddf20a85e4c3797b285966edb6/COMMENT
MEDIUMpython/python/lance/torch/async_dataset.py32# This class is similar to torch.utils.data.DataloaderCOMMENT
MEDIUMpython/python/benchmarks/test_fixed_size_binary.py35 # Create a string array directly from the list of stringsCOMMENT
MEDIUMpython/python/benchmarks/test_fixed_size_binary.py38 # Create the tableCOMMENT
MEDIUMci/create_release_branch.sh103 # Create the RC tagCOMMENT
MEDIUMci/create_release_branch.sh240 # Create the RC tagCOMMENT
MEDIUMci/create_rc.sh65# Create the RC tagCOMMENT
MEDIUMtest_data/v0.30.0_pre_created_at/datagen.py12# Create a simple dataset with a vector indexCOMMENT
MEDIUMtest_data/v0.30.0_pre_created_at/datagen.py26# Create a vector indexCOMMENT
MEDIUMtest_data/pre_file_sizes/datagen.py26# Create a simple dataset with a scalar indexCOMMENT
MEDIUMtest_data/pre_file_sizes/datagen.py37# Create a scalar index (BTree) using the correct methodCOMMENT
MEDIUMrust/lance/src/lib.rs11//! # Create a DatasetCOMMENT
MEDIUMmemtest/python/tests/test_integration.py17 # Create a small Python script that uses memtestCOMMENT
MEDIUMmemtest/python/tests/test_integration.py110 # Create a large NumPy arrayCOMMENT
2 more matches not shown…
Verbosity Indicators105 hits · 166 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_dataset.py5832 # Step 3: append more data to branch2 → verify contains branch1 data + newCOMMENT
LOWpython/python/tests/test_dataset.py5842 # Step 4: validate branches.list() and metadataCOMMENT
LOWpython/python/tests/test_dataset.py5786 # Step 1: create branch1 from main → append to branch1 → create branch2 from tagCOMMENT
LOWpython/python/tests/test_dataset.py5805 # Step 2:COMMENT
LOWrust/lance-io/src/scheduler.rs2393 // Step 1: reserve 50 of the 100 budget bytes with a read we never consume.COMMENT
LOWrust/lance-io/src/scheduler.rs2408 // Step 2: drop the caller-side future while its `rx` is still pending.COMMENT
LOWrust/lance-io/src/scheduler.rs2412 // Step 3: let the in-flight read finish. The reservation should be refundedCOMMENT
LOWrust/lance-io/src/scheduler.rs2419 // Step 4: submit the follow-up. Add a permit up front so that, if it *is*COMMENT
LOWrust/lance/src/dataset/transaction.rs3073 // so here, we need to check if the row ids match the physical rowsCOMMENT
LOWrust/lance/src/dataset/write.rs3776 // Step 2: Verify dataset is still consistent (uncommitted changes not visible)COMMENT
LOWrust/lance/src/dataset/write.rs3784 // Step 3: Commit to transaction (simulates retry after interruption)COMMENT
LOWrust/lance/src/dataset/write.rs3788 // Step 4: Verify dataset now has all 6 rows after successful commitCOMMENT
LOWrust/lance/src/dataset/write.rs839 // Step 1: ValidationsCOMMENT
LOWrust/lance/src/dataset/write.rs859 // Step 2: Assign IDs to initial_bases and add them to all_basesCOMMENT
LOWrust/lance/src/dataset/write.rs878 // Step 3: Resolve target_base_names_or_paths to IDsCOMMENT
LOWrust/lance/src/dataset/write.rs904 // Step 4: Prepare TargetBaseInfo structsCOMMENT
LOWrust/lance/src/dataset/write.rs3758 // Step 1: Write uncommitted data (simulates interrupted write before commit)COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10248 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10251 // Step 3: Another partial merge_insert on the same rows.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10433 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10436 // Step 3: Update all rows that were in fragment 1, causing fragment 1 to beCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10485 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10488 // Step 3: Update HALF of the rows that were in fragment 1. Fragment 1 survivesCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9036 // Step 1: Create dataset with NON-NULLABLE schemaCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9060 // Step 2: Create new data with NULLABLE schema but NO actual null valuesCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9075 // Step 3: Test merge_insert()COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9095 // Step 4: Verify the resultsCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9327 // Step 1: Create a dataset with a multi-column schema.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9353 // Step 2: Create source data with a subschema where one field has a wrong type.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9368 // Step 3: Execute the merge_insert operation, which should fail.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9381 // Step 4: Verify that the operation failed with the correct error type and message.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10450 // Step 4: Partial merge_insert on the same rows.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10502 // Step 4: Partial merge_insert targeting the rows that were updated (and thusCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs872 // Step 1: Create shared state and streaming processor for row addresses and write dataCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs905 // Step 2: Write new fragments using the filtered data (inserts + updates)COMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs960 // Step 3: Apply deletions to existing fragmentsCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs991 // Step 4: Create the transaction operationCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1013 // Step 5: Create and store the transactionCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1016 // Step 6: Store transaction, merge stats, and affected rows for later retrievalCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1042 // Step 7: Return empty result (write operations don't return data)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1596 // Step 4: compact_filesCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1601 // Step 5: optimize_indicesCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1607 // Step 6: Another merge_insert should NOT errorCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2926 // Step 4: compact_files — moves rows to new fragment(s)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2931 // Step 5: optimize_indices — should rebuild the FTS index without stale data.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2939 // Step 6: FTS search should not error and should return correct results.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs3131 // Step 5: Second optimize_indices (merge all) — merges both segments.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs3139 // Step 6: Verify search correctness after merge.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1534 // Step 1: Create dataset with one row {id: 1, value: "a"}COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1555 // Step 2: Create BTree index on 'id'COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1567 // Step 3: merge_insert with reversed column order (value, id)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2538 // Step 1: Create dataset with 2 rows in separate fragmentsCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2562 // Step 2: Create FTS inverted index on 'text'COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2587 // Step 3: Replace fragment 1's data file via DataReplacement.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2640 // Step 4: FTS search should reflect the new data, not the old.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2708 // Step 1: Create dataset with TOTAL rows in 2 fragments.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2731 // Step 2: Create IVF_PQ vector indexCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2760 // Step 3: DataReplacement — replace fragment 1's data.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2813 // Step 4: Search — nearest to all-zeros WITHOUT refine.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2852 // Step 1: Create dataset with 2 rows in separate fragmentsCOMMENT
45 more matches not shown…
Structural Annotation Overuse103 hits · 164 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_dataset.py5832 # Step 3: append more data to branch2 → verify contains branch1 data + newCOMMENT
LOWpython/python/tests/test_dataset.py5842 # Step 4: validate branches.list() and metadataCOMMENT
LOWpython/python/tests/test_dataset.py5786 # Step 1: create branch1 from main → append to branch1 → create branch2 from tagCOMMENT
LOWrust/lance-io/src/scheduler.rs2393 // Step 1: reserve 50 of the 100 budget bytes with a read we never consume.COMMENT
LOWrust/lance-io/src/scheduler.rs2408 // Step 2: drop the caller-side future while its `rx` is still pending.COMMENT
LOWrust/lance-io/src/scheduler.rs2412 // Step 3: let the in-flight read finish. The reservation should be refundedCOMMENT
LOWrust/lance-io/src/scheduler.rs2419 // Step 4: submit the follow-up. Add a permit up front so that, if it *is*COMMENT
LOWrust/lance/src/dataset/write.rs3776 // Step 2: Verify dataset is still consistent (uncommitted changes not visible)COMMENT
LOWrust/lance/src/dataset/write.rs3784 // Step 3: Commit to transaction (simulates retry after interruption)COMMENT
LOWrust/lance/src/dataset/write.rs3788 // Step 4: Verify dataset now has all 6 rows after successful commitCOMMENT
LOWrust/lance/src/dataset/write.rs839 // Step 1: ValidationsCOMMENT
LOWrust/lance/src/dataset/write.rs859 // Step 2: Assign IDs to initial_bases and add them to all_basesCOMMENT
LOWrust/lance/src/dataset/write.rs878 // Step 3: Resolve target_base_names_or_paths to IDsCOMMENT
LOWrust/lance/src/dataset/write.rs904 // Step 4: Prepare TargetBaseInfo structsCOMMENT
LOWrust/lance/src/dataset/write.rs3758 // Step 1: Write uncommitted data (simulates interrupted write before commit)COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10248 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10251 // Step 3: Another partial merge_insert on the same rows.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10433 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10436 // Step 3: Update all rows that were in fragment 1, causing fragment 1 to beCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10485 // Step 2: Partial merge_insert on fragment 1 rows -> fragment 1 drops from bitmapCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10488 // Step 3: Update HALF of the rows that were in fragment 1. Fragment 1 survivesCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9036 // Step 1: Create dataset with NON-NULLABLE schemaCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9060 // Step 2: Create new data with NULLABLE schema but NO actual null valuesCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9075 // Step 3: Test merge_insert()COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9095 // Step 4: Verify the resultsCOMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9327 // Step 1: Create a dataset with a multi-column schema.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9353 // Step 2: Create source data with a subschema where one field has a wrong type.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9368 // Step 3: Execute the merge_insert operation, which should fail.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs9381 // Step 4: Verify that the operation failed with the correct error type and message.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10450 // Step 4: Partial merge_insert on the same rows.COMMENT
LOWrust/lance/src/dataset/write/merge_insert.rs10502 // Step 4: Partial merge_insert targeting the rows that were updated (and thusCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs872 // Step 1: Create shared state and streaming processor for row addresses and write dataCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs905 // Step 2: Write new fragments using the filtered data (inserts + updates)COMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs960 // Step 3: Apply deletions to existing fragmentsCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs991 // Step 4: Create the transaction operationCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1013 // Step 5: Create and store the transactionCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1016 // Step 6: Store transaction, merge stats, and affected rows for later retrievalCOMMENT
LOWrust/lance/src/dataset/write/merge_insert/exec/write.rs1042 // Step 7: Return empty result (write operations don't return data)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1596 // Step 4: compact_filesCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1601 // Step 5: optimize_indicesCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1607 // Step 6: Another merge_insert should NOT errorCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2926 // Step 4: compact_files — moves rows to new fragment(s)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2931 // Step 5: optimize_indices — should rebuild the FTS index without stale data.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2939 // Step 6: FTS search should not error and should return correct results.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs3131 // Step 5: Second optimize_indices (merge all) — merges both segments.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs3139 // Step 6: Verify search correctness after merge.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1534 // Step 1: Create dataset with one row {id: 1, value: "a"}COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1555 // Step 2: Create BTree index on 'id'COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs1567 // Step 3: merge_insert with reversed column order (value, id)COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2538 // Step 1: Create dataset with 2 rows in separate fragmentsCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2562 // Step 2: Create FTS inverted index on 'text'COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2587 // Step 3: Replace fragment 1's data file via DataReplacement.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2640 // Step 4: FTS search should reflect the new data, not the old.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2708 // Step 1: Create dataset with TOTAL rows in 2 fragments.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2731 // Step 2: Create IVF_PQ vector indexCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2760 // Step 3: DataReplacement — replace fragment 1's data.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2813 // Step 4: Search — nearest to all-zeros WITHOUT refine.COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2852 // Step 1: Create dataset with 2 rows in separate fragmentsCOMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2876 // Step 2: Create FTS inverted index on 'text'COMMENT
LOWrust/lance/src/dataset/tests/dataset_merge_update.rs2893 // Step 3: merge_insert with reversed column order (text, id)COMMENT
43 more matches not shown…
Cross-Language Confusion22 hits · 118 pts
SeverityFileLineSnippetContext
HIGHpython/python/tests/test_filter.py118 assert filtered.equals(dataset.to_table())CODE
HIGHpython/python/tests/test_map_type.py38 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py66 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py90 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py117 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py152 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py183 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py207 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py271 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py320 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py338 assert result.equals(data)CODE
HIGHpython/python/tests/test_map_type.py404 assert result.equals(data_valid)CODE
HIGHpython/python/tests/test_map_type.py549 assert result4["properties"][1].as_py() is None # David's properties (null)CODE
HIGHpython/python/tests/test_map_type.py567 assert result6.equals(data), "Full data mismatch"CODE
HIGHpython/python/tests/test_blob.py1507 assert descriptions_df.equals(table_df)STRING
HIGHpython/python/tests/test_blob.py1621 assert descriptions_df.equals(table_df)STRING
HIGHpython/python/tests/test_scalar_index.py352 "ScalarIndexQuery: query=[val >= 10 && val <= 20]@val_idx"CODE
HIGHpython/python/tests/test_scalar_index.py362 "ScalarIndexQuery: query=[val >= 10 && val <= 20]@val_idx"CODE
HIGHpython/python/tests/test_scalar_index.py375 "ScalarIndexQuery: query=[val >= 5000 && val <= 0]@val_idx"CODE
HIGHpython/python/tests/test_scalar_index.py385 "ScalarIndexQuery: query=[val >= 5000 && val <= 0]@val_idx"CODE
HIGHpython/python/tests/test_arrow.py238 assert round_trip.equals(table)CODE
HIGHpython/python/tests/compat/test_file_formats.py110 assert table.equals(expected), f"Data mismatch for {self.name}"CODE
Unused Imports105 hits · 87 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_count_pushdown.py29CODE
LOWpython/python/tests/test_memory_leaks.py4CODE
LOWpython/python/lance/optimize.py7CODE
LOWpython/python/lance/optimize.py8CODE
LOWpython/python/lance/optimize.py9CODE
LOWpython/python/lance/optimize.py10CODE
LOWpython/python/lance/optimize.py11CODE
LOWpython/python/lance/vector.py6CODE
LOWpython/python/lance/util.py4CODE
LOWpython/python/lance/arrow.py14CODE
LOWpython/python/lance/arrow.py14CODE
LOWpython/python/lance/arrow.py21CODE
LOWpython/python/lance/__init__.py4CODE
LOWpython/python/lance/__init__.py11CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py12CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py24CODE
LOWpython/python/lance/__init__.py39CODE
LOWpython/python/lance/__init__.py39CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py40CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py52CODE
LOWpython/python/lance/__init__.py68CODE
LOWpython/python/lance/__init__.py69CODE
LOWpython/python/lance/__init__.py69CODE
45 more matches not shown…
Hallucination Indicators6 hits · 60 pts
SeverityFileLineSnippetContext
CRITICALrust/lance/src/dataset/metadata.rs104 MetadataType::SchemaMetadata => self.dataset.manifest.schema.metadata.clone(),CODE
CRITICALjava/dev/checkstyle.xml152 value="Avoid using com.google.common.io.Files.createTempDir() due to CVE-2020-8908.CODE
CRITICALjava/dev/checkstyle.xml153 Use org.apache.spark.network.util.JavaUtils.createTempDir() instead." />CODE
CRITICALjava/src/test/java/org/lance/DeltaTest.java53 "id", new org.apache.arrow.vector.types.pojo.ArrowType.Int(32, true)),CODE
CRITICALjava/src/test/java/org/lance/DeltaTest.java80 org.apache.arrow.c.ArrowArrayStream.allocateNew(allocator)) {CODE
CRITICALjava/src/test/java/org/lance/DeltaTest.java158 "id", new org.apache.arrow.vector.types.pojo.ArrowType.Int(32, true)),CODE
Excessive Try-Catch Wrapping42 hits · 41 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_namespace_integration.py200 except Exception:CODE
LOWpython/python/tests/test_namespace_integration.py1188 except Exception:CODE
LOWpython/python/tests/test_namespace_integration.py1253 except Exception:CODE
LOWpython/python/tests/test_namespace_integration.py1321 except Exception:CODE
LOWpython/python/tests/test_namespace_integration.py1357 except Exception:CODE
LOWpython/python/tests/test_namespace_dir.py1197 except Exception as e:CODE
LOWpython/python/tests/test_namespace_dir.py1267 except Exception as e:CODE
LOWpython/python/tests/test_namespace_dir.py1339 except Exception as e:CODE
LOWpython/python/tests/test_namespace_dir.py1377 except Exception as e:CODE
LOWpython/python/tests/test_namespace_dir.py1626 except Exception:CODE
LOWpython/python/tests/test_fragment.py239 except Exception:CODE
LOWpython/python/tests/test_vector_index.py2764 except Exception as e:CODE
LOWpython/python/tests/test_scalar_index.py3422 except Exception as e:CODE
LOWpython/python/tests/test_scalar_index.py4125 except Exception as e:CODE
LOWpython/python/tests/compat/venv_runner.py120 except Exception as e:CODE
LOWpython/python/tests/compat/venv_manager.py385 except Exception:CODE
LOWpython/python/tests/compat/venv_manager.py399 except Exception:CODE
LOWpython/python/tests/compat/compat_sequence.py268 except Exception as e:CODE
LOWpython/python/tests/compat/compat_sequence.py290 except Exception as e:CODE
LOWpython/python/tests/compat/compat_decorator.py41 except Exception as e:CODE
LOWpython/python/tests/compat/compat_decorator.py120 except Exception as e:CODE
LOWpython/python/tests/recurring/test_recurring.py58 except Exception:CODE
LOWpython/python/tests/recurring/test_recurring.py90 except Exception as e:CODE
LOWpython/python/lance/download.py47 except Exception:CODE
LOWpython/python/lance/download.py63 except Exception as _:CODE
MEDIUMpython/python/lance/download.py44def import_requests():CODE
LOWpython/python/lance/dataset.py3639 except Exception:CODE
LOWpython/python/lance/udf.py245 except Exception as inner_err:CODE
LOWpython/python/lance/torch/async_dataset.py72 except Exception as e:CODE
LOW…/python/ci_benchmarks/benchmarks/test_ivf_pq_search.py98 except Exception:CODE
LOWpython/python/ci_benchmarks/datagen/count_rows.py71 except Exception:CODE
LOWpython/python/benchmarks/test_search.py22 except Exception:CODE
MEDIUMci/check_breaking_changes.py63 print("Error: last_stable_version and current_version required for validation")CODE
MEDIUMci/coverage.py17 print("Error running coverage analysis:")CODE
LOWtest_data/v1.0.1/datagen.py117except Exception as e:CODE
LOW…benches/mem_wal/write/run_shard_writer_backpressure.sh103 except Exception: continueCODE
LOWrust/lance/benches/mem_wal/kv/run_kv_compare.sh101 except Exception as e:CODE
LOWrust/lance/benches/mem_wal/fts/run_fts_read_sweep.sh162 except Exception as e:CODE
LOWrust/lance/benches/mem_wal/fts/run_fts_compare.sh156 except Exception: continueCODE
LOWrust/lance/benches/mem_wal/fts/run_fineweb_fts.sh110 except Exception as e:CODE
LOW…/lance/benches/mem_wal/vector/hnsw/disk_ann_compare.py207 except Exception:CODE
LOW.github/workflows/file_verification/test_write_read.py61 except Exception:CODE
Deep Nesting35 hits · 32 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_multi_base.py404CODE
LOWpython/python/tests/test_vector_index.py136CODE
LOWpython/python/tests/compat/venv_manager.py143CODE
LOWpython/python/tests/compat/compat_sequence.py212CODE
LOWpython/python/tests/compat/compat_sequence.py226CODE
LOWpython/python/tests/compat/compat_decorator.py71CODE
LOWpython/python/lance/vector.py48CODE
LOWpython/python/lance/vector.py400CODE
LOWpython/python/lance/vector.py604CODE
LOWpython/python/lance/vector.py486CODE
LOWpython/python/lance/vector.py668CODE
LOWpython/python/lance/util.py41CODE
LOWpython/python/lance/util.py156CODE
LOWpython/python/lance/arrow.py519CODE
LOWpython/python/lance/arrow.py161CODE
LOWpython/python/lance/types.py55CODE
LOWpython/python/lance/dataset.py217CODE
LOWpython/python/lance/dataset.py7562CODE
LOWpython/python/lance/dataset.py3108CODE
LOWpython/python/lance/dataset.py3495CODE
LOWpython/python/lance/dataset.py6271CODE
LOWpython/python/lance/udf.py174CODE
LOWpython/python/lance/sampler.py119CODE
LOWpython/python/lance/sampler.py171CODE
LOWpython/python/lance/otel.py35CODE
LOWpython/python/lance/torch/bench_utils.py50CODE
LOWpython/python/lance/torch/data.py114CODE
LOWpython/python/lance/torch/data.py369CODE
LOW…/python/ci_benchmarks/benchmarks/test_random_access.py20CODE
LOW…python/ci_benchmarks/benchmarks/test_index_training.py14CODE
LOWpython/python/benchmarks/test_read_write.py223CODE
LOWci/new_contributors.py105CODE
LOWbenchmarks/sift/perf.py102CODE
LOWbenchmarks/sift/datagen.py12CODE
LOWbenchmarks/hd-vila/datagen.py109CODE
Redundant / Tautological Comments20 hits · 29 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_commit_index.py101 # Check if the index is used in scansCOMMENT
LOWpython/python/tests/test_file.py613 # Check if total row count is correctCOMMENT
LOWpython/python/tests/test_file.py658 # Write files at different levelsCOMMENT
LOWpython/python/tests/test_file.py697 # Write files in different directoriesCOMMENT
LOWpython/python/tests/test_scalar_index.py2368 # Check if the zone map index is no longer being usedCOMMENT
LOWpython/python/tests/compat/venv_manager.py267 # Set PYTHONPATH to include the tests directoryCOMMENT
LOWpython/python/lance/__init__.py275 # Check if namespace manages versioning (commits go through namespace API)COMMENT
LOWpython/python/lance/dataset.py7460 # Check if namespace manages versioning (commits go through namespace API)COMMENT
LOW…/python/ci_benchmarks/benchmarks/test_ivf_pq_search.py87 # Check if dataset already exists and has correct row countCOMMENT
LOWpython/python/ci_benchmarks/datagen/gen_all.py16 # Check if handler already exists (avoid duplicate handlers)COMMENT
LOWpython/python/ci_benchmarks/datagen/wikipedia.py166 # Check if indices existCOMMENT
LOWci/create_release_branch.sh97 # Set version to RC versionCOMMENT
LOWci/create_release_branch.sh227 # Set version to RC versionCOMMENT
LOWci/coverage.py26 # Check if this is a section header (path ending with colon)COMMENT
LOWci/publish_beta.sh82 # Check if major already bumped from baseCOMMENT
LOWci/review_stats.py195 # Print resultsCOMMENT
LOWci/new_contributors.py266 # Print resultsCOMMENT
LOWtest_data/v0.27.1/datagen.py31# Open file in pq_in_schema/_indices/*/auxiliary.idxCOMMENT
LOW.github/workflows/file_verification/test_write_read.py55 # Check if the tables are equalCOMMENT
LOW.github/actions/create-failure-issue/action.yml23 # Check if any job failedCOMMENT
AI Slop Vocabulary9 hits · 23 pts
SeverityFileLineSnippetContext
MEDIUMpython/RUST_THIRD_PARTY_LICENSES.html8523 <li><a href=" https://github.com/georust/robust ">robust 1.2.0</a></li>CODE
LOWpython/python/tests/test_scalar_index.py370 # but we should handle them gracefully and simply return an empty resultCOMMENT
MEDIUMrust/lance/Cargo.toml312# harness = falseCOMMENT
MEDIUMrust/lance/src/io/exec/filtered_read.rs2479 // robust, but the canonical builders preserve representation.COMMENT
MEDIUMrust/lance/src/utils/test.rs31/// dataset operations are robust to different layouts.COMMENT
MEDIUMrust/lance/src/index/scalar.rs913 // `]` markers so the assertion stays robust to unrelated planCOMMENT
MEDIUM…ssion/bitpacking/src/bitpacker_internal/bitpacker4x.rs362/// to leverage `SSE3` instructions to encode and decode the stream.COMMENT
MEDIUMrust/lance-table/src/io/manifest.rs53 // the size to be more robust.COMMENT
MEDIUMjava/RUST_THIRD_PARTY_LICENSES.html7855 <li><a href=" https://github.com/georust/robust ">robust 1.2.0</a></li>CODE
AI Structural Patterns30 hits · 21 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_vector_index.py2572CODE
LOWpython/python/lance/util.py154CODE
LOWpython/python/lance/__init__.py136CODE
LOWpython/python/lance/dataset.py7235CODE
LOWpython/python/lance/dataset.py7613CODE
LOWpython/python/lance/dataset.py765CODE
LOWpython/python/lance/dataset.py1077CODE
LOWpython/python/lance/dataset.py1433CODE
LOWpython/python/lance/dataset.py1590CODE
LOWpython/python/lance/dataset.py2007CODE
LOWpython/python/lance/dataset.py3495CODE
LOWpython/python/lance/dataset.py3882CODE
LOWpython/python/lance/dataset.py4156CODE
LOWpython/python/lance/dataset.py4440CODE
LOWpython/python/lance/dataset.py5080CODE
LOWpython/python/lance/dataset.py5186CODE
LOWpython/python/lance/dataset.py6431CODE
LOWpython/python/lance/dataset.py6836CODE
LOWpython/python/lance/dataset.py7916CODE
LOWpython/python/lance/file.py487CODE
LOWpython/python/lance/fragment.py1068CODE
LOWpython/python/lance/fragment.py338CODE
LOWpython/python/lance/fragment.py496CODE
LOWpython/python/lance/fragment.py600CODE
LOWpython/python/lance/fragment.py629CODE
LOWpython/python/lance/fragment.py653CODE
LOWpython/python/lance/fragment.py1016CODE
LOWpython/python/lance/fragment.py1042CODE
LOWpython/python/lance/torch/kmeans.py111CODE
LOWpython/python/lance/torch/data.py256CODE
AI Response Leakage2 hits · 15 pts
SeverityFileLineSnippetContext
HIGH…ce-encoding/src/encodings/logical/primitive/fullzip.rs7//! In this approach the various compressed buffers are zippedCOMMENT
HIGH…-encoding/src/encodings/logical/primitive/miniblock.rs7//! In this approach the data is compressed into a series of chunks put intoCOMMENT
Modern Structural Boilerplate14 hits · 14 pts
SeverityFileLineSnippetContext
LOWpython/python/lance/arrow.py23__all__ = [CODE
LOWpython/python/lance/__init__.py82__all__ = [CODE
LOWpython/python/lance/file.py617__all__ = [CODE
LOWpython/python/lance/mem_wal.py39__all__ = [CODE
LOWpython/python/lance/namespace.py119__all__ = [CODE
LOWpython/python/lance/sampler.py36__all__ = [CODE
LOWpython/python/lance/dependencies.py214__all__ = [CODE
LOWpython/python/lance/indices/__init__.py14__all__ = [CODE
LOWpython/python/lance/torch/bench_utils.py18__all__ = ["ground_truth"]CODE
LOWpython/python/lance/torch/distance.py9__all__ = [CODE
LOWpython/python/lance/torch/kmeans.py23__all__ = ["KMeans"]CODE
LOWpython/python/lance/torch/data.py41__all__ = ["LanceDataset", "SafeLanceDataset", "get_safe_loader"]CODE
LOWpython/python/lance/_dataset/sharded_batch_iterator.py18__all__ = ["ShardedBatchIterator"]CODE
LOWmemtest/python/memtest/__init__.py249__all__ = [CODE
TODO Padding4 hits · 6 pts
SeverityFileLineSnippetContext
LOW…ance-encoding/src/previous/encodings/physical/basic.rs67// TODO: Add tests for the all-null caseCOMMENT
LOWrust/lance/src/dataset/updater.rs394 // TODO: implement adding blanks for an empty batch.COMMENT
LOWrust/lance/src/session/index_extension.rs29 // TODO: implement this trait and wire it inCOMMENT
LOWrust/lance-index/src/vector/bq/storage.rs2230 // TODO: implement thisCOMMENT
Example Usage Blocks4 hits · 6 pts
SeverityFileLineSnippetContext
LOW…benches/mem_wal/write/run_shard_writer_backpressure.sh8# Usage:COMMENT
LOWrust/lance/benches/mem_wal/kv/run_kv_compare.sh11# Usage:COMMENT
LOWrust/lance/benches/mem_wal/fts/run_fts_read_sweep.sh17# Usage:COMMENT
LOW…lance-namespace-impls/benches/manifest_commit_sweep.sh15# Usage:COMMENT
Fake / Example Data3 hits · 4 pts
SeverityFileLineSnippetContext
LOWrust/lance-table/src/io/commit.rs1502 let dummy_data = memory_store.read_one_all(&dummy_path.into()).await?;CODE
LOWrust/lance-table/src/io/commit.rs1503 let size = dummy_data.len() as u64;CODE
LOWrust/lance-table/src/io/commit.rs1508 dummy_data.into(),CODE
Modern AI Meta-Vocabulary1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMrust/lance/tests/count_pushdown/mod.rs167 // pins the not-firing behaviour and the scaffold for the future test.COMMENT
Slop Phrases1 hit · 1 pts
SeverityFileLineSnippetContext
LOWpython/python/tests/test_scalar_index.py588 # index wants to be used as a prefilter but we have to make sure to scan theCOMMENT