Repository Analysis

apache/paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

8.3 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of apache/paimon, a Java project with 3,365 GitHub stars. SynthScan v2.0 examined 1,275,369 lines of code across 6424 source files, recording 6454 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 8.3 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

8.3
Adjusted Score
8.3
Raw Score
100%
Time Factor
2026-08-09
Last Push
3.4K
Stars
Java
Language
1.3M
Lines of Code
6.4K
Files
6.5K
Pattern Hits
2026-08-09
Scan Date
0.06
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 268HIGH 102MEDIUM 437LOW 5647

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 6454 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers3759 hits · 3650 pts
SeverityFileLineSnippetContext
LOW…n-python/pypaimon/write/global_index_update_checker.py23def scan_global_index_entries(table, snapshot):CODE
LOW…n-python/pypaimon/write/global_index_update_checker.py61def apply_global_index_update_action(CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1078 def _generate_partition_statistics(self, commit_entries: List[ManifestEntry]) -> List[PartitionStatistics]:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py89def _try_replace_manifest_files(current, replaced, replacement):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py117def _try_reuse_manifest_merge_result(retry_result, current_manifests):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py339 def _hash_index_base_snapshot(CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py352 def _overwrite_hash_index_deletes(self, partition_filter, deletes):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py829 def _try_rewrite_row_id_conflict(CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py896 def _create_dynamic_partition_filter(self, commit_messages: List[CommitMessage]):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py914 def _create_static_partition_filter(self, overwrite_partition, commit_messages: List[CommitMessage]):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py935 def _overwrite_changes_provider(self, partition_filter, commit_messages):CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py959 def _collect_changelog_entries(self, commit_messages: List[CommitMessage]) -> List[ManifestEntry]:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py978 def _collect_manifest_entries(self, commit_messages: List[CommitMessage]) -> List[ManifestEntry]:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1005 def _clean_up_reuse_tmp_manifests(CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1027 def _clean_up_no_reuse_tmp_manifests(CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1185 def _assign_row_tracking_meta(self, first_row_id_start: int, commit_entries: List[ManifestEntry]):CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py41def _cast_binary_to_table_schema(table: pa.Table, target_schema: pa.Schema) -> pa.Table:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py235 def add_pending_commit_messages(self, commit_messages) -> None:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py366def _write_postpone_primary_key_blocks(CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py541def _write_primary_key_groups(CODE
LOWpaimon-python/pypaimon/write/table_delete.py235 def _read_existing_deletion_vectors(CODE
LOWpaimon-python/pypaimon/write/table_delete.py279 def _write_deletion_vector_index(CODE
LOWpaimon-python/pypaimon/write/table_update.py51def _filter_by_whole_file_shard(splits: List[DataSplit], sub_task_id: int, total_tasks: int) -> List[DataSplit]:CODE
LOWpaimon-python/pypaimon/write/table_update.py154 def _update_by_arrow_with_row_id(CODE
LOWpaimon-python/pypaimon/write/table_update.py164 def _upsert_by_arrow_with_key(CODE
LOWpaimon-python/pypaimon/write/table_update.py263 def _matched_update_scan_table(self):CODE
LOWpaimon-python/pypaimon/write/table_update.py290 def _validate_predicate_update(self, assignments: Mapping[str, Any]):CODE
LOWpaimon-python/pypaimon/write/table_update.py314 def _build_predicate_update_table(CODE
LOWpaimon-python/pypaimon/write/table_update.py366 def _delete_by_partition_filter(CODE
LOWpaimon-python/pypaimon/write/table_update.py406 def _partition_delete_message(messages, partition, bucket, snapshot_id):CODE
LOWpaimon-python/pypaimon/write/table_update.py433 def _partition_only_delete_filter(CODE
LOWpaimon-python/pypaimon/write/table_update.py450 def _rewrite_predicate_to_partition_indices(CODE
LOWpaimon-python/pypaimon/write/table_update.py502 def update_by_arrow_with_row_id(self, table: pa.Table) -> List[CommitMessage]:CODE
LOWpaimon-python/pypaimon/write/table_update.py565 def update_by_arrow_with_row_id(CODE
LOWpaimon-python/pypaimon/write/table_update_by_row_id.py112 def _load_existing_files_info(self) -> _FilesInfo:CODE
LOWpaimon-python/pypaimon/write/table_update_by_row_id.py425 def _merge_update_with_original(CODE
LOWpaimon-python/pypaimon/write/table_update_by_row_id.py652 def _assign_update_file_metadata(new_files: List[DataFileMeta], first_row_id: int,CODE
LOWpaimon-python/pypaimon/write/table_upsert_by_key.py217 def _dedup_row_items_last_write_wins(CODE
LOWpaimon-python/pypaimon/write/table_upsert_by_key.py473 def _build_key_to_row_ids_map(CODE
LOWpaimon-python/pypaimon/write/row_utils.py89def row_values_to_arrow_table(CODE
LOWpaimon-python/pypaimon/write/table_write.py50 def _create_row_key_extractor(self, static_partition):CODE
LOWpaimon-python/pypaimon/write/table_write.py88 def _write_partition_bucket_batch(self, partition, bucket, data):CODE
LOWpaimon-python/pypaimon/write/table_write.py91 def with_dynamic_bucket_index(CODE
LOWpaimon-python/pypaimon/write/table_write.py117 def write_arrow_batch_to_bucket(CODE
LOWpaimon-python/pypaimon/write/table_write.py193 def _write_partition_bucket_row(CODE
LOWpaimon-python/pypaimon/write/table_write.py274 def _distributed_write_options(self) -> Dict[str, Any]:CODE
LOWpaimon-python/pypaimon/write/table_write.py326 def _release_prepared_indexes(self) -> None:CODE
LOWpaimon-python/pypaimon/write/table_write.py343 def _is_compatible_pyarrow_schema(CODE
LOWpaimon-python/pypaimon/write/table_write.py358 def _write_cols_pyarrow_schema(self, write_cols: List[str]) -> pa.Schema:CODE
LOWpaimon-python/pypaimon/write/table_write.py364 def _raise_inconsistent_schema(self, data_schema: pa.Schema):CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py123 def extract_partition_bucket_batch(self, data: pa.RecordBatch) -> Tuple[List[Tuple], List[int]]:CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py132 def extract_partition_bucket_groups(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py228 def extract_partition_bucket_row(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py243 def _extract_partitions_batch(self, data: pa.RecordBatch) -> List[Tuple]:CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py513 def _extract_key_hashes_batch(self, data: pa.RecordBatch) -> List[int]:CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py536 def extract_partition_bucket_from_hashes_batch(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py547 def extract_partition_bucket_status_from_hashes_batch(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py643 def notify_precomputed_bucket_batch(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py652 def notify_precomputed_bucket_hashes_batch(CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py756 def extract_partition_bucket_batch(CODE
3699 more matches not shown…
Hallucination Indicators268 hits · 3005 pts
SeverityFileLineSnippetContext
CRITICAL…java/org/apache/paimon/jindo/JindoMultiPartUpload.java72 new com.aliyun.jindodata.api.spec.protos.JdoObjectPartList();CODE
CRITICAL…org/apache/paimon/core/IcebergDVCompatibilityTest.java308 org.apache.iceberg.data.GenericRecord.create(type);CODE
CRITICAL…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java95 org.apache.paimon.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java103 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java106 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java109 "col2", org.apache.flink.cdc.common.types.DataTypes.INT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java193 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java196 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java199 "col2", org.apache.flink.cdc.common.types.DataTypes.INT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java202 org.apache.flink.cdc.common.types.DataTypes.INT().notNull())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java224 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java227 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java230 "col2", org.apache.flink.cdc.common.types.DataTypes.INT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java252 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java255 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java259 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java262 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java265 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java295 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java298 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java302 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java305 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java308 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java334 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java337 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java341 org.apache.flink.cdc.common.types.DataTypes.BOOLEAN())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java344 org.apache.flink.cdc.common.types.DataTypes.BINARY(3))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java347 org.apache.flink.cdc.common.types.DataTypes.VARBINARY(10))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java350 org.apache.flink.cdc.common.types.DataTypes.BYTES())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java353 org.apache.flink.cdc.common.types.DataTypes.TINYINT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java356 org.apache.flink.cdc.common.types.DataTypes.SMALLINT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java358 "int", org.apache.flink.cdc.common.types.DataTypes.INT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java361 org.apache.flink.cdc.common.types.DataTypes.FLOAT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java364 org.apache.flink.cdc.common.types.DataTypes.DOUBLE())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java367 org.apache.flink.cdc.common.types.DataTypes.DECIMAL(6, 3))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java369 "char", org.apache.flink.cdc.common.types.DataTypes.CHAR(5))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java372 org.apache.flink.cdc.common.types.DataTypes.VARCHAR(10))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java375 org.apache.flink.cdc.common.types.DataTypes.STRING())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java377 "date", org.apache.flink.cdc.common.types.DataTypes.DATE())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java379 "time", org.apache.flink.cdc.common.types.DataTypes.TIME())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java382 org.apache.flink.cdc.common.types.DataTypes.TIME(6))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java385 org.apache.flink.cdc.common.types.DataTypes.TIMESTAMP())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java388 org.apache.flink.cdc.common.types.DataTypes.TIMESTAMP(3))CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java391 org.apache.flink.cdc.common.types.DataTypes.TIMESTAMP_LTZ())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java394 org.apache.flink.cdc.common.types.DataTypes.TIMESTAMP_LTZ(CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java442 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java445 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java448 "col2", org.apache.flink.cdc.common.types.DataTypes.INT())CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java479 org.apache.flink.cdc.common.types.DataTypes.STRING()),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java485 org.apache.flink.cdc.common.types.DataTypes.STRING())));CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java490 org.apache.flink.cdc.common.types.DataTypes.STRING())));CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java495 org.apache.flink.cdc.common.types.DataTypes.STRING()),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java500 "col7_after", org.apache.flink.cdc.common.types.DataTypes.STRING()),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java531 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java534 org.apache.flink.cdc.common.types.DataTypes.STRING()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java539 org.apache.flink.cdc.common.types.DataTypes.STRING(),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java543 org.apache.flink.cdc.common.types.DataTypes.STRING(),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java547 org.apache.flink.cdc.common.types.DataTypes.STRING(),CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java576 org.apache.flink.cdc.common.schema.Schema.newBuilder()CODE
CRITICAL…ink/pipeline/cdc/schema/PaimonMetadataApplierTest.java579 org.apache.flink.cdc.common.types.DataTypes.INT().notNull())CODE
208 more matches not shown…
Decorative Section Separators262 hits · 964 pts
SeverityFileLineSnippetContext
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml23 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml25 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml77 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml79 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml109 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml111 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml187 # ----------------------------------------COMMENT
MEDIUM…-tests/src/test/resources-filtered/docker-compose.yaml189 # ----------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/write/table_upsert_by_key.py241 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/write/table_upsert_by_key.py243 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/write/table_upsert_by_key.py274 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/write/table_upsert_by_key.py276 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/read/read_builder.py163 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/read/read_builder.py165 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/read/explain.py141# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/read/explain.py143# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/pypaimon/read/reader/aggregation_merge_function.py53# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/pypaimon/read/reader/aggregation_merge_function.py56# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/pypaimon/read/reader/aggregation_merge_function.py118# ---------------------------------------------------------------------------COMMENT
MEDIUM…hon/pypaimon/read/reader/aggregation_merge_function.py120# ---------------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py89 # ------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py91 # ------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py165 # ------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py167 # ------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py226 # ------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/reader/blob_descriptor_convert_reader.py228 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/read/reader/aggregate/aggregators.py1450# ---------------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/read/reader/aggregate/aggregators.py1454# ---------------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/read/reader/aggregate/aggregators.py314# ---------------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/read/reader/aggregate/aggregators.py316# ---------------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/scanner/chunk_shuffle_split_generator.py315# ---------------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/scanner/chunk_shuffle_split_generator.py317# ---------------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/scanner/chunk_shuffle_split_generator.py448# ---------------------------------------------------------------------------COMMENT
MEDIUM…pypaimon/read/scanner/chunk_shuffle_split_generator.py450# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py196 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py198 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py253 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py255 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py277 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_parallel_test.py279 # ------------------------------------------------------------------COMMENT
MEDIUM…on-python/pypaimon/tests/schema_evolution_read_test.py553 # ------------------------------------------------------------------COMMENT
MEDIUM…on-python/pypaimon/tests/schema_evolution_read_test.py559 # ------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py81# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py83# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py559# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py563# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py882# ---------------------------------------------------------------------------COMMENT
MEDIUMpaimon-python/pypaimon/tests/pushdown_bucket_test.py885# ---------------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py48# ======================================================================COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py50# ======================================================================COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py125# ======================================================================COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py127# ======================================================================COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py151 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py153 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py166 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py168 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py199 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py201 # ------------------------------------------------------------------COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py219# ======================================================================COMMENT
MEDIUM…n-python/pypaimon/tests/data_evolution_test_helpers.py221# ======================================================================COMMENT
202 more matches not shown…
Over-Commented Block781 hits · 750 pts
SeverityFileLineSnippetContext
LOW.asf.yaml1#COMMENT
LOW…pache/paimon/iceberg/IcebergRestMetadataCommitter.java481 // When we create an Iceberg table via the REST catalog, we register it withCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-1.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-5.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-4.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-3.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-2.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…cdc/src/test/resources/mongodb/database/test-data-6.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…n-flink-cdc/src/test/resources/mongodb/docker/setup.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…nk-cdc/src/test/resources/mongodb/table/inventory-2.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…nk-cdc/src/test/resources/mongodb/table/inventory-3.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…nk-cdc/src/test/resources/mongodb/table/inventory-4.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…nk-cdc/src/test/resources/mongodb/table/inventory-1.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…/test/resources/mongodb/table/defaultid/defaultId-1.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…/test/resources/mongodb/table/defaultid/defaultId-2.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…resources/mongodb/table/computedcolumn/test-table-2.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…resources/mongodb/table/computedcolumn/test-table-1.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…src/test/resources/mongodb/table/event/event-insert.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…src/test/resources/mongodb/table/event/event-delete.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…src/test/resources/mongodb/table/event/event-update.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…rc/test/resources/mongodb/table/event/event-replace.js1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW…ctors/mysql/source/connection/JdbcConnectionPools.java61 // Intentionally no-op.COMMENT
LOW…e/paimon/flink/action/RemoveUnexistingFilesAction.java221 public void endInput() {COMMENT
LOWtools/ci/sonar_check.sh1#!/usr/bin/env bashCOMMENT
LOWtools/ci/docs.sh1#!/usr/bin/env bashCOMMENT
LOWtools/releasing/create_source_release.sh1#!/usr/bin/env bashCOMMENT
LOWtools/releasing/create_release_branch.sh1#!/usr/bin/env bashCOMMENT
LOWtools/releasing/sign_maven_repository.sh1#!/usr/bin/env bashCOMMENT
LOWtools/releasing/deploy_maven_repository.sh1#!/usr/bin/env bashCOMMENT
LOWtools/releasing/update_branch_version.sh1#!/usr/bin/env bashCOMMENT
LOW…-tests/src/test/resources-filtered/docker-compose.yaml1################################################################################COMMENT
LOWdocs/static/rest-catalog-open-api.yaml1#COMMENT
LOWpaimon-python/conftest.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/setup.py1##########################################################################COMMENT
LOWpaimon-python/dev/cfg.ini1################################################################################COMMENT
LOWpaimon-python/dev/requirements.txt1################################################################################COMMENT
LOWpaimon-python/dev/run_mixed_tests.sh1#!/bin/bashCOMMENT
LOWpaimon-python/dev/lint-python.sh1#!/usr/bin/env bashCOMMENT
LOWpaimon-python/dev/check_license_header.py1#!/usr/bin/env pythonCOMMENT
LOWpaimon-python/dev/requirements-dev.txt1################################################################################COMMENT
LOWpaimon-python/dev/auto-check.sh1#!/usr/bin/env bashCOMMENT
LOWpaimon-python/dev/check-licensing.sh1#!/usr/bin/env bashCOMMENT
LOWpaimon-python/pypaimon/__init__.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_commit.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/blob_format_writer.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…n-python/pypaimon/write/global_index_update_checker.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/postpone_bucket.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/file_store_commit.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/ray_datasink.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_delete.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_update.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/write_builder.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/__init__.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_update_by_row_id.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_upsert_by_key.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/row_utils.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/table_write.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/commit_callback.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/row_key_extractor.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpaimon-python/pypaimon/write/commit_message.py1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
721 more matches not shown…
Excessive Try-Catch Wrapping442 hits · 604 pts
SeverityFileLineSnippetContext
LOWpaimon-python/setup.py44 except Exception:CODE
LOWpaimon-python/dev/check_license_header.py44 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/table_commit.py97 except Exception:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1064 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1073 except Exception:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py752 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py758 except Exception as cleanup_err:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py797 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1021 except Exception:CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1051 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py154 except Exception:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py158 except Exception as abort_error:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py217 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py229 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py257 except Exception as abort_error:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py412 except Exception:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py493 except Exception as error:CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py587 except Exception:CODE
LOWpaimon-python/pypaimon/write/table_delete.py308 except Exception:CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py58 except Exception: # any failure here means "use the fallback"CODE
LOWpaimon-python/pypaimon/write/file_store_write.py350 except Exception as e:CODE
MEDIUM…mon-python/pypaimon/write/commit/conflict_detection.py208def check_conflicts(CODE
LOW…mon-python/pypaimon/write/commit/conflict_detection.py217 except Exception as e:CODE
LOW…mon-python/pypaimon/write/commit/conflict_detection.py224 except Exception as e:CODE
LOW…thon/pypaimon/write/commit/row_id_conflict_rewriter.py139 except Exception:CODE
LOW…thon/pypaimon/write/commit/row_id_conflict_rewriter.py142 except Exception:CODE
LOW…on/pypaimon/write/commit/overwrite_changes_provider.py98 except Exception:CODE
LOWpaimon-python/pypaimon/write/commit/commit_rollback.py59 except Exception:CODE
LOWpaimon-python/pypaimon/write/writer/blob_writer.py244 except Exception as e:CODE
LOW…mon-python/pypaimon/write/writer/data_vector_writer.py129 except Exception as e:CODE
LOW…mon-python/pypaimon/write/writer/data_vector_writer.py143 except Exception as e:CODE
LOW…-python/pypaimon/write/writer/key_value_data_writer.py93 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/writer/data_writer.py117 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/writer/data_writer.py138 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/writer/data_writer.py169 except Exception as e:CODE
LOWpaimon-python/pypaimon/write/writer/data_writer.py258 except Exception:CODE
MEDIUMpaimon-python/pypaimon/write/writer/data_writer.py134def close(self):CODE
LOWpaimon-python/pypaimon/write/writer/blob_file_writer.py192 except Exception:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py231 except Exception as e:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py284 except Exception as e:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py296 except Exception as e:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py324 except Exception as e:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py409 except Exception as e:CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py436 except Exception as e:CODE
MEDIUM…ython/pypaimon/write/writer/dedicated_format_writer.py236def write_row(self, row):CODE
LOWpaimon-python/pypaimon/benchmark/hdfs_io_bench.py108 except Exception as e:CODE
LOWpaimon-python/pypaimon/benchmark/hdfs_io_bench.py147 except Exception as e:CODE
LOW…n-python/pypaimon/snapshot/renaming_snapshot_commit.py98 except Exception as e:CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py186 except Exception:CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py415 except Exception:CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_loader.py71 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py143 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py171 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py194 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py246 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py299 except Exception as e:CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py365 except Exception as e:CODE
LOWpaimon-python/pypaimon/changelog/changelog_manager.py59 except Exception as e:CODE
LOWpaimon-python/pypaimon/changelog/changelog_manager.py70 except Exception as e:CODE
LOWpaimon-python/pypaimon/changelog/changelog_manager.py85 except Exception as e:CODE
382 more matches not shown…
Cross-File Repetition49 hits · 245 pts
SeverityFileLineSnippetContext
HIGH…thon/pypaimon/table/source/full_text_search_builder.py0partition predicate used to prune index manifest entries.STRING
HIGH…-python/pypaimon/table/source/hybrid_search_builder.py0partition predicate used to prune index manifest entries.STRING
HIGH…n/pypaimon/table/source/batch_vector_search_builder.py0partition predicate used to prune index manifest entries.STRING
HIGH…-python/pypaimon/table/source/vector_search_builder.py0partition predicate used to prune index manifest entries.STRING
HIGH…est/scala/org/apache/paimon/spark/PaimonSinkTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…paimon/spark/sql/CreateAndDeleteTagProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…rg/apache/paimon/spark/sql/RollbackProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…est/scala/org/apache/paimon/spark/PaimonSinkTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…/spark/procedure/CreateAndDeleteTagProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…pache/paimon/spark/procedure/BranchProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…e/paimon/spark/procedure/ReplaceTagProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…rk/procedure/CreateTagFromTimestampProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…/paimon/spark/procedure/AlterBranchProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…mon/spark/procedure/ExpireSnapshotsProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…che/paimon/spark/procedure/RollbackProcedureTest.scala0|create table t (a int, b string) |tblproperties ('primary-key'='a', 'bucket'='3') |STRING
HIGH…/org/apache/paimon/spark/sql/InsertOverwriteTest.scala0|create table t (a int, b string) |tblproperties ($prop) |STRING
HIGH…he/paimon/spark/sql/InsertOverwriteTableTestBase.scala0|create table t (a int, b string) |tblproperties ($prop) |STRING
HIGH…g/apache/paimon/spark/sql/DataFrameWriteTestBase.scala0|create table t (a int, b string) |tblproperties ($prop) |STRING
HIGH…/org/apache/paimon/spark/sql/InsertOverwriteTest.scala0|create table t (a int, b int, c string) |using paimon |tblproperties ($prop) |partitioned by (a) |STRING
HIGH…he/paimon/spark/sql/InsertOverwriteTableTestBase.scala0|create table t (a int, b int, c string) |using paimon |tblproperties ($prop) |partitioned by (a) |STRING
HIGH…apache/paimon/spark/sql/TableValuedFunctionsTest.scala0|create table t (a int, b int, c string) |using paimon |tblproperties ($prop) |partitioned by (a) |STRING
HIGH…he/paimon/spark/rowops/PaimonCopyOnWriteScanTest.scala0create table t (id int, name string) | using paimon | tblproperties ('primary-key' = 'id', 'bucket' = '1')STRING
HIGH…g/apache/paimon/spark/sql/MergeIntoAlignmentTest.scala0create table t (id int, name string) | using paimon | tblproperties ('primary-key' = 'id', 'bucket' = '1')STRING
HIGH…org/apache/paimon/spark/sql/WriteMergeSchemaTest.scala0create table t (id int, name string) | using paimon | tblproperties ('primary-key' = 'id', 'bucket' = '1')STRING
HIGH…/paimon/spark/procedure/FastForwardProcedureTest.scala0|create table t (id string, name string) |using paimon |tblproperties ('primary-key'='id') |STRING
HIGH…n/spark/procedure/RemoveOrphanFilesProcedureTest.scala0|create table t (id string, name string) |using paimon |tblproperties ('primary-key'='id') |STRING
HIGH…org/apache/paimon/spark/sql/AnalyzeTableTestBase.scala0|create table t (id string, name string) |using paimon |tblproperties ('primary-key'='id') |STRING
HIGH…mon/spark/procedure/DropGlobalIndexProcedureTest.scala0|create table t (id int, title string, content string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-perSTRING
HIGH…n/spark/procedure/CreateGlobalIndexProcedureTest.scala0|create table t (id int, title string, content string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-perSTRING
HIGH…a/org/apache/paimon/spark/sql/FullTextSearchTest.scala0|create table t (id int, title string, content string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-perSTRING
HIGH…ala/org/apache/paimon/spark/sql/HybridSearchTest.scala0|create table t (id int, title string, content string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-perSTRING
HIGH…mon/spark/procedure/DropGlobalIndexProcedureTest.scala0|create table t (id int, name string, pt string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-per-shardSTRING
HIGH…n/spark/procedure/CreateGlobalIndexProcedureTest.scala0|create table t (id int, name string, pt string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-per-shardSTRING
HIGH…/org/apache/paimon/spark/sql/RowTrackingTestBase.scala0|create table t (id int, name string, pt string) |tblproperties ( | 'bucket' = '-1', | 'global-index.row-count-per-shardSTRING
HIGH…e/paimon/spark/procedure/ExpireTagsProcedureTest.scala0|create table t (id string, name string) |using paimon |STRING
HIGH…e/paimon/spark/procedure/PurgeFilesProcedureTest.scala0|create table t (id string, name string) |using paimon |STRING
HIGH…rg/apache/paimon/spark/sql/PaimonSystemTableTest.scala0|create table t (id string, name string) |using paimon |STRING
HIGH…st/scala/org/apache/paimon/spark/sql/DDLTestBase.scala0|create table rtas (id bigint, data string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '2') |STRING
HIGH…/org/apache/paimon/spark/sql/FormatTableTestBase.scala0|create table rtas (id bigint, data string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '2') |STRING
HIGH…g/apache/paimon/spark/sql/DataFrameWriteTestBase.scala0|create table rtas (id bigint, data string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '2') |STRING
HIGH…paimon/spark/sql/ReplaceTableWithRestCatalogTest.scala0|create table rtas (id bigint, data string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '2') |STRING
HIGH…ache/paimon/spark/sql/DDLWithHiveCatalogTestBase.scala0|create table rtas (id bigint, data string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '2') |STRING
HIGH…st/scala/org/apache/paimon/spark/sql/DDLTestBase.scala0|replace table rt (id bigint, name string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '4') |STRING
HIGH…paimon/spark/sql/ReplaceTableWithRestCatalogTest.scala0|replace table rt (id bigint, name string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '4') |STRING
HIGH…ache/paimon/spark/sql/DDLWithHiveCatalogTestBase.scala0|replace table rt (id bigint, name string) |using paimon |tblproperties ('primary-key' = 'id', 'bucket' = '4') |STRING
HIGH…paimon/spark/sql/MergeIntoNotMatchedBySourceTest.scala0|merge into target |using source |on target.a = source.a |when matched and target.a = 5 then update set b = source.b + tSTRING
HIGH…a/org/apache/paimon/spark/sql/DeletionVectorTest.scala0|merge into target |using source |on target.a = source.a |when matched and target.a = 5 then update set b = source.b + tSTRING
HIGH…g/apache/paimon/spark/sql/MergeIntoTableTestBase.scala0|merge into target |using source |on target.a = source.a |when matched and target.a = 5 then update set b = source.b + tSTRING
HIGH…/org/apache/paimon/spark/sql/RowTrackingTestBase.scala0|merge into target |using source |on target.a = source.a |when matched and target.a = 5 then update set b = source.b + tSTRING
Deep Nesting241 hits · 219 pts
SeverityFileLineSnippetContext
LOWpaimon-python/setup.py51CODE
LOWpaimon-python/setup.py124CODE
LOWpaimon-python/pypaimon/write/postpone_bucket.py259CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py207CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py438CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py545CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py896CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1005CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1042CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1078CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py1185CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py463CODE
LOWpaimon-python/pypaimon/write/table_update_by_row_id.py528CODE
LOW…mon-python/pypaimon/write/commit/conflict_detection.py125CODE
LOW…mon-python/pypaimon/write/commit/conflict_detection.py668CODE
LOW…on/pypaimon/write/commit/overwrite_changes_provider.py54CODE
LOW…mon-python/pypaimon/write/writer/data_vector_writer.py199CODE
LOWpaimon-python/pypaimon/write/writer/data_writer.py214CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py236CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py382CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py495CODE
LOW…imon-python/pypaimon/write/writer/format_row_writer.py233CODE
LOWpaimon-python/pypaimon/benchmark/clickbench_format.py171CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py166CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py237CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py325CODE
LOWpaimon-python/pypaimon/snapshot/time_travel_util.py69CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py332CODE
LOWpaimon-python/pypaimon/catalog/table_query_auth.py66CODE
LOWpaimon-python/pypaimon/catalog/jdbc_catalog.py47CODE
LOWpaimon-python/pypaimon/catalog/rest/fuse_support.py39CODE
LOW…imon-python/pypaimon/manifest/manifest_file_manager.py55CODE
LOW…imon-python/pypaimon/manifest/manifest_file_manager.py96CODE
LOW…mon-python/pypaimon/manifest/simple_stats_evolution.py71CODE
LOWpaimon-python/pypaimon/manifest/schema/file_entry.py92CODE
LOWpaimon-python/pypaimon/read/merge_engine_support.py233CODE
LOWpaimon-python/pypaimon/read/merge_engine_support.py253CODE
LOWpaimon-python/pypaimon/read/table_read.py130CODE
LOWpaimon-python/pypaimon/read/table_read.py238CODE
LOWpaimon-python/pypaimon/read/table_read.py422CODE
LOWpaimon-python/pypaimon/read/table_read.py705CODE
LOWpaimon-python/pypaimon/read/table_read.py133CODE
LOWpaimon-python/pypaimon/read/split_read.py225CODE
LOWpaimon-python/pypaimon/read/split_read.py638CODE
LOWpaimon-python/pypaimon/read/split_read.py1306CODE
LOWpaimon-python/pypaimon/read/split_read.py1467CODE
LOWpaimon-python/pypaimon/read/streaming_table_scan.py128CODE
LOWpaimon-python/pypaimon/read/table_scan.py411CODE
LOWpaimon-python/pypaimon/read/sliced_split.py106CODE
LOW…mon-python/pypaimon/read/reader/auth_masking_reader.py46CODE
LOWpaimon-python/pypaimon/read/reader/lance_utils.py26CODE
LOWpaimon-python/pypaimon/read/reader/field_bunch.py74CODE
LOW…on-python/pypaimon/read/reader/format_mosaic_reader.py178CODE
LOW…n-python/pypaimon/read/reader/format_pyarrow_reader.py170CODE
LOW…n-python/pypaimon/read/reader/format_pyarrow_reader.py249CODE
LOW…n-python/pypaimon/read/reader/format_pyarrow_reader.py397CODE
LOW…imon-python/pypaimon/read/reader/shard_batch_reader.py36CODE
LOW…imon-python/pypaimon/read/reader/format_blob_reader.py107CODE
LOW…imon-python/pypaimon/read/reader/format_blob_reader.py211CODE
LOW…imon-python/pypaimon/read/reader/format_blob_reader.py224CODE
181 more matches not shown…
Unused Imports209 hits · 200 pts
SeverityFileLineSnippetContext
LOWpaimon-python/pypaimon/__init__.py26CODE
LOWpaimon-python/pypaimon/__init__.py27CODE
LOWpaimon-python/pypaimon/__init__.py28CODE
LOWpaimon-python/pypaimon/__init__.py29CODE
LOWpaimon-python/pypaimon/__init__.py30CODE
LOWpaimon-python/pypaimon/__init__.py22CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py35CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py36CODE
LOWpaimon-python/pypaimon/write/table_write.py33CODE
LOWpaimon-python/pypaimon/write/commit_message.py24CODE
LOWpaimon-python/pypaimon/branch/__init__.py18CODE
LOWpaimon-python/pypaimon/branch/__init__.py18CODE
LOWpaimon-python/pypaimon/branch/__init__.py19CODE
LOWpaimon-python/pypaimon/branch/__init__.py20CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py18CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py19CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py20CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py20CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py20CODE
LOWpaimon-python/pypaimon/changelog/__init__.py18CODE
LOWpaimon-python/pypaimon/changelog/__init__.py19CODE
LOWpaimon-python/pypaimon/catalog/jdbc_catalog.py38CODE
LOWpaimon-python/pypaimon/manifest/__init__.py23CODE
LOW…imon-python/pypaimon/read/reader/aggregate/__init__.py84CODE
LOW…imon-python/pypaimon/read/reader/aggregate/__init__.py35CODE
LOW…n/pypaimon/tests/ray_data_evolution_merge_into_test.py36CODE
LOWpaimon-python/pypaimon/tests/table_merge_into_test.py38CODE
LOWpaimon-python/pypaimon/tests/reader_append_only_test.py331CODE
LOWpaimon-python/pypaimon/tests/reader_append_only_test.py409CODE
LOWpaimon-python/pypaimon/tests/reader_append_only_test.py457CODE
LOWpaimon-python/pypaimon/tests/reader_append_only_test.py540CODE
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1340CODE
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1373CODE
LOW…python/pypaimon/tests/e2e/hdfs/hdfs_native_e2e_test.py52CODE
LOWpaimon-python/pypaimon/tests/daft/daft_catalog_test.py21CODE
LOWpaimon-python/pypaimon/tests/daft/daft_explain_test.py21CODE
LOWpaimon-python/pypaimon/tests/daft/daft_data_test.py25CODE
LOW…on-python/pypaimon/tests/daft/daft_integration_test.py21CODE
LOWpaimon-python/pypaimon/tests/daft/daft_sink_test.py26CODE
LOW…/pypaimon/tests/daft/daft_pk_distributed_write_test.py21CODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py21CODE
LOW…mon-python/pypaimon/tests/daft/daft_on_ray_e2e_test.py25CODE
LOWpaimon-python/pypaimon/tests/rest/rest_server.py29CODE
LOWpaimon-python/pypaimon/cli/__init__.py18CODE
LOWpaimon-python/pypaimon/function/__init__.py18CODE
LOWpaimon-python/pypaimon/function/__init__.py18CODE
LOWpaimon-python/pypaimon/function/__init__.py19CODE
LOWpaimon-python/pypaimon/function/__init__.py19CODE
LOWpaimon-python/pypaimon/function/__init__.py19CODE
LOWpaimon-python/pypaimon/function/__init__.py19CODE
LOWpaimon-python/pypaimon/function/__init__.py19CODE
LOWpaimon-python/pypaimon/function/__init__.py23CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py20CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py20CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py20CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py20CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py20CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py27CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py27CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py28CODE
149 more matches not shown…
Cross-Language Confusion29 hits · 181 pts
SeverityFileLineSnippetContext
HIGH…imon-python/pypaimon/manifest/schema/data_file_meta.py64 """Row-id range, failing fast if first_row_id is null (mirrors Java nonNullRowIdRange)."""STRING
HIGH…/pypaimon/read/reader/partial_update_merge_function.py24writes "fill in" fields the earlier writes left null, so users canSTRING
HIGH…hon/pypaimon/read/reader/aggregation_merge_function.py25earlier writes left null; ``AggregateMergeFunction`` runs an actualSTRING
HIGH…ython/pypaimon/read/scanner/bucket_select_converter.py216 # An empty slot (e.g. all literals were null) collapses theCOMMENT
HIGHpaimon-python/pypaimon/tests/ray_read_by_row_id_test.py431 self.assertTrue(real_schema.equals(empty.schema().base_schema))CODE
HIGHpaimon-python/pypaimon/tests/reader_parallel_test.py448 self.assertTrue(serial.equals(parallel))CODE
HIGHpaimon-python/pypaimon/tests/reader_parallel_test.py212 self.assertTrue(df_serial.equals(df_parallel))CODE
HIGHpaimon-python/pypaimon/tests/reader_parallel_test.py226 self.assertTrue(serial_df.equals(parallel_df))CODE
HIGHpaimon-python/pypaimon/tests/reader_parallel_test.py477 self.assertTrue(df_s.equals(df_p))CODE
HIGH…on-python/pypaimon/tests/schema_evolution_read_test.py719 # while the old (non-null) file still reads correctly.COMMENT
HIGHpaimon-python/pypaimon/tests/filesystem_catalog_test.py370 # Default option (disabled=true) rejects nullable -> not null, mirroringCOMMENT
HIGHpaimon-python/pypaimon/tests/variant_test.py407 self._check('{"n":null,"b":true,"i":42,"s":"hello","f":1.5}')CODE
HIGHpaimon-python/pypaimon/tests/row_to_string_test.py53 self.assertEqual("{null, a}", cast_row_to_string(_row(("INT", None),CODE
HIGHpaimon-python/pypaimon/tests/data_evolution_test.py862 self.assertEqual(arrow_res3.num_rows, 0) # Arrow: NULL==NULL is null, filtered outCODE
HIGHpaimon-python/pypaimon/tests/reader_append_only_test.py1105 # partition value: isNull keeps null, drops non-null; equal is the reverse.COMMENT
HIGH…on/pypaimon/tests/schema_evolution_nested_read_test.py644 self.assertEqual(rows[1]['mv'], '{null, x}')CODE
HIGH…n-python/pypaimon/tests/filesystem_catalog_tag_test.py126 # duration string (matching Java's Duration.toString()).COMMENT
HIGHpaimon-python/pypaimon/tests/system/tags_table_test.py139 # duration string (Java Duration.toString()).COMMENT
HIGH…mon-python/pypaimon/tests/api/test_branch_dto_serde.py55 # @Nullable behavior; jackson serializes nullable Long as null).COMMENT
HIGH…mon-python/pypaimon/tests/api/test_branch_dto_serde.py71 # must serialize to {} (not null, not an array, not absent).COMMENT
HIGHpaimon-python/pypaimon/tests/daft/daft_blob_test.py75 # io_config is null without creds; embedded only for valid (non-null) rows with creds.COMMENT
HIGH…thon/pypaimon/tests/daft/daft_blob_native_read_test.py115 # must still be read (as null) via fallback, not dropped.COMMENT
HIGH…on-python/pypaimon/tests/daft/daft_integration_test.py497 assert pypaimon_result.equals(expected_result)CODE
HIGHpaimon-python/pypaimon/common/time_utils.py222 """Render a non-negative ``timedelta`` like ``java.time.Duration.toString()``.STRING
HIGHpaimon-python/pypaimon/common/predicate_json_parser.py146 All comparison results are coerced from three-valued (PyArrow null) toSTRING
HIGHpaimon-python/pypaimon/data/variant_shredding.py436 # if typed_value is null → use overflow bytes directlyCOMMENT
HIGHpaimon-python/pypaimon/ray/data_evolution_merge_join.py520 "_ROW_ID is null; planner snapshot is stale "CODE
HIGHpaimon-python/pypaimon/ray/data_evolution_merge_join.py689 "_ROW_ID is null; the planner snapshot is stale or the row ids "CODE
HIGHpaimon-python/pypaimon/ray/data_evolution_merge_join.py808 "_ROW_ID is null; planner snapshot is stale "CODE
Verbosity Indicators97 hits · 179 pts
SeverityFileLineSnippetContext
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java518 // Step 1: baselineCOMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java525 // Step 2: drop v2 → [k, v1]COMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java531 // Step 3: option-only alter — same fields [k, v1], increments Paimon schema IDCOMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java537 // Step 4: re-add v2 as BIGINT — new field ID, distinct from original v2 (STRING)COMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java88 // Step 1: Convert CDC Schema to Paimon SchemaCOMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java92 // Step 2: Validate Paimon SchemaCOMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java132 // Step 3: Convert it backCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java229 // Step 1: Convert CDC Event to Paimon EventCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java236 // Step 2: Check Paimon Row specsCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java248 // Step 3: Convert it backCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java255 // Step 4: Validate itCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1205 // Step 1: Create a Paimon table with blob field via Flink SQLCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1217 // Step 2: Get the Paimon FileStoreTable and its RowTypeCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1221 // Step 3: Create a Flink temporary table with the same schema (BYTES column)COMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1239 // Step 4: Convert Paimon RowType to Flink RowType via LogicalTypeConversionCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1243 // Step 5: Assert that schemaEquals considers them equalCOMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2091 // Step 1: Write delta data at dt=20250808COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2096 // Step 2: Start streaming job (captures delta position)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2099 // Step 3: Collect Phase 1 output (should include delta@20250808)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2106 // Step 4: Write NEW snapshot data at dt=20250809 (simulates race condition)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2111 // Step 5: Write NEW delta data at dt=20250810COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2116 // Step 6: Collect Phase 2 output (should include delta@20250810)COMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java240 // Step 1: prepend key columns to each row: (key, value) -> JoinedRowCOMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java276 // Step 2: local sort by key columns (no shuffle)COMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java292 // Step 3: remove the prepended key columns and convert back to RowDataCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java158 // Step 1: Build CanonicalizedHeaders (x-acs-* headers, sorted, lowercase)COMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java161 // Step 2: Build CanonicalizedResource (path + sorted query string)COMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java164 // Step 3: Build StringToSignCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java172 // Step 4: Calculate signatureCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java175 // Step 5: Build Authorization headerCOMMENT
LOWpaimon-python/dev/run_mixed_tests.sh751 # Step 1: Java writes 5 base filesCOMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py744 # Step 1: Write data to Paimon table using write_arrow (large_binary type)COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py759 # Step 2: Read from Paimon table using to_ray()COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py783 # Step 3: Simulate user pipeline: map_batches returns Python dict,COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py802 # Step 4: Write mapped dataset back via write_ray().COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py813 # Step 5: Verify the data was written correctlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py56 # Step 1: Create table with a, b, c, d columns (all int32)COMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py71 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py87 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py125 # Step 4: Verify the resultCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py158 # Step 1: Create table with a, b, c, d columns (all int32)COMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py173 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py190 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py224 # Step 4: Verify the resultCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py265 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py282 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py311 # Step 4: Verify the resultCOMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1367 # Step 1: Create table with [f0, f1]COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1396 # Step 3: Schema evolution - add column f2COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1403 # Step 4: Write f2 only for same rows (first_row_id = 0)COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1380 # Step 2: Write data with ALL columns of old schema → write_cols = NoneCOMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1419 # Step 5: Read all columnsCOMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1742 # Step 2: pypaimon shard update - scan and prepare commitCOMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1765 # Step 3: Java compact (compact happening between scan and commit)COMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1782 # Step 4: pypaimon rewrites stale evolution files against the compacted rangeCOMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java800 // Step 1: write data with schemaId=0COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java803 // Step 2: ALTER TABLE SET an unrelated option -> schemaId becomes 1COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java807 // Step 3: write more data with schemaId=1COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java810 // Step 4: compact blob table using DataEvolutionCompactCoordinatorCOMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java981 // Step 1: write blob data — blob files record writeCols=["f2"]COMMENT
37 more matches not shown…
Structural Annotation Overuse97 hits · 178 pts
SeverityFileLineSnippetContext
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java518 // Step 1: baselineCOMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java525 // Step 2: drop v2 → [k, v1]COMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java531 // Step 3: option-only alter — same fields [k, v1], increments Paimon schema IDCOMMENT
LOW…e/paimon/iceberg/IcebergRestMetadataCommitterTest.java537 // Step 4: re-add v2 as BIGINT — new field ID, distinct from original v2 (STRING)COMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java88 // Step 1: Convert CDC Schema to Paimon SchemaCOMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java92 // Step 2: Validate Paimon SchemaCOMMENT
LOW…/paimon/flink/pipeline/cdc/util/TypeConverterTest.java132 // Step 3: Convert it backCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java229 // Step 1: Convert CDC Event to Paimon EventCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java236 // Step 2: Check Paimon Row specsCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java248 // Step 3: Convert it backCOMMENT
LOW…he/paimon/flink/pipeline/cdc/util/DataConvertTest.java255 // Step 4: Validate itCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1205 // Step 1: Create a Paimon table with blob field via Flink SQLCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1217 // Step 2: Get the Paimon FileStoreTable and its RowTypeCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1221 // Step 3: Create a Flink temporary table with the same schema (BYTES column)COMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1239 // Step 4: Convert Paimon RowType to Flink RowType via LogicalTypeConversionCOMMENT
LOW…test/java/org/apache/paimon/flink/BlobTableITCase.java1243 // Step 5: Assert that schemaEquals considers them equalCOMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2091 // Step 1: Write delta data at dt=20250808COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2096 // Step 2: Start streaming job (captures delta position)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2099 // Step 3: Collect Phase 1 output (should include delta@20250808)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2106 // Step 4: Write NEW snapshot data at dt=20250809 (simulates race condition)COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2111 // Step 5: Write NEW delta data at dt=20250810COMMENT
LOW…ava/org/apache/paimon/flink/FlinkChainTableITCase.java2116 // Step 6: Collect Phase 2 output (should include delta@20250810)COMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java240 // Step 1: prepend key columns to each row: (key, value) -> JoinedRowCOMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java276 // Step 2: local sort by key columns (no shuffle)COMMENT
LOW…he/paimon/flink/compact/IncrementalClusterCompact.java292 // Step 3: remove the prepended key columns and convert back to RowDataCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java158 // Step 1: Build CanonicalizedHeaders (x-acs-* headers, sorted, lowercase)COMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java161 // Step 2: Build CanonicalizedResource (path + sorted query string)COMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java164 // Step 3: Build StringToSignCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java172 // Step 4: Calculate signatureCOMMENT
LOW…java/org/apache/paimon/rest/auth/DLFOpenApiSigner.java175 // Step 5: Build Authorization headerCOMMENT
LOWpaimon-python/dev/run_mixed_tests.sh751 # Step 1: Java writes 5 base filesCOMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py744 # Step 1: Write data to Paimon table using write_arrow (large_binary type)COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py759 # Step 2: Read from Paimon table using to_ray()COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py783 # Step 3: Simulate user pipeline: map_batches returns Python dict,COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py802 # Step 4: Write mapped dataset back via write_ray().COMMENT
LOWpaimon-python/pypaimon/tests/ray_data_test.py813 # Step 5: Verify the data was written correctlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py56 # Step 1: Create table with a, b, c, d columns (all int32)COMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py71 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py87 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py125 # Step 4: Verify the resultCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py158 # Step 1: Create table with a, b, c, d columns (all int32)COMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py173 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py190 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py224 # Step 4: Verify the resultCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py265 # Step 2: Write initial data for a, b, c columns onlyCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py282 # Step 3: Use ShardTableUpdator to compute d = c + b - aCOMMENT
LOW…imon-python/pypaimon/tests/shard_table_updator_test.py311 # Step 4: Verify the resultCOMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1367 # Step 1: Create table with [f0, f1]COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1396 # Step 3: Schema evolution - add column f2COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1403 # Step 4: Write f2 only for same rows (first_row_id = 0)COMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1380 # Step 2: Write data with ALL columns of old schema → write_cols = NoneCOMMENT
LOWpaimon-python/pypaimon/tests/data_evolution_test.py1419 # Step 5: Read all columnsCOMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1742 # Step 2: pypaimon shard update - scan and prepare commitCOMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1765 # Step 3: Java compact (compact happening between scan and commit)COMMENT
LOW…n-python/pypaimon/tests/e2e/java_py_read_write_test.py1782 # Step 4: pypaimon rewrites stale evolution files against the compacted rangeCOMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java800 // Step 1: write data with schemaId=0COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java803 // Step 2: ALTER TABLE SET an unrelated option -> schemaId becomes 1COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java807 // Step 3: write more data with schemaId=1COMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java810 // Step 4: compact blob table using DataEvolutionCompactCoordinatorCOMMENT
LOW…/test/java/org/apache/paimon/append/BlobTableTest.java981 // Step 1: write blob data — blob files record writeCols=["f2"]COMMENT
37 more matches not shown…
Self-Referential Comments54 hits · 169 pts
SeverityFileLineSnippetContext
MEDIUM…hon/pypaimon/deletionvectors/bitmap_deletion_vector.py100 # Create the full data with magic numberCOMMENT
MEDIUM…on-python/pypaimon/manifest/simple_stats_evolutions.py57 # Create a mapping from field IDs to indices in data_fields.COMMENT
MEDIUMpaimon-python/pypaimon/read/split_read.py773 # Create a callable method to read the deletion vectorCOMMENT
MEDIUMpaimon-python/pypaimon/read/split_read.py1008 # Create a dict mapping data file name to deletion file reader methodCOMMENT
MEDIUMpaimon-python/pypaimon/read/split_read.py1326 # Create the union readerCOMMENT
MEDIUM…-python/pypaimon/read/reader/data_file_batch_reader.py407 # Create a new array that fills with max_sequence_numberCOMMENT
MEDIUM…imon-python/pypaimon/read/datasource/ray_datasource.py143 # Create a partial function to avoid capturing self in closureCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py1790 # Create a valid blob file firstCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py124 # Create a temporary directory and fileCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py1287 # Create a descriptorCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py1701 # Create a table with multiple columns (should fail - blob format requires single column)COMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py1743 # Create a valid blob file firstCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py1828 # Create a blob file with substantial contentCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_test.py2082 # Create a BlobDescriptor pointing to the local fileCOMMENT
MEDIUMpaimon-python/pypaimon/tests/oss_file_io_test.py85 # Create a test directoryCOMMENT
MEDIUMpaimon-python/pypaimon/tests/oss_file_io_test.py246 # Create a fileCOMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_base_test.py536 # Create a catalog and tableCOMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_base_test.py553 # Create a ManifestFileManagerCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py172 # Create a different config fileCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py281 # Create a CSV file with test dataCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py322 # Create a JSON file with test dataCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py362 # Create a table to dropCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py374 # Create the table firstCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py1061 # Create a dedicated table for this test with two batches of dataCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py1126 # Create a table to renameCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py1335 # Create a table with no dataCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py1357 # Create a partitioned table for drop-partition testCOMMENT
MEDIUMpaimon-python/pypaimon/tests/cli_table_test.py1401 # Create a partitioned tableCOMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_primary_key_test.py568 # Create a unique table for each iterationCOMMENT
MEDIUM…-python/pypaimon/tests/delta_varint_compressor_test.py175 # Create a sequence with small deltasCOMMENT
MEDIUMpaimon-python/pypaimon/tests/binary_row_test.py224 # Create a 10-column append table and write 10 rowsCOMMENT
MEDIUMpaimon-python/pypaimon/tests/reader_append_only_test.py917 # Create a unique table for each iterationCOMMENT
MEDIUMpaimon-python/pypaimon/tests/blob_table_test.py4709 # Create a unique table for each iterationCOMMENT
MEDIUM…n-python/pypaimon/tests/filesystem_catalog_tag_test.py230 # Create a second snapshotCOMMENT
MEDIUM…n-python/pypaimon/tests/filesystem_catalog_tag_test.py252 # Create a second snapshotCOMMENT
MEDIUMpaimon-python/pypaimon/tests/branch_manager_test.py127 # Create a mock manager with minimal dependenciesCOMMENT
MEDIUMpaimon-python/pypaimon/tests/branch_manager_test.py178 # Create a branch directoryCOMMENT
MEDIUM…-python/pypaimon/tests/py36/rest_ao_read_write_test.py813 # Create a ManifestFileManagerCOMMENT
MEDIUM…python/pypaimon/tests/manifest/manifest_schema_test.py77 # Create a mapping of field names to field definitions for easier testingCOMMENT
MEDIUM…python/pypaimon/tests/manifest/manifest_schema_test.py126 # Create a mapping of field names to field definitions for easier testingCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py135 # Create a regular table and branch, then select the branch via theCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py176 # Create a new branchCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py243 # Create a new table with catalog environmentCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py376 # Create a branch firstCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py424 # Create a table with a commentCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py440 # Create a table with a commentCOMMENT
MEDIUM…n-python/pypaimon/tests/table/file_store_table_test.py462 # Create a write builderCOMMENT
MEDIUMpaimon-python/pypaimon/tests/table/simple_table_test.py188 # Create a tagCOMMENT
MEDIUMpaimon-python/pypaimon/tests/table/simple_table_test.py252 # Create a tagCOMMENT
MEDIUMpaimon-python/pypaimon/tests/table/simple_table_test.py260 # Create the same tag with ignore_if_exists=True - should not raise errorCOMMENT
MEDIUMpaimon-python/pypaimon/tests/table/simple_table_test.py289 # Create a tagCOMMENT
MEDIUM…-python/pypaimon/tests/rest/rest_token_file_io_test.py186 # Create a token with a standard OSS endpointCOMMENT
MEDIUMpaimon-python/pypaimon/table/file_store_table.py79 # Create a placeholder identifierCOMMENT
MEDIUMpaimon-python/pypaimon/data/generic_variant.py515 # Create an Arrow StructArray ready for writingSTRING
Docstring Block Structure24 hits · 120 pts
SeverityFileLineSnippetContext
HIGHpaimon-python/pypaimon/snapshot/snapshot_commit.py81 Commit the given snapshot. Args: base_snapshot_uuid: UUID of the snapshot on which the comSTRING
HIGH…n-python/pypaimon/snapshot/renaming_snapshot_commit.py56 Commit the snapshot using file renaming. Args: base_snapshot_uuid: UUID of the base snapshSTRING
HIGHpaimon-python/pypaimon/snapshot/time_travel_util.py74 Try to travel to a snapshot based on the options. Supports the following time travel options: STRING
HIGH…on-python/pypaimon/snapshot/catalog_snapshot_commit.py52 Commit the snapshot using the catalog. Args: base_snapshot_uuid: UUID of the snapshot on wSTRING
HIGHpaimon-python/pypaimon/changelog/changelog_manager.py157Try to get a changelog for the given snapshot ID. Args: snapshot_id: Snapshot ID Returns: STRING
HIGHpaimon-python/pypaimon/catalog/catalog.py142Load the snapshot of table identified by the given Identifier. Args: identifier: Path of the table STRING
HIGHpaimon-python/pypaimon/catalog/catalog.py212List partitions of a table with pagination. Args: identifier: Path of the table. max_reSTRING
HIGHpaimon-python/pypaimon/catalog/catalog.py282 List all branches for the table. Args: identifier: Table identifier Returns: STRING
HIGHpaimon-python/pypaimon/catalog/catalog.py366Get a tag of a table. Args: identifier: Table identifier (Identifier or string). tag_naSTRING
HIGHpaimon-python/pypaimon/catalog/catalog.py389List tags of a table with pagination. Args: identifier: Table identifier (Identifier or string). STRING
HIGHpaimon-python/pypaimon/catalog/rest/rest_catalog.py107 Commit the Snapshot for table identified by the given Identifier. Args: identifier: Path oSTRING
HIGHpaimon-python/pypaimon/catalog/rest/rest_catalog.py383Load the latest snapshot for table. Args: identifier: Path of the table (Identifier or string). STRING
HIGHpaimon-python/pypaimon/manifest/schema/file_entry.py93Merge file entries: ADD and DELETE of the same file cancel each other. - ADD: if identifier already in map, raiSTRING
HIGH…n-python/pypaimon/read/reader/aggregate/aggregators.py282 Return the projected fields as a tuple. Args: element: Either an ``InternalRow`` or a ``diSTRING
HIGHpaimon-python/pypaimon/cli/cli.py33 Load catalog configuration from a YAML file. Args: config_path: Path to the catalog configuration STRING
HIGHpaimon-python/pypaimon/common/where_parser.py73Parse a SQL-like WHERE clause string into a Predicate. Args: where_string: The WHERE clause string (withoutSTRING
HIGHpaimon-python/pypaimon/common/options/options_utils.py31 Convert a value to the target type. Args: value: The value to convert target_tSTRING
HIGHpaimon-python/pypaimon/table/instant.py65Deserialize an Instant from a dictionary. Args: data: A dictionary with a 'type' field indicating tSTRING
HIGHpaimon-python/pypaimon/api/rest_api.py353 Commit snapshot for table. Args: identifier: Database name and table name tablSTRING
HIGHpaimon-python/pypaimon/consumer/consumer.py44 Load consumer from file path with retry mechanism. Args: file_io: FileIO instance for readSTRING
HIGHpaimon-python/pypaimon/data/variant_shredding.py667Parse the ``variant.shreddingSchema`` option value. Args: json_str: JSON-encoded Paimon ROW type where eachSTRING
HIGHpaimon-python/pypaimon/tag/tag_manager.py102 Return the tag or throw exception indicating the tag not found. Args: tag_name: NaSTRING
HIGH…python/pypaimon/globalindex/btree/btree_file_footer.py75 Read footer from byte data. Args: data: Byte data containing the footer STRING
HIGH…imon-python/pypaimon/globalindex/btree/block_reader.py57Seek to slice position from record position. Args: record_position: The record position to STRING
Modern Structural Boilerplate70 hits · 70 pts
SeverityFileLineSnippetContext
LOWpaimon-python/pypaimon/__init__.py32__all__ = [CODE
LOWpaimon-python/pypaimon/write/table_commit.py23logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/file_store_commit.py55logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/ray_datasink.py38logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/table_upsert_by_key.py35logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/row_key_extractor.py35logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/file_store_write.py25logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/write/writer/blob_writer.py29logger = logging.getLogger(__name__)CODE
LOW…mon-python/pypaimon/write/writer/data_vector_writer.py32logger = logging.getLogger(__name__)CODE
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py43logger = logging.getLogger(__name__)CODE
LOW…n-python/pypaimon/snapshot/renaming_snapshot_commit.py23logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/snapshot/snapshot_manager.py24logger = logging.getLogger(__name__)CODE
LOW…on-python/pypaimon/snapshot/catalog_snapshot_commit.py27logger = logging.getLogger(__name__)CODE
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py28logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/branch/__init__.py22__all__ = ['BranchManager', 'DEFAULT_MAIN_BRANCH', 'CatalogBranchManager', 'FileSystemBranchManager']CODE
LOWpaimon-python/pypaimon/branch/branch_manager.py23logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/deletionvectors/__init__.py26__all__ = [CODE
LOWpaimon-python/pypaimon/changelog/changelog_manager.py27logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/changelog/__init__.py21__all__ = ['Changelog', 'ChangelogManager']CODE
LOWpaimon-python/pypaimon/changelog/changelog.py24logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/catalog/rest/rest_catalog.py57logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/catalog/rest/fuse_support.py25logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/read/table_scan.py33logger = logging.getLogger(__name__)CODE
LOW…hon/pypaimon/read/reader/filter_record_batch_reader.py33logger = logging.getLogger(__name__)CODE
LOW…imon-python/pypaimon/read/datasource/ray_datasource.py36logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/read/scanner/file_scanner.py23logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/tests/rest/rest_server.py1052 def set_table_token(self, identifier: Identifier, token: "RESTToken") -> None:CODE
LOWpaimon-python/pypaimon/utils/file_type.py25logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/filesystem/pvfs.py47logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/cli/__init__.py20__all__ = ['main']CODE
LOWpaimon-python/pypaimon/multimodal/__init__.py41__all__ = [CODE
LOWpaimon-python/pypaimon/common/options/__init__.py23__all__ = [CODE
LOWpaimon-python/pypaimon/table/rollback_helper.py22logger = logging.getLogger(__name__)CODE
LOW…mon-python/pypaimon/table/data_evolution_merge_into.py60__all__ = [CODE
LOWpaimon-python/pypaimon/table/iceberg/__init__.py20__all__ = ["IcebergTable"]CODE
LOWpaimon-python/pypaimon/table/system/__init__.py20__all__ = ["SystemTable"]CODE
LOWpaimon-python/pypaimon/table/row/offset_row.py47 def set_row_kind_byte(self, row_kind_byte: int) -> None:CODE
LOWpaimon-python/pypaimon/table/row/generic_row.py569 def _set_null_bit(cls, bytes_data: bytearray, offset: int, pos: int) -> None:CODE
LOWpaimon-python/pypaimon/table/object/__init__.py24__all__ = [CODE
LOWpaimon-python/pypaimon/table/format/__init__.py27__all__ = [CODE
LOWpaimon-python/pypaimon/api/client.py298 def set_error_handler(self, error_handler: ErrorHandler) -> None:CODE
LOWpaimon-python/pypaimon/api/auth/__init__.py30__all__ = [CODE
LOWpaimon-python/pypaimon/consumer/__init__.py29__all__ = [CODE
LOWpaimon-python/pypaimon/data/__init__.py21__all__ = ['Timestamp', 'Decimal']CODE
LOWpaimon-python/pypaimon/daft/daft_datasink.py37logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/daft/daft_datasource.py68logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/daft/__init__.py22__all__ = ["explain_paimon_scan", "read_paimon", "write_paimon", "read_blob",CODE
LOWpaimon-python/pypaimon/daft/daft_predicate_visitor.py42logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/tag/__init__.py21__all__ = ["Tag", "TagManager"]CODE
LOWpaimon-python/pypaimon/tag/tag_manager.py29logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/ray/bucket_join.py37__all__ = ["bucket_join"]CODE
LOWpaimon-python/pypaimon/ray/read_by_row_id.py40__all__ = ["read_by_row_id"]CODE
LOWpaimon-python/pypaimon/ray/range_join.py37__all__ = ["range_join"]CODE
LOWpaimon-python/pypaimon/ray/update_by_row_id.py41__all__ = ["update_by_row_id"]CODE
LOWpaimon-python/pypaimon/ray/update_by_row_id.py43logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/ray/__init__.py35__all__ = [CODE
LOWpaimon-python/pypaimon/ray/process_row_id_ranges.py24__all__ = ["process_row_id_ranges"]CODE
LOWpaimon-python/pypaimon/ray/data_evolution_merge_into.py50__all__ = ["merge_into", "WhenMatched", "WhenNotMatched"]CODE
LOWpaimon-python/pypaimon/ray/data_evolution_merge_into.py52logger = logging.getLogger(__name__)CODE
LOWpaimon-python/pypaimon/globalindex/__init__.py48__all__ = [CODE
10 more matches not shown…
Redundant / Tautological Comments40 hits · 68 pts
SeverityFileLineSnippetContext
LOWpaimon-python/pypaimon/write/file_store_write.py166 # Check if table has blob columnsCOMMENT
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py226 # Check if normal data rolling is neededCOMMENT
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py461 # Check if normal data exceeds target sizeCOMMENT
LOW…ython/pypaimon/write/writer/dedicated_format_writer.py502 # Write file based on formatCOMMENT
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py214 # Check if from_branch is main branchCOMMENT
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py218 # Check if from_branch is blankCOMMENT
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py222 # Check if to_branch is blankCOMMENT
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py232 # Check if from_branch existsCOMMENT
LOW…on-python/pypaimon/branch/filesystem_branch_manager.py236 # Check if to_branch already existsCOMMENT
LOWpaimon-python/pypaimon/catalog/filesystem_catalog.py104 # Check if database still has tablesCOMMENT
LOWpaimon-python/pypaimon/catalog/filesystem_catalog.py266 # Check if table existsCOMMENT
LOWpaimon-python/pypaimon/read/split_read.py808 # Check if this is a SlicedSplit to get shard_file_idx_mapCOMMENT
LOWpaimon-python/pypaimon/read/streaming_table_scan.py180 # Check if we have a prefetched result readyCOMMENT
LOWpaimon-python/pypaimon/read/streaming_table_scan.py215 # Check if we found a scannable snapshot or skipped someCOMMENT
LOW…mon-python/pypaimon/read/reader/format_lance_reader.py50 # Read file metadata (footer only) to get actual schemaCOMMENT
LOW…imon-python/pypaimon/read/reader/shard_batch_reader.py37 # Check if reader is FormatBlobReader (blob type)COMMENT
LOW…imon-python/pypaimon/read/reader/shard_batch_reader.py52 # Check if batch is within the desired rangeCOMMENT
LOWpaimon-python/pypaimon/read/scanner/file_scanner.py173 # Check if manifest row range overlaps with any of the expected row rangesCOMMENT
LOWpaimon-python/pypaimon/read/scanner/file_scanner.py178 # Check if ranges intersectCOMMENT
LOWpaimon-python/pypaimon/read/scanner/file_scanner.py506 # Check if global index is enabledCOMMENT
LOWpaimon-python/pypaimon/read/scanner/file_scanner.py917 # Check if dv_ranges existsCOMMENT
LOW…ypaimon/read/scanner/data_evolution_split_generator.py267 # Check if file overlaps with any of the row rangesCOMMENT
LOW…ypaimon/read/scanner/data_evolution_split_generator.py284 # Check if blob file overlaps with any merged rangeCOMMENT
LOWpaimon-python/pypaimon/tests/blob_test.py1799 # Read the file and corrupt the header (last 5 bytes: index_length + version)COMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py113 # Write fileCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py118 # Read fileCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py136 # Write file using context managerCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py140 # Read fileCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py500 # Write fileCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py159 # Write file in chunksCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py224 # Write fileCOMMENT
LOWpaimon-python/pypaimon/tests/jindo_file_system_test.py240 # Write filesCOMMENT
LOWpaimon-python/pypaimon/tests/blob_table_test.py4065 # Check if the field name matches the actual blob column nameCOMMENT
LOW…n-python/pypaimon/tests/rest/rest_object_table_test.py135 # Write files via pvfs, including a nested subdirectory fileCOMMENT
LOWpaimon-python/pypaimon/tests/rest/rest_server.py1068 # Check if table existsCOMMENT
LOWpaimon-python/pypaimon/cli/cli_table.py393 # Check if table is FileStoreTableCOMMENT
LOWpaimon-python/pypaimon/schema/table_schema.py62 # Check if primary keys contain all partition keysCOMMENT
LOWpaimon-python/pypaimon/schema/schema.py76 # Check if Vector type with dedicated file formatCOMMENT
LOWpaimon-python/pypaimon/tag/tag_manager.py272 # Check if old tag existsCOMMENT
LOWpaimon-python/pypaimon/tag/tag_manager.py276 # Check if new tag already existsCOMMENT
Fake / Example Data15 hits · 14 pts
SeverityFileLineSnippetContext
LOW…ion/cdc/mongodb/strategy/MongoVersionStrategyTest.java53 assertThat(result).containsEntry("name", "John Doe");CODE
LOW…ion/cdc/mongodb/strategy/MongoVersionStrategyTest.java77 assertThat(result).containsEntry("name", "John Doe");CODE
LOW…ormat/debezium/DebeziumAvroRecordParserTestSimple.java70 afterRecord.put("name", "John Doe");CODE
LOW…source/align/AlignedContinuousFileSplitEnumerator.java70 private static final String PLACEHOLDER_SPLIT = "placeholder";CODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py272 fake_token = MagicMock()CODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py273 fake_token.token = token_payloadCODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py275 fake_file_io.token = fake_tokenCODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py312 fake_token = MagicMock()CODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py313 fake_token.token = initial_tokenCODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py315 fake_file_io.token = fake_tokenCODE
LOW…n-python/pypaimon/tests/daft/daft_catalog_rest_test.py327 fake_token.token = refreshed_tokenCODE
LOW…ache/paimon/operation/AllPlaceholdersRecordReader.java42 private static final Path PLACEHOLDER_PATH = new Path("placeholder");CODE
LOW…g/apache/paimon/data/variant/PaimonShreddingUtils.java771 new RowToColumnConverter(RowType.of(new DataField(0, "placeholder", readType)));CODE
LOW…va/org/apache/paimon/format/csv/CsvFileFormatTest.java84 // Second row: "John Doe",,"Developer" (empty middle field)COMMENT
LOW…va/org/apache/paimon/format/csv/CsvFileFormatTest.java88 assertThat(fields[0]).isEqualTo("John Doe");CODE
AI Structural Patterns11 hits · 10 pts
SeverityFileLineSnippetContext
LOW…hon/pypaimon/deletionvectors/bitmap_deletion_vector.py111CODE
LOW…imon-python/pypaimon/manifest/schema/data_file_meta.py88CODE
LOW…n-python/pypaimon/read/reader/aggregate/aggregators.py1345CODE
LOWpaimon-python/pypaimon/api/api_response.py305CODE
LOWpaimon-python/pypaimon/api/api_response.py410CODE
LOWpaimon-python/pypaimon/daft/daft_datasource.py305CODE
LOWpaimon-python/pypaimon/daft/daft_paimon.py196CODE
LOWpaimon-python/pypaimon/daft/daft_paimon.py481CODE
LOWpaimon-python/pypaimon/ray/ray_paimon.py50CODE
LOWpaimon-python/pypaimon/ray/range_join.py331CODE
LOWpaimon-python/pypaimon/globalindex/btree/block_entry.py50CODE
AI Slop Vocabulary4 hits · 8 pts
SeverityFileLineSnippetContext
LOW…on/pypaimon/write/commit/overwrite_changes_provider.py56 # Empty table: nothing existing to delete, just add the new files.COMMENT
LOWpaimon-python/pypaimon/read/split_read.py1147 # No need to merge fields, just create a single file readerCOMMENT
LOW…mon-python/pypaimon/tests/rest/test_fuse_local_path.py221 # Should not raise, just set state to FalseCOMMENT
MEDIUM…ava/org/apache/paimon/sort/zorder/ZOrderByteUtils.java41 * https://aws.amazon.com/blogs/database/z-order-indexing-for-multifaceted-queries-in-amazon-dynamodb-part-2/COMMENT
Slop Phrases1 hit · 1 pts
SeverityFileLineSnippetContext
LOWtools/releasing/update_branch_version.sh61echo "If this is a new version to be released (or a candidate to be voted on), don't forget to create a signed release tCODE
Overly Generic Function Names1 hit · 1 pts
SeverityFileLineSnippetContext
LOWpaimon-python/pypaimon/tests/rest/rest_function_test.py108 def test_function(self):CODE