Repository Analysis

apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

4.5 Likely human-written View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of apache/hudi, a Java project with 6,226 GitHub stars. SynthScan v2.0 examined 1,145,494 lines of code across 5861 source files, recording 1379 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 4.5 places this repository in the Likely human-written band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

4.5
Adjusted Score
4.5
Raw Score
100%
Time Factor
2026-08-28
Last Push
6.2K
Stars
Java
Language
1.1M
Lines of Code
5.9K
Files
1.4K
Pattern Hits
2026-08-29
Scan Date
0.07
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 297HIGH 106MEDIUM 94LOW 882

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1379 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hallucination Indicators297 hits · 3248 pts
SeverityFileLineSnippetContext
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java302 org.apache.hudi.common.schema.internal.InternalSchema internalSchema = new org.apache.hudi.common.schema.internal.InCODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java303 org.apache.hudi.common.schema.internal.Types.RecordType.get(CODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java304 org.apache.hudi.common.schema.internal.Types.Field.get(0, false, "id", org.apache.hudi.common.schema.internaCODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java306 org.apache.hudi.common.schema.internal.utils.SerDeHelper.toJson(internalSchema));CODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java385 org.apache.hudi.common.schema.internal.InternalSchema internalSchema = new org.apache.hudi.common.schema.internal.InCODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java386 org.apache.hudi.common.schema.internal.Types.RecordType.get(CODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java387 org.apache.hudi.common.schema.internal.Types.Field.get(0, false, "id", org.apache.hudi.common.schema.internaCODE
CRITICAL…/apache/hudi/common/table/TestTableSchemaResolver.java389 org.apache.hudi.common.schema.internal.utils.SerDeHelper.toJson(internalSchema));CODE
CRITICAL…hudi/common/table/timeline/TestArchivedTimelineV1.java767 archivedMetaWrapper.setHoodieCommitMetadata(org.apache.hudi.avro.model.HoodieCommitMetadata.newBuilder().build()CODE
CRITICAL…hudi/common/table/timeline/TestArchivedTimelineV1.java778 archivedMetaWrapper.setHoodieInflightReplaceMetadata(convertCommitMetadata(new org.apache.hudi.common.model.HoCODE
CRITICAL…hudi/common/table/timeline/TestArchivedTimelineV1.java785 archivedMetaWrapper.setHoodieCommitMetadata(org.apache.hudi.avro.model.HoodieCommitMetadata.newBuilder().build()CODE
CRITICAL…main/java/org/apache/hudi/tools/TimelineInspector.java319 org.apache.hudi.common.schema.HoodieSchema.fromAvroSchema(CODE
CRITICAL…/hudi/aws/TestHoodieAWSCredentialsProviderFactory.java37 AwsSessionCredentials credentials = (AwsSessionCredentials) org.apache.hudi.aws.credentials.HoodieAWSCredentialsProvCODE
CRITICAL…/hudi/aws/TestHoodieAWSCredentialsProviderFactory.java53 AwsSessionCredentials credentials = (AwsSessionCredentials) org.apache.hudi.aws.credentials.HoodieAWSCredentialsProvCODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java151 software.amazon.awssdk.services.glue.model.StorageDescriptor storageDescriptor = software.amazon.awssdk.services.gluCODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java379 software.amazon.awssdk.services.glue.model.Partition awsPart1 = software.amazon.awssdk.services.glue.model.PartitionCODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java381 software.amazon.awssdk.services.glue.model.Partition awsPart2 = software.amazon.awssdk.services.glue.model.PartitionCODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java406 software.amazon.awssdk.services.glue.model.Partition.builder()CODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java417 software.amazon.awssdk.services.glue.model.Partition.builder()CODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java903 software.amazon.awssdk.services.glue.model.StorageDescriptor storageDescriptor = software.amazon.awssdk.services.gluCODE
CRITICAL…va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java955 software.amazon.awssdk.services.glue.model.Partition.builder()CODE
CRITICAL…c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java748 Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf());CODE
CRITICAL…c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java794 Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf());CODE
CRITICAL…c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java882 Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf());CODE
CRITICAL…c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java937 Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf());CODE
CRITICAL…ava/org/apache/hudi/hive/ddl/HiveQueryDDLExecutor.java85 this.hiveDriver = new org.apache.hadoop.hive.ql.Driver(config.getHiveConf());CODE
CRITICAL…mples-spark/src/test/python/HoodiePySparkQuickstart.py43 self.dataGen = spark._jvm.org.apache.hudi.QuickstartUtils.DataGenerator()CODE
CRITICAL…mples-spark/src/test/python/HoodiePySparkQuickstart.py85 inserts = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateInserts(10))CODE
CRITICAL…mples-spark/src/test/python/HoodiePySparkQuickstart.py92 updates = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateUniqueUpdatesCODE
CRITICAL…mples-spark/src/test/python/HoodiePySparkQuickstart.py219 inserts = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateInserts(10))CODE
CRITICAL…pache/hudi/examples/spark/HoodieMorCompactionJob.scala78 client.commitCompaction(instant.get(), result, org.apache.hudi.common.util.Option.empty())CODE
CRITICAL…i/hadoop/utils/TestHoodieRealtimeInputFormatUtils.java40 hadoopConf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());CODE
CRITICAL…di/hadoop/realtime/TestHoodieRealtimeRecordReader.java128 storageConf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());CODE
CRITICAL…a/org/apache/hudi/io/hfile/TestHFileCompatibility.java278 org.apache.hudi.io.hfile.HFileContext context = org.apache.hudi.io.hfile.HFileContext.builder()CODE
CRITICAL…/hudi/timeline/service/TimelineServiceTestHarness.java172 response = org.apache.http.client.fluent.Request.Get(url).connectTimeout(10000).socketTimeout(10000).execute()CODE
CRITICAL…/hudi/timeline/service/TimelineServiceTestHarness.java176 response = org.apache.http.client.fluent.Request.Post(url).connectTimeout(10000).socketTimeout(10000).execute(CODE
CRITICAL…k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala430 ctx.errorCapturingUnitToUnitInterval.body.from.getText.toLowerCase(Locale.ROOT)CODE
CRITICAL…k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala431 val toUnit = ctx.errorCapturingUnitToUnitInterval.body.to.getText.toLowerCase(Locale.ROOT)CODE
CRITICAL…k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala445 ctx.errorCapturingMultiUnitsInterval.body.unit.asScala.map(CODE
CRITICAL…spark/sql/parser/HoodieSpark4_2ExtendedSqlParser.scala203 new org.antlr.v4.runtime.misc.Pair(token.getTokenSource, token.getInputStream),CODE
CRITICAL…spark/sql/parser/HoodieSpark4_1ExtendedSqlParser.scala203 new org.antlr.v4.runtime.misc.Pair(token.getTokenSource, token.getInputStream),CODE
CRITICAL…k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala430 ctx.errorCapturingUnitToUnitInterval.body.from.getText.toLowerCase(Locale.ROOT)CODE
CRITICAL…k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala431 val toUnit = ctx.errorCapturingUnitToUnitInterval.body.to.getText.toLowerCase(Locale.ROOT)CODE
CRITICAL…k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala445 ctx.errorCapturingMultiUnitsInterval.body.unit.asScala.map(CODE
CRITICAL…ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala66 org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], plan)CODE
CRITICAL…ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala79 org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], LocalRelaCODE
CRITICAL…ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala93 org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], LocalRelaCODE
CRITICAL…n/scala/org/apache/spark/sql/Spark4DataFrameUtil.scala38 org.apache.spark.sql.classic.Dataset.ofRows(sparkSession.asInstanceOf[org.apache.spark.sql.classic.SparkSession], loCODE
CRITICAL…a/org/apache/spark/sql/adapter/BaseSpark4Adapter.scala181 org.apache.spark.sql.classic.Dataset.ofRows(sqlContext.sparkSession.asInstanceOf[org.apache.spark.sql.classic.SparkSCODE
CRITICAL…apache/hudi/io/storage/TestHoodieSparkLanceWriter.java710 StructType blobStruct = (StructType) org.apache.spark.sql.types.BlobType.dataType();CODE
CRITICAL…rg/apache/hudi/table/upgrade/TestUpgradeDowngrade.java888 org.apache.hudi.common.table.view.HoodieTableFileSystemView.fileListingBasedFileSystemView(CODE
CRITICAL…rg/apache/hudi/table/upgrade/TestUpgradeDowngrade.java892 List<String> partitionPaths = org.apache.hudi.common.fs.FSUtils.getAllPartitionPaths(CODE
CRITICAL…on/rollback/TestMergeOnReadRollbackActionExecutor.java399 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(statusesList);CODE
CRITICAL…functional/TestSparkNonBlockingConcurrencyControl.java780 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses);CODE
CRITICAL…he/hudi/functional/TestSparkClusteringCornerCases.java81 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses);CODE
CRITICAL…i/functional/TestColStatsRecordWithMetadataRecord.java534 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses);CODE
CRITICAL…he/hudi/functional/TestSparkSortAndSizeClustering.java245 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatues);CODE
CRITICAL…/apache/hudi/functional/TestConsistentBucketIndex.java278 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatues);CODE
CRITICAL…di/functional/TestSparkConsistentBucketClustering.java371 org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatues);CODE
CRITICAL…cala/org/apache/hudi/TestHoodieCreateRecordUtils.scala288 org.apache.commons.io.FileUtils.deleteQuietly(new java.io.File(tempDir))CODE
237 more matches not shown…
Cross-File Repetition99 hits · 495 pts
SeverityFileLineSnippetContext
HIGH…k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…k/sql/parser/HoodieSpark3_5ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…k/sql/parser/HoodieSpark4_0ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…k/sql/parser/HoodieSpark3_4ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…k/sql/parser/HoodieSpark3_3ExtendedSqlAstBuilder.scala0partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columnsSTRING
HIGH…n/scala/org/apache/spark/sql/avro/AvroSerializer.scala0"$data" cannot be written since it's not defined in enumSTRING
HIGH…n/scala/org/apache/spark/sql/avro/AvroSerializer.scala0"$data" cannot be written since it's not defined in enumSTRING
HIGH…n/scala/org/apache/spark/sql/avro/AvroSerializer.scala0"$data" cannot be written since it's not defined in enumSTRING
HIGH…n/scala/org/apache/spark/sql/avro/AvroSerializer.scala0"$data" cannot be written since it's not defined in enumSTRING
HIGH…e/hudi/functional/TestPartitionStatsIndexWithSql.scala0| insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5STRING
HIGH…pache/spark/sql/hudi/dml/insert/TestInsertTable4.scala0| insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5STRING
HIGH…ql/hudi/dml/others/TestHoodieTableValuedFunction.scala0| insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5STRING
HIGH…udi/analysis/TestHoodiePruneFileSourcePartitions.scala0| insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30STRING
HIGH…pache/spark/sql/hudi/dml/insert/TestInsertTable3.scala0| insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30STRING
HIGH…apache/spark/sql/hudi/dml/insert/TestInsertTable.scala0| insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30STRING
HIGH…he/spark/sql/hudi/dml/others/TestDeleteFromTable.scala0| insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30STRING
HIGH…che/spark/sql/hudi/feature/TestDataSkippingQuery.scala0| insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30STRING
HIGH…pache/spark/sql/hudi/dml/insert/TestInsertTable2.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…apache/spark/sql/hudi/dml/insert/TestInsertTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…apache/spark/sql/hudi/dml/others/TestDeleteTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…apache/spark/sql/hudi/dml/others/TestUpdateTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…che/spark/sql/hudi/dml/others/TestMergeIntoTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…l/others/TestMergeIntoTableWithNonRecordKeyField.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…he/spark/sql/hudi/dml/others/TestTimeTravelTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…cala/org/apache/spark/sql/hudi/ddl/TestSpark3DDL.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ala/org/apache/spark/sql/hudi/ddl/TestAlterTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…/org/apache/spark/sql/hudi/ddl/TestTruncateTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…cala/org/apache/spark/sql/hudi/ddl/TestDropTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…la/org/apache/spark/sql/hudi/ddl/TestCreateTable.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…che/spark/sql/hudi/common/TestROPathFilterOnRead.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…l/hudi/procedure/TestShowInvalidParquetProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…pache/spark/sql/hudi/procedure/TestCallProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…he/spark/sql/hudi/procedure/TestCommitsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…che/spark/sql/hudi/procedure/TestFsViewProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…park/sql/hudi/procedure/TestCopyToTableProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…e/spark/sql/hudi/procedure/TestMetadataProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…/hudi/procedure/TestShowAuditLockStatusProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…k/sql/hudi/procedure/TestCopyToTempViewProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ql/hudi/procedure/TestValidateAuditLockProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…sql/hudi/procedure/TestCleanupAuditLockProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ark/sql/hudi/procedure/TestSetAuditLockProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…he/spark/sql/hudi/procedure/TestRepairsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…rk/sql/hudi/procedure/TestTruncateTableProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…udi/procedure/TestRunTimelineCompactionProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…k/sql/hudi/procedure/TestArchiveCommitsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ql/hudi/procedure/TestShowTimelineTableProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…park/sql/hudi/procedure/TestShowCleansProcedures.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ache/spark/sql/hudi/procedure/TestCleanProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…l/hudi/procedure/TestValidateHoodieSyncProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…k/sql/hudi/procedure/TestExportInstantsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ache/spark/sql/hudi/procedure/TestStatsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…spark/sql/hudi/procedure/TestSavepointsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…l/hudi/procedure/TestUpgradeOrDowngradeProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…sql/hudi/procedure/TestShowFsPathDetailProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…/hudi/procedure/TestShowTablePropertiesProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…ocedure/TestCleanupStaleInflightCommitsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…/hudi/procedure/TestShowInflightCommitsProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
HIGH…i/procedure/TestDeltaStreamerCheckpointProcedure.scala0|create table $tablename ( | id int, | name string, | ts long | ) using hudi | location '${tmp.getcanonicalpath}' | tblpSTRING
39 more matches not shown…
Over-Commented Block398 hits · 390 pts
SeverityFileLineSnippetContext
LOW.asf.yaml1#COMMENT
LOW.codecov.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOW.codecov.yml41 default:COMMENT
LOWazure-pipelines-20230430.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWpackaging/hudi-cli-bundle/hudi-cli-with-bundle.sh1#!/usr/bin/env bashCOMMENT
LOWpackaging/hudi-cli-bundle/conf/hudi-env.sh1#!/usr/bin/env bashCOMMENT
LOWpackaging/bundle-validation/validate.sh1#!/bin/bashCOMMENT
LOWpackaging/bundle-validation/validate.sh61 fiCOMMENT
LOWpackaging/bundle-validation/ci_run.sh1#!/bin/bashCOMMENT
LOWpackaging/bundle-validation/run_docker_java17.sh1#!/bin/bashCOMMENT
LOWpackaging/bundle-validation/flink/compact.sh1#COMMENT
LOWpackaging/bundle-validation/azure/build.sh1#!/bin/bashCOMMENT
LOWpackaging/bundle-validation/cli/commands.txt1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWpackaging/bundle-validation/kafka/consume.sh1#!/bin/bashCOMMENT
LOWpackaging/bundle-validation/kafka/produce.sh1#!/bin/bashCOMMENT
LOW…/bundle-validation/docker_java17/docker_java17_test.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1180hive313spark350scala213.sh1#!/bin/bashCOMMENT
LOW…ndle-validation/base/build_flink1190hive313spark350.sh1#!/bin/bashCOMMENT
LOW…undle-validation/base/build_flink221hive313spark351.sh1#!/bin/bashCOMMENT
LOW…undle-validation/base/build_flink211hive313spark351.sh1#!/bin/bashCOMMENT
LOW…ndle-validation/base/build_flink1181hive313spark343.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1200hive313spark411scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1200hive313spark400scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1200hive313spark350scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1190hive313spark350scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1200hive313spark420scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1180hive313spark351scala213.sh1#!/bin/bashCOMMENT
LOW…ndle-validation/base/build_flink1200hive313spark350.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1190hive313spark351scala213.sh1#!/bin/bashCOMMENT
LOW…idation/base/build_flink1200hive313spark351scala213.sh1#!/bin/bashCOMMENT
LOW…ndle-validation/base/build_flink1180hive313spark350.sh1#!/bin/bashCOMMENT
LOW…undle-validation/base/build_flink200hive313spark351.sh1#!/bin/bashCOMMENT
LOW…ndle-validation/base/build_flink1181hive313spark334.sh1#!/bin/bashCOMMENT
LOWpackaging/hudi-timeline-server-bundle/run_server.sh1#!/usr/bin/env bashCOMMENT
LOW…pache/hudi/common/table/read/TestEventTimeMerging.java61 metaProps.setProperty(ORDERING_FIELDS.key(), "timestamp");COMMENT
LOW…pache/hudi/common/table/read/TestEventTimeMerging.java81 // but we cannot since their ordering value is 1 < 3.COMMENT
LOW…che/hudi/common/table/read/TestCustomRecordMerger.java81 // -------------------------------------------------------------COMMENT
LOW…i/common/table/read/TestOverwriteWithLatestMerger.java61 }COMMENT
LOW…he/hudi/io/storage/hadoop/HoodieAvroParquetReader.java141 }COMMENT
LOW…he/hudi/io/storage/hadoop/HoodieAvroParquetReader.java161 // Parquet [[GroupType]] as list, skipping the checks whether additional [[GroupType]]COMMENT
LOW…ain/java/org/apache/hudi/common/util/AvroOrcUtils.java641 // The time-millis logical type represents a time of day, with no reference to a particular calendar, timeCOMMENT
LOW…ain/java/org/apache/hudi/common/util/AvroOrcUtils.java661 // - UTC-adjusted timestamps (TimestampMillis/Micros) are converted to ORC TimestampCOMMENT
LOWhudi-lakehouse/charts/vllm/Chart.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/vllm/values.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/vllm/values.yaml21# want a bigger open-weight model served in-cluster, then point theCOMMENT
LOWhudi-lakehouse/charts/vllm/templates/deployment.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/vllm/templates/service.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/vllm/templates/pvc.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…ehouse/charts/hudi-agent-gateway/values-local-dev.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-agent-gateway/Chart.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-agent-gateway/values.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…se/charts/hudi-agent-gateway/templates/deployment.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…house/charts/hudi-agent-gateway/templates/service.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…ehouse/charts/hudi-agent-gateway/templates/secret.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-trino/values-local-dev.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-trino/Chart.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-trino/values.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…-lakehouse/charts/hudi-trino/templates/deployment.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOW…use/charts/hudi-trino/templates/configmap-catalog.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
LOWhudi-lakehouse/charts/hudi-trino/templates/service.yaml1# Licensed to the Apache Software Foundation (ASF) under oneCOMMENT
338 more matches not shown…
Structural Annotation Overuse156 hits · 252 pts
SeverityFileLineSnippetContext
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java944 // Step 1: Scan by a list of keysCOMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java960 // Step 2: Scan by the same list of keys (no new scanning should be performed,COMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java1027 // Step 1: Scan by a list of keysCOMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java1043 // Step 2: Scan by the same list of keys (no new scanning should be performed,COMMENT
LOW…c/main/java/org/apache/hudi/hadoop/fs/CachingPath.java157 // NOTE: This method does NOT perform any normalization, assuming that the incoming pathsCOMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java107 // Step 1: Verify rows written correctlyCOMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java111 // Step 2: Assert Parquet metadata was written appropriatelyCOMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java126 // Step 3: Make sure Bloom Filter contains all the record keysCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java506 // Step 1: Write parquet source table with non-nullable fieldsCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java510 // Step 2: Configure and perform metadata-only bootstrapCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java515 // Step 3: Read bootstrapped table and verify recordsCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java532 // Step 4: Perform an updateCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java436 // Step 1: Insert and upsert with column stats enabledCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java459 // Step 2: Disable column stats but set auto.delete.partitions=false, then do an upsertCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java488 // Step 3: Verify column_stats partition is NOT deleted from table configCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java494 // Step 4: Verify column_stats partition received new log files (from HoodieCommitMetadata)COMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java506 // Step 5: Verify column stats log files contain valid column stats recordsCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala56 // Step 1: Serialize/de- original [[HoodieSparkRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala71 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala91 // Step 1: Serialize/de- original [[HoodieRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala102 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala130 // Step 1: Serialize/de- original [[HoodieRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala136 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala364 // Step 1: Bootstrap table w/ N records (t/h bulk-insert)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala374 // Step 2: Update M records out of those (t/h update)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala396 // Step 1: Bootstrap table w/ N records (t/h bulk-insert)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala404 // Step 2: Update M records out of those (t/h update)COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala156 // Step 1: Create table and insert initial records (initial commit)COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala170 // Step 2: Update records to generate new log files with updated stats.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala184 // Step 3: Trigger inline compaction (produces a new base file).COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala197 // Step 4: Perform cleaning to remove older log files (leaving behind delete blocks).COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala210 // Step 5: Downgrade the table to version 6.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala231 // Step 6: Read the table using a predicate on 'price' to force column stats usage.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala241 // Step 7: Do an update with table version 6 to trigger metadata compaction.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala264 // Step 8: Upgrade the table back to current version (version 8) and validate record index.COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala704 // Step 2: Create table and secondary index on 'rider' columnCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala837 // Step 1: Initial Insertion with null valuesCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala890 // Step 2: Delete by record key whose secondary index is null and validate secondary indexCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala913 // Step 3: Update null to non-nullCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala941 // Step 4: Update non-null to nullCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala964 // Step 5: Update null to null (should be no-op but validate)COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala977 // Step 6: Insert new record with null descriptionCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala998 // Step 7: Insert new record with non-null descriptionCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala1049 // Step 8: Test delete record behavior in log files (MOR specific)COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala406 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala415 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala501 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala509 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala536 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala545 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala427 // Step 4: Trigger Compaction with this update as the compaction frequency is set to 3 commitsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala447 // Step 5: Trigger Clustering with this update as the clustering frequency is set to 4 commitsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala462 // Step 6: Perform Deletes on Records and Validate Secondary IndexSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala476 // Step 7: Final Update and ValidationSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala562 // Step 4: Perform Time Travel QuerySTRING
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java42 // Step 1: Set Up Test DataCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java48 // Step 2: Call the MethodCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java50 // Step 3: AssertionsCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java64 // Step 1: Set Up Test DataCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java71 // Step 2: Call the MethodCOMMENT
96 more matches not shown…
Verbosity Indicators155 hits · 251 pts
SeverityFileLineSnippetContext
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java944 // Step 1: Scan by a list of keysCOMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java960 // Step 2: Scan by the same list of keys (no new scanning should be performed,COMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java1027 // Step 1: Scan by a list of keysCOMMENT
LOW…apache/hudi/common/functional/TestHoodieLogFormat.java1043 // Step 2: Scan by the same list of keys (no new scanning should be performed,COMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java107 // Step 1: Verify rows written correctlyCOMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java111 // Step 2: Assert Parquet metadata was written appropriatelyCOMMENT
LOW…io/storage/row/TestHoodieInternalRowParquetWriter.java126 // Step 3: Make sure Bloom Filter contains all the record keysCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java506 // Step 1: Write parquet source table with non-nullable fieldsCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java510 // Step 2: Configure and perform metadata-only bootstrapCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java515 // Step 3: Read bootstrapped table and verify recordsCOMMENT
LOW…est/java/org/apache/hudi/functional/TestBootstrap.java532 // Step 4: Perform an updateCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java436 // Step 1: Insert and upsert with column stats enabledCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java459 // Step 2: Disable column stats but set auto.delete.partitions=false, then do an upsertCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java488 // Step 3: Verify column_stats partition is NOT deleted from table configCOMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java494 // Step 4: Verify column_stats partition received new log files (from HoodieCommitMetadata)COMMENT
LOW…g/apache/hudi/functional/TestHoodieBackedMetadata.java506 // Step 5: Verify column stats log files contain valid column stats recordsCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala56 // Step 1: Serialize/de- original [[HoodieSparkRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala71 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala91 // Step 1: Serialize/de- original [[HoodieRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala102 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala130 // Step 1: Serialize/de- original [[HoodieRecord]]COMMENT
LOW…/hudi/common/model/TestHoodieRecordSerialization.scala136 // Step 2: Serialize the already cloned record, and assert that ser/de loop is losslessCOMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala364 // Step 1: Bootstrap table w/ N records (t/h bulk-insert)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala374 // Step 2: Update M records out of those (t/h update)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala396 // Step 1: Bootstrap table w/ N records (t/h bulk-insert)COMMENT
LOW…ache/hudi/functional/TestParquetColumnProjection.scala404 // Step 2: Update M records out of those (t/h update)COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala156 // Step 1: Create table and insert initial records (initial commit)COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala170 // Step 2: Update records to generate new log files with updated stats.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala184 // Step 3: Trigger inline compaction (produces a new base file).COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala197 // Step 4: Perform cleaning to remove older log files (leaving behind delete blocks).COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala210 // Step 5: Downgrade the table to version 6.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala231 // Step 6: Read the table using a predicate on 'price' to force column stats usage.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala241 // Step 7: Do an update with table version 6 to trigger metadata compaction.COMMENT
LOW…g/apache/hudi/functional/TestSevenToEightUpgrade.scala264 // Step 8: Upgrade the table back to current version (version 8) and validate record index.COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala704 // Step 2: Create table and secondary index on 'rider' columnCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala837 // Step 1: Initial Insertion with null valuesCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala890 // Step 2: Delete by record key whose secondary index is null and validate secondary indexCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala913 // Step 3: Update null to non-nullCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala941 // Step 4: Update non-null to nullCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala964 // Step 5: Update null to null (should be no-op but validate)COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala977 // Step 6: Insert new record with null descriptionCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala998 // Step 7: Insert new record with non-null descriptionCOMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala1049 // Step 8: Test delete record behavior in log files (MOR specific)COMMENT
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala406 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala415 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala501 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala509 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala536 // Step 1: Initial Insertion of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala545 // Step 3: Perform Update Operations on Subset of RecordsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala427 // Step 4: Trigger Compaction with this update as the compaction frequency is set to 3 commitsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala447 // Step 5: Trigger Clustering with this update as the clustering frequency is set to 4 commitsSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala462 // Step 6: Perform Deletes on Records and Validate Secondary IndexSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala476 // Step 7: Final Update and ValidationSTRING
LOW…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala562 // Step 4: Perform Time Travel QuerySTRING
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java42 // Step 1: Set Up Test DataCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java48 // Step 2: Call the MethodCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java50 // Step 3: AssertionsCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java64 // Step 1: Set Up Test DataCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java71 // Step 2: Call the MethodCOMMENT
LOW…ava/org/apache/hudi/common/util/TestBaseFileUtils.java73 // Step 3: AssertionsCOMMENT
95 more matches not shown…
Decorative Section Separators81 hits · 211 pts
SeverityFileLineSnippetContext
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py81# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py83# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py114# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py116# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py172# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py174# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py215# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py217# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py261# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py263# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py301# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py303# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py434# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py436# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py516# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py518# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py567# ======================================================COMMENT
MEDIUM…on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py569# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py273# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py275# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py71# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py73# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py100# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py102# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py157# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py159# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py191# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py193# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py236# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py238# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py346# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py348# ======================================================COMMENT
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py396# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py398# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py441# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py443# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py494# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py496# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py536# ======================================================STRING
MEDIUM…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py538# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py73# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py75# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py111# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py113# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py162# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py164# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py202# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py204# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py262# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py264# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py317# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py319# ======================================================COMMENT
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py347# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py349# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py405# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py407# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py465# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py467# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py532# ======================================================STRING
MEDIUM…/test/python/vector_blob_demo/hudi_blob_reader_demo.py534# ======================================================STRING
21 more matches not shown…
Hyper-Verbose Identifiers71 hits · 84 pts
SeverityFileLineSnippetContext
LOW…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py280def stage_to_parquet_with_pyarrow(data, embedding_dim: int, staging_path: str) -> None:CODE
LOW…g/apache/hudi/timeline/service/TestRequestHandler.java55class TestRequestHandler extends HoodieCommonTestHarness {CODE
LOW…a/org/apache/hudi/timeline/service/RequestHandler.java74public class RequestHandler {CODE
LOW…/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala560 def getOrCreateChild(parent: NestedFieldNode, name: String): NestedFieldNode = {CODE
LOW…pache/spark/sql/hive/SparkCatalogMetaStoreClient.scala282 override def get_role_grants_for_principal(arg0: org.apache.hadoop.hive.metastore.api.GetRoleGrantsForPrincipalRequestCODE
LOWhudi-agent-gateway/tests/test_registry.py45def test_langchain_derivation(simple_registry: ToolRegistry) -> None:CODE
LOWhudi-agent-gateway/tests/test_registry.py56async def test_mcp_derivation_matches(simple_registry: ToolRegistry) -> None:CODE
LOWhudi-agent-gateway/tests/test_registry.py66async def test_same_payload_via_both_paths(simple_registry: ToolRegistry) -> None:CODE
LOWhudi-agent-gateway/tests/test_registry.py77async def test_invocation_logged_once(CODE
LOWhudi-agent-gateway/tests/test_registry.py90def test_duplicate_registration_rejected(simple_registry: ToolRegistry) -> None:CODE
LOWhudi-agent-gateway/tests/test_registry.py95def test_is_tool_error_parses_not_substring_matches() -> None:CODE
LOWhudi-agent-gateway/tests/test_chat_sse.py66async def test_non_streaming_chat_returns_trace(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_chat_sse.py83async def test_streaming_chat_event_order(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_chat_sse.py108async def test_streaming_error_event_on_model_failure(client, settings, registry) -> None:CODE
LOWhudi-agent-gateway/tests/test_chat_sse.py131async def test_validation_rejects_empty_message(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_api_meta.py43async def test_ready_reports_dependency_failures(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py47def test_ollama_factory_plumbs_base_url() -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py56def test_openai_compatible_factory_plumbs_base_url() -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py67async def test_hosted_provider_ready_without_network() -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py73async def test_local_provider_unreachable_reports_not_ready() -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py98async def test_list_models_falls_back_to_default(monkeypatch) -> None:CODE
LOWhudi-agent-gateway/tests/test_llm.py111def test_build_chat_model_override() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py29def test_plain_select_gets_limit_injected() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py34def test_existing_smaller_limit_is_preserved() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py39def test_oversized_limit_is_lowered() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py44def test_cte_select_is_allowed() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py49def test_union_is_allowed_and_capped() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py71def test_non_select_statements_are_rejected(sql: str) -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py76def test_select_wrapping_dml_is_rejected() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py82def test_multiple_statements_are_rejected() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py92def test_comment_smuggled_dml_is_rejected() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py97def test_string_literal_containing_dml_is_fine() -> None:CODE
LOWhudi-agent-gateway/tests/test_guardrails.py102def test_quoted_identifiers_round_trip() -> None:CODE
LOWhudi-agent-gateway/tests/test_sessions.py33def test_touch_tracks_sessions() -> None:CODE
LOWhudi-agent-gateway/tests/test_sessions.py40def test_ttl_sweep_evicts_idle_sessions(monkeypatch) -> None:CODE
LOWhudi-agent-gateway/tests/test_sessions.py52def test_lru_eviction_beyond_max_sessions() -> None:CODE
LOWhudi-agent-gateway/tests/test_sessions.py61def test_last_access_refresh_prevents_eviction() -> None:CODE
LOWhudi-agent-gateway/tests/test_ui.py38async def test_root_redirects_to_ui(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_ui.py55async def test_ui_assets_served_with_content_types(client, asset: str, content_type: str) -> None:CODE
LOWhudi-agent-gateway/tests/test_ui.py61async def test_ui_is_self_contained(client) -> None:CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py28async def test_loop_executes_tool_and_answers(settings, registry, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py45async def test_checkpointer_preserves_history_across_turns(settings, registry) -> None:CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py67def test_system_prompt_interpolation(settings) -> None:CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py74def test_agent_cache_builds_per_model_and_caps(settings, registry) -> None:CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py89async def test_loop_repairs_broken_thinking_block_before_next_model_call(CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py127def test_repair_thinking_blocks_restores_missing_field() -> None:CODE
LOWhudi-agent-gateway/tests/test_config.py47def test_invalid_provider_rejected() -> None:CODE
LOWhudi-agent-gateway/tests/test_config.py52def test_anthropic_requires_key() -> None:CODE
LOWhudi-agent-gateway/tests/test_config.py62def test_openai_compatible_requires_base_url() -> None:CODE
LOWhudi-agent-gateway/tests/test_config.py67def test_unprefixed_api_key_alias(monkeypatch: pytest.MonkeyPatch) -> None:CODE
LOWhudi-agent-gateway/tests/test_config.py73def test_prefixed_api_key_alias(monkeypatch: pytest.MonkeyPatch) -> None:CODE
LOWhudi-agent-gateway/tests/test_mcp.py30async def test_mcp_lists_and_calls_tools(registry) -> None:CODE
LOWhudi-agent-gateway/tests/test_mcp.py42async def test_mounted_mcp_serves_over_http(settings, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py30async def test_query_lakehouse_shapes_result(registry: ToolRegistry, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py39async def test_query_lakehouse_guardrail_error_returned_not_raised(registry: ToolRegistry) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py45async def test_query_lakehouse_trino_error_returned(registry: ToolRegistry, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py51async def test_query_lakehouse_timeout_gets_actionable_hint(CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py75async def test_row_capped_result_reports_truncated(registry: ToolRegistry, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py84async def test_list_tables_defaults(registry: ToolRegistry, fake_trino) -> None:CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py91async def test_list_tables_explicit(registry: ToolRegistry, fake_trino) -> None:CODE
11 more matches not shown…
Fake / Example Data43 hits · 54 pts
SeverityFileLineSnippetContext
LOW…g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java206 new Text("John Doe"),CODE
LOW…g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java214 assertEquals(new Text("John Doe"), serializer.getValue(record, "name"));CODE
LOW…g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java306 new Text("John Doe"),CODE
LOW…g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java314 assertEquals(new Utf8("John Doe"), serializer.getValueAsJava(record, "name"));CODE
LOW…apache/hudi/io/storage/TestHoodieSparkLanceReader.java290 expectedRows.add(createRow(1, "Alice", createRow("123 Main St", "New York", 10001)));CODE
LOW…apache/hudi/io/storage/TestHoodieSparkLanceWriter.java463 UTF8String.fromString("123 Main St"),CODE
LOW…di/functional/TestFileGroupReaderPartitionColumn.scala99 Row("c", 2550218872L, 2L, "IN", "0x100000021ce30", "Acme Corp", "plan change", 11.0),CODE
LOW…di/functional/TestFileGroupReaderPartitionColumn.scala105 Row("c", 2550220512L, 14L, "IN", "0x10000008d8892", "Acme Corp", "deactivation", 17.0),CODE
LOW…di/functional/TestFileGroupReaderPartitionColumn.scala106 Row("c", 2550220784L, 16L, "CN", "0x10000007352cd", "Acme Corp", "telecoms activity", 18.0)CODE
LOW…di/functional/TestFileGroupReaderPartitionColumn.scala120 Row("u", 2650218872L, 2L, "US", "0x100000021ce30", "Acme Corp", "plan change", 11.0),CODE
LOW…apache/hudi/functional/TestSecondaryIndexPruning.scala1872 spark.sql(s"update $tableName set name = 'John Doe' where record_key_col = 'id1'")STRING
LOW…apache/hudi/functional/TestSecondaryIndexPruning.scala1879 spark.sql(s"update $tableName set name = 'Jane Doe' where record_key_col = 'id2'")STRING
LOW…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala1279 | SELECT 1 as id, 'John Doe' as name, 19 as price, 1598886001 as tsCODE
LOW…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala1281 | SELECT 2, 'Jane Doe', 24, 1598972400CODE
LOW…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala1293 | CAST('John Doe' AS STRING) as name,CODE
LOW…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala1316 Seq(1, "John Doe", 19, if (recordMergeMode == RecordMergeMode.EVENT_TIME_ORDERING.name()) 1598886001L else 1CODE
LOW…he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala1317 Seq(2, "Jane Doe", 24, 1598972400L),CODE
LOW…ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala643 | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age,CODE
LOW…ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala663 | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age,CODE
LOW…ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala715 | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age,CODE
LOW…ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala727 |using ( SELECT 'emp_001' as record_key, 'John Doe' as name, 35 as age, cast(1598886200 as BIGINT) as ts) sCODE
LOW…park/sql/hudi/common/TestTableColumnTypeMismatch.scala620 |select 1 as id, 'John Doe' as name, 19 as price, 1598886000 as tsCODE
LOW…park/sql/hudi/common/TestTableColumnTypeMismatch.scala622 |select 2, 'Jane Doe', 24, 1598972400CODE
LOW…park/sql/hudi/common/TestTableColumnTypeMismatch.scala632 | cast('John Doe' as ${testCase.sourceSchema.find(_._1 == "name").get._2}) as name,CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java433 Object rowKeyNotExist = HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", true, false);CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java437 assertEquals("fake_key(Part -fake_key) field not found in record. Acceptable fields were :[timestamp, _row_key, non_CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java439 HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", false, false)).getMessage());CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java455 // test get fake_keyCOMMENT
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java456 assertEquals("fake_key(Part -fake_key) field not found in record. Acceptable fields were :[firstname, lastname, studCODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java458 HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", false, false)).getMessage());CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java469 // test get student.fake_keyCOMMENT
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java470 assertEquals("student.fake_key(Part -fake_key) field not found in record. Acceptable fields were :[firstnameNested, CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java472 HoodieAvroUtils.getNestedFieldVal(rec, "student.fake_key", false, false)).getMessage());CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java480 // test get student.firstname.fake_keyCOMMENT
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java483 HoodieAvroUtils.getNestedFieldVal(rec, "student.firstnameNested.fake_key", false, false)).getMessage());CODE
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java485 // test get student.lastname(null).fake_keyCOMMENT
LOW…a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java488 HoodieAvroUtils.getNestedFieldVal(rec, "student.lastnameNested.fake_key", false, false)).getMessage());CODE
LOW…di/io/TestSecondaryIndexStreamingTrackerFileSlice.java273 nameMap.put("key1", "John Doe");CODE
LOW…i/index/expression/TestHoodieSparkExpressionIndex.java162 RowFactory.create("John Doe"),CODE
LOW…i-utilities/src/test/resources/data/nested_data_1.json1{"firstName":"John","lastName":"Doe","birthdate":{"year":1990,"month":5,"day":15},"address":{"street":"123 Main St","citCODE
LOW…i/utilities/deltastreamer/TestHoodieDeltaStreamer.java1063 "placeholder", false, true, false, null, HoodieTableType.MERGE_ON_READ.name());CODE
LOW…apache/hudi/utilities/sources/TestAvroKafkaSource.java90 private static final String PHONE = "555-0100";CODE
LOW…es/sources/helpers/TestCloudObjectsSelectorCommon.java230 Row address1 = RowFactory.create("123 Main St", "Springfield", "12345", RowFactory.create("India", "IN"));CODE
Unused Imports31 hits · 31 pts
SeverityFileLineSnippetContext
LOW…mples-spark/src/test/python/HoodiePySparkQuickstart.py18CODE
LOWhudi-agent-gateway/tests/test_registry.py19CODE
LOWhudi-agent-gateway/tests/test_chat_sse.py19CODE
LOWhudi-agent-gateway/tests/conftest.py22CODE
LOWhudi-agent-gateway/tests/test_api_meta.py17CODE
LOWhudi-agent-gateway/tests/test_llm.py17CODE
LOWhudi-agent-gateway/tests/test_guardrails.py19CODE
LOWhudi-agent-gateway/tests/test_sessions.py17CODE
LOWhudi-agent-gateway/tests/test_ui.py19CODE
LOWhudi-agent-gateway/tests/test_agent_loop.py19CODE
LOWhudi-agent-gateway/tests/test_config.py17CODE
LOWhudi-agent-gateway/tests/test_mcp.py19CODE
LOWhudi-agent-gateway/tests/test_trino_tools.py17CODE
LOWhudi-agent-gateway/tests/integration/test_live_stack.py25CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/sessions.py28CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/config.py25CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/log.py24CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/llm.py25CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/cli.py19CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/agent.py19CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/app.py19CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/mcp_server.py19CODE
LOW…agent-gateway/src/hudi_agent_gateway/tools/registry.py30CODE
LOW…agent-gateway/src/hudi_agent_gateway/tools/__init__.py23CODE
LOW…t-gateway/src/hudi_agent_gateway/tools/trino_client.py19CODE
LOW…ent-gateway/src/hudi_agent_gateway/tools/guardrails.py24CODE
LOW…nt-gateway/src/hudi_agent_gateway/tools/trino_tools.py25CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/models.py19CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/chat.py19CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/meta.py19CODE
LOWscripts/pr_compliance.py20CODE
Cross-Language Confusion6 hits · 22 pts
SeverityFileLineSnippetContext
HIGH…t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py407 # `named_struct('type', 'INLINE', 'data', <bytes>, 'reference', null)` isSTRING
HIGH…/test/python/vector_blob_demo/hudi_blob_reader_demo.py87# DESCRIPTOR → image_bytes.data is null; you must call read_blob() to materializeCOMMENT
HIGH…/test/python/vector_blob_demo/hudi_blob_reader_demo.py359 # named_struct('type','OUT_OF_LINE','data', null, 'reference', named_struct(path, offset, length, managed))STRING
HIGH…/test/python/vector_blob_demo/hudi_blob_reader_demo.py425 "\nInspecting stored OUT_OF_LINE blobs — `data` is null, `reference.*` points "STRING
HIGH…/test/python/vector_blob_demo/hudi_blob_reader_demo.py436 " `data` is suppressed (length(data) is null), `reference.*` synthesized to point\n"STRING
HIGH…/test/python/vector_blob_demo/hudi_blob_reader_demo.py620 print("✓ Story: bytes live in the Hudi base files but are read lazily — image_bytes.data is null,")STRING
AI Slop Vocabulary7 hits · 21 pts
SeverityFileLineSnippetContext
MEDIUM.codecov.yml55 # Integration-test harness (test DAGs, fixtures, generators), not production behavior.COMMENT
MEDIUM…t/functional/TestHoodieClientOnCopyOnWriteStorage.java1079 // rollback should have succeeded. Essentially, the pending clustering should not hinder the rollback of regular comCOMMENT
MEDIUM…ache/hudi/functional/TestParquetColumnProjection.scala57 // is not robust, and works most reliably only when we read just a single file. As such, making tableCOMMENT
MEDIUM…/spark/sql/hudi/feature/index/TestSecondaryIndex.scala875 // TODO [HUDI-9549] predicate of is null / not null will not leverage index lookup as of todayCOMMENT
MEDIUM…pache/hudi/common/table/log/block/HoodieDataBlock.java61 // TODO rebase records/content to leverage Either to warrantCOMMENT
MEDIUMscripts/release/validate_source_binary_files.sh39# than on a list of permitted MIME types keeps this robust against libmagic'sCOMMENT
MEDIUM…/hudi/integ2/testcontainers/command/CommandResult.java83 // Normalize whitespace for more robust matchingCOMMENT
Excessive Try-Catch Wrapping17 hits · 21 pts
SeverityFileLineSnippetContext
LOWhudi-agent-gateway/src/hudi_agent_gateway/sessions.py61 except Exception: # noqa: BLE001 - eviction must never take the server downCODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/sessions.py83 except Exception: # noqa: BLE001CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/llm.py88 except Exception as e: # noqa: BLE001 - discovery must never break the APICODE
LOW…agent-gateway/src/hudi_agent_gateway/tools/registry.py89 except Exception:CODE
LOW…t-gateway/src/hudi_agent_gateway/tools/trino_client.py120 except Exception:CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/chat.py109 except Exception as e:CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/chat.py159 except Exception as e: # noqa: BLE001 - stream must terminate with an error eventCODE
LOWhudi-notebooks/notebooks/spark3/utils.py167 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark3/utils.py184 except Exception as e:CODE
MEDIUMhudi-notebooks/notebooks/spark3/utils.py185 print(f"Error converting DataFrame to Pandas: {e}")CODE
LOWhudi-notebooks/notebooks/spark4/utils.py190 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark4/utils.py199 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark4/utils.py204 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark4/utils.py215 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark4/utils.py245 except Exception as e:CODE
LOWhudi-notebooks/notebooks/spark4/utils.py264 except Exception as e:CODE
MEDIUMhudi-notebooks/notebooks/spark4/utils.py265 print(f"Error converting DataFrame to Pandas: {e}")CODE
AI Response Leakage1 hit · 8 pts
SeverityFileLineSnippetContext
HIGHhudi-examples/hudi-examples-dbt/dbt_project.yml41# In this example config, we tell dbt to build all models in the example/ directoryCOMMENT
Self-Referential Comments2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMpackaging/bundle-validation/validate.sh305 # Create a temporary directory for CLI commands outputCOMMENT
MEDIUMhudi-kafka-connect/demo/setupKafka.sh124 # Create the topic with 4 partitionsCOMMENT
Redundant / Tautological Comments4 hits · 6 pts
SeverityFileLineSnippetContext
LOWdocker/hoodie/hadoop/hive_base/conf/hive-env.sh48# Set HADOOP_HOME to point to a specific hadoop install directoryCOMMENT
LOW…ources/upgrade-downgrade-fixtures/generate-fixtures.sh104 # Check if version is in the requested arrayCOMMENT
LOW…ources/upgrade-downgrade-fixtures/generate-fixtures.sh161 # Check if Spark binary already existsCOMMENT
LOWscripts/release/validate_source_copyright.sh55# Check if the variable holding the list of files is non-emptyCOMMENT
Modern AI Meta-Vocabulary2 hits · 6 pts
SeverityFileLineSnippetContext
MEDIUMhudi-agent-gateway/src/hudi_agent_gateway/config.py68 # --- guardrails / shaping ---COMMENT
MEDIUMscripts/pr_compliance.py246#Class that orchestrates the validation of the entire bodyCOMMENT
Deep Nesting5 hits · 5 pts
SeverityFileLineSnippetContext
LOWhudi-agent-gateway/tests/test_chat_sse.py51CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/chat.py69CODE
LOWhudi-agent-gateway/src/hudi_agent_gateway/api/chat.py127CODE
LOWscripts/pr_compliance.py210CODE
LOWscripts/pr_compliance.py284CODE
Slop Phrases2 hits · 3 pts
SeverityFileLineSnippetContext
LOW…i/examples/quickstart/source/ContinuousFileSource.java59 * <p>NOTE: this class is represented twice: in test utils and in quickstart. Don't forget to update both files.COMMENT
LOW…org/apache/hudi/utils/source/ContinuousFileSource.java59 * <p>NOTE: this class is represented twice: in test utils and in quickstart. Don't forget to update both files.COMMENT
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOWscripts/release/copy_staging_repo.sh20# Usage:COMMENT
TODO Padding1 hit · 2 pts
SeverityFileLineSnippetContext
LOW…e/hudi/utilities/TestHoodieMetadataTableValidator.java473 // TODO: Add validation for compaction and clustering casesCOMMENT