Upserts, Deletes And Incremental Processing on Big Data.
This report presents the forensic synthetic code analysis of apache/hudi, a Java project with 6,186 GitHub stars. SynthScan v2.0 examined 1,050,470 lines of code across 5386 source files, recording 1120 pattern matches distributed across 20 syntactic categories. The overall adjusted score of 4.5 places this repository in the Likely human-written band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 1120 distinct pattern matches across 20 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 302 | org.apache.hudi.common.schema.internal.InternalSchema internalSchema = new org.apache.hudi.common.schema.internal.In | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 303 | org.apache.hudi.common.schema.internal.Types.RecordType.get( | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 304 | org.apache.hudi.common.schema.internal.Types.Field.get(0, false, "id", org.apache.hudi.common.schema.interna | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 306 | org.apache.hudi.common.schema.internal.utils.SerDeHelper.toJson(internalSchema)); | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 385 | org.apache.hudi.common.schema.internal.InternalSchema internalSchema = new org.apache.hudi.common.schema.internal.In | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 386 | org.apache.hudi.common.schema.internal.Types.RecordType.get( | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 387 | org.apache.hudi.common.schema.internal.Types.Field.get(0, false, "id", org.apache.hudi.common.schema.interna | CODE |
| CRITICAL⚡ | …/apache/hudi/common/table/TestTableSchemaResolver.java | 389 | org.apache.hudi.common.schema.internal.utils.SerDeHelper.toJson(internalSchema)); | CODE |
| CRITICAL | …hudi/common/table/timeline/TestArchivedTimelineV1.java | 767 | archivedMetaWrapper.setHoodieCommitMetadata(org.apache.hudi.avro.model.HoodieCommitMetadata.newBuilder().build() | CODE |
| CRITICAL | …hudi/common/table/timeline/TestArchivedTimelineV1.java | 778 | archivedMetaWrapper.setHoodieInflightReplaceMetadata(convertCommitMetadata(new org.apache.hudi.common.model.Ho | CODE |
| CRITICAL | …hudi/common/table/timeline/TestArchivedTimelineV1.java | 785 | archivedMetaWrapper.setHoodieCommitMetadata(org.apache.hudi.avro.model.HoodieCommitMetadata.newBuilder().build() | CODE |
| CRITICAL | …main/java/org/apache/hudi/tools/TimelineInspector.java | 319 | org.apache.hudi.common.schema.HoodieSchema.fromAvroSchema( | CODE |
| CRITICAL | …/hudi/aws/TestHoodieAWSCredentialsProviderFactory.java | 37 | AwsSessionCredentials credentials = (AwsSessionCredentials) org.apache.hudi.aws.credentials.HoodieAWSCredentialsProv | CODE |
| CRITICAL | …/hudi/aws/TestHoodieAWSCredentialsProviderFactory.java | 53 | AwsSessionCredentials credentials = (AwsSessionCredentials) org.apache.hudi.aws.credentials.HoodieAWSCredentialsProv | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 146 | software.amazon.awssdk.services.glue.model.StorageDescriptor storageDescriptor = software.amazon.awssdk.services.glu | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 374 | software.amazon.awssdk.services.glue.model.Partition awsPart1 = software.amazon.awssdk.services.glue.model.Partition | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 376 | software.amazon.awssdk.services.glue.model.Partition awsPart2 = software.amazon.awssdk.services.glue.model.Partition | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 401 | software.amazon.awssdk.services.glue.model.Partition.builder() | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 412 | software.amazon.awssdk.services.glue.model.Partition.builder() | CODE |
| CRITICAL | …va/org/apache/hudi/aws/sync/TestAWSGlueSyncClient.java | 891 | software.amazon.awssdk.services.glue.model.StorageDescriptor storageDescriptor = software.amazon.awssdk.services.glu | CODE |
| CRITICAL | …c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java | 563 | Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf()); | CODE |
| CRITICAL | …c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java | 609 | Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf()); | CODE |
| CRITICAL | …c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java | 697 | Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf()); | CODE |
| CRITICAL | …c/test/java/org/apache/hudi/hive/TestHiveSyncTool.java | 752 | Driver hiveDriver = new org.apache.hadoop.hive.ql.Driver(HiveTestUtil.getHiveConf()); | CODE |
| CRITICAL | …ava/org/apache/hudi/hive/ddl/HiveQueryDDLExecutor.java | 64 | this.hiveDriver = new org.apache.hadoop.hive.ql.Driver(config.getHiveConf()); | CODE |
| CRITICAL | …mples-spark/src/test/python/HoodiePySparkQuickstart.py | 43 | self.dataGen = spark._jvm.org.apache.hudi.QuickstartUtils.DataGenerator() | CODE |
| CRITICAL | …mples-spark/src/test/python/HoodiePySparkQuickstart.py | 85 | inserts = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateInserts(10)) | CODE |
| CRITICAL | …mples-spark/src/test/python/HoodiePySparkQuickstart.py | 92 | updates = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateUniqueUpdates | CODE |
| CRITICAL | …mples-spark/src/test/python/HoodiePySparkQuickstart.py | 219 | inserts = self.spark._jvm.org.apache.hudi.QuickstartUtils.convertToStringList(self.dataGen.generateInserts(10)) | CODE |
| CRITICAL | …pache/hudi/examples/spark/HoodieMorCompactionJob.scala | 78 | client.commitCompaction(instant.get(), result, org.apache.hudi.common.util.Option.empty()) | CODE |
| CRITICAL | …i/hadoop/utils/TestHoodieRealtimeInputFormatUtils.java | 40 | hadoopConf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName()); | CODE |
| CRITICAL | …di/hadoop/realtime/TestHoodieRealtimeRecordReader.java | 123 | storageConf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName()); | CODE |
| CRITICAL | hudi-trino-plugin/.mvn/modernizer/violations.xml | 312 | <comment>Use io.trino.plugin.base.util.JsonUtils.jsonFactory()</comment> | CODE |
| CRITICAL | hudi-trino-plugin/.mvn/modernizer/violations.xml | 318 | <comment>Use io.trino.plugin.base.util.JsonUtils.jsonFactoryBuilder() instead</comment> | CODE |
| CRITICAL | …a/org/apache/hudi/io/hfile/TestHFileCompatibility.java | 278 | org.apache.hudi.io.hfile.HFileContext context = org.apache.hudi.io.hfile.HFileContext.builder() | CODE |
| CRITICAL | …g/apache/hudi/io/hfile/TestHFileReadCompatibility.java | 282 | org.apache.hudi.io.hfile.HFileContext context = org.apache.hudi.io.hfile.HFileContext.builder() | CODE |
| CRITICAL | …/hudi/timeline/service/TimelineServiceTestHarness.java | 172 | response = org.apache.http.client.fluent.Request.Get(url).connectTimeout(10000).socketTimeout(10000).execute() | CODE |
| CRITICAL | …/hudi/timeline/service/TimelineServiceTestHarness.java | 176 | response = org.apache.http.client.fluent.Request.Post(url).connectTimeout(10000).socketTimeout(10000).execute( | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala | 2484 | ctx.errorCapturingUnitToUnitInterval.body.from.getText.toLowerCase(Locale.ROOT) | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala | 2485 | val toUnit = ctx.errorCapturingUnitToUnitInterval.body.to.getText.toLowerCase(Locale.ROOT) | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala | 2499 | ctx.errorCapturingMultiUnitsInterval.body.unit.asScala.map( | CODE |
| CRITICAL | …spark/sql/parser/HoodieSpark4_2ExtendedSqlParser.scala | 207 | new org.antlr.v4.runtime.misc.Pair(token.getTokenSource, token.getInputStream), | CODE |
| CRITICAL | …spark/sql/parser/HoodieSpark4_1ExtendedSqlParser.scala | 207 | new org.antlr.v4.runtime.misc.Pair(token.getTokenSource, token.getInputStream), | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala | 2484 | ctx.errorCapturingUnitToUnitInterval.body.from.getText.toLowerCase(Locale.ROOT) | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala | 2485 | val toUnit = ctx.errorCapturingUnitToUnitInterval.body.to.getText.toLowerCase(Locale.ROOT) | CODE |
| CRITICAL | …k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala | 2499 | ctx.errorCapturingMultiUnitsInterval.body.unit.asScala.map( | CODE |
| CRITICAL | …ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala | 66 | org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], plan) | CODE |
| CRITICAL | …ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala | 79 | org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], LocalRela | CODE |
| CRITICAL | …ala/org/apache/spark/sql/Spark4HoodieUnsafeUtils.scala | 93 | org.apache.spark.sql.classic.Dataset.ofRows(spark.asInstanceOf[org.apache.spark.sql.classic.SparkSession], LocalRela | CODE |
| CRITICAL | …n/scala/org/apache/spark/sql/Spark4DataFrameUtil.scala | 38 | org.apache.spark.sql.classic.Dataset.ofRows(sparkSession.asInstanceOf[org.apache.spark.sql.classic.SparkSession], lo | CODE |
| CRITICAL | …a/org/apache/spark/sql/adapter/BaseSpark4Adapter.scala | 180 | org.apache.spark.sql.classic.Dataset.ofRows(sqlContext.sparkSession.asInstanceOf[org.apache.spark.sql.classic.SparkS | CODE |
| CRITICAL | …apache/hudi/io/storage/TestHoodieSparkLanceWriter.java | 710 | StructType blobStruct = (StructType) org.apache.spark.sql.types.BlobType.dataType(); | CODE |
| CRITICAL | …rg/apache/hudi/table/upgrade/TestUpgradeDowngrade.java | 845 | org.apache.hudi.common.table.view.HoodieTableFileSystemView.fileListingBasedFileSystemView( | CODE |
| CRITICAL | …rg/apache/hudi/table/upgrade/TestUpgradeDowngrade.java | 849 | List<String> partitionPaths = org.apache.hudi.common.fs.FSUtils.getAllPartitionPaths( | CODE |
| CRITICAL | …on/rollback/TestMergeOnReadRollbackActionExecutor.java | 399 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(statusesList); | CODE |
| CRITICAL | …functional/TestSparkNonBlockingConcurrencyControl.java | 780 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses); | CODE |
| CRITICAL | …he/hudi/functional/TestSparkClusteringCornerCases.java | 81 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses); | CODE |
| CRITICAL | …i/functional/TestColStatsRecordWithMetadataRecord.java | 534 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatuses); | CODE |
| CRITICAL | …he/hudi/functional/TestSparkSortAndSizeClustering.java | 245 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatues); | CODE |
| CRITICAL | …/apache/hudi/functional/TestConsistentBucketIndex.java | 278 | org.apache.hudi.testutils.Assertions.assertNoWriteErrors(writeStatues); | CODE |
| 223 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …k/sql/parser/HoodieSpark4_2ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …k/sql/parser/HoodieSpark4_1ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …k/sql/parser/HoodieSpark3_5ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …k/sql/parser/HoodieSpark4_0ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …k/sql/parser/HoodieSpark3_4ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …k/sql/parser/HoodieSpark3_3ExtendedSqlAstBuilder.scala | 0 | partition by: cannot mix partition expressions and partition columns: |expressions: $references |columns: $columns | STRING |
| HIGH | …n/scala/org/apache/spark/sql/avro/AvroSerializer.scala | 0 | "$data" cannot be written since it's not defined in enum | STRING |
| HIGH | …n/scala/org/apache/spark/sql/avro/AvroSerializer.scala | 0 | "$data" cannot be written since it's not defined in enum | STRING |
| HIGH | …n/scala/org/apache/spark/sql/avro/AvroSerializer.scala | 0 | "$data" cannot be written since it's not defined in enum | STRING |
| HIGH | …n/scala/org/apache/spark/sql/avro/AvroSerializer.scala | 0 | "$data" cannot be written since it's not defined in enum | STRING |
| HIGH | …e/hudi/functional/TestPartitionStatsIndexWithSql.scala | 0 | | insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5 | STRING |
| HIGH | …pache/spark/sql/hudi/dml/insert/TestInsertTable4.scala | 0 | | insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5 | STRING |
| HIGH | …ql/hudi/dml/others/TestHoodieTableValuedFunction.scala | 0 | | insert into $tablename | values (1, 'a1', 1000, 10), (2, 'a2', 2000, 20), (3, 'a3', 3000, 30), (4, 'a4', 2000, 10), (5 | STRING |
| HIGH | …udi/analysis/TestHoodiePruneFileSourcePartitions.scala | 0 | | insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30 | STRING |
| HIGH | …pache/spark/sql/hudi/dml/insert/TestInsertTable3.scala | 0 | | insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30 | STRING |
| HIGH | …apache/spark/sql/hudi/dml/insert/TestInsertTable.scala | 0 | | insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30 | STRING |
| HIGH | …he/spark/sql/hudi/dml/others/TestDeleteFromTable.scala | 0 | | insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30 | STRING |
| HIGH | …che/spark/sql/hudi/feature/TestDataSkippingQuery.scala | 0 | | insert into $tablename values | (1, 'a1', 10, 1000, "2021-01-05"), | (2, 'a2', 20, 2000, "2021-01-06"), | (3, 'a3', 30 | STRING |
| HIGH | …pache/spark/sql/hudi/dml/insert/TestInsertTable2.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …apache/spark/sql/hudi/dml/insert/TestInsertTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …apache/spark/sql/hudi/dml/others/TestDeleteTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …apache/spark/sql/hudi/dml/others/TestUpdateTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …che/spark/sql/hudi/dml/others/TestMergeIntoTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …l/others/TestMergeIntoTableWithNonRecordKeyField.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …he/spark/sql/hudi/dml/others/TestTimeTravelTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …cala/org/apache/spark/sql/hudi/ddl/TestSpark3DDL.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ala/org/apache/spark/sql/hudi/ddl/TestAlterTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …/org/apache/spark/sql/hudi/ddl/TestTruncateTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …cala/org/apache/spark/sql/hudi/ddl/TestDropTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …la/org/apache/spark/sql/hudi/ddl/TestCreateTable.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …che/spark/sql/hudi/common/TestROPathFilterOnRead.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …l/hudi/procedure/TestShowInvalidParquetProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …pache/spark/sql/hudi/procedure/TestCallProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …he/spark/sql/hudi/procedure/TestCommitsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …che/spark/sql/hudi/procedure/TestFsViewProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …park/sql/hudi/procedure/TestCopyToTableProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …e/spark/sql/hudi/procedure/TestMetadataProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …/hudi/procedure/TestShowAuditLockStatusProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …k/sql/hudi/procedure/TestCopyToTempViewProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ql/hudi/procedure/TestValidateAuditLockProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …sql/hudi/procedure/TestCleanupAuditLockProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ark/sql/hudi/procedure/TestSetAuditLockProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …he/spark/sql/hudi/procedure/TestRepairsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …rk/sql/hudi/procedure/TestTruncateTableProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …udi/procedure/TestRunTimelineCompactionProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …k/sql/hudi/procedure/TestArchiveCommitsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ql/hudi/procedure/TestShowTimelineTableProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …park/sql/hudi/procedure/TestShowCleansProcedures.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ache/spark/sql/hudi/procedure/TestCleanProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …k/sql/hudi/procedure/TestExportInstantsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ache/spark/sql/hudi/procedure/TestStatsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …spark/sql/hudi/procedure/TestSavepointsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …l/hudi/procedure/TestUpgradeOrDowngradeProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …sql/hudi/procedure/TestShowFsPathDetailProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …/hudi/procedure/TestShowTablePropertiesProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ocedure/TestCleanupStaleInflightCommitsProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …spark/sql/hudi/procedure/TestCompactionProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …he/spark/sql/hudi/procedure/TestRestoreProcedure.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| HIGH | …ala/org/apache/spark/sql/hudi/common/TestSqlConf.scala | 0 | |create table $tablename ( | id int, | name string, | price double, | ts long |) using hudi | location '$tablepath' | tb | STRING |
| 32 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .asf.yaml | 1 | # | COMMENT |
| LOW | .codecov.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | azure-pipelines-20230430.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | packaging/hudi-cli-bundle/hudi-cli-with-bundle.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | packaging/hudi-cli-bundle/conf/hudi-env.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | packaging/bundle-validation/validate.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/bundle-validation/validate.sh | 61 | fi | COMMENT |
| LOW | packaging/bundle-validation/ci_run.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/bundle-validation/run_docker_java17.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/bundle-validation/flink/compact.sh | 1 | # | COMMENT |
| LOW | packaging/bundle-validation/azure/build.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/bundle-validation/cli/commands.txt | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | packaging/bundle-validation/kafka/consume.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/bundle-validation/kafka/produce.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …/bundle-validation/docker_java17/docker_java17_test.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1180hive313spark350scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ndle-validation/base/build_flink1190hive313spark350.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …undle-validation/base/build_flink211hive313spark351.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ndle-validation/base/build_flink1181hive313spark343.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1200hive313spark411scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1200hive313spark400scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1200hive313spark350scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1190hive313spark350scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1180hive313spark351scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ndle-validation/base/build_flink1200hive313spark350.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …/base/build_flink1200hive313spark420previewscala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1190hive313spark351scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …idation/base/build_flink1200hive313spark351scala213.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ndle-validation/base/build_flink1180hive313spark350.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …undle-validation/base/build_flink200hive313spark351.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …ndle-validation/base/build_flink1181hive313spark334.sh | 1 | #!/bin/bash | COMMENT |
| LOW | packaging/hudi-timeline-server-bundle/run_server.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | …pache/hudi/common/table/read/TestEventTimeMerging.java | 61 | metaProps.setProperty(ORDERING_FIELDS.key(), "timestamp"); | COMMENT |
| LOW | …pache/hudi/common/table/read/TestEventTimeMerging.java | 81 | // but we cannot since their ordering value is 1 < 3. | COMMENT |
| LOW | …che/hudi/common/table/read/TestCustomRecordMerger.java | 81 | // ------------------------------------------------------------- | COMMENT |
| LOW | …i/common/table/read/TestOverwriteWithLatestMerger.java | 61 | } | COMMENT |
| LOW | …he/hudi/io/storage/hadoop/HoodieAvroParquetReader.java | 141 | } | COMMENT |
| LOW | …he/hudi/io/storage/hadoop/HoodieAvroParquetReader.java | 161 | // Parquet [[GroupType]] as list, skipping the checks whether additional [[GroupType]] | COMMENT |
| LOW | …ain/java/org/apache/hudi/common/util/AvroOrcUtils.java | 641 | // The time-millis logical type represents a time of day, with no reference to a particular calendar, time | COMMENT |
| LOW | …ain/java/org/apache/hudi/common/util/AvroOrcUtils.java | 661 | // - UTC-adjusted timestamps (TimestampMillis/Micros) are converted to ORC Timestamp | COMMENT |
| LOW | docker/generate_test_suite.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/build_docker_images.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/stop_demo.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/build_local_docker_images.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/setup_demo.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/demo/get_min_commit_time_cow.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/demo/get_min_commit_time_mor.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/demo/setup_demo_container.sh | 1 | COMMENT | |
| LOW | …-suite/spark-sql-nonpartitioned-external-cow-ctas.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …ker/demo/config/test-suite/spark-delete-partition.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …config/test-suite/deltastreamer-pure-bulk-inserts.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …config/test-suite/spark-sql-partition-cow-updates.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | docker/demo/config/test-suite/multi-writer-1-sds.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | docker/demo/config/test-suite/spark-pure-inserts.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …uite/deltastreamer-medium-full-dataset-validation.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | docker/demo/config/test-suite/mor-async-compact.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …er/demo/config/test-suite/spark-immutable-dataset.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …nfig/test-suite/spark-sql-partitioned-managed-cow.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …nfig/test-suite/spark-sql-partitioned-managed-cow.yaml | 41 | # config: | COMMENT |
| LOW | …t-suite/spark-sql-nonpartitioned-managed-cow-ctas.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| 206 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 942 | // Step 1: Scan by a list of keys | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 958 | // Step 2: Scan by the same list of keys (no new scanning should be performed, | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 1025 | // Step 1: Scan by a list of keys | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 1041 | // Step 2: Scan by the same list of keys (no new scanning should be performed, | COMMENT |
| LOW | …c/main/java/org/apache/hudi/hadoop/fs/CachingPath.java | 157 | // NOTE: This method does NOT perform any normalization, assuming that the incoming paths | COMMENT |
| LOW⚡ | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 103 | // Step 1: Verify rows written correctly | COMMENT |
| LOW⚡ | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 107 | // Step 2: Assert Parquet metadata was written appropriately | COMMENT |
| LOW | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 122 | // Step 3: Make sure Bloom Filter contains all the record keys | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 506 | // Step 1: Write parquet source table with non-nullable fields | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 510 | // Step 2: Configure and perform metadata-only bootstrap | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 515 | // Step 3: Read bootstrapped table and verify records | COMMENT |
| LOW | …est/java/org/apache/hudi/functional/TestBootstrap.java | 532 | // Step 4: Perform an update | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 434 | // Step 1: Insert and upsert with column stats enabled | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 457 | // Step 2: Disable column stats but set auto.delete.partitions=false, then do an upsert | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 486 | // Step 3: Verify column_stats partition is NOT deleted from table config | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 492 | // Step 4: Verify column_stats partition received new log files (from HoodieCommitMetadata) | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 504 | // Step 5: Verify column stats log files contain valid column stats records | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 56 | // Step 1: Serialize/de- original [[HoodieSparkRecord]] | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 71 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 91 | // Step 1: Serialize/de- original [[HoodieRecord]] | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 102 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW⚡ | …/hudi/common/model/TestHoodieRecordSerialization.scala | 130 | // Step 1: Serialize/de- original [[HoodieRecord]] | COMMENT |
| LOW⚡ | …/hudi/common/model/TestHoodieRecordSerialization.scala | 136 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 364 | // Step 1: Bootstrap table w/ N records (t/h bulk-insert) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 374 | // Step 2: Update M records out of those (t/h update) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 396 | // Step 1: Bootstrap table w/ N records (t/h bulk-insert) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 404 | // Step 2: Update M records out of those (t/h update) | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 156 | // Step 1: Create table and insert initial records (initial commit) | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 170 | // Step 2: Update records to generate new log files with updated stats. | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 184 | // Step 3: Trigger inline compaction (produces a new base file). | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 197 | // Step 4: Perform cleaning to remove older log files (leaving behind delete blocks). | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 210 | // Step 5: Downgrade the table to version 6. | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 231 | // Step 6: Read the table using a predicate on 'price' to force column stats usage. | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 241 | // Step 7: Do an update with table version 6 to trigger metadata compaction. | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 264 | // Step 8: Upgrade the table back to current version (version 8) and validate record index. | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 704 | // Step 2: Create table and secondary index on 'rider' column | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 837 | // Step 1: Initial Insertion with null values | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 890 | // Step 2: Delete by record key whose secondary index is null and validate secondary index | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 913 | // Step 3: Update null to non-null | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 941 | // Step 4: Update non-null to null | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 964 | // Step 5: Update null to null (should be no-op but validate) | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 977 | // Step 6: Insert new record with null description | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 998 | // Step 7: Insert new record with non-null description | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 1049 | // Step 8: Test delete record behavior in log files (MOR specific) | COMMENT |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 406 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 415 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 501 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 509 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 536 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 545 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 427 | // Step 4: Trigger Compaction with this update as the compaction frequency is set to 3 commits | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 447 | // Step 5: Trigger Clustering with this update as the clustering frequency is set to 4 commits | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 462 | // Step 6: Perform Deletes on Records and Validate Secondary Index | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 476 | // Step 7: Final Update and Validation | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 562 | // Step 4: Perform Time Travel Query | STRING |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 42 | // Step 1: Set Up Test Data | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 48 | // Step 2: Call the Method | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 50 | // Step 3: Assertions | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 64 | // Step 1: Set Up Test Data | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 71 | // Step 2: Call the Method | COMMENT |
| 96 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 942 | // Step 1: Scan by a list of keys | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 958 | // Step 2: Scan by the same list of keys (no new scanning should be performed, | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 1025 | // Step 1: Scan by a list of keys | COMMENT |
| LOW | …apache/hudi/common/functional/TestHoodieLogFormat.java | 1041 | // Step 2: Scan by the same list of keys (no new scanning should be performed, | COMMENT |
| LOW⚡ | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 103 | // Step 1: Verify rows written correctly | COMMENT |
| LOW⚡ | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 107 | // Step 2: Assert Parquet metadata was written appropriately | COMMENT |
| LOW | …io/storage/row/TestHoodieInternalRowParquetWriter.java | 122 | // Step 3: Make sure Bloom Filter contains all the record keys | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 506 | // Step 1: Write parquet source table with non-nullable fields | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 510 | // Step 2: Configure and perform metadata-only bootstrap | COMMENT |
| LOW⚡ | …est/java/org/apache/hudi/functional/TestBootstrap.java | 515 | // Step 3: Read bootstrapped table and verify records | COMMENT |
| LOW | …est/java/org/apache/hudi/functional/TestBootstrap.java | 532 | // Step 4: Perform an update | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 434 | // Step 1: Insert and upsert with column stats enabled | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 457 | // Step 2: Disable column stats but set auto.delete.partitions=false, then do an upsert | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 486 | // Step 3: Verify column_stats partition is NOT deleted from table config | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 492 | // Step 4: Verify column_stats partition received new log files (from HoodieCommitMetadata) | COMMENT |
| LOW | …g/apache/hudi/functional/TestHoodieBackedMetadata.java | 504 | // Step 5: Verify column stats log files contain valid column stats records | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 56 | // Step 1: Serialize/de- original [[HoodieSparkRecord]] | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 71 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 91 | // Step 1: Serialize/de- original [[HoodieRecord]] | COMMENT |
| LOW | …/hudi/common/model/TestHoodieRecordSerialization.scala | 102 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW⚡ | …/hudi/common/model/TestHoodieRecordSerialization.scala | 130 | // Step 1: Serialize/de- original [[HoodieRecord]] | COMMENT |
| LOW⚡ | …/hudi/common/model/TestHoodieRecordSerialization.scala | 136 | // Step 2: Serialize the already cloned record, and assert that ser/de loop is lossless | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 364 | // Step 1: Bootstrap table w/ N records (t/h bulk-insert) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 374 | // Step 2: Update M records out of those (t/h update) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 396 | // Step 1: Bootstrap table w/ N records (t/h bulk-insert) | COMMENT |
| LOW⚡ | …ache/hudi/functional/TestParquetColumnProjection.scala | 404 | // Step 2: Update M records out of those (t/h update) | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 156 | // Step 1: Create table and insert initial records (initial commit) | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 170 | // Step 2: Update records to generate new log files with updated stats. | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 184 | // Step 3: Trigger inline compaction (produces a new base file). | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 197 | // Step 4: Perform cleaning to remove older log files (leaving behind delete blocks). | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 210 | // Step 5: Downgrade the table to version 6. | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 231 | // Step 6: Read the table using a predicate on 'price' to force column stats usage. | COMMENT |
| LOW⚡ | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 241 | // Step 7: Do an update with table version 6 to trigger metadata compaction. | COMMENT |
| LOW | …g/apache/hudi/functional/TestSevenToEightUpgrade.scala | 264 | // Step 8: Upgrade the table back to current version (version 8) and validate record index. | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 704 | // Step 2: Create table and secondary index on 'rider' column | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 837 | // Step 1: Initial Insertion with null values | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 890 | // Step 2: Delete by record key whose secondary index is null and validate secondary index | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 913 | // Step 3: Update null to non-null | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 941 | // Step 4: Update non-null to null | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 964 | // Step 5: Update null to null (should be no-op but validate) | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 977 | // Step 6: Insert new record with null description | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 998 | // Step 7: Insert new record with non-null description | COMMENT |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 1049 | // Step 8: Test delete record behavior in log files (MOR specific) | COMMENT |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 406 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 415 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 501 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 509 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 536 | // Step 1: Initial Insertion of Records | STRING |
| LOW⚡ | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 545 | // Step 3: Perform Update Operations on Subset of Records | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 427 | // Step 4: Trigger Compaction with this update as the compaction frequency is set to 3 commits | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 447 | // Step 5: Trigger Clustering with this update as the clustering frequency is set to 4 commits | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 462 | // Step 6: Perform Deletes on Records and Validate Secondary Index | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 476 | // Step 7: Final Update and Validation | STRING |
| LOW | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 562 | // Step 4: Perform Time Travel Query | STRING |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 42 | // Step 1: Set Up Test Data | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 48 | // Step 2: Call the Method | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 50 | // Step 3: Assertions | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 64 | // Step 1: Set Up Test Data | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 71 | // Step 2: Call the Method | COMMENT |
| LOW⚡ | …ava/org/apache/hudi/common/util/TestBaseFileUtils.java | 73 | // Step 3: Assertions | COMMENT |
| 95 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | .codecov.yml | 28 | # -------------- | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 81 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 83 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 114 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 116 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 172 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 174 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 215 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 217 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 261 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 263 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 301 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 303 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 434 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 436 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 516 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 518 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 567 | # ====================================================== | COMMENT |
| MEDIUM | …on/vector_blob_demo/hudi_dataframe_vector_blob_demo.py | 569 | # ====================================================== | COMMENT |
| MEDIUM⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 273 | # ====================================================== | COMMENT |
| MEDIUM⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 275 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 71 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 73 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 100 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 102 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 157 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 159 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 191 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 193 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 236 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 238 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 346 | # ====================================================== | COMMENT |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 348 | # ====================================================== | COMMENT |
| MEDIUM⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 396 | # ====================================================== | STRING |
| MEDIUM⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 398 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 441 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 443 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 494 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 496 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 536 | # ====================================================== | STRING |
| MEDIUM | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 538 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 73 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 75 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 111 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 113 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 162 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 164 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 202 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 204 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 262 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 264 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 317 | # ====================================================== | COMMENT |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 319 | # ====================================================== | COMMENT |
| MEDIUM⚡ | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 347 | # ====================================================== | STRING |
| MEDIUM⚡ | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 349 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 405 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 407 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 465 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 467 | # ====================================================== | STRING |
| MEDIUM | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 532 | # ====================================================== | STRING |
| 22 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java | 206 | new Text("John Doe"), | CODE |
| LOW | …g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java | 214 | assertEquals(new Text("John Doe"), serializer.getValue(record, "name")); | CODE |
| LOW | …g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java | 306 | new Text("John Doe"), | CODE |
| LOW | …g/apache/hudi/hadoop/utils/TestHiveAvroSerializer.java | 314 | assertEquals(new Utf8("John Doe"), serializer.getValueAsJava(record, "name")); | CODE |
| LOW | …apache/hudi/io/storage/TestHoodieSparkLanceReader.java | 290 | expectedRows.add(createRow(1, "Alice", createRow("123 Main St", "New York", 10001))); | CODE |
| LOW | …apache/hudi/io/storage/TestHoodieSparkLanceWriter.java | 463 | UTF8String.fromString("123 Main St"), | CODE |
| LOW⚡ | …di/functional/TestFileGroupReaderPartitionColumn.scala | 99 | Row("c", 2550218872L, 2L, "IN", "0x100000021ce30", "Acme Corp", "plan change", 11.0), | CODE |
| LOW⚡ | …di/functional/TestFileGroupReaderPartitionColumn.scala | 105 | Row("c", 2550220512L, 14L, "IN", "0x10000008d8892", "Acme Corp", "deactivation", 17.0), | CODE |
| LOW⚡ | …di/functional/TestFileGroupReaderPartitionColumn.scala | 106 | Row("c", 2550220784L, 16L, "CN", "0x10000007352cd", "Acme Corp", "telecoms activity", 18.0) | CODE |
| LOW | …di/functional/TestFileGroupReaderPartitionColumn.scala | 120 | Row("u", 2650218872L, 2L, "US", "0x100000021ce30", "Acme Corp", "plan change", 11.0), | CODE |
| LOW | …apache/hudi/functional/TestSecondaryIndexPruning.scala | 1800 | spark.sql(s"update $tableName set name = 'John Doe' where record_key_col = 'id1'") | STRING |
| LOW | …apache/hudi/functional/TestSecondaryIndexPruning.scala | 1807 | spark.sql(s"update $tableName set name = 'Jane Doe' where record_key_col = 'id2'") | STRING |
| LOW | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 1279 | | SELECT 1 as id, 'John Doe' as name, 19 as price, 1598886001 as ts | CODE |
| LOW | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 1281 | | SELECT 2, 'Jane Doe', 24, 1598972400 | CODE |
| LOW | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 1293 | | CAST('John Doe' AS STRING) as name, | CODE |
| LOW | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 1316 | Seq(1, "John Doe", 19, if (recordMergeMode == RecordMergeMode.EVENT_TIME_ORDERING.name()) 1598886001L else 1 | CODE |
| LOW | …he/spark/sql/hudi/dml/others/TestMergeIntoTable2.scala | 1317 | Seq(2, "Jane Doe", 24, 1598972400L), | CODE |
| LOW | …ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala | 643 | | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age, | CODE |
| LOW | …ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala | 663 | | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age, | CODE |
| LOW | …ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala | 715 | | SELECT 'emp_001' as record_key, 'John Doe' as name, 30 as age, | CODE |
| LOW | …ql/hudi/dml/others/TestPartialUpdateForMergeInto.scala | 727 | |using ( SELECT 'emp_001' as record_key, 'John Doe' as name, 35 as age, cast(1598886200 as BIGINT) as ts) s | CODE |
| LOW⚡ | …park/sql/hudi/common/TestTableColumnTypeMismatch.scala | 620 | |select 1 as id, 'John Doe' as name, 19 as price, 1598886000 as ts | CODE |
| LOW⚡ | …park/sql/hudi/common/TestTableColumnTypeMismatch.scala | 622 | |select 2, 'Jane Doe', 24, 1598972400 | CODE |
| LOW⚡ | …park/sql/hudi/common/TestTableColumnTypeMismatch.scala | 632 | | cast('John Doe' as ${testCase.sourceSchema.find(_._1 == "name").get._2}) as name, | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 432 | Object rowKeyNotExist = HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", true, false); | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 436 | assertEquals("fake_key(Part -fake_key) field not found in record. Acceptable fields were :[timestamp, _row_key, non_ | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 438 | HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", false, false)).getMessage()); | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 454 | // test get fake_key | COMMENT |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 455 | assertEquals("fake_key(Part -fake_key) field not found in record. Acceptable fields were :[firstname, lastname, stud | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 457 | HoodieAvroUtils.getNestedFieldVal(rec, "fake_key", false, false)).getMessage()); | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 468 | // test get student.fake_key | COMMENT |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 469 | assertEquals("student.fake_key(Part -fake_key) field not found in record. Acceptable fields were :[firstnameNested, | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 471 | HoodieAvroUtils.getNestedFieldVal(rec, "student.fake_key", false, false)).getMessage()); | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 479 | // test get student.firstname.fake_key | COMMENT |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 482 | HoodieAvroUtils.getNestedFieldVal(rec, "student.firstnameNested.fake_key", false, false)).getMessage()); | CODE |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 484 | // test get student.lastname(null).fake_key | COMMENT |
| LOW⚡ | …a/org/apache/hudi/common/avro/TestHoodieAvroUtils.java | 487 | HoodieAvroUtils.getNestedFieldVal(rec, "student.lastnameNested.fake_key", false, false)).getMessage()); | CODE |
| LOW | …di/io/TestSecondaryIndexStreamingTrackerFileSlice.java | 273 | nameMap.put("key1", "John Doe"); | CODE |
| LOW | …i/index/expression/TestHoodieSparkExpressionIndex.java | 162 | RowFactory.create("John Doe"), | CODE |
| LOW | …i-utilities/src/test/resources/data/nested_data_1.json | 1 | {"firstName":"John","lastName":"Doe","birthdate":{"year":1990,"month":5,"day":15},"address":{"street":"123 Main St","cit | CODE |
| LOW | …i/utilities/deltastreamer/TestHoodieDeltaStreamer.java | 958 | "placeholder", false, true, false, null, HoodieTableType.MERGE_ON_READ.name()); | CODE |
| LOW | …es/sources/helpers/TestCloudObjectsSelectorCommon.java | 197 | Row address1 = RowFactory.create("123 Main St", "Springfield", "12345", RowFactory.create("India", "IN")); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 407 | # `named_struct('type', 'INLINE', 'data', <bytes>, 'reference', null)` is | STRING |
| HIGH | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 87 | # DESCRIPTOR → image_bytes.data is null; you must call read_blob() to materialize | COMMENT |
| HIGH⚡ | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 359 | # named_struct('type','OUT_OF_LINE','data', null, 'reference', named_struct(path, offset, length, managed)) | STRING |
| HIGH | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 425 | "\nInspecting stored OUT_OF_LINE blobs — `data` is null, `reference.*` points " | STRING |
| HIGH | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 436 | " `data` is suppressed (length(data) is null), `reference.*` synthesized to point\n" | STRING |
| HIGH | …/test/python/vector_blob_demo/hudi_blob_reader_demo.py | 620 | print("✓ Story: bytes live in the Hudi base files but are read lazily — image_bytes.data is null,") | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …t/functional/TestHoodieClientOnCopyOnWriteStorage.java | 1079 | // rollback should have succeeded. Essentially, the pending clustering should not hinder the rollback of regular com | COMMENT |
| MEDIUM | …ache/hudi/functional/TestParquetColumnProjection.scala | 57 | // is not robust, and works most reliably only when we read just a single file. As such, making table | COMMENT |
| MEDIUM | …/spark/sql/hudi/feature/index/TestSecondaryIndex.scala | 875 | // TODO [HUDI-9549] predicate of is null / not null will not leverage index lookup as of today | COMMENT |
| MEDIUM | …pache/hudi/common/table/log/block/HoodieDataBlock.java | 61 | // TODO rebase records/content to leverage Either to warrant | COMMENT |
| MEDIUM | …/hudi/integ2/testcontainers/command/CommandResult.java | 83 | // Normalize whitespace for more robust matching | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | hudi-notebooks/notebooks/spark3/utils.py | 167 | except Exception as e: | CODE |
| LOW | hudi-notebooks/notebooks/spark3/utils.py | 184 | except Exception as e: | CODE |
| MEDIUM | hudi-notebooks/notebooks/spark3/utils.py | 185 | print(f"Error converting DataFrame to Pandas: {e}") | CODE |
| LOW⚡ | hudi-notebooks/notebooks/spark4/utils.py | 190 | except Exception as e: | CODE |
| LOW⚡ | hudi-notebooks/notebooks/spark4/utils.py | 199 | except Exception as e: | CODE |
| LOW⚡ | hudi-notebooks/notebooks/spark4/utils.py | 204 | except Exception as e: | CODE |
| LOW | hudi-notebooks/notebooks/spark4/utils.py | 215 | except Exception as e: | CODE |
| LOW | hudi-notebooks/notebooks/spark4/utils.py | 245 | except Exception as e: | CODE |
| LOW | hudi-notebooks/notebooks/spark4/utils.py | 264 | except Exception as e: | CODE |
| MEDIUM | hudi-notebooks/notebooks/spark4/utils.py | 265 | print(f"Error converting DataFrame to Pandas: {e}") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .codecov.yml | 19 | # Check if this file is valid by running in bash: | COMMENT |
| LOW | docker/hoodie/hadoop/hive_base/conf/hive-env.sh | 48 | # Set HADOOP_HOME to point to a specific hadoop install directory | COMMENT |
| LOW | …ources/upgrade-downgrade-fixtures/generate-fixtures.sh | 104 | # Check if version is in the requested array | COMMENT |
| LOW | …ources/upgrade-downgrade-fixtures/generate-fixtures.sh | 161 | # Check if Spark binary already exists | COMMENT |
| LOW | scripts/release/validate_source_copyright.sh | 54 | # Check if the variable holding the list of files is non-empty | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | hudi-examples/hudi-examples-dbt/dbt_project.yml | 41 | # In this example config, we tell dbt to build all models in the example/ directory | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …t/python/vector_blob_demo/hudi_sql_vector_blob_demo.py | 280 | def stage_to_parquet_with_pyarrow(data, embedding_dim: int, staging_path: str) -> None: | CODE |
| LOW | …g/apache/hudi/timeline/service/TestRequestHandler.java | 55 | class TestRequestHandler extends HoodieCommonTestHarness { | CODE |
| LOW | …a/org/apache/hudi/timeline/service/RequestHandler.java | 74 | public class RequestHandler { | CODE |
| LOW | …/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala | 560 | def getOrCreateChild(parent: NestedFieldNode, name: String): NestedFieldNode = { | CODE |
| LOW | …pache/spark/sql/hive/SparkCatalogMetaStoreClient.scala | 282 | override def get_role_grants_for_principal(arg0: org.apache.hadoop.hive.metastore.api.GetRoleGrantsForPrincipalRequest | CODE |
| LOW | .github/workflows/azure_ci.js | 20 | async function checkAzureCiAndCreateCommitStatus({ github, context, prNumber, latestCommitHash }) { | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | packaging/bundle-validation/validate.sh | 305 | # Create a temporary directory for CLI commands output | COMMENT |
| MEDIUM | hudi-kafka-connect/demo/setupKafka.sh | 124 | # Create the topic with 4 partitions | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …i/examples/quickstart/source/ContinuousFileSource.java | 59 | * <p>NOTE: this class is represented twice: in test utils and in quickstart. Don't forget to update both files. | COMMENT |
| LOW | …org/apache/hudi/utils/source/ContinuousFileSource.java | 59 | * <p>NOTE: this class is represented twice: in test utils and in quickstart. Don't forget to update both files. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | scripts/pr_compliance.py | 246 | #Class that orchestrates the validation of the entire body | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …mples-spark/src/test/python/HoodiePySparkQuickstart.py | 18 | CODE | |
| LOW | scripts/pr_compliance.py | 20 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/pr_compliance.py | 210 | CODE | |
| LOW | scripts/pr_compliance.py | 284 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/release/copy_staging_repo.sh | 20 | # Usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …e/hudi/utilities/TestHoodieMetadataTableValidator.java | 464 | // TODO: Add validation for compaction and clustering cases | COMMENT |