Apache Beam is a unified programming model for Batch and Streaming data processing.
This report presents the forensic synthetic code analysis of apache/beam, a Java project with 8,628 GitHub stars. SynthScan v2.0 examined 2,850,097 lines of code across 13816 source files, recording 13528 pattern matches distributed across 27 syntactic categories. The overall adjusted score of 7.6 places this repository in the Low AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 13528 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | sdks/go/pkg/beam/io/fhirio/common.go | 163 | operation, err := c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do() | CODE |
| CRITICAL | sdks/go/pkg/beam/io/fhirio/common.go | 170 | operation, err = c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do() | CODE |
| CRITICAL | sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go | 116 | // org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider.configurationSchema(). | COMMENT |
| CRITICAL | sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go | 184 | // org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.from(java.lang.String) | COMMENT |
| CRITICAL | sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go | 199 | // org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.fromQuery(java.lang.String) | COMMENT |
| CRITICAL | sdks/python/apache_beam/io/azure/blobstorageio.py | 44 | from azure.core.exceptions import ResourceNotFoundError | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/io/gcp/bigquery_test.py | 872 | beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema)) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/io/gcp/bigquery_test.py | 916 | table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema( | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/io/gcp/bigquery_test.py | 917 | beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema)) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/io/gcp/bigquery_test.py | 924 | beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema)) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/io/gcp/bigquery_test.py | 937 | beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema)) | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/bigquery_test.py | 829 | table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema( | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/bigquery_test.py | 849 | table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(schema) | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/bigquery_test.py | 902 | beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema)) | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/bigquery_test.py | 1202 | dummy_job_reference = beam.io.gcp.internal.clients.bigquery.JobReference() | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/bigquery_test.py | 2801 | schema = beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema( | CODE |
| CRITICAL | sdks/python/apache_beam/io/gcp/datastore/v1new/util.py | 45 | org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but for | STRING |
| CRITICAL | sdks/python/apache_beam/io/components/util.py | 33 | org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but for | STRING |
| CRITICAL⚡ | sdks/python/apache_beam/transforms/external_test.py | 383 | \tat org.apache.beam.sdk.expansion.service.TransformProvider.apply(TransformProvider.java:121) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/transforms/external_test.py | 384 | \tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:627) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/transforms/external_test.py | 385 | \tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:729) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/transforms/external_test.py | 390 | \tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) | CODE |
| CRITICAL⚡ | sdks/python/apache_beam/transforms/external_test.py | 391 | \tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133) | CODE |
| CRITICAL | …ython/apache_beam/runners/dataflow/dataflow_metrics.py | 104 | in self._job_graph.proto_pipeline.components.transforms.keys()): | CODE |
| CRITICAL | sdks/typescript/test/io_test.ts | 204 | // org.apache.beam.sdk.io.gcp.bigquery.BigQueryTableSourceDef.getBeamSchema(BigQueryTableSourceDef.java:111) | COMMENT |
| CRITICAL⚡ | sdks/typescript/src/apache_beam/io/pubsub.ts | 103 | PubSub.protos.google.pubsub.v1.PubsubMessage.decode(encoded), | CODE |
| CRITICAL | sdks/typescript/src/apache_beam/io/pubsub.ts | 128 | PubSub.protos.google.pubsub.v1.PubsubMessage.encode({ data }).finish(), | CODE |
| CRITICAL | …ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java | 150 | org.apache.commons.logging.LogFactory.getLog("logger.jcl"); | CODE |
| CRITICAL | …ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java | 158 | org.apache.logging.log4j.LogManager.getLogger("logger.log4j2"); | CODE |
| CRITICAL | …/test/java/org/apache/beam/sdk/util/YamlUtilsTest.java | 284 | org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.ImmutableMap.of( | CODE |
| CRITICAL | …e/beam/sdk/util/construction/ParDoTranslationTest.java | 218 | org.apache.beam.sdk.util.construction.Timer.Coder.of( | CODE |
| CRITICAL⚡ | …eam/sdk/util/construction/ValidateRunnerXlangTest.java | 334 | com.google.cloud.secretmanager.v1.Secret.newBuilder() | CODE |
| CRITICAL⚡ | …eam/sdk/util/construction/ValidateRunnerXlangTest.java | 336 | com.google.cloud.secretmanager.v1.Replication.newBuilder() | CODE |
| CRITICAL⚡ | …eam/sdk/util/construction/ValidateRunnerXlangTest.java | 338 | com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder() | CODE |
| CRITICAL⚡ | …/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java | 82 | com.google.cloud.secretmanager.v1.Secret.newBuilder() | CODE |
| CRITICAL⚡ | …/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java | 84 | com.google.cloud.secretmanager.v1.Replication.newBuilder() | CODE |
| CRITICAL⚡ | …/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java | 86 | com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder() | CODE |
| CRITICAL | …/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java | 105 | com.google.cloud.kms.v1.LocationName.of(PROJECT_ID, LOCATION_ID); | CODE |
| CRITICAL | …/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java | 110 | locationName, KEY_RING_ID, com.google.cloud.kms.v1.KeyRing.newBuilder().build()); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 120 | com.google.cloud.secretmanager.v1.Secret.newBuilder() | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 122 | com.google.cloud.secretmanager.v1.Replication.newBuilder() | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 124 | com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder() | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 141 | com.google.cloud.kms.v1.KeyManagementServiceClient.create(); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 144 | com.google.cloud.kms.v1.KeyRingName.of(PROJECT_ID, locationId, KEY_RING_ID); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 146 | com.google.cloud.kms.v1.LocationName.of(PROJECT_ID, locationId); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 151 | locationName, KEY_RING_ID, com.google.cloud.kms.v1.KeyRing.newBuilder().build()); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 155 | com.google.cloud.kms.v1.CryptoKeyName.of(PROJECT_ID, locationId, KEY_RING_ID, KEY_ID); | CODE |
| CRITICAL⚡ | …pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java | 160 | com.google.cloud.kms.v1.CryptoKey.newBuilder() | CODE |
| CRITICAL⚡ | …ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java | 652 | com.google.cloud.secretmanager.v1.Secret.newBuilder() | CODE |
| CRITICAL⚡ | …ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java | 654 | com.google.cloud.secretmanager.v1.Replication.newBuilder() | CODE |
| CRITICAL⚡ | …ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java | 656 | com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder() | CODE |
| CRITICAL | …che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java | 51 | assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable()); | CODE |
| CRITICAL | …che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java | 63 | assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable()); | CODE |
| CRITICAL | …c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java | 58 | com.fasterxml.jackson.core.StreamReadConstraints.overrideDefaultStreamReadConstraints( | CODE |
| CRITICAL | …c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java | 59 | com.fasterxml.jackson.core.StreamReadConstraints.builder() | CODE |
| CRITICAL | …c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java | 82 | com.fasterxml.jackson.core.StreamReadConstraints.builder() | CODE |
| CRITICAL | …va/org/apache/beam/sdk/util/GcpHsmGeneratedSecret.java | 89 | com.google.cloud.secretmanager.v1.Secret.newBuilder() | CODE |
| CRITICAL | …e/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java | 199 | return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource())); | CODE |
| CRITICAL | …e/src/main/java/org/apache/beam/sdk/io/WriteFiles.java | 999 | org.apache.beam.sdk.util.ShardedKey.Coder.of(VarIntCoder.of()), | CODE |
| CRITICAL | …/core/src/main/java/org/apache/beam/sdk/io/TextIO.java | 431 | return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource())); | CODE |
| 458 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | .asf.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | start-build-env.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | .pre-commit-config.yaml | 1 | # Licensed under the Apache License, Version 2.0 (the "License"); | COMMENT |
| LOW | .yamllint.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | local-env-setup.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | .gemini/config.yaml | 1 | # | COMMENT |
| LOW | infra/security/log_analyzer.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/security/requirements.txt | 1 | # | COMMENT |
| LOW | infra/security/config.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/iam/main.tf | 1 | # | COMMENT |
| LOW | infra/iam/requirements.txt | 1 | # | COMMENT |
| LOW | infra/iam/users.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/iam/users.tf | 1 | # | COMMENT |
| LOW | infra/iam/migrate_roles.py | 1 | # | COMMENT |
| LOW | infra/iam/roles/beam_writer.role.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/iam/roles/generate_roles.py | 1 | # | COMMENT |
| LOW | infra/iam/roles/generate_roles.py | 21 | import datetime | COMMENT |
| LOW | infra/iam/roles/beam_admin.role.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/iam/roles/beam_viewer.role.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/iam/roles/test_generate_roles.py | 1 | # | COMMENT |
| LOW | infra/iam/roles/roles_config.yaml | 1 | # | COMMENT |
| LOW | infra/iam/roles/roles.tf | 1 | # | COMMENT |
| LOW | infra/iam/roles/beam_infra_manager.role.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/requirements.txt | 1 | # | COMMENT |
| LOW | infra/keys/test_secret_manager.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/service_account.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/config.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/keys.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/secret_manager.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/keys.yaml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/keys/keys.yaml | 21 | # display_name: account_@project_id.iam.gserviceaccount.com | COMMENT |
| LOW | infra/keys/test_service_account.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/enforcement/requirements.txt | 1 | # | COMMENT |
| LOW | infra/enforcement/iam.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/enforcement/config.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/enforcement/sending.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/enforcement/account_keys.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | infra/enforcement/account_keys.py | 261 | header_info: A string containing the header information to be included in the YAML file. | COMMENT |
| LOW | sdks/standard_external_transforms.yaml | 1 | # | COMMENT |
| LOW | sdks/standard_expansion_services.yaml | 1 | # | COMMENT |
| LOW | sdks/standard_expansion_services.yaml | 21 | # Each service must specify a package destination for each supported SDK, which | COMMENT |
| LOW | sdks/standard_expansion_services.yaml | 61 | 'beam:schematransform:org.apache.beam:mqtt_write:v1': | COMMENT |
| LOW | sdks/standard_expansion_services.yaml | 81 | # - 'beam:schematransform:org.apache.beam:generate_sequence:v1' | COMMENT |
| LOW | sdks/go/run_with_go_version.sh | 1 | #!/bin/bash | COMMENT |
| LOW | sdks/go/run_with_go_version.sh | 21 | # | COMMENT |
| LOW | sdks/go/prepare_go_version.sh | 1 | #!/bin/bash | COMMENT |
| LOW | sdks/go/cmd/starcgen/starcgen_test.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/starcgen/starcgen.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/starcgen/starcgen.go | 21 | // reflection based shims used by beam. Reflection is convenient for development, | COMMENT |
| LOW | sdks/go/cmd/starcgen/starcgen.go | 181 | } | COMMENT |
| LOW | sdks/go/cmd/specialize/main.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/specialize/main_test.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/symtab/main.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/prism/prism.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/beamctl/main.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/beamctl/cmd/artifact.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/beamctl/cmd/provision.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/cmd/beamctl/cmd/root.go | 1 | // Licensed to the Apache Software Foundation (ASF) under one or more | COMMENT |
| LOW | sdks/go/test/run_validatesrunner_tests.sh | 1 | #!/bin/bash | COMMENT |
| LOW | sdks/go/test/run_validatesrunner_tests.sh | 21 | # The following runners are supported, and selected via a flag: | COMMENT |
| 5093 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/security/log_analyzer.py | 116 | def _grant_bucket_permissions(self, sink: logging_v2.Sink) -> None: | STRING |
| LOW | infra/security/log_analyzer.py | 207 | def create_weekly_email_report(self, dry_run: bool = False) -> None: | STRING |
| LOW | infra/keys/test_secret_manager.py | 98 | def test_get_secret_ids_exception(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 129 | def test_secret_is_managed_true(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 141 | def test_secret_is_managed_false(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 153 | def test_secret_is_managed_not_exists(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 164 | def test_create_secret_success(self, mock_client, mock_sleep): | CODE |
| LOW | infra/keys/test_secret_manager.py | 192 | def test_create_secret_already_managed(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 222 | def test_get_secret_not_exists(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 232 | def test_get_secret_not_managed(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 246 | def test_delete_secret_success(self, mock_client, mock_is_managed, mock_exists): | CODE |
| LOW | infra/keys/test_secret_manager.py | 260 | def test_delete_secret_not_managed(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 275 | def test_is_different_user_access_same(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 297 | def test_is_different_user_access_different(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 319 | def test_update_secret_access_success(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 339 | def test_get_secret_versions_success(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 354 | def test_secret_version_exists_true(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 370 | def test_secret_version_exists_false(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 386 | def test_secret_version_is_enabled_true(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 403 | def test_secret_version_is_enabled_false(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 420 | def test_get_latest_secret_version_id_success(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 445 | def test_get_latest_secret_version_id_no_enabled(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 462 | def test_is_key_rotation_due_true(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 478 | def test_is_key_rotation_due_false(self, mock_client): | CODE |
| LOW | infra/keys/test_secret_manager.py | 496 | def test_add_secret_version_success(self, mock_client, mock_checksum, mock_sleep): | CODE |
| LOW | infra/keys/test_secret_manager.py | 529 | def test_get_latest_secret_version_success(self, mock_client, mock_checksum): | CODE |
| LOW | infra/keys/test_secret_manager.py | 561 | def test_enable_secret_version_success(self, mock_client, mock_sleep): | CODE |
| LOW | infra/keys/test_secret_manager.py | 596 | def test_disable_secret_version_success(self, mock_client, mock_sleep): | CODE |
| LOW | infra/keys/test_secret_manager.py | 631 | def test_destroy_secret_version_success(self, mock_client, mock_sleep): | CODE |
| LOW | infra/keys/test_secret_manager.py | 680 | def test_purge_disabled_secret_versions_success(self, mock_client, mock_destroy): | CODE |
| LOW | infra/keys/test_secret_manager.py | 774 | def test_full_secret_lifecycle(self): | CODE |
| LOW | infra/keys/service_account.py | 88 | def _service_account_is_enabled(self, account_id: str) -> bool: | CODE |
| LOW | infra/keys/service_account.py | 246 | def _get_service_account_keys(self, account_id: str) -> List[iam_admin_v1.ServiceAccountKey]: | CODE |
| LOW | infra/keys/service_account.py | 264 | def _service_account_key_exists(self, account_id: str, key_id: str) -> bool: | CODE |
| LOW | infra/keys/service_account.py | 278 | def create_service_account_key(self, account_id: str) -> types.ServiceAccountKey: | CODE |
| LOW | infra/keys/service_account.py | 343 | def delete_service_account_key(self, account_id: str, key_id: str) -> None: | CODE |
| LOW | infra/keys/keys.py | 74 | def load_service_accounts_config() -> ServiceAccountsConfig: | CODE |
| LOW | infra/keys/keys.py | 183 | def _start_all_service_accounts(self) -> None: | CODE |
| LOW | infra/keys/keys.py | 301 | def get_latest_service_account_key(self, account_id: str) -> str: | CODE |
| LOW | infra/keys/secret_manager.py | 355 | def _secret_version_is_enabled(self, secret_id: str, version_id: str) -> bool: | CODE |
| LOW | infra/keys/secret_manager.py | 379 | def _secret_version_is_destroyed(self, secret_id: str, version_id: str) -> bool: | CODE |
| LOW | infra/keys/secret_manager.py | 403 | def _get_latest_secret_version_id(self, secret_id: str) -> str: | CODE |
| LOW | infra/keys/secret_manager.py | 530 | def get_latest_secret_version(self, secret_id: str) -> Tuple[str, bytes]: | CODE |
| LOW | infra/keys/secret_manager.py | 737 | def purge_disabled_secret_versions(self, secret_id: str) -> List[str]: | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 49 | def _create_mock_service_account(self, account_id: str, disabled: bool = False) -> types.ServiceAccount: | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 206 | def test_create_service_account_key_not_found(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 213 | def test_delete_service_account_key(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 222 | def test_list_service_account_keys(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 276 | def test_normalize_account_email_with_email(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 282 | def test_normalize_account_email_with_id(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 288 | def test_service_account_exists_true(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 298 | def test_service_account_exists_false(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 307 | def test_service_account_is_enabled_true(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 317 | def test_service_account_is_enabled_false(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 327 | def test_service_account_is_enabled_not_found(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 336 | def test_get_service_account_success(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 346 | def test_get_service_account_not_found(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 355 | def test_service_account_key_exists_true(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 381 | def test_delete_service_account_key_not_found(self): | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 391 | def test_delete_service_account_key_failed_precondition(self): | CODE |
| 4943 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | infra/iam/roles/generate_roles.py | 0 | \ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice file | STRING |
| HIGH | infra/enforcement/iam.py | 0 | \ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice file | STRING |
| HIGH | infra/enforcement/account_keys.py | 0 | \ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice file | STRING |
| HIGH | sdks/python/gen_protos.py | 0 | \ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice file | STRING |
| HIGH | examples/notebooks/patch.py | 0 | \ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice file | STRING |
| HIGH | sdks/python/apache_beam/pipeline.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/coders/coder_impl.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/dill_pickler.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/cloudpickle_pickler.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/pickler.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/metrics/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/azure/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/internal/gcp/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/utils/urns.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/utils/proto_utils.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | …he_beam/transforms/py_dataflow_distribution_counter.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/portability/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/portability/utils.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/runners/common.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/runners/direct/executor.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/runners/worker/__init__.py | 0 | for internal use only; no backwards-compatibility guarantees. | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 0 | join two or more pathname components for the filesystem args: basepath: string path of the first component of the path p | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componen | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componen | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componen | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 0 | recursively create directories for the provided path. args: path: string path of the directory structure that should be | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 0 | recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects t | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 0 | rename the files at the source list to the destination list. source and destination lists should be of the same size. ar | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 0 | check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 0 | get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raises | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 0 | get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raises | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 0 | get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raises | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 0 | get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raises | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 0 | get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raises | STRING |
| 189 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | sdks/python/apache_beam/dataframe/schemas_test.py | 193 | self.assertTrue(roundtripped.equals(NICE_TYPES_PROXY)) | CODE |
| HIGH | sdks/python/apache_beam/dataframe/partitionings.py | 142 | if not df.index.equals(repartitioned_df.index): | CODE |
| HIGH | sdks/python/apache_beam/dataframe/transforms_test.py | 279 | if not expected.equals(actual): | CODE |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 780 | "result. Consider using df.length() instead.", | CODE |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 828 | lambda df, other: pd.Series(df.equals(other)), | CODE |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 1576 | size = self.length() | CODE |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 2318 | return result / column.length() | CODE |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 3985 | return result/dropped.length() | CODE |
| HIGH⚡ | sdks/python/apache_beam/io/snowflake.py | 390 | {"dataType":{"type":"binary","size":null},"name":"","nullable":false}, | STRING |
| HIGH⚡ | sdks/python/apache_beam/io/snowflake.py | 392 | {"dataType":{"type":"string","length":null},"name":"","nullable":false}, | STRING |
| HIGH⚡ | sdks/python/apache_beam/io/snowflake.py | 393 | {"dataType":{"type":"text","length":null},"name":"","nullable":false}, | STRING |
| HIGH⚡ | sdks/python/apache_beam/io/snowflake.py | 394 | {"dataType":{"type":"varbinary","size":null},"name":"","nullable":false}, | STRING |
| HIGH | …ks/python/apache_beam/io/gcp/bigquery_read_internal.py | 467 | # It probably means its value was null, as the extract to JSON job | COMMENT |
| HIGH⚡ | sdks/python/apache_beam/internal/pickler_test.py | 288 | # elements. Iteration order is implementation dependent and undefined, | COMMENT |
| HIGH⚡ | sdks/python/apache_beam/internal/pickler_test.py | 298 | # elements. Iteration order is implementation dependent and undefined, | COMMENT |
| HIGH | sdks/python/apache_beam/utils/retry.py | 254 | 404 Http errors most of the time. The default value will return true | STRING |
| HIGH | sdks/python/apache_beam/ml/anomaly/thresholds.py | 173 | self._tracker.push(float("NaN")) | CODE |
| HIGH | sdks/python/apache_beam/ml/anomaly/thresholds.py | 176 | self._tracker.push(score) | CODE |
| HIGH | sdks/python/apache_beam/ml/anomaly/univariate/mad.py | 67 | self._median_tracker.push(x) | CODE |
| HIGH | sdks/python/apache_beam/ml/anomaly/univariate/mad.py | 69 | self._diff_median_tracker.push(abs(x - median)) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 35 | t.push(1) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 37 | t.push(2) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 39 | t.push(3) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 41 | t.push(10) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 47 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 50 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 53 | t.push(2) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 55 | t.push(1) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 57 | t.push(3) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 61 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 64 | t.push(10) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 80 | t1.push(v) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 81 | t2.push(v) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 91 | t.push(2) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 93 | t.push(1) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 95 | t.push(3) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 97 | t.push(10) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 104 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 107 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 110 | t.push(1) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 112 | t.push(2) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 114 | t.push(3) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 118 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 121 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 124 | t.push(float('nan')) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 131 | t.push(4) | CODE |
| HIGH⚡ | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 133 | t.push(5) | CODE |
| HIGH | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 149 | t1.push(v) | CODE |
| HIGH | …python/apache_beam/ml/anomaly/univariate/stdev_test.py | 150 | t2.push(v) | CODE |
| HIGH | …/python/apache_beam/ml/anomaly/univariate/perf_test.py | 41 | tracker.push(numbers[i]) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 39 | t.push(1) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 41 | t.push(2) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 43 | t.push(2) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 45 | t.push(0) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 47 | t.push(3) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 49 | t.push(1) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 58 | t.push(1) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 60 | t.push(float('nan')) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 62 | t.push(2) | CODE |
| HIGH⚡ | …hon/apache_beam/ml/anomaly/univariate/quantile_test.py | 64 | t.push(float('nan')) | CODE |
| 90 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | infra/iam/main.tf | 17 | # This file defines the general configuration for the Terraform project. | COMMENT |
| MEDIUM | infra/iam/migrate_roles.py | 91 | # Create the migrated entry | COMMENT |
| MEDIUM | infra/iam/.terraform.lock.hcl | 1 | # This file is maintained automatically by "terraform init". | COMMENT |
| MEDIUM | infra/iam/roles/beam_writer.role.yaml | 16 | # This file is auto-generated by generate_roles.py. | COMMENT |
| MEDIUM | infra/iam/roles/generate_roles.py | 44 | # This file is auto-generated by generate_roles.py. | COMMENT |
| MEDIUM | infra/iam/roles/beam_admin.role.yaml | 16 | # This file is auto-generated by generate_roles.py. | COMMENT |
| MEDIUM | infra/iam/roles/beam_viewer.role.yaml | 16 | # This file is auto-generated by generate_roles.py. | COMMENT |
| MEDIUM | infra/iam/roles/roles_config.yaml | 18 | # This file defines the roles, their hierarchy, the services they can access and the roles they inherit from. | COMMENT |
| MEDIUM | infra/iam/roles/beam_infra_manager.role.yaml | 16 | # This file is auto-generated by generate_roles.py. | COMMENT |
| MEDIUM | infra/keys/test_secret_manager.py | 757 | # Create a logger for integration tests | COMMENT |
| MEDIUM | infra/keys/service_account.py | 307 | # Create the key | COMMENT |
| MEDIUM | infra/keys/keys.py | 174 | # Create a null logger that doesn't actually log anything | COMMENT |
| MEDIUM | infra/keys/keys.yaml | 17 | # This file contains the service account for the project, the account id | COMMENT |
| MEDIUM⚡ | infra/keys/test_service_account.py | 39 | # Create a mock logger | COMMENT |
| MEDIUM⚡ | infra/keys/test_service_account.py | 42 | # Create the service account manager | COMMENT |
| MEDIUM | infra/keys/test_service_account.py | 546 | # Create a key for the service account | COMMENT |
| MEDIUM | infra/keys/test_service_account.py | 560 | # Create a new key to ensure we have multiple keys | COMMENT |
| MEDIUM | sdks/python/gen_managed_doc.py | 116 | # Creating a unique list of expansion service jars. | STRING |
| MEDIUM | sdks/python/apache_beam/pipeline.py | 256 | # Create a ComponentIdMap for assigning IDs to components. Ensures that any | COMMENT |
| MEDIUM | sdks/python/apache_beam/pipeline.py | 31 | # Create a pipeline object using a local runner for execution. | STRING |
| MEDIUM | sdks/python/apache_beam/io/mongodbio.py | 18 | """This module implements IO classes to read and write data on MongoDB. | STRING |
| MEDIUM | sdks/python/apache_beam/io/iobase.py | 615 | """This class is deprecated, no backwards-compatibility guarantees. | STRING |
| MEDIUM | sdks/python/apache_beam/io/iobase.py | 878 | """This class is deprecated, no backwards-compatibility guarantees. | STRING |
| MEDIUM | sdks/python/apache_beam/io/fileio_test.py | 66 | # Create a couple files to be matched | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/fileio_test.py | 240 | # Create a couple files to be matched | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/fileio_test.py | 258 | # Create a couple files to be matched | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/fileio_test.py | 329 | # Create a file to be matched before pipeline | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/fileio_test.py | 363 | # Create a file to be matched before pipeline starts | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery_biglake_test.py | 68 | # Create the transform | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery_test.py | 1983 | # Create a windowed value for testing | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery_test.py | 2062 | # Create a windowed value for testing | COMMENT |
| MEDIUM | …ython/apache_beam/io/gcp/bigquery_geography_it_test.py | 223 | # Create the table first | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 1191 | # Create a new table potentially reusing the schema from a previously | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/io/gcp/bigquery_tools_test.py | 1111 | # Create a mock field with GEOGRAPHY type | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/gcsio_test.py | 94 | # Define the exit logic | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/gcsio_test.py | 479 | # Creating a mock bucket without setting project_number (it returns another mock object) | COMMENT |
| MEDIUM | …/apache_beam/io/gcp/bigquery_change_history_it_test.py | 428 | # Create a change-history-enabled table and insert initial rows via DML. | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/pubsub.py | 318 | """This class is deprecated. Use ``ReadFromPubSub`` instead.""" | STRING |
| MEDIUM | sdks/python/apache_beam/io/gcp/pubsub.py | 341 | """This class is deprecated. Use ``WriteToPubSub`` instead.""" | STRING |
| MEDIUM⚡ | …ython/apache_beam/io/gcp/bigquery_schema_tools_test.py | 291 | # Create a user type with GEOGRAPHY field | COMMENT |
| MEDIUM⚡ | …ython/apache_beam/io/gcp/bigquery_schema_tools_test.py | 300 | # Create the DoFn | COMMENT |
| MEDIUM | …che_beam/io/gcp/healthcare/dicomio_integration_test.py | 89 | # Create a an empty DICOM store | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/aws/s3io_test.py | 388 | # Create the file in the real bucket | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/aws/s3io_test.py | 446 | # Create the file and check that it was created | COMMENT |
| MEDIUM | …on/apache_beam/io/external/xlang_debeziumio_it_test.py | 124 | # Creating a container with testcontainers sometimes raises ReadTimeout | COMMENT |
| MEDIUM | …python/apache_beam/io/external/xlang_mqttio_it_test.py | 94 | # Creating a container with testcontainers sometimes raises ReadTimeout | COMMENT |
| MEDIUM⚡ | …python/apache_beam/io/external/xlang_jdbcio_it_test.py | 176 | # Creating a container with testcontainers sometimes raises ReadTimeout | COMMENT |
| MEDIUM | …python/apache_beam/io/external/xlang_jdbcio_it_test.py | 382 | # Create a simple table for this test | COMMENT |
| MEDIUM | sdks/python/apache_beam/internal/dill_pickler.py | 54 | # The following function is based on 'save_code' from 'dill' | COMMENT |
| MEDIUM | sdks/python/apache_beam/internal/dill_pickler.py | 61 | # The following function is also based on 'save_codeobject' from 'cloudpickle' | COMMENT |
| MEDIUM | sdks/python/apache_beam/utils/multi_process_shared.py | 454 | # Create a pipe to connect with child process | COMMENT |
| MEDIUM | sdks/python/apache_beam/utils/windowed_value.py | 20 | # This module is carefully crafted to have optimal performance when | COMMENT |
| MEDIUM | …python/apache_beam/utils/transform_service_launcher.py | 97 | # Creating the credentials volume. | COMMENT |
| MEDIUM | …python/apache_beam/utils/transform_service_launcher.py | 123 | # Creating the dependencies volume. | COMMENT |
| MEDIUM | sdks/python/apache_beam/transforms/ptransform.py | 856 | # Create a flat list rather than a nested tree of composite | COMMENT |
| MEDIUM | sdks/python/apache_beam/transforms/util.py | 2051 | """This class represents the parameters for | STRING |
| MEDIUM | sdks/python/apache_beam/transforms/core.py | 1994 | """This class represents the state in the ParDoPayload's function spec, | STRING |
| MEDIUM⚡ | sdks/python/apache_beam/transforms/core_test.py | 240 | # Create an instance of the ApplyPartitionFnFn class | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/transforms/core_test.py | 243 | # Define a simple partition function | COMMENT |
| MEDIUM | sdks/python/apache_beam/transforms/core_test.py | 266 | # Create an instance of the ApplyPartitionFnFn class | COMMENT |
| 130 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 4642 | Applies aggregation functions to the grouped data based on the provided keyword arguments and combines the results | STRING |
| HIGH | sdks/python/apache_beam/dataframe/frames.py | 4685 | Handles the aggregation logic based on the function type passed. Args: gb: The groupby instance (DeferredGro | STRING |
| HIGH | sdks/python/apache_beam/io/hadoopfilesystem.py | 150 | Verifies that url begins with hdfs:// prefix, strips it and adds a leading /. Parsing behavior is determined by | STRING |
| HIGH | sdks/python/apache_beam/io/hadoopfilesystem.py | 394 | Fetches last updated time for a URL. Args: url: string url of file. Returns: float UNIX Epoch time | STRING |
| HIGH | sdks/python/apache_beam/io/hadoopfilesystem.py | 424 | Fetch metadata fields of a file on the FileSystem. Args: url: string url of a file. Returns: :clas | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 205 | Find all matching paths to the patterns provided. Pattern matching is done using each filesystem's ``match`` method | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 329 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | sdks/python/apache_beam/io/filesystems.py | 344 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returns | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 589 | List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dir | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 712 | Find all matching paths to the patterns provided. See Also: :meth:`translate_pattern` Patterns ending wi | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 854 | Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size of | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 868 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 881 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returns | STRING |
| HIGH | sdks/python/apache_beam/io/filesystem.py | 903 | Fetch metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returns metadata | STRING |
| HIGH | sdks/python/apache_beam/io/tfrecordio.py | 138 | Read a record from a TFRecords file. Args: file_handle: The file to read from. Returns: None if EOF | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 99 | List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_ | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 266 | Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accor | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 282 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 297 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: stri | STRING |
| HIGH | sdks/python/apache_beam/io/localfilesystem.py | 313 | Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :cl | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 115 | List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dir_o | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 234 | Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size of | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 250 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 266 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: stri | STRING |
| HIGH | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 283 | Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :cl | STRING |
| HIGH | sdks/python/apache_beam/io/azure/blobstorageio.py | 132 | Open an Azure Blob Storage file path for reading or writing. Args: filename (str): Azure Blob Storage file pa | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 120 | List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_ | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 285 | Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accor | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 298 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 311 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: stri | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 328 | Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :cl | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 160 | Parses a table reference into a (project, dataset, table) tuple. Args: destination: Either a TableReference objec | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 239 | Parses a table reference into a (project, dataset, table) tuple. Args: table: The ID of the table. The ID must co | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 794 | Lookup a table's metadata object. Args: client: bigquery.BigqueryV2 instance project_id: table lookup p | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 1141 | Gets or creates a table based on create and write dispositions. The function mimics the behavior of BigQuery import | STRING |
| HIGH | sdks/python/apache_beam/io/gcp/gcsio.py | 274 | Open a GCS file path for reading or writing. Args: filename (str): GCS file path in the form ``gs://<bucket>/ | STRING |
| HIGH | …n/apache_beam/io/gcp/datastore/v1new/query_splitter.py | 45 | Returns a list of sharded queries for the given Cloud Datastore query. This will create up to the desired number of s | STRING |
| HIGH | sdks/python/apache_beam/io/components/rate_limiter.py | 59 | Applies rate limiting to the request. This method checks if the request is permitted by the rate limiting policy. | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3io.py | 76 | Open an S3 file path for reading or writing. Args: filename (str): S3 file path in the form ``s3://<bucket>/< | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 117 | List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_ | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 237 | Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accor | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 253 | Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX E | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 269 | Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: stri | STRING |
| HIGH | sdks/python/apache_beam/io/aws/s3filesystem.py | 286 | Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :cl | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 68 | Returns the code object identifier for a given callable. Args: callable: The callable object to search for. Re | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 230 | Searches a code object to create a code object identifier. Args: callable: The callable to search for. node: | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 335 | Returns the code object from a name pattern. Args: obj: The object to search within. name_result: The result | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 362 | Returns the code object from a lambda with args pattern. Args: obj: The object to search within. lambda_with_ | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 392 | Returns the code object from a lambda with hash pattern. Args: obj: The object to search within. lambda_with_ | STRING |
| HIGH | sdks/python/apache_beam/internal/code_object_pickler.py | 423 | Returns the code object corresponding to the code object identifier. Args: code_object_identifier: A string repre | STRING |
| HIGH | sdks/python/apache_beam/internal/gcp/json_value.py | 37 | For internal use only; no backwards-compatibility guarantees. Converts a basic type into a @type/value dictionary. | STRING |
| HIGH | sdks/python/apache_beam/internal/gcp/json_value.py | 66 | For internal use only; no backwards-compatibility guarantees. Converts Python objects into extra_types.JsonValue obje | STRING |
| HIGH | sdks/python/apache_beam/internal/gcp/json_value.py | 126 | For internal use only; no backwards-compatibility guarantees. Converts ``extra_types.JsonValue`` objects into Python | STRING |
| HIGH | sdks/python/apache_beam/utils/byte_limited_queue.py | 132 | Remove and return an item from the queue. If the queue is empty, block until an item is available, unless `block` | STRING |
| HIGH | sdks/python/apache_beam/transforms/ptransform.py | 393 | Annotates the input type of a :class:`PTransform` with a type-hint. Args: input_type_hint (type): An instance | STRING |
| HIGH | sdks/python/apache_beam/transforms/ptransform.py | 418 | Annotates the output type of a :class:`PTransform` with a type-hint. Args: type_hint (type): An instance of a | STRING |
| HIGH | sdks/python/apache_beam/transforms/ptransform.py | 454 | Adds resource hints to the :class:`PTransform`. Resource hints allow users to express constraints on the environmen | STRING |
| HIGH | sdks/python/apache_beam/transforms/ptransform.py | 920 | Annotates the types of main inputs and side inputs for the PTransform. Args: input_type_hint: An instance of | STRING |
| HIGH | sdks/python/apache_beam/transforms/core.py | 1807 | Returns a tagged tuple allowing access to the outputs of a :class:`ParDo`. The resulting object supports access | STRING |
| HIGH | sdks/python/apache_beam/transforms/core.py | 2065 | :func:`FlatMap` is like :class:`ParDo` except it takes a callable to specify the transformation. The callable must | STRING |
| 45 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/security/log_analyzer.py | 270 | except Exception as e: | STRING |
| MEDIUM⚡ | infra/iam/roles/generate_roles.py | 80 | print(f"Error: Permission denied. Ensure you have 'resourcemanager.projects.get' on project '{project_id}'.") | CODE |
| MEDIUM⚡ | infra/iam/roles/generate_roles.py | 84 | print(f"Error: Project '{project_id}' not found.") | CODE |
| LOW⚡ | infra/iam/roles/generate_roles.py | 87 | except Exception as e: | CODE |
| MEDIUM | infra/iam/roles/generate_roles.py | 130 | print(f"Error: The role '{role_name}' was not found.") | CODE |
| LOW | infra/iam/roles/generate_roles.py | 132 | except Exception as e: | CODE |
| LOW | infra/keys/test_secret_manager.py | 771 | except Exception as e: | CODE |
| LOW | infra/keys/service_account.py | 335 | except Exception as e: | CODE |
| LOW | infra/keys/service_account.py | 367 | except Exception as e: | CODE |
| LOW | infra/keys/service_account.py | 415 | except Exception as auth_error: | CODE |
| LOW | infra/keys/keys.py | 236 | except Exception as e: | CODE |
| LOW | infra/keys/keys.py | 277 | except Exception as e: | CODE |
| LOW | infra/keys/keys.py | 292 | except Exception as e: | CODE |
| LOW | infra/keys/keys.py | 321 | except Exception as e: | CODE |
| MEDIUM | infra/keys/keys.py | 355 | print(f"Error: Service account '{account_id}' not found in configuration.") | CODE |
| LOW⚡ | infra/keys/keys.py | 370 | except Exception as e: | CODE |
| MEDIUM⚡ | infra/keys/keys.py | 371 | print(f"Error retrieving key for {account_id}: {e}") | CODE |
| LOW⚡ | infra/keys/keys.py | 376 | except Exception as e: | CODE |
| MEDIUM⚡ | infra/keys/keys.py | 377 | print(f"An error occurred: {e}") | CODE |
| LOW | infra/keys/secret_manager.py | 67 | except Exception as e: | CODE |
| LOW | infra/keys/secret_manager.py | 88 | except Exception as e: | CODE |
| LOW | infra/keys/secret_manager.py | 252 | except Exception as e: | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 523 | except Exception as e: | CODE |
| LOW⚡ | infra/keys/test_service_account.py | 525 | except Exception as e: | CODE |
| LOW | infra/enforcement/iam.py | 94 | except Exception as e: | CODE |
| LOW | infra/enforcement/iam.py | 158 | except Exception as e: | CODE |
| LOW | infra/enforcement/iam.py | 380 | except Exception as e: | STRING |
| LOW⚡ | infra/enforcement/iam.py | 410 | except Exception as e: | STRING |
| LOW | infra/enforcement/account_keys.py | 126 | except Exception as e: | CODE |
| LOW | infra/enforcement/account_keys.py | 152 | except Exception as e: | CODE |
| LOW | infra/enforcement/account_keys.py | 175 | except Exception as e: | CODE |
| LOW | infra/enforcement/account_keys.py | 195 | except Exception as e: | CODE |
| LOW | infra/enforcement/account_keys.py | 226 | except Exception as e: | CODE |
| LOW⚡ | infra/enforcement/account_keys.py | 589 | except Exception as e: | STRING |
| LOW | infra/enforcement/account_keys.py | 559 | except Exception as e: | STRING |
| LOW | sdks/python/conftest.py | 134 | except Exception as e: | CODE |
| LOW⚡ | sdks/python/apache_beam/pipeline.py | 1050 | except Exception: | CODE |
| LOW | sdks/python/apache_beam/pipeline.py | 1508 | except Exception as exn: | CODE |
| LOW | …n/apache_beam/options/pipeline_options_context_test.py | 86 | except Exception as e: | CODE |
| LOW | …n/apache_beam/options/pipeline_options_context_test.py | 274 | except Exception as e: | CODE |
| MEDIUM | …n/apache_beam/options/pipeline_options_context_test.py | 71 | def thread_worker(thread_id, runner_name): | CODE |
| MEDIUM | …n/apache_beam/options/pipeline_options_context_test.py | 265 | def construct_pipeline(worker_id): | CODE |
| LOW | sdks/python/apache_beam/coders/coders_test_common.py | 816 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/coders/coders_test_common.py | 853 | except Exception as e: | STRING |
| LOW⚡ | sdks/python/apache_beam/coders/coder_impl.py | 517 | except Exception as e: | CODE |
| LOW⚡ | sdks/python/apache_beam/coders/coder_impl.py | 524 | except Exception as e: | CODE |
| LOW⚡ | sdks/python/apache_beam/coders/coder_impl.py | 532 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 454 | except Exception as exn: | CODE |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 472 | except Exception as exn: | CODE |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 548 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/coders/coders.py | 839 | except Exception: # pylint: disable=broad-except | CODE |
| LOW | sdks/python/apache_beam/coders/coders.py | 847 | except Exception: # pylint: disable=broad-except | CODE |
| LOW | sdks/python/apache_beam/coders/coders.py | 1033 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/coders/typecoders.py | 252 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 288 | except Exception: | CODE |
| LOW | sdks/python/apache_beam/dataframe/frames_test.py | 80 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/dataframe/frames_test.py | 91 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/dataframe/frames_test.py | 105 | except Exception as e: | CODE |
| LOW | sdks/python/apache_beam/io/hadoopfilesystem.py | 226 | except Exception as e: # pylint: disable=broad-except | CODE |
| LOW | sdks/python/apache_beam/io/hadoopfilesystem.py | 339 | except Exception as e: # pylint: disable=broad-except | CODE |
| 357 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/security/log_analyzer.py | 158 | CODE | |
| LOW | infra/iam/migrate_roles.py | 31 | CODE | |
| LOW | infra/keys/service_account.py | 278 | CODE | |
| LOW | infra/keys/keys.py | 325 | CODE | |
| LOW | infra/keys/keys.py | 183 | CODE | |
| LOW | infra/keys/keys.py | 239 | CODE | |
| LOW | infra/keys/test_service_account.py | 514 | CODE | |
| LOW | infra/enforcement/iam.py | 343 | CODE | |
| LOW | infra/enforcement/iam.py | 78 | CODE | |
| LOW | infra/enforcement/iam.py | 201 | CODE | |
| LOW | infra/enforcement/account_keys.py | 522 | CODE | |
| LOW | infra/enforcement/account_keys.py | 199 | CODE | |
| LOW | infra/enforcement/account_keys.py | 293 | CODE | |
| LOW | sdks/python/gen_xlang_wrappers.py | 247 | CODE | |
| LOW | sdks/python/gen_managed_doc.py | 104 | CODE | |
| LOW | sdks/python/gen_protos.py | 111 | CODE | |
| LOW | sdks/python/gen_protos.py | 370 | CODE | |
| LOW | sdks/python/gen_protos.py | 416 | CODE | |
| LOW | sdks/python/gen_protos.py | 242 | CODE | |
| LOW | sdks/python/setup.py | 281 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 316 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 710 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 879 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 1329 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 1450 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 335 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 471 | CODE | |
| LOW | sdks/python/apache_beam/metrics/monitoring_infos.py | 517 | CODE | |
| LOW | sdks/python/apache_beam/metrics/cells.py | 740 | CODE | |
| LOW | sdks/python/apache_beam/metrics/cells.py | 766 | CODE | |
| LOW | …thon/apache_beam/options/pipeline_options_validator.py | 393 | CODE | |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 257 | CODE | |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 422 | CODE | |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 481 | CODE | |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 944 | CODE | |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 1249 | CODE | |
| LOW | …ks/python/apache_beam/options/pipeline_options_test.py | 775 | CODE | |
| LOW | sdks/python/apache_beam/coders/coders_test_common.py | 267 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 404 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 486 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 587 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 1302 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 1959 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 2005 | CODE | |
| LOW | sdks/python/apache_beam/coders/row_coder.py | 144 | CODE | |
| LOW | sdks/python/apache_beam/coders/typecoders.py | 174 | CODE | |
| LOW | sdks/python/apache_beam/coders/standard_coders_test.py | 77 | CODE | |
| LOW | sdks/python/apache_beam/coders/standard_coders_test.py | 85 | CODE | |
| LOW | sdks/python/apache_beam/coders/standard_coders_test.py | 189 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 521 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 223 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 302 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 397 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 424 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/transforms.py | 147 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/transforms.py | 356 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/transforms.py | 436 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/transforms.py | 175 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/convert.py | 106 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/convert.py | 167 | CODE | |
| 469 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/enforcement/iam.py | 24 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 85 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 86 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 87 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 88 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 89 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 91 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 92 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 93 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 94 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 95 | CODE | |
| LOW | sdks/python/apache_beam/__init__.py | 100 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 106 | CODE | |
| LOW | sdks/python/apache_beam/pipeline.py | 109 | CODE | |
| LOW | sdks/python/apache_beam/pvalue.py | 50 | CODE | |
| LOW | sdks/python/apache_beam/pvalue.py | 51 | CODE | |
| LOW | sdks/python/apache_beam/pvalue.py | 53 | CODE | |
| LOW | sdks/python/apache_beam/pvalue.py | 54 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 38 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 39 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 40 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 41 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 42 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 43 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 52 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 54 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 59 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 60 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 61 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 62 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 63 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 64 | CODE | |
| LOW | sdks/python/apache_beam/metrics/execution.py | 65 | CODE | |
| LOW | sdks/python/apache_beam/metrics/__init__.py | 17 | CODE | |
| LOW | sdks/python/apache_beam/metrics/__init__.py | 18 | CODE | |
| LOW | sdks/python/apache_beam/metrics/metric.py | 40 | CODE | |
| LOW | sdks/python/apache_beam/metrics/metric.py | 51 | CODE | |
| LOW | sdks/python/apache_beam/metrics/metric.py | 52 | CODE | |
| LOW | sdks/python/apache_beam/metrics/metric.py | 53 | CODE | |
| LOW | sdks/python/apache_beam/metrics/metric.py | 54 | CODE | |
| LOW | …ks/python/apache_beam/options/pipeline_options_test.py | 50 | CODE | |
| LOW | …python/apache_beam/options/pipeline_options_context.py | 36 | CODE | |
| LOW | sdks/python/apache_beam/coders/fast_coders_test.py | 25 | CODE | |
| LOW | sdks/python/apache_beam/coders/fast_coders_test.py | 37 | CODE | |
| LOW | sdks/python/apache_beam/coders/slow_coders_test.py | 25 | CODE | |
| LOW | sdks/python/apache_beam/coders/slow_coders_test.py | 36 | CODE | |
| LOW | sdks/python/apache_beam/coders/slow_coders_test.py | 43 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 47 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 49 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 50 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 51 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 53 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 78 | CODE | |
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 1890 | CODE | |
| LOW | sdks/python/apache_beam/coders/__init__.py | 17 | CODE | |
| LOW | sdks/python/apache_beam/coders/__init__.py | 18 | CODE | |
| LOW | sdks/python/apache_beam/coders/__init__.py | 19 | CODE | |
| LOW | sdks/python/apache_beam/coders/coders.py | 48 | CODE | |
| LOW | sdks/python/apache_beam/coders/coders.py | 67 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 54 | CODE | |
| 362 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | sdks/python/apache_beam/coders/coders.py | 209 | # =========================================================================== | COMMENT |
| MEDIUM | sdks/python/apache_beam/coders/coders.py | 212 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/io/unbounded_source_test.py | 278 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/io/unbounded_source_test.py | 280 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/io/unbounded_source_test.py | 835 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/io/unbounded_source_test.py | 838 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 142 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 144 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 273 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 276 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 1001 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/unbounded_source.py | 1003 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 299 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | sdks/python/apache_beam/io/gcp/bigquery.py | 590 | # ----------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 387 | # ============================================================================= | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 389 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 680 | # ============================================================================= | COMMENT |
| MEDIUM⚡ | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 682 | # ============================================================================= | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 1053 | # ============================================================================= | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 1055 | # ============================================================================= | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 1118 | # ============================================================================= | COMMENT |
| MEDIUM | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 1120 | # ============================================================================= | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 772 | # ------------------------------------------------- | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 808 | # ------------------------------------ | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 814 | # ----------------------------------- | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 924 | # ------------------------------- | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 1239 | # ------------------------------------ | COMMENT |
| MEDIUM | …python/apache_beam/internal/cloudpickle/cloudpickle.py | 1322 | # --------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 76 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 78 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 222 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 224 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 235 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 314 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 316 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 154 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 156 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 283 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 285 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 406 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 408 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 467 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 469 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 614 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …he_beam/testing/benchmarks/sort_and_batch_benchmark.py | 616 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …apache_beam/ml/inference/agent_development_kit_test.py | 67 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | …apache_beam/ml/inference/agent_development_kit_test.py | 70 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …pache_beam/yaml/extended_tests/databases/bigquery.yaml | 88 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM | examples/terraform/envoy-ratelimiter/variables.tf | 19 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | examples/terraform/envoy-ratelimiter/variables.tf | 21 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | examples/terraform/envoy-ratelimiter/variables.tf | 43 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | examples/terraform/envoy-ratelimiter/variables.tf | 45 | # ------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 21 | # ------------------------------------------------------- | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 40 | # ------------------------------------------------------- | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 57 | # ------------------------------------------------------- | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 83 | # ------------------------------------------------------- | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 111 | # ------------------------------------------------------- | COMMENT |
| MEDIUM | dev-support/docker/beam_env_checks.sh | 117 | # ------------------------------------------------------- | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | sdks/go/test/run_validatesrunner_tests.sh | 53 | # a staged SDK harness container. Note for Dataflow: Using this flag | COMMENT |
| MEDIUM | sdks/go/examples/large_wordcount/large_wordcount.go | 310 | // A more robust implementation would write to the pipeline's temporary folder instead, | COMMENT |
| MEDIUM | sdks/go/examples/large_wordcount/large_wordcount.go | 368 | // A more robust implementation would move from the pipeline's temporary folder to | COMMENT |
| MEDIUM | sdks/go/pkg/beam/io/natsio/write.go | 56 | // ProducerMessage to utilize JetStream's support for deduplication of messages. | COMMENT |
| MEDIUM | …g/beam/runners/prism/internal/engine/elementmanager.go | 199 | // Essentially, it needs to track the current watermarks for each PCollection | COMMENT |
| LOW | sdks/python/apache_beam/metrics/monitoring_infos.py | 471 | # If it is not a user counter, just use the first part of the URN, i.e. 'beam' | COMMENT |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 4236 | # By default do_apply will just call pandas apply() | COMMENT |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 4872 | # Boolean indexer, just pass it in as-is | COMMENT |
| LOW | sdks/python/apache_beam/io/filebasedsource_test.py | 657 | # Should simply return stop_offset - start_offset | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 846 | # Temp dataset was provided by the user so we can just return. | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1067 | # Temp dataset was provided by the user so we can just return. | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1288 | # server-side liquid sharding. A split will simply return the current source | COMMENT |
| MEDIUM | …che_beam/io/gcp/healthcare/dicomio_integration_test.py | 156 | # Both refine and comprehensive search will be tested. | COMMENT |
| MEDIUM | …python/apache_beam/io/external/xlang_mqttio_it_test.py | 218 | # never terminates on its own. Amend the harness-provided pipeline options | COMMENT |
| MEDIUM | …python/apache_beam/io/external/xlang_mqttio_it_test.py | 226 | # passed to the constructor; the remaining harness-provided options are | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/internal/cloudpickle_pickler.py | 112 | # Unwrap typing.TypeAliasType to its underlying value for robust pickling. | COMMENT |
| MEDIUM | …n/apache_beam/testing/analyzers/perf_analysis_utils.py | 315 | # MAD (Median Absolute Deviation) is a robust measure of variability. | STRING |
| MEDIUM | …n/apache_beam/testing/analyzers/perf_analysis_utils.py | 325 | # significant, making the detection more robust to noise and outliers. | STRING |
| LOW | sdks/python/apache_beam/transforms/window.py | 190 | # By default, just return the input timestamp. | COMMENT |
| MEDIUM | sdks/python/apache_beam/transforms/combiners.py | 344 | # Essentially, given s map bundles, we are trading about O(sn) compares in | COMMENT |
| LOW | sdks/python/apache_beam/transforms/core.py | 4220 | # No field data - just use default Union. | COMMENT |
| LOW | sdks/python/apache_beam/transforms/stats_test.py | 512 | # sum (297.5). If we just use key=sum, tie-breaking is sensitive to bundle merging | COMMENT |
| LOW | sdks/python/apache_beam/transforms/external.py | 1196 | # For anything other than 'JavaJarExpansionService' we just use the | COMMENT |
| LOW | sdks/python/apache_beam/transforms/trigger.py | 1237 | # Here we also just pass through all the values exactly once. | COMMENT |
| MEDIUM | sdks/python/apache_beam/ml/anomaly/transforms.py | 594 | # Add a temporary unique key per data point to facilitate grouping the | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/ml/transforms/tft_test.py | 438 | # Front-padded to facilitate lexicographic sorting. | COMMENT |
| MEDIUM⚡ | sdks/python/apache_beam/ml/transforms/tft_test.py | 448 | dtype=np.int64) # Front-padded to facilitate lexicographic | CODE |
| MEDIUM | sdks/python/apache_beam/ml/transforms/tft_test.py | 410 | i, # Front-padded to facilitate lexicographic sorting. | CODE |
| MEDIUM | sdks/python/apache_beam/ml/inference/base_test.py | 1233 | # applying GroupByKey to utilize windowing according to | COMMENT |
| MEDIUM | sdks/python/apache_beam/ml/inference/base_test.py | 1516 | # applying GroupByKey to utilize windowing according to | COMMENT |
| LOW | sdks/python/apache_beam/examples/snippets/snippets.py | 1372 | # simply use beam.combiners.Count.PerElement here. | COMMENT |
| LOW | …xamples/snippets/transforms/elementwise/map_context.py | 51 | # Here we just create a (shared) random value, but in practice one | COMMENT |
| MEDIUM | sdks/python/apache_beam/portability/python_urns.py | 60 | # Instantiate SDK harness via a command line provided in the payload. | COMMENT |
| MEDIUM | sdks/python/apache_beam/portability/python_urns.py | 62 | # starts up the SDK harness directly, rather than the bootstrapping | COMMENT |
| LOW | sdks/python/apache_beam/yaml/yaml_ml.py | 637 | # If we can't get a schema, just return the result. | COMMENT |
| LOW | sdks/python/apache_beam/runners/common.py | 860 | # or if the process accesses the window parameter. We can just call it once | COMMENT |
| MEDIUM | …python/apache_beam/runners/dataflow/dataflow_runner.py | 546 | # comprehensive. | COMMENT |
| MEDIUM | …hon/apache_beam/runners/dataflow/internal/apiclient.py | 288 | # Don't pass impersonate_service_account through to the harness. | COMMENT |
| MEDIUM | …hon/apache_beam/runners/dataflow/internal/apiclient.py | 854 | # Stage other resources for the SDK harness | COMMENT |
| MEDIUM | …/python/apache_beam/runners/dataflow/internal/names.py | 36 | # requires changes to SDK harness container or SDK harness launcher. | COMMENT |
| LOW | sdks/python/apache_beam/runners/dask/dask_runner.py | 145 | # not actually need to use the results here, so we just pass. to gather, | COMMENT |
| LOW | …apache_beam/runners/interactive/pipeline_instrument.py | 603 | # To put the cached value into the correct window, simply return a | COMMENT |
| MEDIUM | …ks/python/apache_beam/runners/interactive/sql/utils.py | 222 | """Displays actionable widgets to utilize the options, run pipelines and | STRING |
| LOW | …pache_beam/runners/portability/abstract_job_service.py | 107 | # For now, just use the preparation id as the job id. | COMMENT |
| MEDIUM | …pache_beam/runners/portability/portable_runner_test.py | 56 | # Controls job service interaction, not sdk harness interaction. | COMMENT |
| MEDIUM | …n/apache_beam/runners/portability/prism_runner_test.py | 548 | # Verify the fix: StopWorker successfully tells the thread harness to shut down, | COMMENT |
| MEDIUM | …s/python/apache_beam/runners/portability/job_server.py | 126 | # isEnabledFor check, allowing the filter to dynamically elevate log | COMMENT |
| MEDIUM | …/python/apache_beam/runners/worker/bundle_processor.py | 1166 | # Out of caution, terminate the SDK harness process. | COMMENT |
| MEDIUM | …/python/apache_beam/runners/worker/bundle_processor.py | 1666 | # The Dataflow runner harness strips the base64 encoding. | COMMENT |
| MEDIUM | …s/python/apache_beam/runners/worker/opcounters_test.py | 206 | # The seed is arbitrary and exists just to ensure this test is robust. | COMMENT |
| LOW | sdks/python/apache_beam/runners/worker/sideinputs.py | 114 | # If any reader has errored, just return. | COMMENT |
| LOW | sdks/python/apache_beam/runners/worker/sideinputs.py | 130 | # If any reader has errored, just return. | COMMENT |
| MEDIUM | sdks/python/apache_beam/runners/worker/worker_status.py | 45 | # This SDK harness will (by default), log a "lull" in processing if it sees no | COMMENT |
| MEDIUM | …/python/apache_beam/runners/worker/worker_pool_main.py | 195 | # unblocking the harness request stream. | COMMENT |
| MEDIUM | sdks/python/apache_beam/runners/worker/operations.py | 444 | # These are overwritten in the legacy harness. | COMMENT |
| MEDIUM | sdks/python/apache_beam/runners/worker/sdk_worker.py | 169 | # Unrecoverable SDK harness initialization error (if any) | COMMENT |
| LOW | sdks/python/apache_beam/typehints/schemas.py | 686 | # if the named tuple's schema is in registry, we just use it instead of | COMMENT |
| MEDIUM | sdks/python/apache_beam/typehints/row_type.py | 157 | # to be used in conjunction with native typehints, like Optional. | COMMENT |
| MEDIUM | …rChangeStreamOrderedByTimestampAndTransactionIdIT.java | 252 | // We utilize a looping timer to determine when to flush the buffer: | COMMENT |
| MEDIUM | …/it/SpannerChangeStreamOrderedWithinKeyGloballyIT.java | 270 | // We utilize a looping timer to determine when to flush the buffer: | COMMENT |
| 11 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 112 | // Step 1: Initialise Beam | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 128 | // Step 3: Read input text file | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 133 | // Step 4: split lens into words | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 141 | // Step 5: Count words occurences | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 148 | // Step 6: Format results | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 154 | // Step 7: Write output to file | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 160 | // Step 8: Execute pipeline | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 522 | # Step 1: Insert initial data that doesn't exist. | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 571 | # Step 2: Update existing data (same IDs, different content). | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 613 | # Step 3: Repeat the same update operation 3 more times (idempotence test). | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 21 | # Step 1: Creating rows to be written to Spanner | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 34 | # Step 2: Writing the created rows to a Spanner database | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 49 | # Step 3: Writing the failed records to a JSON file | COMMENT |
| LOW⚡ | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 23 | # Step 1: Creating a collection of elements that needs | COMMENT |
| LOW⚡ | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 33 | # Step 2: Enriching the data with Bigtable | COMMENT |
| LOW | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 46 | # Step 3: Logging for testing | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 21 | # Step 1: Read orders details from Spanner | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 30 | # Step 2: Enrich order details with customers details from BigQuery | COMMENT |
| LOW | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 42 | # Step 3: Map enriched values to Beam schema | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 69 | # Step 4: Filter orders with amount greater than 110 | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 78 | # Step 6: Write processed order to another spanner table | COMMENT |
| LOW | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 91 | # Step 7: Handle write errors by writing to JSON | COMMENT |
| LOW | …/examples/transforms/blueprint/iceberg_to_alloydb.yaml | 23 | # Step 1: Reading data from Iceberg | COMMENT |
| LOW | …/examples/transforms/blueprint/iceberg_to_alloydb.yaml | 38 | # Step 2: Write records out to AlloyDB | COMMENT |
| LOW⚡ | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 25 | # Step 1: Reading data from Oracle | COMMENT |
| LOW⚡ | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/gcs_text_to_bigquery.yaml | 25 | # Step 1: Reading data from GCS | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/gcs_text_to_bigquery.yaml | 30 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 24 | # Step 1: Reading data from Kafka | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 38 | # Step 2: Convert Kafka records | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 50 | # Step 3: Write records out to Iceberg | COMMENT |
| LOW | …l/examples/transforms/blueprint/pubsub_to_iceberg.yaml | 24 | # Step 1: Reading messages from Pub/Sub topic | COMMENT |
| LOW | …l/examples/transforms/blueprint/pubsub_to_iceberg.yaml | 35 | # Step 2: Write records out to Iceberg | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 25 | # Step 1: Reading messages from Pub/Sub subscription | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 36 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 47 | # Step 3: Write the failed messages to BQ to a JSON file | COMMENT |
| LOW⚡ | …aml/examples/transforms/blueprint/spanner_to_avro.yaml | 25 | # Step 1: Reading shipment data from Spanner DB | COMMENT |
| LOW⚡ | …aml/examples/transforms/blueprint/spanner_to_avro.yaml | 33 | # Step 2: Write successful records out to GCS avro files | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 25 | # Step 1: Reading data from Postgres | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 25 | # Step 1: Reading data from SqlServer | COMMENT |
| LOW⚡ | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …examples/transforms/blueprint/spanner_to_bigquery.yaml | 25 | # Step 1: Reading data from Spanner | COMMENT |
| LOW⚡ | …examples/transforms/blueprint/spanner_to_bigquery.yaml | 33 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW⚡ | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 25 | # Step 1: Reading data from MySql | COMMENT |
| LOW⚡ | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 25 | # Step 1: Reading shipment data from jdbc DB | COMMENT |
| LOW⚡ | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 32 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 25 | # Step 1: Reading messages from Pub/Sub topic | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 36 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 47 | # Step 3: Write the failed messages to BQ to a JSON file | COMMENT |
| LOW | …ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java | 98 | // Step 1: Find the effective location of the query. | COMMENT |
| LOW | …ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java | 122 | // Step 2: Create a temporary dataset in the query location only if the user has not specified | COMMENT |
| LOW | …ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java | 164 | // Step 3: Execute the query. Generate a transient (random) query job ID, because this code | COMMENT |
| LOW⚡ | examples/terraform/envoy-ratelimiter/README.md | 124 | # Step 1: Initialize Terraform | COMMENT |
| 20 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 112 | // Step 1: Initialise Beam | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 116 | // Step 2: | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 128 | // Step 3: Read input text file | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 133 | // Step 4: split lens into words | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 141 | // Step 5: Count words occurences | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 148 | // Step 6: Format results | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 154 | // Step 7: Write output to file | COMMENT |
| LOW⚡ | sdks/go/examples/minimal_wordcount/minimal_wordcount.go | 160 | // Step 8: Execute pipeline | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 522 | # Step 1: Insert initial data that doesn't exist. | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 571 | # Step 2: Update existing data (same IDs, different content). | COMMENT |
| LOW | …/apache_beam/ml/rag/ingestion/milvus_search_it_test.py | 613 | # Step 3: Repeat the same update operation 3 more times (idempotence test). | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 21 | # Step 1: Creating rows to be written to Spanner | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 34 | # Step 2: Writing the created rows to a Spanner database | COMMENT |
| LOW | …he_beam/yaml/examples/transforms/io/spanner_write.yaml | 49 | # Step 3: Writing the failed records to a JSON file | COMMENT |
| LOW⚡ | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 23 | # Step 1: Creating a collection of elements that needs | COMMENT |
| LOW⚡ | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 33 | # Step 2: Enriching the data with Bigtable | COMMENT |
| LOW | …m/yaml/examples/transforms/ml/bigtable_enrichment.yaml | 46 | # Step 3: Logging for testing | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 21 | # Step 1: Read orders details from Spanner | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 30 | # Step 2: Enrich order details with customers details from BigQuery | COMMENT |
| LOW | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 42 | # Step 3: Map enriched values to Beam schema | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 69 | # Step 4: Filter orders with amount greater than 110 | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 78 | # Step 6: Write processed order to another spanner table | COMMENT |
| LOW | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 91 | # Step 7: Handle write errors by writing to JSON | COMMENT |
| LOW | …/examples/transforms/blueprint/iceberg_to_alloydb.yaml | 23 | # Step 1: Reading data from Iceberg | COMMENT |
| LOW | …/examples/transforms/blueprint/iceberg_to_alloydb.yaml | 38 | # Step 2: Write records out to AlloyDB | COMMENT |
| LOW⚡ | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 25 | # Step 1: Reading data from Oracle | COMMENT |
| LOW⚡ | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …/examples/transforms/blueprint/oracle_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/gcs_text_to_bigquery.yaml | 25 | # Step 1: Reading data from GCS | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/gcs_text_to_bigquery.yaml | 30 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 24 | # Step 1: Reading data from Kafka | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 38 | # Step 2: Convert Kafka records | COMMENT |
| LOW | …ml/examples/transforms/blueprint/kafka_to_iceberg.yaml | 50 | # Step 3: Write records out to Iceberg | COMMENT |
| LOW | …l/examples/transforms/blueprint/pubsub_to_iceberg.yaml | 24 | # Step 1: Reading messages from Pub/Sub topic | COMMENT |
| LOW | …l/examples/transforms/blueprint/pubsub_to_iceberg.yaml | 35 | # Step 2: Write records out to Iceberg | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 25 | # Step 1: Reading messages from Pub/Sub subscription | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 36 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …nsforms/blueprint/pubsub_subscription_to_bigquery.yaml | 47 | # Step 3: Write the failed messages to BQ to a JSON file | COMMENT |
| LOW⚡ | …aml/examples/transforms/blueprint/spanner_to_avro.yaml | 25 | # Step 1: Reading shipment data from Spanner DB | COMMENT |
| LOW⚡ | …aml/examples/transforms/blueprint/spanner_to_avro.yaml | 33 | # Step 2: Write successful records out to GCS avro files | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 25 | # Step 1: Reading data from Postgres | COMMENT |
| LOW⚡ | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …xamples/transforms/blueprint/postgres_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 25 | # Step 1: Reading data from SqlServer | COMMENT |
| LOW⚡ | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …amples/transforms/blueprint/sqlserver_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …examples/transforms/blueprint/spanner_to_bigquery.yaml | 25 | # Step 1: Reading data from Spanner | COMMENT |
| LOW⚡ | …examples/transforms/blueprint/spanner_to_bigquery.yaml | 33 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW⚡ | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 25 | # Step 1: Reading data from MySql | COMMENT |
| LOW⚡ | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 32 | # Step 2: Write records out to BigQuery | COMMENT |
| LOW | …l/examples/transforms/blueprint/mysql_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW⚡ | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 25 | # Step 1: Reading shipment data from jdbc DB | COMMENT |
| LOW⚡ | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 32 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml | 43 | # Step 3: Write the failed messages to BQ to a dead letter queue JSON file | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 25 | # Step 1: Reading messages from Pub/Sub topic | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 36 | # Step 2: Write successful records out to BigQuery | COMMENT |
| LOW | …les/transforms/blueprint/pubsub_topic_to_bigquery.yaml | 47 | # Step 3: Write the failed messages to BQ to a JSON file | COMMENT |
| LOW | …o/gcp/bigtable/changestreams/dao/MetadataTableDao.java | 718 | // If the lock is already held we need to check if it was acquired by a duplicate | COMMENT |
| LOW | …ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java | 98 | // Step 1: Find the effective location of the query. | COMMENT |
| LOW | …ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java | 122 | // Step 2: Create a temporary dataset in the query location only if the user has not specified | COMMENT |
| 19 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/security/log_analyzer.py | 140 | # Check if the policy is already configured | STRING |
| LOW | infra/keys/service_account.py | 298 | # Check if service account exists and get its state | COMMENT |
| LOW | sdks/go/run_with_go_version.sh | 74 | # Check if we've already prepared the Go command. If so, then we don't need to | COMMENT |
| LOW | sdks/go/test/run_validatesrunner_tests.sh | 353 | # Check if Docker daemon is running | COMMENT |
| LOW⚡ | sdks/python/apache_beam/pipeline_test.py | 658 | # Check if inp type hint is Any that we can still infer | COMMENT |
| LOW | sdks/python/apache_beam/pvalue.py | 296 | # Check if we accessed this tag before. | COMMENT |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 1026 | # Set dtype to object if more than one value | COMMENT |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 3857 | # Set dtype to object if more than one value | COMMENT |
| LOW | sdks/python/apache_beam/io/tfrecordio_test.py | 499 | # Read the file back and compare. | COMMENT |
| LOW | sdks/python/apache_beam/io/tfrecordio_test.py | 514 | # Read the file back and compare. | COMMENT |
| LOW | sdks/python/apache_beam/io/tfrecordio_test.py | 529 | # Read the file back and compare. | COMMENT |
| LOW | sdks/python/apache_beam/io/tfrecordio_test.py | 548 | # Read the file back and compare. | COMMENT |
| LOW | sdks/python/apache_beam/io/tfrecordio_test.py | 567 | # Read the file back and compare. | COMMENT |
| LOW | sdks/python/apache_beam/io/filesystem_test.py | 230 | # Check if limits are followed correctly | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 851 | # Check if dataset already exists otherwise create it | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/gcsio_test.py | 96 | # Assign responses to the mock instance itself | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1611 | # Check if individual row exceeds size limit | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1680 | # Check if individual row exceeds size limit | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1693 | # Check if adding this row would exceed batch size limit | COMMENT |
| LOW⚡ | sdks/python/apache_beam/io/gcp/pubsub.py | 595 | # Check if using DirectRunner | COMMENT |
| LOW⚡ | sdks/python/apache_beam/io/gcp/pubsub.py | 601 | # Check if it's a DirectRunner variant | COMMENT |
| LOW⚡ | sdks/python/apache_beam/io/gcp/pubsub.py | 610 | # Check if in batch mode (not streaming) | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_file_loads.py | 405 | # Check if destination table exists | COMMENT |
| LOW | …s/python/apache_beam/io/gcp/pubsub_integration_test.py | 176 | # Set on_success_matcher to verify pipeline state and pubsub output. These | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/healthcare/dicomio.py | 218 | # Check if all required keys present. | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/healthcare/dicomio.py | 228 | # Check if return type is correct. | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/healthcare/dicomio.py | 242 | # Check if the element is valid | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/healthcare/dicomio.py | 370 | # Check if the required keys present and | COMMENT |
| LOW | sdks/python/apache_beam/io/gcp/healthcare/dicomio.py | 540 | # Read the file based on different input. If the read fails ,return | COMMENT |
| LOW | sdks/python/apache_beam/internal/code_object_pickler.py | 293 | # Check if there are any lambdas with the same signature. | COMMENT |
| LOW | …/python/apache_beam/testing/analyzers/perf_analysis.py | 291 | # Set this to true while running in production. | COMMENT |
| LOW | …ache_beam/testing/analyzers/load_test_perf_analysis.py | 97 | # Set this to true while running in production. | STRING |
| LOW | sdks/python/apache_beam/transforms/util.py | 977 | # Check if we should replay a previous batch size due to it not being | COMMENT |
| LOW | sdks/python/apache_beam/transforms/util.py | 1441 | # Check if adding this element would exceed limits | COMMENT |
| LOW | sdks/python/apache_beam/transforms/core.py | 842 | # Check if this DoFn's process method has been overridden | COMMENT |
| LOW | sdks/python/apache_beam/transforms/core.py | 851 | # Check if this DoFn's process_batch method has been overridden | COMMENT |
| LOW | sdks/python/apache_beam/transforms/util_test.py | 269 | # Check if we're looking at the actual elements being encoded/decoded | COMMENT |
| LOW⚡ | sdks/python/apache_beam/transforms/external.py | 543 | # Set it to an empty placeholder type. | COMMENT |
| LOW | …thon/apache_beam/ml/inference/huggingface_inference.py | 669 | # Check if the device is specified twice. If true then the device parameter | COMMENT |
| LOW | …les/snippets/transforms/elementwise/enrichment_test.py | 359 | # Check if the test used a container-based external SQL database. | COMMENT |
| LOW⚡ | sdks/python/apache_beam/yaml/yaml_transform.py | 800 | # Check if any transform has a NON-EMPTY explicit input or output. | COMMENT |
| LOW | sdks/python/apache_beam/yaml/yaml_transform.py | 834 | # Check if output is empty, not just present (normalization sets it to {}) | COMMENT |
| LOW | …s/python/apache_beam/yaml/yaml_transform_scope_test.py | 108 | # Check if target_annotations is a subset of result_annotations | STRING |
| LOW | sdks/python/apache_beam/yaml/yaml_provider.py | 920 | # Check if elements have different keys | COMMENT |
| LOW | …s/python/apache_beam/yaml/tests/assign_timestamps.yaml | 19 | # Assign timestamp to beam row element | COMMENT |
| LOW | …s/python/apache_beam/yaml/tests/assign_timestamps.yaml | 52 | # Assign timestamp to beam row element with error_handling | COMMENT |
| LOW | …s/python/apache_beam/yaml/tests/assign_timestamps.yaml | 86 | # Assign timestamp to beam row element with error handling and output schema | COMMENT |
| LOW | …s/python/apache_beam/yaml/tests/assign_timestamps.yaml | 129 | # Assign timestamp to beam row element with error handling and output schema | COMMENT |
| LOW | …l/sentiment_analysis/streaming_sentiment_analysis.yaml | 230 | # Assign windows to each element of the unbounded PCollection. | COMMENT |
| LOW | …sforms/ml/taxi_fare/streaming_taxifare_prediction.yaml | 68 | # Assign windows to each element of the unbounded PCollection. | COMMENT |
| LOW | …n/apache_beam/runners/dataflow/ptransform_overrides.py | 39 | # Check if this ParDo uses _PubSubWriteDoFn | COMMENT |
| LOW | …he_beam/runners/interactive/interactive_environment.py | 182 | # Check if [interactive] dependencies are installed. | COMMENT |
| LOW | …he_beam/runners/interactive/interactive_environment.py | 368 | # Check if the pipeline is already tracked as a user pipeline before cleanup. | COMMENT |
| LOW | …apache_beam/runners/interactive/pipeline_instrument.py | 63 | # Check if the user defined pipeline contains any source to cache. | COMMENT |
| LOW | …he_beam/runners/interactive/caching/read_cache_test.py | 80 | # Check if the actual_pipeline uses cache as input of the | COMMENT |
| LOW | …he_beam/runners/interactive/caching/streaming_cache.py | 110 | # Open the file for 'append-mode' and writing 'bytes'. | COMMENT |
| LOW | …he_beam/runners/interactive/caching/streaming_cache.py | 186 | # Check if we are at EOF or if we have an incomplete line. | COMMENT |
| LOW | …he_beam/runners/interactive/caching/streaming_cache.py | 514 | # Loop through the elements with the correct timestamp. | COMMENT |
| LOW | …e_beam/runners/interactive/caching/write_cache_test.py | 66 | # Check if the actual_pipeline uses pcoll as an input of a write transform. | COMMENT |
| LOW | …python/apache_beam/runners/portability/prism_runner.py | 362 | # Check if the path is a URL. | COMMENT |
| 26 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/keys/secret_manager.py | 269 | def update_secret_access(self, secret_id: str, allowed_users: List[str]) -> None: | CODE |
| LOW | infra/enforcement/sending.py | 144 | def update_issue_body(self, issue_number: int, new_body: str) -> None: | CODE |
| LOW | sdks/python/apache_beam/pipeline.py | 112 | __all__ = ['Pipeline', 'transform_annotations'] | CODE |
| LOW | sdks/python/apache_beam/pvalue.py | 56 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/metrics/metricbase.py | 39 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/metrics/metric.py | 56 | __all__ = ['Metrics', 'MetricsFilter', 'Lineage'] | CODE |
| LOW | sdks/python/apache_beam/metrics/cells.py | 49 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/options/pipeline_options.py | 41 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/options/value_provider.py | 31 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/coders/avro_record.py | 22 | __all__ = ['AvroRecord'] | CODE |
| LOW | sdks/python/apache_beam/coders/row_coder.py | 48 | __all__ = ["RowCoder"] | CODE |
| LOW | sdks/python/apache_beam/coders/coders.py | 85 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/coders/typecoders.py | 75 | __all__ = ['registry'] | CODE |
| LOW | sdks/python/apache_beam/dataframe/transforms.py | 35 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 58 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/hadoopfilesystem.py | 43 | __all__ = ['HadoopFileSystem'] | CODE |
| LOW | sdks/python/apache_beam/io/filesystems.py | 99 | __all__ = ['FileSystems'] | CODE |
| LOW | sdks/python/apache_beam/io/concat_source_test.py | 33 | __all__ = ['RangeSource'] | CODE |
| LOW | sdks/python/apache_beam/io/filesystemio.py | 26 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/filebasedsource.py | 54 | __all__ = ['FileBasedSource'] | CODE |
| LOW | sdks/python/apache_beam/io/textio.py | 45 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/filesystem.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | sdks/python/apache_beam/io/filesystem.py | 49 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/kinesis.py | 93 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/filebasedsink.py | 43 | __all__ = ['FileBasedSink'] | CODE |
| LOW | sdks/python/apache_beam/io/unbounded_source.py | 116 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/jdbc.py | 104 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/range_trackers.py | 30 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/mongodbio.py | 112 | __all__ = ["ReadFromMongoDB", "WriteToMongoDB"] | CODE |
| LOW | sdks/python/apache_beam/io/avroio.py | 67 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/source_test_utils.py | 57 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/requestresponse.py | 65 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/snowflake.py | 87 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/tfrecordio.py | 41 | __all__ = ['ReadFromTFRecord', 'ReadAllFromTFRecord', 'WriteToTFRecord'] | CODE |
| LOW | sdks/python/apache_beam/io/localfilesystem.py | 33 | __all__ = ['LocalFileSystem'] | CODE |
| LOW | sdks/python/apache_beam/io/debezium.py | 92 | __all__ = ['ReadFromDebezium', 'DriverClassName'] | CODE |
| LOW | sdks/python/apache_beam/io/iobase.py | 66 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/parquetio.py | 70 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/fileio.py | 120 | __all__ = [ | CODE |
| LOW | …s/python/apache_beam/io/azure/blobstoragefilesystem.py | 30 | __all__ = ['BlobStorageFileSystem'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/gcsio_retry.py | 39 | __all__ = ['DEFAULT_RETRY_WITH_THROTTLING_COUNTER'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/gcsfilesystem.py | 39 | __all__ = ['GCSFileSystem'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 442 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/gcp/bigtableio.py | 69 | __all__ = ['WriteToBigTable', 'ReadFromBigtable'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 93 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/io/gcp/pubsub.py | 59 | __all__ = [ | CODE |
| LOW | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 83 | __all__ = ['ReadBigQueryChangeHistory'] | CODE |
| LOW | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 262 | def set_watermark(self, timestamp: Timestamp) -> None: | CODE |
| LOW | sdks/python/apache_beam/io/gcp/gcsio.py | 54 | __all__ = ['GcsIO', 'create_storage_client'] | CODE |
| LOW | …ks/python/apache_beam/io/gcp/experimental/spannerio.py | 221 | __all__ = [ | CODE |
| LOW | …ks/python/apache_beam/io/gcp/tests/bigquery_matcher.py | 34 | __all__ = ['BigqueryMatcher', 'BigQueryTableMatcher'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py | 30 | __all__ = ['PubSubMessageMatcher'] | CODE |
| LOW | …n/apache_beam/io/gcp/datastore/v1new/query_splitter.py | 28 | __all__ = ['QuerySplitterError', 'SplitNotPossibleError', 'get_splits'] | CODE |
| LOW | sdks/python/apache_beam/io/gcp/datastore/v1new/types.py | 35 | __all__ = ['Query', 'Key', 'Entity'] | CODE |
| LOW | …thon/apache_beam/io/gcp/datastore/v1new/datastoreio.py | 61 | __all__ = ['ReadFromDatastore', 'WriteToDatastore', 'DeleteFromDatastore'] | CODE |
| LOW | sdks/python/apache_beam/io/aws/s3filesystem.py | 30 | __all__ = ['S3FileSystem'] | CODE |
| LOW | sdks/python/apache_beam/internal/metrics/metric.py | 51 | __all__ = ['Metrics'] | CODE |
| LOW | …ks/python/apache_beam/internal/cloudpickle/__init__.py | 8 | __all__ = [ # noqa | CODE |
| LOW | sdks/python/apache_beam/testing/pipeline_verifiers.py | 37 | __all__ = [ | CODE |
| LOW | sdks/python/apache_beam/testing/util.py | 44 | __all__ = [ | CODE |
| 70 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sdks/python/apache_beam/coders/coder_impl.py | 2160 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/doctests.py | 631 | CODE | |
| LOW | sdks/python/apache_beam/dataframe/frames.py | 3878 | CODE | |
| LOW | sdks/python/apache_beam/io/textio.py | 559 | CODE | |
| LOW | sdks/python/apache_beam/io/textio.py | 439 | CODE | |
| LOW | sdks/python/apache_beam/io/textio.py | 606 | CODE | |
| LOW | sdks/python/apache_beam/io/textio.py | 758 | CODE | |
| LOW | sdks/python/apache_beam/io/textio.py | 837 | CODE | |
| LOW | sdks/python/apache_beam/io/kinesis.py | 132 | CODE | |
| LOW | sdks/python/apache_beam/io/kinesis.py | 227 | CODE | |
| LOW | sdks/python/apache_beam/io/filebasedsink.py | 65 | CODE | |
| LOW | sdks/python/apache_beam/io/jdbc.py | 178 | CODE | |
| LOW | sdks/python/apache_beam/io/jdbc.py | 304 | CODE | |
| LOW | sdks/python/apache_beam/io/avroio.py | 366 | CODE | |
| LOW | sdks/python/apache_beam/io/source_test_utils.py | 404 | CODE | |
| LOW | sdks/python/apache_beam/io/snowflake.py | 128 | CODE | |
| LOW | sdks/python/apache_beam/io/snowflake.py | 268 | CODE | |
| LOW | sdks/python/apache_beam/io/kafka.py | 158 | CODE | |
| LOW | sdks/python/apache_beam/io/parquetio.py | 488 | CODE | |
| LOW | sdks/python/apache_beam/io/parquetio.py | 651 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_json_it_test.py | 479 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 529 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 719 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 810 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_tools.py | 1054 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/gcsio_test.py | 196 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 595 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 642 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 967 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1414 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 1972 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery.py | 2636 | CODE | |
| LOW | …ks/python/apache_beam/io/gcp/bigquery_read_internal.py | 192 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 198 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 408 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 464 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 520 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 576 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/spanner.py | 632 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_file_loads.py | 643 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_file_loads.py | 683 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/bigquery_file_loads.py | 901 | CODE | |
| LOW | …s/python/apache_beam/io/gcp/bigquery_change_history.py | 1181 | CODE | |
| LOW | …ks/python/apache_beam/io/gcp/experimental/spannerio.py | 679 | CODE | |
| LOW | …ks/python/apache_beam/io/gcp/experimental/spannerio.py | 886 | CODE | |
| LOW | …ks/python/apache_beam/io/gcp/experimental/spannerio.py | 941 | CODE | |
| LOW | …che_beam/io/gcp/healthcare/dicomio_integration_test.py | 85 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/tests/utils_test.py | 233 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py | 52 | CODE | |
| LOW | …io/gcp/internal/clients/bigquery/bigquery_v2_client.py | 44 | CODE | |
| LOW | sdks/python/apache_beam/io/gcp/datastore/v1new/types.py | 39 | CODE | |
| LOW | …s/python/apache_beam/io/aws/clients/s3/boto3_client.py | 201 | CODE | |
| LOW | sdks/python/apache_beam/utils/retry.py | 234 | CODE | |
| LOW | …s/python/apache_beam/testing/metric_result_matchers.py | 65 | CODE | |
| LOW | sdks/python/apache_beam/testing/synthetic_pipeline.py | 255 | CODE | |
| LOW | sdks/python/apache_beam/testing/test_pipeline.py | 67 | CODE | |
| LOW | …e_beam/testing/benchmarks/chicago_taxi/process_tfma.py | 33 | CODE | |
| LOW | sdks/python/apache_beam/transforms/ptransform.py | 1045 | CODE | |
| LOW | sdks/python/apache_beam/transforms/util.py | 746 | CODE | |
| LOW | sdks/python/apache_beam/transforms/util.py | 1308 | CODE | |
| 80 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …apache_beam/examples/cookbook/multiple_output_pardo.py | 57 | # of the basic wordcount example. In this example words | COMMENT |
| HIGH | …rence/pytorch_image_classification_with_side_inputs.py | 176 | # In this example we pass keyed inputs to RunInference transform. | COMMENT |
| HIGH | …am/examples/inference/tensorflow_mnist_with_weights.py | 61 | # In this example we pass keyed inputs to RunInference transform. | COMMENT |
| HIGH | …/examples/inference/tensorflow_mnist_classification.py | 94 | # In this example we pass keyed inputs to RunInference transform. | COMMENT |
| HIGH | …eam/examples/inference/pytorch_image_classification.py | 135 | # In this example we pass keyed inputs to RunInference transform. | COMMENT |
| HIGH | …examples/inference/tensorflow_imagenet_segmentation.py | 101 | # In this example we will use the TensorflowHub model URL. | COMMENT |
| HIGH | …eam/examples/inference/sklearn_mnist_classification.py | 106 | # In this example we pass keyed inputs to RunInference transform. | COMMENT |
| HIGH | …ing-content/core-transforms/side-inputs/description.md | 117 | # of the actual elements of pcoll being passed into each process invocation. In this example, side inputs are | COMMENT |
| HIGH | …www/site/content/en/documentation/programming-guide.md | 2467 | # of the actual elements of pcoll being passed into each process invocation. In this example, side inputs are | COMMENT |
| HIGH | …ontent/en/documentation/ml/multi-language-inference.md | 64 | The preprocessed data is then used to make inference. This is done in the [`RunInference`](https://beam.apache.org/docum | CODE |
| HIGH | …e/www/site/content/en/blog/apache-hop-with-dataflow.md | 371 | Also, depending on your network configuration, you may want to check the box of "Use Public IPs?", or alternatively leav | CODE |
| HIGH | …e/www/site/content/en/get-started/wordcount-example.md | 525 | # In this example, the DoFns are defined as classes: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | infra/enforcement/iam.py | 364 | github_token = config["github_token"] or "dummy-token" | STRING |
| LOW⚡ | infra/enforcement/iam.py | 398 | recipient = config["recipient"] or "admin@example.com" | STRING |
| LOW⚡ | infra/enforcement/iam.py | 402 | recipient = config["recipient"] or "admin@example.com" | STRING |
| LOW⚡ | infra/enforcement/account_keys.py | 577 | recipient = config["recipient"] or "admin@example.com" | STRING |
| LOW⚡ | infra/enforcement/account_keys.py | 581 | recipient = config["recipient"] or "admin@example.com" | STRING |
| LOW | infra/enforcement/account_keys.py | 543 | github_token = config["github_token"] or "dummy-token" | STRING |
| LOW | …s/go/test/integration/io/bigqueryio/bigqueryio_test.go | 54 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " + | CODE |
| LOW | …s/go/test/integration/io/bigqueryio/bigqueryio_test.go | 54 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " + | CODE |
| LOW | …go/test/integration/io/xlang/bigquery/bigquery_test.go | 55 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " + | CODE |
| LOW | …go/test/integration/io/xlang/bigquery/bigquery_test.go | 55 | text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " + | CODE |
| LOW | sdks/python/apache_beam/dataframe/expressions.py | 265 | super().__init__('placeholder', proxy) | CODE |
| LOW | …/gcp/internal/clients/bigquery/bigquery_v2_messages.py | 702 | "userByEmail": "user@example.com", } ] } Please refer | CODE |
| LOW | …on/apache_beam/testing/analyzers/perf_analysis_test.py | 273 | os.environ['GITHUB_TOKEN'] = 'fake_token' | CODE |
| LOW | sdks/python/apache_beam/transforms/external_test.py | 508 | identifier='dummy_id', | STRING |
| LOW | sdks/python/apache_beam/transforms/external_test.py | 516 | self.assertEqual('dummy_id', payload_from_bytes.identifier) | STRING |
| LOW | …n/apache_beam/ml/inference/anthropic_inference_test.py | 315 | api_key='fake-key', | CODE |
| LOW | …n/apache_beam/ml/inference/anthropic_inference_test.py | 334 | api_key='fake-key', | CODE |
| LOW | …/python/apache_beam/examples/snippets/snippets_test.py | 647 | self._dummy_token = 'dummy_token' | CODE |
| LOW | …/src/test/resources/test_expansion_service_config.yaml | 24 | "dummy_id": | CODE |
| LOW | …rvice/ExpansionServiceSchemaTransformProviderTest.java | 135 | return "dummy_id"; | CODE |
| LOW | …rvice/ExpansionServiceSchemaTransformProviderTest.java | 385 | .setSpec(createSpec("dummy_id", configRow)) | CODE |
| LOW | …rvice/ExpansionServiceSchemaTransformProviderTest.java | 427 | .setSpec(createSpec("dummy_id", configRow)) | CODE |
| LOW | …rvice/ExpansionServiceSchemaTransformProviderTest.java | 518 | RunnerApi.FunctionSpec spec = createSpec("dummy_id", configRow); | CODE |
| LOW | …rvice/ExpansionServiceSchemaTransformProviderTest.java | 528 | RunnerApi.FunctionSpec equivalentSpec = createSpec("dummy_id", equivalentConfigRow); | CODE |
| LOW | …ions/euphoria/core/docs/DocumentationExamplesTest.java | 94 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ", | CODE |
| LOW | …ions/euphoria/core/docs/DocumentationExamplesTest.java | 94 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ", | CODE |
| LOW | …ions/sql/meta/provider/kafka/KafkaTableProviderIT.java | 278 | c.output(KV.of("fake_key", c.element())); | CODE |
| LOW | …tent/splittable-dofn/splittable/java-example/Task.java | 53 | PCollection<String> input = pipeline.apply(Create.of("Lorem Ipsum is simply dummy text of the printing and types | CODE |
| LOW⚡ | …tent/splittable-dofn/splittable/python-example/task.py | 65 | lines = (p | 'Create' >> beam.Create(["Lorem Ipsum is simply dummy text of the printing and typesetting industry. " | CODE |
| LOW⚡ | …tent/splittable-dofn/splittable/python-example/task.py | 66 | "Lorem Ipsum has been the industry's standard dummy text ever since the " | CODE |
| LOW⚡ | …tent/splittable-dofn/splittable/python-example/task.py | 71 | "sheets containing Lorem Ipsum passages, and more recently with desktop " | CODE |
| LOW⚡ | …tent/splittable-dofn/splittable/python-example/task.py | 72 | "publishing software like Aldus PageMaker including versions of Lorem Ipsum."]) | CODE |
| LOW | …a/org/apache/beam/it/neo4j/Neo4jResourceManagerIT.java | 45 | Neo4jResourceManager.builder("placeholder") | CODE |
| LOW | …/beam/it/gcp/datastore/DatastoreResourceManagerIT.java | 44 | Entity.newBuilder().set("name", "John Doe").build(), | CODE |
| LOW | …/beam/it/gcp/datastore/DatastoreResourceManagerIT.java | 63 | "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build())); | CODE |
| LOW | …/beam/it/gcp/datastore/DatastoreResourceManagerIT.java | 71 | assertThat(person.getString("name")).isEqualTo("John Doe"); | CODE |
| LOW | …/beam/it/gcp/datastore/DatastoreResourceManagerIT.java | 85 | "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build())); | CODE |
| LOW | website/CASE_STUDY_TEMPLATE.md | 34 | “Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's | CODE |
| LOW | website/CASE_STUDY_TEMPLATE.md | 59 | [Lorem Ipsum](https://www.lipsum.com/) is simply dummy text of the printing and typesetting industry. Lorem Ipsum has be | CODE |
| LOW | website/CASE_STUDY_TEMPLATE.md | 65 | Lorem Ipsum is simply dummy text of the printing and typesetting industry | CODE |
| LOW | website/CASE_STUDY_TEMPLATE.md | 84 | Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literature | CODE |
| LOW | website/CASE_STUDY_TEMPLATE.md | 92 | Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literature | CODE |
| LOW | website/ADD_CASE_STUDY.md | 71 | text: Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's s | CODE |
| LOW | website/www/site/layouts/partials/header.html | 241 | $('input:text').attr('placeholder',"What are you looking for?"); | CODE |
| LOW | …che/beam/runners/flink/EncodedValueComparatorTest.java | 57 | CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"), | CODE |
| LOW | …che/beam/runners/flink/EncodedValueComparatorTest.java | 56 | CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"), | CODE |
| LOW | …org/apache/beam/runners/spark/io/AvroPipelineTest.java | 63 | savedRecord.put("name", "John Doe"); | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …pache_beam/examples/ml_transform/ml_transform_basic.py | 160 | # To fetch the artifacts produced in MLTransform, you can use | COMMENT |
| LOW⚡ | …amples/transforms/ml/enrich_spanner_with_bigquery.yaml | 79 | # Note: Make sure to replace $VARS with your values. | COMMENT |
| MEDIUM | sdks/python/container/run_generate_requirements.sh | 46 | # Note that you can modify the behavior of the pip install command in this script by passing in your own $PIP_EXTRA_OPTI | COMMENT |
| LOW | …rc/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 520 | * KafkaIO#write()} and method withValueSerializer() make sure to erase the generic types by casting | COMMENT |
| MEDIUM | …ava/io/hadoop-format/src/test/resources/cassandra.yaml | 57 | # initial_token allows you to specify tokens manually. While you can use # it with | COMMENT |
| MEDIUM | …ava/io/hadoop-format/src/test/resources/cassandra.yaml | 592 | # you may want to adjust max_value_size_in_mb accordingly. | COMMENT |
| LOW | …ava/io/hadoop-format/src/test/resources/cassandra.yaml | 797 | # Warning: before enabling this property make sure to ntp is installed | COMMENT |
| MEDIUM | …main/java/org/apache/beam/sdk/jpmstests/WordCount.java | 107 | * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments to | COMMENT |
| LOW | …ain/java/org/apache/beam/it/common/TestProperties.java | 201 | * doing so. The method {@link #getCredentialsStream()} will make sure to search for the specific | COMMENT |
| MEDIUM | …/src/main/java/org/apache/beam/examples/WordCount.java | 171 | * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments to | COMMENT |
| MEDIUM | …/org/apache/beam/examples/cookbook/TriggerExample.java | 202 | // file. You may want to adjust the window duration otherwise. | COMMENT |
| MEDIUM | …main/java/org/apache/beam/examples/kotlin/WordCount.kt | 144 | * Concept #4: Defining your own configuration options. Here, you can add your own arguments to | COMMENT |
| MEDIUM | …apache/beam/examples/kotlin/cookbook/TriggerExample.kt | 213 | // file. You may want to adjust the window duration otherwise. | COMMENT |
| MEDIUM | .github/workflows/codeql.yml | 73 | # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize how | COMMENT |
| MEDIUM | …ners/spark/structuredstreaming/examples/WordCount.java | 99 | * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments to | COMMENT |
| MEDIUM | …/org/apache/beam/runners/spark/examples/WordCount.java | 99 | * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments to | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …m/internal/test_data/module_1_lambda_variable_added.py | 24 | def my_function(): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 25 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 32 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 39 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 46 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 53 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 60 | def my_method(self): | CODE |
| LOW⚡ | sdks/python/apache_beam/internal/test_data/module_2.py | 67 | def my_method(self): | CODE |
| LOW | sdks/python/apache_beam/internal/test_data/module_2.py | 79 | def my_method(self): | CODE |
| LOW | …am/internal/test_data/module_1_local_variable_added.py | 24 | def my_function(): | CODE |
| LOW | sdks/python/apache_beam/internal/test_data/module_3.py | 23 | def my_function(): | CODE |
| LOW | …che_beam/internal/test_data/module_1_function_added.py | 30 | def my_function(): | CODE |
| LOW | …on/apache_beam/internal/test_data/module_3_modified.py | 24 | def my_function(): | CODE |
| LOW | …internal/test_data/module_1_nested_function_2_added.py | 24 | def my_function(): | CODE |
| LOW | …m/internal/test_data/module_1_global_variable_added.py | 26 | def my_function(): | CODE |
| LOW | …m/internal/test_data/module_1_nested_function_added.py | 24 | def my_function(): | CODE |
| LOW | …/internal/test_data/module_1_local_variable_removed.py | 24 | def my_function(): | CODE |
| LOW | …apache_beam/internal/test_data/module_1_class_added.py | 31 | def my_function(): | CODE |
| LOW | sdks/python/apache_beam/internal/test_data/module_1.py | 24 | def my_function(): | CODE |
| LOW⚡ | …on/apache_beam/internal/test_data/module_2_modified.py | 25 | def my_method(self): | CODE |
| LOW⚡ | …on/apache_beam/internal/test_data/module_2_modified.py | 33 | def my_method(self): | CODE |
| LOW⚡ | …on/apache_beam/internal/test_data/module_2_modified.py | 39 | def my_method(self): | CODE |
| LOW⚡ | …on/apache_beam/internal/test_data/module_2_modified.py | 47 | def my_method(self): | CODE |
| LOW⚡ | …on/apache_beam/internal/test_data/module_2_modified.py | 53 | def my_method(self): | CODE |
| LOW | …on/apache_beam/internal/test_data/module_2_modified.py | 64 | def my_method(self): | CODE |
| LOW | …on/apache_beam/internal/test_data/module_2_modified.py | 81 | def my_method(self): | CODE |
| LOW | …on/apache_beam/internal/test_data/module_2_modified.py | 88 | def my_method(self): | CODE |
| LOW | sdks/python/apache_beam/transforms/ptransform_test.py | 1317 | def my_function(*args): | CODE |
| LOW | …content/io/kafka-io/kafka-write/python-example/task.py | 32 | def process_data(element): | CODE |
| LOW | …-content/io/kafka-io/kafka-read/python-example/task.py | 32 | def process_data(element): | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | sdks/go/pkg/beam/core/runtime/exec/pcollection_test.go | 123 | // BenchmarkPCollection_Baseline measures the baseline of the node benchmarking scaffold. | COMMENT |
| MEDIUM | …che_beam/ml/transforms/embeddings/vertex_ai_it_test.py | 43 | # Load the Vertex dependencies last so type resolution still pulls in RAG | COMMENT |
| MEDIUM | …python/apache_beam/examples/ml-orchestration/README.md | 20 | # Example ML workflow orchestration with Kubeflow Pipelines and Tensorflow Extended | COMMENT |
| MEDIUM | …beam/runners/interactive/user_pipeline_tracker_test.py | 243 | # Intercept shutil.rmtree inside clear() to orchestrate the concurrent | COMMENT |
| MEDIUM | …bsite/www/site/content/en/documentation/ml/overview.md | 44 | * [Workflow orchestration](#workflow-orchestration) | COMMENT |
| MEDIUM | …bsite/www/site/content/en/documentation/ml/overview.md | 96 | ## Workflow orchestration | COMMENT |
| MEDIUM | …/www/site/content/en/documentation/ml/orchestration.md | 18 | # Workflow orchestration | COMMENT |
| MEDIUM | …content/en/documentation/ml/large-language-modeling.md | 174 | ## RAG and Prompt Engineering in Beam | COMMENT |
| MEDIUM | website/www/site/content/en/case-studies/hsbc.md | 141 | Apache Beam provides powerful [transforms](/documentation/programming-guide/#transforms) and orchestration capabilities | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | sdks/go/pkg/beam/core/graph/fn.go | 450 | // Example usage: | COMMENT |
| LOW | sdks/go/pkg/beam/core/graph/fn.go | 463 | // Example usage: | COMMENT |
| LOW | sdks/go/pkg/beam/io/synthetic/step.go | 45 | // Usage example: | COMMENT |
| LOW | sdks/go/pkg/beam/io/synthetic/step.go | 148 | // Usage example: | COMMENT |
| LOW | sdks/go/pkg/beam/io/synthetic/source.go | 54 | // Usage example: | COMMENT |
| LOW | sdks/go/pkg/beam/io/synthetic/source.go | 74 | // Usage example: | COMMENT |
| LOW | sdks/go/pkg/beam/io/synthetic/source.go | 162 | // Usage example: | COMMENT |
| LOW | sdks/python/apache_beam/io/iobase_it_test.py | 30 | # Usage: | COMMENT |
| LOW | …he_beam/testing/benchmarks/chicago_taxi/run_chicago.sh | 23 | # Example usage: | COMMENT |
| LOW | …e_beam/yaml/examples/transforms/io/bigquery_write.yaml | 27 | # Usage: | COMMENT |
| LOW | …mples/transforms/ml/log_analysis/batch_log_analysis.sh | 18 | # Usage: | COMMENT |
| LOW | …l/apache_beam_jupyterlab_sidepanel/yaml_parse_utils.py | 156 | # Example usage | COMMENT |
| LOW | sdks/java/build-tools/beam-linkage-check.sh | 22 | # Usage: | COMMENT |
| LOW | .test-infra/metrics/build_and_publish_containers.sh | 24 | # Usage: | COMMENT |
| LOW | .test-infra/mock-apis/buf.gen.yaml | 24 | # Usage: | COMMENT |
| LOW | .test-infra/dataproc/flink_cluster.sh | 32 | # Example usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx | 314 | // TODO: implement onChange to update node data from Panel | COMMENT |
| LOW | …e/src/main/java/org/apache/beam/sdk/util/ZipFiles.java | 82 | // TODO: implement size() to try calling entry.getSize()? | COMMENT |
| LOW | …/src/main/java/org/apache/beam/sdk/io/cdap/CdapIO.java | 478 | // TODO: implement SparkReceiverIO.<~>write() | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 180 | // TODO: implement logical type date and timestamp | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 262 | // TODO: implement logical type date and timestamp | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 335 | // TODO: implement logical date and datetime | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 372 | // TODO: implement logical datetime | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 387 | // TODO: implement logical date | COMMENT |
| LOW | …va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java | 448 | // TODO: implement logical date | COMMENT |
| LOW | …xtensions/sql/meta/provider/FullNameTableProvider.java | 52 | // TODO: implement with trie | COMMENT |
| LOW | learning/tour-of-beam/backend/auth.go | 86 | // TODO: implement IDToken caching in tb_user to optimize calls to Firebase API | COMMENT |
| LOW | …ker/streaming/sideinput/SideInputStateFetcherTest.java | 66 | // TODO: Add tests with different encoded windows to verify version is correctly plumbed. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …python/apache_beam/ml/inference/anthropic_inference.py | 35 | api_key='your-api-key', | STRING |
| HIGH | …python/apache_beam/ml/inference/anthropic_inference.py | 42 | api_key='your-api-key', | STRING |
| HIGH | …ache/beam/sdk/ml/inference/remote/RemoteInference.java | 44 | * .apiKey("your-api-key") | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …pache_beam/ml/transforms/embeddings/open_ai_it_test.py | 111 | # Check that we get 512-dimensional embeddings as requested | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx | 157 | print(parse_beam_yaml("""${escapedYaml}""", | CODE |