AI Slop Code RIsk Monitor

apache/beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

8.0 Moderate pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for apache/beam, a Java project with 8,680 GitHub stars. SynthScan examined 2,985,995 lines of code across 14248 source files, recording 14375 pattern matches distributed across 28 syntactic categories. The legacy adjusted pattern signal is 8.0 (Moderate pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

8.0
Adjusted Signal
8.0
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
8.7K
Stars
Java
Language
3.0M
Lines of Code
14.2K
Files
14.4K
Pattern Hits
2026-10-12
Scan Date
0.09
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 19.4/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 12062 finding(s).

Hallucinated Dependency & Supply Chain Risk 12.4/100 · LOW

Are imports declared and package/API names verified? 1223 finding(s).

Agent Over-Engineering Ratio 12.8/100 · LOW

Are wrappers, guards, and repeated structures necessary? 6641 finding(s).

PR Review Velocity Impact 32.9/100 · MEDIUM

Which changes need focused human review? 14375 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 584HIGH 672MEDIUM 410LOW 12709

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 14375 distinct pattern matches across 28 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hallucination Indicators584 hits · 6565 pts
SeverityFileLineSnippetContext
CRITICALsdks/go/pkg/beam/io/fhirio/common.go163 operation, err := c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do()CODE
CRITICALsdks/go/pkg/beam/io/fhirio/common.go170 operation, err = c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do()CODE
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go116// org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider.configurationSchema().COMMENT
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go184// org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.from(java.lang.String)COMMENT
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go199// org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.fromQuery(java.lang.String)COMMENT
CRITICALsdks/python/apache_beam/io/azure/blobstorageio.py44 from azure.core.exceptions import ResourceNotFoundErrorCODE
CRITICAL⚡sdks/python/apache_beam/io/gcp/bigquery_test.py973 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICAL⚡sdks/python/apache_beam/io/gcp/bigquery_test.py1017 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(CODE
CRITICAL⚡sdks/python/apache_beam/io/gcp/bigquery_test.py1018 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICAL⚡sdks/python/apache_beam/io/gcp/bigquery_test.py1025 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICAL⚡sdks/python/apache_beam/io/gcp/bigquery_test.py1038 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py930 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py950 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(schema)CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py1003 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py1445 dummy_job_reference = beam.io.gcp.internal.clients.bigquery.JobReference()CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py3046 schema = beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(CODE
CRITICALsdks/python/apache_beam/io/gcp/datastore/v1new/util.py45 org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but forSTRING
CRITICALsdks/python/apache_beam/io/components/util.py33 org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but forSTRING
CRITICAL⚡sdks/python/apache_beam/transforms/external_test.py383\tat org.apache.beam.sdk.expansion.service.TransformProvider.apply(TransformProvider.java:121)CODE
CRITICAL⚡sdks/python/apache_beam/transforms/external_test.py384\tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:627)CODE
CRITICAL⚡sdks/python/apache_beam/transforms/external_test.py385\tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:729)CODE
CRITICAL⚡sdks/python/apache_beam/transforms/external_test.py390\tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)CODE
CRITICAL⚡sdks/python/apache_beam/transforms/external_test.py391\tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)CODE
CRITICAL…ython/apache_beam/runners/dataflow/dataflow_metrics.py104 in self._job_graph.proto_pipeline.components.transforms.keys()):CODE
CRITICALsdks/typescript/test/io_test.ts204 // org.apache.beam.sdk.io.gcp.bigquery.BigQueryTableSourceDef.getBeamSchema(BigQueryTableSourceDef.java:111)COMMENT
CRITICAL⚡sdks/typescript/src/apache_beam/io/pubsub.ts103 PubSub.protos.google.pubsub.v1.PubsubMessage.decode(encoded),CODE
CRITICALsdks/typescript/src/apache_beam/io/pubsub.ts128 PubSub.protos.google.pubsub.v1.PubsubMessage.encode({ data }).finish(),CODE
CRITICAL…ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java150 org.apache.commons.logging.LogFactory.getLog("logger.jcl");CODE
CRITICAL…ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java158 org.apache.logging.log4j.LogManager.getLogger("logger.log4j2");CODE
CRITICAL…/test/java/org/apache/beam/sdk/util/YamlUtilsTest.java284 org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.ImmutableMap.of(CODE
CRITICAL…e/beam/sdk/util/construction/ParDoTranslationTest.java218 org.apache.beam.sdk.util.construction.Timer.Coder.of(CODE
CRITICAL…/test/java/org/apache/beam/sdk/io/FileSystemsTest.java84 ref.set(com.google.common.collect.ImmutableMap.of("dummy", fakeFileSystem));CODE
CRITICAL…che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java51 assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable());CODE
CRITICAL…che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java63 assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable());CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java58 com.fasterxml.jackson.core.StreamReadConstraints.overrideDefaultStreamReadConstraints(CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java59 com.fasterxml.jackson.core.StreamReadConstraints.builder()CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java82 com.fasterxml.jackson.core.StreamReadConstraints.builder()CODE
CRITICAL…e/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java201 return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource()));CODE
CRITICAL…e/src/main/java/org/apache/beam/sdk/io/WriteFiles.java1176 org.apache.beam.sdk.util.ShardedKey.Coder.of(VarIntCoder.of()),CODE
CRITICAL…/core/src/main/java/org/apache/beam/sdk/io/TextIO.java433 return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource()));CODE
CRITICAL…ain/java/org/apache/beam/sdk/io/range/OffsetRange.java59 return new org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker(this);CODE
CRITICAL…in/java/org/apache/beam/sdk/io/range/ByteKeyRange.java372 return org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker.of(this);CODE
CRITICAL⚡…ava/org/apache/beam/sdk/schemas/SchemaTranslation.java527 org.apache.beam.sdk.util.Preconditions.checkArgumentNotNull(fieldType.getRowSchema()));CODE
CRITICAL⚡…ava/org/apache/beam/sdk/schemas/SchemaTranslation.java532 org.apache.beam.sdk.util.Preconditions.checkArgumentNotNull(CODE
CRITICAL⚡…ava/org/apache/beam/sdk/schemas/SchemaTranslation.java537 org.apache.beam.sdk.util.Preconditions.checkArgumentNotNull(fieldType.getMapKeyType()));CODE
CRITICAL⚡…ava/org/apache/beam/sdk/schemas/SchemaTranslation.java539 org.apache.beam.sdk.util.Preconditions.checkArgumentNotNull(CODE
CRITICAL⚡…ava/org/apache/beam/sdk/schemas/SchemaTranslation.java545 org.apache.beam.sdk.util.Preconditions.checkArgumentNotNull(CODE
CRITICAL…/java/org/apache/beam/sdk/schemas/utils/JsonUtils.java313 org.everit.json.schema.loader.SchemaLoader.load(parsedSchema);CODE
CRITICAL…a/org/apache/beam/sdk/testing/TestPipelineOptions.java57 @org.apache.beam.sdk.options.Description(CODE
CRITICAL…rg/apache/beam/sdk/transforms/GroupByEncryptedKey.java190 com.google.common.primitives.Bytes.concat(keyIv, encryptedKey),CODE
CRITICAL…rg/apache/beam/sdk/transforms/GroupByEncryptedKey.java191 com.google.common.primitives.Bytes.concat(valueIv, encryptedValue))));CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/Redistribute.java228 // org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.Hashing.smear().COMMENT
CRITICAL…ain/java/org/apache/beam/sdk/transforms/Reshuffle.java248 // org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.Hashing.smear().COMMENT
CRITICAL…c/main/java/org/apache/beam/sdk/transforms/Create.java877 org.apache.beam.sdk.values.WindowedValues.getFullCoder(CODE
CRITICAL…n/java/org/apache/beam/sdk/transforms/Deduplicate.java213 .apply(org.apache.beam.sdk.transforms.Values.create());CODE
CRITICAL…/apache/beam/sdk/fn/channel/ManagedChannelFactory.java51 org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.ensureAvailability();CODE
CRITICAL…/test/java/org/apache/beam/sdk/io/delta/DeltaIOIT.java106 org.apache.beam.sdk.extensions.gcp.util.gcsfs.GcsPath.fromUri(tempLocation);CODE
CRITICAL…/test/java/org/apache/beam/sdk/io/delta/DeltaIOIT.java193 io.delta.kernel.internal.util.Utils.toCloseableIterator(CODE
CRITICAL…/test/java/org/apache/beam/sdk/io/delta/DeltaIOIT.java239 io.delta.kernel.internal.util.Utils.toCloseableIterator(addActionsList.iterator()));CODE
CRITICAL⚡…est/java/org/apache/beam/sdk/io/delta/DeltaIOTest.java315 org.apache.beam.sdk.transforms.MapElements.into(CODE
524 more matches not shown…
Over-Commented Block5246 hits · 5172 pts
SeverityFileLineSnippetContext
LOW.asf.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWstart-build-env.sh1#!/usr/bin/env bashCOMMENT
LOW.pre-commit-config.yaml1# Licensed under the Apache License, Version 2.0 (the "License");COMMENT
LOW.yamllint.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWlocal-env-setup.sh1#!/usr/bin/env bashCOMMENT
LOW.gemini/config.yaml1#COMMENT
LOWinfra/security/log_analyzer.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/security/requirements.txt1#COMMENT
LOWinfra/security/config.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/main.tf1#COMMENT
LOWinfra/iam/requirements.txt1#COMMENT
LOWinfra/iam/users.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/users.tf1#COMMENT
LOWinfra/iam/migrate_roles.py1#COMMENT
LOWinfra/iam/roles/beam_writer.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/generate_roles.py1#COMMENT
LOWinfra/iam/roles/generate_roles.py21import datetimeCOMMENT
LOWinfra/iam/roles/beam_admin.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/beam_viewer.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/test_generate_roles.py1#COMMENT
LOWinfra/iam/roles/roles_config.yaml1#COMMENT
LOWinfra/iam/roles/roles.tf1#COMMENT
LOWinfra/iam/roles/beam_infra_manager.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/requirements.txt1#COMMENT
LOWinfra/keys/test_secret_manager.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/service_account.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/config.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/secret_manager.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.yaml21# display_name: account_@project_id.iam.gserviceaccount.comCOMMENT
LOWinfra/keys/test_service_account.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/requirements.txt1#COMMENT
LOWinfra/enforcement/iam.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/config.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/sending.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/test_sending.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/account_keys.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/account_keys.py261COMMENT
LOWsdks/standard_external_transforms.yaml1#COMMENT
LOWsdks/standard_expansion_services.yaml1#COMMENT
LOWsdks/standard_expansion_services.yaml21# Each service must specify a package destination for each supported SDK, whichCOMMENT
LOWsdks/standard_expansion_services.yaml81# transforms:COMMENT
LOWsdks/standard_expansion_services.yaml101# # Handwritten wrappers exist in apache_beam/io/gcp/bigtableio.pyCOMMENT
LOWsdks/go/run_with_go_version.sh1#!/bin/bashCOMMENT
LOWsdks/go/run_with_go_version.sh21#COMMENT
LOWsdks/go/prepare_go_version.sh1#!/bin/bashCOMMENT
LOWsdks/go/cmd/starcgen/starcgen_test.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/starcgen/starcgen.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/starcgen/starcgen.go21// reflection based shims used by beam. Reflection is convenient for development,COMMENT
LOWsdks/go/cmd/starcgen/starcgen.go181}COMMENT
LOWsdks/go/cmd/specialize/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/specialize/main_test.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/symtab/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/prism/prism.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/artifact.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/provision.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/root.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/test/run_validatesrunner_tests.sh1#!/bin/bashCOMMENT
5186 more matches not shown…
Hyper-Verbose Identifiers5408 hits · 5130 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py116 def _grant_bucket_permissions(self, sink: logging_v2.Sink) -> None:STRING
LOWinfra/security/log_analyzer.py207 def create_weekly_email_report(self, dry_run: bool = False) -> None:STRING
LOWinfra/keys/test_secret_manager.py98 def test_get_secret_ids_exception(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py129 def test_secret_is_managed_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py141 def test_secret_is_managed_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py153 def test_secret_is_managed_not_exists(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py164 def test_create_secret_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py192 def test_create_secret_already_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py222 def test_get_secret_not_exists(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py232 def test_get_secret_not_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py246 def test_delete_secret_success(self, mock_client, mock_is_managed, mock_exists):CODE
LOWinfra/keys/test_secret_manager.py260 def test_delete_secret_not_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py275 def test_is_different_user_access_same(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py297 def test_is_different_user_access_different(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py319 def test_update_secret_access_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py339 def test_get_secret_versions_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py354 def test_secret_version_exists_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py370 def test_secret_version_exists_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py386 def test_secret_version_is_enabled_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py403 def test_secret_version_is_enabled_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py420 def test_get_latest_secret_version_id_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py445 def test_get_latest_secret_version_id_no_enabled(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py462 def test_is_key_rotation_due_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py478 def test_is_key_rotation_due_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py496 def test_add_secret_version_success(self, mock_client, mock_checksum, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py529 def test_get_latest_secret_version_success(self, mock_client, mock_checksum):CODE
LOWinfra/keys/test_secret_manager.py561 def test_enable_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py596 def test_disable_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py631 def test_destroy_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py680 def test_purge_disabled_secret_versions_success(self, mock_client, mock_destroy):CODE
LOWinfra/keys/test_secret_manager.py774 def test_full_secret_lifecycle(self):CODE
LOWinfra/keys/service_account.py88 def _service_account_is_enabled(self, account_id: str) -> bool:CODE
LOWinfra/keys/service_account.py246 def _get_service_account_keys(self, account_id: str) -> List[iam_admin_v1.ServiceAccountKey]:CODE
LOWinfra/keys/service_account.py264 def _service_account_key_exists(self, account_id: str, key_id: str) -> bool:CODE
LOWinfra/keys/service_account.py278 def create_service_account_key(self, account_id: str) -> types.ServiceAccountKey:CODE
LOWinfra/keys/service_account.py343 def delete_service_account_key(self, account_id: str, key_id: str) -> None:CODE
LOWinfra/keys/keys.py74def load_service_accounts_config() -> ServiceAccountsConfig:CODE
LOWinfra/keys/keys.py183 def _start_all_service_accounts(self) -> None:CODE
LOWinfra/keys/keys.py301 def get_latest_service_account_key(self, account_id: str) -> str:CODE
LOWinfra/keys/secret_manager.py355 def _secret_version_is_enabled(self, secret_id: str, version_id: str) -> bool:CODE
LOWinfra/keys/secret_manager.py379 def _secret_version_is_destroyed(self, secret_id: str, version_id: str) -> bool:CODE
LOWinfra/keys/secret_manager.py403 def _get_latest_secret_version_id(self, secret_id: str) -> str:CODE
LOWinfra/keys/secret_manager.py530 def get_latest_secret_version(self, secret_id: str) -> Tuple[str, bytes]:CODE
LOWinfra/keys/secret_manager.py737 def purge_disabled_secret_versions(self, secret_id: str) -> List[str]:CODE
LOW⚡infra/keys/test_service_account.py49 def _create_mock_service_account(self, account_id: str, disabled: bool = False) -> types.ServiceAccount:CODE
LOW⚡infra/keys/test_service_account.py206 def test_create_service_account_key_not_found(self):CODE
LOW⚡infra/keys/test_service_account.py213 def test_delete_service_account_key(self):CODE
LOW⚡infra/keys/test_service_account.py222 def test_list_service_account_keys(self):CODE
LOW⚡infra/keys/test_service_account.py276 def test_normalize_account_email_with_email(self):CODE
LOW⚡infra/keys/test_service_account.py282 def test_normalize_account_email_with_id(self):CODE
LOW⚡infra/keys/test_service_account.py288 def test_service_account_exists_true(self):CODE
LOW⚡infra/keys/test_service_account.py298 def test_service_account_exists_false(self):CODE
LOW⚡infra/keys/test_service_account.py307 def test_service_account_is_enabled_true(self):CODE
LOW⚡infra/keys/test_service_account.py317 def test_service_account_is_enabled_false(self):CODE
LOW⚡infra/keys/test_service_account.py327 def test_service_account_is_enabled_not_found(self):CODE
LOW⚡infra/keys/test_service_account.py336 def test_get_service_account_success(self):CODE
LOW⚡infra/keys/test_service_account.py346 def test_get_service_account_not_found(self):CODE
LOW⚡infra/keys/test_service_account.py355 def test_service_account_key_exists_true(self):CODE
LOW⚡infra/keys/test_service_account.py381 def test_delete_service_account_key_not_found(self):CODE
LOW⚡infra/keys/test_service_account.py391 def test_delete_service_account_key_failed_precondition(self):CODE
5348 more matches not shown…
Cross-File Repetition249 hits · 1245 pts
SeverityFileLineSnippetContext
HIGHinfra/iam/roles/generate_roles.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHinfra/enforcement/iam.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHinfra/enforcement/account_keys.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHsdks/python/gen_protos.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHexamples/notebooks/patch.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHsdks/python/apache_beam/pipeline.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/coders/coder_impl.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/dill_pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/metrics/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/azure/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/gcp/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/utils/urns.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/utils/proto_utils.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGH…he_beam/transforms/py_dataflow_distribution_counter.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/portability/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/portability/utils.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/common.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/direct/executor.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/worker/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/io/filesystems.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/filesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/filesystems.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/filesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/filesystems.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
189 more matches not shown…
Cross-Language Confusion150 hits · 901 pts
SeverityFileLineSnippetContext
HIGH⚡sdks/python/apache_beam/dataframe/schemas_test.py193 self.assertTrue(roundtripped.equals(NICE_TYPES_PROXY))CODE
HIGHsdks/python/apache_beam/dataframe/partitionings.py142 if not df.index.equals(repartitioned_df.index):CODE
HIGHsdks/python/apache_beam/dataframe/transforms_test.py279 if not expected.equals(actual):CODE
HIGHsdks/python/apache_beam/dataframe/frames.py780 "result. Consider using df.length() instead.",CODE
HIGHsdks/python/apache_beam/dataframe/frames.py828 lambda df, other: pd.Series(df.equals(other)),CODE
HIGHsdks/python/apache_beam/dataframe/frames.py1630 size = self.length()CODE
HIGHsdks/python/apache_beam/dataframe/frames.py2372 return result / column.length()CODE
HIGHsdks/python/apache_beam/dataframe/frames.py4039 return result/dropped.length()CODE
HIGH⚡sdks/python/apache_beam/io/snowflake.py390 {"dataType":{"type":"binary","size":null},"name":"","nullable":false},STRING
HIGH⚡sdks/python/apache_beam/io/snowflake.py392 {"dataType":{"type":"string","length":null},"name":"","nullable":false},STRING
HIGH⚡sdks/python/apache_beam/io/snowflake.py393 {"dataType":{"type":"text","length":null},"name":"","nullable":false},STRING
HIGH⚡sdks/python/apache_beam/io/snowflake.py394 {"dataType":{"type":"varbinary","size":null},"name":"","nullable":false},STRING
HIGH…ks/python/apache_beam/io/gcp/bigquery_read_internal.py467 # It probably means its value was null, as the extract to JSON jobCOMMENT
HIGH⚡sdks/python/apache_beam/internal/pickler_test.py288 # elements. Iteration order is implementation dependent and undefined,COMMENT
HIGH⚡sdks/python/apache_beam/internal/pickler_test.py298 # elements. Iteration order is implementation dependent and undefined,COMMENT
HIGHsdks/python/apache_beam/utils/retry.py254 404 Http errors most of the time. The default value will return trueSTRING
HIGHsdks/python/apache_beam/ml/anomaly/thresholds.py173 self._tracker.push(float("NaN"))CODE
HIGHsdks/python/apache_beam/ml/anomaly/thresholds.py176 self._tracker.push(score)CODE
HIGHsdks/python/apache_beam/ml/anomaly/univariate/mad.py67 self._median_tracker.push(x)CODE
HIGHsdks/python/apache_beam/ml/anomaly/univariate/mad.py69 self._diff_median_tracker.push(abs(x - median))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py35 t.push(1)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py37 t.push(2)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py39 t.push(3)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py41 t.push(10)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py47 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py50 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py53 t.push(2)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py55 t.push(1)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py57 t.push(3)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py61 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py64 t.push(10)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py80 t1.push(v)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py81 t2.push(v)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py91 t.push(2)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py93 t.push(1)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py95 t.push(3)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py97 t.push(10)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py104 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py107 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py110 t.push(1)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py112 t.push(2)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py114 t.push(3)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py118 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py121 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py124 t.push(float('nan'))CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py131 t.push(4)CODE
HIGH⚡…python/apache_beam/ml/anomaly/univariate/stdev_test.py133 t.push(5)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py149 t1.push(v)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py150 t2.push(v)CODE
HIGH…/python/apache_beam/ml/anomaly/univariate/perf_test.py33 tracker.push(numbers[i])CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py39 t.push(1)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py41 t.push(2)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py43 t.push(2)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py45 t.push(0)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py47 t.push(3)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py49 t.push(1)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py58 t.push(1)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py60 t.push(float('nan'))CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py62 t.push(2)CODE
HIGH⚡…hon/apache_beam/ml/anomaly/univariate/quantile_test.py64 t.push(float('nan'))CODE
90 more matches not shown…
Empty Error Handlers149 hits · 745 pts
SeverityFileLineSnippetContext
HIGHsdks/python/setup.py111except PackageNotFoundError:CODE
HIGHsdks/python/setup.py126except PackageNotFoundError:CODE
HIGHsdks/python/apache_beam/__init__.py101except ImportError:CODE
HIGH…n/apache_beam/options/pipeline_options_context_test.py60except ValueError:CODE
HIGHsdks/python/apache_beam/coders/coder_impl.py1892except ImportError:CODE
HIGHsdks/python/apache_beam/coders/stream_test.py219except ImportError:CODE
HIGHsdks/python/apache_beam/dataframe/io.py591except ValueError:CODE
HIGHsdks/python/apache_beam/dataframe/io.py598except (OSError, ValueError):CODE
HIGHsdks/python/apache_beam/io/localfilesystem_test.py204except IOError:CODE
HIGHsdks/python/apache_beam/io/filesystems.py42except ModuleNotFoundError:CODE
HIGHsdks/python/apache_beam/io/filesystems.py54except ModuleNotFoundError:CODE
HIGHsdks/python/apache_beam/io/filesystems.py66except ModuleNotFoundError:CODE
HIGHsdks/python/apache_beam/io/filesystems.py77except ModuleNotFoundError:CODE
HIGHsdks/python/apache_beam/io/filesystems.py88except ModuleNotFoundError:CODE
HIGHsdks/python/apache_beam/io/textio.py804except TypeError:CODE
HIGHsdks/python/apache_beam/io/__init__.py41except ImportError:CODE
HIGHsdks/python/apache_beam/io/tfrecordio.py60except ImportError:CODE
HIGHsdks/python/apache_beam/io/tfrecordio.py69except ImportError:CODE
HIGHsdks/python/apache_beam/io/localfilesystem.py125except OSError:CODE
HIGHsdks/python/apache_beam/io/fileio.py832except IOError:CODE
HIGHsdks/python/apache_beam/io/gcp/gce_metadata_util.py34except requests.exceptions.RequestException:CODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_json_it_test.py74except gexc.NotFound:CODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools_test.py305except: # pylint: disable=bare-exceptCODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools_test.py328except: # pylint: disable=bare-exceptCODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools_test.py385except Exception:CODE
HIGHsdks/python/apache_beam/io/gcp/bigtableio_test.py324except: # pylint: disable=bare-exceptCODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_compat.py887except ImportError:CODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_compat.py931except Exception:CODE
HIGHsdks/python/apache_beam/io/gcp/bigquery_file_loads.py55except ImportError:CODE
HIGH…apache_beam/io/gcp/big_query_query_to_table_it_test.py47except ImportError:CODE
HIGH…ks/python/apache_beam/io/gcp/gcsio_integration_test.py233except NotFound:CODE
HIGH…ks/python/apache_beam/io/gcp/gcsio_integration_test.py262except NotFound:CODE
HIGHsdks/python/apache_beam/io/gcp/gcsio.py435except RetryError:CODE
HIGH…e_beam/io/gcp/experimental/spannerio_read_perf_test.py107except AlreadyExists:CODE
HIGH…ks/python/apache_beam/io/gcp/experimental/spannerio.py217except ImportError:CODE
HIGH…ks/python/apache_beam/io/gcp/tests/bigquery_matcher.py111except ValueError:CODE
HIGH…on/apache_beam/io/gcp/tests/xlang_spannerio_it_test.py320except: # pylint: disable=bare-exceptCODE
HIGH…thon/apache_beam/io/gcp/datastore/v1new/datastoreio.py58except ImportError:CODE
HIGH…python/apache_beam/io/external/xlang_mqttio_it_test.py113except Exception:CODE
HIGH…/python/apache_beam/io/external/xlang_jmsio_it_test.py258except Exception:CODE
HIGH…/python/apache_beam/io/external/xlang_jmsio_it_test.py187except Exception:CODE
HIGH…/python/apache_beam/io/external/xlang_jmsio_it_test.py318except Exception:CODE
HIGHsdks/python/apache_beam/internal/dill_pickler.py330except AttributeError:CODE
HIGHsdks/python/apache_beam/internal/dill_pickler.py339except AttributeError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py55except (ImportError, ModuleNotFoundError):CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py71except ImportError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py77except ImportError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py194except NameError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py201except NameError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py205except NameError:CODE
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py83except ImportError:CODE
HIGHsdks/python/apache_beam/internal/metrics/metric.py48except ImportError:CODE
HIGH…python/apache_beam/internal/cloudpickle/cloudpickle.py318except Exception:CODE
HIGH…python/apache_beam/internal/cloudpickle/cloudpickle.py539except KeyError:CODE
HIGHsdks/python/apache_beam/utils/thread_pool_executor.py100except queue.Empty:CODE
HIGH…/python/apache_beam/utils/multi_process_shared_test.py208except Exception:CODE
HIGH…/python/apache_beam/utils/multi_process_shared_test.py240except Exception:CODE
HIGH…/python/apache_beam/utils/multi_process_shared_test.py268except Exception:CODE
HIGH…/python/apache_beam/utils/multi_process_shared_test.py342except Exception:CODE
HIGH…/python/apache_beam/utils/multi_process_shared_test.py386except Exception:CODE
89 more matches not shown…
Self-Referential Comments192 hits · 574 pts
SeverityFileLineSnippetContext
MEDIUMinfra/iam/main.tf17# This file defines the general configuration for the Terraform project.COMMENT
MEDIUMinfra/iam/migrate_roles.py91 # Create the migrated entryCOMMENT
MEDIUMinfra/iam/.terraform.lock.hcl1# This file is maintained automatically by "terraform init".COMMENT
MEDIUMinfra/iam/roles/beam_writer.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/generate_roles.py44# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/beam_admin.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/beam_viewer.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/roles_config.yaml18# This file defines the roles, their hierarchy, the services they can access and the roles they inherit from.COMMENT
MEDIUMinfra/iam/roles/beam_infra_manager.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/keys/test_secret_manager.py757 # Create a logger for integration testsCOMMENT
MEDIUMinfra/keys/service_account.py307 # Create the keyCOMMENT
MEDIUMinfra/keys/keys.py174 # Create a null logger that doesn't actually log anythingCOMMENT
MEDIUMinfra/keys/keys.yaml17# This file contains the service account for the project, the account idCOMMENT
MEDIUM⚡infra/keys/test_service_account.py39 # Create a mock loggerCOMMENT
MEDIUM⚡infra/keys/test_service_account.py42 # Create the service account managerCOMMENT
MEDIUMinfra/keys/test_service_account.py546 # Create a key for the service accountCOMMENT
MEDIUMinfra/keys/test_service_account.py560 # Create a new key to ensure we have multiple keysCOMMENT
MEDIUM⚡infra/enforcement/test_sending.py26 # Create a SendingClient with dummy valuesCOMMENT
MEDIUMsdks/python/gen_managed_doc.py116 # Creating a unique list of expansion service jars.STRING
MEDIUMsdks/python/apache_beam/pipeline.py258 # Create a ComponentIdMap for assigning IDs to components. Ensures that anyCOMMENT
MEDIUMsdks/python/apache_beam/pipeline.py31 # Create a pipeline object using a local runner for execution.STRING
MEDIUMsdks/python/apache_beam/io/mongodbio.py18"""This module implements IO classes to read and write data on MongoDB.STRING
MEDIUMsdks/python/apache_beam/io/iobase.py615 """This class is deprecated, no backwards-compatibility guarantees.STRING
MEDIUMsdks/python/apache_beam/io/iobase.py878 """This class is deprecated, no backwards-compatibility guarantees.STRING
MEDIUM⚡sdks/python/apache_beam/io/fileio_test.py649 # Create a file to be matched before pipelineCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py68 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py242 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py260 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py331 # Create a file to be matched before pipelineCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py365 # Create a file to be matched before pipeline startsCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_biglake_test.py68 # Create the transformCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_test.py2228 # Create a windowed value for testingCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_test.py2307 # Create a windowed value for testingCOMMENT
MEDIUM…ython/apache_beam/io/gcp/bigquery_geography_it_test.py223 # Create the table firstCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_tools.py1275 # Create a new table potentially reusing the schema from a previouslyCOMMENT
MEDIUM⚡sdks/python/apache_beam/io/gcp/bigquery_tools_test.py1204 # Create a mock field with GEOGRAPHY typeCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/gcsio_test.py94 # Define the exit logicCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/gcsio_test.py479 # Creating a mock bucket without setting project_number (it returns another mock object)COMMENT
MEDIUM…/apache_beam/io/gcp/bigquery_change_history_it_test.py428 # Create a change-history-enabled table and insert initial rows via DML.COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/pubsub.py318 """This class is deprecated. Use ``ReadFromPubSub`` instead."""STRING
MEDIUMsdks/python/apache_beam/io/gcp/pubsub.py341 """This class is deprecated. Use ``WriteToPubSub`` instead."""STRING
MEDIUM⚡…ython/apache_beam/io/gcp/bigquery_schema_tools_test.py357 # Create a user type with GEOGRAPHY fieldCOMMENT
MEDIUM⚡…ython/apache_beam/io/gcp/bigquery_schema_tools_test.py366 # Create the DoFnCOMMENT
MEDIUM…che_beam/io/gcp/healthcare/dicomio_integration_test.py89 # Create a an empty DICOM storeCOMMENT
MEDIUMsdks/python/apache_beam/io/aws/s3io_test.py388 # Create the file in the real bucketCOMMENT
MEDIUMsdks/python/apache_beam/io/aws/s3io_test.py446 # Create the file and check that it was createdCOMMENT
MEDIUM…on/apache_beam/io/external/xlang_debeziumio_it_test.py124# Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_mqttio_it_test.py94 # Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM⚡…python/apache_beam/io/external/xlang_jdbcio_it_test.py228 # Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_jdbcio_it_test.py434 # Create a simple table for this testCOMMENT
MEDIUMsdks/python/apache_beam/internal/dill_pickler.py54 # The following function is based on 'save_code' from 'dill'COMMENT
MEDIUMsdks/python/apache_beam/internal/dill_pickler.py61 # The following function is also based on 'save_codeobject' from 'cloudpickle'COMMENT
MEDIUMsdks/python/apache_beam/utils/multi_process_shared.py454 # Create a pipe to connect with child processCOMMENT
MEDIUMsdks/python/apache_beam/utils/windowed_value.py20# This module is carefully crafted to have optimal performance whenCOMMENT
MEDIUM…python/apache_beam/utils/transform_service_launcher.py97 # Creating the credentials volume.COMMENT
MEDIUM…python/apache_beam/utils/transform_service_launcher.py123 # Creating the dependencies volume.COMMENT
MEDIUMsdks/python/apache_beam/transforms/ptransform.py856 # Create a flat list rather than a nested tree of compositeCOMMENT
MEDIUMsdks/python/apache_beam/transforms/util.py1814 """This class represents the parameters forSTRING
MEDIUMsdks/python/apache_beam/transforms/core.py1996 """This class represents the state in the ParDoPayload's function spec,STRING
MEDIUM⚡sdks/python/apache_beam/transforms/core_test.py240 # Create an instance of the ApplyPartitionFnFn classCOMMENT
132 more matches not shown…
Excessive Try-Catch Wrapping474 hits · 534 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py270 except Exception as e:STRING
MEDIUM⚡infra/iam/roles/generate_roles.py80 print(f"Error: Permission denied. Ensure you have 'resourcemanager.projects.get' on project '{project_id}'.")CODE
MEDIUM⚡infra/iam/roles/generate_roles.py84 print(f"Error: Project '{project_id}' not found.")CODE
LOW⚡infra/iam/roles/generate_roles.py87 except Exception as e:CODE
MEDIUMinfra/iam/roles/generate_roles.py130 print(f"Error: The role '{role_name}' was not found.")CODE
LOWinfra/iam/roles/generate_roles.py132 except Exception as e:CODE
LOWinfra/keys/test_secret_manager.py771 except Exception as e:CODE
LOWinfra/keys/service_account.py335 except Exception as e:CODE
LOWinfra/keys/service_account.py367 except Exception as e:CODE
LOWinfra/keys/service_account.py415 except Exception as auth_error:CODE
LOWinfra/keys/keys.py236 except Exception as e:CODE
LOWinfra/keys/keys.py277 except Exception as e:CODE
LOWinfra/keys/keys.py292 except Exception as e:CODE
LOWinfra/keys/keys.py321 except Exception as e:CODE
MEDIUMinfra/keys/keys.py355 print(f"Error: Service account '{account_id}' not found in configuration.")CODE
LOW⚡infra/keys/keys.py370 except Exception as e:CODE
MEDIUM⚡infra/keys/keys.py371 print(f"Error retrieving key for {account_id}: {e}")CODE
LOW⚡infra/keys/keys.py376 except Exception as e:CODE
MEDIUM⚡infra/keys/keys.py377 print(f"An error occurred: {e}")CODE
LOWinfra/keys/secret_manager.py67 except Exception as e:CODE
LOWinfra/keys/secret_manager.py88 except Exception as e:CODE
LOWinfra/keys/secret_manager.py252 except Exception as e:CODE
LOW⚡infra/keys/test_service_account.py523 except Exception as e:CODE
LOW⚡infra/keys/test_service_account.py525 except Exception as e:CODE
LOWinfra/enforcement/iam.py96 except Exception as e:CODE
LOWinfra/enforcement/iam.py160 except Exception as e:CODE
LOWinfra/enforcement/iam.py417 except Exception as e:STRING
LOW⚡infra/enforcement/iam.py447 except Exception as e:STRING
LOWinfra/enforcement/account_keys.py129 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py155 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py179 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py199 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py230 except Exception as e:CODE
LOW⚡infra/enforcement/account_keys.py617 except Exception as e:STRING
LOWinfra/enforcement/account_keys.py587 except Exception as e:STRING
LOWsdks/python/conftest.py134 except Exception as e:CODE
LOW⚡sdks/python/apache_beam/pipeline.py1052 except Exception:CODE
LOWsdks/python/apache_beam/pipeline.py1510 except Exception as exn:CODE
LOW…n/apache_beam/options/pipeline_options_context_test.py86 except Exception as e:CODE
LOW…n/apache_beam/options/pipeline_options_context_test.py274 except Exception as e:CODE
MEDIUM…n/apache_beam/options/pipeline_options_context_test.py71def thread_worker(thread_id, runner_name):CODE
MEDIUM…n/apache_beam/options/pipeline_options_context_test.py265def construct_pipeline(worker_id):CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py816 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py853 except Exception as e:STRING
LOW⚡sdks/python/apache_beam/coders/coder_impl.py518 except Exception as e:CODE
LOW⚡sdks/python/apache_beam/coders/coder_impl.py525 except Exception as e:CODE
LOW⚡sdks/python/apache_beam/coders/coder_impl.py533 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py455 except Exception as exn:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py473 except Exception as exn:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py549 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coders.py842 except Exception: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/coders/coders.py850 except Exception: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/coders/coders.py1062 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/typecoders.py252 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/doctests.py288 except Exception:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py80 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py91 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py105 except Exception as e:CODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py226 except Exception as e: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py339 except Exception as e: # pylint: disable=broad-exceptCODE
414 more matches not shown…
Docstring Block Structure106 hits · 530 pts
SeverityFileLineSnippetContext
HIGHsdks/python/apache_beam/dataframe/frames.py4696 Applies aggregation functions to the grouped data based on the provided keyword arguments and combines the results STRING
HIGHsdks/python/apache_beam/dataframe/frames.py4739 Handles the aggregation logic based on the function type passed. Args: gb: The groupby instance (DeferredGroSTRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py150Verifies that url begins with hdfs:// prefix, strips it and adds a leading /. Parsing behavior is determined bySTRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py394Fetches last updated time for a URL. Args: url: string url of file. Returns: float UNIX Epoch time STRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py424Fetch metadata fields of a file on the FileSystem. Args: url: string url of a file. Returns: :clasSTRING
HIGHsdks/python/apache_beam/io/filesystems.py205Find all matching paths to the patterns provided. Pattern matching is done using each filesystem's ``match`` methodSTRING
HIGHsdks/python/apache_beam/io/filesystems.py329Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/filesystems.py344Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returnsSTRING
HIGHsdks/python/apache_beam/io/filesystem.py589List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dirSTRING
HIGHsdks/python/apache_beam/io/filesystem.py712Find all matching paths to the patterns provided. See Also: :meth:`translate_pattern` Patterns ending wiSTRING
HIGHsdks/python/apache_beam/io/filesystem.py854Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size ofSTRING
HIGHsdks/python/apache_beam/io/filesystem.py868Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/filesystem.py881Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returnsSTRING
HIGHsdks/python/apache_beam/io/filesystem.py903Fetch metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returns metadataSTRING
HIGHsdks/python/apache_beam/io/tfrecordio.py138Read a record from a TFRecords file. Args: file_handle: The file to read from. Returns: None if EOFSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py99List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py266Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py282Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py297Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py313Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py115List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dir_oSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py234Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size ofSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py250Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py266Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py283Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/io/azure/blobstorageio.py132Open an Azure Blob Storage file path for reading or writing. Args: filename (str): Azure Blob Storage file paSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py120List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py285Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py298Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py311Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py328Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py174Parses a table reference into a (project, dataset, table) tuple. Args: destination: Either a TableReference objecSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py253Parses a table reference into a (project, dataset, table) tuple. Args: table: The ID of the table. The ID must coSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py877Lookup a table's metadata object. Args: client: bigquery.BigqueryV2 instance project_id: table lookup pSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py1225Gets or creates a table based on create and write dispositions. The function mimics the behavior of BigQuery importSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsio.py305Open a GCS file path for reading or writing. Args: filename (str): GCS file path in the form ``gs://<bucket>/STRING
HIGH…n/apache_beam/io/gcp/datastore/v1new/query_splitter.py45Returns a list of sharded queries for the given Cloud Datastore query. This will create up to the desired number of sSTRING
HIGHsdks/python/apache_beam/io/components/rate_limiter.py59Applies rate limiting to the request. This method checks if the request is permitted by the rate limiting policy. STRING
HIGHsdks/python/apache_beam/io/aws/s3io.py78Open an S3 file path for reading or writing. Args: filename (str): S3 file path in the form ``s3://<bucket>/<STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py117List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py237Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py253Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py269Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py286Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py68Returns the code object identifier for a given callable. Args: callable: The callable object to search for. ReSTRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py230Searches a code object to create a code object identifier. Args: callable: The callable to search for. node: STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py335Returns the code object from a name pattern. Args: obj: The object to search within. name_result: The result STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py362Returns the code object from a lambda with args pattern. Args: obj: The object to search within. lambda_with_STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py392Returns the code object from a lambda with hash pattern. Args: obj: The object to search within. lambda_with_STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py423Returns the code object corresponding to the code object identifier. Args: code_object_identifier: A string repreSTRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py37For internal use only; no backwards-compatibility guarantees. Converts a basic type into a @type/value dictionary. STRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py66For internal use only; no backwards-compatibility guarantees. Converts Python objects into extra_types.JsonValue objeSTRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py126For internal use only; no backwards-compatibility guarantees. Converts ``extra_types.JsonValue`` objects into Python STRING
HIGHsdks/python/apache_beam/utils/byte_limited_queue.py132Remove and return an item from the queue. If the queue is empty, block until an item is available, unless `block` STRING
HIGHsdks/python/apache_beam/utils/timestamp.py299Returns a ``datetime.datetime`` object of UTC for this Timestamp. Note that this method returns a ``datetime.datetiSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py393Annotates the input type of a :class:`PTransform` with a type-hint. Args: input_type_hint (type): An instanceSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py418Annotates the output type of a :class:`PTransform` with a type-hint. Args: type_hint (type): An instance of aSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py454Adds resource hints to the :class:`PTransform`. Resource hints allow users to express constraints on the environmenSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py920Annotates the types of main inputs and side inputs for the PTransform. Args: input_type_hint: An instance of STRING
HIGHsdks/python/apache_beam/transforms/core.py1807Returns a tagged tuple allowing access to the outputs of a :class:`ParDo`. The resulting object supports accessSTRING
46 more matches not shown…
Deep Nesting547 hits · 466 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py158CODE
LOWinfra/iam/migrate_roles.py31CODE
LOWinfra/keys/service_account.py278CODE
LOWinfra/keys/keys.py325CODE
LOWinfra/keys/keys.py183CODE
LOWinfra/keys/keys.py239CODE
LOWinfra/keys/test_service_account.py514CODE
LOWinfra/enforcement/iam.py380CODE
LOWinfra/enforcement/iam.py80CODE
LOWinfra/enforcement/iam.py203CODE
LOWinfra/enforcement/sending.py63CODE
LOWinfra/enforcement/account_keys.py550CODE
LOWinfra/enforcement/account_keys.py203CODE
LOWsdks/python/gen_xlang_wrappers.py247CODE
LOWsdks/python/gen_managed_doc.py104CODE
LOWsdks/python/gen_protos.py111CODE
LOWsdks/python/gen_protos.py370CODE
LOWsdks/python/gen_protos.py416CODE
LOWsdks/python/gen_protos.py242CODE
LOWsdks/python/setup.py280CODE
LOWsdks/python/apache_beam/pipeline.py318CODE
LOWsdks/python/apache_beam/pipeline.py712CODE
LOWsdks/python/apache_beam/pipeline.py881CODE
LOWsdks/python/apache_beam/pipeline.py1331CODE
LOWsdks/python/apache_beam/pipeline.py1452CODE
LOWsdks/python/apache_beam/pipeline.py337CODE
LOWsdks/python/apache_beam/pipeline.py473CODE
LOWsdks/python/apache_beam/metrics/monitoring_infos.py517CODE
LOWsdks/python/apache_beam/metrics/cells.py740CODE
LOWsdks/python/apache_beam/metrics/cells.py766CODE
LOW…thon/apache_beam/options/pipeline_options_validator.py393CODE
LOWsdks/python/apache_beam/options/pipeline_options.py257CODE
LOWsdks/python/apache_beam/options/pipeline_options.py422CODE
LOWsdks/python/apache_beam/options/pipeline_options.py481CODE
LOWsdks/python/apache_beam/options/pipeline_options.py951CODE
LOWsdks/python/apache_beam/options/pipeline_options.py1283CODE
LOW…ks/python/apache_beam/options/pipeline_options_test.py800CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py267CODE
LOWsdks/python/apache_beam/coders/coder_impl.py405CODE
LOWsdks/python/apache_beam/coders/coder_impl.py487CODE
LOWsdks/python/apache_beam/coders/coder_impl.py588CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1303CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1963CODE
LOWsdks/python/apache_beam/coders/coder_impl.py2010CODE
LOWsdks/python/apache_beam/coders/row_coder.py144CODE
LOWsdks/python/apache_beam/coders/typecoders.py174CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py77CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py85CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py189CODE
LOWsdks/python/apache_beam/dataframe/doctests.py521CODE
LOWsdks/python/apache_beam/dataframe/doctests.py223CODE
LOWsdks/python/apache_beam/dataframe/doctests.py302CODE
LOWsdks/python/apache_beam/dataframe/doctests.py397CODE
LOWsdks/python/apache_beam/dataframe/doctests.py424CODE
LOWsdks/python/apache_beam/dataframe/transforms.py147CODE
LOWsdks/python/apache_beam/dataframe/transforms.py356CODE
LOWsdks/python/apache_beam/dataframe/transforms.py436CODE
LOWsdks/python/apache_beam/dataframe/transforms.py175CODE
LOWsdks/python/apache_beam/dataframe/convert.py106CODE
LOWsdks/python/apache_beam/dataframe/convert.py167CODE
487 more matches not shown…
Unused Imports432 hits · 399 pts
SeverityFileLineSnippetContext
LOWsdks/python/apache_beam/__init__.py85CODE
LOWsdks/python/apache_beam/__init__.py86CODE
LOWsdks/python/apache_beam/__init__.py87CODE
LOWsdks/python/apache_beam/__init__.py88CODE
LOWsdks/python/apache_beam/__init__.py89CODE
LOWsdks/python/apache_beam/__init__.py91CODE
LOWsdks/python/apache_beam/__init__.py92CODE
LOWsdks/python/apache_beam/__init__.py93CODE
LOWsdks/python/apache_beam/__init__.py94CODE
LOWsdks/python/apache_beam/__init__.py95CODE
LOWsdks/python/apache_beam/__init__.py100CODE
LOWsdks/python/apache_beam/pipeline.py107CODE
LOWsdks/python/apache_beam/pipeline.py110CODE
LOWsdks/python/apache_beam/pvalue.py50CODE
LOWsdks/python/apache_beam/pvalue.py51CODE
LOWsdks/python/apache_beam/pvalue.py53CODE
LOWsdks/python/apache_beam/pvalue.py54CODE
LOWsdks/python/apache_beam/metrics/metrics_flag.py29CODE
LOWsdks/python/apache_beam/metrics/metrics_flag.py32CODE
LOWsdks/python/apache_beam/metrics/execution.py38CODE
LOWsdks/python/apache_beam/metrics/execution.py39CODE
LOWsdks/python/apache_beam/metrics/execution.py40CODE
LOWsdks/python/apache_beam/metrics/execution.py41CODE
LOWsdks/python/apache_beam/metrics/execution.py42CODE
LOWsdks/python/apache_beam/metrics/execution.py43CODE
LOWsdks/python/apache_beam/metrics/execution.py44CODE
LOWsdks/python/apache_beam/metrics/execution.py54CODE
LOWsdks/python/apache_beam/metrics/execution.py56CODE
LOWsdks/python/apache_beam/metrics/execution.py61CODE
LOWsdks/python/apache_beam/metrics/execution.py62CODE
LOWsdks/python/apache_beam/metrics/execution.py63CODE
LOWsdks/python/apache_beam/metrics/execution.py64CODE
LOWsdks/python/apache_beam/metrics/execution.py65CODE
LOWsdks/python/apache_beam/metrics/execution.py66CODE
LOWsdks/python/apache_beam/metrics/execution.py67CODE
LOWsdks/python/apache_beam/metrics/__init__.py17CODE
LOWsdks/python/apache_beam/metrics/__init__.py18CODE
LOWsdks/python/apache_beam/metrics/metric.py40CODE
LOWsdks/python/apache_beam/metrics/metric.py51CODE
LOWsdks/python/apache_beam/metrics/metric.py52CODE
LOWsdks/python/apache_beam/metrics/metric.py53CODE
LOWsdks/python/apache_beam/metrics/metric.py54CODE
LOW…python/apache_beam/options/pipeline_options_context.py36CODE
LOWsdks/python/apache_beam/coders/fast_coders_test.py25CODE
LOWsdks/python/apache_beam/coders/fast_coders_test.py37CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py25CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py36CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py43CODE
LOWsdks/python/apache_beam/coders/coder_impl.py47CODE
LOWsdks/python/apache_beam/coders/coder_impl.py49CODE
LOWsdks/python/apache_beam/coders/coder_impl.py50CODE
LOWsdks/python/apache_beam/coders/coder_impl.py51CODE
LOWsdks/python/apache_beam/coders/coder_impl.py53CODE
LOWsdks/python/apache_beam/coders/coder_impl.py79CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1891CODE
LOWsdks/python/apache_beam/coders/__init__.py17CODE
LOWsdks/python/apache_beam/coders/__init__.py18CODE
LOWsdks/python/apache_beam/coders/__init__.py19CODE
LOWsdks/python/apache_beam/coders/coders.py49CODE
LOWsdks/python/apache_beam/coders/coders.py68CODE
372 more matches not shown…
Decorative Section Separators81 hits · 273 pts
SeverityFileLineSnippetContext
MEDIUMsdks/python/apache_beam/coders/coders.py212 # ===========================================================================COMMENT
MEDIUMsdks/python/apache_beam/coders/coders.py215 # ===========================================================================COMMENT
MEDIUM⚡sdks/python/apache_beam/io/unbounded_source_test.py280# ------------------------------------------------------------------------------COMMENT
MEDIUM⚡sdks/python/apache_beam/io/unbounded_source_test.py282# ------------------------------------------------------------------------------COMMENT
MEDIUM⚡sdks/python/apache_beam/io/unbounded_source_test.py856# ------------------------------------------------------------------------------COMMENT
MEDIUM⚡sdks/python/apache_beam/io/unbounded_source_test.py859# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py144# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py146# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py275# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py278# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py1010# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py1012# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py107# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py109# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py261# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py263# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py298# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py300# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py406# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py408# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py613# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/watch.py615# ------------------------------------------------------------------------------COMMENT
MEDIUM⚡sdks/python/apache_beam/io/watch.py773# ------------------------------------------------------------------------------COMMENT
MEDIUM⚡sdks/python/apache_beam/io/watch.py775# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_tools.py379# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery.py651# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py102# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py109# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py667# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py669# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py908# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py910# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py1118# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_compat.py1120# -----------------------------------------------------------------------------COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py387# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py389# =============================================================================COMMENT
MEDIUM⚡…s/python/apache_beam/io/gcp/bigquery_change_history.py681# =============================================================================COMMENT
MEDIUM⚡…s/python/apache_beam/io/gcp/bigquery_change_history.py683# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1057# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1059# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1122# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1124# =============================================================================COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py772# -------------------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py808# ------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py814# -----------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py924# -------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py1239# ------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py1322# ---------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py76# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py78# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py222# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py224# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py235# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py237# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py314# ---------------------------------------------------------------------------COMMENT
MEDIUM⚡…he_beam/testing/benchmarks/sort_and_batch_benchmark.py316# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py154# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py156# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py283# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py285# ---------------------------------------------------------------------------COMMENT
21 more matches not shown…
AI Slop Vocabulary75 hits · 188 pts
SeverityFileLineSnippetContext
MEDIUMsdks/go/test/run_validatesrunner_tests.sh53# a staged SDK harness container. Note for Dataflow: Using this flagCOMMENT
MEDIUMsdks/go/examples/large_wordcount/large_wordcount.go310// A more robust implementation would write to the pipeline's temporary folder instead,COMMENT
MEDIUMsdks/go/examples/large_wordcount/large_wordcount.go368// A more robust implementation would move from the pipeline's temporary folder toCOMMENT
MEDIUMsdks/go/pkg/beam/io/natsio/write.go56// ProducerMessage to utilize JetStream's support for deduplication of messages.COMMENT
MEDIUM…g/beam/runners/prism/internal/engine/elementmanager.go199// Essentially, it needs to track the current watermarks for each PCollectionCOMMENT
LOWsdks/python/apache_beam/metrics/monitoring_infos.py471 # If it is not a user counter, just use the first part of the URN, i.e. 'beam'COMMENT
MEDIUMsdks/python/apache_beam/metrics/metrics_flag_test.py94 # do not change the flags the harness was started with.COMMENT
MEDIUM⚡sdks/python/apache_beam/metrics/metrics_flag_test.py190 # unpickled on the worker, where the harness sets the flags.COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py4290 # By default do_apply will just call pandas apply()COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py4926 # Boolean indexer, just pass it in as-isCOMMENT
LOWsdks/python/apache_beam/io/filebasedsource_test.py657 # Should simply return stop_offset - start_offsetCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py911 # Temp dataset was provided by the user so we can just return.COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1148 # Temp dataset was provided by the user so we can just return.COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1361 # server-side liquid sharding. A split will simply return the current sourceCOMMENT
MEDIUM…che_beam/io/gcp/healthcare/dicomio_integration_test.py156 # Both refine and comprehensive search will be tested.COMMENT
MEDIUM⚡sdks/python/apache_beam/internal/cloudpickle_pickler.py112 # Unwrap typing.TypeAliasType to its underlying value for robust pickling.COMMENT
MEDIUM…n/apache_beam/testing/analyzers/perf_analysis_utils.py315 # MAD (Median Absolute Deviation) is a robust measure of variability.STRING
MEDIUM…n/apache_beam/testing/analyzers/perf_analysis_utils.py325 # significant, making the detection more robust to noise and outliers.STRING
LOWsdks/python/apache_beam/transforms/window.py190 # By default, just return the input timestamp.COMMENT
MEDIUMsdks/python/apache_beam/transforms/combiners.py344 # Essentially, given s map bundles, we are trading about O(sn) compares inCOMMENT
LOWsdks/python/apache_beam/transforms/core.py4222 # No field data - just use default Union.COMMENT
LOWsdks/python/apache_beam/transforms/stats_test.py512 # sum (297.5). If we just use key=sum, tie-breaking is sensitive to bundle mergingCOMMENT
LOWsdks/python/apache_beam/transforms/external.py1197 # For anything other than 'JavaJarExpansionService' we just use theCOMMENT
LOWsdks/python/apache_beam/transforms/trigger.py1237 # Here we also just pass through all the values exactly once.COMMENT
MEDIUMsdks/python/apache_beam/ml/anomaly/transforms.py594 # Add a temporary unique key per data point to facilitate grouping theCOMMENT
MEDIUM⚡sdks/python/apache_beam/ml/transforms/tft_test.py438 # Front-padded to facilitate lexicographic sorting.COMMENT
MEDIUM⚡sdks/python/apache_beam/ml/transforms/tft_test.py448 dtype=np.int64) # Front-padded to facilitate lexicographicCODE
MEDIUMsdks/python/apache_beam/ml/transforms/tft_test.py410 i, # Front-padded to facilitate lexicographic sorting.CODE
MEDIUM⚡sdks/python/apache_beam/ml/inference/base_test.py1870 # harness evicts an idle bundle processor.COMMENT
MEDIUMsdks/python/apache_beam/ml/inference/base_test.py1251 # applying GroupByKey to utilize windowing according toCOMMENT
MEDIUMsdks/python/apache_beam/ml/inference/base_test.py1534 # applying GroupByKey to utilize windowing according toCOMMENT
MEDIUM…che_beam/ml/inference/vertex_ai_model_monitoring_v2.py218 # multiple streaming pipelines utilize the same model and write to theCOMMENT
LOWsdks/python/apache_beam/examples/snippets/snippets.py1372 # simply use beam.combiners.Count.PerElement here.COMMENT
LOW…xamples/snippets/transforms/elementwise/map_context.py51 # Here we just create a (shared) random value, but in practice oneCOMMENT
MEDIUMsdks/python/apache_beam/portability/python_urns.py60# Instantiate SDK harness via a command line provided in the payload.COMMENT
MEDIUMsdks/python/apache_beam/portability/python_urns.py62# starts up the SDK harness directly, rather than the bootstrappingCOMMENT
LOWsdks/python/apache_beam/yaml/yaml_ml.py637 # If we can't get a schema, just return the result.COMMENT
LOWsdks/python/apache_beam/runners/common.py861 # or if the process accesses the window parameter. We can just call it onceCOMMENT
MEDIUM…python/apache_beam/runners/dataflow/dataflow_runner.py546 # comprehensive.COMMENT
MEDIUM…hon/apache_beam/runners/dataflow/internal/apiclient.py288 # Don't pass impersonate_service_account through to the harness.COMMENT
MEDIUM…hon/apache_beam/runners/dataflow/internal/apiclient.py854 # Stage other resources for the SDK harnessCOMMENT
MEDIUM…/python/apache_beam/runners/dataflow/internal/names.py36# requires changes to SDK harness container or SDK harness launcher.COMMENT
LOWsdks/python/apache_beam/runners/dask/dask_runner.py145 # not actually need to use the results here, so we just pass. to gather,COMMENT
LOW…apache_beam/runners/interactive/pipeline_instrument.py603 # To put the cached value into the correct window, simply return aCOMMENT
MEDIUM…ks/python/apache_beam/runners/interactive/sql/utils.py222 """Displays actionable widgets to utilize the options, run pipelines andSTRING
LOW…pache_beam/runners/portability/abstract_job_service.py107 # For now, just use the preparation id as the job id.COMMENT
MEDIUM…pache_beam/runners/portability/portable_runner_test.py56 # Controls job service interaction, not sdk harness interaction.COMMENT
MEDIUM…n/apache_beam/runners/portability/prism_runner_test.py548 # Verify the fix: StopWorker successfully tells the thread harness to shut down,COMMENT
MEDIUM…pache_beam/runners/portability/kafka_streams_runner.py69 # The job server runs on this machine, so the SDK harness can too, whichCOMMENT
MEDIUM…s/python/apache_beam/runners/portability/job_server.py126 # isEnabledFor check, allowing the filter to dynamically elevate logCOMMENT
MEDIUM…/python/apache_beam/runners/worker/bundle_processor.py1194 # Out of caution, terminate the SDK harness process.COMMENT
MEDIUM…/python/apache_beam/runners/worker/bundle_processor.py1708 # The Dataflow runner harness strips the base64 encoding.COMMENT
MEDIUM…s/python/apache_beam/runners/worker/opcounters_test.py206 # The seed is arbitrary and exists just to ensure this test is robust.COMMENT
LOWsdks/python/apache_beam/runners/worker/sideinputs.py114 # If any reader has errored, just return.COMMENT
LOWsdks/python/apache_beam/runners/worker/sideinputs.py130 # If any reader has errored, just return.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/worker_status.py46# This SDK harness will (by default), log a "lull" in processing if it sees noCOMMENT
MEDIUM…/python/apache_beam/runners/worker/worker_pool_main.py195 # unblocking the harness request stream.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/operations.py444 # These are overwritten in the legacy harness.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/sdk_worker.py170 # Unrecoverable SDK harness initialization error (if any)COMMENT
LOWsdks/python/apache_beam/typehints/schemas.py720 # if the named tuple's schema is in registry, we just use it instead ofCOMMENT
15 more matches not shown…
Structural Annotation Overuse82 hits · 158 pts
SeverityFileLineSnippetContext
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go112 // Step 1: Initialise BeamCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go128 // Step 3: Read input text fileCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go133 // Step 4: split lens into wordsCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go141 // Step 5: Count words occurencesCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go148 // Step 6: Format resultsCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go154 // Step 7: Write output to fileCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go160 // Step 8: Execute pipelineCOMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py522 # Step 1: Insert initial data that doesn't exist.COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py571 # Step 2: Update existing data (same IDs, different content).COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py613 # Step 3: Repeat the same update operation 3 more times (idempotence test).COMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml21 # Step 1: Creating rows to be written to SpannerCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml34 # Step 2: Writing the created rows to a Spanner databaseCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml49 # Step 3: Writing the failed records to a JSON fileCOMMENT
LOW⚡…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml23 # Step 1: Creating a collection of elements that needsCOMMENT
LOW⚡…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml33 # Step 2: Enriching the data with BigtableCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml46 # Step 3: Logging for testingCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml21 # Step 1: Read orders details from SpannerCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml30 # Step 2: Enrich order details with customers details from BigQueryCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml43 # Step 3: Map enriched values to Beam schemaCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml70 # Step 4: Filter orders with amount greater than 110COMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml79 # Step 6: Write processed order to another spanner tableCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml92 # Step 7: Handle write errors by writing to JSONCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml23 # Step 1: Reading data from IcebergCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml38 # Step 2: Write records out to AlloyDBCOMMENT
LOW⚡…/examples/transforms/blueprint/oracle_to_bigquery.yaml25 # Step 1: Reading data from OracleCOMMENT
LOW⚡…/examples/transforms/blueprint/oracle_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml25 # Step 1: Reading data from GCSCOMMENT
LOW⚡…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml30 # Step 2: Write records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml24 # Step 1: Reading data from KafkaCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml38 # Step 2: Convert Kafka recordsCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml50 # Step 3: Write records out to IcebergCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml24 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml35 # Step 2: Write records out to IcebergCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub subscriptionCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW⚡…aml/examples/transforms/blueprint/spanner_to_avro.yaml25 # Step 1: Reading shipment data from Spanner DBCOMMENT
LOW⚡…aml/examples/transforms/blueprint/spanner_to_avro.yaml33 # Step 2: Write successful records out to GCS avro filesCOMMENT
LOW⚡…xamples/transforms/blueprint/cloudsql_to_bigquery.yaml24 # Step 1: Reading data from Cloud SQL PostgresCOMMENT
LOW⚡…xamples/transforms/blueprint/cloudsql_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW⚡…xamples/transforms/blueprint/postgres_to_bigquery.yaml24 # Step 1: Reading data from PostgresCOMMENT
LOW⚡…xamples/transforms/blueprint/postgres_to_bigquery.yaml31 # Step 2: Write records out to BigQueryCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml42 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…amples/transforms/blueprint/sqlserver_to_bigquery.yaml25 # Step 1: Reading data from SqlServerCOMMENT
LOW⚡…amples/transforms/blueprint/sqlserver_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…examples/transforms/blueprint/spanner_to_bigquery.yaml25 # Step 1: Reading data from SpannerCOMMENT
LOW⚡…examples/transforms/blueprint/spanner_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW⚡…l/examples/transforms/blueprint/mysql_to_bigquery.yaml25 # Step 1: Reading data from MySqlCOMMENT
LOW⚡…l/examples/transforms/blueprint/mysql_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml25 # Step 1: Reading shipment data from jdbc DBCOMMENT
LOW⚡…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml32 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java98 // Step 1: Find the effective location of the query.COMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java122 // Step 2: Create a temporary dataset in the query location only if the user has not specifiedCOMMENT
22 more matches not shown…
Verbosity Indicators81 hits · 154 pts
SeverityFileLineSnippetContext
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go112 // Step 1: Initialise BeamCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go116 // Step 2:COMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go128 // Step 3: Read input text fileCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go133 // Step 4: split lens into wordsCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go141 // Step 5: Count words occurencesCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go148 // Step 6: Format resultsCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go154 // Step 7: Write output to fileCOMMENT
LOW⚡sdks/go/examples/minimal_wordcount/minimal_wordcount.go160 // Step 8: Execute pipelineCOMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py522 # Step 1: Insert initial data that doesn't exist.COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py571 # Step 2: Update existing data (same IDs, different content).COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py613 # Step 3: Repeat the same update operation 3 more times (idempotence test).COMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml21 # Step 1: Creating rows to be written to SpannerCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml34 # Step 2: Writing the created rows to a Spanner databaseCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml49 # Step 3: Writing the failed records to a JSON fileCOMMENT
LOW⚡…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml23 # Step 1: Creating a collection of elements that needsCOMMENT
LOW⚡…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml33 # Step 2: Enriching the data with BigtableCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml46 # Step 3: Logging for testingCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml21 # Step 1: Read orders details from SpannerCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml30 # Step 2: Enrich order details with customers details from BigQueryCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml43 # Step 3: Map enriched values to Beam schemaCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml70 # Step 4: Filter orders with amount greater than 110COMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml79 # Step 6: Write processed order to another spanner tableCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml92 # Step 7: Handle write errors by writing to JSONCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml23 # Step 1: Reading data from IcebergCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml38 # Step 2: Write records out to AlloyDBCOMMENT
LOW⚡…/examples/transforms/blueprint/oracle_to_bigquery.yaml25 # Step 1: Reading data from OracleCOMMENT
LOW⚡…/examples/transforms/blueprint/oracle_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml25 # Step 1: Reading data from GCSCOMMENT
LOW⚡…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml30 # Step 2: Write records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml24 # Step 1: Reading data from KafkaCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml38 # Step 2: Convert Kafka recordsCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml50 # Step 3: Write records out to IcebergCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml24 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml35 # Step 2: Write records out to IcebergCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub subscriptionCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW⚡…aml/examples/transforms/blueprint/spanner_to_avro.yaml25 # Step 1: Reading shipment data from Spanner DBCOMMENT
LOW⚡…aml/examples/transforms/blueprint/spanner_to_avro.yaml33 # Step 2: Write successful records out to GCS avro filesCOMMENT
LOW⚡…xamples/transforms/blueprint/cloudsql_to_bigquery.yaml24 # Step 1: Reading data from Cloud SQL PostgresCOMMENT
LOW⚡…xamples/transforms/blueprint/cloudsql_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW⚡…xamples/transforms/blueprint/postgres_to_bigquery.yaml24 # Step 1: Reading data from PostgresCOMMENT
LOW⚡…xamples/transforms/blueprint/postgres_to_bigquery.yaml31 # Step 2: Write records out to BigQueryCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml42 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…amples/transforms/blueprint/sqlserver_to_bigquery.yaml25 # Step 1: Reading data from SqlServerCOMMENT
LOW⚡…amples/transforms/blueprint/sqlserver_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…examples/transforms/blueprint/spanner_to_bigquery.yaml25 # Step 1: Reading data from SpannerCOMMENT
LOW⚡…examples/transforms/blueprint/spanner_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW⚡…l/examples/transforms/blueprint/mysql_to_bigquery.yaml25 # Step 1: Reading data from MySqlCOMMENT
LOW⚡…l/examples/transforms/blueprint/mysql_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW⚡…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml25 # Step 1: Reading shipment data from jdbc DBCOMMENT
LOW⚡…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml32 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…o/gcp/bigtable/changestreams/dao/MetadataTableDao.java734 // If the lock is already held we need to check if it was acquired by a duplicateCOMMENT
21 more matches not shown…
Modern Structural Boilerplate137 hits · 140 pts
SeverityFileLineSnippetContext
LOWinfra/keys/secret_manager.py269 def update_secret_access(self, secret_id: str, allowed_users: List[str]) -> None:CODE
LOWinfra/enforcement/sending.py191 def update_issue_body(self, issue_number: int, new_body: str) -> None:CODE
LOWsdks/python/apache_beam/pipeline.py113__all__ = ['Pipeline', 'transform_annotations']CODE
LOWsdks/python/apache_beam/pvalue.py56__all__ = [CODE
LOWsdks/python/apache_beam/metrics/metrics_flag.py34__all__ = ['MetricsFlag']CODE
LOWsdks/python/apache_beam/metrics/metrics_flag.py62 def set_default_pipeline_options(cls, options: 'PipelineOptions') -> None:CODE
LOWsdks/python/apache_beam/metrics/metricbase.py39__all__ = [CODE
LOWsdks/python/apache_beam/metrics/metric.py56__all__ = ['Metrics', 'MetricsFilter', 'Lineage']CODE
LOWsdks/python/apache_beam/metrics/cells.py49__all__ = [CODE
LOWsdks/python/apache_beam/options/pipeline_options.py41__all__ = [CODE
LOWsdks/python/apache_beam/options/value_provider.py31__all__ = [CODE
LOWsdks/python/apache_beam/coders/avro_record.py22__all__ = ['AvroRecord']CODE
LOWsdks/python/apache_beam/coders/row_coder.py48__all__ = ["RowCoder"]CODE
LOWsdks/python/apache_beam/coders/coders.py86__all__ = [CODE
LOWsdks/python/apache_beam/coders/typecoders.py75__all__ = ['registry']CODE
LOWsdks/python/apache_beam/dataframe/transforms.py35__all__ = [CODE
LOWsdks/python/apache_beam/dataframe/frames.py58__all__ = [CODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py43__all__ = ['HadoopFileSystem']CODE
LOWsdks/python/apache_beam/io/filesystems.py99__all__ = ['FileSystems']CODE
LOWsdks/python/apache_beam/io/concat_source_test.py33__all__ = ['RangeSource']CODE
LOWsdks/python/apache_beam/io/filesystemio.py26__all__ = [CODE
LOWsdks/python/apache_beam/io/filebasedsource.py54__all__ = ['FileBasedSource']CODE
LOWsdks/python/apache_beam/io/textio.py45__all__ = [CODE
LOWsdks/python/apache_beam/io/filesystem.py45logger = logging.getLogger(__name__)CODE
LOWsdks/python/apache_beam/io/filesystem.py49__all__ = [CODE
LOWsdks/python/apache_beam/io/kinesis.py93__all__ = [CODE
LOWsdks/python/apache_beam/io/filebasedsink.py43__all__ = ['FileBasedSink']CODE
LOWsdks/python/apache_beam/io/unbounded_source.py118__all__ = [CODE
LOWsdks/python/apache_beam/io/jdbc.py104__all__ = [CODE
LOWsdks/python/apache_beam/io/range_trackers.py30__all__ = [CODE
LOWsdks/python/apache_beam/io/mongodbio.py112__all__ = ["ReadFromMongoDB", "WriteToMongoDB"]CODE
LOWsdks/python/apache_beam/io/avroio.py67__all__ = [CODE
LOWsdks/python/apache_beam/io/source_test_utils.py57__all__ = [CODE
LOWsdks/python/apache_beam/io/requestresponse.py65__all__ = [CODE
LOWsdks/python/apache_beam/io/snowflake.py87__all__ = [CODE
LOWsdks/python/apache_beam/io/tfrecordio.py41__all__ = ['ReadFromTFRecord', 'ReadAllFromTFRecord', 'WriteToTFRecord']CODE
LOWsdks/python/apache_beam/io/watch.py92__all__ = [CODE
LOW⚡sdks/python/apache_beam/io/watch.py766def _set_watermark_if_greater(watermark_estimator, new_watermark) -> None:CODE
LOWsdks/python/apache_beam/io/localfilesystem.py33__all__ = ['LocalFileSystem']CODE
LOWsdks/python/apache_beam/io/debezium.py92__all__ = ['ReadFromDebezium', 'DriverClassName']CODE
LOWsdks/python/apache_beam/io/iobase.py66__all__ = [CODE
LOWsdks/python/apache_beam/io/parquetio.py70__all__ = [CODE
LOWsdks/python/apache_beam/io/fileio.py127__all__ = [CODE
LOW…s/python/apache_beam/io/azure/blobstoragefilesystem.py30__all__ = ['BlobStorageFileSystem']CODE
LOWsdks/python/apache_beam/io/gcp/gcsio_retry.py39__all__ = ['DEFAULT_RETRY_WITH_THROTTLING_COUNTER']CODE
LOWsdks/python/apache_beam/io/gcp/gcsfilesystem.py39__all__ = ['GCSFileSystem']CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py447__all__ = [CODE
LOWsdks/python/apache_beam/io/gcp/bigtableio.py71__all__ = ['WriteToBigTable', 'ReadFromBigtable']CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py93__all__ = [CODE
LOWsdks/python/apache_beam/io/gcp/pubsub.py59__all__ = [CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py83__all__ = ['ReadBigQueryChangeHistory']CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py262 def set_watermark(self, timestamp: Timestamp) -> None:CODE
LOWsdks/python/apache_beam/io/gcp/gcsio.py65__all__ = ['GcsIO', 'create_storage_client']CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py221__all__ = [CODE
LOW…ks/python/apache_beam/io/gcp/tests/bigquery_matcher.py34__all__ = ['BigqueryMatcher', 'BigQueryTableMatcher']CODE
LOWsdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py30__all__ = ['PubSubMessageMatcher']CODE
LOW…n/apache_beam/io/gcp/datastore/v1new/query_splitter.py28__all__ = ['QuerySplitterError', 'SplitNotPossibleError', 'get_splits']CODE
LOWsdks/python/apache_beam/io/gcp/datastore/v1new/types.py35__all__ = ['Query', 'Key', 'Entity']CODE
LOW…thon/apache_beam/io/gcp/datastore/v1new/datastoreio.py61__all__ = ['ReadFromDatastore', 'WriteToDatastore', 'DeleteFromDatastore']CODE
LOWsdks/python/apache_beam/io/aws/s3filesystem.py30__all__ = ['S3FileSystem']CODE
77 more matches not shown…
Redundant / Tautological Comments86 hits · 132 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py140 # Check if the policy is already configuredSTRING
LOWinfra/keys/service_account.py298 # Check if service account exists and get its stateCOMMENT
LOWsdks/go/run_with_go_version.sh74# Check if we've already prepared the Go command. If so, then we don't need toCOMMENT
LOWsdks/go/test/run_validatesrunner_tests.sh357 # Check if Docker daemon is runningCOMMENT
LOW⚡sdks/python/apache_beam/pipeline_test.py658 # Check if inp type hint is Any that we can still inferCOMMENT
LOWsdks/python/apache_beam/pvalue.py296 # Check if we accessed this tag before.COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py1026 # Set dtype to object if more than one valueCOMMENT
LOWsdks/python/apache_beam/dataframe/frames.py3911 # Set dtype to object if more than one valueCOMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py499 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py514 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py529 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py548 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py567 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/filesystem_test.py230 # Check if limits are followed correctlyCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py934 # Check if dataset already exists otherwise create itCOMMENT
LOWsdks/python/apache_beam/io/gcp/gcsio_test.py96 # Assign responses to the mock instance itselfCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1684 # Check if individual row exceeds size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1753 # Check if individual row exceeds size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1766 # Check if adding this row would exceed batch size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery_compat.py387# Check if an underlying type is available because the internal client silentlyCOMMENT
LOW⚡sdks/python/apache_beam/io/gcp/pubsub.py595 # Check if using DirectRunnerCOMMENT
LOW⚡sdks/python/apache_beam/io/gcp/pubsub.py601 # Check if it's a DirectRunner variantCOMMENT
LOW⚡sdks/python/apache_beam/io/gcp/pubsub.py610 # Check if in batch mode (not streaming)COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py431 # Check if destination table existsCOMMENT
LOW…s/python/apache_beam/io/gcp/pubsub_integration_test.py176 # Set on_success_matcher to verify pipeline state and pubsub output. TheseCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py218 # Check if all required keys present.COMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py228 # Check if return type is correct.COMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py242 # Check if the element is validCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py370 # Check if the required keys present andCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py540 # Read the file based on different input. If the read fails ,returnCOMMENT
LOWsdks/python/apache_beam/internal/code_object_pickler.py293 # Check if there are any lambdas with the same signature.COMMENT
LOW…/python/apache_beam/testing/analyzers/perf_analysis.py291 # Set this to true while running in production.COMMENT
LOW…ache_beam/testing/analyzers/load_test_perf_analysis.py97 # Set this to true while running in production.STRING
LOWsdks/python/apache_beam/transforms/util.py740 # Check if we should replay a previous batch size due to it not beingCOMMENT
LOWsdks/python/apache_beam/transforms/util.py1204 # Check if adding this element would exceed limitsCOMMENT
LOWsdks/python/apache_beam/transforms/core.py842 # Check if this DoFn's process method has been overriddenCOMMENT
LOWsdks/python/apache_beam/transforms/core.py851 # Check if this DoFn's process_batch method has been overriddenCOMMENT
LOWsdks/python/apache_beam/transforms/util_test.py269 # Check if we're looking at the actual elements being encoded/decodedCOMMENT
LOW⚡sdks/python/apache_beam/transforms/external.py544 # Set it to an empty placeholder type.COMMENT
LOW…thon/apache_beam/ml/inference/huggingface_inference.py669 # Check if the device is specified twice. If true then the device parameterCOMMENT
LOW…les/snippets/transforms/elementwise/enrichment_test.py359 # Check if the test used a container-based external SQL database.COMMENT
LOW⚡sdks/python/apache_beam/yaml/yaml_transform.py805 # Check if any transform has a NON-EMPTY explicit input or output.COMMENT
LOWsdks/python/apache_beam/yaml/yaml_transform.py839 # Check if output is empty, not just present (normalization sets it to {})COMMENT
LOW…s/python/apache_beam/yaml/yaml_transform_scope_test.py108 # Check if target_annotations is a subset of result_annotationsSTRING
LOWsdks/python/apache_beam/yaml/yaml_provider.py938 # Check if elements have different keysCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml19 # Assign timestamp to beam row elementCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml52 # Assign timestamp to beam row element with error_handlingCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml86# Assign timestamp to beam row element with error handling and output schemaCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml129# Assign timestamp to beam row element with error handling and output schemaCOMMENT
LOW…l/sentiment_analysis/streaming_sentiment_analysis.yaml230 # Assign windows to each element of the unbounded PCollection.COMMENT
LOW…sforms/ml/taxi_fare/streaming_taxifare_prediction.yaml68 # Assign windows to each element of the unbounded PCollection.COMMENT
LOW…n/apache_beam/runners/dataflow/ptransform_overrides.py39 # Check if this ParDo uses _PubSubWriteDoFnCOMMENT
LOW…he_beam/runners/interactive/interactive_environment.py182 # Check if [interactive] dependencies are installed.COMMENT
LOW…he_beam/runners/interactive/interactive_environment.py368 # Check if the pipeline is already tracked as a user pipeline before cleanup.COMMENT
LOW…apache_beam/runners/interactive/pipeline_instrument.py63 # Check if the user defined pipeline contains any source to cache.COMMENT
LOW…he_beam/runners/interactive/caching/read_cache_test.py80 # Check if the actual_pipeline uses cache as input of theCOMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py110 # Open the file for 'append-mode' and writing 'bytes'.COMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py186 # Check if we are at EOF or if we have an incomplete line.COMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py514 # Loop through the elements with the correct timestamp.COMMENT
LOW…e_beam/runners/interactive/caching/write_cache_test.py66 # Check if the actual_pipeline uses pcoll as an input of a write transform.COMMENT
26 more matches not shown…
AI Structural Patterns143 hits · 128 pts
SeverityFileLineSnippetContext
LOWsdks/python/apache_beam/coders/coder_impl.py2174CODE
LOWsdks/python/apache_beam/dataframe/doctests.py631CODE
LOWsdks/python/apache_beam/dataframe/frames.py3932CODE
LOWsdks/python/apache_beam/io/textio.py559CODE
LOWsdks/python/apache_beam/io/textio.py439CODE
LOWsdks/python/apache_beam/io/textio.py606CODE
LOWsdks/python/apache_beam/io/textio.py758CODE
LOWsdks/python/apache_beam/io/textio.py837CODE
LOWsdks/python/apache_beam/io/kinesis.py132CODE
LOWsdks/python/apache_beam/io/kinesis.py227CODE
LOWsdks/python/apache_beam/io/filebasedsink.py65CODE
LOWsdks/python/apache_beam/io/jdbc.py189CODE
LOWsdks/python/apache_beam/io/jdbc.py335CODE
LOWsdks/python/apache_beam/io/avroio.py366CODE
LOWsdks/python/apache_beam/io/source_test_utils.py404CODE
LOWsdks/python/apache_beam/io/snowflake.py128CODE
LOWsdks/python/apache_beam/io/snowflake.py268CODE
LOWsdks/python/apache_beam/io/kafka.py158CODE
LOWsdks/python/apache_beam/io/parquetio.py488CODE
LOWsdks/python/apache_beam/io/parquetio.py651CODE
LOWsdks/python/apache_beam/io/fileio.py390CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_json_it_test.py479CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py609CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py799CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py893CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py1138CODE
LOWsdks/python/apache_beam/io/gcp/gcsio_test.py196CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py656CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py703CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py1032CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py1487CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py2045CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py2739CODE
LOW…ks/python/apache_beam/io/gcp/bigquery_read_internal.py192CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py198CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py408CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py464CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py520CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py576CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py632CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_compat.py206CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py669CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py709CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py956CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py1185CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py679CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py886CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py941CODE
LOW…che_beam/io/gcp/healthcare/dicomio_integration_test.py85CODE
LOWsdks/python/apache_beam/io/gcp/tests/utils_test.py233CODE
LOWsdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py52CODE
LOW…io/gcp/internal/clients/bigquery/bigquery_v2_client.py44CODE
LOWsdks/python/apache_beam/io/gcp/datastore/v1new/types.py39CODE
LOW…s/python/apache_beam/io/aws/clients/s3/boto3_client.py201CODE
LOWsdks/python/apache_beam/utils/retry.py234CODE
LOW…s/python/apache_beam/testing/metric_result_matchers.py65CODE
LOWsdks/python/apache_beam/testing/synthetic_pipeline.py255CODE
LOWsdks/python/apache_beam/testing/test_pipeline.py67CODE
LOW…e_beam/testing/benchmarks/chicago_taxi/process_tfma.py33CODE
LOWsdks/python/apache_beam/transforms/ptransform.py1045CODE
83 more matches not shown…
AI Response Leakage12 hits · 85 pts
SeverityFileLineSnippetContext
HIGH…apache_beam/examples/cookbook/multiple_output_pardo.py57# of the basic wordcount example. In this example wordsCOMMENT
HIGH…rence/pytorch_image_classification_with_side_inputs.py176 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…am/examples/inference/tensorflow_mnist_with_weights.py61 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…/examples/inference/tensorflow_mnist_classification.py94 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…eam/examples/inference/pytorch_image_classification.py135 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…examples/inference/tensorflow_imagenet_segmentation.py101 # In this example we will use the TensorflowHub model URL.COMMENT
HIGH…eam/examples/inference/sklearn_mnist_classification.py106 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…ing-content/core-transforms/side-inputs/description.md117# of the actual elements of pcoll being passed into each process invocation. In this example, side inputs areCOMMENT
HIGH…www/site/content/en/documentation/programming-guide.md2467# of the actual elements of pcoll being passed into each process invocation. In this example, side inputs areCOMMENT
HIGH…ontent/en/documentation/ml/multi-language-inference.md64The preprocessed data is then used to make inference. This is done in the [`RunInference`](https://beam.apache.org/documCODE
HIGH…e/www/site/content/en/blog/apache-hop-with-dataflow.md371Also, depending on your network configuration, you may want to check the box of "Use Public IPs?", or alternatively leavCODE
HIGH…e/www/site/content/en/get-started/wordcount-example.md525# In this example, the DoFns are defined as classes:COMMENT
Fake / Example Data52 hits · 50 pts
SeverityFileLineSnippetContext
LOWinfra/enforcement/iam.py401 github_token = config["github_token"] or "dummy-token"STRING
LOW⚡infra/enforcement/iam.py435 recipient = config["recipient"] or "admin@example.com"STRING
LOW⚡infra/enforcement/iam.py439 recipient = config["recipient"] or "admin@example.com"STRING
LOW⚡infra/enforcement/test_sending.py29 github_token="dummy-token",CODE
LOW⚡infra/enforcement/account_keys.py605 recipient = config["recipient"] or "admin@example.com"STRING
LOW⚡infra/enforcement/account_keys.py609 recipient = config["recipient"] or "admin@example.com"STRING
LOWinfra/enforcement/account_keys.py571 github_token = config["github_token"] or "dummy-token"STRING
LOW…s/go/test/integration/io/bigqueryio/bigqueryio_test.go56 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…s/go/test/integration/io/bigqueryio/bigqueryio_test.go56 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…go/test/integration/io/xlang/bigquery/bigquery_test.go55 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…go/test/integration/io/xlang/bigquery/bigquery_test.go55 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOWsdks/python/apache_beam/dataframe/expressions.py265 super().__init__('placeholder', proxy)CODE
LOW…/gcp/internal/clients/bigquery/bigquery_v2_messages.py702 "userByEmail": "user@example.com", } ] } Please referCODE
LOW…on/apache_beam/testing/analyzers/perf_analysis_test.py273 os.environ['GITHUB_TOKEN'] = 'fake_token'CODE
LOWsdks/python/apache_beam/transforms/external_test.py508 identifier='dummy_id',STRING
LOWsdks/python/apache_beam/transforms/external_test.py516 self.assertEqual('dummy_id', payload_from_bytes.identifier)STRING
LOW…n/apache_beam/ml/inference/anthropic_inference_test.py315 api_key='fake-key',CODE
LOW…n/apache_beam/ml/inference/anthropic_inference_test.py334 api_key='fake-key',CODE
LOW…thon/apache_beam/ml/inference/openai_inference_test.py571 api_key='fake-key',CODE
LOW…thon/apache_beam/ml/inference/openai_inference_test.py589 api_key='fake-key',CODE
LOW…thon/apache_beam/ml/inference/openai_inference_test.py608 api_key='fake-key',CODE
LOW…/python/apache_beam/examples/snippets/snippets_test.py647 self._dummy_token = 'dummy_token'CODE
LOW…beam/runners/portability/sdk_container_builder_test.py148 mock_build_response.metadata.build.id = 'dummy-id'CODE
LOW…/src/test/resources/test_expansion_service_config.yaml24 "dummy_id":CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java135 return "dummy_id";CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java385 .setSpec(createSpec("dummy_id", configRow))CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java427 .setSpec(createSpec("dummy_id", configRow))CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java518 RunnerApi.FunctionSpec spec = createSpec("dummy_id", configRow);CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java528 RunnerApi.FunctionSpec equivalentSpec = createSpec("dummy_id", equivalentConfigRow);CODE
LOW…ions/euphoria/core/docs/DocumentationExamplesTest.java94 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ",CODE
LOW…ions/euphoria/core/docs/DocumentationExamplesTest.java94 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ",CODE
LOW…ions/sql/meta/provider/kafka/KafkaTableProviderIT.java278 c.output(KV.of("fake_key", c.element()));CODE
LOW…tent/splittable-dofn/splittable/java-example/Task.java53 PCollection<String> input = pipeline.apply(Create.of("Lorem Ipsum is simply dummy text of the printing and typesCODE
LOW⚡…tent/splittable-dofn/splittable/python-example/task.py65 lines = (p | 'Create' >> beam.Create(["Lorem Ipsum is simply dummy text of the printing and typesetting industry. "CODE
LOW⚡…tent/splittable-dofn/splittable/python-example/task.py66 "Lorem Ipsum has been the industry's standard dummy text ever since the "CODE
LOW⚡…tent/splittable-dofn/splittable/python-example/task.py71 "sheets containing Lorem Ipsum passages, and more recently with desktop "CODE
LOW⚡…tent/splittable-dofn/splittable/python-example/task.py72 "publishing software like Aldus PageMaker including versions of Lorem Ipsum."])CODE
LOW…a/org/apache/beam/it/neo4j/Neo4jResourceManagerIT.java45 Neo4jResourceManager.builder("placeholder")CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java44 Entity.newBuilder().set("name", "John Doe").build(),CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java63 "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build()));CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java71 assertThat(person.getString("name")).isEqualTo("John Doe");CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java85 "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build()));CODE
LOWwebsite/CASE_STUDY_TEMPLATE.md34 “Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's CODE
LOWwebsite/CASE_STUDY_TEMPLATE.md59[Lorem Ipsum](https://www.lipsum.com/) is simply dummy text of the printing and typesetting industry. Lorem Ipsum has beCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md65 Lorem Ipsum is simply dummy text of the printing and typesetting industryCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md84Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literatureCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md92Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literatureCODE
LOWwebsite/ADD_CASE_STUDY.md71 text: Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's sCODE
LOWwebsite/www/site/layouts/partials/header.html241 $('input:text').attr('placeholder',"What are you looking for?");CODE
LOW…che/beam/runners/flink/EncodedValueComparatorTest.java57 CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"),CODE
LOW…che/beam/runners/flink/EncodedValueComparatorTest.java56 CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"),CODE
LOW…org/apache/beam/runners/spark/io/AvroPipelineTest.java63 savedRecord.put("name", "John Doe");CODE
Slop Phrases16 hits · 43 pts
SeverityFileLineSnippetContext
MEDIUM…pache_beam/examples/ml_transform/ml_transform_basic.py160 # To fetch the artifacts produced in MLTransform, you can useCOMMENT
LOW⚡…amples/transforms/ml/enrich_spanner_with_bigquery.yaml80 # Note: Make sure to replace $VARS with your values.COMMENT
MEDIUMsdks/python/container/run_generate_requirements.sh46# Note that you can modify the behavior of the pip install command in this script by passing in your own $PIP_EXTRA_OPTICOMMENT
LOW…rc/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java531 * KafkaIO#write()} and method withValueSerializer() make sure to erase the generic types by castingCOMMENT
MEDIUM…ava/io/hadoop-format/src/test/resources/cassandra.yaml57# initial_token allows you to specify tokens manually. While you can use # it withCOMMENT
MEDIUM…ava/io/hadoop-format/src/test/resources/cassandra.yaml592# you may want to adjust max_value_size_in_mb accordingly.COMMENT
LOW…ava/io/hadoop-format/src/test/resources/cassandra.yaml797# Warning: before enabling this property make sure to ntp is installedCOMMENT
MEDIUM…main/java/org/apache/beam/sdk/jpmstests/WordCount.java107 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
LOW…ain/java/org/apache/beam/it/common/TestProperties.java201 * doing so. The method {@link #getCredentialsStream()} will make sure to search for the specificCOMMENT
MEDIUM…/src/main/java/org/apache/beam/examples/WordCount.java173 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…/org/apache/beam/examples/cookbook/TriggerExample.java202 // file. You may want to adjust the window duration otherwise.COMMENT
MEDIUM…main/java/org/apache/beam/examples/kotlin/WordCount.kt144 * Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…apache/beam/examples/kotlin/cookbook/TriggerExample.kt213 // file. You may want to adjust the window duration otherwise.COMMENT
MEDIUM.github/workflows/codeql.yml135 # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize howCOMMENT
MEDIUM…ners/spark/structuredstreaming/examples/WordCount.java99 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…/org/apache/beam/runners/spark/examples/WordCount.java99 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
Overly Generic Function Names30 hits · 36 pts
SeverityFileLineSnippetContext
LOW…m/internal/test_data/module_1_lambda_variable_added.py24def my_function():CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py25 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py32 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py39 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py46 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py53 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py60 def my_method(self):CODE
LOW⚡sdks/python/apache_beam/internal/test_data/module_2.py67 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py79 def my_method(self):CODE
LOW…am/internal/test_data/module_1_local_variable_added.py24def my_function():CODE
LOWsdks/python/apache_beam/internal/test_data/module_3.py23def my_function():CODE
LOW…che_beam/internal/test_data/module_1_function_added.py30def my_function():CODE
LOW…on/apache_beam/internal/test_data/module_3_modified.py24def my_function():CODE
LOW…internal/test_data/module_1_nested_function_2_added.py24def my_function():CODE
LOW…m/internal/test_data/module_1_global_variable_added.py26def my_function():CODE
LOW…m/internal/test_data/module_1_nested_function_added.py24def my_function():CODE
LOW…/internal/test_data/module_1_local_variable_removed.py24def my_function():CODE
LOW…apache_beam/internal/test_data/module_1_class_added.py31def my_function():CODE
LOWsdks/python/apache_beam/internal/test_data/module_1.py24def my_function():CODE
LOW⚡…on/apache_beam/internal/test_data/module_2_modified.py25 def my_method(self):CODE
LOW⚡…on/apache_beam/internal/test_data/module_2_modified.py33 def my_method(self):CODE
LOW⚡…on/apache_beam/internal/test_data/module_2_modified.py39 def my_method(self):CODE
LOW⚡…on/apache_beam/internal/test_data/module_2_modified.py47 def my_method(self):CODE
LOW⚡…on/apache_beam/internal/test_data/module_2_modified.py53 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py64 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py81 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py88 def my_method(self):CODE
LOWsdks/python/apache_beam/transforms/ptransform_test.py1317 def my_function(*args):CODE
LOW…content/io/kafka-io/kafka-write/python-example/task.py32def process_data(element):CODE
LOW…-content/io/kafka-io/kafka-read/python-example/task.py32def process_data(element):CODE
Modern AI Meta-Vocabulary9 hits · 26 pts
SeverityFileLineSnippetContext
MEDIUMsdks/go/pkg/beam/core/runtime/exec/pcollection_test.go123// BenchmarkPCollection_Baseline measures the baseline of the node benchmarking scaffold.COMMENT
MEDIUM…che_beam/ml/transforms/embeddings/vertex_ai_it_test.py43 # Load the Vertex dependencies last so type resolution still pulls in RAGCOMMENT
MEDIUM…python/apache_beam/examples/ml-orchestration/README.md20# Example ML workflow orchestration with Kubeflow Pipelines and Tensorflow ExtendedCOMMENT
MEDIUM…beam/runners/interactive/user_pipeline_tracker_test.py243 # Intercept shutil.rmtree inside clear() to orchestrate the concurrentCOMMENT
MEDIUM…bsite/www/site/content/en/documentation/ml/overview.md44* [Workflow orchestration](#workflow-orchestration)COMMENT
MEDIUM…bsite/www/site/content/en/documentation/ml/overview.md96## Workflow orchestrationCOMMENT
MEDIUM…/www/site/content/en/documentation/ml/orchestration.md18# Workflow orchestrationCOMMENT
MEDIUM…content/en/documentation/ml/large-language-modeling.md174## RAG and Prompt Engineering in BeamCOMMENT
MEDIUMwebsite/www/site/content/en/case-studies/hsbc.md141Apache Beam provides powerful [transforms](/documentation/programming-guide/#transforms) and orchestration capabilities CODE
Example Usage Blocks16 hits · 24 pts
SeverityFileLineSnippetContext
LOWsdks/go/pkg/beam/core/graph/fn.go450// Example usage:COMMENT
LOWsdks/go/pkg/beam/core/graph/fn.go463// Example usage:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/step.go45// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/step.go148// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go54// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go74// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go162// Usage example:COMMENT
LOWsdks/python/apache_beam/io/iobase_it_test.py30# Usage:COMMENT
LOW…he_beam/testing/benchmarks/chicago_taxi/run_chicago.sh23# Example usage:COMMENT
LOW…e_beam/yaml/examples/transforms/io/bigquery_write.yaml27# Usage:COMMENT
LOW…mples/transforms/ml/log_analysis/batch_log_analysis.sh18# Usage:COMMENT
LOW…l/apache_beam_jupyterlab_sidepanel/yaml_parse_utils.py156 # Example usageCOMMENT
LOWsdks/java/build-tools/beam-linkage-check.sh22# Usage:COMMENT
LOW.test-infra/metrics/build_and_publish_containers.sh24# Usage:COMMENT
LOW.test-infra/mock-apis/buf.gen.yaml24# Usage:COMMENT
LOW.test-infra/dataproc/flink_cluster.sh32# Example usage:COMMENT
TODO Padding12 hits · 18 pts
SeverityFileLineSnippetContext
LOW…ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx314 // TODO: implement onChange to update node data from PanelCOMMENT
LOW…e/src/main/java/org/apache/beam/sdk/util/ZipFiles.java82 // TODO: implement size() to try calling entry.getSize()?COMMENT
LOW…/src/main/java/org/apache/beam/sdk/io/cdap/CdapIO.java478 // TODO: implement SparkReceiverIO.<~>write()COMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java180 // TODO: implement logical type date and timestampCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java262 // TODO: implement logical type date and timestampCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java335 // TODO: implement logical date and datetimeCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java372 // TODO: implement logical datetimeCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java387 // TODO: implement logical dateCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java448 // TODO: implement logical dateCOMMENT
LOW…xtensions/sql/meta/provider/FullNameTableProvider.java52 // TODO: implement with trieCOMMENT
LOWlearning/tour-of-beam/backend/auth.go86 // TODO: implement IDToken caching in tb_user to optimize calls to Firebase APICOMMENT
LOW…ker/streaming/sideinput/SideInputStateFetcherTest.java66// TODO: Add tests with different encoded windows to verify version is correctly plumbed.COMMENT
Magic Placeholder Names4 hits · 15 pts
SeverityFileLineSnippetContext
HIGH…ks/python/apache_beam/ml/inference/openai_inference.py36 api_key='your-api-key',STRING
HIGH…python/apache_beam/ml/inference/anthropic_inference.py35 api_key='your-api-key',STRING
HIGH…python/apache_beam/ml/inference/anthropic_inference.py42 api_key='your-api-key',STRING
HIGH…ache/beam/sdk/ml/inference/remote/RemoteInference.java45 * .apiKey("your-api-key")COMMENT
Synthetic Comment Markers1 hit · 8 pts
SeverityFileLineSnippetContext
HIGH…pache_beam/ml/transforms/embeddings/open_ai_it_test.py111 # Check that we get 512-dimensional embeddings as requestedCOMMENT
Cross-Language Confusion (JS/TS)1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH…ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx157print(parse_beam_yaml("""${escapedYaml}""",CODE