Repository Analysis

apache/beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

7.6 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of apache/beam, a Java project with 8,628 GitHub stars. SynthScan v2.0 examined 2,850,097 lines of code across 13816 source files, recording 13528 pattern matches distributed across 27 syntactic categories. The overall adjusted score of 7.6 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

7.6
Adjusted Score
7.6
Raw Score
100%
Time Factor
2026-07-14
Last Push
8.6K
Stars
Java
Language
2.9M
Lines of Code
13.8K
Files
13.5K
Pattern Hits
2026-07-14
Scan Date
0.08
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 518HIGH 521MEDIUM 373LOW 12116

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 13528 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hallucination Indicators518 hits · 5810 pts
SeverityFileLineSnippetContext
CRITICALsdks/go/pkg/beam/io/fhirio/common.go163 operation, err := c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do()CODE
CRITICALsdks/go/pkg/beam/io/fhirio/common.go170 operation, err = c.healthcareService.Projects.Locations.Datasets.Operations.Get(operation.Name).Do()CODE
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go116// org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider.configurationSchema().COMMENT
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go184// org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.from(java.lang.String)COMMENT
CRITICALsdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go199// org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.fromQuery(java.lang.String)COMMENT
CRITICALsdks/python/apache_beam/io/azure/blobstorageio.py44 from azure.core.exceptions import ResourceNotFoundErrorCODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py872 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py916 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py917 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py924 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py937 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py829 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py849 table_schema = beam.io.gcp.bigquery.BigQueryWriteFn.get_table_schema(schema)CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py902 beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(schema))CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py1202 dummy_job_reference = beam.io.gcp.internal.clients.bigquery.JobReference()CODE
CRITICALsdks/python/apache_beam/io/gcp/bigquery_test.py2801 schema = beam.io.gcp.bigquery.WriteToBigQuery.get_dict_table_schema(CODE
CRITICALsdks/python/apache_beam/io/gcp/datastore/v1new/util.py45 org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but forSTRING
CRITICALsdks/python/apache_beam/io/components/util.py33 org.apache.beam.sdk.util.MovingFunction(..., Sum.ofLongs()), but forSTRING
CRITICALsdks/python/apache_beam/transforms/external_test.py383\tat org.apache.beam.sdk.expansion.service.TransformProvider.apply(TransformProvider.java:121)CODE
CRITICALsdks/python/apache_beam/transforms/external_test.py384\tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:627)CODE
CRITICALsdks/python/apache_beam/transforms/external_test.py385\tat org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:729)CODE
CRITICALsdks/python/apache_beam/transforms/external_test.py390\tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)CODE
CRITICALsdks/python/apache_beam/transforms/external_test.py391\tat org.apache.beam.vendor.grpc.v1p69p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)CODE
CRITICAL…ython/apache_beam/runners/dataflow/dataflow_metrics.py104 in self._job_graph.proto_pipeline.components.transforms.keys()):CODE
CRITICALsdks/typescript/test/io_test.ts204 // org.apache.beam.sdk.io.gcp.bigquery.BigQueryTableSourceDef.getBeamSchema(BigQueryTableSourceDef.java:111)COMMENT
CRITICALsdks/typescript/src/apache_beam/io/pubsub.ts103 PubSub.protos.google.pubsub.v1.PubsubMessage.decode(encoded),CODE
CRITICALsdks/typescript/src/apache_beam/io/pubsub.ts128 PubSub.protos.google.pubsub.v1.PubsubMessage.encode({ data }).finish(),CODE
CRITICAL…ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java150 org.apache.commons.logging.LogFactory.getLog("logger.jcl");CODE
CRITICAL…ava/org/apache/beam/sdk/SdkHarnessEnvironmentTest.java158 org.apache.logging.log4j.LogManager.getLogger("logger.log4j2");CODE
CRITICAL…/test/java/org/apache/beam/sdk/util/YamlUtilsTest.java284 org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.ImmutableMap.of(CODE
CRITICAL…e/beam/sdk/util/construction/ParDoTranslationTest.java218 org.apache.beam.sdk.util.construction.Timer.Coder.of(CODE
CRITICAL…eam/sdk/util/construction/ValidateRunnerXlangTest.java334 com.google.cloud.secretmanager.v1.Secret.newBuilder()CODE
CRITICAL…eam/sdk/util/construction/ValidateRunnerXlangTest.java336 com.google.cloud.secretmanager.v1.Replication.newBuilder()CODE
CRITICAL…eam/sdk/util/construction/ValidateRunnerXlangTest.java338 com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder()CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java82 com.google.cloud.secretmanager.v1.Secret.newBuilder()CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java84 com.google.cloud.secretmanager.v1.Replication.newBuilder()CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java86 com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder()CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java105 com.google.cloud.kms.v1.LocationName.of(PROJECT_ID, LOCATION_ID);CODE
CRITICAL…/java/org/apache/beam/sdk/transforms/GroupByKeyIT.java110 locationName, KEY_RING_ID, com.google.cloud.kms.v1.KeyRing.newBuilder().build());CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java120 com.google.cloud.secretmanager.v1.Secret.newBuilder()CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java122 com.google.cloud.secretmanager.v1.Replication.newBuilder()CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java124 com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder()CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java141 com.google.cloud.kms.v1.KeyManagementServiceClient.create();CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java144 com.google.cloud.kms.v1.KeyRingName.of(PROJECT_ID, locationId, KEY_RING_ID);CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java146 com.google.cloud.kms.v1.LocationName.of(PROJECT_ID, locationId);CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java151 locationName, KEY_RING_ID, com.google.cloud.kms.v1.KeyRing.newBuilder().build());CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java155 com.google.cloud.kms.v1.CryptoKeyName.of(PROJECT_ID, locationId, KEY_RING_ID, KEY_ID);CODE
CRITICAL…pache/beam/sdk/transforms/GroupByEncryptedKeyTest.java160 com.google.cloud.kms.v1.CryptoKey.newBuilder()CODE
CRITICAL…ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java652 com.google.cloud.secretmanager.v1.Secret.newBuilder()CODE
CRITICAL…ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java654 com.google.cloud.secretmanager.v1.Replication.newBuilder()CODE
CRITICAL…ava/org/apache/beam/sdk/transforms/GroupByKeyTest.java656 com.google.cloud.secretmanager.v1.Replication.Automatic.newBuilder()CODE
CRITICAL…che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java51 assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable());CODE
CRITICAL…che/beam/sdk/fn/channel/ManagedChannelFactoryTest.java63 assertTrue(org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.Epoll.isAvailable());CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java58 com.fasterxml.jackson.core.StreamReadConstraints.overrideDefaultStreamReadConstraints(CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java59 com.fasterxml.jackson.core.StreamReadConstraints.builder()CODE
CRITICAL…c/main/java/org/apache/beam/sdk/util/RowJsonUtils.java82 com.fasterxml.jackson.core.StreamReadConstraints.builder()CODE
CRITICAL…va/org/apache/beam/sdk/util/GcpHsmGeneratedSecret.java89 com.google.cloud.secretmanager.v1.Secret.newBuilder()CODE
CRITICAL…e/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java199 return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource()));CODE
CRITICAL…e/src/main/java/org/apache/beam/sdk/io/WriteFiles.java999 org.apache.beam.sdk.util.ShardedKey.Coder.of(VarIntCoder.of()),CODE
CRITICAL…/core/src/main/java/org/apache/beam/sdk/io/TextIO.java431 return input.apply("Read", org.apache.beam.sdk.io.Read.from(getSource()));CODE
458 more matches not shown…
Over-Commented Block5153 hits · 5086 pts
SeverityFileLineSnippetContext
LOW.asf.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWstart-build-env.sh1#!/usr/bin/env bashCOMMENT
LOW.pre-commit-config.yaml1# Licensed under the Apache License, Version 2.0 (the "License");COMMENT
LOW.yamllint.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWlocal-env-setup.sh1#!/usr/bin/env bashCOMMENT
LOW.gemini/config.yaml1#COMMENT
LOWinfra/security/log_analyzer.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/security/requirements.txt1#COMMENT
LOWinfra/security/config.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/main.tf1#COMMENT
LOWinfra/iam/requirements.txt1#COMMENT
LOWinfra/iam/users.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/users.tf1#COMMENT
LOWinfra/iam/migrate_roles.py1#COMMENT
LOWinfra/iam/roles/beam_writer.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/generate_roles.py1#COMMENT
LOWinfra/iam/roles/generate_roles.py21import datetimeCOMMENT
LOWinfra/iam/roles/beam_admin.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/beam_viewer.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/iam/roles/test_generate_roles.py1#COMMENT
LOWinfra/iam/roles/roles_config.yaml1#COMMENT
LOWinfra/iam/roles/roles.tf1#COMMENT
LOWinfra/iam/roles/beam_infra_manager.role.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/requirements.txt1#COMMENT
LOWinfra/keys/test_secret_manager.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/service_account.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/config.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/secret_manager.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.yaml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/keys/keys.yaml21# display_name: account_@project_id.iam.gserviceaccount.comCOMMENT
LOWinfra/keys/test_service_account.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/requirements.txt1#COMMENT
LOWinfra/enforcement/iam.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/config.yml1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/sending.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/account_keys.py1# Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWinfra/enforcement/account_keys.py261 header_info: A string containing the header information to be included in the YAML file.COMMENT
LOWsdks/standard_external_transforms.yaml1#COMMENT
LOWsdks/standard_expansion_services.yaml1#COMMENT
LOWsdks/standard_expansion_services.yaml21# Each service must specify a package destination for each supported SDK, whichCOMMENT
LOWsdks/standard_expansion_services.yaml61 'beam:schematransform:org.apache.beam:mqtt_write:v1':COMMENT
LOWsdks/standard_expansion_services.yaml81# - 'beam:schematransform:org.apache.beam:generate_sequence:v1'COMMENT
LOWsdks/go/run_with_go_version.sh1#!/bin/bashCOMMENT
LOWsdks/go/run_with_go_version.sh21#COMMENT
LOWsdks/go/prepare_go_version.sh1#!/bin/bashCOMMENT
LOWsdks/go/cmd/starcgen/starcgen_test.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/starcgen/starcgen.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/starcgen/starcgen.go21// reflection based shims used by beam. Reflection is convenient for development,COMMENT
LOWsdks/go/cmd/starcgen/starcgen.go181}COMMENT
LOWsdks/go/cmd/specialize/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/specialize/main_test.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/symtab/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/prism/prism.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/main.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/artifact.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/provision.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/cmd/beamctl/cmd/root.go1// Licensed to the Apache Software Foundation (ASF) under one or moreCOMMENT
LOWsdks/go/test/run_validatesrunner_tests.sh1#!/bin/bashCOMMENT
LOWsdks/go/test/run_validatesrunner_tests.sh21# The following runners are supported, and selected via a flag:COMMENT
5093 more matches not shown…
Hyper-Verbose Identifiers5003 hits · 4769 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py116 def _grant_bucket_permissions(self, sink: logging_v2.Sink) -> None:STRING
LOWinfra/security/log_analyzer.py207 def create_weekly_email_report(self, dry_run: bool = False) -> None:STRING
LOWinfra/keys/test_secret_manager.py98 def test_get_secret_ids_exception(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py129 def test_secret_is_managed_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py141 def test_secret_is_managed_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py153 def test_secret_is_managed_not_exists(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py164 def test_create_secret_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py192 def test_create_secret_already_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py222 def test_get_secret_not_exists(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py232 def test_get_secret_not_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py246 def test_delete_secret_success(self, mock_client, mock_is_managed, mock_exists):CODE
LOWinfra/keys/test_secret_manager.py260 def test_delete_secret_not_managed(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py275 def test_is_different_user_access_same(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py297 def test_is_different_user_access_different(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py319 def test_update_secret_access_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py339 def test_get_secret_versions_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py354 def test_secret_version_exists_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py370 def test_secret_version_exists_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py386 def test_secret_version_is_enabled_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py403 def test_secret_version_is_enabled_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py420 def test_get_latest_secret_version_id_success(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py445 def test_get_latest_secret_version_id_no_enabled(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py462 def test_is_key_rotation_due_true(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py478 def test_is_key_rotation_due_false(self, mock_client):CODE
LOWinfra/keys/test_secret_manager.py496 def test_add_secret_version_success(self, mock_client, mock_checksum, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py529 def test_get_latest_secret_version_success(self, mock_client, mock_checksum):CODE
LOWinfra/keys/test_secret_manager.py561 def test_enable_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py596 def test_disable_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py631 def test_destroy_secret_version_success(self, mock_client, mock_sleep):CODE
LOWinfra/keys/test_secret_manager.py680 def test_purge_disabled_secret_versions_success(self, mock_client, mock_destroy):CODE
LOWinfra/keys/test_secret_manager.py774 def test_full_secret_lifecycle(self):CODE
LOWinfra/keys/service_account.py88 def _service_account_is_enabled(self, account_id: str) -> bool:CODE
LOWinfra/keys/service_account.py246 def _get_service_account_keys(self, account_id: str) -> List[iam_admin_v1.ServiceAccountKey]:CODE
LOWinfra/keys/service_account.py264 def _service_account_key_exists(self, account_id: str, key_id: str) -> bool:CODE
LOWinfra/keys/service_account.py278 def create_service_account_key(self, account_id: str) -> types.ServiceAccountKey:CODE
LOWinfra/keys/service_account.py343 def delete_service_account_key(self, account_id: str, key_id: str) -> None:CODE
LOWinfra/keys/keys.py74def load_service_accounts_config() -> ServiceAccountsConfig:CODE
LOWinfra/keys/keys.py183 def _start_all_service_accounts(self) -> None:CODE
LOWinfra/keys/keys.py301 def get_latest_service_account_key(self, account_id: str) -> str:CODE
LOWinfra/keys/secret_manager.py355 def _secret_version_is_enabled(self, secret_id: str, version_id: str) -> bool:CODE
LOWinfra/keys/secret_manager.py379 def _secret_version_is_destroyed(self, secret_id: str, version_id: str) -> bool:CODE
LOWinfra/keys/secret_manager.py403 def _get_latest_secret_version_id(self, secret_id: str) -> str:CODE
LOWinfra/keys/secret_manager.py530 def get_latest_secret_version(self, secret_id: str) -> Tuple[str, bytes]:CODE
LOWinfra/keys/secret_manager.py737 def purge_disabled_secret_versions(self, secret_id: str) -> List[str]:CODE
LOWinfra/keys/test_service_account.py49 def _create_mock_service_account(self, account_id: str, disabled: bool = False) -> types.ServiceAccount:CODE
LOWinfra/keys/test_service_account.py206 def test_create_service_account_key_not_found(self):CODE
LOWinfra/keys/test_service_account.py213 def test_delete_service_account_key(self):CODE
LOWinfra/keys/test_service_account.py222 def test_list_service_account_keys(self):CODE
LOWinfra/keys/test_service_account.py276 def test_normalize_account_email_with_email(self):CODE
LOWinfra/keys/test_service_account.py282 def test_normalize_account_email_with_id(self):CODE
LOWinfra/keys/test_service_account.py288 def test_service_account_exists_true(self):CODE
LOWinfra/keys/test_service_account.py298 def test_service_account_exists_false(self):CODE
LOWinfra/keys/test_service_account.py307 def test_service_account_is_enabled_true(self):CODE
LOWinfra/keys/test_service_account.py317 def test_service_account_is_enabled_false(self):CODE
LOWinfra/keys/test_service_account.py327 def test_service_account_is_enabled_not_found(self):CODE
LOWinfra/keys/test_service_account.py336 def test_get_service_account_success(self):CODE
LOWinfra/keys/test_service_account.py346 def test_get_service_account_not_found(self):CODE
LOWinfra/keys/test_service_account.py355 def test_service_account_key_exists_true(self):CODE
LOWinfra/keys/test_service_account.py381 def test_delete_service_account_key_not_found(self):CODE
LOWinfra/keys/test_service_account.py391 def test_delete_service_account_key_failed_precondition(self):CODE
4943 more matches not shown…
Cross-File Repetition249 hits · 1245 pts
SeverityFileLineSnippetContext
HIGHinfra/iam/roles/generate_roles.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHinfra/enforcement/iam.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHinfra/enforcement/account_keys.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHsdks/python/gen_protos.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHexamples/notebooks/patch.py0\ licensed to the apache software foundation (asf) under one or more contributor license agreements. see the notice fileSTRING
HIGHsdks/python/apache_beam/pipeline.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/coders/coder_impl.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/dill_pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/cloudpickle_pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/pickler.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/metrics/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/azure/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/internal/gcp/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/utils/urns.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/utils/proto_utils.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGH…he_beam/transforms/py_dataflow_distribution_counter.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/portability/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/portability/utils.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/common.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/direct/executor.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/runners/worker/__init__.py0for internal use only; no backwards-compatibility guarantees.STRING
HIGHsdks/python/apache_beam/io/filesystems.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0join two or more pathname components for the filesystem args: basepath: string path of the first component of the path pSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0splits the given path into two parts. splits the path into a pair (head, tail) such that tail contains the last componenSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/filesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0recursively create directories for the provided path. args: path: string path of the directory structure that should be STRING
HIGHsdks/python/apache_beam/io/filesystems.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0recursively copy the file tree from the source to the destination args: source_file_names: list of source file objects tSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0rename the files at the source list to the destination list. source and destination lists should be of the same size. arSTRING
HIGHsdks/python/apache_beam/io/filesystems.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/filesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py0check if the provided path exists on the filesystem. args: path: string path that needs to be checked. returns: boolean STRING
HIGHsdks/python/apache_beam/io/filesystems.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/filesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py0get unix epoch time in seconds on the filesystem. args: path: string path of file. returns: float unix epoch time raisesSTRING
189 more matches not shown…
Cross-Language Confusion150 hits · 901 pts
SeverityFileLineSnippetContext
HIGHsdks/python/apache_beam/dataframe/schemas_test.py193 self.assertTrue(roundtripped.equals(NICE_TYPES_PROXY))CODE
HIGHsdks/python/apache_beam/dataframe/partitionings.py142 if not df.index.equals(repartitioned_df.index):CODE
HIGHsdks/python/apache_beam/dataframe/transforms_test.py279 if not expected.equals(actual):CODE
HIGHsdks/python/apache_beam/dataframe/frames.py780 "result. Consider using df.length() instead.",CODE
HIGHsdks/python/apache_beam/dataframe/frames.py828 lambda df, other: pd.Series(df.equals(other)),CODE
HIGHsdks/python/apache_beam/dataframe/frames.py1576 size = self.length()CODE
HIGHsdks/python/apache_beam/dataframe/frames.py2318 return result / column.length()CODE
HIGHsdks/python/apache_beam/dataframe/frames.py3985 return result/dropped.length()CODE
HIGHsdks/python/apache_beam/io/snowflake.py390 {"dataType":{"type":"binary","size":null},"name":"","nullable":false},STRING
HIGHsdks/python/apache_beam/io/snowflake.py392 {"dataType":{"type":"string","length":null},"name":"","nullable":false},STRING
HIGHsdks/python/apache_beam/io/snowflake.py393 {"dataType":{"type":"text","length":null},"name":"","nullable":false},STRING
HIGHsdks/python/apache_beam/io/snowflake.py394 {"dataType":{"type":"varbinary","size":null},"name":"","nullable":false},STRING
HIGH…ks/python/apache_beam/io/gcp/bigquery_read_internal.py467 # It probably means its value was null, as the extract to JSON jobCOMMENT
HIGHsdks/python/apache_beam/internal/pickler_test.py288 # elements. Iteration order is implementation dependent and undefined,COMMENT
HIGHsdks/python/apache_beam/internal/pickler_test.py298 # elements. Iteration order is implementation dependent and undefined,COMMENT
HIGHsdks/python/apache_beam/utils/retry.py254 404 Http errors most of the time. The default value will return trueSTRING
HIGHsdks/python/apache_beam/ml/anomaly/thresholds.py173 self._tracker.push(float("NaN"))CODE
HIGHsdks/python/apache_beam/ml/anomaly/thresholds.py176 self._tracker.push(score)CODE
HIGHsdks/python/apache_beam/ml/anomaly/univariate/mad.py67 self._median_tracker.push(x)CODE
HIGHsdks/python/apache_beam/ml/anomaly/univariate/mad.py69 self._diff_median_tracker.push(abs(x - median))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py35 t.push(1)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py37 t.push(2)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py39 t.push(3)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py41 t.push(10)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py47 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py50 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py53 t.push(2)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py55 t.push(1)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py57 t.push(3)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py61 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py64 t.push(10)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py80 t1.push(v)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py81 t2.push(v)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py91 t.push(2)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py93 t.push(1)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py95 t.push(3)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py97 t.push(10)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py104 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py107 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py110 t.push(1)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py112 t.push(2)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py114 t.push(3)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py118 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py121 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py124 t.push(float('nan'))CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py131 t.push(4)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py133 t.push(5)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py149 t1.push(v)CODE
HIGH…python/apache_beam/ml/anomaly/univariate/stdev_test.py150 t2.push(v)CODE
HIGH…/python/apache_beam/ml/anomaly/univariate/perf_test.py41 tracker.push(numbers[i])CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py39 t.push(1)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py41 t.push(2)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py43 t.push(2)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py45 t.push(0)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py47 t.push(3)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py49 t.push(1)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py58 t.push(1)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py60 t.push(float('nan'))CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py62 t.push(2)CODE
HIGH…hon/apache_beam/ml/anomaly/univariate/quantile_test.py64 t.push(float('nan'))CODE
90 more matches not shown…
Self-Referential Comments190 hits · 565 pts
SeverityFileLineSnippetContext
MEDIUMinfra/iam/main.tf17# This file defines the general configuration for the Terraform project.COMMENT
MEDIUMinfra/iam/migrate_roles.py91 # Create the migrated entryCOMMENT
MEDIUMinfra/iam/.terraform.lock.hcl1# This file is maintained automatically by "terraform init".COMMENT
MEDIUMinfra/iam/roles/beam_writer.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/generate_roles.py44# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/beam_admin.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/beam_viewer.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/iam/roles/roles_config.yaml18# This file defines the roles, their hierarchy, the services they can access and the roles they inherit from.COMMENT
MEDIUMinfra/iam/roles/beam_infra_manager.role.yaml16# This file is auto-generated by generate_roles.py.COMMENT
MEDIUMinfra/keys/test_secret_manager.py757 # Create a logger for integration testsCOMMENT
MEDIUMinfra/keys/service_account.py307 # Create the keyCOMMENT
MEDIUMinfra/keys/keys.py174 # Create a null logger that doesn't actually log anythingCOMMENT
MEDIUMinfra/keys/keys.yaml17# This file contains the service account for the project, the account idCOMMENT
MEDIUMinfra/keys/test_service_account.py39 # Create a mock loggerCOMMENT
MEDIUMinfra/keys/test_service_account.py42 # Create the service account managerCOMMENT
MEDIUMinfra/keys/test_service_account.py546 # Create a key for the service accountCOMMENT
MEDIUMinfra/keys/test_service_account.py560 # Create a new key to ensure we have multiple keysCOMMENT
MEDIUMsdks/python/gen_managed_doc.py116 # Creating a unique list of expansion service jars.STRING
MEDIUMsdks/python/apache_beam/pipeline.py256 # Create a ComponentIdMap for assigning IDs to components. Ensures that anyCOMMENT
MEDIUMsdks/python/apache_beam/pipeline.py31 # Create a pipeline object using a local runner for execution.STRING
MEDIUMsdks/python/apache_beam/io/mongodbio.py18"""This module implements IO classes to read and write data on MongoDB.STRING
MEDIUMsdks/python/apache_beam/io/iobase.py615 """This class is deprecated, no backwards-compatibility guarantees.STRING
MEDIUMsdks/python/apache_beam/io/iobase.py878 """This class is deprecated, no backwards-compatibility guarantees.STRING
MEDIUMsdks/python/apache_beam/io/fileio_test.py66 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py240 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py258 # Create a couple files to be matchedCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py329 # Create a file to be matched before pipelineCOMMENT
MEDIUMsdks/python/apache_beam/io/fileio_test.py363 # Create a file to be matched before pipeline startsCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_biglake_test.py68 # Create the transformCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_test.py1983 # Create a windowed value for testingCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_test.py2062 # Create a windowed value for testingCOMMENT
MEDIUM…ython/apache_beam/io/gcp/bigquery_geography_it_test.py223 # Create the table firstCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_tools.py1191 # Create a new table potentially reusing the schema from a previouslyCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_tools_test.py1111 # Create a mock field with GEOGRAPHY typeCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/gcsio_test.py94 # Define the exit logicCOMMENT
MEDIUMsdks/python/apache_beam/io/gcp/gcsio_test.py479 # Creating a mock bucket without setting project_number (it returns another mock object)COMMENT
MEDIUM…/apache_beam/io/gcp/bigquery_change_history_it_test.py428 # Create a change-history-enabled table and insert initial rows via DML.COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/pubsub.py318 """This class is deprecated. Use ``ReadFromPubSub`` instead."""STRING
MEDIUMsdks/python/apache_beam/io/gcp/pubsub.py341 """This class is deprecated. Use ``WriteToPubSub`` instead."""STRING
MEDIUM…ython/apache_beam/io/gcp/bigquery_schema_tools_test.py291 # Create a user type with GEOGRAPHY fieldCOMMENT
MEDIUM…ython/apache_beam/io/gcp/bigquery_schema_tools_test.py300 # Create the DoFnCOMMENT
MEDIUM…che_beam/io/gcp/healthcare/dicomio_integration_test.py89 # Create a an empty DICOM storeCOMMENT
MEDIUMsdks/python/apache_beam/io/aws/s3io_test.py388 # Create the file in the real bucketCOMMENT
MEDIUMsdks/python/apache_beam/io/aws/s3io_test.py446 # Create the file and check that it was createdCOMMENT
MEDIUM…on/apache_beam/io/external/xlang_debeziumio_it_test.py124# Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_mqttio_it_test.py94 # Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_jdbcio_it_test.py176 # Creating a container with testcontainers sometimes raises ReadTimeoutCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_jdbcio_it_test.py382 # Create a simple table for this testCOMMENT
MEDIUMsdks/python/apache_beam/internal/dill_pickler.py54 # The following function is based on 'save_code' from 'dill'COMMENT
MEDIUMsdks/python/apache_beam/internal/dill_pickler.py61 # The following function is also based on 'save_codeobject' from 'cloudpickle'COMMENT
MEDIUMsdks/python/apache_beam/utils/multi_process_shared.py454 # Create a pipe to connect with child processCOMMENT
MEDIUMsdks/python/apache_beam/utils/windowed_value.py20# This module is carefully crafted to have optimal performance whenCOMMENT
MEDIUM…python/apache_beam/utils/transform_service_launcher.py97 # Creating the credentials volume.COMMENT
MEDIUM…python/apache_beam/utils/transform_service_launcher.py123 # Creating the dependencies volume.COMMENT
MEDIUMsdks/python/apache_beam/transforms/ptransform.py856 # Create a flat list rather than a nested tree of compositeCOMMENT
MEDIUMsdks/python/apache_beam/transforms/util.py2051 """This class represents the parameters forSTRING
MEDIUMsdks/python/apache_beam/transforms/core.py1994 """This class represents the state in the ParDoPayload's function spec,STRING
MEDIUMsdks/python/apache_beam/transforms/core_test.py240 # Create an instance of the ApplyPartitionFnFn classCOMMENT
MEDIUMsdks/python/apache_beam/transforms/core_test.py243 # Define a simple partition functionCOMMENT
MEDIUMsdks/python/apache_beam/transforms/core_test.py266 # Create an instance of the ApplyPartitionFnFn classCOMMENT
130 more matches not shown…
Docstring Block Structure105 hits · 525 pts
SeverityFileLineSnippetContext
HIGHsdks/python/apache_beam/dataframe/frames.py4642 Applies aggregation functions to the grouped data based on the provided keyword arguments and combines the results STRING
HIGHsdks/python/apache_beam/dataframe/frames.py4685 Handles the aggregation logic based on the function type passed. Args: gb: The groupby instance (DeferredGroSTRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py150Verifies that url begins with hdfs:// prefix, strips it and adds a leading /. Parsing behavior is determined bySTRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py394Fetches last updated time for a URL. Args: url: string url of file. Returns: float UNIX Epoch time STRING
HIGHsdks/python/apache_beam/io/hadoopfilesystem.py424Fetch metadata fields of a file on the FileSystem. Args: url: string url of a file. Returns: :clasSTRING
HIGHsdks/python/apache_beam/io/filesystems.py205Find all matching paths to the patterns provided. Pattern matching is done using each filesystem's ``match`` methodSTRING
HIGHsdks/python/apache_beam/io/filesystems.py329Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/filesystems.py344Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returnsSTRING
HIGHsdks/python/apache_beam/io/filesystem.py589List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dirSTRING
HIGHsdks/python/apache_beam/io/filesystem.py712Find all matching paths to the patterns provided. See Also: :meth:`translate_pattern` Patterns ending wiSTRING
HIGHsdks/python/apache_beam/io/filesystem.py854Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size ofSTRING
HIGHsdks/python/apache_beam/io/filesystem.py868Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/filesystem.py881Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returnsSTRING
HIGHsdks/python/apache_beam/io/filesystem.py903Fetch metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. This operation returns metadataSTRING
HIGHsdks/python/apache_beam/io/tfrecordio.py138Read a record from a TFRecords file. Args: file_handle: The file to read from. Returns: None if EOFSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py99List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/localfilesystem.py266Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py282Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py297Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/localfilesystem.py313Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py115List files in a location. Listing is non-recursive (for filesystems that support directories). Args: dir_oSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py234Get size in bytes of a file on the FileSystem. Args: path: string filepath of file. Returns: int size ofSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py250Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py266Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGH…s/python/apache_beam/io/azure/blobstoragefilesystem.py283Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/io/azure/blobstorageio.py132Open an Azure Blob Storage file path for reading or writing. Args: filename (str): Azure Blob Storage file paSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py120List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py285Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py298Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py311Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsfilesystem.py328Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py160Parses a table reference into a (project, dataset, table) tuple. Args: destination: Either a TableReference objecSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py239Parses a table reference into a (project, dataset, table) tuple. Args: table: The ID of the table. The ID must coSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py794Lookup a table's metadata object. Args: client: bigquery.BigqueryV2 instance project_id: table lookup pSTRING
HIGHsdks/python/apache_beam/io/gcp/bigquery_tools.py1141Gets or creates a table based on create and write dispositions. The function mimics the behavior of BigQuery importSTRING
HIGHsdks/python/apache_beam/io/gcp/gcsio.py274Open a GCS file path for reading or writing. Args: filename (str): GCS file path in the form ``gs://<bucket>/STRING
HIGH…n/apache_beam/io/gcp/datastore/v1new/query_splitter.py45Returns a list of sharded queries for the given Cloud Datastore query. This will create up to the desired number of sSTRING
HIGHsdks/python/apache_beam/io/components/rate_limiter.py59Applies rate limiting to the request. This method checks if the request is permitted by the rate limiting policy. STRING
HIGHsdks/python/apache_beam/io/aws/s3io.py76Open an S3 file path for reading or writing. Args: filename (str): S3 file path in the form ``s3://<bucket>/<STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py117List files in a location. Listing is non-recursive, for filesystems that support directories. Args: dir_STRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py237Get size of path on the FileSystem. Args: path: string path in question. Returns: int size of path accorSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py253Get UNIX Epoch time in seconds on the FileSystem. Args: path: string path of file. Returns: float UNIX ESTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py269Fetch checksum metadata of a file on the :class:`~apache_beam.io.filesystem.FileSystem`. Args: path: striSTRING
HIGHsdks/python/apache_beam/io/aws/s3filesystem.py286Fetch metadata fields of a file on the FileSystem. Args: path: string path of a file. Returns: :clSTRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py68Returns the code object identifier for a given callable. Args: callable: The callable object to search for. ReSTRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py230Searches a code object to create a code object identifier. Args: callable: The callable to search for. node: STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py335Returns the code object from a name pattern. Args: obj: The object to search within. name_result: The result STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py362Returns the code object from a lambda with args pattern. Args: obj: The object to search within. lambda_with_STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py392Returns the code object from a lambda with hash pattern. Args: obj: The object to search within. lambda_with_STRING
HIGHsdks/python/apache_beam/internal/code_object_pickler.py423Returns the code object corresponding to the code object identifier. Args: code_object_identifier: A string repreSTRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py37For internal use only; no backwards-compatibility guarantees. Converts a basic type into a @type/value dictionary. STRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py66For internal use only; no backwards-compatibility guarantees. Converts Python objects into extra_types.JsonValue objeSTRING
HIGHsdks/python/apache_beam/internal/gcp/json_value.py126For internal use only; no backwards-compatibility guarantees. Converts ``extra_types.JsonValue`` objects into Python STRING
HIGHsdks/python/apache_beam/utils/byte_limited_queue.py132Remove and return an item from the queue. If the queue is empty, block until an item is available, unless `block` STRING
HIGHsdks/python/apache_beam/transforms/ptransform.py393Annotates the input type of a :class:`PTransform` with a type-hint. Args: input_type_hint (type): An instanceSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py418Annotates the output type of a :class:`PTransform` with a type-hint. Args: type_hint (type): An instance of aSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py454Adds resource hints to the :class:`PTransform`. Resource hints allow users to express constraints on the environmenSTRING
HIGHsdks/python/apache_beam/transforms/ptransform.py920Annotates the types of main inputs and side inputs for the PTransform. Args: input_type_hint: An instance of STRING
HIGHsdks/python/apache_beam/transforms/core.py1807Returns a tagged tuple allowing access to the outputs of a :class:`ParDo`. The resulting object supports accessSTRING
HIGHsdks/python/apache_beam/transforms/core.py2065:func:`FlatMap` is like :class:`ParDo` except it takes a callable to specify the transformation. The callable must STRING
45 more matches not shown…
Excessive Try-Catch Wrapping417 hits · 469 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py270 except Exception as e:STRING
MEDIUMinfra/iam/roles/generate_roles.py80 print(f"Error: Permission denied. Ensure you have 'resourcemanager.projects.get' on project '{project_id}'.")CODE
MEDIUMinfra/iam/roles/generate_roles.py84 print(f"Error: Project '{project_id}' not found.")CODE
LOWinfra/iam/roles/generate_roles.py87 except Exception as e:CODE
MEDIUMinfra/iam/roles/generate_roles.py130 print(f"Error: The role '{role_name}' was not found.")CODE
LOWinfra/iam/roles/generate_roles.py132 except Exception as e:CODE
LOWinfra/keys/test_secret_manager.py771 except Exception as e:CODE
LOWinfra/keys/service_account.py335 except Exception as e:CODE
LOWinfra/keys/service_account.py367 except Exception as e:CODE
LOWinfra/keys/service_account.py415 except Exception as auth_error:CODE
LOWinfra/keys/keys.py236 except Exception as e:CODE
LOWinfra/keys/keys.py277 except Exception as e:CODE
LOWinfra/keys/keys.py292 except Exception as e:CODE
LOWinfra/keys/keys.py321 except Exception as e:CODE
MEDIUMinfra/keys/keys.py355 print(f"Error: Service account '{account_id}' not found in configuration.")CODE
LOWinfra/keys/keys.py370 except Exception as e:CODE
MEDIUMinfra/keys/keys.py371 print(f"Error retrieving key for {account_id}: {e}")CODE
LOWinfra/keys/keys.py376 except Exception as e:CODE
MEDIUMinfra/keys/keys.py377 print(f"An error occurred: {e}")CODE
LOWinfra/keys/secret_manager.py67 except Exception as e:CODE
LOWinfra/keys/secret_manager.py88 except Exception as e:CODE
LOWinfra/keys/secret_manager.py252 except Exception as e:CODE
LOWinfra/keys/test_service_account.py523 except Exception as e:CODE
LOWinfra/keys/test_service_account.py525 except Exception as e:CODE
LOWinfra/enforcement/iam.py94 except Exception as e:CODE
LOWinfra/enforcement/iam.py158 except Exception as e:CODE
LOWinfra/enforcement/iam.py380 except Exception as e:STRING
LOWinfra/enforcement/iam.py410 except Exception as e:STRING
LOWinfra/enforcement/account_keys.py126 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py152 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py175 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py195 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py226 except Exception as e:CODE
LOWinfra/enforcement/account_keys.py589 except Exception as e:STRING
LOWinfra/enforcement/account_keys.py559 except Exception as e:STRING
LOWsdks/python/conftest.py134 except Exception as e:CODE
LOWsdks/python/apache_beam/pipeline.py1050 except Exception:CODE
LOWsdks/python/apache_beam/pipeline.py1508 except Exception as exn:CODE
LOW…n/apache_beam/options/pipeline_options_context_test.py86 except Exception as e:CODE
LOW…n/apache_beam/options/pipeline_options_context_test.py274 except Exception as e:CODE
MEDIUM…n/apache_beam/options/pipeline_options_context_test.py71def thread_worker(thread_id, runner_name):CODE
MEDIUM…n/apache_beam/options/pipeline_options_context_test.py265def construct_pipeline(worker_id):CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py816 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py853 except Exception as e:STRING
LOWsdks/python/apache_beam/coders/coder_impl.py517 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py524 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py532 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py454 except Exception as exn:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py472 except Exception as exn:CODE
LOWsdks/python/apache_beam/coders/coder_impl.py548 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/coders.py839 except Exception: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/coders/coders.py847 except Exception: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/coders/coders.py1033 except Exception as e:CODE
LOWsdks/python/apache_beam/coders/typecoders.py252 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/doctests.py288 except Exception:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py80 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py91 except Exception as e:CODE
LOWsdks/python/apache_beam/dataframe/frames_test.py105 except Exception as e:CODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py226 except Exception as e: # pylint: disable=broad-exceptCODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py339 except Exception as e: # pylint: disable=broad-exceptCODE
357 more matches not shown…
Deep Nesting529 hits · 454 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py158CODE
LOWinfra/iam/migrate_roles.py31CODE
LOWinfra/keys/service_account.py278CODE
LOWinfra/keys/keys.py325CODE
LOWinfra/keys/keys.py183CODE
LOWinfra/keys/keys.py239CODE
LOWinfra/keys/test_service_account.py514CODE
LOWinfra/enforcement/iam.py343CODE
LOWinfra/enforcement/iam.py78CODE
LOWinfra/enforcement/iam.py201CODE
LOWinfra/enforcement/account_keys.py522CODE
LOWinfra/enforcement/account_keys.py199CODE
LOWinfra/enforcement/account_keys.py293CODE
LOWsdks/python/gen_xlang_wrappers.py247CODE
LOWsdks/python/gen_managed_doc.py104CODE
LOWsdks/python/gen_protos.py111CODE
LOWsdks/python/gen_protos.py370CODE
LOWsdks/python/gen_protos.py416CODE
LOWsdks/python/gen_protos.py242CODE
LOWsdks/python/setup.py281CODE
LOWsdks/python/apache_beam/pipeline.py316CODE
LOWsdks/python/apache_beam/pipeline.py710CODE
LOWsdks/python/apache_beam/pipeline.py879CODE
LOWsdks/python/apache_beam/pipeline.py1329CODE
LOWsdks/python/apache_beam/pipeline.py1450CODE
LOWsdks/python/apache_beam/pipeline.py335CODE
LOWsdks/python/apache_beam/pipeline.py471CODE
LOWsdks/python/apache_beam/metrics/monitoring_infos.py517CODE
LOWsdks/python/apache_beam/metrics/cells.py740CODE
LOWsdks/python/apache_beam/metrics/cells.py766CODE
LOW…thon/apache_beam/options/pipeline_options_validator.py393CODE
LOWsdks/python/apache_beam/options/pipeline_options.py257CODE
LOWsdks/python/apache_beam/options/pipeline_options.py422CODE
LOWsdks/python/apache_beam/options/pipeline_options.py481CODE
LOWsdks/python/apache_beam/options/pipeline_options.py944CODE
LOWsdks/python/apache_beam/options/pipeline_options.py1249CODE
LOW…ks/python/apache_beam/options/pipeline_options_test.py775CODE
LOWsdks/python/apache_beam/coders/coders_test_common.py267CODE
LOWsdks/python/apache_beam/coders/coder_impl.py404CODE
LOWsdks/python/apache_beam/coders/coder_impl.py486CODE
LOWsdks/python/apache_beam/coders/coder_impl.py587CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1302CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1959CODE
LOWsdks/python/apache_beam/coders/coder_impl.py2005CODE
LOWsdks/python/apache_beam/coders/row_coder.py144CODE
LOWsdks/python/apache_beam/coders/typecoders.py174CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py77CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py85CODE
LOWsdks/python/apache_beam/coders/standard_coders_test.py189CODE
LOWsdks/python/apache_beam/dataframe/doctests.py521CODE
LOWsdks/python/apache_beam/dataframe/doctests.py223CODE
LOWsdks/python/apache_beam/dataframe/doctests.py302CODE
LOWsdks/python/apache_beam/dataframe/doctests.py397CODE
LOWsdks/python/apache_beam/dataframe/doctests.py424CODE
LOWsdks/python/apache_beam/dataframe/transforms.py147CODE
LOWsdks/python/apache_beam/dataframe/transforms.py356CODE
LOWsdks/python/apache_beam/dataframe/transforms.py436CODE
LOWsdks/python/apache_beam/dataframe/transforms.py175CODE
LOWsdks/python/apache_beam/dataframe/convert.py106CODE
LOWsdks/python/apache_beam/dataframe/convert.py167CODE
469 more matches not shown…
Unused Imports422 hits · 394 pts
SeverityFileLineSnippetContext
LOWinfra/enforcement/iam.py24CODE
LOWsdks/python/apache_beam/__init__.py85CODE
LOWsdks/python/apache_beam/__init__.py86CODE
LOWsdks/python/apache_beam/__init__.py87CODE
LOWsdks/python/apache_beam/__init__.py88CODE
LOWsdks/python/apache_beam/__init__.py89CODE
LOWsdks/python/apache_beam/__init__.py91CODE
LOWsdks/python/apache_beam/__init__.py92CODE
LOWsdks/python/apache_beam/__init__.py93CODE
LOWsdks/python/apache_beam/__init__.py94CODE
LOWsdks/python/apache_beam/__init__.py95CODE
LOWsdks/python/apache_beam/__init__.py100CODE
LOWsdks/python/apache_beam/pipeline.py106CODE
LOWsdks/python/apache_beam/pipeline.py109CODE
LOWsdks/python/apache_beam/pvalue.py50CODE
LOWsdks/python/apache_beam/pvalue.py51CODE
LOWsdks/python/apache_beam/pvalue.py53CODE
LOWsdks/python/apache_beam/pvalue.py54CODE
LOWsdks/python/apache_beam/metrics/execution.py38CODE
LOWsdks/python/apache_beam/metrics/execution.py39CODE
LOWsdks/python/apache_beam/metrics/execution.py40CODE
LOWsdks/python/apache_beam/metrics/execution.py41CODE
LOWsdks/python/apache_beam/metrics/execution.py42CODE
LOWsdks/python/apache_beam/metrics/execution.py43CODE
LOWsdks/python/apache_beam/metrics/execution.py52CODE
LOWsdks/python/apache_beam/metrics/execution.py54CODE
LOWsdks/python/apache_beam/metrics/execution.py59CODE
LOWsdks/python/apache_beam/metrics/execution.py60CODE
LOWsdks/python/apache_beam/metrics/execution.py61CODE
LOWsdks/python/apache_beam/metrics/execution.py62CODE
LOWsdks/python/apache_beam/metrics/execution.py63CODE
LOWsdks/python/apache_beam/metrics/execution.py64CODE
LOWsdks/python/apache_beam/metrics/execution.py65CODE
LOWsdks/python/apache_beam/metrics/__init__.py17CODE
LOWsdks/python/apache_beam/metrics/__init__.py18CODE
LOWsdks/python/apache_beam/metrics/metric.py40CODE
LOWsdks/python/apache_beam/metrics/metric.py51CODE
LOWsdks/python/apache_beam/metrics/metric.py52CODE
LOWsdks/python/apache_beam/metrics/metric.py53CODE
LOWsdks/python/apache_beam/metrics/metric.py54CODE
LOW…ks/python/apache_beam/options/pipeline_options_test.py50CODE
LOW…python/apache_beam/options/pipeline_options_context.py36CODE
LOWsdks/python/apache_beam/coders/fast_coders_test.py25CODE
LOWsdks/python/apache_beam/coders/fast_coders_test.py37CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py25CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py36CODE
LOWsdks/python/apache_beam/coders/slow_coders_test.py43CODE
LOWsdks/python/apache_beam/coders/coder_impl.py47CODE
LOWsdks/python/apache_beam/coders/coder_impl.py49CODE
LOWsdks/python/apache_beam/coders/coder_impl.py50CODE
LOWsdks/python/apache_beam/coders/coder_impl.py51CODE
LOWsdks/python/apache_beam/coders/coder_impl.py53CODE
LOWsdks/python/apache_beam/coders/coder_impl.py78CODE
LOWsdks/python/apache_beam/coders/coder_impl.py1890CODE
LOWsdks/python/apache_beam/coders/__init__.py17CODE
LOWsdks/python/apache_beam/coders/__init__.py18CODE
LOWsdks/python/apache_beam/coders/__init__.py19CODE
LOWsdks/python/apache_beam/coders/coders.py48CODE
LOWsdks/python/apache_beam/coders/coders.py67CODE
LOWsdks/python/apache_beam/dataframe/doctests.py54CODE
362 more matches not shown…
Decorative Section Separators59 hits · 201 pts
SeverityFileLineSnippetContext
MEDIUMsdks/python/apache_beam/coders/coders.py209 # ===========================================================================COMMENT
MEDIUMsdks/python/apache_beam/coders/coders.py212 # ===========================================================================COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source_test.py278# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source_test.py280# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source_test.py835# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source_test.py838# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py142# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py144# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py273# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py276# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py1001# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/unbounded_source.py1003# ------------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery_tools.py299# -----------------------------------------------------------------------------COMMENT
MEDIUMsdks/python/apache_beam/io/gcp/bigquery.py590# -----------------------------------------------------------------------------COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py387# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py389# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py680# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py682# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1053# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1055# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1118# =============================================================================COMMENT
MEDIUM…s/python/apache_beam/io/gcp/bigquery_change_history.py1120# =============================================================================COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py772# -------------------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py808# ------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py814# -----------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py924# -------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py1239# ------------------------------------COMMENT
MEDIUM…python/apache_beam/internal/cloudpickle/cloudpickle.py1322# ---------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py76# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py78# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py222# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py224# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py235# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py237# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py314# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py316# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py154# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py156# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py283# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py285# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py406# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py408# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py467# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py469# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py614# ---------------------------------------------------------------------------COMMENT
MEDIUM…he_beam/testing/benchmarks/sort_and_batch_benchmark.py616# ---------------------------------------------------------------------------COMMENT
MEDIUM…apache_beam/ml/inference/agent_development_kit_test.py67# ---------------------------------------------------------------------------COMMENT
MEDIUM…apache_beam/ml/inference/agent_development_kit_test.py70# ---------------------------------------------------------------------------COMMENT
MEDIUM…pache_beam/yaml/extended_tests/databases/bigquery.yaml88 # ----------------------------------------------------------------------------COMMENT
MEDIUMexamples/terraform/envoy-ratelimiter/variables.tf19# ------------------------------------------------------------------------------COMMENT
MEDIUMexamples/terraform/envoy-ratelimiter/variables.tf21# ------------------------------------------------------------------------------COMMENT
MEDIUMexamples/terraform/envoy-ratelimiter/variables.tf43# ------------------------------------------------------------------------------COMMENT
MEDIUMexamples/terraform/envoy-ratelimiter/variables.tf45# ------------------------------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh21# -------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh40# -------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh57# -------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh83# -------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh111# -------------------------------------------------------COMMENT
MEDIUMdev-support/docker/beam_env_checks.sh117# -------------------------------------------------------COMMENT
AI Slop Vocabulary71 hits · 173 pts
SeverityFileLineSnippetContext
MEDIUMsdks/go/test/run_validatesrunner_tests.sh53# a staged SDK harness container. Note for Dataflow: Using this flagCOMMENT
MEDIUMsdks/go/examples/large_wordcount/large_wordcount.go310// A more robust implementation would write to the pipeline's temporary folder instead,COMMENT
MEDIUMsdks/go/examples/large_wordcount/large_wordcount.go368// A more robust implementation would move from the pipeline's temporary folder toCOMMENT
MEDIUMsdks/go/pkg/beam/io/natsio/write.go56// ProducerMessage to utilize JetStream's support for deduplication of messages.COMMENT
MEDIUM…g/beam/runners/prism/internal/engine/elementmanager.go199// Essentially, it needs to track the current watermarks for each PCollectionCOMMENT
LOWsdks/python/apache_beam/metrics/monitoring_infos.py471 # If it is not a user counter, just use the first part of the URN, i.e. 'beam'COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py4236 # By default do_apply will just call pandas apply()COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py4872 # Boolean indexer, just pass it in as-isCOMMENT
LOWsdks/python/apache_beam/io/filebasedsource_test.py657 # Should simply return stop_offset - start_offsetCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py846 # Temp dataset was provided by the user so we can just return.COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1067 # Temp dataset was provided by the user so we can just return.COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1288 # server-side liquid sharding. A split will simply return the current sourceCOMMENT
MEDIUM…che_beam/io/gcp/healthcare/dicomio_integration_test.py156 # Both refine and comprehensive search will be tested.COMMENT
MEDIUM…python/apache_beam/io/external/xlang_mqttio_it_test.py218 # never terminates on its own. Amend the harness-provided pipeline optionsCOMMENT
MEDIUM…python/apache_beam/io/external/xlang_mqttio_it_test.py226 # passed to the constructor; the remaining harness-provided options areCOMMENT
MEDIUMsdks/python/apache_beam/internal/cloudpickle_pickler.py112 # Unwrap typing.TypeAliasType to its underlying value for robust pickling.COMMENT
MEDIUM…n/apache_beam/testing/analyzers/perf_analysis_utils.py315 # MAD (Median Absolute Deviation) is a robust measure of variability.STRING
MEDIUM…n/apache_beam/testing/analyzers/perf_analysis_utils.py325 # significant, making the detection more robust to noise and outliers.STRING
LOWsdks/python/apache_beam/transforms/window.py190 # By default, just return the input timestamp.COMMENT
MEDIUMsdks/python/apache_beam/transforms/combiners.py344 # Essentially, given s map bundles, we are trading about O(sn) compares inCOMMENT
LOWsdks/python/apache_beam/transforms/core.py4220 # No field data - just use default Union.COMMENT
LOWsdks/python/apache_beam/transforms/stats_test.py512 # sum (297.5). If we just use key=sum, tie-breaking is sensitive to bundle mergingCOMMENT
LOWsdks/python/apache_beam/transforms/external.py1196 # For anything other than 'JavaJarExpansionService' we just use theCOMMENT
LOWsdks/python/apache_beam/transforms/trigger.py1237 # Here we also just pass through all the values exactly once.COMMENT
MEDIUMsdks/python/apache_beam/ml/anomaly/transforms.py594 # Add a temporary unique key per data point to facilitate grouping theCOMMENT
MEDIUMsdks/python/apache_beam/ml/transforms/tft_test.py438 # Front-padded to facilitate lexicographic sorting.COMMENT
MEDIUMsdks/python/apache_beam/ml/transforms/tft_test.py448 dtype=np.int64) # Front-padded to facilitate lexicographicCODE
MEDIUMsdks/python/apache_beam/ml/transforms/tft_test.py410 i, # Front-padded to facilitate lexicographic sorting.CODE
MEDIUMsdks/python/apache_beam/ml/inference/base_test.py1233 # applying GroupByKey to utilize windowing according toCOMMENT
MEDIUMsdks/python/apache_beam/ml/inference/base_test.py1516 # applying GroupByKey to utilize windowing according toCOMMENT
LOWsdks/python/apache_beam/examples/snippets/snippets.py1372 # simply use beam.combiners.Count.PerElement here.COMMENT
LOW…xamples/snippets/transforms/elementwise/map_context.py51 # Here we just create a (shared) random value, but in practice oneCOMMENT
MEDIUMsdks/python/apache_beam/portability/python_urns.py60# Instantiate SDK harness via a command line provided in the payload.COMMENT
MEDIUMsdks/python/apache_beam/portability/python_urns.py62# starts up the SDK harness directly, rather than the bootstrappingCOMMENT
LOWsdks/python/apache_beam/yaml/yaml_ml.py637 # If we can't get a schema, just return the result.COMMENT
LOWsdks/python/apache_beam/runners/common.py860 # or if the process accesses the window parameter. We can just call it onceCOMMENT
MEDIUM…python/apache_beam/runners/dataflow/dataflow_runner.py546 # comprehensive.COMMENT
MEDIUM…hon/apache_beam/runners/dataflow/internal/apiclient.py288 # Don't pass impersonate_service_account through to the harness.COMMENT
MEDIUM…hon/apache_beam/runners/dataflow/internal/apiclient.py854 # Stage other resources for the SDK harnessCOMMENT
MEDIUM…/python/apache_beam/runners/dataflow/internal/names.py36# requires changes to SDK harness container or SDK harness launcher.COMMENT
LOWsdks/python/apache_beam/runners/dask/dask_runner.py145 # not actually need to use the results here, so we just pass. to gather,COMMENT
LOW…apache_beam/runners/interactive/pipeline_instrument.py603 # To put the cached value into the correct window, simply return aCOMMENT
MEDIUM…ks/python/apache_beam/runners/interactive/sql/utils.py222 """Displays actionable widgets to utilize the options, run pipelines andSTRING
LOW…pache_beam/runners/portability/abstract_job_service.py107 # For now, just use the preparation id as the job id.COMMENT
MEDIUM…pache_beam/runners/portability/portable_runner_test.py56 # Controls job service interaction, not sdk harness interaction.COMMENT
MEDIUM…n/apache_beam/runners/portability/prism_runner_test.py548 # Verify the fix: StopWorker successfully tells the thread harness to shut down,COMMENT
MEDIUM…s/python/apache_beam/runners/portability/job_server.py126 # isEnabledFor check, allowing the filter to dynamically elevate logCOMMENT
MEDIUM…/python/apache_beam/runners/worker/bundle_processor.py1166 # Out of caution, terminate the SDK harness process.COMMENT
MEDIUM…/python/apache_beam/runners/worker/bundle_processor.py1666 # The Dataflow runner harness strips the base64 encoding.COMMENT
MEDIUM…s/python/apache_beam/runners/worker/opcounters_test.py206 # The seed is arbitrary and exists just to ensure this test is robust.COMMENT
LOWsdks/python/apache_beam/runners/worker/sideinputs.py114 # If any reader has errored, just return.COMMENT
LOWsdks/python/apache_beam/runners/worker/sideinputs.py130 # If any reader has errored, just return.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/worker_status.py45# This SDK harness will (by default), log a "lull" in processing if it sees noCOMMENT
MEDIUM…/python/apache_beam/runners/worker/worker_pool_main.py195 # unblocking the harness request stream.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/operations.py444 # These are overwritten in the legacy harness.COMMENT
MEDIUMsdks/python/apache_beam/runners/worker/sdk_worker.py169 # Unrecoverable SDK harness initialization error (if any)COMMENT
LOWsdks/python/apache_beam/typehints/schemas.py686 # if the named tuple's schema is in registry, we just use it instead ofCOMMENT
MEDIUMsdks/python/apache_beam/typehints/row_type.py157 # to be used in conjunction with native typehints, like Optional.COMMENT
MEDIUM…rChangeStreamOrderedByTimestampAndTransactionIdIT.java252 // We utilize a looping timer to determine when to flush the buffer:COMMENT
MEDIUM…/it/SpannerChangeStreamOrderedWithinKeyGloballyIT.java270 // We utilize a looping timer to determine when to flush the buffer:COMMENT
11 more matches not shown…
Structural Annotation Overuse80 hits · 153 pts
SeverityFileLineSnippetContext
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go112 // Step 1: Initialise BeamCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go128 // Step 3: Read input text fileCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go133 // Step 4: split lens into wordsCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go141 // Step 5: Count words occurencesCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go148 // Step 6: Format resultsCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go154 // Step 7: Write output to fileCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go160 // Step 8: Execute pipelineCOMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py522 # Step 1: Insert initial data that doesn't exist.COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py571 # Step 2: Update existing data (same IDs, different content).COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py613 # Step 3: Repeat the same update operation 3 more times (idempotence test).COMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml21 # Step 1: Creating rows to be written to SpannerCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml34 # Step 2: Writing the created rows to a Spanner databaseCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml49 # Step 3: Writing the failed records to a JSON fileCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml23 # Step 1: Creating a collection of elements that needsCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml33 # Step 2: Enriching the data with BigtableCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml46 # Step 3: Logging for testingCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml21 # Step 1: Read orders details from SpannerCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml30 # Step 2: Enrich order details with customers details from BigQueryCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml42 # Step 3: Map enriched values to Beam schemaCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml69 # Step 4: Filter orders with amount greater than 110COMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml78 # Step 6: Write processed order to another spanner tableCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml91 # Step 7: Handle write errors by writing to JSONCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml23 # Step 1: Reading data from IcebergCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml38 # Step 2: Write records out to AlloyDBCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml25 # Step 1: Reading data from OracleCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml25 # Step 1: Reading data from GCSCOMMENT
LOW…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml30 # Step 2: Write records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml24 # Step 1: Reading data from KafkaCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml38 # Step 2: Convert Kafka recordsCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml50 # Step 3: Write records out to IcebergCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml24 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml35 # Step 2: Write records out to IcebergCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub subscriptionCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…aml/examples/transforms/blueprint/spanner_to_avro.yaml25 # Step 1: Reading shipment data from Spanner DBCOMMENT
LOW…aml/examples/transforms/blueprint/spanner_to_avro.yaml33 # Step 2: Write successful records out to GCS avro filesCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml25 # Step 1: Reading data from PostgresCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml25 # Step 1: Reading data from SqlServerCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…examples/transforms/blueprint/spanner_to_bigquery.yaml25 # Step 1: Reading data from SpannerCOMMENT
LOW…examples/transforms/blueprint/spanner_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml25 # Step 1: Reading data from MySqlCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml25 # Step 1: Reading shipment data from jdbc DBCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml32 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java98 // Step 1: Find the effective location of the query.COMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java122 // Step 2: Create a temporary dataset in the query location only if the user has not specifiedCOMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java164 // Step 3: Execute the query. Generate a transient (random) query job ID, because this codeCOMMENT
LOWexamples/terraform/envoy-ratelimiter/README.md124# Step 1: Initialize TerraformCOMMENT
20 more matches not shown…
Verbosity Indicators79 hits · 150 pts
SeverityFileLineSnippetContext
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go112 // Step 1: Initialise BeamCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go116 // Step 2:COMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go128 // Step 3: Read input text fileCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go133 // Step 4: split lens into wordsCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go141 // Step 5: Count words occurencesCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go148 // Step 6: Format resultsCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go154 // Step 7: Write output to fileCOMMENT
LOWsdks/go/examples/minimal_wordcount/minimal_wordcount.go160 // Step 8: Execute pipelineCOMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py522 # Step 1: Insert initial data that doesn't exist.COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py571 # Step 2: Update existing data (same IDs, different content).COMMENT
LOW…/apache_beam/ml/rag/ingestion/milvus_search_it_test.py613 # Step 3: Repeat the same update operation 3 more times (idempotence test).COMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml21 # Step 1: Creating rows to be written to SpannerCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml34 # Step 2: Writing the created rows to a Spanner databaseCOMMENT
LOW…he_beam/yaml/examples/transforms/io/spanner_write.yaml49 # Step 3: Writing the failed records to a JSON fileCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml23 # Step 1: Creating a collection of elements that needsCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml33 # Step 2: Enriching the data with BigtableCOMMENT
LOW…m/yaml/examples/transforms/ml/bigtable_enrichment.yaml46 # Step 3: Logging for testingCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml21 # Step 1: Read orders details from SpannerCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml30 # Step 2: Enrich order details with customers details from BigQueryCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml42 # Step 3: Map enriched values to Beam schemaCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml69 # Step 4: Filter orders with amount greater than 110COMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml78 # Step 6: Write processed order to another spanner tableCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml91 # Step 7: Handle write errors by writing to JSONCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml23 # Step 1: Reading data from IcebergCOMMENT
LOW…/examples/transforms/blueprint/iceberg_to_alloydb.yaml38 # Step 2: Write records out to AlloyDBCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml25 # Step 1: Reading data from OracleCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…/examples/transforms/blueprint/oracle_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml25 # Step 1: Reading data from GCSCOMMENT
LOW…xamples/transforms/blueprint/gcs_text_to_bigquery.yaml30 # Step 2: Write records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml24 # Step 1: Reading data from KafkaCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml38 # Step 2: Convert Kafka recordsCOMMENT
LOW…ml/examples/transforms/blueprint/kafka_to_iceberg.yaml50 # Step 3: Write records out to IcebergCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml24 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…l/examples/transforms/blueprint/pubsub_to_iceberg.yaml35 # Step 2: Write records out to IcebergCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub subscriptionCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…nsforms/blueprint/pubsub_subscription_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…aml/examples/transforms/blueprint/spanner_to_avro.yaml25 # Step 1: Reading shipment data from Spanner DBCOMMENT
LOW…aml/examples/transforms/blueprint/spanner_to_avro.yaml33 # Step 2: Write successful records out to GCS avro filesCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml25 # Step 1: Reading data from PostgresCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…xamples/transforms/blueprint/postgres_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml25 # Step 1: Reading data from SqlServerCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…amples/transforms/blueprint/sqlserver_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…examples/transforms/blueprint/spanner_to_bigquery.yaml25 # Step 1: Reading data from SpannerCOMMENT
LOW…examples/transforms/blueprint/spanner_to_bigquery.yaml33 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml25 # Step 1: Reading data from MySqlCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml32 # Step 2: Write records out to BigQueryCOMMENT
LOW…l/examples/transforms/blueprint/mysql_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml25 # Step 1: Reading shipment data from jdbc DBCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml32 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…ml/examples/transforms/blueprint/jdbc_to_bigquery.yaml43 # Step 3: Write the failed messages to BQ to a dead letter queue JSON fileCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml25 # Step 1: Reading messages from Pub/Sub topicCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml36 # Step 2: Write successful records out to BigQueryCOMMENT
LOW…les/transforms/blueprint/pubsub_topic_to_bigquery.yaml47 # Step 3: Write the failed messages to BQ to a JSON fileCOMMENT
LOW…o/gcp/bigtable/changestreams/dao/MetadataTableDao.java718 // If the lock is already held we need to check if it was acquired by a duplicateCOMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java98 // Step 1: Find the effective location of the query.COMMENT
LOW…ache/beam/sdk/io/gcp/bigquery/BigQueryQueryHelper.java122 // Step 2: Create a temporary dataset in the query location only if the user has not specifiedCOMMENT
19 more matches not shown…
Redundant / Tautological Comments86 hits · 132 pts
SeverityFileLineSnippetContext
LOWinfra/security/log_analyzer.py140 # Check if the policy is already configuredSTRING
LOWinfra/keys/service_account.py298 # Check if service account exists and get its stateCOMMENT
LOWsdks/go/run_with_go_version.sh74# Check if we've already prepared the Go command. If so, then we don't need toCOMMENT
LOWsdks/go/test/run_validatesrunner_tests.sh353 # Check if Docker daemon is runningCOMMENT
LOWsdks/python/apache_beam/pipeline_test.py658 # Check if inp type hint is Any that we can still inferCOMMENT
LOWsdks/python/apache_beam/pvalue.py296 # Check if we accessed this tag before.COMMENT
LOWsdks/python/apache_beam/dataframe/frames.py1026 # Set dtype to object if more than one valueCOMMENT
LOWsdks/python/apache_beam/dataframe/frames.py3857 # Set dtype to object if more than one valueCOMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py499 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py514 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py529 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py548 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/tfrecordio_test.py567 # Read the file back and compare.COMMENT
LOWsdks/python/apache_beam/io/filesystem_test.py230 # Check if limits are followed correctlyCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py851 # Check if dataset already exists otherwise create itCOMMENT
LOWsdks/python/apache_beam/io/gcp/gcsio_test.py96 # Assign responses to the mock instance itselfCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1611 # Check if individual row exceeds size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1680 # Check if individual row exceeds size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery.py1693 # Check if adding this row would exceed batch size limitCOMMENT
LOWsdks/python/apache_beam/io/gcp/pubsub.py595 # Check if using DirectRunnerCOMMENT
LOWsdks/python/apache_beam/io/gcp/pubsub.py601 # Check if it's a DirectRunner variantCOMMENT
LOWsdks/python/apache_beam/io/gcp/pubsub.py610 # Check if in batch mode (not streaming)COMMENT
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py405 # Check if destination table existsCOMMENT
LOW…s/python/apache_beam/io/gcp/pubsub_integration_test.py176 # Set on_success_matcher to verify pipeline state and pubsub output. TheseCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py218 # Check if all required keys present.COMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py228 # Check if return type is correct.COMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py242 # Check if the element is validCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py370 # Check if the required keys present andCOMMENT
LOWsdks/python/apache_beam/io/gcp/healthcare/dicomio.py540 # Read the file based on different input. If the read fails ,returnCOMMENT
LOWsdks/python/apache_beam/internal/code_object_pickler.py293 # Check if there are any lambdas with the same signature.COMMENT
LOW…/python/apache_beam/testing/analyzers/perf_analysis.py291 # Set this to true while running in production.COMMENT
LOW…ache_beam/testing/analyzers/load_test_perf_analysis.py97 # Set this to true while running in production.STRING
LOWsdks/python/apache_beam/transforms/util.py977 # Check if we should replay a previous batch size due to it not beingCOMMENT
LOWsdks/python/apache_beam/transforms/util.py1441 # Check if adding this element would exceed limitsCOMMENT
LOWsdks/python/apache_beam/transforms/core.py842 # Check if this DoFn's process method has been overriddenCOMMENT
LOWsdks/python/apache_beam/transforms/core.py851 # Check if this DoFn's process_batch method has been overriddenCOMMENT
LOWsdks/python/apache_beam/transforms/util_test.py269 # Check if we're looking at the actual elements being encoded/decodedCOMMENT
LOWsdks/python/apache_beam/transforms/external.py543 # Set it to an empty placeholder type.COMMENT
LOW…thon/apache_beam/ml/inference/huggingface_inference.py669 # Check if the device is specified twice. If true then the device parameterCOMMENT
LOW…les/snippets/transforms/elementwise/enrichment_test.py359 # Check if the test used a container-based external SQL database.COMMENT
LOWsdks/python/apache_beam/yaml/yaml_transform.py800 # Check if any transform has a NON-EMPTY explicit input or output.COMMENT
LOWsdks/python/apache_beam/yaml/yaml_transform.py834 # Check if output is empty, not just present (normalization sets it to {})COMMENT
LOW…s/python/apache_beam/yaml/yaml_transform_scope_test.py108 # Check if target_annotations is a subset of result_annotationsSTRING
LOWsdks/python/apache_beam/yaml/yaml_provider.py920 # Check if elements have different keysCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml19 # Assign timestamp to beam row elementCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml52 # Assign timestamp to beam row element with error_handlingCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml86# Assign timestamp to beam row element with error handling and output schemaCOMMENT
LOW…s/python/apache_beam/yaml/tests/assign_timestamps.yaml129# Assign timestamp to beam row element with error handling and output schemaCOMMENT
LOW…l/sentiment_analysis/streaming_sentiment_analysis.yaml230 # Assign windows to each element of the unbounded PCollection.COMMENT
LOW…sforms/ml/taxi_fare/streaming_taxifare_prediction.yaml68 # Assign windows to each element of the unbounded PCollection.COMMENT
LOW…n/apache_beam/runners/dataflow/ptransform_overrides.py39 # Check if this ParDo uses _PubSubWriteDoFnCOMMENT
LOW…he_beam/runners/interactive/interactive_environment.py182 # Check if [interactive] dependencies are installed.COMMENT
LOW…he_beam/runners/interactive/interactive_environment.py368 # Check if the pipeline is already tracked as a user pipeline before cleanup.COMMENT
LOW…apache_beam/runners/interactive/pipeline_instrument.py63 # Check if the user defined pipeline contains any source to cache.COMMENT
LOW…he_beam/runners/interactive/caching/read_cache_test.py80 # Check if the actual_pipeline uses cache as input of theCOMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py110 # Open the file for 'append-mode' and writing 'bytes'.COMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py186 # Check if we are at EOF or if we have an incomplete line.COMMENT
LOW…he_beam/runners/interactive/caching/streaming_cache.py514 # Loop through the elements with the correct timestamp.COMMENT
LOW…e_beam/runners/interactive/caching/write_cache_test.py66 # Check if the actual_pipeline uses pcoll as an input of a write transform.COMMENT
LOW…python/apache_beam/runners/portability/prism_runner.py362 # Check if the path is a URL.COMMENT
26 more matches not shown…
Modern Structural Boilerplate130 hits · 132 pts
SeverityFileLineSnippetContext
LOWinfra/keys/secret_manager.py269 def update_secret_access(self, secret_id: str, allowed_users: List[str]) -> None:CODE
LOWinfra/enforcement/sending.py144 def update_issue_body(self, issue_number: int, new_body: str) -> None:CODE
LOWsdks/python/apache_beam/pipeline.py112__all__ = ['Pipeline', 'transform_annotations']CODE
LOWsdks/python/apache_beam/pvalue.py56__all__ = [CODE
LOWsdks/python/apache_beam/metrics/metricbase.py39__all__ = [CODE
LOWsdks/python/apache_beam/metrics/metric.py56__all__ = ['Metrics', 'MetricsFilter', 'Lineage']CODE
LOWsdks/python/apache_beam/metrics/cells.py49__all__ = [CODE
LOWsdks/python/apache_beam/options/pipeline_options.py41__all__ = [CODE
LOWsdks/python/apache_beam/options/value_provider.py31__all__ = [CODE
LOWsdks/python/apache_beam/coders/avro_record.py22__all__ = ['AvroRecord']CODE
LOWsdks/python/apache_beam/coders/row_coder.py48__all__ = ["RowCoder"]CODE
LOWsdks/python/apache_beam/coders/coders.py85__all__ = [CODE
LOWsdks/python/apache_beam/coders/typecoders.py75__all__ = ['registry']CODE
LOWsdks/python/apache_beam/dataframe/transforms.py35__all__ = [CODE
LOWsdks/python/apache_beam/dataframe/frames.py58__all__ = [CODE
LOWsdks/python/apache_beam/io/hadoopfilesystem.py43__all__ = ['HadoopFileSystem']CODE
LOWsdks/python/apache_beam/io/filesystems.py99__all__ = ['FileSystems']CODE
LOWsdks/python/apache_beam/io/concat_source_test.py33__all__ = ['RangeSource']CODE
LOWsdks/python/apache_beam/io/filesystemio.py26__all__ = [CODE
LOWsdks/python/apache_beam/io/filebasedsource.py54__all__ = ['FileBasedSource']CODE
LOWsdks/python/apache_beam/io/textio.py45__all__ = [CODE
LOWsdks/python/apache_beam/io/filesystem.py45logger = logging.getLogger(__name__)CODE
LOWsdks/python/apache_beam/io/filesystem.py49__all__ = [CODE
LOWsdks/python/apache_beam/io/kinesis.py93__all__ = [CODE
LOWsdks/python/apache_beam/io/filebasedsink.py43__all__ = ['FileBasedSink']CODE
LOWsdks/python/apache_beam/io/unbounded_source.py116__all__ = [CODE
LOWsdks/python/apache_beam/io/jdbc.py104__all__ = [CODE
LOWsdks/python/apache_beam/io/range_trackers.py30__all__ = [CODE
LOWsdks/python/apache_beam/io/mongodbio.py112__all__ = ["ReadFromMongoDB", "WriteToMongoDB"]CODE
LOWsdks/python/apache_beam/io/avroio.py67__all__ = [CODE
LOWsdks/python/apache_beam/io/source_test_utils.py57__all__ = [CODE
LOWsdks/python/apache_beam/io/requestresponse.py65__all__ = [CODE
LOWsdks/python/apache_beam/io/snowflake.py87__all__ = [CODE
LOWsdks/python/apache_beam/io/tfrecordio.py41__all__ = ['ReadFromTFRecord', 'ReadAllFromTFRecord', 'WriteToTFRecord']CODE
LOWsdks/python/apache_beam/io/localfilesystem.py33__all__ = ['LocalFileSystem']CODE
LOWsdks/python/apache_beam/io/debezium.py92__all__ = ['ReadFromDebezium', 'DriverClassName']CODE
LOWsdks/python/apache_beam/io/iobase.py66__all__ = [CODE
LOWsdks/python/apache_beam/io/parquetio.py70__all__ = [CODE
LOWsdks/python/apache_beam/io/fileio.py120__all__ = [CODE
LOW…s/python/apache_beam/io/azure/blobstoragefilesystem.py30__all__ = ['BlobStorageFileSystem']CODE
LOWsdks/python/apache_beam/io/gcp/gcsio_retry.py39__all__ = ['DEFAULT_RETRY_WITH_THROTTLING_COUNTER']CODE
LOWsdks/python/apache_beam/io/gcp/gcsfilesystem.py39__all__ = ['GCSFileSystem']CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py442__all__ = [CODE
LOWsdks/python/apache_beam/io/gcp/bigtableio.py69__all__ = ['WriteToBigTable', 'ReadFromBigtable']CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py93__all__ = [CODE
LOWsdks/python/apache_beam/io/gcp/pubsub.py59__all__ = [CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py83__all__ = ['ReadBigQueryChangeHistory']CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py262 def set_watermark(self, timestamp: Timestamp) -> None:CODE
LOWsdks/python/apache_beam/io/gcp/gcsio.py54__all__ = ['GcsIO', 'create_storage_client']CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py221__all__ = [CODE
LOW…ks/python/apache_beam/io/gcp/tests/bigquery_matcher.py34__all__ = ['BigqueryMatcher', 'BigQueryTableMatcher']CODE
LOWsdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py30__all__ = ['PubSubMessageMatcher']CODE
LOW…n/apache_beam/io/gcp/datastore/v1new/query_splitter.py28__all__ = ['QuerySplitterError', 'SplitNotPossibleError', 'get_splits']CODE
LOWsdks/python/apache_beam/io/gcp/datastore/v1new/types.py35__all__ = ['Query', 'Key', 'Entity']CODE
LOW…thon/apache_beam/io/gcp/datastore/v1new/datastoreio.py61__all__ = ['ReadFromDatastore', 'WriteToDatastore', 'DeleteFromDatastore']CODE
LOWsdks/python/apache_beam/io/aws/s3filesystem.py30__all__ = ['S3FileSystem']CODE
LOWsdks/python/apache_beam/internal/metrics/metric.py51__all__ = ['Metrics']CODE
LOW…ks/python/apache_beam/internal/cloudpickle/__init__.py8__all__ = [ # noqaCODE
LOWsdks/python/apache_beam/testing/pipeline_verifiers.py37__all__ = [CODE
LOWsdks/python/apache_beam/testing/util.py44__all__ = [CODE
70 more matches not shown…
AI Structural Patterns140 hits · 127 pts
SeverityFileLineSnippetContext
LOWsdks/python/apache_beam/coders/coder_impl.py2160CODE
LOWsdks/python/apache_beam/dataframe/doctests.py631CODE
LOWsdks/python/apache_beam/dataframe/frames.py3878CODE
LOWsdks/python/apache_beam/io/textio.py559CODE
LOWsdks/python/apache_beam/io/textio.py439CODE
LOWsdks/python/apache_beam/io/textio.py606CODE
LOWsdks/python/apache_beam/io/textio.py758CODE
LOWsdks/python/apache_beam/io/textio.py837CODE
LOWsdks/python/apache_beam/io/kinesis.py132CODE
LOWsdks/python/apache_beam/io/kinesis.py227CODE
LOWsdks/python/apache_beam/io/filebasedsink.py65CODE
LOWsdks/python/apache_beam/io/jdbc.py178CODE
LOWsdks/python/apache_beam/io/jdbc.py304CODE
LOWsdks/python/apache_beam/io/avroio.py366CODE
LOWsdks/python/apache_beam/io/source_test_utils.py404CODE
LOWsdks/python/apache_beam/io/snowflake.py128CODE
LOWsdks/python/apache_beam/io/snowflake.py268CODE
LOWsdks/python/apache_beam/io/kafka.py158CODE
LOWsdks/python/apache_beam/io/parquetio.py488CODE
LOWsdks/python/apache_beam/io/parquetio.py651CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_json_it_test.py479CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py529CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py719CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py810CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_tools.py1054CODE
LOWsdks/python/apache_beam/io/gcp/gcsio_test.py196CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py595CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py642CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py967CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py1414CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py1972CODE
LOWsdks/python/apache_beam/io/gcp/bigquery.py2636CODE
LOW…ks/python/apache_beam/io/gcp/bigquery_read_internal.py192CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py198CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py408CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py464CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py520CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py576CODE
LOWsdks/python/apache_beam/io/gcp/spanner.py632CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py643CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py683CODE
LOWsdks/python/apache_beam/io/gcp/bigquery_file_loads.py901CODE
LOW…s/python/apache_beam/io/gcp/bigquery_change_history.py1181CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py679CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py886CODE
LOW…ks/python/apache_beam/io/gcp/experimental/spannerio.py941CODE
LOW…che_beam/io/gcp/healthcare/dicomio_integration_test.py85CODE
LOWsdks/python/apache_beam/io/gcp/tests/utils_test.py233CODE
LOWsdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py52CODE
LOW…io/gcp/internal/clients/bigquery/bigquery_v2_client.py44CODE
LOWsdks/python/apache_beam/io/gcp/datastore/v1new/types.py39CODE
LOW…s/python/apache_beam/io/aws/clients/s3/boto3_client.py201CODE
LOWsdks/python/apache_beam/utils/retry.py234CODE
LOW…s/python/apache_beam/testing/metric_result_matchers.py65CODE
LOWsdks/python/apache_beam/testing/synthetic_pipeline.py255CODE
LOWsdks/python/apache_beam/testing/test_pipeline.py67CODE
LOW…e_beam/testing/benchmarks/chicago_taxi/process_tfma.py33CODE
LOWsdks/python/apache_beam/transforms/ptransform.py1045CODE
LOWsdks/python/apache_beam/transforms/util.py746CODE
LOWsdks/python/apache_beam/transforms/util.py1308CODE
80 more matches not shown…
AI Response Leakage12 hits · 85 pts
SeverityFileLineSnippetContext
HIGH…apache_beam/examples/cookbook/multiple_output_pardo.py57# of the basic wordcount example. In this example wordsCOMMENT
HIGH…rence/pytorch_image_classification_with_side_inputs.py176 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…am/examples/inference/tensorflow_mnist_with_weights.py61 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…/examples/inference/tensorflow_mnist_classification.py94 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…eam/examples/inference/pytorch_image_classification.py135 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…examples/inference/tensorflow_imagenet_segmentation.py101 # In this example we will use the TensorflowHub model URL.COMMENT
HIGH…eam/examples/inference/sklearn_mnist_classification.py106 # In this example we pass keyed inputs to RunInference transform.COMMENT
HIGH…ing-content/core-transforms/side-inputs/description.md117# of the actual elements of pcoll being passed into each process invocation. In this example, side inputs areCOMMENT
HIGH…www/site/content/en/documentation/programming-guide.md2467# of the actual elements of pcoll being passed into each process invocation. In this example, side inputs areCOMMENT
HIGH…ontent/en/documentation/ml/multi-language-inference.md64The preprocessed data is then used to make inference. This is done in the [`RunInference`](https://beam.apache.org/documCODE
HIGH…e/www/site/content/en/blog/apache-hop-with-dataflow.md371Also, depending on your network configuration, you may want to check the box of "Use Public IPs?", or alternatively leavCODE
HIGH…e/www/site/content/en/get-started/wordcount-example.md525# In this example, the DoFns are defined as classes:COMMENT
Fake / Example Data47 hits · 45 pts
SeverityFileLineSnippetContext
LOWinfra/enforcement/iam.py364 github_token = config["github_token"] or "dummy-token"STRING
LOWinfra/enforcement/iam.py398 recipient = config["recipient"] or "admin@example.com"STRING
LOWinfra/enforcement/iam.py402 recipient = config["recipient"] or "admin@example.com"STRING
LOWinfra/enforcement/account_keys.py577 recipient = config["recipient"] or "admin@example.com"STRING
LOWinfra/enforcement/account_keys.py581 recipient = config["recipient"] or "admin@example.com"STRING
LOWinfra/enforcement/account_keys.py543 github_token = config["github_token"] or "dummy-token"STRING
LOW…s/go/test/integration/io/bigqueryio/bigqueryio_test.go54 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…s/go/test/integration/io/bigqueryio/bigqueryio_test.go54 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…go/test/integration/io/xlang/bigquery/bigquery_test.go55 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOW…go/test/integration/io/xlang/bigquery/bigquery_test.go55 text = "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas eget nulla nec " +CODE
LOWsdks/python/apache_beam/dataframe/expressions.py265 super().__init__('placeholder', proxy)CODE
LOW…/gcp/internal/clients/bigquery/bigquery_v2_messages.py702 "userByEmail": "user@example.com", } ] } Please referCODE
LOW…on/apache_beam/testing/analyzers/perf_analysis_test.py273 os.environ['GITHUB_TOKEN'] = 'fake_token'CODE
LOWsdks/python/apache_beam/transforms/external_test.py508 identifier='dummy_id',STRING
LOWsdks/python/apache_beam/transforms/external_test.py516 self.assertEqual('dummy_id', payload_from_bytes.identifier)STRING
LOW…n/apache_beam/ml/inference/anthropic_inference_test.py315 api_key='fake-key',CODE
LOW…n/apache_beam/ml/inference/anthropic_inference_test.py334 api_key='fake-key',CODE
LOW…/python/apache_beam/examples/snippets/snippets_test.py647 self._dummy_token = 'dummy_token'CODE
LOW…/src/test/resources/test_expansion_service_config.yaml24 "dummy_id":CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java135 return "dummy_id";CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java385 .setSpec(createSpec("dummy_id", configRow))CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java427 .setSpec(createSpec("dummy_id", configRow))CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java518 RunnerApi.FunctionSpec spec = createSpec("dummy_id", configRow);CODE
LOW…rvice/ExpansionServiceSchemaTransformProviderTest.java528 RunnerApi.FunctionSpec equivalentSpec = createSpec("dummy_id", equivalentConfigRow);CODE
LOW…ions/euphoria/core/docs/DocumentationExamplesTest.java94 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ",CODE
LOW…ions/euphoria/core/docs/DocumentationExamplesTest.java94 "Lorem ipsum dolor sit amet, consectetur adipiscing elit. ",CODE
LOW…ions/sql/meta/provider/kafka/KafkaTableProviderIT.java278 c.output(KV.of("fake_key", c.element()));CODE
LOW…tent/splittable-dofn/splittable/java-example/Task.java53 PCollection<String> input = pipeline.apply(Create.of("Lorem Ipsum is simply dummy text of the printing and typesCODE
LOW…tent/splittable-dofn/splittable/python-example/task.py65 lines = (p | 'Create' >> beam.Create(["Lorem Ipsum is simply dummy text of the printing and typesetting industry. "CODE
LOW…tent/splittable-dofn/splittable/python-example/task.py66 "Lorem Ipsum has been the industry's standard dummy text ever since the "CODE
LOW…tent/splittable-dofn/splittable/python-example/task.py71 "sheets containing Lorem Ipsum passages, and more recently with desktop "CODE
LOW…tent/splittable-dofn/splittable/python-example/task.py72 "publishing software like Aldus PageMaker including versions of Lorem Ipsum."])CODE
LOW…a/org/apache/beam/it/neo4j/Neo4jResourceManagerIT.java45 Neo4jResourceManager.builder("placeholder")CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java44 Entity.newBuilder().set("name", "John Doe").build(),CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java63 "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build()));CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java71 assertThat(person.getString("name")).isEqualTo("John Doe");CODE
LOW…/beam/it/gcp/datastore/DatastoreResourceManagerIT.java85 "person", ImmutableMap.of(1L, Entity.newBuilder().set("name", "John Doe").build()));CODE
LOWwebsite/CASE_STUDY_TEMPLATE.md34 “Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's CODE
LOWwebsite/CASE_STUDY_TEMPLATE.md59[Lorem Ipsum](https://www.lipsum.com/) is simply dummy text of the printing and typesetting industry. Lorem Ipsum has beCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md65 Lorem Ipsum is simply dummy text of the printing and typesetting industryCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md84Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literatureCODE
LOWwebsite/CASE_STUDY_TEMPLATE.md92Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literatureCODE
LOWwebsite/ADD_CASE_STUDY.md71 text: Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's sCODE
LOWwebsite/www/site/layouts/partials/header.html241 $('input:text').attr('placeholder',"What are you looking for?");CODE
LOW…che/beam/runners/flink/EncodedValueComparatorTest.java57 CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"),CODE
LOW…che/beam/runners/flink/EncodedValueComparatorTest.java56 CoderUtils.encodeToByteArray(coder, "Lorem Ipsum Dolor Omit Longer"),CODE
LOW…org/apache/beam/runners/spark/io/AvroPipelineTest.java63 savedRecord.put("name", "John Doe");CODE
Slop Phrases16 hits · 43 pts
SeverityFileLineSnippetContext
MEDIUM…pache_beam/examples/ml_transform/ml_transform_basic.py160 # To fetch the artifacts produced in MLTransform, you can useCOMMENT
LOW…amples/transforms/ml/enrich_spanner_with_bigquery.yaml79 # Note: Make sure to replace $VARS with your values.COMMENT
MEDIUMsdks/python/container/run_generate_requirements.sh46# Note that you can modify the behavior of the pip install command in this script by passing in your own $PIP_EXTRA_OPTICOMMENT
LOW…rc/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java520 * KafkaIO#write()} and method withValueSerializer() make sure to erase the generic types by castingCOMMENT
MEDIUM…ava/io/hadoop-format/src/test/resources/cassandra.yaml57# initial_token allows you to specify tokens manually. While you can use # it withCOMMENT
MEDIUM…ava/io/hadoop-format/src/test/resources/cassandra.yaml592# you may want to adjust max_value_size_in_mb accordingly.COMMENT
LOW…ava/io/hadoop-format/src/test/resources/cassandra.yaml797# Warning: before enabling this property make sure to ntp is installedCOMMENT
MEDIUM…main/java/org/apache/beam/sdk/jpmstests/WordCount.java107 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
LOW…ain/java/org/apache/beam/it/common/TestProperties.java201 * doing so. The method {@link #getCredentialsStream()} will make sure to search for the specificCOMMENT
MEDIUM…/src/main/java/org/apache/beam/examples/WordCount.java171 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…/org/apache/beam/examples/cookbook/TriggerExample.java202 // file. You may want to adjust the window duration otherwise.COMMENT
MEDIUM…main/java/org/apache/beam/examples/kotlin/WordCount.kt144 * Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…apache/beam/examples/kotlin/cookbook/TriggerExample.kt213 // file. You may want to adjust the window duration otherwise.COMMENT
MEDIUM.github/workflows/codeql.yml73 # If you are analyzing a compiled language, you can modify the 'build-mode' for that language to customize howCOMMENT
MEDIUM…ners/spark/structuredstreaming/examples/WordCount.java99 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
MEDIUM…/org/apache/beam/runners/spark/examples/WordCount.java99 * <p>Concept #4: Defining your own configuration options. Here, you can add your own arguments toCOMMENT
Overly Generic Function Names30 hits · 36 pts
SeverityFileLineSnippetContext
LOW…m/internal/test_data/module_1_lambda_variable_added.py24def my_function():CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py25 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py32 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py39 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py46 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py53 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py60 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py67 def my_method(self):CODE
LOWsdks/python/apache_beam/internal/test_data/module_2.py79 def my_method(self):CODE
LOW…am/internal/test_data/module_1_local_variable_added.py24def my_function():CODE
LOWsdks/python/apache_beam/internal/test_data/module_3.py23def my_function():CODE
LOW…che_beam/internal/test_data/module_1_function_added.py30def my_function():CODE
LOW…on/apache_beam/internal/test_data/module_3_modified.py24def my_function():CODE
LOW…internal/test_data/module_1_nested_function_2_added.py24def my_function():CODE
LOW…m/internal/test_data/module_1_global_variable_added.py26def my_function():CODE
LOW…m/internal/test_data/module_1_nested_function_added.py24def my_function():CODE
LOW…/internal/test_data/module_1_local_variable_removed.py24def my_function():CODE
LOW…apache_beam/internal/test_data/module_1_class_added.py31def my_function():CODE
LOWsdks/python/apache_beam/internal/test_data/module_1.py24def my_function():CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py25 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py33 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py39 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py47 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py53 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py64 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py81 def my_method(self):CODE
LOW…on/apache_beam/internal/test_data/module_2_modified.py88 def my_method(self):CODE
LOWsdks/python/apache_beam/transforms/ptransform_test.py1317 def my_function(*args):CODE
LOW…content/io/kafka-io/kafka-write/python-example/task.py32def process_data(element):CODE
LOW…-content/io/kafka-io/kafka-read/python-example/task.py32def process_data(element):CODE
Modern AI Meta-Vocabulary9 hits · 26 pts
SeverityFileLineSnippetContext
MEDIUMsdks/go/pkg/beam/core/runtime/exec/pcollection_test.go123// BenchmarkPCollection_Baseline measures the baseline of the node benchmarking scaffold.COMMENT
MEDIUM…che_beam/ml/transforms/embeddings/vertex_ai_it_test.py43 # Load the Vertex dependencies last so type resolution still pulls in RAGCOMMENT
MEDIUM…python/apache_beam/examples/ml-orchestration/README.md20# Example ML workflow orchestration with Kubeflow Pipelines and Tensorflow ExtendedCOMMENT
MEDIUM…beam/runners/interactive/user_pipeline_tracker_test.py243 # Intercept shutil.rmtree inside clear() to orchestrate the concurrentCOMMENT
MEDIUM…bsite/www/site/content/en/documentation/ml/overview.md44* [Workflow orchestration](#workflow-orchestration)COMMENT
MEDIUM…bsite/www/site/content/en/documentation/ml/overview.md96## Workflow orchestrationCOMMENT
MEDIUM…/www/site/content/en/documentation/ml/orchestration.md18# Workflow orchestrationCOMMENT
MEDIUM…content/en/documentation/ml/large-language-modeling.md174## RAG and Prompt Engineering in BeamCOMMENT
MEDIUMwebsite/www/site/content/en/case-studies/hsbc.md141Apache Beam provides powerful [transforms](/documentation/programming-guide/#transforms) and orchestration capabilities CODE
Example Usage Blocks16 hits · 24 pts
SeverityFileLineSnippetContext
LOWsdks/go/pkg/beam/core/graph/fn.go450// Example usage:COMMENT
LOWsdks/go/pkg/beam/core/graph/fn.go463// Example usage:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/step.go45// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/step.go148// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go54// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go74// Usage example:COMMENT
LOWsdks/go/pkg/beam/io/synthetic/source.go162// Usage example:COMMENT
LOWsdks/python/apache_beam/io/iobase_it_test.py30# Usage:COMMENT
LOW…he_beam/testing/benchmarks/chicago_taxi/run_chicago.sh23# Example usage:COMMENT
LOW…e_beam/yaml/examples/transforms/io/bigquery_write.yaml27# Usage:COMMENT
LOW…mples/transforms/ml/log_analysis/batch_log_analysis.sh18# Usage:COMMENT
LOW…l/apache_beam_jupyterlab_sidepanel/yaml_parse_utils.py156 # Example usageCOMMENT
LOWsdks/java/build-tools/beam-linkage-check.sh22# Usage:COMMENT
LOW.test-infra/metrics/build_and_publish_containers.sh24# Usage:COMMENT
LOW.test-infra/mock-apis/buf.gen.yaml24# Usage:COMMENT
LOW.test-infra/dataproc/flink_cluster.sh32# Example usage:COMMENT
TODO Padding12 hits · 18 pts
SeverityFileLineSnippetContext
LOW…ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx314 // TODO: implement onChange to update node data from PanelCOMMENT
LOW…e/src/main/java/org/apache/beam/sdk/util/ZipFiles.java82 // TODO: implement size() to try calling entry.getSize()?COMMENT
LOW…/src/main/java/org/apache/beam/sdk/io/cdap/CdapIO.java478 // TODO: implement SparkReceiverIO.<~>write()COMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java180 // TODO: implement logical type date and timestampCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java262 // TODO: implement logical type date and timestampCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java335 // TODO: implement logical date and datetimeCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java372 // TODO: implement logical datetimeCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java387 // TODO: implement logical dateCOMMENT
LOW…va/org/apache/beam/sdk/io/gcp/spanner/StructUtils.java448 // TODO: implement logical dateCOMMENT
LOW…xtensions/sql/meta/provider/FullNameTableProvider.java52 // TODO: implement with trieCOMMENT
LOWlearning/tour-of-beam/backend/auth.go86 // TODO: implement IDToken caching in tb_user to optimize calls to Firebase APICOMMENT
LOW…ker/streaming/sideinput/SideInputStateFetcherTest.java66// TODO: Add tests with different encoded windows to verify version is correctly plumbed.COMMENT
Magic Placeholder Names3 hits · 12 pts
SeverityFileLineSnippetContext
HIGH…python/apache_beam/ml/inference/anthropic_inference.py35 api_key='your-api-key',STRING
HIGH…python/apache_beam/ml/inference/anthropic_inference.py42 api_key='your-api-key',STRING
HIGH…ache/beam/sdk/ml/inference/remote/RemoteInference.java44 * .apiKey("your-api-key")COMMENT
Synthetic Comment Markers1 hit · 8 pts
SeverityFileLineSnippetContext
HIGH…pache_beam/ml/transforms/embeddings/open_ai_it_test.py111 # Check that we get 512-dimensional embeddings as requestedCOMMENT
Cross-Language Confusion (JS/TS)1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH…ons/apache-beam-jupyterlab-sidepanel/src/yaml/Yaml.tsx157print(parse_beam_yaml("""${escapedYaml}""",CODE