Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
This report presents the forensic synthetic code analysis of pathwaycom/pathway, a Python project with 62,670 GitHub stars. SynthScan v2.0 examined 373,868 lines of code across 1393 source files, recording 4169 pattern matches distributed across 22 syntactic categories. The overall adjusted score of 13.4 places this repository in the Low AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 4169 distinct pattern matches across 22 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/conftest.py | 91 | def tmp_path_with_airbyte_config(tmp_path): | CODE |
| LOW | python/pathway/cli.py | 53 | def validate_and_resolve_spawn_args( | CODE |
| LOW | python/pathway/cli.py | 186 | def terminate_process_handles(process_handles: list[subprocess.Popen]): | CODE |
| LOW | python/pathway/udfs.py | 23 | ... async def long_running_async_function(a: int, b: int) -> int: | STRING |
| LOW | python/pathway/io/_synchronization.py | 59 | def register_input_synchronization_group( | CODE |
| LOW | python/pathway/io/_utils.py | 268 | def construct_raw_data_schema_by_flags( | CODE |
| LOW | python/pathway/io/_utils.py | 285 | def construct_schema_and_data_format( | CODE |
| LOW | python/pathway/io/_utils.py | 410 | def check_raw_and_plaintext_only_kwargs_for_message_queues(f): | CODE |
| LOW | python/pathway/io/_utils.py | 619 | def add_column_reference_to_extract( | CODE |
| LOW | python/pathway/io/_utils.py | 660 | def maybe_schema_registry_settings( | CODE |
| LOW | python/pathway/io/python/__init__.py | 331 | def _create_python_datasource( | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 63 | def _ensure_versions_are_consecutive(self): | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 83 | def _create_no_op_version_in_between(self, prev_version: int, current_version: int): | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 273 | def _get_actual_parquet_block_paths(self) -> set[str]: | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 284 | def _remove_obsolete_versions(self, tlog_file_names: list[str]): | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 504 | def _read_table_schema_from_metadata( | CODE |
| LOW | python/pathway/io/bigquery/__init__.py | 42 | def _convert_to_compatible_format(self, row: dict[str, Any]): | CODE |
| LOW | python/pathway/io/gdrive/__init__.py | 137 | def _deduce_list_objects_strategy(self) -> _ListObjectsStrategy: | CODE |
| LOW | python/pathway/io/gdrive/__init__.py | 170 | def _traverse_objects_with_limit(self) -> list[GDriveFile]: | CODE |
| LOW | python/pathway/io/gdrive/__init__.py | 211 | def _detect_objects_with_full_scan(self) -> list[GDriveFile]: | CODE |
| LOW | python/pathway/io/gdrive/__init__.py | 328 | def _prepare_download_request(self, file: GDriveFile) -> Any: | CODE |
| LOW | python/pathway/io/postgres/__init__.py | 131 | def _augment_postgres_settings(settings: dict, unique_name: str | None) -> dict: | CODE |
| LOW | python/pathway/io/postgres/__init__.py | 145 | def _connection_string_from_settings(settings: dict): | CODE |
| LOW | python/pathway/io/postgres/__init__.py | 154 | def _replication_connection_string_from_settings(settings: dict): | CODE |
| LOW | python/pathway/io/postgres/__init__.py | 242 | def _construct_replication_settings( | CODE |
| LOW | python/pathway/io/http/_common.py | 50 | def wait_duration_before_retry(self): | CODE |
| LOW | python/pathway/io/http/_server.py | 217 | def _add_optional_traits_if_present(self, field_description, props): | CODE |
| LOW | python/pathway/io/http/_server.py | 223 | def _construct_openapi_plaintext_schema(self, schema) -> dict: | CODE |
| LOW | python/pathway/io/http/_server.py | 242 | def _construct_openapi_get_request_schema(self, schema) -> list: | CODE |
| LOW | python/pathway/io/http/_server.py | 265 | def _construct_openapi_json_schema(self, schema) -> dict: | CODE |
| LOW | python/pathway/io/http/_server.py | 445 | def _create_request_processor(self): | CODE |
| LOW | python/pathway/io/http/_server.py | 572 | def _wrap_handler_with_logger( | CODE |
| LOW | python/pathway/io/airbyte/logic.py | 89 | def _handle_stream_state_inner(self, stream): | CODE |
| LOW | python/pathway/io/milvus/__init__.py | 69 | def _is_milvus_transient_connect_error(e: Exception) -> bool: | CODE |
| LOW | python/pathway/tests/test_async_transformer.py | 304 | def test_with_instance_work_after_restart(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 348 | def test_fails_whole_instance(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 391 | def test_fails_on_too_many_columns(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 414 | def test_fails_on_not_enough_columns(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 470 | def test_consistent_when_instance_for_key_changes(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 503 | def test_requires_hashable_instance(): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 568 | def test_commits_even_if_blocked_on_processing(tmp_path): | STRING |
| LOW | python/pathway/tests/test_async_transformer.py | 597 | def test_commits_even_if_nothing_to_process(tmp_path): | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 14 | def test_deduplicate_keeps_state(tmp_path: pathlib.Path): | CODE |
| LOW | python/pathway/tests/test_deduplicate.py | 103 | def test_deduplicate_keeps_state_after_two_restarts(tmp_path: pathlib.Path): | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 225 | def test_deduplicate_with_instance_keeps_state(tmp_path: pathlib.Path): | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 303 | def test_deduplicate_keeps_state_after_code_change(tmp_path: pathlib.Path): | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 369 | def test_deduplicate_keeps_state_with_regular_persistence(tmp_path: pathlib.Path): | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 414 | def test_selective_persistence_name_set( | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 485 | def test_selective_persistence_no_name_set_or_different_names_set( | STRING |
| LOW | python/pathway/tests/test_deduplicate.py | 559 | def test_deduplicate_python_tuple(): | STRING |
| LOW | python/pathway/tests/test_io_leann.py | 51 | def test_on_change_deletion_nonexistent_key(tmp_path: pathlib.Path): | CODE |
| LOW | python/pathway/tests/test_io_leann.py | 61 | def test_on_change_skips_empty_text(tmp_path: pathlib.Path): | CODE |
| LOW | python/pathway/tests/test_io_leann.py | 86 | def test_on_change_with_metadata(tmp_path: pathlib.Path): | CODE |
| LOW | python/pathway/tests/test_io_leann.py | 104 | def test_on_time_end_rebuilds_when_dirty(tmp_path: pathlib.Path): | CODE |
| LOW⚡ | python/pathway/tests/test_io_leann.py | 115 | def test_on_end_builds_index_when_dirty(tmp_path: pathlib.Path): | CODE |
| LOW⚡ | python/pathway/tests/test_io_leann.py | 125 | def test_on_end_skips_build_when_not_dirty_and_index_exists(tmp_path: pathlib.Path): | CODE |
| LOW⚡ | python/pathway/tests/test_io_leann.py | 135 | def test_build_index_skips_when_no_documents(tmp_path: pathlib.Path): | CODE |
| LOW⚡ | python/pathway/tests/test_io_leann.py | 144 | def test_build_index_with_documents(tmp_path: pathlib.Path): | CODE |
| LOW | python/pathway/tests/test_io_leann.py | 182 | def test_observer_initialization_via_write_params(tmp_path: pathlib.Path): | CODE |
| LOW⚡ | python/pathway/tests/test_io_leann.py | 203 | def test_check_leann_available_raises_on_missing_package(): | CODE |
| 1641 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/io/gdrive/__init__.py | 41 | "application/vnd.google-apps.document": "application/vnd.openxmlformats-officedocument.wordprocessingml.document", | COMMENT |
| LOW | python/pathway/io/gdrive/__init__.py | 61 | # 1. Traverse the directory using any graph-traversal algorithm, basically making one | COMMENT |
| LOW | python/pathway/io/postgres/__init__.py | 61 | return prefix | COMMENT |
| LOW | python/pathway/io/postgres/__init__.py | 81 | # Detection-time math: with ``keepalives_idle=300`` and | COMMENT |
| LOW | python/pathway/io/postgres/__init__.py | 161 | def enc(v) -> str: | COMMENT |
| LOW | python/pathway/tests/test_graphs.py | 221 | COMMENT | |
| LOW | python/pathway/tests/test_persistence.py | 161 | # A scenario is executed as follows: | COMMENT |
| LOW | python/pathway/tests/test_deltalake.py | 1461 | time_start_5 = int(time.time() * 1000) | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 301 | COMMENT | |
| LOW | python/pathway/tests/test_persistence_iterate.py | 321 | # | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 401 | # Scenario: append new events AFTER all existing ones. | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 421 | # chunk=10 ──────────────────── | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 441 | # | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 461 | # chunk=5 chunk=10 ───────────── | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 481 | # Events 30, 40 switch from chunk 30 → chunk 10. | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 501 | "flip_false_to_true": [ | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 521 | "d": (40, False, "d")}, | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 541 | {"c": (30, True, "c")}, | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 561 | {"x": (55, True, "x")}, # split | COMMENT |
| LOW | python/pathway/tests/test_persistence_iterate.py | 581 | {"c": (30, False, "c"), "d": (40, True, "d")}, | COMMENT |
| LOW | integration_tests/kafka/test_nats.py | 21 | COMMENT | |
| LOW | integration_tests/kafka/test_simple.py | 2481 | # --------------------------------------------------------------------------- | COMMENT |
| LOW | integration_tests/kafka/test_backfilling.py | 41 | # The input topic is fully populated before the program starts and does | COMMENT |
| LOW | integration_tests/kafka/utils.py | 61 | # always transient, so the timeout is generous on purpose. | COMMENT |
| LOW | integration_tests/kafka/utils.py | 81 | # request timed out (rstream's request timeout) before the broker answered; | COMMENT |
| LOW | integration_tests/kafka/utils.py | 321 | def read_topic(self, topic, poll_timeout_ms: int = 1000) -> list[ConsumerRecord]: | COMMENT |
| LOW | integration_tests/kafka/utils.py | 761 | await asyncio.sleep(RABBITMQ_RETRY_INTERVAL) | COMMENT |
| LOW | integration_tests/kafka/utils.py | 881 | # confirmation, so the message is durably committed — in its own stream | COMMENT |
| LOW | integration_tests/db_connectors/conftest.py | 241 | COMMENT | |
| LOW | integration_tests/db_connectors/test_milvus_types.py | 1 | # Copyright © 2026 Pathway | COMMENT |
| LOW | integration_tests/db_connectors/test_mysql.py | 441 | elapsed = time.monotonic() - start | COMMENT |
| LOW | integration_tests/db_connectors/test_mongodb.py | 821 | # knows to delete the persistence directory rather than getting silent | COMMENT |
| LOW | integration_tests/db_connectors/utils.py | 61 | # NeonDB is exposed through the official ``neondatabase/neon_local`` proxy | COMMENT |
| LOW | integration_tests/db_connectors/utils.py | 181 | # Cross-process reader/writer lock for the shared binary log. | COMMENT |
| LOW | integration_tests/db_connectors/utils.py | 261 | COMMENT | |
| LOW | integration_tests/db_connectors/utils.py | 321 | # tightest bound; PostgreSQL handles concurrent replication better, so its cap | COMMENT |
| LOW | integration_tests/db_connectors/utils.py | 341 | # catch-up (which only settles on two empty getMores) can't be kept spinning by | COMMENT |
| LOW | integration_tests/db_connectors/utils.py | 1201 | # The native connector talks to Qdrant over gRPC, so the URL handed to | COMMENT |
| LOW | integration_tests/db_connectors/test_leann.py | 141 | COMMENT | |
| LOW | integration_tests/db_connectors/test_leann.py | 161 | # ) | COMMENT |
| LOW | integration_tests/db_connectors/test_postgres.py | 4961 | augmented = _augment_postgres_settings(user_settings, unique_name="ignored") | COMMENT |
| LOW | tests/integration/test_polling.rs | 1 | // Copyright © 2026 Pathway | COMMENT |
| LOW | tests/integration/test_cached_object_storage.rs | 81 | COMMENT | |
| LOW | …/4.user-guide/40.temporal-data/.window-join/article.py | 1 | # --- | COMMENT |
| LOW | …/4.user-guide/40.temporal-data/.window-join/article.py | 21 | # src: '/assets/content/tutorials/clickstream_window_join/window_join_illustrative.png' | COMMENT |
| LOW | …/4.user-guide/40.temporal-data/.window-join/article.py | 101 | COMMENT | |
| LOW | …poral-data/.interval_join_temporal_behavior/article.py | 1 | # --- | COMMENT |
| LOW | …poral-data/.interval_join_temporal_behavior/article.py | 81 | COMMENT | |
| LOW | …poral-data/.interval_join_temporal_behavior/article.py | 121 | # However, the maximal seen time in the `orders` stream when Frank's order arrived was $128$ | COMMENT |
| LOW | …poral-data/.interval_join_temporal_behavior/article.py | 221 | discounts_with_updates.price, | COMMENT |
| LOW | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 1 | # --- | COMMENT |
| LOW | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 21 | # * `Forward`: It finds the next row in the other table where the time is greater than or equal to the time in the curre | COMMENT |
| LOW | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 41 | # | COMMENT |
| LOW | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 161 | preview_table(merged, time_col="event_t") | COMMENT |
| LOW | …40.temporal-data/.windows_temporal_behavior/article.py | 1 | # --- | COMMENT |
| LOW | …40.temporal-data/.windows_temporal_behavior/article.py | 21 | # | COMMENT |
| LOW | …de/40.temporal-data/.windowby-reduce-manual/article.py | 1 | # --- | COMMENT |
| LOW | ….user-guide/40.temporal-data/.interval-join/article.py | 1 | # --- | COMMENT |
| LOW | ….user-guide/40.temporal-data/.interval-join/article.py | 101 | # Pathway Live Data Framework has a function called `interval_join` (resp. `interval_join_{outer/left/right}`) which you | COMMENT |
| LOW | …uide/20.connect/99.connectors/.fs-connector/article.py | 1 | # --- | COMMENT |
| 855 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/conftest.py | 3 | CODE | |
| LOW | python/pathway/reducers.py | 23 | CODE | |
| LOW | python/pathway/reducers.py | 23 | CODE | |
| LOW | python/pathway/reducers.py | 23 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/reducers.py | 28 | CODE | |
| LOW | python/pathway/universes.py | 34 | CODE | |
| LOW | python/pathway/universes.py | 34 | CODE | |
| LOW | python/pathway/universes.py | 34 | CODE | |
| LOW | python/pathway/__init__.py | 3 | CODE | |
| LOW | python/pathway/__init__.py | 5 | CODE | |
| LOW | python/pathway/__init__.py | 6 | CODE | |
| LOW | python/pathway/__init__.py | 8 | CODE | |
| LOW | python/pathway/__init__.py | 9 | CODE | |
| LOW | python/pathway/__init__.py | 10 | CODE | |
| LOW | python/pathway/__init__.py | 10 | CODE | |
| LOW | python/pathway/__init__.py | 10 | CODE | |
| LOW | python/pathway/__init__.py | 10 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| LOW | python/pathway/__init__.py | 11 | CODE | |
| 566 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | Cargo.toml | 114 | tantivy = "0.22.1" # Note: don't bump this dependency before the RAG integration test failure is investigated | CODE |
| MEDIUM | python/pathway/io/mongodb/__init__.py | 584 | # vectors, for example the output of an embedder UDF in a RAG pipeline. | STRING |
| MEDIUM | python/pathway/tests/test_io_duckdb.py | 431 | # Destination guardrails (Rust-side preflight) | COMMENT |
| MEDIUM | python/pathway/tests/test_io_duckdb.py | 559 | # Rich types & RAG vectors | COMMENT |
| MEDIUM | python/pathway/xpacks/llm/question_answering.py | 774 | ... # define your agent, or custom RAG using any framework or plain Python | STRING |
| MEDIUM | integration_tests/rag_evals/README.md | 1 | # Pathway Live Data Framework RAG evals | COMMENT |
| MEDIUM | integration_tests/db_connectors/test_pinecone.py | 636 | # --- Configuration / type guardrails (validated up front, before any request) --- | COMMENT |
| MEDIUM | …pers/4.user-guide/90.development/10.troubleshooting.md | 106 | ## Common errors with RAG applications | COMMENT |
| MEDIUM | …s/2.developers/4.user-guide/50.llm-xpack/20.llm-app.md | 11 | # Create your own real-time RAG with Pathway Live Data Framework | COMMENT |
| MEDIUM | …s/2.developers/4.user-guide/50.llm-xpack/20.llm-app.md | 33 | ## RAG architecture | COMMENT |
| MEDIUM | …s/2.developers/4.user-guide/50.llm-xpack/20.llm-app.md | 37 | - [**User Query**](#user-queries): A user inputs a query, which could be a question or a request for information. This q | CODE |
| MEDIUM | …s/2.developers/4.user-guide/50.llm-xpack/50.parsers.md | 35 | [`Utf8Parser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.Utf8Parser) is a simple parser | CODE |
| MEDIUM | …s/2.developers/4.user-guide/50.llm-xpack/50.parsers.md | 248 | [`TwelveLabsVideoParser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.TwelveLabsVideoPars | CODE |
| MEDIUM | …2.developers/4.user-guide/50.llm-xpack/70.embedders.md | 20 | - [`MarengoEmbedder`](#marengoembedder) - Embed text with TwelveLabs' multimodal Marengo model, for Video RAG pipelines | CODE |
| MEDIUM | …2.developers/4.user-guide/50.llm-xpack/70.embedders.md | 141 | [`MarengoEmbedder`](/developers/api-docs/pathway-xpacks-llm/embedders#pathway.xpacks.llm.embedders.MarengoEmbedder) embe | STRING |
| MEDIUM | …/2.developers/4.user-guide/50.llm-xpack/10.overview.md | 108 | To combine all the pieces into a [RAG](https://en.wikipedia.org/wiki/Retrieval-augmented_generation) (Retrieval Augmente | CODE |
| MEDIUM | …velopers/4.user-guide/50.llm-xpack/.parsers/parsers.md | 35 | [`Utf8Parser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.Utf8Parser) is a simple parser | CODE |
| MEDIUM | …velopers/4.user-guide/50.llm-xpack/.parsers/parsers.md | 248 | [`TwelveLabsVideoParser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.TwelveLabsVideoPars | CODE |
| MEDIUM | …pers/4.user-guide/50.llm-xpack/.embedders/embedders.md | 20 | - [`MarengoEmbedder`](#marengoembedder) - Embed text with TwelveLabs' multimodal Marengo model, for Video RAG pipelines | CODE |
| MEDIUM | …pers/4.user-guide/50.llm-xpack/.embedders/embedders.md | 141 | [`MarengoEmbedder`](/developers/api-docs/pathway-xpacks-llm/embedders#pathway.xpacks.llm.embedders.MarengoEmbedder) embe | STRING |
| MEDIUM | docs/2.developers/7.templates/30.configure-yaml.md | 8 | # Customizing Pathway Live Data Framework RAG Templates with YAML configuration files | COMMENT |
| MEDIUM | docs/2.developers/7.templates/30.configure-yaml.md | 96 | ## Example: Question-Answering RAG | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 19 | ## Adaptive RAG | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 65 | # Manages the storage and retrieval of documents for the RAG template. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 72 | # Configures the question-answering component using the RAG approach. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 122 | # Manages the storage and retrieval of documents for the RAG template. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 129 | # Configures the question-answering component using the RAG approach. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 179 | # Manages the storage and retrieval of documents for the RAG template. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 186 | # Configures the question-answering component using the RAG approach. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 235 | # Manages the storage and retrieval of documents for the RAG template. | COMMENT |
| MEDIUM | …mplates/39.yaml-snippets/30.full-pipelines-examples.md | 242 | # Configures the question-answering component using the RAG approach. | COMMENT |
| MEDIUM | …ates/39.yaml-snippets/20.rag-configuration-examples.md | 9 | # RAG configuration YAML Examples | COMMENT |
| MEDIUM | …ates/39.yaml-snippets/20.rag-configuration-examples.md | 39 | #### Standard RAG | COMMENT |
| MEDIUM | …ates/39.yaml-snippets/20.rag-configuration-examples.md | 59 | #### Adaptive RAG | COMMENT |
| MEDIUM | …ates/39.yaml-snippets/20.rag-configuration-examples.md | 370 | [`Utf8Parser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.Utf8Parser) is a simple parser | CODE |
| MEDIUM | …ers/7.templates/ETL/_readmes/question-answering-rag.md | 1 | # Retrieval-Augmented Generation (RAG) Pipeline with Pathway | COMMENT |
| MEDIUM | …ers/7.templates/ETL/_readmes/question-answering-rag.md | 28 | ## RAG architecture | COMMENT |
| MEDIUM | …elopers/7.templates/40.rag-customization/30.parsers.md | 35 | [`Utf8Parser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.Utf8Parser) is a simple parser | CODE |
| MEDIUM | …elopers/7.templates/40.rag-customization/30.parsers.md | 248 | [`TwelveLabsVideoParser`](/developers/api-docs/pathway-xpacks-llm/parsers#pathway.xpacks.llm.parsers.TwelveLabsVideoPars | CODE |
| MEDIUM | …lopers/7.templates/40.rag-customization/10.REST-API.md | 9 | # Pathway Live Data Framework RAG REST API | COMMENT |
| MEDIUM | …lopers/7.templates/40.rag-customization/10.REST-API.md | 24 | | [Answer with RAG](#answer-with-rag) | POST | `/v2/answer` | Generate an answer to a query using | CODE |
| MEDIUM | …lopers/7.templates/40.rag-customization/10.REST-API.md | 76 | ## Answer with RAG | COMMENT |
| MEDIUM | …opers/7.templates/40.rag-customization/50.embedders.md | 20 | - [`MarengoEmbedder`](#marengoembedder) - Embed text with TwelveLabs' multimodal Marengo model, for Video RAG pipelines | CODE |
| MEDIUM | …opers/7.templates/40.rag-customization/50.embedders.md | 141 | [`MarengoEmbedder`](/developers/api-docs/pathway-xpacks-llm/embedders#pathway.xpacks.llm.embedders.MarengoEmbedder) embe | STRING |
| MEDIUM | …s/7.templates/40.rag-customization/20.custom-prompt.md | 8 | # Customizing prompts in RAG templates | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 18 | # keywords: ['LLM', 'RAG', 'Adaptive RAG', 'prompt engineering', 'prompt', 'explainability', 'notebook', 'Docker'] | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 23 | # # Adaptive RAG: cut your LLM costs without sacrificing accuracy | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 26 | # <!-- Source for plots: https://github.com/pathwaycom/IoT-Pathway/blob/develop/experimental/szymon/geometric-RAG-plots/ | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 28 | # **TLDR**: We demonstrate how to dynamically adapt the number of documents in a RAG prompt using feedback from the LLM. | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 40 | # Retrieval Augmented Generation (RAG) allows Large Language Models (LLMs) to answer questions based on knowledge not pr | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 42 | # A typical RAG Question Answering procedure works in two steps. First the question is analyzed and a number of relevant | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 44 | # Practical implementations of the RAG procedure need to specify the number of documents put into the prompt. A large nu | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 46 | # Thus the context size, given by the number of considered documents in a RAG setup, must be chosen to balance costs, de | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 54 | # We base our evaluation on the Stanford Question Answering Dataset ([SQUAD](https://rajpurkar.github.io/SQuAD-explorer/ | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 56 | # We form a document knowledge base from all wikipedia paragraphs indexed using their vector representations computed us | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 78 | # The LLM can respond using a paraphrase of the ground-truth answer. To properly score paraphrases we canonicalize answe | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 81 | # The chart below shows a typical relation between accuracy and supporting context size for a RAG question answering sy | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 83 | #  | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 87 | # We can get further insights into the operation of the RAG LLM by performing error analysis: categorizing each error as | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 87 | # We can get further insights into the operation of the RAG LLM by performing error analysis: categorizing each error as | COMMENT |
| 92 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 400 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 404 | # chunk=10 ────────────── chunk=40 ────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 407 | # chunk=70 ───────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 410 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 417 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 421 | # chunk=10 ──────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 425 | # chunk=10 ────── chunk=25 ───────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 429 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 436 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 440 | # chunk=10 ───────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 444 | # chunk=10 ────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 447 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 453 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 457 | # chunk=10 ───────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 461 | # chunk=5 chunk=10 ───────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 465 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 471 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 475 | # chunk=10 ────── chunk=30 ────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 479 | # chunk=10 ──────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 482 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 489 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 493 | # chunk=10 ──────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 497 | # chunk=10 ────── chunk=30 ────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 500 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 507 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 511 | # chunk=10 ──────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 518 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 526 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 530 | # chunk=10 ──────────────────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 537 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 545 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 549 | # chunk=10 ────── chunk=30 ────── chunk=50 ────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 556 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 564 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 568 | # chunk=10 ────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 578 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 586 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 590 | # chunk=10 ────────────── | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 600 | # ----------------------------------------------------------------------- | COMMENT |
| MEDIUM | python/pathway/tests/test_persistence_iterate.py | 303 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | python/pathway/tests/test_persistence_iterate.py | 305 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | python/pathway/tests/test_persistence_iterate.py | 331 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 1402 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | python/pathway/tests/test_persistence_iterate.py | 1406 | # --------------------------------------------------------------------------- | STRING |
| MEDIUM⚡ | integration_tests/iceberg/test_iceberg.py | 1322 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/iceberg/test_iceberg.py | 1326 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM | integration_tests/iceberg/test_iceberg.py | 595 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM | integration_tests/iceberg/test_iceberg.py | 603 | # ---------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2321 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2328 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2374 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2382 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2427 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2434 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2481 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2491 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2537 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2547 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2581 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | integration_tests/kafka/test_simple.py | 2589 | # --------------------------------------------------------------------------- | COMMENT |
| 40 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | python/pathway/tests/test_deduplicate.py | 0 | a | __time__ | __diff__ 1 | 2 | 1 1 | 4 | -1 1 | 6 | 1 2 | 8 | 1 1 | 10 | -1 | STRING |
| HIGH | python/pathway/tests/test_common.py | 0 | a | __time__ | __diff__ 1 | 2 | 1 1 | 4 | -1 1 | 6 | 1 2 | 8 | 1 1 | 10 | -1 | STRING |
| HIGH | python/pathway/tests/test_errors.py | 0 | a | __time__ | __diff__ 1 | 2 | 1 1 | 4 | -1 1 | 6 | 1 2 | 8 | 1 1 | 10 | -1 | STRING |
| HIGH | python/pathway/tests/test_udf.py | 0 | a | __time__ | __diff__ 1 | 2 | 1 1 | 4 | -1 1 | 6 | 1 2 | 8 | 1 1 | 10 | -1 | STRING |
| HIGH | python/pathway/tests/test_streaming_test_utils.py | 0 | a | __time__ | __diff__ 1 | 2 | 1 1 | 4 | -1 1 | 6 | 1 2 | 8 | 1 1 | 10 | -1 | STRING |
| HIGH | python/pathway/tests/test_utils.py | 0 | key | genus | epithet 1 | upupa | epops 2 | acherontia | atropos 3 | bubo | scandiacus | STRING |
| HIGH | python/pathway/tests/test_common.py | 0 | key | genus | epithet 1 | upupa | epops 2 | acherontia | atropos 3 | bubo | scandiacus | STRING |
| HIGH | python/pathway/tests/test_io.py | 0 | key | genus | epithet 1 | upupa | epops 2 | acherontia | atropos 3 | bubo | scandiacus | STRING |
| HIGH | python/pathway/tests/test_common.py | 0 | | pet | owner | age 1 | 7 | bob | 11 2 | 1 | bob | 9 3 | 2 | alice | 8 4 | 1 | bob | 7 | STRING |
| HIGH | python/pathway/tests/test_api.py | 0 | | pet | owner | age 1 | 7 | bob | 11 2 | 1 | bob | 9 3 | 2 | alice | 8 4 | 1 | bob | 7 | STRING |
| HIGH | python/pathway/tests/test_error_messages.py | 0 | | pet | owner | age 1 | 7 | bob | 11 2 | 1 | bob | 9 3 | 2 | alice | 8 4 | 1 | bob | 7 | STRING |
| HIGH | python/pathway/tests/test_build_and_run.py | 0 | | pet | owner | age 1 | 7 | bob | 11 2 | 1 | bob | 9 3 | 2 | alice | 8 4 | 1 | bob | 7 | STRING |
| HIGH | python/pathway/tests/test_common.py | 0 | | a | b | k 0 | 3 | 1 | 1 1 | 4 | 1 | 1 2 | 5 | 3 | 1 3 | 5 | 4 | 1 4 | 1 | 1 | 2 | STRING |
| HIGH | python/pathway/tests/test_errors.py | 0 | | a | b | k 0 | 3 | 1 | 1 1 | 4 | 1 | 1 2 | 5 | 3 | 1 3 | 5 | 4 | 1 4 | 1 | 1 | 2 | STRING |
| HIGH | python/pathway/tests/temporal/test_interval_joins.py | 0 | | a | b | k 0 | 3 | 1 | 1 1 | 4 | 1 | 1 2 | 5 | 3 | 1 3 | 5 | 4 | 1 4 | 1 | 1 | 2 | STRING |
| HIGH | python/pathway/tests/temporal/test_window_joins.py | 0 | | a | b | k 0 | 3 | 1 | 1 1 | 4 | 1 | 1 2 | 5 | 3 | 1 3 | 5 | 4 | 1 4 | 1 | 1 | 2 | STRING |
| HIGH | python/pathway/tests/test_operators.py | 0 | a | __time__ 1 | 2 2 | 2 3 | 2 4 | 2 5 | 2 6 | 2 7 | 2 8 | 2 9 | 6 10 | 8 | STRING |
| HIGH | python/pathway/tests/temporal/test_operators.py | 0 | a | __time__ 1 | 2 2 | 2 3 | 2 4 | 2 5 | 2 6 | 2 7 | 2 8 | 2 9 | 6 10 | 8 | STRING |
| HIGH | python/pathway/tests/temporal/test_asof_joins_stream.py | 0 | a | __time__ 1 | 2 2 | 2 3 | 2 4 | 2 5 | 2 6 | 2 7 | 2 8 | 2 9 | 6 10 | 8 | STRING |
| HIGH | python/pathway/tests/programs/debug.py | 0 | a | __time__ 1 | 2 2 | 2 3 | 2 4 | 2 5 | 2 6 | 2 7 | 2 8 | 2 9 | 6 10 | 8 | STRING |
| HIGH | ….user-guide/30.data-transformation/.iterate/article.py | 0 | a | __time__ 1 | 2 2 | 2 3 | 2 4 | 2 5 | 2 6 | 2 7 | 2 8 | 2 9 | 6 10 | 8 | STRING |
| HIGH | python/pathway/internals/joins.py | 0 | computes a result of a window join. args: args: column references. kwargs: column expressions with their new assigned na | STRING |
| HIGH | python/pathway/stdlib/temporal/_asof_now_join.py | 0 | computes a result of a window join. args: args: column references. kwargs: column expressions with their new assigned na | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 0 | computes a result of a window join. args: args: column references. kwargs: column expressions with their new assigned na | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 0 | computes a result of a window join. args: args: column references. kwargs: column expressions with their new assigned na | STRING |
| HIGH | python/pathway/internals/expressions/numerical.py | 0 | a module containing methods related to string. they can be called using a `str` attribute of an expression. typical use: | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 0 | a module containing methods related to string. they can be called using a `str` attribute of an expression. typical use: | STRING |
| HIGH | python/pathway/internals/expressions/string.py | 0 | a module containing methods related to string. they can be called using a `str` attribute of an expression. typical use: | STRING |
| HIGH | integration_tests/db_connectors/test_chroma.py | 0 | rows with an existing primary key should be replaced, not duplicated. | STRING |
| HIGH | integration_tests/db_connectors/test_pinecone.py | 0 | rows with an existing primary key should be replaced, not duplicated. | STRING |
| HIGH | integration_tests/db_connectors/test_milvus.py | 0 | rows with an existing primary key should be replaced, not duplicated. | STRING |
| HIGH | integration_tests/db_connectors/test_qdrant.py | 0 | rows with an existing primary key should be replaced, not duplicated. | STRING |
| HIGH | integration_tests/db_connectors/test_weaviate.py | 0 | rows with an existing primary key should be replaced, not duplicated. | STRING |
| HIGH | integration_tests/db_connectors/test_chroma.py | 0 | rows with diff=-1 should be removed from the collection. | STRING |
| HIGH | integration_tests/db_connectors/test_milvus.py | 0 | rows with diff=-1 should be removed from the collection. | STRING |
| HIGH | integration_tests/db_connectors/test_qdrant.py | 0 | rows with diff=-1 should be removed from the collection. | STRING |
| HIGH | integration_tests/db_connectors/test_weaviate.py | 0 | rows with diff=-1 should be removed from the collection. | STRING |
| HIGH | integration_tests/db_connectors/test_chroma.py | 0 | writing an empty table should succeed without errors. | STRING |
| HIGH | integration_tests/db_connectors/test_pinecone.py | 0 | writing an empty table should succeed without errors. | STRING |
| HIGH | integration_tests/db_connectors/test_milvus.py | 0 | writing an empty table should succeed without errors. | STRING |
| HIGH | integration_tests/db_connectors/test_qdrant.py | 0 | writing an empty table should succeed without errors. | STRING |
| HIGH | integration_tests/db_connectors/test_weaviate.py | 0 | writing an empty table should succeed without errors. | STRING |
| HIGH | integration_tests/db_connectors/test_chroma.py | 0 | passing a vector column from a different table raises a clear valueerror. | STRING |
| HIGH | integration_tests/db_connectors/test_milvus.py | 0 | passing a vector column from a different table raises a clear valueerror. | STRING |
| HIGH | integration_tests/db_connectors/test_pinecone.py | 0 | passing a vector column from a different table raises a clear valueerror. | STRING |
| HIGH | integration_tests/db_connectors/test_weaviate.py | 0 | passing a vector column from a different table raises a clear valueerror. | STRING |
| HIGH | integration_tests/db_connectors/test_qdrant.py | 0 | passing a vector column from a different table raises a clear valueerror. | STRING |
| HIGH | …2.developers/4.user-guide/50.llm-xpack/80.llm-chats.md | 0 | questions | max_tokens how many 'r' there are in 'strawberry'? | 400 | STRING |
| HIGH | …velopers/4.user-guide/50.llm-xpack/.chats/llm-chats.md | 0 | questions | max_tokens how many 'r' there are in 'strawberry'? | 400 | STRING |
| HIGH | …opers/7.templates/40.rag-customization/60.llm-chats.md | 0 | questions | max_tokens how many 'r' there are in 'strawberry'? | 400 | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/io/deltalake/__init__.py | 76 | except Exception: | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 235 | except Exception: | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 307 | except Exception: | CODE |
| LOW | python/pathway/io/http/_server.py | 483 | except Exception: | CODE |
| LOW | python/pathway/io/http/_server.py | 586 | except Exception: | CODE |
| LOW | python/pathway/io/http/_server.py | 696 | except Exception as e: | CODE |
| LOW | python/pathway/io/pubsub/__init__.py | 48 | except Exception: | CODE |
| LOW | python/pathway/io/airbyte/logic.py | 184 | except Exception: | CODE |
| LOW | python/pathway/io/milvus/__init__.py | 98 | except Exception as e: | CODE |
| MEDIUM | python/pathway/tests/utils.py | 421 | def __call__(self): | CODE |
| MEDIUM | python/pathway/tests/utils.py | 490 | def checker(): | CODE |
| MEDIUM | python/pathway/tests/utils.py | 517 | def __call__(self): | CODE |
| MEDIUM | python/pathway/tests/utils.py | 541 | def __call__(self): | CODE |
| LOW | python/pathway/tests/utils.py | 122 | except Exception as e: | CODE |
| LOW | python/pathway/tests/utils.py | 424 | except Exception: | CODE |
| LOW | python/pathway/tests/utils.py | 498 | except Exception: | CODE |
| LOW | python/pathway/tests/utils.py | 528 | except Exception as exception: | CODE |
| LOW | python/pathway/tests/utils.py | 544 | except Exception as exception: | CODE |
| LOW | …/expressions/test_non_existing_date_time_conversion.py | 303 | except Exception: # FIXME: make conversions work in all cases | CODE |
| LOW | python/pathway/xpacks/connectors/sharepoint/__init__.py | 213 | except Exception as e: | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 984 | except Exception: | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 1287 | except Exception as e: | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 1319 | except Exception as e: | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 1552 | except Exception: | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 1590 | except Exception: # noqa: BLE001 | CODE |
| LOW | python/pathway/xpacks/llm/embedders.py | 64 | except Exception: | CODE |
| LOW | python/pathway/xpacks/llm/embedders.py | 70 | except Exception: | CODE |
| MEDIUM | python/pathway/xpacks/llm/embedders.py | 32 | def _safe_aclose(self): | CODE |
| LOW | python/pathway/xpacks/llm/prompts.py | 319 | except Exception: | STRING |
| LOW | python/pathway/xpacks/llm/tests/test_parsers.py | 23 | except Exception: | CODE |
| LOW | python/pathway/internals/trace.py | 133 | except Exception as e: | CODE |
| LOW | python/pathway/internals/trace.py | 143 | except Exception as e: | CODE |
| MEDIUM | python/pathway/internals/trace.py | 130 | def _pathway_trace_marker(*args, **kwargs): | CODE |
| LOW | python/pathway/internals/udfs/retries.py | 94 | except Exception: | CODE |
| LOW | python/pathway/stdlib/utils/async_transformer.py | 166 | except Exception: | CODE |
| LOW | integration_tests/s3/base.py | 58 | except Exception as exc: | CODE |
| LOW | integration_tests/wordcount/base.py | 470 | except Exception: | CODE |
| LOW | integration_tests/wordcount/base.py | 479 | except Exception: | CODE |
| LOW | integration_tests/rag_evals/experiment.py | 34 | except Exception: | CODE |
| LOW | integration_tests/rag_evals/evaluator.py | 303 | except Exception: | CODE |
| MEDIUM | integration_tests/iceberg/test_iceberg.py | 112 | def __call__(self) -> bool: | CODE |
| MEDIUM | integration_tests/iceberg/test_iceberg.py | 119 | def provide_information_on_failure(self) -> str: | CODE |
| LOW⚡ | integration_tests/iceberg/test_iceberg.py | 116 | except Exception: | CODE |
| LOW⚡ | integration_tests/iceberg/test_iceberg.py | 129 | except Exception as e: | CODE |
| LOW | integration_tests/webserver/test_rest_connector.py | 332 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_rest_connector.py | 559 | except Exception: | CODE |
| MEDIUM | integration_tests/webserver/test_rest_connector.py | 317 | def checker() -> bool: | CODE |
| MEDIUM | integration_tests/webserver/test_rest_connector.py | 552 | def checker() -> bool: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 75 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 289 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 343 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 417 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 461 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 513 | except Exception: | CODE |
| LOW | integration_tests/webserver/test_llm_xpack.py | 551 | except Exception: | CODE |
| MEDIUM | integration_tests/webserver/test_llm_xpack.py | 283 | def checker() -> bool: | CODE |
| MEDIUM | integration_tests/webserver/test_llm_xpack.py | 333 | def checker() -> bool: | CODE |
| MEDIUM | integration_tests/webserver/test_llm_xpack.py | 395 | def checker() -> bool: | CODE |
| LOW | integration_tests/kafka/test_nats.py | 83 | except Exception: | CODE |
| LOW | integration_tests/kafka/test_nats.py | 143 | except Exception: | CODE |
| 86 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/io/iceberg/__init__.py | 183 | Don't forget to run your program with ``pw.run`` once you define all necessary | STRING |
| LOW | python/pathway/io/iceberg/__init__.py | 309 | Don't forget to run your program with ``pw.run`` once you define all necessary | STRING |
| MEDIUM | python/pathway/io/kafka/__init__.py | 129 | Consider a Kafka queue running locally on port 9092. For demonstration purposes, our | STRING |
| MEDIUM | python/pathway/io/kafka/__init__.py | 618 | Consider a Kafka queue running locally on port 9092. For demonstration purposes, our | STRING |
| LOW | python/pathway/io/pubsub/__init__.py | 122 | At last, don't forget to add ``pw.run()`` to run your pipeline. | STRING |
| MEDIUM | …/4.user-guide/40.temporal-data/.window-join/article.py | 124 | # Here's how you can do it: | COMMENT |
| MEDIUM | …poral-data/.interval_join_temporal_behavior/article.py | 22 | # To deliver streaming data in a production system, you can use a connector like Kafka or Redpanda (you can read more ab | COMMENT |
| MEDIUM | …poral-data/.interval_join_temporal_behavior/article.py | 88 | # As such, their orders are not present in the `result` table. If you want to include all orders (also those that can't | COMMENT |
| MEDIUM | …40.temporal-data/.windows_temporal_behavior/article.py | 16 | # The examples in this article use the sliding windows, but you can also use behaviors with tumbling windows. | COMMENT |
| MEDIUM | …40.temporal-data/.windows_temporal_behavior/article.py | 58 | # To that end, you can use sliding windows. To keep things simple, start with a piece of code that only groups data into | COMMENT |
| MEDIUM | ….user-guide/40.temporal-data/.interval-join/article.py | 101 | # Pathway Live Data Framework has a function called `interval_join` (resp. `interval_join_{outer/left/right}`) which you | COMMENT |
| MEDIUM | ….user-guide/40.temporal-data/.interval-join/article.py | 101 | # Pathway Live Data Framework has a function called `interval_join` (resp. `interval_join_{outer/left/right}`) which you | COMMENT |
| MEDIUM | …uide/20.connect/99.connectors/.fs-connector/article.py | 121 | # In most cases, in order to read the data, you need to define its schema and pass it to the connector. Furthermore, for | COMMENT |
| MEDIUM | …velopers/4.user-guide/20.connect/.datatypes/article.py | 80 | # Sometimes you may want to compute a value of a column, using e.g. a function from an external library, that does not d | COMMENT |
| MEDIUM | …velopers/4.user-guide/20.connect/.datatypes/article.py | 156 | # Similarly, as in the conversion between `str` and `bytes`, you can use `apply_with_type` to convert a column of type ` | COMMENT |
| MEDIUM | …velopers/4.user-guide/20.connect/.datatypes/article.py | 187 | # As in the case of conversion from `int` to `float`, you can use `pw.cast` to convert data from type `float` to `int`. | COMMENT |
| MEDIUM | …/4.user-guide/20.connect/.schema_generation/article.py | 80 | # If you have a CSV file with sample data, you can use it to generate a schema in Pathway Live Data Framework. The name | COMMENT |
| MEDIUM | …/4.user-guide/20.connect/.schema_generation/article.py | 101 | # For the example, you can use the default values of the optional arguments, so the Python code is: | COMMENT |
| MEDIUM | …/4.user-guide/20.connect/.schema_generation/article.py | 116 | # To do that, you can use a method in the Schema class called `generate_class` to generate a string with a class definit | COMMENT |
| MEDIUM | …10.introduction/.streaming-and-static-modes/article.py | 33 | # In practice, you would need two input connectors to create T1 and T2, you can use the previous sample of code to build | COMMENT |
| MEDIUM | …pers/4.user-guide/70.migrating/.from_pandas/article.py | 115 | # The arguments to `select` are dynamic; you can use them to define the desired column names and then pass the content. | COMMENT |
| MEDIUM | docs/2.developers/4.user-guide/.sql/article.py | 76 | # With the `SELECT ...` and `WHERE ...` clauses, you can use the following operators: | COMMENT |
| MEDIUM | docs/2.developers/4.user-guide/.sql/article.py | 133 | # With `GROUP BY`, you can use the following aggregation functions: | COMMENT |
| MEDIUM | ….user-guide/30.data-transformation/.iterate/article.py | 315 | # Now you can use the `bellman_ford` in iterate. Note the [`pw.iterate_universe`](/developers/api-docs/pathway#pathway.i | COMMENT |
| MEDIUM | ….user-guide/30.data-transformation/.iterate/article.py | 324 | # If you wish, you can try simulating changes in the graph over time by adding `__time__` and `__diff__` columns to `pw. | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 109 | # Monitoring changes of answers to your queries might not be what you want. Especially if you have **a lot of** queries. | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 157 | # In contrast to an ordinary [`join`](/developers/user-guide/data-transformation/join-manual), `asof_now_join` is not sy | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 177 | # If you don't want answers to your queries to be updated, you can use [`get_nearest_items_asof_now`](/developers/api-do | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 247 | # To receive the queries, you can use the [`rest_connector`](/developers/api-docs/pathway-io/http#pathway.io.http.rest_c | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 274 | # To answer the queries, you can use the `get_nearest_items_asof_now` method of the index. It'll find the nearest points | COMMENT |
| MEDIUM | …/30.data-transformation/.indexes-in-pathway/article.py | 370 | # To intercept messages in a stream, you can use the [`pw.io.subscribe`](/developers/api-docs/pathway-io#pathway.io.subs | COMMENT |
| MEDIUM | …e/30.data-transformation/.async-transformer/article.py | 14 | # However, if the flexibility of the UDFs is still not enough, you can use even more general and flexible `AsyncTransfor | COMMENT |
| MEDIUM | …e/30.data-transformation/.async-transformer/article.py | 203 | # If you want to guarantee an order within a group of records, you can use the `instance` parameter of the `AsyncTransfo | COMMENT |
| MEDIUM | …data-transformation/.user-defined-functions/article.py | 35 | # Now you can use it as an ordinary Pathway Live Data Framework expression, as in the example shown below. | COMMENT |
| MEDIUM | …data-transformation/.user-defined-functions/article.py | 77 | # For example, you can't add a column with type `Any` to a column of type `int` (you also can't add `Any` to `Any`), but | COMMENT |
| MEDIUM | …data-transformation/.user-defined-functions/article.py | 107 | # Also note that the `inc` function is only present in this guide for demonstration purposes. | COMMENT |
| MEDIUM | …data-transformation/.user-defined-functions/article.py | 411 | # Note that accidentally you created a sleepsort. Values in the `finishing` messages are sorted! As an exercise, you can | COMMENT |
| MEDIUM | …r-guide/30.data-transformation/.join-manual/article.py | 125 | # that here, you can use columns of both tables as arguments, e.g. | COMMENT |
| MEDIUM | …r-guide/30.data-transformation/.join-manual/article.py | 479 | # To handle joins using those columns, you can use [`pointer_from`](/developers/api-docs/pathway-table#pathway.Table.poi | COMMENT |
| MEDIUM | …r-guide/30.data-transformation/.join-manual/article.py | 499 | # `join_left` in `people_allergies`, you can use the following: | COMMENT |
| MEDIUM | …2.developers/7.templates/ETL/.option-greeks/article.py | 28 | # The Pathway Live Data Framework comes with an easy-to-use Python API, syntax that is simple and intuitive, and you can | COMMENT |
| MEDIUM | …2.developers/7.templates/ETL/.option-greeks/article.py | 373 | # To compute the average prices for all bids, you can use a simple [groupby/reduce](https://pathway.com/developers/user- | COMMENT |
| MEDIUM | …2.developers/7.templates/ETL/.option-greeks/article.py | 686 | # Furthermore, you can use _[Databento live APIs](https://databento.com/docs/api-reference-live?historical=python&live=p | COMMENT |
| LOW | …2.developers/7.templates/ETL/.option-greeks/article.py | 127 | # To continue, make sure to install all the needed packages. | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 261 | # The value 1224744825 is hand-picked to fit this dataset; you can replace it by any desired value. | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 363 | # To compute the distance, you can use the `pyproj` package, which you can install by uncommenting and executing the fol | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 386 | # Note this is the simple 2-dimensional distance, but you can use your favorite distance metric. | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 398 | # Then, you can use `ix` method to fetch values from corresponding `prev` and `next` rows, and use them to compute the i | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.fuzzy_join_chapter1/article.py | 204 | # If you would like to get some more experience with Pathway Live Data Framework, you can try those two challenges: | COMMENT |
| MEDIUM | …velopers/7.templates/ETL/.live_data_jupyter/article.py | 43 | # Because the Pathway Live Data Framework [unites static and stream processing](/developers/user-guide/connect/switch-fr | COMMENT |
| MEDIUM | …velopers/7.templates/ETL/.live_data_jupyter/article.py | 154 | # The code is analogous to the 20-minute statistics but simpler: you can use a `tumbling window` and don't have to compu | COMMENT |
| MEDIUM | …emplates/ETL/.interval_over_gaussian_filter/article.py | 211 | # To do so, you can use `windowby`, that takes three arguments: | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 299 | # For implementing this example using open source LLMs, here’s a [private RAG app template](https://pathway.com/develope | COMMENT |
| MEDIUM | ….developers/7.templates/rag/.multimodal-rag/article.py | 210 | # default file you can use to test | COMMENT |
| MEDIUM⚡ | …7.templates/rag/.private_rag_ollama_mistral/article.py | 53 | # To tackle this, you can use a **private RAG: locally deployed LLMs and embedders in your RAG pipeline**. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | python/pathway/io/__init__.py | 31 | null, | CODE |
| HIGH | python/pathway/tests/test_errors.py | 1282 | {"a": 7, "b": 1, "c": null} | CODE |
| HIGH | python/pathway/tests/test_io.py | 584 | {"k": "b", "b": 2, "c": null } | CODE |
| HIGH | python/pathway/tests/test_io.py | 261 | assert result.equals(expected) | STRING |
| HIGH | python/pathway/tests/test_io.py | 439 | assert result.equals(expected) | STRING |
| HIGH | python/pathway/tests/test_io.py | 2984 | "_airbyte_data": '{"type": "STREAM", "stream": {"stream_descriptor": {"name": "commits", "namespace": nu | STRING |
| HIGH | python/pathway/tests/test_io.py | 3002 | "_airbyte_data": '{"type": "STREAM", "stream": {"stream_descriptor": {"name": "not_commits", "namespace" | STRING |
| HIGH | python/pathway/tests/test_io.py | 3024 | "_airbyte_data": '{"type": "STREAM", "stream": {"stream_descriptor": {"name": "commits", "namespace": nu | STRING |
| HIGH | python/pathway/tests/test_io.py | 3468 | assert result.equals(expected) | STRING |
| HIGH | python/pathway/tests/test_io.py | 3480 | assert result.equals(expected) | STRING |
| HIGH | python/pathway/tests/test_deltalake.py | 140 | assert final.equals(original) | STRING |
| HIGH | python/pathway/tests/test_deltalake.py | 659 | '{"append_only": false, "description": null, "dtype": {"type": "INT"}, ' | STRING |
| HIGH | python/pathway/tests/utils.py | 500 | return expected.equals(result) | CODE |
| HIGH | python/pathway/tests/test_json.py | 674 | ('"{""a"": 1,""b"": ""foo"", ""c"": null, ""d"": [1,2,3]}"', dict), | CODE |
| HIGH | python/pathway/tests/test_json.py | 691 | ('{"field": 1, "b": "foo", "c": null, "d": [1,2,3]}', dict), | CODE |
| HIGH | python/pathway/internals/expression.py | 333 | - returns `json(null)` for Json | STRING |
| HIGH | python/pathway/stdlib/utils/pandas_transformer.py | 70 | if output_universe_arg_index is not None and not result.index.equals( | CODE |
| HIGH | integration_tests/s3/test_s3_deltalake.py | 196 | assert final.equals(original) | CODE |
| HIGH | integration_tests/s3/test_s3_deltalake.py | 238 | assert final.equals(original) | STRING |
| HIGH | integration_tests/s3/test_s3_generic.py | 102 | assert result.equals(expected) | CODE |
| HIGH | integration_tests/s3/test_s3_generic.py | 218 | assert result.equals(expected) | CODE |
| HIGH | integration_tests/s3/test_s3_generic.py | 275 | assert result.equals(expected) | CODE |
| HIGH | integration_tests/s3/test_s3_generic.py | 308 | assert result.equals(expected) | CODE |
| HIGH | integration_tests/iceberg/test_iceberg.py | 1403 | # `important` is required (non-null) — Pathway must supply it. | COMMENT |
| HIGH | integration_tests/iceberg/test_iceberg.py | 1417 | ), f"error should mention that the column is required / non-null, got: {msg}" | CODE |
| HIGH | integration_tests/iceberg/test_iceberg.py | 1390 | """Existing iceberg table has a required (non-null) column that the user's | STRING |
| HIGH | integration_tests/kafka/test_rabbitmq.py | 140 | # AMQP 1.0 property fields exist (may be null) | COMMENT |
| HIGH | …gration_tests/db_connectors/test_clickhouse_parsing.py | 186 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | integration_tests/db_connectors/test_mssql_parsing.py | 396 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | integration_tests/db_connectors/test_mongodb_parsing.py | 314 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | …tegration_tests/db_connectors/test_postgres_parsing.py | 260 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | …tion_tests/db_connectors/test_elasticsearch_parsing.py | 248 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | integration_tests/db_connectors/test_mysql_parsing.py | 316 | "quote'semicolon;null,./;'l][p!@#!@#!@#%$#$#]", | CODE |
| HIGH | integration_tests/db_connectors/test_postgres.py | 1088 | null, | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | python/pathway/io/_subscribe.py | 26 | Calls a callback function ``on_change`` on every change happening in table. Args: table: the table to | STRING |
| HIGH | python/pathway/io/http/_server.py | 101 | Adds an example to the collection. Args: id: Short and unique ID for the example. It is us | STRING |
| HIGH | python/pathway/io/kafka/__init__.py | 556 | Write a table to a given topic on a Kafka instance. The produced messages consist of the key, corresponding to row' | STRING |
| HIGH | python/pathway/io/pubsub/__init__.py | 62 | Publish the ``table``'s stream of changes into the specified PubSub topic. Please note that ``table`` must consist o | STRING |
| HIGH | python/pathway/io/duckdb/__init__.py | 55 | Writes ``table`` into a table of a `DuckDB <https://duckdb.org/>`_ database file. DuckDB is an in-process analytical | STRING |
| HIGH | python/pathway/internals/table_subscription.py | 189 | Calls a callback function on_change on every change happening in table. This method is similar to the one we ex | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 385 | Returns a number of (nano,micro,milli)seconds from 1970-01-01 for naive DateTime and from 1970-01-01 UTC for tim | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 663 | Converts DateTimeNaive to UTC from time zone provided as `from_timezone` argument. If the given DateTime doesn't | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 753 | Converts DateTimeUtc to time zone specified as `timezone` argument. Args: timezone: The time zone t | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 978 | Rounds DateTime to precision specified by `duration` argument. Args: duration: rounding precision | STRING |
| HIGH | python/pathway/internals/expressions/date_time.py | 1050 | Truncates DateTime to precision specified by `duration` argument. Args: duration: truncation precis | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 65 | Allows testing whether two times are within a certain distance. Note: Usually used as an argument of `.inte | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 589 | Performs an interval join of self with other using a time difference and join expressions. If `self_time + lower_bou | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 793 | Performs an interval join of self with other using a time difference and join expressions. If `self_time + lower_bou | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 992 | Performs an interval left join of self with other using a time difference and join expressions. If `self_time + lowe | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 1209 | Performs an interval right join of self with other using a time difference and join expressions. If `self_time + low | STRING |
| HIGH | python/pathway/stdlib/temporal/_interval_join.py | 1415 | Performs an interval outer join of self with other using a time difference and join expressions. If `self_time + low | STRING |
| HIGH | python/pathway/stdlib/temporal/_window.py | 506 | Allows grouping together elements within a window across ordered time-like data column by locally grouping adjacent | STRING |
| HIGH | python/pathway/stdlib/temporal/_window.py | 571 | Allows grouping together elements within a window of a given length sliding across ordered time-like data column acc | STRING |
| HIGH | python/pathway/stdlib/temporal/_window.py | 645 | Allows grouping together elements within a window of a given length tumbling across ordered time-like data column st | STRING |
| HIGH | python/pathway/stdlib/temporal/_window.py | 706 | Allows grouping together elements within a window. Windows are created for each time t in at, by taking values with | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 167 | Performs a window join of self with other using a window and join expressions. If two records belong to the same win | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 370 | Performs a window join of self with other using a window and join expressions. If two records belong to the same win | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 571 | Performs a window left join of self with other using a window and join expressions. If two records belong to the sam | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 791 | Performs a window right join of self with other using a window and join expressions. If two records belong to the sa | STRING |
| HIGH | python/pathway/stdlib/temporal/_window_join.py | 1006 | Performs a window outer join of self with other using a window and join expressions. If two records belong to the sa | STRING |
| HIGH | python/pathway/stdlib/statistical/_interpolate.py | 62 | Interpolates missing values in a column using the previous and next values based on a timestamps column. Args: | STRING |
| HIGH | python/pathway/stdlib/ordered/diff.py | 16 | Compute the difference between the values in the ``values`` columns and the previous values according to the or | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | integration_tests/db_connectors/utils.py | 329 | # server-side behavior; a fully robust fix would need a resumable (non-temporary) | COMMENT |
| MEDIUM | integration_tests/db_connectors/test_mongodb_parsing.py | 33 | # MSSQL CDC twin of this harness. The streaming reader can live neither on a | COMMENT |
| MEDIUM | …/4.user-guide/40.temporal-data/.window-join/article.py | 122 | # The next step is to calculate the conversion rate, i.e., the proportion of product page visits that resulted in a purc | COMMENT |
| MEDIUM | …/4.user-guide/40.temporal-data/.window-join/article.py | 170 | # And that concludes the demonstration of the comprehensive, data-driven approach to analyzing user behavior and convers | COMMENT |
| MEDIUM | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 36 | # 1. **Temporal Alignment**: Realtime data is time-stamped and is often required to be analyzed in conjunction with oth | COMMENT |
| MEDIUM | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 51 | # In the scope of this tutorial, you will be leveraging data from a public API in a static mode purely for illustrative | COMMENT |
| MEDIUM | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 125 | # During the development and testing stages of your data processing pipeline, it's essential to validate that the data i | COMMENT |
| MEDIUM | …de/40.temporal-data/.windowby-reduce-manual/article.py | 10 | # Pathway Live Data Framework offers powerful features for time series data manipulation. One such feature is the `windo | COMMENT |
| MEDIUM⚡ | …de/40.temporal-data/.windowby-reduce-manual/article.py | 135 | # In this guide, you've mastered the use of the windowby-reduce scheme in the Pathway Live Data Framework library, a rob | COMMENT |
| MEDIUM⚡ | …de/40.temporal-data/.windowby-reduce-manual/article.py | 135 | # In this guide, you've mastered the use of the windowby-reduce scheme in the Pathway Live Data Framework library, a rob | COMMENT |
| MEDIUM⚡ | …de/40.temporal-data/.windowby-reduce-manual/article.py | 135 | # In this guide, you've mastered the use of the windowby-reduce scheme in the Pathway Live Data Framework library, a rob | COMMENT |
| MEDIUM | ….user-guide/40.temporal-data/.interval-join/article.py | 12 | # This article offers a comprehensive tutorial on how to use the interval join function in Pathway Live Data Framework t | COMMENT |
| MEDIUM | …velopers/4.user-guide/20.connect/.datatypes/article.py | 398 | # Below are a few examples demonstrating the `diff` operator. Essentially, it sorts the table with respect to one column | STRING |
| MEDIUM | …velopers/4.user-guide/20.connect/.json_type/article.py | 144 | # You can utilize the [`flatten()`](/developers/api-docs/pathway-table#pathway.internals.table.Table.flatten) operator s | COMMENT |
| MEDIUM | …uide/80.advanced/.declarative_vs_imperative/article.py | 14 | # Many real-world data processing tasks — such as those in logistics, supply chain management, or event stream analysis— | COMMENT |
| MEDIUM | …uide/80.advanced/.declarative_vs_imperative/article.py | 16 | # In data processing, imperative pipelines require you to specify step-by-step instructions for how data should be trans | COMMENT |
| MEDIUM | …opers/4.user-guide/80.advanced/.consistency/article.py | 117 | # Given that money was transferred from one account to another without any external funds entering the system, the total | COMMENT |
| MEDIUM | …r-guide/30.data-transformation/.join-manual/article.py | 508 | # Essentially, for a join `left.join(right, *on)`, `pw.left` allows us to address the `left` table | COMMENT |
| MEDIUM⚡ | …lopers/7.templates/ETL/.merging-time-series/article.py | 97 | # Combining time series is the process of combining different time series into a single time series based on a common ti | COMMENT |
| MEDIUM⚡ | …lopers/7.templates/ETL/.merging-time-series/article.py | 106 | # - Environmental monitoring 🌡️: Combining time series data from air quality sensors, weather stations, and pollutant l | COMMENT |
| MEDIUM⚡ | …lopers/7.templates/ETL/.merging-time-series/article.py | 108 | # - Analyzing stock market data 📈: Combining time series of stock prices, trading volumes, and financial indicators can | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 460 | # By combining these time series, you could create a more comprehensive picture of the conditions affecting your area's | COMMENT |
| MEDIUM | …s/7.templates/ETL/.interval_over_upsampling/article.py | 324 | # Standard digital signal processing systems assume robust sampling and would deal with out-of-order and irregularly sam | COMMENT |
| MEDIUM | …emplates/ETL/.interval_over_gaussian_filter/article.py | 120 | # I will not delve into details: if you are interested you can check out the [Wikipedia article](https://en.wikipedia.or | COMMENT |
| MEDIUM | …emplates/ETL/.interval_over_gaussian_filter/article.py | 496 | # Now that you understand the differences between idealized signal processing and data stream processing, I'm sure you c | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 78 | # The LLM can respond using a paraphrase of the ground-truth answer. To properly score paraphrases we canonicalize answe | COMMENT |
| MEDIUM⚡ | …/2.developers/7.templates/rag/.adaptive-rag/article.py | 78 | # The LLM can respond using a paraphrase of the ground-truth answer. To properly score paraphrases we canonicalize answe | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 62 | # Currently, most [RAG applications](/blog/retrieval-augmented-generation-beginners-guide-rag-apps) are mostly limited t | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 80 | # Multimodal search and Multimodal RAG (MM-RAG) both utilize deep learning models to create an embedding space—a map of | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 111 | # Building a multimodal RAG system for production requires a robust and scalable architecture that can handle diverse da | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 128 | # - **Pathway Live Data Framework**: Provides real-time synchronization, secure document handling, and a robust in-memor | COMMENT |
| MEDIUM⚡ | ….developers/7.templates/rag/.multimodal-rag/article.py | 142 | # 2. **Answering Questions**: Questions are sent to the LLM with the relevant context, including parsed tables. This all | COMMENT |
| MEDIUM | ….developers/7.templates/rag/.multimodal-rag/article.py | 182 | # - **[llm.parsers.DoclingParser](/developers/api-docs/pathway-xpacks-llm/parsers)**: The `DoclingParser` class efficien | COMMENT |
| LOW | examples/projects/option-greeks/greeks-replay.py | 212 | # We now simply add the volatility column, using the `select` operation on a Table. | COMMENT |
| MEDIUM | external/timely-dataflow/timely/src/worker.rs | 28 | /// The `ProgressMode::Demand` variant is the most robust, and least | COMMENT |
| MEDIUM | …l/timely-dataflow/timely/src/dataflow/operators/map.rs | 71 | // TODO : This would be more robust if it captured an iterator and then pulled an appropriate | COMMENT |
| MEDIUM | src/connectors/synchronization.rs | 9 | /// implementation but holding a unique source ID and metadata. Essentially, an accessor | COMMENT |
| MEDIUM | src/connectors/data_storage/aws/kinesis.rs | 173 | // an equal chance to utilize this extra time. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/cli.py | 150 | CODE | |
| LOW | python/pathway/cli.py | 211 | CODE | |
| LOW | python/pathway/io/_utils.py | 285 | CODE | |
| LOW | python/pathway/io/_utils.py | 437 | CODE | |
| LOW | python/pathway/io/deltalake/__init__.py | 193 | CODE | |
| LOW | python/pathway/io/deltalake/__init__.py | 203 | CODE | |
| LOW | python/pathway/io/gdrive/__init__.py | 474 | CODE | |
| LOW | python/pathway/io/postgres/__init__.py | 605 | CODE | |
| LOW | python/pathway/io/http/_server.py | 669 | CODE | |
| LOW | python/pathway/io/pyfilesystem/__init__.py | 49 | CODE | |
| LOW | python/pathway/io/airbyte/logic.py | 58 | CODE | |
| LOW | python/pathway/io/airbyte/logic.py | 177 | CODE | |
| LOW | python/pathway/tests/test_persistence.py | 222 | CODE | |
| LOW | python/pathway/tests/test_io.py | 82 | CODE | |
| LOW | python/pathway/tests/test_io.py | 3573 | CODE | |
| LOW | python/pathway/tests/test_io.py | 4053 | CODE | |
| LOW | python/pathway/tests/test_io.py | 85 | CODE | |
| LOW | python/pathway/tests/test_io.py | 4066 | CODE | |
| LOW | python/pathway/tests/test_io.py | 3594 | CODE | |
| LOW | python/pathway/tests/utils.py | 717 | CODE | |
| LOW | python/pathway/tests/test_unpack_snapshots.py | 58 | CODE | |
| LOW | python/pathway/tests/test_persistence_iterate.py | 615 | CODE | |
| LOW | python/pathway/tests/temporal/test_windows_stream.py | 85 | CODE | |
| LOW | python/pathway/tests/temporal/test_window_joins.py | 25 | CODE | |
| LOW | python/pathway/tests/temporal/test_window_joins.py | 811 | CODE | |
| LOW | python/pathway/xpacks/connectors/sharepoint/__init__.py | 109 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 183 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 525 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 610 | CODE | |
| LOW | python/pathway/xpacks/llm/llms.py | 66 | CODE | |
| LOW | python/pathway/xpacks/llm/llms.py | 830 | CODE | |
| LOW | python/pathway/xpacks/llm/llms.py | 873 | CODE | |
| LOW | python/pathway/xpacks/llm/_parser_utils.py | 312 | CODE | |
| LOW | python/pathway/internals/type_interpreter.py | 158 | CODE | |
| LOW | python/pathway/internals/type_interpreter.py | 502 | CODE | |
| LOW | python/pathway/internals/dtype.py | 643 | CODE | |
| LOW | python/pathway/internals/dtype.py | 841 | CODE | |
| LOW | python/pathway/internals/dtype.py | 881 | CODE | |
| LOW | python/pathway/internals/dtype.py | 90 | CODE | |
| LOW | python/pathway/internals/monitoring.py | 211 | CODE | |
| LOW | python/pathway/internals/joins.py | 621 | CODE | |
| LOW | python/pathway/internals/joins.py | 669 | CODE | |
| LOW | python/pathway/internals/api.py | 132 | CODE | |
| LOW | python/pathway/internals/api.py | 197 | CODE | |
| LOW | python/pathway/internals/arg_handlers.py | 72 | CODE | |
| LOW | python/pathway/internals/arg_handlers.py | 73 | CODE | |
| LOW | python/pathway/internals/custom_reducers.py | 282 | CODE | |
| LOW | python/pathway/internals/custom_reducers.py | 324 | CODE | |
| LOW | python/pathway/internals/custom_reducers.py | 326 | CODE | |
| LOW | python/pathway/internals/table.py | 1192 | CODE | |
| LOW | python/pathway/internals/expression_printer.py | 37 | CODE | |
| LOW | python/pathway/internals/fingerprints.py | 20 | CODE | |
| LOW | python/pathway/internals/column.py | 1064 | CODE | |
| LOW | python/pathway/internals/schema.py | 55 | CODE | |
| LOW | python/pathway/internals/graph_runner/storage_graph.py | 137 | CODE | |
| LOW | python/pathway/internals/graph_runner/__init__.py | 136 | CODE | |
| LOW | python/pathway/internals/graph_runner/__init__.py | 201 | CODE | |
| LOW | python/pathway/internals/graph_runner/telemetry.py | 163 | CODE | |
| LOW | …hon/pathway/internals/graph_runner/operator_handler.py | 104 | CODE | |
| LOW | …rnals/graph_runner/row_transformer_operator_handler.py | 67 | CODE | |
| 44 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/io/_utils.py | 285 | CODE | |
| LOW | python/pathway/io/_utils.py | 437 | CODE | |
| LOW | python/pathway/io/s3/__init__.py | 95 | CODE | |
| LOW | python/pathway/io/s3/__init__.py | 335 | CODE | |
| LOW | python/pathway/io/s3/__init__.py | 489 | CODE | |
| LOW | python/pathway/io/chroma/__init__.py | 27 | CODE | |
| LOW | python/pathway/io/deltalake/__init__.py | 326 | CODE | |
| LOW | python/pathway/io/rabbitmq/__init__.py | 27 | CODE | |
| LOW | python/pathway/io/gdrive/__init__.py | 519 | CODE | |
| LOW | python/pathway/io/minio/__init__.py | 59 | CODE | |
| LOW | python/pathway/io/pinecone/__init__.py | 106 | CODE | |
| LOW | python/pathway/io/redpanda/__init__.py | 19 | CODE | |
| LOW | python/pathway/io/postgres/__init__.py | 284 | CODE | |
| LOW | python/pathway/io/postgres/__init__.py | 605 | CODE | |
| LOW | python/pathway/io/nats/__init__.py | 24 | CODE | |
| LOW | python/pathway/io/http/__init__.py | 28 | CODE | |
| LOW | python/pathway/io/http/__init__.py | 151 | CODE | |
| LOW | python/pathway/io/http/_server.py | 723 | CODE | |
| LOW | python/pathway/io/kafka/__init__.py | 33 | CODE | |
| LOW | python/pathway/io/kafka/__init__.py | 412 | CODE | |
| LOW | python/pathway/io/kafka/__init__.py | 541 | CODE | |
| LOW | python/pathway/io/csv/__init__.py | 18 | CODE | |
| LOW | python/pathway/io/jsonlines/__init__.py | 18 | CODE | |
| LOW | python/pathway/io/airbyte/__init__.py | 112 | CODE | |
| LOW | python/pathway/io/airbyte/logic.py | 51 | CODE | |
| LOW | python/pathway/io/mqtt/__init__.py | 22 | CODE | |
| LOW | python/pathway/io/fs/__init__.py | 32 | CODE | |
| LOW | python/pathway/io/weaviate/__init__.py | 18 | CODE | |
| LOW | python/pathway/tests/test_error_messages.py | 285 | CODE | |
| LOW | …n/pathway/tests/external_index/test_brute_force_knn.py | 60 | CODE | |
| LOW | python/pathway/xpacks/connectors/sharepoint/__init__.py | 267 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 181 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 303 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 891 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 949 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 1181 | CODE | |
| LOW | python/pathway/xpacks/llm/question_answering.py | 1211 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 714 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 878 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 1154 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 1349 | CODE | |
| LOW | python/pathway/xpacks/llm/parsers.py | 1476 | CODE | |
| LOW | python/pathway/xpacks/llm/embedders.py | 678 | CODE | |
| LOW | python/pathway/xpacks/llm/llms.py | 890 | CODE | |
| LOW | python/pathway/xpacks/llm/mcp_server.py | 250 | CODE | |
| LOW | python/pathway/internals/run.py | 13 | CODE | |
| LOW | python/pathway/internals/run.py | 77 | CODE | |
| LOW | python/pathway/internals/thisclass.py | 173 | CODE | |
| LOW | python/pathway/internals/schema.py | 756 | CODE | |
| LOW | python/pathway/internals/schema.py | 927 | CODE | |
| LOW | python/pathway/internals/schema.py | 475 | CODE | |
| LOW | python/pathway/internals/graph_runner/__init__.py | 49 | CODE | |
| LOW | python/pathway/stdlib/temporal/_asof_join.py | 83 | CODE | |
| LOW | python/pathway/stdlib/temporal/time_utils.py | 229 | CODE | |
| LOW | python/pathway/stdlib/temporal/_window.py | 842 | CODE | |
| LOW | python/pathway/stdlib/temporal/_window.py | 356 | CODE | |
| LOW | python/pathway/stdlib/temporal/_window.py | 103 | CODE | |
| LOW | python/pathway/stdlib/utils/pandas_transformer.py | 121 | CODE | |
| LOW | python/pathway/stdlib/utils/col.py | 188 | CODE | |
| LOW | python/pathway/stdlib/utils/col.py | 350 | CODE | |
| 12 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …rs/4.user-guide/60.deployment/20.aws-fargate-deploy.md | 106 | ### Step 1: Login Into AWS CLI | COMMENT |
| LOW | …rs/4.user-guide/60.deployment/20.aws-fargate-deploy.md | 127 | ### Step 2: Register Task Definition In AWS | COMMENT |
| LOW | …rs/4.user-guide/60.deployment/20.aws-fargate-deploy.md | 189 | ### Step 4: Launch The Container | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 172 | ### Step 1: Performing Azure Configuration | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 226 | ### Step 2: Authenticating in Dockerhub | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 242 | ### Step 3: Configuring Backend for Delta Lake Storage | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 263 | ### Step 4: Providing Pathway Live Data Framework License Key and Github PAT | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 278 | ### Step 5: Configuring a Container in Azure Container Instances | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 387 | ### Step 6: Container Group Creation | COMMENT |
| LOW | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 421 | ### Step 7: Launch The Container | COMMENT |
| LOW | …elopers/7.templates/60.deploy/20.aws-fargate-deploy.md | 106 | ### Step 1: Login Into AWS CLI | COMMENT |
| LOW | …elopers/7.templates/60.deploy/20.aws-fargate-deploy.md | 127 | ### Step 2: Register Task Definition In AWS | COMMENT |
| LOW | …elopers/7.templates/60.deploy/20.aws-fargate-deploy.md | 189 | ### Step 4: Launch The Container | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 172 | ### Step 1: Performing Azure Configuration | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 226 | ### Step 2: Authenticating in Dockerhub | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 242 | ### Step 3: Configuring Backend for Delta Lake Storage | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 263 | ### Step 4: Providing Pathway Live Data Framework License Key and Github PAT | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 278 | ### Step 5: Configuring a Container in Azure Container Instances | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 387 | ### Step 6: Container Group Creation | COMMENT |
| LOW | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 421 | ### Step 7: Launch The Container | COMMENT |
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 570 | // Step 0: If logging is enabled, construct and log inbound changes. | COMMENT |
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 594 | // Step 1: Drain `self.input_changes` and determine actual frontier changes. | COMMENT |
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 638 | // Step 2: Circulate implications of changes to `self.pointstamps`. | COMMENT |
| LOW | …ferential-dataflow/mdbook/src/chapter_0/chapter_0_3.md | 1 | ## Step 3: Make things more exciting. | COMMENT |
| LOW | …ferential-dataflow/mdbook/src/chapter_0/chapter_0_2.md | 1 | ## Step 2: Change its input. | COMMENT |
| LOW | …ferential-dataflow/mdbook/src/chapter_0/chapter_0_1.md | 1 | ## Step 1: Write a program. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 349 | // Step 1: The MESSAGES operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 427 | // Step 2: The UPDATES operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 473 | // Step 3: The PROGRESS operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 556 | // Step 4: The FEEDBACK operator. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1452 | // Step 1: record LSN before snapshot read. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1461 | // Step 2: read the full table snapshot. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1464 | // Step 3: record LSN after snapshot read. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1471 | // Step 4: fetch CDC changes that raced with the snapshot read. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1150 | /// Step 1: Record the current CDC max LSN (retry until the capture agent | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1176 | /// Step 2: Read the full table snapshot via a plain SELECT. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1190 | /// Step 3: Record the CDC max LSN again, immediately after the snapshot SELECT. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1299 | /// Step 4: Fetch CDC changes that raced with the snapshot read. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1488 | // Step 5: pick the offset that gets stamped on the snapshot | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1548 | // Step 6: advance last_lsn so poll_cdc_changes starts strictly after | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | …pers/4.user-guide/60.deployment/25.azure-aci-deploy.md | 293 | from azure.core.exceptions import HttpResponseError | CODE |
| CRITICAL | …evelopers/7.templates/60.deploy/25.azure-aci-deploy.md | 293 | from azure.core.exceptions import HttpResponseError | CODE |
| CRITICAL | examples/projects/azure-aci-deploy/launch.py | 6 | from azure.core.exceptions import HttpResponseError | CODE |
| CRITICAL | …differential-dataflow/src/trace/implementations/ord.rs | 315 | let starting_updates = self.result.vals.vals.vals.len(); | CODE |
| CRITICAL | …differential-dataflow/src/trace/implementations/ord.rs | 323 | effort = (self.result.vals.vals.vals.len() - starting_updates) as isize; | CODE |
| CRITICAL | …differential-dataflow/src/trace/implementations/ord.rs | 348 | effort = (self.result.vals.vals.vals.len() - starting_updates) as isize; | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/reducers.py | 47 | __all__ = [ | CODE |
| LOW | python/pathway/universes.py | 40 | __all__ = [ | CODE |
| LOW | python/pathway/__init__.py | 93 | __all__ = [ | CODE |
| LOW | python/pathway/udfs.py | 69 | __all__ = [ | CODE |
| LOW | python/pathway/io/__init__.py | 59 | __all__ = [ | CODE |
| LOW | python/pathway/io/s3/__init__.py | 641 | __all__ = [ | CODE |
| LOW | python/pathway/io/chroma/__init__.py | 185 | __all__ = ["write"] | CODE |
| LOW | python/pathway/io/deltalake/__init__.py | 704 | __all__ = [ | CODE |
| LOW | python/pathway/io/leann/__init__.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | python/pathway/io/leann/__init__.py | 293 | __all__ = ["write"] | CODE |
| LOW | python/pathway/io/pinecone/__init__.py | 336 | __all__ = ["write"] | CODE |
| LOW | python/pathway/io/http/__init__.py | 290 | __all__ = [ | CODE |
| LOW | python/pathway/io/kafka/__init__.py | 784 | __all__ = [ | CODE |
| LOW | python/pathway/io/duckdb/__init__.py | 396 | __all__ = ["write"] | CODE |
| LOW | python/pathway/io/weaviate/__init__.py | 182 | __all__ = ["write"] | CODE |
| LOW | python/pathway/io/elasticsearch/__init__.py | 378 | __all__ = [ | CODE |
| LOW | python/pathway/xpacks/llm/__init__.py | 17 | __all__ = [ | CODE |
| LOW | python/pathway/xpacks/llm/parsers.py | 42 | logger = logging.getLogger(__name__) | CODE |
| LOW | python/pathway/xpacks/llm/embedders.py | 22 | __all__ = [ | CODE |
| LOW | python/pathway/xpacks/llm/llms.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | python/pathway/xpacks/llm/rerankers.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | python/pathway/xpacks/llm/_parser_utils.py | 38 | logger = logging.getLogger(__name__) | CODE |
| LOW | python/pathway/internals/config.py | 142 | def set_license_key(key: str | None) -> None: | CODE |
| LOW | python/pathway/internals/config.py | 193 | __all__ = [ | CODE |
| LOW | python/pathway/internals/dtype.py | 615 | def _set_args(self, wrapped: type) -> None: | CODE |
| LOW | python/pathway/internals/monitoring.py | 206 | def update_monitoring(self, data: Any, now: int) -> None: | CODE |
| LOW | python/pathway/internals/operator.py | 163 | def set_error_log(self, error_log: tables.Table | None) -> None: | CODE |
| LOW | python/pathway/internals/__init__.py | 81 | __all__ = [ | CODE |
| LOW | python/pathway/internals/yaml_loader.py | 236 | __all__ = ["load_yaml"] | CODE |
| LOW | python/pathway/internals/json.py | 256 | __all__ = ["Json", "JsonValue"] | CODE |
| LOW | …pathway/internals/graph_runner/expression_evaluator.py | 151 | def set_temporary_table(self, storage: Storage, table: api.Table) -> None: | CODE |
| LOW | …pathway/internals/graph_runner/expression_evaluator.py | 158 | def set_non_deterministic(self) -> None: | CODE |
| LOW | python/pathway/internals/graph_runner/__init__.py | 285 | __all__ = [ | CODE |
| LOW | python/pathway/internals/graph_runner/state.py | 148 | def set_table(self, storage: Storage, table: api.Table) -> None: | CODE |
| LOW | python/pathway/internals/graph_runner/state.py | 160 | def set_error_log(self, table: table.Table, error_log: api.ErrorLog) -> None: | CODE |
| LOW | python/pathway/internals/udfs/__init__.py | 44 | __all__ = [ | CODE |
| LOW | python/pathway/internals/expressions/__init__.py | 7 | __all__ = ["DateTimeNamespace", "NumericalNamespace", "StringNamespace"] | CODE |
| LOW | python/pathway/stdlib/temporal/__init__.py | 45 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/stateful/__init__.py | 7 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/utils/__init__.py | 7 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/utils/async_transformer.py | 272 | def _set_failure(self, key: Pointer, task_id: Pointer) -> None: | CODE |
| LOW | python/pathway/stdlib/viz/__init__.py | 6 | __all__ = ["plot", "show", "_repr_mimebundle_"] | CODE |
| LOW | python/pathway/stdlib/ml/__init__.py | 7 | __all__ = ["classifiers", "datasets", "hmm", "smart_table_ops", "utils"] | CODE |
| LOW | python/pathway/stdlib/ml/smart_table_ops/__init__.py | 19 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/ml/datasets/__init__.py | 7 | __all__ = ["classification"] | CODE |
| LOW | python/pathway/stdlib/ml/classifiers/__init__.py | 16 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/statistical/__init__.py | 6 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/graphs/__init__.py | 9 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/graphs/pagerank/__init__.py | 7 | __all__ = ["Result", "pagerank"] | CODE |
| LOW | python/pathway/stdlib/graphs/bellman_ford/__init__.py | 7 | __all__ = ["DistFromSource", "Vertex", "bellman_ford"] | CODE |
| LOW | python/pathway/stdlib/indexing/__init__.py | 30 | __all__ = [ | CODE |
| LOW | python/pathway/stdlib/ordered/__init__.py | 6 | __all__ = [ | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …poral-data/.interval_join_temporal_behavior/article.py | 164 | # In this example, a special column `__diff__` is used to tell the Pathway Live Data Framework whether a record | COMMENT |
| HIGH | …10.introduction/.streaming-and-static-modes/article.py | 52 | # In this example, T1 and T2 could be obtained using Kafka connectors, and T2bis and T3 could be output using PostgreSQL | COMMENT |
| HIGH | ….user-guide/30.data-transformation/.iterate/article.py | 71 | # In this example, you are going to use a [Newton method](https://en.wikipedia.org/wiki/Newton%27s_method) to find roots | COMMENT |
| HIGH | ….user-guide/30.data-transformation/.iterate/article.py | 255 | # Another interesting use of `pw.iterate` is computing shortest paths in a graph. In this example, you are going to find | COMMENT |
| HIGH | docs/2.developers/7.templates/30.configure-yaml.md | 281 | Alternatively, you may wish to improve indexing capabilities by using the [HybridIndex](/developers/api-docs/indexing#pa | CODE |
| HIGH | …lopers/7.templates/ETL/.fuzzy_join_chapter1/article.py | 96 | # In this example we will use the `smart_fuzzy_join` function from Pathway Live Data Framework's standard library to mak | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | python/pathway/tests/utils.py | 217 | # This class is an abstract subclass of OnChangeCallback, which takes a list of entries | COMMENT |
| MEDIUM | integration_tests/kafka/utils.py | 763 | # Create a stream and wait until it is fully usable. create_stream returns | COMMENT |
| MEDIUM | …tegration_tests/monitoring/test_detailed_monitoring.py | 51 | # Create an empty metrics db file so dashboard can start | COMMENT |
| MEDIUM | integration_tests/db_connectors/test_mssql.py | 1349 | # Create a table inside the new DB via its own connection. | COMMENT |
| MEDIUM | …s/4.user-guide/40.temporal-data/.asof-join/.article.py | 74 | # Define the list of ticker symbols for the 5 major US companies | COMMENT |
| MEDIUM | ….user-guide/40.temporal-data/.interval-join/article.py | 52 | # Create a maintenance data table | COMMENT |
| MEDIUM | …lopers/7.templates/ETL/.merging-time-series/article.py | 120 | # ## Creating the dataset | COMMENT |
| MEDIUM | …velopers/7.templates/ETL/.live_data_jupyter/article.py | 84 | # Create a streaming data source that replays data in a CSV file. This is an easy way to simulate a live data stream wit | COMMENT |
| MEDIUM | …7.templates/rag/.private_rag_ollama_mistral/article.py | 147 | # Create a table with example questions | COMMENT |
| MEDIUM | examples/projects/conf42/main.py | 39 | # Define the model | COMMENT |
| MEDIUM | examples/templates/el-pipeline/app.yaml | 28 | # Define the Kafka data source using the schema and the configurations. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 570 | // Step 0: If logging is enabled, construct and log inbound changes. | COMMENT |
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 594 | // Step 1: Drain `self.input_changes` and determine actual frontier changes. | COMMENT |
| LOW | …al/timely-dataflow/timely/src/progress/reachability.rs | 638 | // Step 2: Circulate implications of changes to `self.pointstamps`. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 349 | // Step 1: The MESSAGES operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 427 | // Step 2: The UPDATES operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 473 | // Step 3: The PROGRESS operator. | COMMENT |
| LOW | external/differential-dataflow/src/capture.rs | 556 | // Step 4: The FEEDBACK operator. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1452 | // Step 1: record LSN before snapshot read. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1461 | // Step 2: read the full table snapshot. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1464 | // Step 3: record LSN after snapshot read. | COMMENT |
| LOW⚡ | src/connectors/data_storage/mssql.rs | 1471 | // Step 4: fetch CDC changes that raced with the snapshot read. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1150 | /// Step 1: Record the current CDC max LSN (retry until the capture agent | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1176 | /// Step 2: Read the full table snapshot via a plain SELECT. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1190 | /// Step 3: Record the CDC max LSN again, immediately after the snapshot SELECT. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1299 | /// Step 4: Fetch CDC changes that raced with the snapshot read. | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1488 | // Step 5: pick the offset that gets stamped on the snapshot | COMMENT |
| LOW | src/connectors/data_storage/mssql.rs | 1548 | // Step 6: advance last_lsn so poll_cdc_changes starts strictly after | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | python/pathway/io/pinecone/__init__.py | 193 | >>> pc = Pinecone(api_key="YOUR_API_KEY") # doctest: +SKIP | STRING |
| HIGH | python/pathway/io/pinecone/__init__.py | 227 | ... api_key="YOUR_API_KEY", | STRING |
| HIGH | …e/20.connect/99.connectors/90.websockets-connectors.md | 128 | API_KEY = "your-api-key" | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/internals/schema.py | 611 | # Check if self has all columns of other | COMMENT |
| LOW | python/pathway/internals/schema.py | 616 | # Check if types of columns are the same | COMMENT |
| LOW | …de/40.temporal-data/.windowby-reduce-manual/article.py | 82 | # Print the result | COMMENT |
| LOW | …de/40.temporal-data/.windowby-reduce-manual/article.py | 104 | # Print the result | COMMENT |
| LOW⚡ | …de/40.temporal-data/.windowby-reduce-manual/article.py | 129 | # Print the result | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/pathway/tests/ml/test_index.py | 538 | Lorem ipsum dolor sit amet, consectetur adipiscing elit. | 1 | 2 | STRING |
| LOW | python/pathway/tests/ml/test_index.py | 538 | Lorem ipsum dolor sit amet, consectetur adipiscing elit. | 1 | 2 | STRING |
| LOW | python/pathway/xpacks/llm/tests/test_parsers.py | 84 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod" | CODE |
| LOW | python/pathway/xpacks/llm/tests/test_parsers.py | 84 | "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod" | CODE |
| LOW | integration_tests/kafka/conftest.py | 41 | monkeypatch.setenv("AWS_ACCESS_KEY_ID", "placeholder") | CODE |
| LOW | integration_tests/kafka/conftest.py | 42 | monkeypatch.setenv("AWS_SECRET_ACCESS_KEY", "placeholder") | CODE |
| LOW | integration_tests/kafka/utils.py | 473 | aws_access_key_id="placeholder", | CODE |
| LOW | integration_tests/kafka/utils.py | 474 | aws_secret_access_key="placeholder", | CODE |