High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
This report presents the forensic synthetic code analysis of Eventual-Inc/Daft, a Rust project with 5,731 GitHub stars. SynthScan v2.0 examined 509,269 lines of code across 2516 source files, recording 7066 pattern matches distributed across 24 syntactic categories. The overall adjusted score of 18.8 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 7066 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/convert_md_to_notebook.py | 33 | def convert_admonition_to_html(match: re.Match) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 108 | def escape_angle_brackets_in_backticks(content: str) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 124 | def convert_markdown_links_to_html(content: str) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 138 | def convert_code_blocks_to_html(content: str) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 154 | def convert_admonition_to_html_direct(admonition_type: str, title: str | None, content: str) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 274 | def create_colab_badge_markdown(notebook_path: str, branch: str = "main", for_mkdocs: bool = False) -> str: | CODE |
| LOW | tools/convert_md_to_notebook.py | 310 | def update_colab_badge_in_markdown( | CODE |
| LOW | tests/conftest.py | 35 | def get_tests_daft_runner_name() -> Literal["ray"] | Literal["native"]: | CODE |
| LOW | tests/conftest.py | 58 | def __arrow_ext_deserialize__(cls, storage_type, serialized): | CODE |
| LOW⚡ | tests/test_datatypes.py | 419 | def test_datatype_property_access_equals_call(name, expected): | CODE |
| LOW⚡ | tests/test_datatypes.py | 429 | def test_datatype_property_hash_consistency(name, expected): | CODE |
| LOW⚡ | tests/test_datatypes.py | 437 | def test_datatype_property_isinstance(): | CODE |
| LOW⚡ | tests/test_datatypes.py | 501 | def test_datatype_schema_from_field_name_and_types(): | CODE |
| LOW⚡ | tests/test_datatypes.py | 510 | def test_datatype_infer_with_property(): | CODE |
| LOW⚡ | tests/test_datatypes.py | 517 | def test_datatype_property_set_dedup(): | CODE |
| LOW | tests/test_datatypes.py | 90 | def test_subscripted_datatype_parsing(source, expected): | CODE |
| LOW | tests/test_datatypes.py | 190 | def test_is_fixed_size_binary(test_type): | CODE |
| LOW | tests/test_datatypes.py | 217 | def test_is_fixed_shape_image(test_type): | CODE |
| LOW | tests/test_datatypes.py | 235 | def test_is_fixed_shape_tensor(test_type): | CODE |
| LOW | tests/test_datatypes.py | 247 | def test_is_fixed_shape_sparse_tensor(test_type: DataType): | CODE |
| LOW | tests/test_datatypes.py | 311 | def test_struct_fields_property(test_type: DataType): | CODE |
| LOW | tests/test_datatypes.py | 323 | def test_precision_and_scale_properties(test_type): | CODE |
| LOW | tests/test_datatypes.py | 361 | def test_use_offset_indices_property(test_type: DataType): | CODE |
| LOW | tests/test_datatypes.py | 463 | def test_datatype_property_call_is_same_instance(): | CODE |
| LOW | tests/test_datatypes.py | 490 | def test_only_simple_datatype_singletons_are_callable(): | CODE |
| LOW | tests/test_datatypes.py | 536 | def test_datatype_property_dict_key(): | CODE |
| LOW | tests/test_datatypes.py | 551 | def test_datatype_property_repr(): | CODE |
| LOW | tests/test_datatypes.py | 578 | def test_datatype_property_call_returns_datatype(): | CODE |
| LOW | tests/test_datatypes.py | 605 | def test_datatype_property_with_complex_types(): | CODE |
| LOW | tests/test_datatypes.py | 677 | def test_datatype_property_is_methods(): | CODE |
| LOW | tests/test_datatypes.py | 690 | def test_datatype_constructor_names_no_underscore(): | CODE |
| LOW⚡ | tests/test_session.py | 174 | def test_list_namespaces_catalog_qualified_pattern(): | CODE |
| LOW⚡ | tests/test_session.py | 182 | def test_list_namespaces_only_current_catalog_without_pattern(): | CODE |
| LOW⚡ | tests/test_session.py | 191 | def test_list_namespaces_returns_empty_without_current_catalog(): | CODE |
| LOW⚡ | tests/test_session.py | 201 | def test_list_namespaces_round_trips_with_list_tables(): | CODE |
| LOW⚡ | tests/test_session.py | 466 | def test_set_provider_and_current_provider(monkeypatch): | CODE |
| LOW⚡ | tests/test_session.py | 474 | def test_set_provider_with_provider_instance(): | CODE |
| LOW⚡ | tests/test_session.py | 483 | def test_set_provider_with_provider_instance_toplevel(): | CODE |
| LOW | tests/test_session.py | 15 | def test_current_session_exists(): | CODE |
| LOW | tests/test_session.py | 99 | def test_list_tables_returns_identifiers(): | CODE |
| LOW | tests/test_session.py | 111 | def test_list_tables_with_attached_catalog(): | CODE |
| LOW | tests/test_session.py | 121 | def test_list_tables_temp_plus_catalog(): | CODE |
| LOW | tests/test_session.py | 132 | def test_list_tables_catalog_qualified_pattern(): | CODE |
| LOW | tests/test_session.py | 140 | def test_list_tables_narrows_to_current_namespace(): | CODE |
| LOW | tests/test_session.py | 154 | def test_list_tables_only_current_catalog_without_pattern(): | CODE |
| LOW | tests/test_session.py | 163 | def test_list_namespaces_with_attached_catalog(): | CODE |
| LOW | tests/test_session.py | 229 | def test_create_temp_view_replaces_existing(): | CODE |
| LOW | tests/test_session.py | 239 | def test_attach_accepts_dataframe_with_alias(): | CODE |
| LOW | tests/test_session.py | 443 | def test_attach_provider_with_alias(): | CODE |
| LOW | tests/test_session.py | 500 | def test_set_provider_with_provider_instance_replaces_existing(): | CODE |
| LOW | tests/test_session.py | 513 | def test_set_provider_with_provider_instance_twice_raises(): | CODE |
| LOW | tests/test_session.py | 525 | def test_set_provider_with_provider_instance_and_options_raises(): | CODE |
| LOW | tests/test_session.py | 533 | def test_set_provider_with_provider_instance_then_string(): | CODE |
| LOW | tests/test_session.py | 545 | def test_current_session_drop_table(): | CODE |
| LOW | tests/test_session.py | 582 | def test_session_catalog_function_fallback(): | CODE |
| LOW | tests/test_session.py | 603 | def test_session_catalog_function_fallback_raises(): | CODE |
| LOW | tests/test_session.py | 612 | def test_session_function_priority_over_catalog(): | CODE |
| LOW | tests/test_session.py | 635 | def test_dataframe_select_with_catalog_get_function(): | CODE |
| LOW | tests/test_session.py | 654 | def test_catalog_register_cls_udf_from_external_module(): | CODE |
| LOW | tests/test_scarf_telemetry.py | 41 | def test_scarf_telemetry_basic( | CODE |
| 3856 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 26 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 28 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 37 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 39 | # ============================================================================ | COMMENT |
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 44 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | k8s/charts/quickstart/values.yaml | 46 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 11 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 13 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 78 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 80 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 91 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 93 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 105 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 107 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 120 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 122 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 137 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 139 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 171 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 173 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 264 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 266 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 330 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 332 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 349 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 351 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 367 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 369 | # ============================================================================ | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 386 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 388 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 401 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM | k8s/charts/quickstart/values.yaml | 403 | # -------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 101 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 103 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 142 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 144 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 168 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 170 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 291 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 293 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 322 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 324 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 355 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_asof_join_nearest.py | 357 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 15 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 535 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 537 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 636 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/dataframe/test_asof_join_nearest.py | 638 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_checkpoint_commit_helpers.py | 53 | # ── empty_write_result ──────────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_checkpoint_commit_helpers.py | 73 | # ── decode_file_metadata ────────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 104 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 106 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 116 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 118 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 169 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 171 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 238 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_sort_shuffle_elision.py | 240 | # --------------------------------------------------------------------------- | COMMENT |
| 384 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/upload_droid_scene_classifications.py | 20 | CODE | |
| LOW | tools/convert_md_to_notebook.py | 12 | CODE | |
| LOW | tools/trace_to_speedscope.py | 15 | CODE | |
| LOW | tests/conftest.py | 1 | CODE | |
| LOW | tests/conftest.py | 17 | CODE | |
| LOW | tests/test_datatypes.py | 1 | CODE | |
| LOW | tests/test_session.py | 1 | CODE | |
| LOW | tests/test_scarf_telemetry.py | 1 | CODE | |
| LOW | tests/_hf_retry.py | 15 | CODE | |
| LOW | tests/test_schema.py | 1 | CODE | |
| LOW | tests/test_import.py | 1 | CODE | |
| LOW | tests/utils.py | 1 | CODE | |
| LOW | tests/test_subscribers.py | 1 | CODE | |
| LOW | tests/test_trace_to_speedscope.py | 1 | CODE | |
| LOW | tests/test_extension_type.py | 1 | CODE | |
| LOW | tests/test_context.py | 1 | CODE | |
| LOW | tests/test_lazy_import.py | 1 | CODE | |
| LOW | tests/test_size_estimations.py | 1 | CODE | |
| LOW | tests/test_events.py | 1 | CODE | |
| LOW | tests/test_resource_requests.py | 1 | CODE | |
| LOW | tests/test_logger.py | 1 | CODE | |
| LOW | tests/test_datatype_inference.py | 1 | CODE | |
| LOW | tests/series/test_tensor.py | 1 | CODE | |
| LOW | tests/series/test_bitwise.py | 1 | CODE | |
| LOW | tests/series/test_html_repr.py | 3 | CODE | |
| LOW | tests/series/test_list.py | 1 | CODE | |
| LOW | tests/series/test_cast.py | 1 | CODE | |
| LOW | tests/series/test_if_else.py | 1 | CODE | |
| LOW | tests/series/test_filter.py | 1 | CODE | |
| LOW | tests/series/test_image.py | 1 | CODE | |
| LOW | tests/series/__init__.py | 1 | CODE | |
| LOW | tests/series/test_utf8_ops.py | 1 | CODE | |
| LOW | tests/series/test_comparisons.py | 1 | CODE | |
| LOW | tests/series/test_sort.py | 1 | CODE | |
| LOW | tests/series/test_numeric_ops.py | 1 | CODE | |
| LOW | tests/series/test_embedding.py | 1 | CODE | |
| LOW | tests/series/test_size_bytes.py | 1 | CODE | |
| LOW | tests/series/test_take.py | 1 | CODE | |
| LOW | tests/series/test_partitioning.py | 1 | CODE | |
| LOW | tests/series/test_sparse_tensor.py | 1 | CODE | |
| LOW | tests/series/test_hash.py | 1 | CODE | |
| LOW | tests/series/test_try_cast.py | 3 | CODE | |
| LOW | tests/series/test_concat.py | 1 | CODE | |
| LOW | tests/series/test_slice.py | 1 | CODE | |
| LOW | tests/series/test_stddev.py | 1 | CODE | |
| LOW | tests/series/test_fill_null.py | 1 | CODE | |
| LOW | tests/series/test_float.py | 1 | CODE | |
| LOW | tests/series/test_arithmetic.py | 1 | CODE | |
| LOW | tests/series/test_temporal_ops.py | 1 | CODE | |
| LOW | tests/series/test_series.py | 1 | CODE | |
| LOW | tests/series/test_minhash.py | 1 | CODE | |
| LOW | tests/property_based_testing/strategies.py | 1 | CODE | |
| LOW | tests/property_based_testing/test_sort.py | 1 | CODE | |
| LOW | tests/dataframe/test_to_pylist.py | 1 | CODE | |
| LOW | tests/dataframe/test_into_batches.py | 1 | CODE | |
| LOW | tests/dataframe/test_map_groups.py | 1 | CODE | |
| LOW | tests/dataframe/test_into_partitions.py | 1 | CODE | |
| LOW | tests/dataframe/conftest.py | 1 | CODE | |
| LOW | tests/dataframe/test_with_column.py | 1 | CODE | |
| LOW | tests/dataframe/test_transform.py | 1 | CODE | |
| 1350 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | docs/contributing/development.md | 366 | Summary of method Args: arg1: description Returns: return1: description Raises: title (op | STRING |
| HIGH | daft/window.py | 47 | Partitions the dataset by one or more columns or expressions. Args: *cols: Columns or expressions o | STRING |
| HIGH | daft/window.py | 83 | Orders rows within each partition by specified columns or expressions. Args: *cols: Columns or expr | STRING |
| HIGH | daft/window.py | 136 | Restricts each window to a row-based frame between start and end boundaries. This defines a sliding window base | STRING |
| HIGH | daft/window.py | 197 | Restricts each window to a range-based frame between start and end boundaries. This defines a window frame base | STRING |
| HIGH | daft/convert.py | 32 | Creates a DataFrame from a list of dictionaries. Args: data: List of dictionaries, where each key is a colu | STRING |
| HIGH | daft/convert.py | 63 | Creates a DataFrame from a Python dictionary. Args: data: Key -> Sequence[item] of data. Each Key is create | STRING |
| HIGH | daft/convert.py | 97 | Creates a DataFrame from Arrow data. Accepts pyarrow Tables, lists/iterables of pyarrow Tables, or any object i | STRING |
| HIGH | daft/convert.py | 142 | Creates a Daft DataFrame from a pandas DataFrame. Args: data: pandas DataFrame(s) that we wish to convert i | STRING |
| HIGH | daft/convert.py | 177 | Creates a DataFrame from a Ray Dataset. Args: ds: The Ray Dataset to create a Daft DataFrame from. Ret | STRING |
| HIGH | daft/convert.py | 217 | Creates a Daft DataFrame from a Dask DataFrame. The provided Dask DataFrame must have been created using [Dask-on-R | STRING |
| HIGH | daft/convert.py | 261 | Concatenates multiple DataFrames into a single DataFrame. All DataFrames must have exactly the same schema. Ar | STRING |
| HIGH | daft/session.py | 405 | Creates a temp table scoped to this session's lifetime. Args: identifier (str): table identifier (n | STRING |
| HIGH | daft/session.py | 547 | Returns the catalog or raises an exception if it does not exist. Args: identifier (str): catalog id | STRING |
| HIGH | daft/session.py | 561 | Returns the provider or raises an exception if it does not exist. Args: identifier (str): provider | STRING |
| HIGH | daft/session.py | 575 | Returns the table or raises an exception if it does not exist. Args: identifier (Identifier|str): t | STRING |
| HIGH | daft/session.py | 664 | Returns a list of available namespaces. Args: - pattern (str, optional): Pattern to match namespace | STRING |
| HIGH | daft/session.py | 682 | Returns a list of available tables. Args: - pattern (str, optional): Pattern to match table names. | STRING |
| HIGH | daft/session.py | 704 | Returns the table as a DataFrame or raises an exception if it does not exist. Args: identifier (Ide | STRING |
| HIGH | daft/session.py | 1112 | Locate the native library for the current platform in the module's directory. Args: mod (types.ModuleType): | STRING |
| HIGH | daft/dataframe/dataframe.py | 279 | Apply the function to this DataFrame. Args: function (Callable[Concatenate["DataFrame", P], T]): Fu | STRING |
| HIGH | daft/dataframe/dataframe.py | 318 | Prints the (logical and physical) plans that will be executed to produce this DataFrame. Defaults to showing th | STRING |
| HIGH | daft/dataframe/dataframe.py | 533 | Return an iterator of rows for this dataframe. Each row will be a Python dictionary of the form `{ "key" : valu | STRING |
| HIGH | daft/dataframe/dataframe.py | 620 | Return an iterator of pyarrow recordbatches for this dataframe. Args: results_buffer_size: how many | STRING |
| HIGH | daft/dataframe/dataframe.py | 675 | Begin executing this dataframe and return an iterator over the partitions. Each partition will be returned as a | STRING |
| HIGH | daft/dataframe/dataframe.py | 919 | Write the DataFrame to a SQL database and return write metrics. The write is executed via :meth:`daft.DataFrame | STRING |
| HIGH | daft/dataframe/dataframe.py | 1029 | Writes the DataFrame as parquet files, returning a new DataFrame with paths to the files that were written. Fil | STRING |
| HIGH | daft/dataframe/dataframe.py | 1126 | Writes the DataFrame as CSV files, returning a new DataFrame with paths to the files that were written. Files w | STRING |
| HIGH | daft/dataframe/dataframe.py | 1239 | Writes the DataFrame as JSON files, returning a new DataFrame with paths to the files that were written. Files | STRING |
| HIGH | daft/dataframe/dataframe.py | 1338 | Writes the DataFrame to an [Iceberg](https://iceberg.apache.org/docs/nightly/) table, returning a new DataFrame with the | STRING |
| HIGH | daft/dataframe/dataframe.py | 1734 | Writes the DataFrame to an Apache Paimon table, returning a summary DataFrame. Args: table (pypaimo | STRING |
| HIGH | daft/dataframe/dataframe.py | 1782 | Writes the DataFrame to a [Delta Lake](https://docs.delta.io/latest/index.html) table, returning a new DataFrame with th | STRING |
| HIGH | daft/dataframe/dataframe.py | 2308 | Writes the DataFrame to a Lance table. Args: uri: The URI of the Lance table to write to. Accepts a l | STRING |
| HIGH | daft/dataframe/dataframe.py | 2697 | Gets a column from the DataFrame as an Expression (``df["mycol"]``). Args: item (Union[int, str, sl | STRING |
| HIGH | daft/dataframe/dataframe.py | 2797 | Generates a column of monotonically increasing unique ids for the DataFrame. The implementation of this method | STRING |
| HIGH | daft/dataframe/dataframe.py | 2836 | Creates a new DataFrame from the provided expressions, similar to a SQL ``SELECT``. Args: *columns | STRING |
| HIGH | daft/dataframe/dataframe.py | 2925 | Computes distinct rows, dropping duplicates. Optionally, specify a subset of columns to perform distinct on. | STRING |
| HIGH | daft/dataframe/dataframe.py | 2973 | Computes distinct rows, dropping duplicates. Alias for [DataFrame.distinct][daft.DataFrame.distinct]. | STRING |
| HIGH | daft/dataframe/dataframe.py | 3005 | Computes distinct rows, dropping duplicates. Alias for [DataFrame.distinct][daft.DataFrame.distinct]. | STRING |
| HIGH | daft/dataframe/dataframe.py | 3043 | Samples rows from the DataFrame. Args: fraction (Optional[float]): fraction of rows to sample (betw | STRING |
| HIGH | daft/dataframe/dataframe.py | 3115 | Drops columns from the current DataFrame by name. This is equivalent of performing a select with all the column | STRING |
| HIGH | daft/dataframe/dataframe.py | 3149 | Filters rows via a predicate expression, similar to SQL ``WHERE``. Alias for [daft.DataFrame.where][daft.DataFr | STRING |
| HIGH | daft/dataframe/dataframe.py | 3183 | Filters rows via a predicate expression, similar to SQL ``WHERE``. Args: predicate (Expression): ex | STRING |
| HIGH | daft/dataframe/dataframe.py | 3246 | Filter out rows whose key(s) already exist in existing data (i.e., already processed rows). This method reads e | STRING |
| HIGH | daft/dataframe/dataframe.py | 3409 | Adds a column to the current DataFrame with an Expression, equivalent to a ``select`` with all current columns and the n | STRING |
| HIGH | daft/dataframe/dataframe.py | 3444 | Adds columns to the current DataFrame with Expressions, equivalent to a ``select`` with all current columns and the new | STRING |
| HIGH | daft/dataframe/dataframe.py | 3478 | Renames a column in the current DataFrame. If the column in the DataFrame schema does not exist, this will be a | STRING |
| HIGH | daft/dataframe/dataframe.py | 3512 | Renames multiple columns in the current DataFrame. If the columns in the DataFrame schema do not exist, this wi | STRING |
| HIGH | daft/dataframe/dataframe.py | 3550 | Sorts DataFrame globally. Args: by (Union[ColumnInputType, List[ColumnInputType]]): column to sort | STRING |
| HIGH | daft/dataframe/dataframe.py | 3642 | Limits the rows in the DataFrame to the first ``N`` rows, similar to a SQL ``LIMIT``. Args: num (in | STRING |
| HIGH | daft/dataframe/dataframe.py | 3679 | Returns a new DataFrame by skipping the first ``N`` rows, similar to a SQL ``Offset``. Args: num (i | STRING |
| HIGH | daft/dataframe/dataframe.py | 3760 | Repartitions DataFrame to ``num`` partitions. If columns are passed in, then DataFrame will be repartitioned by | STRING |
| HIGH | daft/dataframe/dataframe.py | 3841 | Splits or coalesces DataFrame to partitions of size ``batch_size``. Note: Batch sizing is performed | STRING |
| HIGH | daft/dataframe/dataframe.py | 3880 | Column-wise join of the current DataFrame with an ``other`` DataFrame, similar to a SQL ``JOIN``. If the two Da | STRING |
| HIGH | daft/dataframe/dataframe.py | 3979 | Point-in-time (asof) join: each left row matches the nearest right row according to the chosen strategy. Args: | STRING |
| HIGH | daft/dataframe/dataframe.py | 4082 | Concatenates two DataFrames together in a "vertical" concatenation. The resulting DataFrame has number of rows | STRING |
| HIGH | daft/dataframe/dataframe.py | 4128 | Drops rows that contains NaNs. If cols is None it will drop rows with any NaN value. If column names are suppli | STRING |
| HIGH | daft/dataframe/dataframe.py | 4202 | Drops rows that contains NaNs or NULLs. If cols is None it will drop rows with any NULL value. If column names | STRING |
| HIGH | daft/dataframe/dataframe.py | 4245 | Explodes a List column, where every element in each row's List becomes its own row, and all other columns in the DataFra | STRING |
| HIGH | daft/dataframe/dataframe.py | 4395 | Unpivots a DataFrame from wide to long format. Args: ids (ManyColumnsInputType): Columns to keep as | STRING |
| 190 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/test_size_estimations.py | 209 | # Create a newline delimited JSON file | COMMENT |
| MEDIUM | tests/series/test_html_repr.py | 12 | # Create a string longer than 1MB | COMMENT |
| MEDIUM | tests/series/test_html_repr.py | 67 | # Create a string with unicode characters near the 1MB boundary | COMMENT |
| MEDIUM | tests/series/test_html_repr.py | 88 | # Create a dataframe with the Python object | COMMENT |
| MEDIUM | tests/series/test_html_repr.py | 102 | # Create a list with many elements that would produce a large string | COMMENT |
| MEDIUM | tests/series/test_series.py | 312 | # Create a Series with 1 million elements. | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_into_batches.py | 11 | # Create a dataframe with 64 rows in a single partition | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_into_batches.py | 17 | # Create a UDF that asserts each batch size is exactly 8 | COMMENT |
| MEDIUM | tests/dataframe/test_into_batches.py | 34 | # Create a dataframe with 64 rows split into 64 partitions (1 row each) | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_into_batches.py | 53 | # Create a dataframe with 70 rows (not evenly divisible by 8) | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_into_batches.py | 59 | # Create a UDF that checks batch sizes | COMMENT |
| MEDIUM | tests/dataframe/test_aggregations.py | 910 | # Create a DataFrame with duplicates that will be distributed across partitions | COMMENT |
| MEDIUM | tests/dataframe/test_shuffles.py | 60 | # Create a temporary directory that automatically cleans up | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_repr.py | 404 | # Create a DataFrame and get its RecordBatch | COMMENT |
| MEDIUM⚡ | tests/dataframe/test_repr.py | 408 | # Create a PreviewFormatter and generate interactive HTML | COMMENT |
| MEDIUM | tests/file/test_file_basics.py | 56 | # Create a file in the temporary directory | COMMENT |
| MEDIUM | tests/file/test_file_basics.py | 77 | # Create a simple red image | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_openai.py | 250 | # Create a green square image | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_openai.py | 298 | # Create a temporary image file (yellow square) | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_openai.py | 514 | # Create a red square image | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_openai.py | 518 | # Create a simple PDF file | COMMENT |
| MEDIUM | tests/integration/ai/test_openai.py | 206 | # Create a simple test image (a red square) | COMMENT |
| MEDIUM | tests/integration/ai/test_openai.py | 359 | # Create a simple test image (a blue square) | COMMENT |
| MEDIUM | tests/integration/ai/test_openai.py | 453 | # Create a simple PDF file | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_google.py | 196 | # Create a green square image | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_google.py | 246 | # Create a temporary image file (yellow square) | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_google.py | 462 | # Create a red square image | COMMENT |
| MEDIUM⚡ | tests/integration/ai/test_google.py | 466 | # Create a simple PDF file | COMMENT |
| MEDIUM | tests/integration/ai/test_google.py | 151 | # Create a simple test image (a red square) | COMMENT |
| MEDIUM | tests/integration/ai/test_google.py | 351 | # Create a simple PDF file | COMMENT |
| MEDIUM | tests/integration/ai/test_google.py | 411 | # Create a simple test image (a blue square) | COMMENT |
| MEDIUM | tests/integration/ray/autoscaling_cluster.py | 141 | # Create the autoscaling cluster before ray.init() | COMMENT |
| MEDIUM | tests/integration/sql/test_write_sql.py | 359 | # Create a DataFrame with non-primitive columns (list and struct) | COMMENT |
| MEDIUM⚡ | tests/catalog/test_gravitino.py | 252 | # Create a minimal schema mock | COMMENT |
| MEDIUM⚡ | tests/catalog/test_memory.py | 139 | # Create a namespace | COMMENT |
| MEDIUM⚡ | tests/catalog/test_memory.py | 144 | # Create a table in namespace | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_io.py | 124 | # Create a temporary directory with parquet files to simulate the underlying storage | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_io.py | 126 | # Create a simple DataFrame and save it | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_io.py | 145 | # Create a temporary directory with some files | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_io.py | 153 | # Create a simple parquet file | COMMENT |
| MEDIUM⚡ | tests/io/test_parquet_roundtrip.py | 121 | # Define the expected data type for the tensor column | COMMENT |
| MEDIUM⚡ | tests/io/test_parquet_roundtrip.py | 127 | # Create a Daft DataFrame with the tensor data | COMMENT |
| MEDIUM⚡ | tests/io/test_parquet_roundtrip.py | 210 | # Create an array of random True/False values that are None 10% of the time. | COMMENT |
| MEDIUM⚡ | tests/io/test_parquet_roundtrip.py | 213 | # Create an array of random True/False values. | COMMENT |
| MEDIUM | tests/io/test_turbopuffer_write.py | 60 | # Create a mock turbopuffer module with real exception classes. | COMMENT |
| MEDIUM | tests/io/test_turbopuffer_write.py | 114 | # Create a mock turbopuffer module with real exception classes. | COMMENT |
| MEDIUM | tests/io/test_write_modes.py | 30 | # Create a unique directory in the home directory | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_filesystem.py | 78 | # Create a mock path that returns our gvfs URL | COMMENT |
| MEDIUM⚡ | tests/io/test_gravitino_filesystem.py | 81 | # Create a regular Path object but override __str__ | COMMENT |
| MEDIUM | tests/io/test_gravitino_filesystem.py | 380 | # Create a mock logger to capture the error | COMMENT |
| MEDIUM | tests/io/test_csv.py | 396 | # Create a MicroPartition with date and timestamp columns | COMMENT |
| MEDIUM | tests/io/test_csv.py | 416 | # Create a CSVFileWriter with custom formats | COMMENT |
| MEDIUM | tests/io/test_jsonl_split_ranges.py | 16 | # Create a test JSONL file in tmp_path - simplified format with more rows | COMMENT |
| MEDIUM | tests/io/test_jsonl_split_ranges.py | 84 | # Create a test single-line JSON file in tmp_path - simplified | COMMENT |
| MEDIUM⚡ | tests/io/lancedb/test_lancedb_vector_search.py | 160 | # Create a small index | COMMENT |
| MEDIUM⚡ | tests/cookbook/test_write.py | 199 | # Create a unique path to make sure that the writer is comfortable with nonexistent directories | COMMENT |
| MEDIUM | tests/cookbook/test_write.py | 182 | # Create a unique path to make sure that the writer is comfortable with nonexistent directories | COMMENT |
| MEDIUM | tests/recordbatch/image/test_decode.py | 28 | # Create an 8-bit grayscale image | COMMENT |
| MEDIUM | tests/recordbatch/image/test_decode.py | 34 | # Create a 16-bit grayscale image (TIFF format supports 16-bit) | COMMENT |
| MEDIUM | tests/ai/google/test_google_prompter.py | 520 | # Create a dummy numpy array image | COMMENT |
| 57 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/conftest.py | 105 | assert df1.equals(df2) | CODE |
| HIGH | tests/series/test_cast.py | 398 | assert t.list.length().to_pylist() == [3, 3, 3, 3, 2, 2, None] | CODE |
| HIGH | tests/series/test_cast.py | 427 | assert t.list.length().to_pylist() == [3, 3, 3, 3, 3, 3, None] | CODE |
| HIGH | tests/series/test_cast.py | 459 | assert t.list.length().to_pylist() == [3, 3, 3, 3, 3, 3, None] | CODE |
| HIGH | tests/series/test_cast.py | 481 | assert t.list.length().to_pylist() == [3, 3, 3, None] | CODE |
| HIGH | tests/series/test_cast.py | 506 | assert t.list.length().to_pylist() == [12, 27, None] | CODE |
| HIGH | tests/series/test_cast.py | 540 | assert t.list.length().to_pylist() == [6, 27, None] | CODE |
| HIGH | tests/series/test_cast.py | 581 | assert t.list.length().to_pylist() == [12, 12, None] | CODE |
| HIGH⚡ | tests/series/test_utf8_ops.py | 266 | result = s.str.length() | CODE |
| HIGH⚡ | tests/series/test_utf8_ops.py | 272 | result = s.str.length() | CODE |
| HIGH⚡ | tests/series/test_utf8_ops.py | 278 | result = s.str.length() | CODE |
| HIGH⚡ | tests/series/test_utf8_ops.py | 284 | result = s.str.length() | CODE |
| HIGH⚡ | tests/series/test_utf8_ops.py | 290 | result = s.str.length() | CODE |
| HIGH | tests/dataframe/test_asof_join_nearest.py | 218 | """A group with no right rows produces null; other groups still match correctly.""" | STRING |
| HIGH⚡ | tests/dataframe/test_window_first_last_value.py | 333 | # Trailing nulls: last element is null, so all rows see null | COMMENT |
| HIGH | tests/dataframe/test_creation.py | 972 | ['{"foo": {}}', '{"foo":null}'], | CODE |
| HIGH | tests/integration/test_file_udfs_s3.py | 45 | expected = df.select(df["path"].download().binary.length()).to_pydict() | CODE |
| HIGH | tests/integration/iceberg/test_glue_iceberg.py | 110 | assert read_back_pd.equals(df_pd), "Did not write data correctly to Glue Iceberg table" | STRING |
| HIGH | tests/io/test_parquet_roundtrip.py | 271 | assert ba.equals(aa, check_metadata=False) | CODE |
| HIGH⚡ | tests/recordbatch/test_from_py.py | 699 | assert result.equals(arrow_arr) | CODE |
| HIGH⚡ | tests/recordbatch/test_from_py.py | 707 | assert result.equals(arrow_arr) | CODE |
| HIGH⚡ | tests/recordbatch/test_from_py.py | 715 | assert result.equals(arrow_arr) | CODE |
| HIGH⚡ | tests/recordbatch/test_from_py.py | 723 | assert result.equals(arrow_arr) | CODE |
| HIGH | tests/recordbatch/test_from_py.py | 749 | assert result.equals(arrow_arr) | CODE |
| HIGH | tests/window/test_running_agg.py | 686 | """Test all three count modes (all, valid, null).""" | STRING |
| HIGH | tests/expressions/test_to_arrow_expr.py | 189 | # (lit("hello").str.length(), "utf8_length('hello')"), | COMMENT |
| HIGH | tests/expressions/typing/test_logical.py | 44 | # NOT is resolvable for bool and null; `NOT (NULL)` is valid SQL and evaluates to NULL. | COMMENT |
| HIGH⚡ | tests/functions/json/test_json_funcs.py | 20 | "[null, null]", | CODE |
| HIGH⚡ | tests/functions/json/test_jq.py | 9 | '{ "a": null, "b": true, "c": 1, "d": 1.1, "e": "ABC" }', | CODE |
| HIGH⚡ | tests/functions/json/test_jq.py | 10 | '{ "a": null, "b": true, "c": 2, "d": 2.2, "e": "DEF" }', | CODE |
| HIGH⚡ | tests/functions/json/test_jq.py | 11 | '{ "a": null, "b": false, "c": 3, "d": 3.3, "e": "GHI" }', | CODE |
| HIGH⚡ | tests/functions/json/test_jq.py | 12 | '{ "a": null, "b": false, "c": 3, "d": 4.4, "e": "JKL" }', | CODE |
| HIGH⚡ | tests/functions/json/test_jq.py | 13 | '{ "a": null, "b": null, "c": null, "d": null, "e": null }', | CODE |
| HIGH | tests/functions/json/test_jq.py | 27 | '{ "a": null, "b": true, "c": 1, "d": 1.1, "e": "ABC" }', | CODE |
| HIGH | tests/functions/json/test_jq.py | 30 | '{ "a": null, "b": false, "c": 2, "d": 2.2, "e": "DEF" }', | CODE |
| HIGH | tests/functions/json/test_jq.py | 105 | '{ "a": { "b": null } }', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 137 | '{"a":null,"b":1,"c":1.1,"d":"ABC"}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 138 | '{"a":null,"b":2,"c":2.2,"d":"DEF"}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 139 | '{"a":null,"b":3,"c":3.3,"d":"GHI"}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 140 | '{"a":null,"b":4,"c":4.4,"d":"JKL"}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 155 | '{"a":1,"b":null,"c":"valid"}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 156 | '{"a":null,"b":2,"c":null}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 170 | '{"arr":[1,2,3],"map":{"a":null,"b":2},"struct":{"x":1,"y":"z"}}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 171 | '{"arr":[4,5,6],"map":{"a":3,"b":null},"struct":{"x":2,"y":"w"}}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 172 | '{"arr":null,"map":null,"struct":null}', | CODE |
| HIGH⚡ | tests/functions/serde/test_serde_json.py | 186 | '{"arr":null,"map":null}', | CODE |
| HIGH | tests/ray/test_datasets.py | 180 | assert out_table.equals(expected_table), (out_table, expected_table) | CODE |
| HIGH | tests/sql/test_coalesce.py | 109 | actual = daft.sql("select coalesce(null, 1, 2) as result from df") | CODE |
| HIGH⚡ | tests/sql/test_coalesce.py | 123 | actual = daft.sql("select coalesce(null, null, null) as result from df") | CODE |
| HIGH⚡ | tests/sql/test_coalesce.py | 128 | actual = daft.sql("select coalesce(col1, null) as result from df") | CODE |
| HIGH⚡ | tests/sql/test_coalesce.py | 133 | actual = daft.sql("select coalesce(null, col1) as result from df") | CODE |
| HIGH | tests/sql/test_aggs.py | 145 | ("count(null) as null", "sum(values) > 10", {"null": [0, 0]}), | STRING |
| HIGH | examples/dvector/tests/test_dvector.py | 125 | """Cosine distance with zero-norm vector returns null, not error.""" | STRING |
| HIGH | benchmarking/tpcds/__main__.py | 90 | if t1.equals(t2): | CODE |
| HIGH | benchmarking/tpcds/__main__.py | 131 | return lhs_casted.equals(rhs_casted) | CODE |
| HIGH | benchmarking/tpcds/__main__.py | 133 | return lhs.equals(rhs) | CODE |
| HIGH | daft/dataframe/dataframe.py | 3998 | DataFrame: Left-join-shaped result (every left row kept; unmatched right columns are null). | STRING |
| HIGH | daft/io/delta_lake/delta_lake_write.py | 104 | # min/max is infinity is equivalent to saying it is null, anyways. | COMMENT |
| HIGH | daft/functions/misc.py | 621 | """Returns the first non-null value in a list of expressions. If all inputs are null, returns null. | STRING |
| HIGH | daft/functions/str.py | 37 | Expression: A new expression with the deserialized value (or null). | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | k8s/charts/quickstart/values.yaml | 1 | # Default values for Daft quickstart Helm chart | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 21 | # - Full Ray cluster with head and worker nodes | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 41 | # regardless of the deployment mode. | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 61 | # - Best for: production, complex dependencies, custom environments | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 81 | COMMENT | |
| LOW | k8s/charts/quickstart/values.yaml | 101 | # - name: LOG_LEVEL | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 121 | # Job Execution Settings | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 141 | # -- Node selector for job pod placement | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 161 | # requiredDuringSchedulingIgnoredDuringExecution: | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 201 | # operator: "Equal" | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 221 | COMMENT | |
| LOW | k8s/charts/quickstart/values.yaml | 241 | # -- Service type (ClusterIP, NodePort, LoadBalancer) | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 261 | # service.beta.kubernetes.io/aws-load-balancer-type: "nlb" | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 281 | memory: "2Gi" | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 301 | # affinity: | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 321 | COMMENT | |
| LOW | k8s/charts/quickstart/values.yaml | 341 | # - name: config | COMMENT |
| LOW | k8s/charts/quickstart/values.yaml | 361 | annotations: {} | COMMENT |
| LOW | tests/series/test_image.py | 441 | ("RGB", "tiff"), | COMMENT |
| LOW | tests/series/test_image.py | 501 | # TODO(Clark): Support uint16 images. | COMMENT |
| LOW | tests/dataframe/test_temporals.py | 81 | # "time32_s": pa.array([1], pa.time32("s")), | COMMENT |
| LOW | tests/integration/delta_lake/conftest.py | 81 | ), | COMMENT |
| LOW | …ts/integration/io/parquet/test_reads_local_fixtures.py | 21 | COMMENT | |
| LOW | tests/integration/iceberg/docker-compose/run-minio.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …tion/iceberg/docker-compose/docker-compose-azurite.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | tests/integration/iceberg/docker-compose/run-azurite.sh | 1 | #!/bin/bash | COMMENT |
| LOW | …s/integration/iceberg/docker-compose/run-gcs-server.sh | 1 | #!/bin/bash | COMMENT |
| LOW | tests/integration/iceberg/docker-compose/provision.py | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …n/iceberg/docker-compose/docker-compose-gcs-server.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | …/integration/iceberg/docker-compose/docker-compose.yml | 1 | # Licensed to the Apache Software Foundation (ASF) under one | COMMENT |
| LOW | tests/integration/iceberg/docker-compose/entrypoint.sh | 1 | #!/bin/bash | COMMENT |
| LOW | tests/integration/ray/fake_cluster.yaml | 1 | # Licensed under the Apache License, Version 2.0 (the "License"); | COMMENT |
| LOW | tests/integration/ray/autoscaling_cluster.py | 1 | # Licensed under the Apache License, Version 2.0 (the "License"); | COMMENT |
| LOW | tests/integration/sql/test_postgres_catalog.py | 461 | # Extension | COMMENT |
| LOW | tests/io/test_parquet.py | 501 | # non-local reads), then upon checking the next page for more values, we would read | COMMENT |
| LOW | tests/cookbook/test_pandas_cookbook.py | 181 | ### | COMMENT |
| LOW | tests/cookbook/test_pandas_cookbook.py | 261 | # Area Bins Test_0_L Data_L Test_1_L Test_0_R Data_R Test_1_R | COMMENT |
| LOW | tests/expressions/test_to_arrow_expr.py | 181 | (lit("hello").endswith(lit("o")), pc.ends_with(pc.scalar("hello"), "o")), | COMMENT |
| LOW | tests/expressions/test_to_arrow_expr.py | 201 | # (lit("hello").str.rstrip(), "rstrip('hello')"), | COMMENT |
| LOW | docs/examples/audio-transcription.md | 81 | # | b"..." | | COMMENT |
| LOW | docs/examples/udf-patterns.md | 301 | # from transformers import pipeline | COMMENT |
| LOW | docs/examples/document-processing.md | 741 | # NOTE: We can easily define a UDF that operates on multiple columns! | COMMENT |
| LOW | examples/dvector/README.md | 41 | # ╭───────────╮ | COMMENT |
| LOW | examples/hello_cpp/README.md | 81 | # │ --- │ | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 581 | # Uncomment when re-enabling credentialed testing. | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 601 | # uses: jlumbroso/free-disk-space@v1.3.1 | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 621 | # - name: Download built wheels | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 641 | # max_attempts: 3 | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 661 | # credentials_json: ${{ secrets.ACTIONS_GCP_SERVICE_ACCOUNT_JSON }} | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 681 | # uses: slackapi/slack-github-action@v3.0.3 | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 841 | with: | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 1161 | # timeout-minutes: 45 | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 1181 | # path: dist | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 1201 | # uv pip install dist/${{ env.package-name }}-*x86_64*.whl --force-reinstall | COMMENT |
| LOW | .github/workflows/pr-test-suite.yml | 1221 | # { | COMMENT |
| LOW | tutorials/flyte/app.py | 21 | # ], | COMMENT |
| LOW | benchmarking/lerobot/run_hand_tracking.sh | 1 | #!/bin/bash | COMMENT |
| LOW | daft/lazy_import.py | 1 | # Licensed under the Apache License, Version 2.0 (the "License"); | COMMENT |
| LOW | daft/pickle/cloudpickle.py | 801 | COMMENT | |
| LOW | daft/pickle/cloudpickle.py | 1261 | # globals at pickling time to also share them once unpickled, at one | COMMENT |
| 244 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tools/aggregate_test_durations.py | 68 | print(f"Error: File '{filename}' not found.") | CODE |
| LOW⚡ | tools/aggregate_test_durations.py | 70 | except Exception as e: | CODE |
| MEDIUM⚡ | tools/aggregate_test_durations.py | 71 | print(f"Error reading file '{filename}': {e}") | CODE |
| MEDIUM | tools/aggregate_test_durations.py | 283 | print(f"Error: File '{file_path}' does not exist.") | CODE |
| LOW | tests/_hf_retry.py | 144 | except Exception as exc: | CODE |
| LOW | tests/test_datatype_inference.py | 572 | except Exception as e: | CODE |
| LOW | tests/dataframe/test_shuffles.py | 468 | except Exception as e: | CODE |
| MEDIUM | tests/dataframe/test_shuffles.py | 465 | def run(): | CODE |
| LOW | tests/integration/test_dashboard.py | 71 | except Exception: | CODE |
| LOW | tests/integration/test_dashboard.py | 100 | except Exception as e: | CODE |
| LOW | tests/integration/io/conftest.py | 310 | except Exception: | CODE |
| LOW | tests/integration/io/test_kafka_integration.py | 32 | except Exception as e: | CODE |
| LOW⚡ | …ration/iceberg/test_iceberg_count_pushdown_coverage.py | 238 | except Exception: | CODE |
| LOW | tests/integration/iceberg/test_iceberg_reads.py | 424 | except Exception: | CODE |
| LOW | tests/integration/iceberg/test_iceberg_table.py | 38 | except Exception as e: | CODE |
| LOW | tests/integration/iceberg/test_iceberg_writes.py | 27 | except Exception as e: | CODE |
| LOW⚡ | tests/integration/iceberg/test_iceberg_writes.py | 46 | except Exception as e: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 19 | except Exception: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 24 | except Exception: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 57 | except Exception as e: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 71 | except Exception as e: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 85 | except Exception as e: | CODE |
| LOW | tests/integration/gravitino/test_utils.py | 178 | except Exception as e: | CODE |
| LOW | …sts/integration/gravitino/test_gravitino_fileset_s3.py | 54 | except Exception as e: | CODE |
| LOW | …sts/integration/gravitino/test_gravitino_fileset_s3.py | 64 | except Exception: | CODE |
| LOW⚡ | tests/integration/gravitino/test_gravitino_table.py | 178 | except Exception: | CODE |
| LOW⚡ | tests/integration/gravitino/test_gravitino_table.py | 187 | except Exception: | CODE |
| LOW | tests/integration/sql/conftest.py | 58 | except Exception as e: | CODE |
| LOW | tests/integration/sql/conftest.py | 68 | except Exception as e: | CODE |
| LOW⚡ | tests/integration/sql/test_postgres_catalog.py | 323 | except Exception: | CODE |
| LOW⚡ | tests/integration/sql/test_postgres_catalog.py | 328 | except Exception: | CODE |
| LOW | tests/integration/sql/test_postgres_catalog.py | 128 | except Exception: | CODE |
| LOW | tests/catalog/test_iceberg.py | 47 | except Exception: | CODE |
| LOW | tests/catalog/test_iceberg.py | 58 | except Exception: | CODE |
| LOW | tests/io/test_gravitino_filesystem.py | 92 | except Exception: | CODE |
| LOW⚡ | tests/io/lancedb/test_lancedb_vector_search.py | 163 | except Exception: | CODE |
| LOW | tests/io/lancedb/test_lancedb_vector_search.py | 205 | except Exception: | CODE |
| MEDIUM | tests/udf/test_row_wise_udf.py | 96 | def test_row_wise_udf_with_ray_options(): | CODE |
| LOW | tests/udf/test_row_wise_udf.py | 103 | except Exception: | CODE |
| LOW | tests/ray/conftest.py | 109 | except Exception as e: | CODE |
| LOW | tests/ray/conftest.py | 115 | except Exception: | CODE |
| LOW | tests/ray/conftest.py | 193 | except Exception as e: | CODE |
| LOW | tests/ray/conftest.py | 204 | except Exception as e: | CODE |
| LOW | tests/ray/test_udf_ray_options.py | 50 | except Exception: | CODE |
| LOW | tests/ray/test_udf_ray_options.py | 219 | except Exception as e: | CODE |
| LOW | tests/ray/test_udf_ray_options.py | 225 | except Exception: | CODE |
| LOW⚡ | tests/sql/test_sample.py | 281 | except Exception as e: | CODE |
| LOW⚡ | tests/sql/test_sample.py | 289 | except Exception as e: | CODE |
| LOW | tests/sql/test_exprs.py | 375 | except Exception: | STRING |
| MEDIUM | tests/sql/test_sql.py | 392 | print(f"Error: {e}") | CODE |
| LOW | tests/sql/test_sql.py | 391 | except Exception as e: | CODE |
| LOW⚡ | tests/sql/test_sql_catalog.py | 14 | except Exception as e: | CODE |
| LOW⚡ | tests/sql/test_sql_catalog.py | 28 | except Exception as e: | CODE |
| LOW⚡ | tests/sql/test_sql_catalog.py | 56 | except Exception as e: | CODE |
| LOW | docs/modalities/images.md | 216 | except Exception: | CODE |
| LOW | docs/examples/document-processing.md | 654 | except Exception: | CODE |
| LOW | benchmarking/asof_join/benchmark.py | 56 | except Exception: | CODE |
| LOW | benchmarking/asof_join/benchmark.py | 78 | except Exception: | CODE |
| LOW | benchmarking/tpcds/__main__.py | 210 | except Exception as e: | CODE |
| LOW | benchmarking/tpcds/__main__.py | 240 | except Exception as e: | CODE |
| 116 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/aggregate_test_durations.py | 28 | CODE | |
| LOW | tools/convert_md_to_notebook.py | 184 | CODE | |
| LOW | tests/test_subscribers.py | 169 | CODE | |
| LOW | tests/property_based_testing/test_sort.py | 86 | CODE | |
| LOW | tests/dataframe/test_creation.py | 721 | CODE | |
| LOW | tests/dataframe/test_creation.py | 755 | CODE | |
| LOW | tests/dataframe/test_creation.py | 773 | CODE | |
| LOW | tests/integration/io/conftest.py | 164 | CODE | |
| LOW | tests/integration/gravitino/test_gravitino_table.py | 64 | CODE | |
| LOW | tests/integration/ray/test_autoscaling.py | 99 | CODE | |
| LOW | tests/integration/sql/test_sql.py | 135 | CODE | |
| LOW | tests/datasets/test_common_crawl_mocked.py | 98 | CODE | |
| LOW | tests/io/test_hive_style_partitions.py | 270 | CODE | |
| LOW | tests/cookbook/test_image_hash_compat.py | 25 | CODE | |
| LOW | tests/recordbatch/test_table_aggs.py | 1143 | CODE | |
| LOW | tests/recordbatch/test_table_aggs.py | 1184 | CODE | |
| LOW | tests/recordbatch/image/test_attribute.py | 11 | CODE | |
| LOW | tests/ai/google/test_google_prompter.py | 251 | CODE | |
| LOW | tests/ai/google/test_google_prompter.py | 254 | CODE | |
| LOW | tests/ai/transformers/test_transformers_provider.py | 35 | CODE | |
| LOW | tests/ai/transformers/test_transformers_provider.py | 59 | CODE | |
| LOW | …ts/ai/transformers/test_transformers_image_embedder.py | 39 | CODE | |
| LOW | tests/window/test_partition_order_by_rank.py | 310 | CODE | |
| LOW | tests/window/test_partition_order_by_rank.py | 428 | CODE | |
| LOW | tests/window/test_partition_order_by_rank.py | 354 | CODE | |
| LOW | tests/window/test_running_agg.py | 829 | CODE | |
| LOW | tests/window/test_running_agg.py | 886 | CODE | |
| LOW | tests/window/test_running_agg.py | 1339 | CODE | |
| LOW | tests/window/test_running_agg.py | 1385 | CODE | |
| LOW | tests/window/test_partition_order_by_lag_lead.py | 414 | CODE | |
| LOW | tests/benchmarks/test_parquet_writes.py | 133 | CODE | |
| LOW | tests/benchmarks/test_parquet_writes.py | 72 | CODE | |
| LOW | tests/expressions/conftest.py | 12 | CODE | |
| LOW | tests/expressions/conftest.py | 13 | CODE | |
| LOW | tests/expressions/test_visitor.py | 27 | CODE | |
| LOW | tests/expressions/test_visitor.py | 34 | CODE | |
| LOW | tests/expressions/test_legacy_udf.py | 205 | CODE | |
| LOW | tests/expressions/test_legacy_udf.py | 209 | CODE | |
| LOW | tests/ray/conftest.py | 43 | CODE | |
| LOW | tests/sql/test_sql_udfs.py | 93 | CODE | |
| LOW | docs/gen_pages/generate_llms_txt.py | 8 | CODE | |
| LOW | docs/gen_pages/gen_function_pages.py | 75 | CODE | |
| LOW | .github/ci-scripts/generate_simple_py_index.py | 58 | CODE | |
| LOW | benchmarking/tpcds/helpers.py | 18 | CODE | |
| LOW | benchmarking/tpcds/__main__.py | 136 | CODE | |
| LOW | benchmarking/tpcds/__main__.py | 256 | CODE | |
| LOW | benchmarking/tpcds/__main__.py | 59 | CODE | |
| LOW | benchmarking/tpch/data_generation.py | 245 | CODE | |
| LOW | benchmarking/parquet/test_local.py | 10 | CODE | |
| LOW | daft/series.py | 818 | CODE | |
| LOW | daft/session.py | 176 | CODE | |
| LOW | daft/api_annotations.py | 66 | CODE | |
| LOW | daft/utils.py | 155 | CODE | |
| LOW | daft/datatype.py | 117 | CODE | |
| LOW | daft/datatype.py | 183 | CODE | |
| LOW | daft/datatype.py | 407 | CODE | |
| LOW | daft/datatype.py | 443 | CODE | |
| LOW | daft/datatype.py | 734 | CODE | |
| LOW | daft/dataframe/dataframe.py | 136 | CODE | |
| LOW | daft/dataframe/dataframe.py | 315 | CODE | |
| 70 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/ray/conftest.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/utils.py | 14 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/tpcds/datagen.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/tpcds/__main__.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/tpch/data_generation.py | 14 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/tpch/pipelined_data_generation.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmarking/tpch/__main__.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/checkpoint.py | 22 | __all__ = ["CheckpointConfig", "CheckpointStore", "IdempotentCommit", "KeyFilteringSettings"] | CODE |
| LOW | daft/filesystem.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/filesystem.py | 206 | def _set_if_not_none(kwargs: dict[str, Any], key: str, val: Any | None) -> None: | CODE |
| LOW⚡ | daft/session.py | 1074 | def set_catalog(identifier: str | None) -> None: | CODE |
| LOW⚡ | daft/session.py | 1079 | def set_namespace(identifier: Identifier | str | None) -> None: | CODE |
| LOW⚡ | daft/session.py | 1084 | def set_provider(identifier: str | Provider | None, **options: Any) -> None: | CODE |
| LOW⚡ | daft/session.py | 1089 | def set_model(identifier: str | None) -> None: | CODE |
| LOW⚡ | daft/session.py | 1094 | def set_session(session: Session) -> None: | CODE |
| LOW | daft/session.py | 25 | __all__ = [ | CODE |
| LOW | daft/session.py | 721 | def set_catalog(self, identifier: str | None) -> None: | STRING |
| LOW | daft/session.py | 732 | def set_namespace(self, identifier: Identifier | str | None) -> None: | STRING |
| LOW | daft/session.py | 742 | def set_provider(self, identifier: str | Provider | None, **options: Any) -> None: | STRING |
| LOW | daft/session.py | 771 | def set_model(self, identifier: str | None) -> None: | STRING |
| LOW | daft/__init__.py | 187 | __all__ = [ | CODE |
| LOW | daft/event_loop.py | 34 | def set_event_loop(loop: asyncio.AbstractEventLoop) -> None: | CODE |
| LOW | daft/context.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/dependencies.py | 56 | __all__ = [ | CODE |
| LOW | daft/schema.py | 22 | __all__ = [ | CODE |
| LOW | daft/dataframe/to_torch.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/dataframe/dataframe.py | 90 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/dataframe/dataframe.py | 146 | def set_storage_option(key: str, value: str) -> None: | CODE |
| LOW | daft/dataframe/__init__.py | 5 | __all__ = ["DataFrame", "GroupedDataFrame"] | CODE |
| LOW | daft/file/__init__.py | 11 | __all__ = ["AudioFile", "DaftFileIO", "File", "Hdf5File", "ImageFile", "VideoFile", "open_file"] | CODE |
| LOW | daft/catalog/__init__.py | 62 | __all__ = [ | CODE |
| LOW | daft/catalog/__gravitino/__init__.py | 11 | __all__ = [ | CODE |
| LOW | daft/catalog/__unity/__init__.py | 5 | __all__ = [ | CODE |
| LOW | daft/datasets/lerobot.py | 538 | __all__ = [ | CODE |
| LOW | daft/datasets/droid.py | 480 | __all__ = [ | STRING |
| LOW | daft/datasets/__init__.py | 5 | __all__ = ["common_crawl", "droid", "lerobot"] | CODE |
| LOW | daft/io/clustering.py | 11 | __all__ = [ | CODE |
| LOW | daft/io/__init__.py | 55 | __all__ = [ | CODE |
| LOW | daft/io/_kafka.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/source.py | 21 | __all__ = [ | CODE |
| LOW | daft/io/delta_lake/delta_lake_write.py | 273 | __all__ = ["AddAction"] | CODE |
| LOW | daft/io/delta_lake/delta_lake_scan.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/clickhouse/__init__.py | 5 | __all__ = ["ClickHouseDataSink"] | CODE |
| LOW | daft/io/av/__init__.py | 11 | __all__ = [ | CODE |
| LOW | daft/io/hudi/hudi_scan.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/bigtable/__init__.py | 3 | __all__ = ["BigtableDataSink"] | CODE |
| LOW | daft/io/paimon/_predicate_visitor.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/paimon/__init__.py | 4 | __all__ = ["PaimonDataSink", "read_paimon"] | CODE |
| LOW | daft/io/paimon/paimon_scan.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/lance/lance_compaction.py | 5 | __all__ = ["compact_files_internal"] | CODE |
| LOW | daft/io/lance/_lance.py | 15 | __all__ = [ | CODE |
| LOW | daft/io/lance/__init__.py | 9 | __all__ = [ | CODE |
| LOW | daft/io/lance/lance_data_sink.py | 5 | __all__ = ["LanceDataSink"] | CODE |
| LOW | daft/io/lance/lance_scalar_index.py | 5 | __all__ = ["create_scalar_index_internal"] | CODE |
| LOW | daft/io/lance/lance_scan.py | 9 | __all__ = [ | CODE |
| LOW | daft/io/lance/utils.py | 9 | __all__ = [ | CODE |
| LOW | daft/io/lance/point_lookup.py | 5 | __all__ = ["detect_point_lookup_columns"] | CODE |
| LOW | daft/io/lance/lance_merge_column.py | 8 | __all__ = ["merge_columns_from_df", "merge_columns_internal"] | CODE |
| LOW | daft/io/iceberg/iceberg_scan.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | daft/io/iceberg/_expressions.py | 19 | logger = logging.getLogger(__name__) | CODE |
| 39 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | docs/connectors/custom.md | 20 | ### Step 1: Implement the `DataSource` and `DataSourceTask` Interfaces | COMMENT |
| LOW | docs/connectors/custom.md | 117 | ### Step 2: Use Your Custom Data Source to Create a Daft DataFrame | COMMENT |
| LOW | docs/connectors/custom.md | 252 | ### Step 1: Implement the `DataSink` Interface | COMMENT |
| LOW | docs/connectors/custom.md | 407 | ### Step 2: Use Your Custom Data Sink | COMMENT |
| LOW | docs/contributing/development.md | 216 | ### Step 1: Implement the function in Rust | COMMENT |
| LOW | docs/contributing/development.md | 277 | ### Step 2: Register the function | COMMENT |
| LOW | docs/contributing/development.md | 294 | ### Step 3: Add python bindings | COMMENT |
| LOW | docs/contributing/development.md | 392 | ### Step 4: Write tests | COMMENT |
| LOW | docs/examples/llms-red-pajamas.md | 18 | ## Step 0: Dependencies and configuration | COMMENT |
| LOW | docs/examples/llms-red-pajamas.md | 24 | ## Step 1: Load the dataset | COMMENT |
| LOW | docs/examples/llms-red-pajamas.md | 43 | ## Step 2: Compute embeddings | COMMENT |
| LOW | docs/examples/llms-red-pajamas.md | 97 | ## Step 3: Semantic similarity | COMMENT |
| LOW | docs/examples/llms-red-pajamas.md | 166 | ## Step 4: Inspect and write results | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 473 | # Step 2: Group by u, and aggregate the list of v's | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 480 | # Step 3: Compute m = min over nbrs union {u} | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 489 | # Step 4: Emit (v, m(u)) for v > u | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 512 | # Step 1: For each edge, emit to the larger node as key, smaller as value | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 521 | # Step 2: Group by larger u, nbrs are smaller neighbors | COMMENT |
| LOW⚡ | docs/examples/minhash-dedupe.md | 528 | # Step 3: Compute m = min over nbrs union {u} | COMMENT |
| LOW | docs/examples/document-processing.md | 711 | ### Step 1: Enumerate S3 Keys | COMMENT |
| LOW | docs/examples/document-processing.md | 724 | ### Step 2: Download PDFs | COMMENT |
| LOW | docs/examples/document-processing.md | 734 | ### Step 3: Load PDFs, Maybe Apply OCR | COMMENT |
| LOW | docs/examples/document-processing.md | 782 | ### Step 4: Text Box Processing | COMMENT |
| LOW | docs/examples/document-processing.md | 834 | ### Step 5: Text Embeddings | COMMENT |
| LOW⚡ | docs/examples/text-embeddings.md | 44 | ## Step 1: Import Dependencies and Configure Constants | COMMENT |
| LOW⚡ | docs/examples/text-embeddings.md | 60 | ## Step 2: Create Text Chunking UDF | COMMENT |
| LOW | docs/examples/text-embeddings.md | 124 | ## Step 3: Create Embedding Generation UDF | COMMENT |
| LOW | docs/examples/text-embeddings.md | 177 | ## Step 4: Configure Distributed Processing | COMMENT |
| LOW | docs/examples/text-embeddings.md | 194 | ## Step 5: Execute the Pipeline | COMMENT |
| LOW | docs/examples/voice-ai-analytics.md | 165 | ## Step 1: Transcription | COMMENT |
| LOW | docs/examples/voice-ai-analytics.md | 234 | ## Step 2: Summarization | COMMENT |
| LOW | docs/examples/voice-ai-analytics.md | 308 | ## Step 3: Generating Subtitles | COMMENT |
| LOW | docs/examples/voice-ai-analytics.md | 370 | ## Step 4: Embedding Segments for Later Retrieval | COMMENT |
| LOW | src/daft-recordbatch/src/probeable/mod.rs | 117 | /// NOTE: This function only works if track_indices is true. | COMMENT |
| LOW⚡ | src/daft-image/src/ops.rs | 747 | // Step 1: remove DC | COMMENT |
| LOW⚡ | src/daft-image/src/ops.rs | 752 | // Step 2: extract hash-band LL | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tools/aggregate_test_durations.py | 280 | # Check if all files exist | COMMENT |
| LOW | tools/convert_md_to_notebook.py | 209 | # Check if there's an output block immediately after this code block | COMMENT |
| LOW | tools/convert_md_to_notebook.py | 336 | # Check if badge already exists | COMMENT |
| LOW | tools/git_utils.py | 69 | # Check if the branch has a remote tracking branch. | COMMENT |
| LOW | tests/integration/test_dashboard.py | 72 | # Check if process exited prematurely | COMMENT |
| LOW⚡ | tests/integration/ai/test_openai.py | 236 | # Check if "red" appears in the answer (case-insensitive) | COMMENT |
| LOW⚡ | tests/integration/ai/test_openai.py | 284 | # Check if "green" appears in the answer (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_openai.py | 334 | # Check if "yellow" appears in the answer (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_openai.py | 391 | # Check if "blue" appears in the dominant color (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_openai.py | 489 | # Check if relevant keywords appear in the answer (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_openai.py | 553 | # Check if answer indicates a match or mentions red color (case-insensitive) | COMMENT |
| LOW⚡ | tests/integration/ai/test_google.py | 182 | # Check if "red" appears in the answer (case-insensitive) | COMMENT |
| LOW⚡ | tests/integration/ai/test_google.py | 232 | # Check if "green" appears in the answer (case-insensitive) | COMMENT |
| LOW⚡ | tests/integration/ai/test_google.py | 444 | # Check if "blue" appears in the response (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_google.py | 284 | # Check if "yellow" appears in the answer (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_google.py | 388 | # Check if relevant keywords appear in the answer (case-insensitive) | COMMENT |
| LOW | tests/integration/ai/test_google.py | 503 | # Check if answer indicates a match or mentions red color (case-insensitive) | COMMENT |
| LOW⚡ | tests/io/lancedb/test_lancedb_vector_search.py | 173 | # Check if the result is valid (distance should be 0, so id % 3 == 0) | COMMENT |
| LOW⚡ | tests/expressions/test_null_safe_equals.py | 98 | # Check if this is a fixed-size binary test case | COMMENT |
| LOW | docs/gen_pages/gen_function_pages.py | 82 | # Check if parameter has a default value (is optional) | COMMENT |
| LOW | .github/actions/restore-mtime/action.yaml | 45 | # Set them to a fixed past time so cargo skips them. | COMMENT |
| LOW | daft/utils.py | 142 | # Check if running inside a Ray worker | COMMENT |
| LOW | daft/catalog/__postgres.py | 32 | # Check if extension is available before attempting to create it | COMMENT |
| LOW | daft/io/_generator.py | 43 | >>> # Set runner to Ray for distributed processing | STRING |
| LOW | daft/io/iceberg/iceberg_scan.py | 267 | # Check if there is a count aggregation pushdown | COMMENT |
| LOW | daft/io/iceberg/iceberg_scan.py | 403 | # Check if any task has delete files | COMMENT |
| LOW | daft/io/huggingface/__init__.py | 55 | # Check if this is a 400 error (parquet files not yet available) | COMMENT |
| LOW | daft/execution/vllm.py | 173 | # Check if we need to log (in case periodic log isn't running in distributed mode) | COMMENT |
| LOW | daft/functions/ai/__init__.py | 587 | # Check if this is a vLLM provider - if so, use PyExpr.vllm directly | COMMENT |
| LOW | daft/runners/ray_runner.py | 210 | # Check if it's ArrowTensorTypeV2 (imported if available) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | tests/series/test_temporal_ops.py | 530 | # just a sanity check, more robust tests are in tests/dataframe/test_temporals.py | COMMENT |
| MEDIUM⚡ | tests/series/test_temporal_ops.py | 538 | # just a sanity check, more robust tests are in tests/dataframe/test_temporals.py | COMMENT |
| MEDIUM⚡ | tests/sql/test_sql.py | 327 | # Test various sqlparser error formats to ensure robust parsing | COMMENT |
| MEDIUM | daft/dataframe/dataframe.py | 5587 | """Executes enough of the DataFrame in order to display the first ``n`` rows. | STRING |
| LOW | daft/catalog/__postgres.py | 120 | # If inner type contains a complex type, simply use JSONB. | COMMENT |
| LOW | daft/catalog/__postgres.py | 251 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 324 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 384 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 478 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 492 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 612 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/catalog/__postgres.py | 644 | # Since this is user-configurable, we simply pass along the single identifier to PostgreSQL. | COMMENT |
| LOW | daft/udf/legacy.py | 130 | # If the param is not an expression, we can just pass it directly | COMMENT |
| LOW | daft/sql/sql_connection.py | 75 | # If all options are None, just return the original sql | COMMENT |
| MEDIUM⚡ | daft/sql/sql_connection.py | 151 | # driver-specific extras), so dropping the URL is the only robust | COMMENT |
| MEDIUM | src/daft-minhash/src/lib.rs | 133 | /// data to create a robust signature. The permutation function used is of the form: | COMMENT |
| MEDIUM | src/daft-io/src/google_cloud.rs | 179 | // We use regex here instead of the more robust url crate because we do not want to handle character escaping | COMMENT |
| MEDIUM | src/daft-image/src/functions/hash_method.rs | 10 | /// Average hash — fastest, least robust. | COMMENT |
| MEDIUM | src/daft-image/src/functions/hash_method.rs | 16 | /// DCT-based perceptual hash — most robust (default). | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/dataframe/test_asof_join_nearest.py | 0 | null asof keys on left should produce null matches on the right side. | STRING |
| HIGH | tests/dataframe/test_asof_join_forward.py | 0 | null asof keys on left should produce null matches on the right side. | STRING |
| HIGH | tests/dataframe/test_asof_join.py | 0 | null asof keys on left should produce null matches on the right side. | STRING |
| HIGH | tests/ai/google/test_google_provider.py | 0 | test that the provider returns a prompter descriptor with default settings. | STRING |
| HIGH | tests/ai/google/test_google_prompter.py | 0 | test that the provider returns a prompter descriptor with default settings. | STRING |
| HIGH | tests/ai/openai/test_openai_prompter.py | 0 | test that the provider returns a prompter descriptor with default settings. | STRING |
| HIGH | tests/ai/google/test_google_provider.py | 0 | test that the provider accepts generation config options. | STRING |
| HIGH | tests/ai/google/test_google_prompter.py | 0 | test that the provider accepts generation config options. | STRING |
| HIGH | tests/ai/openai/test_openai_prompter.py | 0 | test that the provider accepts generation config options. | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | tests/ai/openai/test_openai_prompter.py | 1069 | mock_client.beta.chat.completions.parse.assert_called_once_with( | CODE |
| CRITICAL | tests/ai/openai/test_openai_prompter.py | 1259 | mock_client.beta.chat.completions.parse.assert_called_once() | CODE |
| CRITICAL | daft/ai/openai/protocols/prompter.py | 324 | response = await self.llm.beta.chat.completions.parse( | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/ai/test_lm_studio.py | 51 | CODE | |
| LOW | tests/udf/test_batch_udf.py | 145 | CODE | |
| LOW | tests/udf/test_batch_udf.py | 259 | CODE | |
| LOW | tests/udf/test_batch_udf.py | 266 | CODE | |
| LOW | daft/context.py | 211 | CODE | |
| LOW | daft/dataframe/dataframe.py | 1113 | CODE | |
| LOW | daft/dataframe/dataframe.py | 1767 | CODE | |
| LOW | daft/dataframe/dataframe.py | 2499 | CODE | |
| LOW | daft/dataframe/dataframe.py | 3964 | CODE | |
| LOW | daft/catalog/__glue.py | 37 | CODE | |
| LOW | daft/io/_json.py | 24 | CODE | |
| LOW | daft/io/_parquet.py | 24 | CODE | |
| LOW | daft/io/_text.py | 12 | CODE | |
| LOW | daft/io/_csv.py | 24 | CODE | |
| LOW | daft/io/source.py | 148 | CODE | |
| LOW | daft/io/lance/_lance.py | 25 | CODE | |
| LOW | daft/io/turbopuffer/turbopuffer_data_sink.py | 55 | CODE | |
| LOW | daft/recordbatch/micropartition.py | 473 | CODE | |
| LOW | daft/recordbatch/recordbatch.py | 565 | CODE | |
| LOW | daft/recordbatch/recordbatch.py | 599 | CODE | |
| LOW | daft/recordbatch/recordbatch.py | 476 | CODE | |
| LOW | daft/expressions/expressions.py | 121 | CODE | |
| LOW | daft/udf/__init__.py | 360 | CODE | |
| LOW | daft/udf/__init__.py | 372 | CODE | |
| LOW | daft/udf/__init__.py | 384 | CODE | |
| LOW | daft/udf/__init__.py | 24 | CODE | |
| LOW | daft/udf/__init__.py | 51 | CODE | |
| LOW | daft/udf/__init__.py | 252 | CODE | |
| LOW | daft/udf/udf_v2.py | 73 | CODE | |
| LOW | daft/runners/__init__.py | 67 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/ai/openai/test_openai_text_embedder.py | 157 | # An OpenAI embedding model's dimensions are known without probing. | COMMENT |
| MEDIUM | docs/modalities/text.md | 117 | # Select a text embedding model that you've loaded into LM Studio | COMMENT |
| MEDIUM | docs/extensions/projects.md | 23 | | [hypergraph](https://github.com/gilad-rubin/hypergraph) | Python workflow orchestration framework for DAG pipelines an | CODE |
| MEDIUM | docs/examples/mnist.md | 64 | For the convenience of this quickstart tutorial, we pre-trained a model using a PyTorch-provided example script and save | CODE |
| MEDIUM | docs/examples/document-processing.md | 698 | # The text embedding model to use. See HuggingFace for a more complete list! | COMMENT |
| MEDIUM⚡ | docs/examples/text-embeddings.md | 54 | EMBEDDING_MODEL_NAME = "Qwen/Qwen3-Embedding-0.6B" # The text embedding model to use | CODE |
| MEDIUM | docs/examples/text-embeddings.md | 267 | EMBEDDING_MODEL_NAME = "Qwen/Qwen3-Embedding-0.6B" # The text embedding model to use | CODE |
| MEDIUM | docs/examples/voice-ai-analytics.md | 456 | ### 4. **RAG Workflow** | COMMENT |
| MEDIUM | docs/examples/common-crawl-daft-tutorial.md | 190 | EMBEDDING_MODEL_NAME: str = "Qwen/Qwen3-Embedding-0.6B" # Text embedding model | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/test_datatype_inference.py | 393 | # (PydanticWithAlias(name="Jane Doe", age=28), dt.struct({"fullName": dt.string(), "age": dt.int64()})), | COMMENT |
| LOW | tests/test_datatype_inference.py | 395 | PydanticWithAliasNoSerializeByAlias(name="Jane Doe", age=28), | CODE |
| LOW | tests/recordbatch/test_tokenize.py | 57 | "placeholder", | CODE |
| LOW | tests/recordbatch/test_tokenize.py | 63 | "placeholder", | CODE |
| LOW⚡ | tests/recordbatch/utf8/test_count_matches.py | 111 | "test123@example.org", | CODE |
| LOW⚡ | tests/ai/openai/test_openai_provider.py | 18 | sess.set_provider("openai", api_key="fake_key") | CODE |
| LOW⚡ | tests/ai/openai/test_openai_provider.py | 23 | daft.set_provider("openai", api_key="fake_key") | CODE |
| LOW | tests/benchmarks/test_interactive_reads.py | 29 | local_file = f"{tmpdir}/small-fake-data.parquet.parquet" | CODE |
| LOW | tests/benchmarks/test_interactive_reads.py | 31 | s3.download_file("daft-oss-public-data", "test_fixtures/parquet/small-fake-data.parquet", local_file) | CODE |
| LOW⚡ | daft/functions/list.py | 410 | >>> df = daft.from_pydict({"id": [1, 2, 3], "sentence": ["lorem ipsum", "foo bar baz", "hi"]}) | STRING |
| LOW⚡ | daft/functions/list.py | 418 | │ 1 ┆ lorem ipsum ┆ lorem │ | STRING |
| LOW⚡ | daft/functions/list.py | 420 | │ 1 ┆ lorem ipsum ┆ ipsum │ | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/io/test_kafka_mock.py | 420 | # Stub consumer that always returns exactly as many messages as requested, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | tests/io/test_partition_filter_pushdown.py | 143 | CODE | |
| MEDIUM | tests/io/av/test_video.py | 52 | CODE | |
| MEDIUM | daft/io/source.py | 240 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | src/daft-io/src/object_io.rs | 293 | /// So we need to check if the source supports range requests. | COMMENT |
| LOW⚡ | src/daft-image/src/ops.rs | 747 | // Step 1: remove DC | COMMENT |
| LOW⚡ | src/daft-image/src/ops.rs | 752 | // Step 2: extract hash-band LL | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | daft/io/_range.py | 36 | # TODO: consider using `from_range` and `Series.from_range` instead. | COMMENT |
| LOW | daft/udf/udf_v2.py | 323 | # TODO: implement generator UDFs on the engine side | COMMENT |
| LOW | …al-plan/src/optimization/rules/granular_projections.rs | 468 | // TODO: Add test for UDFs, can't create a fake one for testing | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | src/daft-dsl/src/functions/function_args.rs | 105 | /// Example usage: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/dataframe/test_set_ops.py | 12 | def helper(make_df, op: str, left: dict[str, Any], right: dict[str, Any], expected: dict[str, Any]): | CODE |