Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
This report presents the forensic synthetic code analysis of Unstructured-IO/unstructured, a HTML project with 15,129 GitHub stars. SynthScan v2.0 examined 467,013 lines of code across 1043 source files, recording 3198 pattern matches distributed across 18 syntactic categories. The overall adjusted score of 8.4 places this repository in the Low AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 3198 distinct pattern matches across 18 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | test_unstructured/test_safe_http.py | 88 | def test_allows_public_addresses(self, ip: str): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 91 | def test_fails_closed_on_unparseable_input(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 102 | def test_returns_lowercase_for_ascii_input(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 111 | def test_idn_collapses_to_punycode(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 132 | def test_rejects_non_http_scheme(self, url: str): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 136 | def test_rejects_missing_hostname(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 145 | def test_rejects_out_of_range_port(self, url: str): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 177 | def test_rejects_blocked_ip_literals(self, url: str): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 182 | def test_rejects_hostname_resolving_to_non_routable(self, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 188 | def test_allows_public_hostname(self, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 193 | def test_rejects_when_any_resolved_ip_is_blocked(self, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 201 | def test_skips_validation_with_allow_private(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 204 | def test_skips_validation_with_env_var(self, monkeypatch): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 216 | def test_rejects_blocked_resolved_address_at_connect(self, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 223 | def test_connects_to_validated_public_address(self, mock_getaddrinfo, MockSocket): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 245 | def test_returns_response_for_public_url(self, MockSession, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 375 | def test_rejects_proxies_kwarg(self, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 389 | def test_mounts_safe_adapter_and_disables_trust_env(self, MockSession, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 420 | def test_proxy_manager_is_refused(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 432 | def test_same_origin_not_cross(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 435 | def test_different_host_is_cross(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 438 | def test_http_to_https_upgrade_is_not_cross(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 441 | def test_downgrade_on_same_nondefault_port_is_cross(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 444 | def test_explicit_default_port_same_origin_not_cross(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 447 | def test_unparseable_port_fails_safe(self): | CODE |
| LOW⚡ | test_unstructured/test_safe_http.py | 452 | def test_removes_credential_headers(self): | CODE |
| LOW | test_unstructured/test_safe_http.py | 74 | def test_blocks_sixtofour_embedded(self): | CODE |
| LOW | test_unstructured/test_safe_http.py | 162 | def test_rejects_blocked_hostname(self, hostname: str): | CODE |
| LOW | test_unstructured/test_safe_http.py | 260 | def test_applies_default_timeout(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 272 | def test_respects_explicit_timeout(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 284 | def test_forces_allow_redirects_false(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 296 | def test_validates_redirect_targets(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 312 | def test_follows_valid_redirect_chain(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 329 | def test_enforces_max_redirects(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 342 | def test_returns_response_on_missing_location_header(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 353 | def test_rejects_non_routable_url_without_fetch(self): | CODE |
| LOW | test_unstructured/test_safe_http.py | 359 | def test_session_closed_on_validation_error(self, MockSession, mock_getaddrinfo): | CODE |
| LOW | test_unstructured/test_safe_http.py | 403 | def test_allow_private_skips_adapter_and_permits_proxies(self, MockSession): | CODE |
| LOW | test_unstructured/test_safe_http.py | 464 | def test_removes_auth_and_cookies_kwargs(self): | CODE |
| LOW | test_unstructured/test_safe_http.py | 480 | def test_strips_credentials_on_cross_origin_redirect(self, MockSession, mock_getaddrinfo): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 46 | def test_requires_dependencies_decorator(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 54 | def test_requires_dependencies_decorator_multiple(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 63 | def test_requires_dependencies_decorator_import_error(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 72 | def test_requires_dependencies_decorator_import_error_multiple(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 82 | def test_requires_dependencies_decorator_in_class(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 315 | def test_only_returns_singleton_iterable(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 321 | def test_only_raises_on_non_singleton_iterable(): | CODE |
| LOW⚡ | test_unstructured/test_utils.py | 327 | def test_calculate_shared_ngram_percentage_returns_null_vals_for_empty_str(): | CODE |
| LOW | test_unstructured/test_utils.py | 97 | def test_first_raises_if_empty(iterator): | CODE |
| LOW | test_unstructured/test_utils.py | 114 | def test_only_raises_if_empty(iterator): | CODE |
| LOW | test_unstructured/test_utils.py | 265 | def test_catch_overlapping_and_nested_bboxes( | CODE |
| LOW | test_unstructured/test_utils.py | 291 | def test_catch_overlapping_and_nested_bboxes_non_overlapping_case(): | CODE |
| LOW | test_unstructured/test_utils.py | 339 | def it_groups_elements_by_parent_id_with_orphans_in_none_group(self): | CODE |
| LOW | test_unstructured/test_utils.py | 357 | def it_assigns_orphans_to_previous_element_group_when_assign_orphans_is_true(self): | CODE |
| LOW | test_unstructured/test_utils.py | 374 | def it_keeps_first_orphan_in_none_group_when_assign_orphans_is_true(self): | CODE |
| LOW⚡ | test_unstructured/test_cli_doctor.py | 31 | def test_resolve_specifier_pdf() -> None: | CODE |
| LOW⚡ | test_unstructured/test_cli_doctor.py | 36 | def test_resolve_specifier_jpg_exact() -> None: | CODE |
| LOW⚡ | test_unstructured/test_cli_doctor.py | 40 | def test_resolve_specifier_image_family() -> None: | CODE |
| LOW⚡ | test_unstructured/test_cli_doctor.py | 46 | def test_resolve_specifier_audio_family() -> None: | CODE |
| LOW⚡ | test_unstructured/test_cli_doctor.py | 52 | def test_resolve_specifier_email_partitioner_shortname() -> None: | CODE |
| 1988 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …ingest/src/local-single-file-chunk-no-orig-elements.sh | 3 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | …ingest/src/local-single-file-chunk-no-orig-elements.sh | 7 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 96 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 98 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 116 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 118 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 209 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 211 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 239 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 381 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 383 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 426 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/test_safe_http.py | 428 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | test_unstructured/test_safe_http.py | 22 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | test_unstructured/test_safe_http.py | 24 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | test_unstructured/unit_utils.py | 111 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/unit_utils.py | 113 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/unit_utils.py | 116 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_basic.py | 224 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_basic.py | 226 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 30 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 32 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 35 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 546 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 548 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 551 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 705 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_title.py | 707 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 46 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 48 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 292 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 294 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 327 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 329 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 460 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 462 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 931 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 933 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 3299 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/chunking/test_base.py | 3301 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 674 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 676 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 2820 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 2822 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 3572 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/chunking/test_base.py | 3574 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_ndjson.py | 305 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_xml.py | 175 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 112 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 202 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 271 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 708 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 710 | # ================================================================================================ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_docx.py | 713 | # ================================================================================================ | COMMENT |
| MEDIUM | test_unstructured/partition/test_docx.py | 469 | # ------------------------------------------------------------------------------------------------ | COMMENT |
| MEDIUM | test_unstructured/partition/test_docx.py | 1121 | # ┌───────┐ | COMMENT |
| MEDIUM | test_unstructured/partition/test_docx.py | 1151 | # ┌───────┬───┬───┐ | COMMENT |
| MEDIUM | test_unstructured/partition/test_docx.py | 1159 | # └───────┘ | COMMENT |
| MEDIUM⚡ | test_unstructured/partition/test_email.py | 392 | # ================================================================================================ | COMMENT |
| 232 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | README.md | 150 | elements = partition(filename="example-docs/eml/fake-email.eml") | CODE |
| LOW | …t-with-permissions/SitePages/This-is-a-title.aspx.json | 49 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales c | CODE |
| LOW | …t-with-permissions/SitePages/This-is-a-title.aspx.json | 49 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales c | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW⚡ | …airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.json | 21 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.json | 21 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.json | 23 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n\n\n2023-08-26T14:00:00.000Z\nName3\n# | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.json | 23 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n\n\n2023-08-26T14:00:00.000Z\nName3\n# | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.json | 20 | "text_as_html": "<table border=\"1\" class=\"dataframe\">\n <tbody>\n <tr>\n <td></td>\n <td>Assigne | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW⚡ | …airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.json | 22 | "text": "\n\n\n\nAssignee\nCheckboxes\nDates\nName\nNotes 1\nStatus\n\n\n0.0\n{'id': 'usrNdSxRQjglQU4eR', 'email': ' | CODE |
| LOW | …expected-structured-output/google-drive/fake.docx.json | 5 | "text": "Lorem ipsum dolor sit amet.", | CODE |
| LOW | …expected-structured-output/google-drive/fake.docx.json | 5 | "text": "Lorem ipsum dolor sit amet.", | CODE |
| LOW | …d-structured-output/google-drive/nested/fake.docx.json | 5 | "text": "Lorem ipsum dolor sit amet.", | CODE |
| LOW | …d-structured-output/google-drive/nested/fake.docx.json | 5 | "text": "Lorem ipsum dolor sit amet.", | CODE |
| LOW | …gest/expected-structured-output/jira-diff/1/10000.json | 219 | "text": "Unstructured Devops My comment 1 Unstructured Devops My attachment image lorem ipsum:", | CODE |
| LOW | …gest/expected-structured-output/jira-diff/1/10000.json | 329 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. [Nam quid possumus facere melius?|http://loripsum. | CODE |
| LOW | …gest/expected-structured-output/jira-diff/1/10000.json | 329 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. [Nam quid possumus facere melius?|http://loripsum. | CODE |
| LOW | …-output/Sharepoint/SitePages/This-is-a-title.aspx.json | 49 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales c | CODE |
| LOW | …-output/Sharepoint/SitePages/This-is-a-title.aspx.json | 49 | "text": "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales c | CODE |
| LOW | …int-with-permissions/SitePages/This-is-a-title.aspx.md | 3 | Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales consequat turp | CODE |
| LOW | …int-with-permissions/SitePages/This-is-a-title.aspx.md | 3 | Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam ex tellus, sodales non nulla et, sodales consequat turp | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 27 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 27 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 36 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblbj2vBlL2dN2xqq.md | 36 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 36 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/appJ43QmP8I17zu88/tblfu7DzEcCWNKwP4.md | 36 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 18 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 36 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblBoUk54tWXGqYai.md | 36 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 18 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 18 | <td># Quis est enim, in quo sit cupiditas, quin recte cupidus dici possit?\nLorem ipsum dolor sit amet, consectetu | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 27 | <td># Nescio quo modo praetervolavit oratio.\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Quid ad uti | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 36 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW⚡ | …n/airtable-diff/app5YQxSfp220fWtm/tblxdPc7L2meGIZLE.md | 36 | <td># Nec lapathi suavitatem acupenseri Galloni Laelius anteponebat, sed suavitatem ipsam neglegebat;\nLorem ipsum | CODE |
| LOW | …d-structured-output-markdown/google-drive/fake.docx.md | 1 | Lorem ipsum dolor sit amet. | CODE |
| LOW | …d-structured-output-markdown/google-drive/fake.docx.md | 1 | Lorem ipsum dolor sit amet. | CODE |
| LOW | …tured-output-markdown/google-drive/nested/fake.docx.md | 1 | Lorem ipsum dolor sit amet. | CODE |
| LOW | …tured-output-markdown/google-drive/nested/fake.docx.md | 1 | Lorem ipsum dolor sit amet. | CODE |
| LOW⚡ | …pected-structured-output-markdown/jira-diff/1/10000.md | 10 | Unstructured Devops My comment 1 Unstructured Devops My attachment image lorem ipsum: | CODE |
| LOW⚡ | …pected-structured-output-markdown/jira-diff/1/10000.md | 15 | Lorem ipsum dolor sit amet, consectetur adipiscing elit. [Nam quid possumus facere melius?|http://loripsum.net/] Ita rel | CODE |
| 362 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test_unstructured/test_safe_http.py | 3 | CODE | |
| LOW | test_unstructured/test_utils.py | 1 | CODE | |
| LOW | test_unstructured/test_utils.py | 49 | CODE | |
| LOW | test_unstructured/test_utils.py | 57 | CODE | |
| LOW | test_unstructured/test_utils.py | 58 | CODE | |
| LOW | test_unstructured/test_utils.py | 66 | CODE | |
| LOW | test_unstructured/test_utils.py | 75 | CODE | |
| LOW | test_unstructured/test_utils.py | 76 | CODE | |
| LOW | test_unstructured/test_utils.py | 86 | CODE | |
| LOW | test_unstructured/test_cli_doctor.py | 3 | CODE | |
| LOW | test_unstructured/test_telemetry.py | 8 | CODE | |
| LOW | test_unstructured/unit_utils.py | 3 | CODE | |
| LOW | test_unstructured/unit_utils.py | 10 | CODE | |
| LOW | test_unstructured/unit_utils.py | 10 | CODE | |
| LOW | test_unstructured/unit_utils.py | 10 | CODE | |
| LOW | test_unstructured/unit_utils.py | 21 | CODE | |
| LOW | test_unstructured/unit_utils.py | 21 | CODE | |
| LOW | test_unstructured/unit_utils.py | 21 | CODE | |
| LOW | test_unstructured/metrics/test_element_type.py | 1 | CODE | |
| LOW | test_unstructured/staging/test_base.py | 14 | CODE | |
| LOW | test_unstructured/chunking/test_dispatch.py | 5 | CODE | |
| LOW | test_unstructured/chunking/test_basic.py | 7 | CODE | |
| LOW | test_unstructured/chunking/test_table_isolation.py | 10 | CODE | |
| LOW | test_unstructured/chunking/test_title.py | 5 | CODE | |
| LOW | test_unstructured/chunking/test_base.py | 5 | CODE | |
| LOW | test_unstructured/common/test_html_table.py | 5 | CODE | |
| LOW | test_unstructured/documents/test_elements.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_ndjson.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_xml.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_docx.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_email.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_odt.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_tsv.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_md.py | 1 | CODE | |
| LOW | test_unstructured/partition/test_audio.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_org.py | 1 | CODE | |
| LOW | test_unstructured/partition/test_ppt.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_xlsx.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_msg.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_text.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_rst.py | 1 | CODE | |
| LOW | test_unstructured/partition/test_rtf.py | 1 | CODE | |
| LOW | test_unstructured/partition/test_auto.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_json.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_pptx.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_doc.py | 5 | CODE | |
| LOW | test_unstructured/partition/test_csv.py | 3 | CODE | |
| LOW | test_unstructured/partition/test_epub.py | 1 | CODE | |
| LOW | …tured/partition/utils/ocr_models/test_ocr_interface.py | 5 | CODE | |
| LOW | …t_unstructured/partition/html/test_xss_sanitization.py | 12 | CODE | |
| LOW | test_unstructured/partition/html/test_partition.py | 5 | CODE | |
| LOW | test_unstructured/partition/common/test_lang.py | 5 | CODE | |
| LOW | test_unstructured/partition/common/test_metadata.py | 5 | CODE | |
| LOW | …nstructured/partition/common/test_json_partitioning.py | 3 | CODE | |
| LOW | test_unstructured/partition/pdf_image/test_image.py | 1 | CODE | |
| LOW | test_unstructured/file_utils/test_model.py | 3 | CODE | |
| LOW | test_unstructured/file_utils/test_filetype.py | 5 | CODE | |
| LOW | scripts/performance/benchmark_partition.py | 23 | CODE | |
| LOW | scripts/performance/compare_benchmark.py | 38 | CODE | |
| LOW | unstructured/cli.py | 3 | CODE | |
| 91 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | test_unstructured/partition/test_docx.py | 0 | all default arguments for `htmlpartitioneroptions`. individual argument values can be changed to suit each test. makes c | STRING |
| HIGH | test_unstructured/partition/test_xlsx.py | 0 | all default arguments for `htmlpartitioneroptions`. individual argument values can be changed to suit each test. makes c | STRING |
| HIGH | test_unstructured/partition/test_pptx.py | 0 | all default arguments for `htmlpartitioneroptions`. individual argument values can be changed to suit each test. makes c | STRING |
| HIGH | test_unstructured/partition/test_msg.py | 0 | all default arguments for `htmlpartitioneroptions`. individual argument values can be changed to suit each test. makes c | STRING |
| HIGH | test_unstructured/partition/html/test_partition.py | 0 | all default arguments for `htmlpartitioneroptions`. individual argument values can be changed to suit each test. makes c | STRING |
| HIGH | unstructured/partition/docx.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/email.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/xlsx.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/msg.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/pptx.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/html/partition.py | 0 | encapsulates partitioning option validation, computation, and application of defaults. | STRING |
| HIGH | unstructured/partition/docx.py | 0 | the best last-modified date available, none if no sources are available. | STRING |
| HIGH | unstructured/partition/csv.py | 0 | the best last-modified date available, none if no sources are available. | STRING |
| HIGH | unstructured/partition/xlsx.py | 0 | the best last-modified date available, none if no sources are available. | STRING |
| HIGH | unstructured/partition/pptx.py | 0 | the best last-modified date available, none if no sources are available. | STRING |
| HIGH | unstructured/partition/html/partition.py | 0 | the best last-modified date available, none if no sources are available. | STRING |
| HIGH | unstructured/partition/docx.py | 0 | the best available file-path for this document or `none` if unavailable. | STRING |
| HIGH | unstructured/partition/xlsx.py | 0 | the best available file-path for this document or `none` if unavailable. | STRING |
| HIGH | unstructured/partition/pptx.py | 0 | the best available file-path for this document or `none` if unavailable. | STRING |
| HIGH | unstructured/partition/org.py | 0 | partitions an rst document. the document is first converted to html and then partitioned using partition_html. parameter | STRING |
| HIGH | unstructured/partition/rtf.py | 0 | partitions an rst document. the document is first converted to html and then partitioned using partition_html. parameter | STRING |
| HIGH | unstructured/partition/rst.py | 0 | partitions an rst document. the document is first converted to html and then partitioned using partition_html. parameter | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test_unstructured_ingest/json-to-text.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | …ed-output-markdown/s3/2023-Jan-economic-outlook.pdf.md | 61 | The balance of risks to the global outlook remains tilted to the downside, with scope for lower growth and higher inflat | COMMENT |
| LOW | …-structured-output-markdown/s3/Silent-Giant-(1).pdf.md | 61 | However, markets fail to give due credit to electricity generators, such as nuclear energy, that are able to meet these | COMMENT |
| LOW | …-structured-output-markdown/s3/Silent-Giant-(1).pdf.md | 81 | # i | COMMENT |
| LOW | …ed-output-markdown/s3/recalibrating-risk-report.pdf.md | 41 | 8 | COMMENT |
| LOW | …uctured-output-markdown/confluence-diff/MFS/1605928.md | 1 | # \uD83D\uDDD3 Date | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 1 | <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd" | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 21 | <body> <div class="header"> <div class="header-content"> <a href="http://www.weather.gov" class="header-nws"><img src="/ | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 41 | <p><strong>First, take steps to better prepare for the seasonal hazards weather can throw at you.</strong><br /> This co | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 61 | # width | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 81 | <!- | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 101 | # <div class="div | COMMENT |
| LOW | …tructured-output-markdown/azure/spring-weather.html.md | 121 | > | COMMENT |
| LOW | …nedrive/utic-test-ingest-fixtures/tests-example.xls.md | 1 | <table><tr><td>MC</td><td>What is 2+2?</td><td>4</td><td>correct</td><td>3</td><td>incorrect</td><td/><td/><td/></tr><tr | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-4-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-1-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-8-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-2-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-7-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-9-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-5-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-6-57554198.md | 1 | # American | COMMENT |
| LOW | …ctured-output-markdown/opensearch/movies-3-57554198.md | 1 | # American | COMMENT |
| LOW | …ed-output-markdown/mongodb/659daefa21dd8c9054b084b7.md | 1 | 1901 | COMMENT |
| LOW | …ed-output-markdown/mongodb/659daefa21dd8c9054b084b6.md | 1 | 1901 | COMMENT |
| LOW | …ed-output-markdown/mongodb/659daefa21dd8c9054b084b9.md | 1 | 1908 | COMMENT |
| LOW | …ed-output-markdown/mongodb/659daefa21dd8c9054b084b8.md | 1 | 1908 | COMMENT |
| LOW | …uctured-output-markdown/hubspot/products/2362691415.md | 1 | Example product description. This is a text containing relevant information pertaining to ProductA. The text represents | COMMENT |
| LOW | …uctured-output-markdown/hubspot/products/2362691417.md | 1 | Example product description. This is a text containing relevant information pertaining to ProductC. The text represents | COMMENT |
| LOW | …uctured-output-markdown/hubspot/products/2362691416.md | 1 | Example product description. This is a text containing relevant information pertaining to ProductB. The text represents | COMMENT |
| LOW | …rkdown/local-single-file/UDHR_first_article_all.txt.md | 81 | Chin, Matu Thlangboeih he rhimomna, vanpitna, yalpona hamhmoel ka tawn thlang la cuun la ng’om u. Thlanghing he athae-th | COMMENT |
| LOW | …rkdown/local-single-file/UDHR_first_article_all.txt.md | 101 | # Chinese, Mandarin (Tianjin) | COMMENT |
| LOW | …pected-structured-output-markdown/jira-diff/1/10002.md | 1 | # IssueID_IssueKey:10002 JCTP1-3 | COMMENT |
| LOW | …pected-structured-output-markdown/jira-diff/1/10013.md | 1 | # IssueID_IssueKey:10013 JCTP1-4 | COMMENT |
| LOW | …pected-structured-output-markdown/jira-diff/1/10000.md | 1 | # IssueID_IssueKey:10000 JCTP1-1 | COMMENT |
| LOW | …pected-structured-output-markdown/jira-diff/1/10000.md | 21 | # test.atlassian.net/rest/api/2/attachment/10000 | COMMENT |
| LOW | …pected-structured-output-markdown/jira-diff/1/10001.md | 1 | # IssueID_IssueKey:10001 JCTP1-2 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP3/10014.md | 1 | # IssueID_IssueKey:10014 JCTP3-1 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP2/10009.md | 1 | # IssueID_IssueKey:10009 JCTP2-7 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP2/10006.md | 1 | # IssueID_IssueKey:10006 JCTP2-4 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP2/10012.md | 1 | # IssueID_IssueKey:10012 JCTP2-10 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP2/10010.md | 1 | # IssueID_IssueKey:10010 JCTP2-8 | COMMENT |
| LOW | …ed-structured-output-markdown/jira-diff/JCTP2/10015.md | 1 | # IssueID_IssueKey:10015 JCTP2-11 | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9FIAU.xml.md | 1 | # attributes.type: Campaign | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9FIAU.xml.md | 21 | # NumberOfResponses: 0 | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9GIAU.xml.md | 1 | # attributes.type: Campaign | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9GIAU.xml.md | 21 | # NumberOfResponses: 0 | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9EIAU.xml.md | 1 | # attributes.type: Campaign | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9EIAU.xml.md | 21 | # NumberOfResponses: 0 | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9HIAU.xml.md | 1 | # attributes.type: Campaign | COMMENT |
| LOW | …markdown/salesforce/Campaign/701Hu000001eX9HIAU.xml.md | 21 | # NumberOfResponses: 0 | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-4-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-1-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-8-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-2-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-7-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-9-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-5-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-6-57554198.md | 1 | # American | COMMENT |
| LOW | …red-output-markdown/elasticsearch/movies-3-57554198.md | 1 | # American | COMMENT |
| 10 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test_unstructured/partition/test_audio.py | 190 | CODE | |
| LOW | test_unstructured/partition/test_auto.py | 1451 | CODE | |
| LOW | test_unstructured/partition/pdf_image/test_pdf.py | 286 | CODE | |
| LOW | test_unstructured/partition/pdf_image/test_pdf.py | 969 | CODE | |
| LOW | test_unstructured/partition/pdf_image/test_pdf.py | 1352 | CODE | |
| LOW | test_unstructured/partition/pdf_image/test_pdf.py | 1874 | CODE | |
| LOW | test_unstructured/file_utils/test_encoding.py | 15 | CODE | |
| LOW | unstructured/utils.py | 366 | CODE | |
| LOW | unstructured/safe_http.py | 190 | CODE | |
| LOW | unstructured/metrics/text_extraction.py | 123 | CODE | |
| LOW | unstructured/metrics/evaluate.py | 510 | CODE | |
| LOW | unstructured/metrics/evaluate.py | 599 | CODE | |
| LOW | unstructured/metrics/evaluate.py | 282 | CODE | |
| LOW | unstructured/metrics/table/table_alignment.py | 59 | CODE | |
| LOW | unstructured/metrics/table/table_extraction.py | 15 | CODE | |
| LOW | unstructured/staging/weaviate.py | 89 | CODE | |
| LOW | unstructured/staging/base.py | 196 | CODE | |
| LOW | unstructured/staging/base.py | 359 | CODE | |
| LOW | unstructured/staging/base.py | 557 | CODE | |
| LOW | unstructured/staging/base.py | 711 | CODE | |
| LOW | unstructured/chunking/base.py | 734 | CODE | |
| LOW | unstructured/chunking/base.py | 887 | CODE | |
| LOW | unstructured/chunking/base.py | 1462 | CODE | |
| LOW | unstructured/chunking/base.py | 896 | CODE | |
| LOW | unstructured/nlp/tokenize.py | 52 | CODE | |
| LOW | unstructured/documents/elements.py | 367 | CODE | |
| LOW | unstructured/partition/md.py | 48 | CODE | |
| LOW | unstructured/partition/docx.py | 393 | CODE | |
| LOW | unstructured/partition/docx.py | 483 | CODE | |
| LOW | unstructured/partition/docx.py | 785 | CODE | |
| LOW | unstructured/partition/docx.py | 833 | CODE | |
| LOW | unstructured/partition/docx.py | 502 | CODE | |
| LOW | unstructured/partition/docx.py | 838 | CODE | |
| LOW | unstructured/partition/pdf.py | 253 | CODE | |
| LOW | unstructured/partition/pdf.py | 480 | CODE | |
| LOW | unstructured/partition/pdf.py | 618 | CODE | |
| LOW | unstructured/partition/pdf.py | 779 | CODE | |
| LOW | unstructured/partition/pdf.py | 1400 | CODE | |
| LOW | unstructured/partition/api.py | 232 | CODE | |
| LOW | unstructured/partition/text.py | 111 | CODE | |
| LOW | unstructured/partition/xlsx.py | 45 | CODE | |
| LOW | unstructured/partition/xlsx.py | 441 | CODE | |
| LOW | unstructured/partition/pptx.py | 141 | CODE | |
| LOW | unstructured/partition/pptx.py | 217 | CODE | |
| LOW | unstructured/partition/utils/sorting.py | 99 | CODE | |
| LOW | unstructured/partition/utils/sorting.py | 138 | CODE | |
| LOW | unstructured/partition/html/transformations.py | 302 | CODE | |
| LOW | unstructured/partition/common/lang.py | 328 | CODE | |
| LOW | unstructured/partition/common/lang.py | 412 | CODE | |
| LOW | unstructured/partition/common/common.py | 34 | CODE | |
| LOW | unstructured/partition/pdf_image/pdf_image_utils.py | 117 | CODE | |
| LOW | unstructured/partition/pdf_image/pdf_image_utils.py | 313 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 467 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 772 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 1234 | CODE | |
| LOW | unstructured/partition/pdf_image/ocr.py | 105 | CODE | |
| LOW | unstructured/partition/pdf_image/ocr.py | 210 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_utils.py | 46 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_utils.py | 155 | CODE | |
| LOW | unstructured/partition/pdf_image/pdfminer_utils.py | 461 | CODE | |
| 10 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | test_unstructured_ingest/structured-json-to-html.sh | 3 | # Define the input and output top directories | COMMENT |
| MEDIUM | test_unstructured_ingest/structured-json-to-markdown.sh | 3 | # Define the input and output top directories | COMMENT |
| MEDIUM | test_unstructured/partition/utils/test_xycut.py | 114 | # Define the expected image with the square drawn | COMMENT |
| MEDIUM | test_unstructured/partition/html/test_partition.py | 1505 | # Create a file-like object with empty content | COMMENT |
| MEDIUM | test_unstructured/partition/html/test_partition.py | 1509 | # Create a temporary file with the given content | COMMENT |
| MEDIUM | test_unstructured/partition/pdf_image/test_pdf.py | 1249 | # Create an exception that will be raised directly after OCR is called to stop execution | COMMENT |
| MEDIUM | …nstructured/partition/pdf_image/test_merge_elements.py | 30 | # Create a PageLayout for the inferred layout | COMMENT |
| MEDIUM | example-docs/logger.py | 7 | # Create a custom logging level | COMMENT |
| MEDIUM | example-docs/logger.py | 12 | # Create a custom log method for the "DETAIL" level | COMMENT |
| MEDIUM | …rs/destination_connector/create-opensearch-instance.sh | 7 | # Create the Opensearch cluster | COMMENT |
| MEDIUM | …elpers/source_connector/create-and-check-opensearch.sh | 7 | # Create the Opensearch cluster | COMMENT |
| MEDIUM | …destination_connector/create-elasticsearch-instance.sh | 8 | # Create the Elasticsearch cluster | COMMENT |
| MEDIUM | …t-helpers/source_connector/create-fill-and-check-es.sh | 8 | # Create the Elasticsearch cluster | COMMENT |
| MEDIUM | scripts/kafka-test-helpers/create-kafka-instance.sh | 7 | # Create the Weaviate instance | COMMENT |
| MEDIUM | scripts/sql-test-helpers/create-sql-instance.sh | 9 | # Create the SQL instance | COMMENT |
| MEDIUM | …ipts/weaviate-test-helpers/create-weaviate-instance.sh | 7 | # Create the Weaviate instance | COMMENT |
| MEDIUM | scripts/performance/benchmark-local.sh | 4 | # This file is separated out to allow us to easily execute this part of the test script inside a Docker container. | COMMENT |
| MEDIUM | unstructured/logger.py | 6 | # Create a custom logging level | COMMENT |
| MEDIUM | unstructured/logger.py | 11 | # Create a custom log method for the "DETAIL" level | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test_unstructured_ingest/test-ingest-src.sh | 61 | # Check if the test is in tests_to_ignore | COMMENT |
| LOW | …structured_ingest/python/test-produce-kafka-message.py | 47 | # Read the file in binary mode and encode content in base64 | COMMENT |
| LOW | …structured_ingest/python/test-ingest-astradb-output.py | 38 | # Print the results | COMMENT |
| LOW | test_unstructured/partition/utils/test_xycut.py | 132 | # Check if the resulting image contains the expected shapes and labels | COMMENT |
| LOW | test_unstructured/partition/utils/test_xycut.py | 178 | # Check if vis_points was called with the correct arguments | COMMENT |
| LOW⚡ | test_unstructured/partition/pdf_image/test_ocr.py | 352 | # Check if the final layout contains the original layout elements | COMMENT |
| LOW⚡ | test_unstructured/partition/pdf_image/test_ocr.py | 356 | # Check if the final layout contains the OCR-derived elements | COMMENT |
| LOW⚡ | test_unstructured/partition/pdf_image/test_ocr.py | 359 | # Check if the OCR-derived elements that are subregions of layout elements are removed | COMMENT |
| LOW | test_unstructured/partition/pdf_image/test_ocr.py | 381 | # Check if the out layout's text attribute is updated with aggregated OCR text | COMMENT |
| LOW | test_unstructured/partition/pdf_image/test_ocr.py | 384 | # Check if the final layout contains both original elements and OCR-derived elements | COMMENT |
| LOW | test_unstructured/partition/pdf_image/test_ocr.py | 530 | # Check if the out layout's text attribute is updated with aggregated OCR text | COMMENT |
| LOW | test_unstructured/partition/pdf_image/test_ocr.py | 533 | # Check if the final layout contains both original elements and OCR-derived elements | COMMENT |
| LOW | …structured/partition/pdf_image/test_pdf_image_utils.py | 370 | # Check if images for both layouts were saved | COMMENT |
| LOW | …structured/partition/pdf_image/test_pdf_image_utils.py | 391 | # Check if only the inferred layout image was saved if extracted layout is None | COMMENT |
| LOW | scripts/check-new-release-version.sh | 22 | # Check if the current version is a non-dev version and not matching the main version | COMMENT |
| LOW | scripts/user/u-tables-inspect.sh | 33 | # Check if the directory exists, if not create it | COMMENT |
| LOW | scripts/user/u-tables-inspect.sh | 65 | # Open the file in a new browser window | COMMENT |
| LOW | scripts/user/process-pdf-parallel-through-api.sh | 31 | # Check if UNST_API_KEY is set | COMMENT |
| LOW | scripts/user/process-pdf-parallel-through-api.sh | 49 | # Check if PDF parts directory exists | COMMENT |
| LOW | scripts/user/unstructured-get-json.sh | 198 | # Check if vlm-provider or vlm-model are provided without --vlm | COMMENT |
| LOW | unstructured/metrics/utils.py | 238 | # Check if the file exists | COMMENT |
| LOW | unstructured/staging/base.py | 181 | # Check if we hit the size limit or if data is actually incomplete | COMMENT |
| LOW | unstructured/embed/voyageai.py | 113 | # Check if adding this text would exceed limits | COMMENT |
| LOW⚡ | unstructured/partition/docx.py | 907 | # Check if category depth can be determined from style ilvl | COMMENT |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 444 | # Check if text is low_fidelity: | COMMENT |
| LOW | unstructured/partition/pdf_image/pdfminer_utils.py | 447 | # Check if this is a duplicate of the last LTChar | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | test_unstructured/partition/pdf_image/test_pdf.py | 1154 | except Exception as e: | CODE |
| LOW | scripts/performance/quick_partition_bench.py | 41 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | unstructured/doctor.py | 54 | except Exception as exc: # noqa: BLE001 — surface libmagic load/binary issues | CODE |
| MEDIUM | unstructured/doctor.py | 47 | def _libmagic_status() -> tuple[Status, str]: | CODE |
| LOW | unstructured/metrics/evaluate.py | 197 | except Exception as e: | CODE |
| LOW⚡ | unstructured/metrics/table/table_extraction.py | 163 | except Exception as e: | CODE |
| MEDIUM⚡ | unstructured/metrics/table/table_extraction.py | 164 | print(f"Error converting ground truth data: {e}") | CODE |
| LOW⚡ | unstructured/metrics/table/table_extraction.py | 254 | except Exception as e: | CODE |
| MEDIUM⚡ | unstructured/metrics/table/table_extraction.py | 255 | print(f"Error converting Unstructured table data: {e}") | CODE |
| LOW | unstructured/partition/docx.py | 534 | except Exception as e: | CODE |
| LOW | unstructured/partition/docx.py | 794 | except Exception as e: | CODE |
| LOW | unstructured/partition/pdf.py | 326 | except Exception as e: | CODE |
| LOW | unstructured/partition/pdf.py | 713 | except Exception: | CODE |
| LOW | unstructured/partition/pdf.py | 740 | except Exception as e: | CODE |
| LOW | …ition/utils/speech_to_text/speech_to_text_interface.py | 82 | except Exception as e: | CODE |
| LOW | …ructured/partition/utils/speech_to_text/whisper_stt.py | 48 | except Exception as exc: | CODE |
| LOW | unstructured/partition/common/json_partitioning.py | 69 | except Exception as e: | CODE |
| LOW | unstructured/partition/pdf_image/pdf_image_utils.py | 389 | except Exception as e: | CODE |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 1052 | except Exception: | CODE |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 1074 | except Exception: | CODE |
| LOW | unstructured/partition/pdf_image/ocr.py | 202 | except Exception as e: | CODE |
| LOW | …red/partition/pdf_image/analysis/bbox_visualisation.py | 682 | except Exception as ex: # noqa: E722 | CODE |
| LOW | …red/partition/pdf_image/analysis/bbox_visualisation.py | 704 | except Exception as ex: # noqa: E722 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | test_unstructured/staging/test_base.py | 152 | assert df.type.equals(expected_df.type) is True # type: ignore | CODE |
| HIGH⚡ | test_unstructured/staging/test_base.py | 153 | assert df.text.equals(expected_df.text) is True # type: ignore | CODE |
| HIGH | unstructured/partition/common/json_partitioning.py | 102 | # -- scalar (str / number / bool / null) -- | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | unstructured/metrics/text_extraction.py | 76 | Calculates edit distance using Levenshtein distance between two strings. Args: output (str): The targe | STRING |
| HIGH | unstructured/partition/html/transformations.py | 378 | Parses the given HTML code and converts it into an Element object. Args: html_code (str): The HTML cod | STRING |
| HIGH | unstructured/partition/pdf_image/pdf_image_utils.py | 35 | Write an image to a specified file path, supporting both PIL Image and numpy ndarray formats. Parameters: | STRING |
| HIGH | unstructured/file_utils/filetype.py | 75 | Determine file-type of specified file using libmagic and/or fallback methods. One of `file_path` or `file` must be | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | unstructured/staging/datasaur.py | 24 | CODE | |
| LOW | unstructured/embed/vertexai.py | 64 | CODE | |
| LOW | unstructured/chunking/basic.py | 24 | CODE | |
| LOW | unstructured/chunking/title.py | 23 | CODE | |
| LOW | unstructured/documents/elements.py | 238 | CODE | |
| LOW | unstructured/partition/pdf.py | 127 | CODE | |
| LOW | unstructured/partition/pdf.py | 253 | CODE | |
| LOW | unstructured/partition/pdf.py | 779 | CODE | |
| LOW | unstructured/partition/pdf.py | 1133 | CODE | |
| LOW | unstructured/partition/pdf.py | 1400 | CODE | |
| LOW | unstructured/partition/api.py | 24 | CODE | |
| LOW | unstructured/partition/image.py | 17 | CODE | |
| LOW | unstructured/partition/auto.py | 26 | CODE | |
| LOW | unstructured/partition/html/partition.py | 28 | CODE | |
| LOW | unstructured/partition/common/common.py | 157 | CODE | |
| LOW | unstructured/partition/pdf_image/ocr.py | 35 | CODE | |
| LOW | unstructured/partition/pdf_image/ocr.py | 105 | CODE | |
| LOW | unstructured/partition/pdf_image/analysis/tools.py | 57 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | unstructured/chunking/base.py | 685 | # -- efficient and definitely more robust than hoping two different computations of combined | COMMENT |
| MEDIUM | unstructured/common/html_table.py | 66 | # -- root is always a `<table>` element so far but let's be robust -- | COMMENT |
| LOW | unstructured/partition/docx.py | 404 | # -- functions like `._iter_paragraph_elements()` where the "just return when done" | COMMENT |
| LOW | unstructured/partition/pptx.py | 152 | # -- functions like `._iter_shape_elements()` where the "just return when done" | COMMENT |
| MEDIUM | unstructured/partition/pptx.py | 432 | # -- any documents, however there's no reason not to make the mechanism robust against | COMMENT |
| LOW | unstructured/partition/pdf_image/pdfminer_processing.py | 89 | # TODO: refactor to just use np array as input | COMMENT |
| LOW | unstructured/partition/pdf_image/ocr.py | 391 | # results. Can we just use ocr bounding boxes (gonna be many but at least we save | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/performance/benchmark_partition.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | scripts/performance/benchmark_partition.py | 86 | def _set_github_output(key: str, value: str) -> None: | CODE |
| LOW | scripts/performance/compare_benchmark.py | 51 | logger = logging.getLogger(__name__) | CODE |
| LOW | scripts/convert/elements_json_to_format.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | scripts/convert/rendered_html_from_elements.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | unstructured/safe_http.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | unstructured/chunking/__init__.py | 15 | __all__ = [ | CODE |
| LOW | unstructured/nlp/tokenize.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | unstructured/partition/utils/config.py | 53 | def _setup_tmpdir(self, tmpdir: str) -> None: | CODE |
| LOW | unstructured/partition/utils/speech_to_text/__init__.py | 8 | __all__ = ["SpeechToTextAgent", "TranscriptionSegment"] | CODE |
| LOW | unstructured/partition/html/convert.py | 11 | logger = logging.getLogger(__name__) | CODE |
| LOW | unstructured/partition/html/convert.py | 80 | def set_children(self, children: list["ElementHtml"]) -> None: | STRING |
| LOW | unstructured/partition/html/__init__.py | 3 | __all__ = ["partition_html"] | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …/airtable-test-helpers/create_scale_test_components.py | 47 | CODE | |
| MEDIUM | unstructured/partition/docx.py | 990 | CODE | |
| MEDIUM | unstructured/partition/pptx.py | 512 | CODE | |
| MEDIUM | unstructured/partition/html/parser.py | 579 | CODE | |
| MEDIUM | unstructured/partition/html/parser.py | 901 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | scripts/performance/benchmark.sh | 3 | # Usage: | COMMENT |
| LOW | scripts/performance/profile.sh | 8 | # Usage: | COMMENT |
| LOW | scripts/performance/profile.sh | 23 | # Usage example: | COMMENT |
| LOW | unstructured/metrics/object_detection.py | 705 | # Example usage | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …ctured/partition/pdf_image/test_pdfminer_processing.py | 579 | # Now you can use it in tests | COMMENT |