Repository Analysis

opendatalab/MinerU

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

11.2 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of opendatalab/MinerU, a Python project with 74,520 GitHub stars. SynthScan v2.0 examined 118,164 lines of code across 311 source files, recording 1286 pattern matches distributed across 14 syntactic categories. The overall adjusted score of 11.2 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

11.2
Adjusted Score
11.2
Raw Score
100%
Time Factor
2026-07-14
Last Push
74.5K
Stars
Python
Language
118.2K
Lines of Code
311
Files
1.3K
Pattern Hits
2026-07-14
Scan Date
0.07
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 21MEDIUM 19LOW 1246

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1286 distinct pattern matches across 14 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers691 hits · 661 pts
SeverityFileLineSnippetContext
LOWdemo/demo.py83def prepare_local_api_temp_dir() -> None:CODE
LOWtests/unittest/test_e2e.py23def test_pipeline_with_two_config():CODE
LOWmineru/utils/model_utils.py116def remove_nested_ocr_text_blocks(CODE
LOWmineru/utils/model_utils.py148def get_res_list_from_layout_res(layout_res, overlap_threshold=0.8):CODE
LOWmineru/utils/pdfium_guard.py32def get_pdfium_document_page_count(pdf_doc) -> int:CODE
LOWmineru/utils/pdfium_guard.py54def close_pdfium_objects_safely(*pdfium_objs, owner: str = "pdfium cleanup") -> None:CODE
LOWmineru/utils/pdfium_guard.py65def get_loadable_pdfium_page_indices(CODE
LOWmineru/utils/pdfium_guard.py108def rewrite_pdf_bytes_with_pdfium(CODE
LOWmineru/utils/models_download_utils.py23def get_tools_config_file_path() -> str:CODE
LOWmineru/utils/models_download_utils.py38def is_config_version_outdated(config_version):CODE
LOWmineru/utils/models_download_utils.py88def persist_resolved_model_source(model_source: str) -> None:CODE
LOWmineru/utils/models_download_utils.py102def normalize_download_relative_path(relative_path: str, repo_mode: str) -> str:CODE
LOWmineru/utils/models_download_utils.py113def read_existing_tools_config() -> dict | None:CODE
LOWmineru/utils/models_download_utils.py130def get_configured_repo_model_root(config: dict, repo_mode: str) -> str | None:CODE
LOWmineru/utils/models_download_utils.py144def build_configured_model_path(model_root: str, relative_path: str) -> str:CODE
LOWmineru/utils/models_download_utils.py151def get_existing_configured_model_root(repo_mode: str, relative_path: str) -> str | None:CODE
LOWmineru/utils/models_download_utils.py168def persist_downloaded_model_config(model_source: str, repo_mode: str, model_root: str) -> None:CODE
LOWmineru/utils/models_download_utils.py190def resolve_auto_model_source() -> str:CODE
LOWmineru/utils/models_download_utils.py254def _snapshot_download_cached(model_source: str, repo_mode: str, repo: str, relative_path: str) -> str:CODE
LOWmineru/utils/models_download_utils.py279def auto_download_and_get_model_root_path(relative_path: str, repo_mode='pipeline') -> str:CODE
LOWmineru/utils/check_sys_env.py26def is_mac_os_version_supported(min_version: str = "13.5") -> bool:CODE
LOWmineru/utils/pdf_text_tool.py54def _get_visible_char_signature(CODE
LOWmineru/utils/pdf_text_tool.py80def _calculate_bbox_overlap_in_smaller_area(CODE
LOWmineru/utils/pdf_text_tool.py107def _is_adjacent_offset_duplicate_char(CODE
LOWmineru/utils/pdf_text_tool.py149def _get_near_identical_bbox_bucket_key(CODE
LOWmineru/utils/pdf_text_tool.py159def _iter_neighbor_bbox_bucket_keys(CODE
LOWmineru/utils/pdf_text_tool.py244def _legacy_chars_to_page_chars(chars):CODE
LOWmineru/utils/pdf_text_tool.py278def _deduplicate_near_identical_chars(CODE
LOWmineru/utils/llm_aided.py20def _get_title_line_avg_height(block):CODE
LOWmineru/utils/llm_aided.py44def _collect_title_block_refs(page_info_list):CODE
LOWmineru/utils/llm_aided.py71def _build_title_optimize_prompt(title_dict):CODE
LOWmineru/utils/llm_aided.py114def _build_relative_title_optimize_prompt(title_dict):STRING
LOWmineru/utils/llm_aided.py235def _get_title_block_identity(block):STRING
LOWmineru/utils/llm_aided.py247def _sync_para_titles_to_preproc(page_info_list):STRING
LOWmineru/utils/llm_aided.py270def _run_single_pass_title_leveling(title_block_refs, title_aided_config):STRING
LOWmineru/utils/llm_aided.py276def _split_paragraph_title_groups(title_block_refs):STRING
LOWmineru/utils/llm_aided.py295def _offset_paragraph_title_levels(levels_by_index):STRING
LOWmineru/utils/llm_aided.py305def _request_paragraph_group_levels(title_block_refs, title_aided_config):STRING
LOWmineru/utils/llm_aided.py315def _run_grouped_title_leveling(title_block_refs, title_aided_config):STRING
LOWmineru/utils/config_reader.py33def get_configured_model_source(default: str | None = None) -> str | None:CODE
LOWmineru/utils/config_reader.py152def get_ocr_det_mask_inline_formula_enable(enable):CODE
LOWmineru/utils/config_reader.py158def get_processing_window_size(default: int = 64) -> int:CODE
LOWmineru/utils/config_reader.py172def get_max_concurrent_requests(default: int = 3) -> int:CODE
LOWmineru/utils/config_reader.py195def get_latex_delimiter_config():CODE
LOWmineru/utils/magic_model_utils.py79 def calc_effective_index_diff(obj_index: int, sub_index: int) -> int:CODE
LOWmineru/utils/visual_magic_model_utils.py101def fallback_inline_caption_fragments(blocks, visual_main_types):CODE
LOWmineru/utils/visual_magic_model_utils.py132def fallback_leading_table_continuation_captions(blocks, visual_main_types):CODE
LOWmineru/utils/visual_magic_model_utils.py175def _is_leading_continuation_text_block(block):CODE
LOWmineru/utils/visual_magic_model_utils.py193def is_transparent_visual_relation_block(block):CODE
LOWmineru/utils/visual_magic_model_utils.py204def _is_leading_continuation_cluster_near_table(leading_blocks, table_block):CODE
LOWmineru/utils/visual_magic_model_utils.py226def fallback_stacked_table_caption_fragments(blocks, visual_main_types):CODE
LOWmineru/utils/visual_magic_model_utils.py267def find_stacked_table_caption_cluster(table_block, blocks):CODE
LOWmineru/utils/visual_magic_model_utils.py303def find_last_caption_position(caption_cluster):CODE
LOWmineru/utils/visual_magic_model_utils.py311def is_horizontally_near_table(block, table_block):CODE
LOWmineru/utils/visual_magic_model_utils.py323def is_single_line_caption_fragment(block):CODE
LOWmineru/utils/visual_magic_model_utils.py333def find_previous_effective_block(ordered_blocks, pos):CODE
LOWmineru/utils/visual_magic_model_utils.py342def find_next_effective_block(ordered_blocks, pos):CODE
LOWmineru/utils/visual_magic_model_utils.py351def is_inline_caption_fragment(previous_caption, text_block, next_visual):CODE
LOWmineru/utils/visual_magic_model_utils.py477def absorb_image_block_members(blocks):CODE
LOWmineru/utils/visual_magic_model_utils.py622def effective_visual_index_diff(CODE
631 more matches not shown…
Deep Nesting197 hits · 165 pts
SeverityFileLineSnippetContext
LOWmineru/utils/model_utils.py148CODE
LOWmineru/utils/model_utils.py183CODE
LOWmineru/utils/model_utils.py217CODE
LOWmineru/utils/pdfium_guard.py65CODE
LOWmineru/utils/pdfium_guard.py108CODE
LOWmineru/utils/pdf_reader.py11CODE
LOWmineru/utils/llm_aided.py160CODE
LOWmineru/utils/config_reader.py105CODE
LOWmineru/utils/magic_model_utils.py32CODE
LOWmineru/utils/guess_suffix_or_lang.py41CODE
LOWmineru/utils/guess_suffix_or_lang.py185CODE
LOWmineru/utils/span_pre_proc.py43CODE
LOWmineru/utils/span_pre_proc.py453CODE
LOWmineru/utils/span_pre_proc.py605CODE
LOWmineru/utils/office_rich_text.py300CODE
LOWmineru/utils/office_rich_text.py350CODE
LOWmineru/utils/engine_utils.py10CODE
LOWmineru/utils/table_merge.py78CODE
LOWmineru/utils/table_merge.py402CODE
LOWmineru/utils/table_merge.py483CODE
LOWmineru/utils/table_merge.py769CODE
LOWmineru/utils/table_merge.py868CODE
LOWmineru/utils/table_merge.py938CODE
LOWmineru/utils/pdf_image_tools.py184CODE
LOWmineru/utils/pdf_image_tools.py419CODE
LOWmineru/utils/pdf_classify.py290CODE
LOWmineru/utils/pdf_classify.py313CODE
LOWmineru/utils/pdf_classify.py1055CODE
LOWmineru/utils/draw_bbox.py102CODE
LOWmineru/utils/draw_bbox.py146CODE
LOWmineru/utils/draw_bbox.py317CODE
LOWmineru/utils/draw_bbox.py325CODE
LOWmineru/utils/boxbase.py40CODE
LOWmineru/utils/ocr_language.py134CODE
LOWmineru/backend/pipeline/model_json_to_middle_json.py72CODE
LOWmineru/backend/pipeline/model_json_to_middle_json.py148CODE
LOWmineru/backend/pipeline/model_json_to_middle_json.py196CODE
LOWmineru/backend/pipeline/batch_analyze.py408CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py18CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py124CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py365CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py518CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py550CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py609CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py745CODE
LOW…eru/backend/pipeline/pipeline_middle_json_mkcontent.py968CODE
LOWmineru/backend/pipeline/para_split.py59CODE
LOWmineru/backend/pipeline/para_split.py265CODE
LOWmineru/backend/pipeline/para_split.py309CODE
LOWmineru/backend/pipeline/para_split.py371CODE
LOWmineru/backend/pipeline/para_split.py417CODE
LOWmineru/backend/pipeline/pipeline_magic_model.py199CODE
LOWmineru/backend/pipeline/pipeline_magic_model.py222CODE
LOWmineru/backend/pipeline/model_init.py189CODE
LOWmineru/backend/pipeline/pipeline_analyze.py157CODE
LOWmineru/backend/pipeline/pipeline_analyze.py331CODE
LOWmineru/backend/office/model_output_to_middle_json.py11CODE
LOWmineru/backend/office/model_output_to_middle_json.py94CODE
LOWmineru/backend/office/model_output_to_middle_json.py126CODE
LOWmineru/backend/office/office_magic_model.py227CODE
137 more matches not shown…
Excessive Try-Catch Wrapping153 hits · 162 pts
SeverityFileLineSnippetContext
LOWupdate_version.py15 except Exception as e:CODE
MEDIUMtests/clean_coverage.py16 print(f"Error deleting file '{path}': {e}")CODE
MEDIUMtests/clean_coverage.py22 print(f"Error deleting directory '{path}': {e}")CODE
LOWtests/unittest/test_e2e.py148 except Exception as e:CODE
MEDIUMtests/unittest/test_e2e.py144def validate_html(html_content):CODE
LOWmineru/utils/pdfium_guard.py61 except Exception as exc:CODE
LOWmineru/utils/pdfium_guard.py98 except Exception:CODE
LOWmineru/utils/models_download_utils.py98 except Exception as exc:CODE
LOWmineru/utils/models_download_utils.py121 except Exception as exc:CODE
LOWmineru/utils/models_download_utils.py182 except Exception as exc:CODE
LOWmineru/utils/models_download_utils.py202 except Exception as exc:CODE
LOWmineru/utils/pdf_reader.py31 except Exception as e:CODE
LOWmineru/utils/pdf_text_tool.py336 except Exception:CODE
LOWmineru/utils/llm_aided.py212 except Exception as e:STRING
LOWmineru/utils/config_reader.py118 except Exception as e:CODE
LOWmineru/utils/config_reader.py122 except Exception as e:CODE
LOWmineru/utils/config_reader.py126 except Exception as e:CODE
LOWmineru/utils/config_reader.py130 except Exception as e:CODE
LOWmineru/utils/config_reader.py134 except Exception as e:CODE
LOWmineru/utils/guess_suffix_or_lang.py81 except Exception:CODE
LOWmineru/utils/guess_suffix_or_lang.py199 except Exception as e:CODE
LOWmineru/utils/span_pre_proc.py51 except Exception as exc:CODE
LOWmineru/utils/pdf_image_tools.py241 except Exception as exc:CODE
LOWmineru/utils/pdf_image_tools.py245 except Exception as exc:CODE
LOWmineru/utils/pdf_image_tools.py407 except Exception:CODE
LOWmineru/utils/pdf_image_tools.py415 except Exception:CODE
LOWmineru/utils/pdf_image_tools.py97 except Exception:CODE
LOWmineru/utils/pdf_image_tools.py338 except Exception:CODE
LOWmineru/utils/pdf_image_tools.py386 except Exception:CODE
LOWmineru/utils/pdf_image_tools.py395 except Exception:CODE
LOWmineru/utils/pdf_classify.py249 except Exception as e:CODE
LOWmineru/backend/pipeline/batch_analyze.py543 except Exception as e:CODE
LOWmineru/backend/pipeline/batch_analyze.py555 except Exception as e:CODE
LOWmineru/backend/pipeline/model_init.py353 except Exception as e:CODE
LOWmineru/backend/pipeline/pipeline_analyze.py102 except Exception:CODE
LOWmineru/backend/pipeline/pipeline_analyze.py193 except Exception:CODE
LOWmineru/backend/pipeline/pipeline_analyze.py347 except Exception as e:CODE
LOWmineru/backend/utils/office_chart.py78 except Exception:CODE
LOWmineru/backend/utils/office_chart.py299 except Exception:CODE
LOWmineru/backend/utils/ocr_det_utils.py16 except Exception as e:CODE
LOWmineru/backend/utils/html_image_utils.py46 except Exception as exc:CODE
LOWmineru/backend/utils/html_image_utils.py62 except Exception:CODE
LOWmineru/backend/utils/html_image_utils.py87 except Exception as exc:CODE
LOWmineru/backend/vlm/vlm_magic_model.py60 except Exception as e:CODE
LOWmineru/backend/vlm/vlm_analyze.py320 except Exception as exc:CODE
LOWmineru/backend/vlm/vlm_analyze.py419 except Exception:CODE
LOWmineru/backend/vlm/utils.py108 except Exception as e:CODE
MEDIUMmineru/backend/vlm/utils.py95def set_default_batch_size() -> int:CODE
LOWmineru/backend/hybrid/hybrid_analyze.py438 except Exception as exc:CODE
LOWmineru/backend/hybrid/hybrid_analyze.py413 except Exception as exc:CODE
LOWmineru/backend/hybrid/hybrid_analyze.py885 except Exception:CODE
LOWmineru/backend/hybrid/hybrid_magic_model.py116 except Exception as e:CODE
MEDIUMmineru/cli/client.py390def create_visualization_context() -> Optional[VisualizationContext]:CODE
LOWmineru/cli/client.py400 except Exception as exc:CODE
LOWmineru/cli/client.py436 except Exception as exc:CODE
LOWmineru/cli/client.py459 except Exception as exc:CODE
LOWmineru/cli/client.py801 except Exception as exc:CODE
LOWmineru/cli/client.py898 except Exception as exc:CODE
LOWmineru/cli/models_download.py152 except Exception as e:STRING
LOWmineru/cli/visualization.py52 except Exception as exc:CODE
93 more matches not shown…
Unused Imports116 hits · 115 pts
SeverityFileLineSnippetContext
LOWtests/get_coverage.py6CODE
LOWmineru/utils/engine_utils.py2CODE
LOWmineru/utils/engine_utils.py41CODE
LOWmineru/utils/engine_utils.py50CODE
LOWmineru/utils/engine_utils.py63CODE
LOWmineru/utils/engine_utils.py54CODE
LOWmineru/utils/cli_parser.py4CODE
LOWmineru/utils/title_level_postprocess.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py2CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_middle_json_mkcontent.py10CODE
LOWmineru/backend/office/office_magic_model.py7CODE
LOWmineru/backend/hybrid/hybrid_analyze.py5CODE
LOWmineru/cli/vlm_server.py32CODE
LOWmineru/cli/vlm_server.py48CODE
LOWmineru/cli/vlm_server.py55CODE
LOWmineru/cli/vlm_server.py38CODE
LOWmineru/cli/client_side_output.py2CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py2CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py2CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py2CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py3CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py3CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py3CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py4CODE
LOW…model/mfr/unimernet/unimernet_hf/modeling_unimernet.py8CODE
LOW…el/mfr/unimernet/unimernet_hf/unimer_mbart/__init__.py2CODE
LOW…el/mfr/unimernet/unimernet_hf/unimer_mbart/__init__.py3CODE
LOW…el/mfr/unimernet/unimernet_hf/unimer_mbart/__init__.py3CODE
LOW…del/mfr/unimernet/unimernet_hf/unimer_swin/__init__.py2CODE
LOW…del/mfr/unimernet/unimernet_hf/unimer_swin/__init__.py3CODE
LOW…del/mfr/unimernet/unimernet_hf/unimer_swin/__init__.py4CODE
LOWmineru/model/mfr/pp_formulanet_plus_m/processors.py11CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py20CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py20CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py23CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py24CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py25CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py28CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py4CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py5CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py17CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py18CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py19CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py22CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py22CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py22CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py22CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py23CODE
56 more matches not shown…
Cross-File Repetition14 hits · 70 pts
SeverityFileLineSnippetContext
HIGH…ernet/unimernet_hf/unimer_swin/modeling_unimer_swin.py0drop paths (stochastic depth) per sample (when applied in main path of residual blocks).STRING
HIGH…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py0drop paths (stochastic depth) per sample (when applied in main path of residual blocks).STRING
HIGH…/utils/pytorchocr/modeling/backbones/rec_donut_swin.py0drop paths (stochastic depth) per sample (when applied in main path of residual blocks).STRING
HIGHmineru/data/data_reader_writer/filebase.py0read at offset and limit. args: path (str): the path of file, if the path is relative path, it will be joined with parenSTRING
HIGHmineru/data/io/s3.py0read at offset and limit. args: path (str): the path of file, if the path is relative path, it will be joined with parenSTRING
HIGHmineru/data/io/base.py0read at offset and limit. args: path (str): the path of file, if the path is relative path, it will be joined with parenSTRING
HIGHmineru/data/data_reader_writer/filebase.py0write file with data. args: path (str): the path of file, if the path is relative path, it will be joined with parent_diSTRING
HIGHmineru/data/io/http.py0write file with data. args: path (str): the path of file, if the path is relative path, it will be joined with parent_diSTRING
HIGHmineru/data/io/s3.py0write file with data. args: path (str): the path of file, if the path is relative path, it will be joined with parent_diSTRING
HIGHmineru/data/io/base.py0write file with data. args: path (str): the path of file, if the path is relative path, it will be joined with parent_diSTRING
HIGHmineru/data/data_reader_writer/base.py0read the file. args: path (str): file path to read returns: bytes: the content of the fileSTRING
HIGHmineru/data/io/http.py0read the file. args: path (str): file path to read returns: bytes: the content of the fileSTRING
HIGHmineru/data/io/s3.py0read the file. args: path (str): file path to read returns: bytes: the content of the fileSTRING
HIGHmineru/data/io/base.py0read the file. args: path (str): file path to read returns: bytes: the content of the fileSTRING
AI Structural Patterns54 hits · 48 pts
SeverityFileLineSnippetContext
LOWdemo/demo.py95CODE
LOWmineru/backend/office/office_magic_model.py483CODE
LOWmineru/backend/office/office_magic_model.py589CODE
LOWmineru/backend/hybrid/hybrid_analyze.py889CODE
LOWmineru/backend/hybrid/hybrid_analyze.py1097CODE
LOWmineru/cli/api_request.py92CODE
LOWmineru/cli/gradio_app.py756CODE
LOWmineru/cli/gradio_app.py1006CODE
LOWmineru/cli/gradio_app.py1158CODE
LOWmineru/cli/gradio_app.py1787CODE
LOWmineru/cli/common.py668CODE
LOWmineru/cli/common.py760CODE
LOWmineru/model/layout/pp_doclayoutv2.py213CODE
LOWmineru/model/layout/pp_doclayoutv2.py814CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py785CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py1317CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py1620CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py1746CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py1905CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py2033CODE
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py2178CODE
LOW…nimernet_hf/unimer_mbart/configuration_unimer_mbart.py106CODE
LOW…ernet/unimernet_hf/unimer_swin/modeling_unimer_swin.py398CODE
LOW…/unimernet_hf/unimer_swin/configuration_unimer_swin.py91CODE
LOWmineru/model/utils/tools/infer/pytorchocr_utility.py220CODE
LOWmineru/model/utils/pytorchocr/modeling/necks/rnn.py91CODE
LOWmineru/model/utils/pytorchocr/modeling/necks/rnn.py324CODE
LOW…u/model/utils/pytorchocr/modeling/heads/det_db_head.py162CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py1289CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py159CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py665CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py779CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py976CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py1414CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py1627CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py1935CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py2016CODE
LOW…/utils/pytorchocr/modeling/heads/rec_unimernet_head.py2327CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py406CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py638CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py714CODE
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py918CODE
LOW…l/utils/pytorchocr/modeling/backbones/rec_pphgnetv2.py42CODE
LOW…l/utils/pytorchocr/modeling/backbones/rec_pphgnetv2.py1208CODE
LOW…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py21CODE
LOW…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py53CODE
LOW…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py131CODE
LOW…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py200CODE
LOW…del/utils/pytorchocr/modeling/backbones/rec_svtrnet.py405CODE
LOW…/utils/pytorchocr/modeling/backbones/rec_donut_swin.py437CODE
LOW…/utils/pytorchocr/modeling/backbones/rec_donut_swin.py21CODE
LOW…u/model/table/rec/slanet_plus/table_structure_utils.py178CODE
LOW…u/model/table/rec/slanet_plus/table_structure_utils.py215CODE
LOW…eru/model/table/rec/unet_table/table_structure_unet.py82CODE
Over-Commented Block26 hits · 26 pts
SeverityFileLineSnippetContext
LOWdemo/demo.py221 # "vlm-engine" -> local VLM parsingCOMMENT
LOWmineru/model/ocr/seal_det_warp.py1# Copyright (c) 2024 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOWmineru/model/ocr/seal_crop.py1# Copyright (c) 2024 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py1# coding=utf-8COMMENT
LOW…net/unimernet_hf/unimer_mbart/modeling_unimer_mbart.py421 if self.is_decoder:COMMENT
LOW…nimernet_hf/unimer_mbart/configuration_unimer_mbart.py1# coding=utf-8COMMENT
LOW…ernet/unimernet_hf/unimer_swin/modeling_unimer_swin.py1# coding=utf-8COMMENT
LOW…/unimernet_hf/unimer_swin/configuration_unimer_swin.py1# coding=utf-8COMMENT
LOWmineru/model/utils/tools/__init__.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOW…neru/model/utils/pytorchocr/modeling/necks/__init__.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOWmineru/model/utils/pytorchocr/modeling/necks/rnn.py21 # def forward(self, x):COMMENT
LOW…el/utils/pytorchocr/modeling/architectures/__init__.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOW…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOW…/model/utils/pytorchocr/modeling/backbones/__init__.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOW…del/utils/pytorchocr/modeling/backbones/rec_lcnetv3.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOW…/model/utils/pytorchocr/postprocess/rec_postprocess.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOWmineru/model/utils/pytorchocr/data/imaug/__init__.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOWmineru/model/utils/pytorchocr/data/imaug/operators.py1"""COMMENT
LOWmineru/model/table/rec/slanet_plus/matcher.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOWmineru/model/table/rec/slanet_plus/table_structure.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOW…u/model/table/rec/slanet_plus/table_structure_utils.py1# Copyright (c) 2020 PaddlePaddle Authors. All Rights Reserved.COMMENT
LOWmineru/model/table/rec/slanet_plus/matcher_utils.py1# Copyright (c) Opendatalab. All rights reserved.COMMENT
LOWmineru/model/table/rec/slanet_plus/matcher_utils.py121 if not has_span_in_head:COMMENT
LOW.github/workflows/cla.yml41 #custom-allsigned-prcomment: 'pull request comment when all contributors has signed, defaults to **CLA AssistaCOMMENT
LOW.github/workflows/cli.yml41# notify_to_feishu:COMMENT
Magic Placeholder Names5 hits · 25 pts
SeverityFileLineSnippetContext
HIGHmineru.template.json18 "api_key": "your_api_key",CODE
HIGHdocs/zh/usage/quick_usage.md138 "api_key": "your_api_key",CODE
HIGHdocs/zh/usage/quick_usage.md148 "api_key": "your_api_key",CODE
HIGHdocs/en/usage/quick_usage.md138 "api_key": "your_api_key",CODE
HIGHdocs/en/usage/quick_usage.md148 "api_key": "your_api_key",CODE
Modern Structural Boilerplate17 hits · 19 pts
SeverityFileLineSnippetContext
LOWmineru/backend/office/office_middle_json_mkcontent.py21__all__ = [CODE
LOWmineru/cli/client.py155 def set_renderer(self, renderer: "LiveTaskStatusRenderer | None") -> None:CODE
LOWmineru/model/layout/pp_doclayoutv2.py1187 def _set_box_label(box: Dict, label: str) -> None:CODE
LOWmineru/model/layout/pp_doclayoutv2.py1195 def _set_formula_label(box: Dict, label: str) -> None:CODE
LOWmineru/model/layout/pp_doclayoutv2.py1201 def _set_header_footer_label(box: Dict, label: str) -> None:CODE
LOWmineru/model/layout/pp_doclayoutv2.py1208 def _set_footnote_label(box: Dict) -> None:CODE
LOWmineru/model/layout/pp_doclayoutv2.py1670__all__ = [CODE
LOWmineru/model/mfr/unimernet/unimernet_hf/__init__.py6__all__ = [CODE
LOW…el/mfr/unimernet/unimernet_hf/unimer_mbart/__init__.py5__all__ = [CODE
LOW…del/mfr/unimernet/unimernet_hf/unimer_swin/__init__.py6__all__ = [CODE
LOW…neru/model/utils/pytorchocr/modeling/necks/__init__.py15__all__ = ["build_neck"]CODE
LOW…el/utils/pytorchocr/modeling/architectures/__init__.py17__all__ = ["build_model"]CODE
LOW…neru/model/utils/pytorchocr/modeling/heads/__init__.py15__all__ = ["build_head"]CODE
LOW…/model/utils/pytorchocr/modeling/backbones/__init__.py15__all__ = ["build_backbone"]CODE
LOWmineru/model/utils/pytorchocr/postprocess/__init__.py10__all__ = ['build_post_process']CODE
LOWmineru/data/data_reader_writer/__init__.py6__all__ = [CODE
LOWmineru/data/io/__init__.py6__all__ = ['IOReader', 'IOWriter', 'HttpReader', 'HttpWriter', 'S3Reader', 'S3Writer']CODE
Self-Referential Comments4 hits · 10 pts
SeverityFileLineSnippetContext
MEDIUMmineru/utils/model_utils.py59 # Create a white background arrayCOMMENT
MEDIUMmineru/utils/model_utils.py69 # Create a white background arrayCOMMENT
MEDIUMmineru/utils/draw_bbox.py91 rect = cal_canvas_rect(page, bbox) # Define the rectangleCODE
MEDIUMmineru/utils/draw_bbox.py110 rect = cal_canvas_rect(page, bbox) # Define the rectangleCODE
AI Slop Vocabulary3 hits · 8 pts
SeverityFileLineSnippetContext
MEDIUM…ils/pytorchocr/modeling/heads/rec_ppformulanet_head.py971 # 1. Check whether the user has defined `decoder_input_ids` manually. To facilitate in terms of input naming,COMMENT
MEDIUM…/model/utils/pytorchocr/postprocess/rec_postprocess.py112 ): # grouping word with '-', such as 'state-of-the-art'CODE
MEDIUMmineru/model/docx/main.py19 # provide a more robust command-line interface and resolve the demoCOMMENT
Redundant / Tautological Comments4 hits · 6 pts
SeverityFileLineSnippetContext
LOWdemo/demo.py213 # Set this to an existing MinerU FastAPI base URL, for example:COMMENT
LOWmineru/utils/model_utils.py95 # Check if intersection is validCOMMENT
LOWmineru/utils/model_utils.py112 # Check if overlap exceeds thresholdCOMMENT
LOWmineru/model/xlsx/xlsx_converter.py389 # Check if file exists in zipCOMMENT
Cross-Language Confusion1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHmineru/model/mfr/utils.py312 r'\\(?:lefteqn|boldmath|ensuremath|centering|textsubscript|sides|textsl|textcent|emph|protect|null)')CODE
Docstring Block Structure1 hit · 5 pts
SeverityFileLineSnippetContext
HIGH…l/utils/pytorchocr/modeling/backbones/rec_pphgnetv2.py546use 'handle_func' to modify the sub-layer(s) specified by 'layer_name_pattern'. Args: layer_name_paSTRING