Repository Analysis

xberg-io/xberg

A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.

6.0 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of xberg-io/xberg, a Rust project with 8,642 GitHub stars. SynthScan v2.0 examined 1,154,681 lines of code across 4593 source files, recording 4681 pattern matches distributed across 17 syntactic categories. The overall adjusted score of 6.0 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

6.0
Adjusted Score
6.0
Raw Score
100%
Time Factor
2026-07-14
Last Push
8.6K
Stars
Rust
Language
1.2M
Lines of Code
4.6K
Files
4.7K
Pattern Hits
2026-07-14
Scan Date
0.06
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 216HIGH 40MEDIUM 177LOW 4248

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 4681 distinct pattern matches across 17 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Over-Commented Block3357 hits · 2828 pts
SeverityFileLineSnippetContext
LOWbasemind.toml1# basemind configuration — https://github.com/Goldziher/basemindCOMMENT
LOWbasemind.toml21# max_file_bytes = 2097152COMMENT
LOWbasemind.toml41[mcp]COMMENT
LOWbasemind.toml61# extract_archives = falseCOMMENT
LOWdocs-site/src/snippets/go/config/embedding_config.go81 _ = embeddingConfigCOMMENT
LOWdocs-site/src/snippets/go/config/hierarchy_config.go81//COMMENT
LOW…cs-site/src/snippets/python/config/embedding_config.py61)COMMENT
LOW…cs-site/src/snippets/python/config/embedding_config.py81#COMMENT
LOW…cs-site/src/snippets/python/config/hierarchy_config.py61# - Lower values create simpler structureCOMMENT
LOW…s-site/src/snippets/dart/plugins/pdf_only_processor.md1<!-- snippet:skip reason="Dart cannot construct the opaque BoxFn closure types required by createPostProcessorDartImpl —COMMENT
LOW…e/src/snippets/dart/plugins/quality_score_validator.md1<!-- snippet:skip reason="Dart cannot construct the opaque BoxFn closure types required by createValidatorDartImpl — fluCOMMENT
LOW…ite/src/snippets/typescript/config/hierarchy_config.ts61const _resultOcr = extract({ kind: "uri", uri: "document.pdf" }, extractionConfigOcr);COMMENT
LOW…ite/src/snippets/typescript/config/hierarchy_config.ts81// - Range: 0.0 to 1.0COMMENT
LOW…ite/src/snippets/typescript/config/embedding_config.ts81//COMMENT
LOWdocs-site/src/snippets/rust/config/embedding_config.rs61 preset: Some("balanced".to_string()),COMMENT
LOWdocs-site/src/snippets/rust/config/embedding_config.rs81// - None: Uses .xberg/embeddings/ in current directoryCOMMENT
LOWdocs-site/src/snippets/rust/config/hierarchy_config.rs61};COMMENT
LOWdocs-site/src/snippets/rust/config/hierarchy_config.rs81// include_bbox: bool (default: true)COMMENT
LOWdocs-site/src/snippets/wasm/config/hierarchy_config.ts81//COMMENT
LOWdocs-site/src/snippets/wasm/config/embedding_config.ts81// batchSize: Number of texts to embed at once (32-128 typical)COMMENT
LOW…cs-site/src/snippets/java/config/hierarchy_config.java81// kClusters: int (default: 6, valid: 1-7)COMMENT
LOW…cs-site/src/snippets/java/config/embedding_config.java81//COMMENT
LOW…e/src/snippets/swift/plugins/pdf_metadata_extractor.md1<!-- snippet:skip reason="swift-bridge 0.1.59 does not expose SwiftDocumentExtractorBox constructor or protocol definitiCOMMENT
LOW…cs-site/src/snippets/swift/plugins/plugin_extractor.md1<!-- snippet:skip reason="swift-bridge 0.1.59 does not expose SwiftDocumentExtractorBox constructor or protocol definitiCOMMENT
LOW…e/src/snippets/swift/plugins/extractor_registration.md1<!-- snippet:skip reason="swift-bridge does not generate Swift-side protocol constructors for plugin registration. The RCOMMENT
LOW…cs-site/src/snippets/csharp/config/embedding_config.cs101// CacheDir: Where to store downloaded modelsCOMMENT
LOW…cs-site/src/snippets/csharp/config/hierarchy_config.cs81// - Enable or disable hierarchy extractionCOMMENT
LOWdocs-site/src/snippets/ruby/config/hierarchy_config.rb61 hierarchy: hierarchy_config_ocrCOMMENT
LOWdocs-site/src/snippets/ruby/config/hierarchy_config.rb81# - Lower values create simpler structureCOMMENT
LOWdocs-site/src/snippets/ruby/config/embedding_config.rb81#COMMENT
LOWtools/benchmark-harness/tests/structured_smoke.rs1//! Stage 0/2 smoke test: prove the structured-extraction benchmark plumbingCOMMENT
LOWtools/benchmark-harness/tests/profiling_zero_cost.rs1//! Zero-cost profiling verification testsCOMMENT
LOWtools/benchmark-harness/tests/profiling_zero_cost.rs21}COMMENT
LOWtools/benchmark-harness/tests/fixture_validation.rs1//! Comprehensive fixture validation integration testsCOMMENT
LOWtools/benchmark-harness/scripts/bench_local.sh1#!/usr/bin/env bashCOMMENT
LOWtools/benchmark-harness/src/system_load.rs1//! System-load capture for benchmark measurements.COMMENT
LOWtools/benchmark-harness/src/sizes.rs1//! Framework size measurementCOMMENT
LOWtools/benchmark-harness/src/sizes.rs21 /// Size in bytes (package + system deps + models combined)COMMENT
LOWtools/benchmark-harness/src/types.rs41 }COMMENT
LOWtools/benchmark-harness/src/types.rs61 pub first_parse_ms: f64,COMMENT
LOWtools/benchmark-harness/src/types.rs141COMMENT
LOWtools/benchmark-harness/src/types.rs161/// - **Timeout**: extraction exceeded configured timeoutCOMMENT
LOWtools/benchmark-harness/src/types.rs241 /// File extension without dot (e.g., "pdf", "docx")COMMENT
LOWtools/benchmark-harness/src/types.rs321 #[serde(default, skip_serializing_if = "Vec::is_empty")]COMMENT
LOWtools/benchmark-harness/src/adapter.rs21 /// Get the framework name (e.g., "xberg-rust", "xberg-python")COMMENT
LOWtools/benchmark-harness/src/adapter.rs41 /// Get the output formats supported by this adapterCOMMENT
LOWtools/benchmark-harness/src/adapter.rs61 &self,COMMENT
LOWtools/benchmark-harness/src/adapter.rs121COMMENT
LOWtools/benchmark-harness/src/diagnostics.rs1//! Per-document diagnostic output for poor-scoring documents.COMMENT
LOWtools/benchmark-harness/src/monitoring.rs1//! Resource monitoring for benchmark executionCOMMENT
LOWtools/benchmark-harness/src/monitoring.rs41COMMENT
LOWtools/benchmark-harness/src/monitoring.rs101COMMENT
LOWtools/benchmark-harness/src/monitoring.rs121 Some(*pid)COMMENT
LOWtools/benchmark-harness/src/monitoring.rs181/// Recursively traverses the process tree, summing CPU usage from the parentCOMMENT
LOWtools/benchmark-harness/src/profile_report.rs1//! Comprehensive profiling report generation with hotspot analysisCOMMENT
LOWtools/benchmark-harness/src/profile_report.rs21//! # HTML Report FormatCOMMENT
LOWtools/benchmark-harness/src/profile_report.rs81 effective_frequency: 0.0,COMMENT
LOWtools/benchmark-harness/src/profile_report.rs141 ///COMMENT
LOWtools/benchmark-harness/src/profile_report.rs161 function_name: "[profile data collected - hotspot extraction requires pprof API enhancement]".to_string(),COMMENT
LOWtools/benchmark-harness/src/profile_report.rs241 }COMMENT
3297 more matches not shown…
Hallucination Indicators216 hits · 2655 pts
SeverityFileLineSnippetContext
CRITICAL…e/src/snippets/csharp/advanced/custom_postprocessor.cs19 result.Metadata.Additional["word_count"] = System.Text.Json.Nodes.JsonValue.Create(wordCount);CODE
CRITICAL…e/src/snippets/csharp/advanced/custom_postprocessor.cs38 result.Metadata.Additional["sentiment"] = System.Text.Json.Nodes.JsonValue.Create(sentiment);CODE
CRITICAL…snippets/csharp/plugins/custom_postprocessor_plugin.cs25 result.Metadata.Additional["word_count"] = System.Text.Json.Nodes.JsonValue.Create(wordCount);CODE
CRITICAL…snippets/csharp/plugins/custom_postprocessor_plugin.cs71 result.Metadata.Additional["detected_language"] = System.Text.Json.Nodes.JsonValue.Create(detectedLanguage);CODE
CRITICAL…ates/xberg-candle-ocr/src/models/deepseek_ocr/model.rs1292 config.vision_config.width.sam_vit_b.global_attn_indexes.clone(),CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt31@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = NoChunkingReasonDeserializer::class)CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt32@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = NoChunkingReasonSerializer::class)CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt35 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt36 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt42 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt43 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt49 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt50 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt56 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt57 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/NoChunkingReason.kt84 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/ChunkingConfig.kt78 @field:com.fasterxml.jackson.databind.annotation.JsonSerialize(`as` = ChunkSizing::class)CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt31@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = EmbeddingModelTypeDeserializer::class)CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt32@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = EmbeddingModelTypeSerializer::class)CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt35 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt36 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt41 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt42 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt53 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt54 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt79 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt80 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…android/src/main/kotlin/io/xberg/EmbeddingModelType.kt101 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/FormatMetadata.kt36@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = FormatMetadataDeserializer::class)CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/FormatMetadata.kt37@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = FormatMetadataSerializer::class)CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/FormatMetadata.kt127 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt31@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = AuthConfigDeserializer::class)CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt32@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = AuthConfigSerializer::class)CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt35 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt36 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt42 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt43 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt48 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt49 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…/kotlin-android/src/main/kotlin/io/xberg/AuthConfig.kt70 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt35@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = SparseEmbeddingModelTypeDeserializer::class)CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt36@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = SparseEmbeddingModelTypeSerializer::class)CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt39 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt40 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt45 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt46 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt54 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt55 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
CRITICAL…d/src/main/kotlin/io/xberg/SparseEmbeddingModelType.kt75 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…n-android/src/main/kotlin/io/xberg/DocumentRevision.kt67 @field:com.fasterxml.jackson.databind.annotation.JsonSerialize(`as` = RevisionAnchor::class)CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/EntityCategory.kt36@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = EntityCategoryDeserializer::class)CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/EntityCategory.kt37@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = EntityCategorySerializer::class)CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/EntityCategory.kt82 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/EntityCategory.kt96 else -> throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/EntityCategory.kt103 throw com.fasterxml.jackson.databind.exc.InvalidFormatException(CODE
CRITICAL…lin-android/src/main/kotlin/io/xberg/RerankerConfig.kt40 @field:com.fasterxml.jackson.databind.annotation.JsonSerialize(`as` = RerankerModelType::class)CODE
CRITICAL…ndroid/src/main/kotlin/io/xberg/OcrBoundingGeometry.kt36@com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = OcrBoundingGeometryDeserializer::class)CODE
CRITICAL…ndroid/src/main/kotlin/io/xberg/OcrBoundingGeometry.kt37@com.fasterxml.jackson.databind.annotation.JsonSerialize(using = OcrBoundingGeometrySerializer::class)CODE
CRITICAL…ndroid/src/main/kotlin/io/xberg/OcrBoundingGeometry.kt40 @com.fasterxml.jackson.databind.annotation.JsonDeserialize(using = com.fasterxml.jackson.databind.JsonDeserializer.NCODE
CRITICAL…ndroid/src/main/kotlin/io/xberg/OcrBoundingGeometry.kt41 @com.fasterxml.jackson.databind.annotation.JsonSerialize(using = com.fasterxml.jackson.databind.JsonSerializer.None:CODE
156 more matches not shown…
Unused Imports443 hits · 258 pts
SeverityFileLineSnippetContext
LOWdocs-site/src/snippets/python/cli/basic_cli.py4CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py3CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py29CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py12CODE
LOWtools/benchmark-harness/scripts/docling_extract.py9CODE
LOWtools/benchmark-harness/scripts/xberg_extract.py11CODE
LOWtools/benchmark-harness/scripts/generate_markdown_gt.py24CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py3CODE
LOWtools/benchmark-harness/scripts/markitdown_extract.py3CODE
LOW…mark-harness/python_baselines/paddleocr_vl_baseline.py18CODE
LOW…mark-harness/python_baselines/deepseek_ocr_baseline.py19CODE
LOWtools/generate_test_fixtures/tests/test_generation.py7CODE
LOW…xtures/src/generate_test_fixtures/security_fixtures.py22CODE
LOW…_fixtures/src/generate_test_fixtures/xlsx_revisions.py15CODE
LOW…_test_fixtures/src/generate_test_fixtures/gt_schema.py14CODE
LOW…t_fixtures/src/generate_test_fixtures/odt_revisions.py17CODE
LOW…test_fixtures/src/generate_test_fixtures/diff_pairs.py20CODE
LOW…fixtures/src/generate_test_fixtures/pdf_incremental.py28CODE
LOW…_fixtures/src/generate_test_fixtures/docx_revisions.py15CODE
LOW…t_fixtures/src/generate_test_fixtures/pptx_comments.py16CODE
LOW…e_test_fixtures/src/generate_test_fixtures/__main__.py8CODE
LOWtools/perf/extract_top_symbols.py17CODE
LOWscripts/sign_macos_wheels.py4CODE
LOWscripts/python/print_xberg_version.py4CODE
LOWscripts/ci/docker/test_docker.py4CODE
LOWpackages/python/xberg/options.py7CODE
LOWpackages/python/xberg/options.py13CODE
LOWpackages/python/xberg/options.py13CODE
LOWpackages/python/xberg/options.py13CODE
LOWpackages/python/xberg/options.py13CODE
LOWpackages/python/xberg/options.py13CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/options.py61CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
LOWpackages/python/xberg/__init__.py10CODE
383 more matches not shown…
Hyper-Verbose Identifiers256 hits · 230 pts
SeverityFileLineSnippetContext
LOWdocs-site/src/snippets/python/ocr/cloud_ocr_backend.md28 def supports_document_processing(self) -> bool:CODE
LOWdocs-site/src/snippets/python/ocr/cloud_ocr_backend.md31 def emits_structured_markdown(self) -> bool:CODE
LOW…e/src/snippets/wasm/advanced/token_reduction_config.md38async function compareTokenReductionModes(bytes: Uint8Array): Promise<TokenReductionResult[]> {CODE
LOWdocs-site/src/snippets/wasm/config/chunking-config.ts40async function extractWithPrependHeadingContext() {CODE
LOW…cs-site/src/snippets/wasm/config/conditional-config.ts4async function extractWithConditionalConfig(fileSize: number) {CODE
LOW…ite/src/snippets/wasm/plugins/post-processor-custom.ts23async function demonstrateCustomProcessor() {CODE
LOWdocs-site/src/snippets/wasm/plugins/plugin-lifecycle.ts49async function demonstratePluginLifecycle() {CODE
LOWdocs-site/src/snippets/wasm/plugins/plugin_testing.md21function testPostProcessorRegistration() {CODE
LOWdocs-site/src/snippets/wasm/plugins/plugin_testing.md36function testValidatorRegistration() {CODE
LOWdocs-site/src/snippets/wasm/ocr/multi-language-ocr.ts3async function extractMultilingualDocument() {CODE
LOWdocs-site/src/snippets/wasm/ocr/progress-tracking.ts3async function extractWithProgressTracking() {CODE
LOWdocs-site/src/snippets/wasm/metadata/filter-metadata.ts11async function filterAndSummarizeMetadata(files: string[]): Promise<DocumentSummary[]> {CODE
LOW…-site/src/snippets/php/advanced/performance_tuning.php90function processLargeDocumentEfficiently(string $filePath): voidCODE
LOWdocs-site/src/snippets/php/plugins/ocr_backend.md59 public function supportsDocumentProcessing(): bool {CODE
LOW…cs-site/src/snippets/php/utils/image_preprocessing.php145function recommendPreprocessingSettings(string $documentType): ImagePreprocessingConfigCODE
LOW…snippets/php/utils/language_detection_multilingual.php73function categorizeMultilingualDocument(array $languages): stringCODE
LOW…src/snippets/php/utils/vector_database_integration.php264function exportVectorRecordsToJson(array $records, string $filename): voidCODE
LOWdocs-site/src/content/docs/reference/api-ruby.md4025def supports_document_processing()CODE
LOWdocs-site/src/content/docs/reference/api-ruby.md4048def emits_structured_markdown()CODE
LOWdocs-site/src/content/docs/reference/api-php.md216public static function registerDocumentExtractor(DocumentExtractor $extractor): voidCODE
LOWdocs-site/src/content/docs/reference/api-php.md251public static function unregisterDocumentExtractor(string $name): voidCODE
LOWdocs-site/src/content/docs/reference/api-php.md4025public function supportsDocumentProcessing(): boolCODE
LOWdocs-site/src/content/docs/reference/api-typescript.md216function registerDocumentExtractor(extractor: DocumentExtractor): voidCODE
LOWdocs-site/src/content/docs/reference/api-typescript.md251function unregisterDocumentExtractor(name: string): voidCODE
LOWdocs-site/src/content/docs/reference/api-elixir.md242def clear_document_extractors()CODE
LOWdocs-site/src/content/docs/reference/api-elixir.md3906def supports_document_processing()CODE
LOWdocs-site/src/content/docs/reference/api-elixir.md3929def emits_structured_markdown()CODE
LOWdocs-site/src/content/docs/reference/api-python.md234def clear_document_extractors() -> NoneCODE
LOWdocs-site/src/content/docs/reference/api-python.md3902def supports_document_processing(self) -> boolCODE
LOWdocs-site/src/content/docs/reference/api-python.md3925def emits_structured_markdown(self) -> boolCODE
LOWdocs-site/src/content/docs/reference/api-wasm.md216function registerDocumentExtractor(extractor: DocumentExtractor): voidCODE
LOWdocs-site/src/content/docs/reference/api-wasm.md251function unregisterDocumentExtractor(name: string): voidCODE
LOWtools/generate_test_fixtures/tests/test_generation.py46def test_generator_runs_and_emits_well_formed_outputs(module, tmp_path: Path, repo_root: Path) -> None:CODE
LOW…xtures/src/generate_test_fixtures/security_fixtures.py132def _emit_docx_oversized_embedded(output_dir: Path, repo_root: Path) -> list[Path]:CODE
LOW…fixtures/src/generate_test_fixtures/pdf_incremental.py90def _append_incremental_update(CODE
LOWcrates/xberg-node/index.js29function requireOptionalDependency(name) {CODE
LOWcrates/xberg-node/index.d.ts8017export declare function registerDocumentExtractor(extractor: DocumentExtractor): void;CODE
LOWcrates/xberg-node/index.d.ts8054export declare function unregisterDocumentExtractor(name: string): void;CODE
LOWcrates/xberg-node/index.d.ts8056export declare function unregisterEmbeddingBackend(name: string): void;CODE
LOWcrates/xberg-node/index.d.ts8068export declare function unregisterRerankerBackend(name: string): void;CODE
LOWcrates/xberg-node/index.d.ts8070export declare function unregisterTokenizerBackend(name: string): void;CODE
LOWscripts/ci/docker/test_docker.py348def test_paddle_ocr_extraction(t: TestRunner) -> None:CODE
LOWscripts/ci/ruby/vendor-xberg-core.py115def replace_workspace_deps_in_toml(toml_path: Path, workspace_deps: dict[str, object]) -> None:CODE
LOWscripts/ci/ruby/vendor-xberg-core.py197def generate_vendor_cargo_toml(CODE
LOWpackages/python/xberg/options.py4022def _from_native_dbf_metadata(native: Any) -> DbfMetadata:CODE
LOWpackages/python/xberg/options.py4031def _from_native_diff_options(native: Any) -> DiffOptions:CODE
LOWpackages/python/xberg/options.py4040def _from_native_document_counts(native: Any) -> DocumentCounts:CODE
LOWpackages/python/xberg/options.py4049def _from_native_document_structure(native: Any) -> DocumentStructure:CODE
LOWpackages/python/xberg/options.py4059def _from_native_docx_app_properties(native: Any) -> DocxAppProperties:CODE
LOWpackages/python/xberg/options.py4726def _from_native_pptx_metadata(native: Any) -> PptxMetadata:CODE
LOWpackages/python/xberg/options.py4736def _from_native_proxy_config(native: Any) -> ProxyConfig:CODE
LOWpackages/python/xberg/options.py4745def _from_native_pst_metadata(native: Any) -> PstMetadata:CODE
LOWpackages/python/xberg/options.py4926def _from_native_text_metadata(native: Any) -> TextMetadata:CODE
LOWpackages/python/xberg/options.py4936def _from_native_token_counter(_native: Any) -> TokenCounter:CODE
LOWpackages/python/xberg/options.py4941def _from_native_token_reduction_config(native: Any) -> TokenReductionConfig:CODE
LOWpackages/python/xberg/options.py3811def _from_native_acceleration_config(native: Any) -> AccelerationConfig:CODE
LOWpackages/python/xberg/options.py3819def _from_native_archive_metadata(native: Any) -> ArchiveMetadata:CODE
LOWpackages/python/xberg/options.py3830def _from_native_audio_metadata(native: Any) -> AudioMetadata:CODE
LOWpackages/python/xberg/options.py3842def _from_native_bibtex_metadata(native: Any) -> BibtexMetadata:CODE
LOWpackages/python/xberg/options.py3853def _from_native_bounding_box(native: Any) -> BoundingBox:CODE
196 more matches not shown…
Cross-File Repetition31 hits · 155 pts
SeverityFileLineSnippetContext
HIGH…pets/swift/advanced/language_detection_multilingual.md0{ "language_detection": { "enabled": true, "min_confidence": 0.8, "detect_multiple": true } }STRING
HIGH…src/snippets/swift/config/language_detection_config.md0{ "language_detection": { "enabled": true, "min_confidence": 0.8, "detect_multiple": true } }STRING
HIGH…pets/swift/metadata/language_detection_multilingual.md0{ "language_detection": { "enabled": true, "min_confidence": 0.8, "detect_multiple": true } }STRING
HIGHdocs-site/src/snippets/swift/config/config_ocr.md0{ "ocr": { "backend": "tesseract", "language": "eng" } }STRING
HIGHdocs-site/src/snippets/swift/ocr/ocr_extraction.md0{ "ocr": { "backend": "tesseract", "language": "eng" } }STRING
HIGHpackages/swift/README.md0{ "ocr": { "backend": "tesseract", "language": "eng" } }STRING
HIGHtools/benchmark-harness/scripts/pymupdf4llm_extract.py0get peak memory usage in bytes using resource module.STRING
HIGHtools/benchmark-harness/scripts/mineru_extract.py0get peak memory usage in bytes using resource module.STRING
HIGHtools/benchmark-harness/scripts/docling_extract.py0get peak memory usage in bytes using resource module.STRING
HIGHtools/benchmark-harness/scripts/unstructured_extract.py0get peak memory usage in bytes using resource module.STRING
HIGHtools/benchmark-harness/scripts/markitdown_extract.py0get peak memory usage in bytes using resource module.STRING
HIGHtools/benchmark-harness/scripts/pymupdf4llm_extract.py0run extraction in a forked child process. closes inherited stdin/stdout so the child cannot corrupt the parent's line-baSTRING
HIGHtools/benchmark-harness/scripts/mineru_extract.py0run extraction in a forked child process. closes inherited stdin/stdout so the child cannot corrupt the parent's line-baSTRING
HIGHtools/benchmark-harness/scripts/docling_extract.py0run extraction in a forked child process. closes inherited stdin/stdout so the child cannot corrupt the parent's line-baSTRING
HIGHtools/benchmark-harness/scripts/unstructured_extract.py0run extraction in a forked child process. closes inherited stdin/stdout so the child cannot corrupt the parent's line-baSTRING
HIGHtools/benchmark-harness/scripts/markitdown_extract.py0run extraction in a forked child process. closes inherited stdin/stdout so the child cannot corrupt the parent's line-baSTRING
HIGHtools/benchmark-harness/scripts/pymupdf4llm_extract.py0execute fn(*args) in a forked child with a timeout. on timeout the child is killed but the parent stays alive — no expenSTRING
HIGHtools/benchmark-harness/scripts/mineru_extract.py0execute fn(*args) in a forked child with a timeout. on timeout the child is killed but the parent stays alive — no expenSTRING
HIGHtools/benchmark-harness/scripts/docling_extract.py0execute fn(*args) in a forked child with a timeout. on timeout the child is killed but the parent stays alive — no expenSTRING
HIGHtools/benchmark-harness/scripts/unstructured_extract.py0execute fn(*args) in a forked child with a timeout. on timeout the child is killed but the parent stays alive — no expenSTRING
HIGHtools/benchmark-harness/scripts/markitdown_extract.py0execute fn(*args) in a forked child with a timeout. on timeout the child is killed but the parent stays alive — no expenSTRING
HIGHtools/benchmark-harness/scripts/pymupdf4llm_extract.py0parse a request line: json object with path field, or plain file path.STRING
HIGHtools/benchmark-harness/scripts/mineru_extract.py0parse a request line: json object with path field, or plain file path.STRING
HIGHtools/benchmark-harness/scripts/docling_extract.py0parse a request line: json object with path field, or plain file path.STRING
HIGHtools/benchmark-harness/scripts/unstructured_extract.py0parse a request line: json object with path field, or plain file path.STRING
HIGHtools/benchmark-harness/scripts/markitdown_extract.py0parse a request line: json object with path field, or plain file path.STRING
HIGHtools/benchmark-harness/scripts/mineru_extract.py0persistent server mode: read paths from stdin, write json to stdout.STRING
HIGHtools/benchmark-harness/scripts/docling_extract.py0persistent server mode: read paths from stdin, write json to stdout.STRING
HIGHtools/benchmark-harness/scripts/xberg_extract.py0persistent server mode: read paths from stdin, write json to stdout.STRING
HIGHtools/benchmark-harness/scripts/unstructured_extract.py0persistent server mode: read paths from stdin, write json to stdout.STRING
HIGHtools/benchmark-harness/scripts/markitdown_extract.py0persistent server mode: read paths from stdin, write json to stdout.STRING
Excessive Try-Catch Wrapping90 hits · 146 pts
SeverityFileLineSnippetContext
MEDIUM…cs-site/src/snippets/zig/api/error_handling_extract.md34 else => try stderr.print("Error: {s}\n", .{@errorName(err)}),CODE
MEDIUM…te/src/snippets/python/utils/error_handling_extract.md18 print(f"Error: {error_type}: {message}")CODE
MEDIUMdocs-site/src/snippets/python/cli/cli_with_config.py14 print(f"Error: {result.stderr}", file=sys.stderr)CODE
MEDIUMdocs-site/src/snippets/python/cli/basic_cli.py14 print(f"Error: {result.stderr}", file=sys.stderr)CODE
MEDIUM…-site/src/snippets/swift/api/error_handling_extract.md30 print("Error: \(message)")CODE
LOW…s/benchmark-harness/scripts/generate_pdf_gt_mistral.py153 except Exception as e:CODE
LOW…nchmark-harness/scripts/generate_vendored_baselines.py151 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py51 except Exception:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py56 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py78 except Exception:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py93 except Exception:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py96 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py123 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/pymupdf4llm_extract.py157 print("Error: sync mode requires a file path", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py163 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/pymupdf4llm_extract.py164 print(f"Error extracting with PyMuPDF4LLM: {e}", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py170 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/pymupdf4llm_extract.py171 print(f"Error extracting with PyMuPDF4LLM: {e}", file=sys.stderr)CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py286 except Exception:CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py635 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py128 except Exception:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py154 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py186 except Exception:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py191 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py213 except Exception:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py228 except Exception:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py231 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py258 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/mineru_extract.py281 print(f"Error: --format must be 'markdown' or 'plaintext'; got '{output_format}'", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/mineru_extract.py301 print("Error: sync mode requires exactly one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/mineru_extract.py311 print("Error: batch mode requires at least one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/mineru_extract.py322 print(f"Error: Unknown mode '{mode}'. Use sync, batch, or server", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py325 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/mineru_extract.py326 print(f"Error extracting with MinerU: {e}", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/docling_extract.py129 except Exception:CODE
LOWtools/benchmark-harness/scripts/docling_extract.py134 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/docling_extract.py156 except Exception:CODE
LOWtools/benchmark-harness/scripts/docling_extract.py171 except Exception:CODE
LOWtools/benchmark-harness/scripts/docling_extract.py174 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/docling_extract.py201 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/docling_extract.py237 print(f"Error: --format must be 'markdown' or 'plaintext'; got '{output_format}'", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/docling_extract.py259 print("Error: sync mode requires exactly one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/docling_extract.py266 print("Error: batch mode requires at least one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/docling_extract.py277 print(f"Error: Unknown mode '{mode}'. Use sync, batch, or server", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/docling_extract.py280 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/docling_extract.py281 print(f"Error extracting with Docling: {e}", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/xberg_extract.py167 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/xberg_extract.py197 print("Error: sync mode requires exactly one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/xberg_extract.py204 print("Error: async mode requires exactly one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/xberg_extract.py211 print("Error: batch mode requires at least one file", file=sys.stderr)CODE
MEDIUMtools/benchmark-harness/scripts/xberg_extract.py222 print(f"Error: Unknown mode '{mode}'. Use sync, async, batch, or server", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/xberg_extract.py225 except Exception as e:CODE
MEDIUMtools/benchmark-harness/scripts/xberg_extract.py226 print(f"Error extracting with Xberg: {e}", file=sys.stderr)CODE
LOWtools/benchmark-harness/scripts/generate_markdown_gt.py230 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py98 except Exception:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py103 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py125 except Exception:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py140 except Exception:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py143 except Exception as e:CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py170 except Exception as e:CODE
30 more matches not shown…
Self-Referential Comments47 hits · 141 pts
SeverityFileLineSnippetContext
MEDIUMcrates/xberg-wasm/Cargo.toml1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMcrates/xberg-ffi/cbindgen.toml1# This file is auto-generated by alef. DO NOT EDIT.COMMENT
MEDIUM.cargo/config.toml1# This file is auto-generated by alef. DO NOT EDIT.COMMENT
MEDIUMpackages/python/xberg/options.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/python/xberg/__init__.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/python/xberg/api.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/python/xberg/exceptions.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/ruby/lib/xberg.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/ruby/lib/xberg/native.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMpackages/ruby/lib/xberg/version.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/conftest.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_registry.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_format_specific.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_post_processor_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_smoke.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_reranker_backend_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_summarization.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_error.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_ocr_backend_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_plugin_api.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_tokenizer_backend_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_url.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_extract.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_batch.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_validator_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_renderer_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/python/tests/test_embedding_backend_management.py1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/rust/Cargo.toml1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/rust/.cargo/config.toml1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/error_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/batch_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/spec_helper.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/validator_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/summarization_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/url_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/renderer_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/plugin_api_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/registry_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/contract_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/post_processor_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/reranker_backend_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/tokenizer_backend_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/format_specific_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/ocr_backend_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/embedding_backend_management_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/extract_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
MEDIUMe2e/ruby/spec/smoke_spec.rb1# This file is auto-generated by alef — DO NOT EDIT.COMMENT
Modern AI Meta-Vocabulary51 hits · 138 pts
SeverityFileLineSnippetContext
MEDIUMbasemind.toml46# Document RAG tier (PDF / Office / HTML / email / images). Requires a `documents` build.COMMENT
MEDIUM…cs-site/src/snippets/python/config/embedding_config.py15# - "balanced" (768 dims): Production, general-purpose RAG, English documentsCOMMENT
MEDIUMdocs-site/src/snippets/php/README.md15├── chunking/ # Text chunking for RAGCODE
MEDIUMdocs-site/src/snippets/ruby/config/embedding_config.rb15# - "balanced" (768 dims): Production, general-purpose RAG, English documentsCOMMENT
MEDIUMdocs-site/src/content/docs/reference/api-dart.md1169| `prependHeadingContext` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/api-ruby.md1169| `prepend_heading_context` | `Boolean` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hiCODE
MEDIUMdocs-site/src/content/docs/reference/api-php.md1169| `prependHeadingContext` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/api-zig.md1169| `prependHeadingContext` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/api-java.md1152| `prependHeadingContext` | `boolean` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierCODE
MEDIUMdocs-site/src/content/docs/reference/api-typescript.md1169| `prependHeadingContext` | `boolean` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierCODE
MEDIUMdocs-site/src/content/docs/reference/api-go.md1213| `PrependHeadingContext` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/api-elixir.md1050| `prepend_heading_context` | `boolean()` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading CODE
MEDIUMdocs-site/src/content/docs/reference/api-c.md1152| `prepend_heading_context` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hieraCODE
MEDIUMdocs-site/src/content/docs/reference/api-rust.md1327| `prepend_heading_context` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hieraCODE
MEDIUMdocs-site/src/content/docs/reference/api-csharp.md1024| `PrependHeadingContext` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/configuration.md586| `prepend_heading_context` | `bool` | `False` | When `True` and `chunker_type` is `Markdown`, prepend the heading hieraCODE
MEDIUMdocs-site/src/content/docs/reference/api-python.md1024| `prepend_heading_context` | `bool` | `False` | When `True` and `chunker_type` is `Markdown`, prepend the heading hieraCODE
MEDIUM…-site/src/content/docs/reference/api-kotlin-android.md1043| `prependHeadingContext` | `Boolean` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierCODE
MEDIUMdocs-site/src/content/docs/reference/types.md733| `prepend_heading_context` | `bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hieraCODE
MEDIUMdocs-site/src/content/docs/reference/api-swift.md1024| `prependHeadingContext` | `Bool` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierarcCODE
MEDIUMdocs-site/src/content/docs/reference/api-wasm.md910| `prependHeadingContext` | `boolean` | `false` | When `true` and `chunker_type` is `Markdown`, prepend the heading hierCODE
MEDIUMtools/benchmark-harness/src/field_quality.rs15//! SF1/TF1 guardrails system.COMMENT
MEDIUMtools/benchmark-harness/src/main.rs176 /// Enable quality guardrails (fail on regressions)COMMENT
MEDIUMtools/benchmark-harness/src/main.rs180 /// Path to guardrails JSON config file (used when --guardrails is set)COMMENT
MEDIUMtools/benchmark-harness/src/main.rs181 #[arg(long, default_value = "guardrails.json")]COMMENT
MEDIUMtools/benchmark-harness/src/main.rs205 /// Generate quality guardrails JSON from benchmark resultsCOMMENT
MEDIUMtools/benchmark-harness/src/main.rs219 /// Output path for the guardrails JSON fileCOMMENT
MEDIUMtools/benchmark-harness/src/main.rs220 #[arg(short, long, default_value = "guardrails.json")]COMMENT
MEDIUMtools/benchmark-harness/src/main.rs304 /// Write a split-boundary-guardrails.json to this path (from default-threshold results)COMMENT
MEDIUMtools/benchmark-harness/src/split_benchmark.rs81 /// If set, write a `split-boundary-guardrails.json` at this path from theCOMMENT
MEDIUMtools/benchmark-harness/src/split_benchmark.rs135/// `split-boundary-guardrails.json` schema (mirrors `guardrails.json`).COMMENT
MEDIUMtools/benchmark-harness/src/split_benchmark.rs395/// Write a `split-boundary-guardrails.json` from default-threshold results.COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs2//! compare quality (SF1, TF1) against ground truth with optional guardrails.COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs24//! When `guardrails` is enabled, the comparison enforces per-document minimumCOMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs226 /// Path to a JSON guardrails file. When `guardrails` is true this fileCOMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs1040/// Data-driven guardrails configuration loaded from JSON.COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs1060/// Load a guardrails configuration from a JSON file.COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs1067/// Generate a guardrails configuration from benchmark results.COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs1106/// Check guardrails from a loaded config, returning a list of failure messages (empty = all passed).COMMENT
MEDIUMtools/benchmark-harness/src/comparison.rs1147/// Run comparison with guardrails and return exit code (0 = pass, 1 = fail).COMMENT
MEDIUMcrates/xberg-cli/README.md583# Download only the fast embedding modelCOMMENT
MEDIUMcrates/xberg/Cargo.toml351ner-llm = ["ner", "liter-llm"] # LLM-driven zero-shot NER (no ORT).CODE
MEDIUMcrates/xberg/tests/generated_fixtures.rs1//! Integration scaffold for the generated fixture corpus produced byCOMMENT
MEDIUMcrates/xberg/tests/gpu_acceleration.rs291 #[ignore = "gpu: requires CUDA + ONNX Runtime CUDA EP + embedding model"]COMMENT
MEDIUMcrates/xberg/tests/gpu_acceleration.rs319 #[ignore = "gpu: requires CUDA + ONNX Runtime CUDA EP + embedding model"]COMMENT
MEDIUM.cargo/config.toml3# Re-generate with: alef scaffoldCOMMENT
MEDIUM.ai-rulez/skills/chunking-embeddings/SKILL.md94## RAG Integration PatternCOMMENT
MEDIUMpackages/ruby/lib/xberg/native.rb698 ## Provider-hosted embedding model via liter-llm.COMMENT
MEDIUMpackages/ruby/lib/xberg/native.rb741 ## context window via `max_characters` directly.COMMENT
MEDIUMpackages/ruby/lib/xberg/native.rb949 # Sparse-embedding model types supported by Xberg.COMMENT
MEDIUMtemplates/readme/cli.md583# Download only the fast embedding modelCOMMENT
Fake / Example Data101 hits · 123 pts
SeverityFileLineSnippetContext
LOW…-harness/vendored/docling/md/picture_classification.md27Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md27Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md33Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md33Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md65Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md65Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md71Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…-harness/vendored/docling/md/picture_classification.md71Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…hmark-harness/vendored/docling/md/word365_structure.md3Lorem ipsum dolorCODE
LOW…hmark-harness/vendored/docling/md/word365_structure.md9Lorem ipsum dolor sit ametCODE
LOW…hmark-harness/vendored/docling/md/word365_structure.md9Lorem ipsum dolor sit ametCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md3Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md3Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md5Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md5Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md13Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md13Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md15Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md15Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md19Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md19Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md21Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md21Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md25Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md25Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magnCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md27Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md27Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md29Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…chmark-harness/vendored/docling/md/code_and_formula.md29Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat, vel illum dolore eu feugiat nulCODE
LOW…ls/benchmark-harness/vendored/docling/md/pdf_tables.md3Lorem ipsum dolor sit amet, consectetur adipiscing elitCODE
LOW…ls/benchmark-harness/vendored/docling/md/pdf_tables.md3Lorem ipsum dolor sit amet, consectetur adipiscing elitCODE
LOW…ols/benchmark-harness/vendored/docling/md/issue-905.md5Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Phasellus facilisis odio sed mi. Curabitur suscipit. Nullam veCODE
LOW…ols/benchmark-harness/vendored/docling/md/issue-905.md5Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Phasellus facilisis odio sed mi. Curabitur suscipit. Nullam veCODE
LOW…benchmark-harness/vendored/docling/md/pdf_structure.md3Contenu 1, contenu 2, contenu 3. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididuCODE
LOW…benchmark-harness/vendored/docling/md/pdf_structure.md3Contenu 1, contenu 2, contenu 3. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididuCODE
LOW…benchmark-harness/vendored/docling/md/pdf_structure.md143. Longue énumération : Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labCODE
LOW…benchmark-harness/vendored/docling/md/pdf_structure.md143. Longue énumération : Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labCODE
LOWcrates/xberg/tests/jupyter_extractor_tests.rs40/// - Lorem ipsum heading with bold formattingCOMMENT
LOWcrates/xberg/tests/jupyter_extractor_tests.rs74 extraction.content.contains("Lorem ipsum"),CODE
LOWcrates/xberg/tests/jupyter_extractor_tests.rs75 "Should extract markdown cell 'Lorem ipsum'"CODE
LOWcrates/xberg/tests/jupyter_extractor_tests.rs78 extraction.content.contains("Lorem ipsum"),CODE
LOWcrates/xberg/tests/latex_extractor_tests.rs92 Some("John Doe"),CODE
LOWcrates/xberg/tests/latex_extractor_tests.rs93 "FAIL: Should extract author 'John Doe' from \\author{{}} command"CODE
LOWcrates/xberg/tests/structured_pipeline.rs117 r#"{"invoice_number":"INV-001","vendor":"Acme Corp","total":"$42.00"}"#,CODE
LOWcrates/xberg/tests/structured_pipeline.rs132 assert_eq!(structured_output["vendor"].as_str(), Some("Acme Corp"));CODE
LOWcrates/xberg/tests/rtf_extractor_tests.rs676 result.content.to_lowercase().contains("lorem ipsum"),CODE
LOWcrates/xberg/tests/rtf_extractor_tests.rs677 "Content should contain lorem ipsum text"CODE
LOWcrates/xberg/tests/pdf_form_fields.rs249 let count = content.matches("Jane Doe").count();CODE
LOWcrates/xberg/tests/pdf_form_fields.rs252 "flattened Widget value 'Jane Doe' must appear exactly once, not duplicated; got: {content:?}"CODE
LOWcrates/xberg/tests/pdf_form_fields.rs261/// `test_documents/ground_truth/pdf/flattened_form.fields.json` expects "Jane Doe".COMMENT
LOWcrates/xberg/tests/pdf_form_fields.rs274 result.content.contains("Jane Doe"),CODE
LOWcrates/xberg/tests/pdf_form_fields.rs275 "content-stream text 'Jane Doe' missing; got {:?}",CODE
LOWcrates/xberg/tests/opml_extractor_tests.rs152 Some("Jane Doe"),CODE
LOWcrates/xberg/tests/markdown_extractor_tests.rs47 assert_eq!(result.metadata.created_by.as_deref(), Some("John Doe"));CODE
LOWcrates/xberg/tests/bibtex_parity_test.rs168 ("author = {John Doe}", vec!["John Doe"]),CODE
LOWcrates/xberg/tests/bibtex_parity_test.rs169 ("author = {John Doe and Jane Smith}", vec!["John Doe", "Jane Smith"]),CODE
LOWcrates/xberg/tests/bibtex_parity_test.rs173 vec!["John Doe", "Jane Smith", "Bob Jones"],CODE
LOWcrates/xberg/tests/odt_extractor_tests.rs88 assert_eq!(created_by.as_str(), Some("John Doe"), "Creator should match");CODE
LOWcrates/xberg/tests/odt_extractor_tests.rs94 assert_eq!(authors_array[0].as_str(), Some("John Doe"), "Author name should match");CODE
LOWcrates/xberg/src/heuristics/multidoc.rs530 let page_a = approximate_text_density(&"lorem ipsum ".repeat(300));CODE
41 more matches not shown…
AI Slop Vocabulary23 hits · 74 pts
SeverityFileLineSnippetContext
MEDIUMtools/benchmark-harness/scripts/bench_local.sh11# batch : batch throughput. NOTE: the harness runs Xberg's batch asCOMMENT
MEDIUMtools/benchmark-harness/scripts/bench_local.sh20# OUT output dir (default: tools/benchmark-harness/results/local)COMMENT
MEDIUMtools/benchmark-harness/scripts/bench_local.sh54# 2. Build the xberg CLI + harness (release), unless skipped.COMMENT
MEDIUMtools/benchmark-harness/scripts/bench_local.sh63# 3. Add Docling only if it is importable the same way the harness invokes it.COMMENT
MEDIUMtools/benchmark-harness/scripts/bench_local.sh64# The harness's find_python_with_framework() prefers `uv run` whenever `uv`COMMENT
MEDIUMtools/benchmark-harness/src/main.rs39#[command(name = "benchmark-harness")]COMMENT
MEDIUMtools/benchmark-harness/src/main.rs40#[command(about = "Benchmark harness for document extraction frameworks", long_about = None)]COMMENT
MEDIUMtools/benchmark-harness/src/main.rs297 #[arg(short, long, default_value = "tools/benchmark-harness/fixtures/split")]COMMENT
MEDIUMcrates/xberg-ffi/tests/email_attachment_data_len.rs55 // Simple and robust: the declaration for this specific function must mention out_len.COMMENT
MEDIUMcrates/xberg/tests/ocr_errors.rs3//! This module tests OCR error scenarios to ensure robust error handling:COMMENT
MEDIUMcrates/xberg/tests/typst_behavioral_tests.rs838/// Even if a heading has no text, extraction should be robust.COMMENT
MEDIUMcrates/xberg/src/embeddings/engine.rs223/// robust to either left- or right-padding. A row whose mask is entirely zeroCOMMENT
MEDIUMcrates/xberg/src/embeddings/engine.rs478 /// last_pool picks the final non-pad token per row, robust to right- andCOMMENT
MEDIUMcrates/xberg/src/core/batch_optimizations.rs3//! This module provides optimized batch processing utilities that leverageCOMMENT
MEDIUMcrates/xberg/src/ocr/layout_assembly.rs171/// least 20% of the element's area. This is more robust than center-pointCOMMENT
MEDIUMcrates/xberg/src/pdf/render.rs11/// producing a usable raster for OCR/VLM (which are robust to moderate downscaling).COMMENT
MEDIUMcrates/xberg/src/pdf/structure/constants.rs27/// jitter amplitudes ≥ 3 pt while being robust against false positives:COMMENT
MEDIUM…s/xberg/src/pdf/structure/regions/table_recognition.rs943/// paragraphs are never swallowed. Alignment is robust for dense many-columnCOMMENT
MEDIUMcrates/xberg/src/reranking/mod.rs250/// robust to how different tokenizers encode a leading word.COMMENT
MEDIUMpackages/ruby/lib/xberg/native.rb419 ## reasonable starting point; calibrate with the Stage 0 benchmark harness.COMMENT
MEDIUM.github/actions/cache-benchmark-harness/action.yml61 # Compute hash for harness source files and Cargo.tomlCOMMENT
MEDIUM.github/actions/cache-benchmark-harness/action.yml130 # harness-{profile}-{platform}-src-{harness-hash}-xberg-{xberg-hash}-cargo-{cargo-hash}-v{version}COMMENT
MEDIUM.github/actions/cache-benchmark-harness/action.yml228 # Build benchmark-harnessCOMMENT
Decorative Section Separators23 hits · 69 pts
SeverityFileLineSnippetContext
MEDIUMTaskfile.yml3# ============================================================================COMMENT
MEDIUMTaskfile.yml4# ============================================================================COMMENT
MEDIUMdocs-site/public/demo.html356 // ── Structured logger ──────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html376 // ── Resolve the latest published WASM release ──────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html430 // ── Drag & Drop ────────────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html474 // ── Markdown Renderer ──────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html546 // ── JSON Syntax Highlighter ────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html562 // ── Extraction via Web Worker ──────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html665 // ── Process File ───────────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html743 // ── Reset ──────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html757 // ── Copy ───────────────────────────────────────────────────────────────COMMENT
MEDIUMdocs-site/public/demo.html780 // ── Tab Switcher ───────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-wasm/typescript/ocr/enabler.spec.ts16// ── Module mocks ─────────────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-wasm/typescript/ocr/enabler.spec.ts45// ── Imports (after mocks are declared) ───────────────────────────────────────COMMENT
MEDIUMcrates/xberg-wasm/typescript/ocr/enabler.spec.ts53// ── Helpers ───────────────────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-wasm/typescript/ocr/enabler.spec.ts65// ── Tests ─────────────────────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-ffi/tests/vtable_bytes_len.rs19// ── Per-test callback state ───────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-ffi/tests/vtable_bytes_len.rs35// ── C callback stubs ─────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg-ffi/tests/vtable_bytes_len.rs91// ── Tests ─────────────────────────────────────────────────────────────────COMMENT
MEDIUMcrates/xberg/src/pdf/structure/constants.rs3// ~keep ── Glyph-fragmentation repair (issue #962) ────────────────────────────────COMMENT
MEDIUMcrates/xberg/src/pdf/structure/constants.rs3// ~keep ── Glyph-fragmentation repair (issue #962) ────────────────────────────────COMMENT
MEDIUM.task/tools/demo.yml3# ============================================================================COMMENT
MEDIUM.task/tools/fixtures.yml3# ============================================================================COMMENT
Magic Placeholder Names6 hits · 30 pts
SeverityFileLineSnippetContext
HIGHdocs-site/src/snippets/python/ocr/cloud_ocr_backend.md61backend: CloudOcrBackend = CloudOcrBackend(api_key="your-api-key")CODE
HIGHdocs-site/src/snippets/java/ocr/cloud_ocr_backend.md13 String apiKey = "your-api-key";CODE
HIGHdocs-site/src/snippets/csharp/cloud_ocr_backend.md52 var backend = new CloudOcrBackend(apiKey: "your-api-key");CODE
HIGH…ite/src/snippets/csharp/advanced/custom_ocr_backend.cs63 using var backend = new CloudOcrBackend("your-api-key");CODE
HIGH…-site/src/snippets/csharp/plugins/custom_ocr_plugin.cs65 using var backend = new CloudOcrBackend(apiKey: "your-api-key-here");CODE
HIGHdocs-site/src/snippets/csharp/ocr/cloud_ocr_backend.md74 var backend = new CloudOcrBackend(apiKey: "your-api-key");CODE
Deep Nesting27 hits · 27 pts
SeverityFileLineSnippetContext
LOWtools/benchmark-harness/scripts/import_omnidocbench.py228CODE
LOW…nchmark-harness/scripts/generate_vendored_baselines.py55CODE
LOW…nchmark-harness/scripts/generate_vendored_baselines.py78CODE
LOWtools/benchmark-harness/scripts/pymupdf4llm_extract.py128CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py235CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py281CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py430CODE
LOW…ols/benchmark-harness/scripts/generate_ground_truth.py462CODE
LOWtools/benchmark-harness/scripts/sanitize_pandoc_gt.py30CODE
LOWtools/benchmark-harness/scripts/sanitize_pandoc_gt.py101CODE
LOWtools/benchmark-harness/scripts/mineru_extract.py263CODE
LOWtools/benchmark-harness/scripts/docling_extract.py206CODE
LOWtools/benchmark-harness/scripts/xberg_extract.py172CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py24CODE
LOWtools/benchmark-harness/scripts/unstructured_extract.py175CODE
LOWtools/benchmark-harness/scripts/markitdown_extract.py125CODE
LOW…mark-harness/python_baselines/paddleocr_vl_baseline.py147CODE
LOW…mark-harness/python_baselines/paddleocr_vl_baseline.py163CODE
LOW…xtures/src/generate_test_fixtures/security_fixtures.py43CODE
LOW…_fixtures/src/generate_test_fixtures/xlsx_revisions.py91CODE
LOW…t_fixtures/src/generate_test_fixtures/odt_revisions.py108CODE
LOW…t_fixtures/src/generate_test_fixtures/pptx_comments.py103CODE
LOWscripts/ci/ruby/vendor-xberg-core.py115CODE
LOWscripts/ci/ruby/vendor-xberg-core.py245CODE
LOWscripts/ci/ruby/vendor-xberg-core.py124CODE
LOWcli-proxy/pypi/xberg_cli/downloader.py182CODE
LOWe2e/python/conftest.py35CODE
Synthetic Comment Markers2 hits · 10 pts
SeverityFileLineSnippetContext
HIGH…ls/benchmark-harness/vendored/docling/md/nougat_034.md163Most beneficial owners holding stock in 'street name' will receive instructions for voting their shares from their brokeCODE
HIGHtools/benchmark-harness/vendored/docling/md/pdfa_009.md163Most beneficial owners holding stock in 'street name' will receive instructions for voting their shares from their brokeCODE
Redundant / Tautological Comments5 hits · 8 pts
SeverityFileLineSnippetContext
LOW.github/workflows/benchmarks.yaml754 # Check if benchmark-artifacts directory exists and is not emptyCOMMENT
LOW.github/workflows/benchmarks.yaml779 # Check if we should skip (from validation step)COMMENT
LOW.github/workflows/benchmarks.yaml820 # Check if aggregated.json existsCOMMENT
LOW.github/actions/cache-benchmark-harness/action.yml250 # Check if binary existsCOMMENT
LOW.github/actions/cache-benchmark-harness/action.yml256 # Check if binary is executableCOMMENT
Cross-Language Confusion1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHscripts/ci/docker/test_docker.py772 "echo 'attempt' > /data/test2.txt 2>&1 || echo 'READ_ONLY'",CODE
Modern Structural Boilerplate2 hits · 2 pts
SeverityFileLineSnippetContext
LOWpackages/python/xberg/__init__.py367__all__ = [CODE
LOWpackages/python/xberg/exceptions.py40__all__ = [CODE