Home / Marker-Inc-Korea / AutoRAG
AI Slop Code RIsk Monitor

Marker-Inc-Korea/AutoRAG

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

6.6 Moderate pattern signal View on GitHub

Maintenance and Governance Review

This report summarizes scanner evidence for Marker-Inc-Korea/AutoRAG, a TypeScript project with 5,122 GitHub stars. SynthScan examined 172,885 lines of code across 1138 source files, recording 821 pattern matches distributed across 24 syntactic categories. The legacy adjusted pattern signal is 6.6 (Moderate pattern signal); it is not an authorship estimate.

Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.

6.6
Adjusted Signal
6.6
Raw Pattern Score
100%
Time Factor
2026-10-11
Last Push
5.1K
Stars
TypeScript
Language
172.9K
Lines of Code
1.1K
Files
821
Pattern Hits
2026-10-12
Scan Date
0.04
HC Hit Rate

Risk Review · v3

Use each vector to guide manual verification of the underlying findings.

Cognitive Ownership Risk 19.1/100 · LOW

Can maintainers explain intent, assumptions, and trade-offs? 618 finding(s).

Hallucinated Dependency & Supply Chain Risk 5.5/100 · LOW

Are imports declared and package/API names verified? 125 finding(s).

Agent Over-Engineering Ratio 20.0/100 · LOW

Are wrappers, guards, and repeated structures necessary? 615 finding(s).

PR Review Velocity Impact 28.5/100 · MEDIUM

Which changes need focused human review? 821 finding(s).

What These Metrics Mean

Adjusted Signal
Legacy pattern score normalized per 1,000 scanned lines and multiplied by the repository-level time factor. It is not an estimate of AI authorship.
Raw Pattern Score
Sum of severity- and context-weighted pattern findings before applying the time factor.
Time Factor
A coarse multiplier based on repository last-push metadata. It does not identify when individual code was written.
Pattern Hits
Count of configured pattern findings. Review each location and surrounding code before acting.
HC Hit Rate
High- and critical-severity findings per scanned file. Severity is a configured detector weight, not proof of a vulnerability or authorship.
Lines / Files
Scan coverage denominators used by the legacy normalized score.

Pattern-Signal History

This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.

Severity Breakdown

Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.

CRITICAL 0HIGH 40MEDIUM 69LOW 712

Directory Score Breakdown

This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.

Pattern Findings

The scanner identified 821 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.

Hyper-Verbose Identifiers515 hits · 542 pts
SeverityFileLineSnippetContext
LOWtest/datasource/skills/lazykatok/client.test.ts553 function writeFakeLazykatokStreaming(payload: string): void {CODE
LOWtest/mcp/stdio.test.ts132function expectStructuredMatchesText(result: { content: unknown; structuredContent?: unknown }): void {CODE
LOWtest/parser/decode-text.test.ts47function referenceReplacementCount(value: string): number {CODE
LOWtest/live-e2e/web-search.test.ts41function neutralizeModelCredentials(): void {CODE
LOWtest/helpers/fake-fsearch.ts5export function writeFakeFSearchExecutable(directory: string, resultPath: string): string {CODE
LOWtest/helpers/fake-minsync.ts10export function fakeMinSyncExecutableName(platform: NodeJS.Platform = process.platform): string {CODE
LOWtest/helpers/fake-minsync.ts81export function writeFakeMinSyncExecutable(directory: string, logPath?: string): string {CODE
LOWtest/helpers/fake-minsync.ts94export function writeInertMinSyncExecutable(directory: string): string {CODE
LOWtest/mirror/sync.test.ts392 async function refreshWithDeliberateSkips(): Promise<void> {CODE
LOWlegacy/tests/conftest.py12def _allow_aioresponses_without_stream_writer():CODE
LOWlegacy/tests/mock.py137def mock_get_text_embedding_batch(CODE
LOWlegacy/tests/mock.py146async def mock_aget_text_embedding_batch(CODE
LOWlegacy/tests/sample_dataset/test_load_clapnq_dataset.py4def test_records_to_dataframes_uses_official_passage_ids_and_answers():CODE
LOWlegacy/tests/sample_dataset/test_load_clapnq_dataset.py31def test_records_to_dataframes_ignores_questions_without_gold_passages():CODE
LOWlegacy/tests/autorag/test_parser.py83def test_start_parsing_specific_type_with_perfect_simple_yaml(simple_parser):CODE
LOWlegacy/tests/autorag/test_parser.py90def test_start_parser_specific_type_with_lack_simple_yaml(simple_parser):CODE
LOW⚡legacy/tests/autorag/test_parser.py138def test_start_parsing_specific_type_with_perfect_full_yaml(full_parser):CODE
LOW⚡legacy/tests/autorag/test_parser.py145def test_start_parsing_specific_type_with_lack_full_yaml(full_parser):CODE
LOW⚡legacy/tests/autorag/test_parser.py152def test_start_parsing_all_files(simple_parser):CODE
LOWlegacy/tests/autorag/test_strategy.py99def test_select_normalize_mean():CODE
LOWlegacy/tests/autorag/test_dashboard.py36def test_make_trial_summary_md():CODE
LOWlegacy/tests/autorag/test_web.py18def test_web_cli_yaml_project_dir():CODE
LOW⚡legacy/tests/autorag/test_evaluator.py64def test_start_trial_stores_absolute_vectordb_path(evaluator):CODE
LOWlegacy/tests/autorag/test_evaluator.py536def test_restart_leads_start_trial(evaluator):CODE
LOWlegacy/tests/autorag/test_node_line.py9def test_run_node_line_reports_missing_best_module(tmp_path):CODE
LOWlegacy/tests/autorag/test_deploy.py41def evaluator_data_gen_by_autorag():CODE
LOWlegacy/tests/autorag/test_deploy.py163def test_extract_node_line_names(full_config):CODE
LOWlegacy/tests/autorag/test_deploy.py172def test_extract_node_strategy(full_config):CODE
LOWlegacy/tests/autorag/test_deploy.py353def test_runner_api_server_stream(evaluator_trial_done):CODE
LOW⚡legacy/tests/autorag/test_optional_extras.py30def test_gpu_extra_does_not_include_vllm():CODE
LOW⚡legacy/tests/autorag/test_optional_extras.py35def test_vllm_is_its_own_optional_extra():CODE
LOW⚡legacy/tests/autorag/test_optional_extras.py40def test_legacy_unit_test_job_skips_vllm_install_and_bounds_runtime():CODE
LOWlegacy/tests/autorag/test_optional_extras.py52def test_legacy_unit_test_job_bounds_the_pytest_step():CODE
LOWlegacy/tests/autorag/test_optional_extras.py81def test_vllm_extra_specifier_matches_the_lock():CODE
LOWlegacy/tests/autorag/test_cli.py92def test_extract_best_config_cli():CODE
LOWlegacy/tests/autorag/test_cli.py121def test_restart_evaluate_leads_start_evaluate():CODE
LOW…/nodes/passageaugmenter/test_pass_passage_augmenter.py9def test_pass_passage_augmenter():CODE
LOW…g/nodes/passageaugmenter/test_run_passage_augmenter.py39def test_run_passage_augmenter_node(node_line_dir):CODE
LOW⚡…rag/nodes/passageaugmenter/test_prev_next_augmenter.py19def prev_next_augmenter_instance():CODE
LOW⚡…rag/nodes/passageaugmenter/test_prev_next_augmenter.py23def test_prev_next_augmenter_next(prev_next_augmenter_instance):CODE
LOW⚡…rag/nodes/passageaugmenter/test_prev_next_augmenter.py32def test_prev_next_augmenter_prev(prev_next_augmenter_instance):CODE
LOW⚡…rag/nodes/passageaugmenter/test_prev_next_augmenter.py41def test_prev_next_augmenter_both(prev_next_augmenter_instance):CODE
LOW⚡…rag/nodes/passageaugmenter/test_prev_next_augmenter.py50def test_prev_next_augmenter_multi_passages(prev_next_augmenter_instance):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py70def test_prev_next_augmenter_node():CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py14def long_context_reorder_instance():CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py18def test_long_context_reorder(long_context_reorder_instance):CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py34def test_long_context_reorder_node():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py52def test_evaluate_generator_result():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py63def test_evaluate_one_prompt_maker_node():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py143def test_run_prompt_maker_node(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py188def test_run_prompt_maker_node_metric_inputs_not_aliased(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py261def test_run_prompt_maker_node_default(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py283def test_run_prompt_maker_one_module(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py317def test_summary_metric_name_at_threshold_cutoff():CODE
LOW…s/autorag/nodes/promptmaker/test_window_replacement.py27def window_replacement_instance(pseudo_project_dir):CODE
LOW…s/autorag/nodes/promptmaker/test_window_replacement.py47def test_window_replacement_node(pseudo_project_dir):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py66def project_dir_for_vectordb_node():CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py99def project_dir_for_vectordb_node_from_sample_project():CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py149def test_vectordb_retrieval_ids(vectordb_instance):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py161def test_vectordb_retrieval_ids_empty(vectordb_instance):CODE
455 more matches not shown…
Unused Imports96 hits · 96 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/nodes/passageaugmenter/__init__.py1CODE
LOWlegacy/autorag/nodes/passageaugmenter/__init__.py2CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py1CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py2CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py3CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py4CODE
LOWlegacy/autorag/nodes/semanticretrieval/__init__.py1CODE
LOWlegacy/autorag/nodes/hybridretrieval/__init__.py1CODE
LOWlegacy/autorag/nodes/hybridretrieval/__init__.py2CODE
LOWlegacy/autorag/nodes/generator/__init__.py1CODE
LOWlegacy/autorag/nodes/generator/__init__.py2CODE
LOWlegacy/autorag/nodes/generator/__init__.py3CODE
LOWlegacy/autorag/nodes/generator/__init__.py4CODE
LOWlegacy/autorag/nodes/generator/__init__.py5CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py1CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py2CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py3CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py4CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py1CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py2CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py3CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py4CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py5CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py6CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py7CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py8CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py9CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py10CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py11CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py12CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py13CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py14CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py15CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py16CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py17CODE
LOWlegacy/autorag/nodes/passagereranker/tart/__init__.py1CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py1CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py2CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py3CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py4CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py5CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py6CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py1CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py2CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py3CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py4CODE
LOWlegacy/autorag/nodes/lexicalretrieval/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py8CODE
LOWlegacy/autorag/deploy/__init__.py9CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py8CODE
36 more matches not shown…
Cross-File Repetition16 hits · 80 pts
SeverityFileLineSnippetContext
HIGH…tests/autorag/data/qa/evolve/base_test_query_evolve.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGH…torag/data/qa/generation_gt/base_test_generation_gt.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGH…acy/tests/autorag/data/qa/query/base_test_query_gen.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGHlegacy/autorag/nodes/hybridretrieval/run.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/queryexpansion/run.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/retrieval/run_util.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/passagereranker/nvidia.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/mixedbreadai.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/jina.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/cohere.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGH…/autorag/nodes/passagereranker/sentence_transformer.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/openvino.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/monot5.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/koreranker.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGH…cy/autorag/nodes/passagereranker/flag_embedding_llm.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/flag_embedding.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
Modern AI Meta-Vocabulary23 hits · 67 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/README.md222# RAG OptimizationCOMMENT
MEDIUMlegacy/README.md232## How AutoRAG optimizes RAG pipeline?COMMENT
MEDIUMlegacy/README.md244### 📌 Supporting RAG Optimization Nodes & modulesCOMMENT
MEDIUMlegacy/README.md363### 4. Deploy your optimal RAG pipelineCOMMENT
MEDIUMlegacy/tests/autorag/nodes/generator/test_openai.py196 # unknown gpt-5.4+ variants fall back to the family context windowCOMMENT
MEDIUM⚡legacy/tests/autorag/embedding/test_base.py19 # Test loading a supported embedding modelCOMMENT
MEDIUM⚡legacy/tests/autorag/embedding/test_base.py24 # Test loading an unsupported embedding modelCOMMENT
MEDIUMlegacy/tests/autorag/vectordb/test_pinecone.py21 dimension=768, # mock embedding model has 768 dimensionsCODE
MEDIUMlegacy/docs/source/tutorial.md51## Find Optimal RAG PipelineCOMMENT
MEDIUMlegacy/docs/source/tutorial.md213## Deploy your optimal RAG pipelineCOMMENT
MEDIUMlegacy/docs/source/test_your_rag.md1# Evaluate your RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md8# Road to Modular RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md10## 🤷‍♂️ What is Modular RAG?COMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md43## 🚀 Road to Modular RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md113### Node line for Modular RAGCOMMENT
MEDIUM…/autorag/nodes/passageaugmenter/prev_next_augmenter.py41 # init embedding modelCOMMENT
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py22 1_050_000 # gpt-5.4 / gpt-5.5 / gpt-5.6 families share a 1.05M context windowCODE
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py25# gpt-5 family prefixes that support the 1.05M context window.COMMENT
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py36 # gpt-5.6 family (July 2026) - 1.05M context windowCOMMENT
MEDIUMlegacy/autorag/utils/util.py551 openai_embedding_limit = 8000 # all openai embedding model has 8000 max token inputCODE
MEDIUM.github/copilot-instructions.md1# AutoRAG - AI-Powered RAG Pipeline OptimizationCOMMENT
MEDIUM.github/copilot-instructions.md235│ │ ├── nodes/ # RAG pipeline nodesCODE
MEDIUM.github/copilot-instructions.md239│ │ ├── rag/ # RAG pipeline configsCODE
Magic Placeholder Names12 hits · 60 pts
SeverityFileLineSnippetContext
HIGHlegacy/docs/source/troubleshooting.md82export OPENAI_API_KEY=your_api_keyCODE
HIGHlegacy/docs/source/troubleshooting.md102 api_key: your_api_keyCODE
HIGHlegacy/docs/source/local_model.md62 api_key: your_api_keyCODE
HIGHlegacy/docs/source/local_model.md87 api_key: your_api_keyCODE
HIGHlegacy/docs/source/install.md96export OPENAI_API_KEY="sk-...your-api-key..."CODE
HIGHlegacy/docs/source/install.md107OPENAI_API_KEY=sk-...your-api-key...CODE
HIGHlegacy/docs/source/install.md148 OPENAI_API_KEY=sk-...your-api-key...CODE
HIGHlegacy/docs/source/integration/llm/huggingface_llm.md24 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/llm/nvidia_nim.md41 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/llm/llm.md61 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/vectordb/chroma.md110 api_key: YOUR_API_KEYCODE
HIGH.github/copilot-instructions.md92 OPENAI_API_KEY=sk-your-api-key-hereCODE
Dead Code23 hits · 43 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py148CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py152CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py161CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py162CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py169CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py170CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py173CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py179CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py180CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py184CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py185CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py189CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py190CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py192CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py193CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py202CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py211CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py220CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py224CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py225CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py227CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py236CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py239CODE
Decorative Section Separators10 hits · 30 pts
SeverityFileLineSnippetContext
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts13// ── Paths ───────────────────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts24// ── Helpers ──────────────────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts58// ── Before/after helpers ─────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts76// ── Tests ────────────────────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts179// ── Fingerprint / warm-mode mismatch tests ──────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts256// ── Lock contention tests ────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts390// ── Bugfix 2: malformed fingerprint blocks warm mode ────────────────COMMENT
MEDIUMtest/live-e2e/env-fingerprint-lock.test.ts436// ── Bugfix 3: stale lock detection and break ─────────────────────────COMMENT
MEDIUMtest/live-e2e/manifest-invariant.test.ts8// ── The manifest contract ─────────────────────────────────────────────COMMENT
MEDIUMtest/live-e2e/manifest-invariant.test.ts39// ── Tests ────────────────────────────────────────────────────────────COMMENT
Empty Error Handlers6 hits · 30 pts
SeverityFileLineSnippetContext
HIGHlegacy/tests/delete_tests.py14except FileNotFoundError:CODE
HIGHlegacy/autorag/nodes/passagereranker/nvidia.py56except Exception:CODE
HIGHlegacy/autorag/nodes/passagereranker/nvidia.py60except Exception:CODE
HIGHlegacy/autorag/nodes/passagereranker/jina.py56except Exception:CODE
HIGHlegacy/autorag/nodes/passagereranker/jina.py60except Exception:CODE
HIGHlegacy/autorag/utils/util.py701except ImportError:CODE
Self-Referential Comments9 hits · 30 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/tests/autorag/nodes/generator/test_minimax.py317 # Create a very long promptCOMMENT
MEDIUM…utorag/nodes/passagereranker/test_voyageai_reranker.py42 # Create a mock VoyageResponse objectCOMMENT
MEDIUM…utorag/nodes/passagereranker/test_voyageai_reranker.py51 # Create an instance of RerankingObject using the mock dataCOMMENT
MEDIUMlegacy/autorag/nodes/passagereranker/nvidia.py109 # Create the session here, on the loop that runs the requests. aiohttp 3.13COMMENT
MEDIUMlegacy/autorag/nodes/passagereranker/jina.py97 # Create the session here, on the loop that runs the requests. aiohttp 3.13COMMENT
MEDIUM⚡legacy/autorag/utils/util.py530 # Create the header of the tableCOMMENT
MEDIUM⚡legacy/autorag/utils/util.py533 # Create the rows of the tableCOMMENT
MEDIUMlegacy/autorag/data/parse/clova.py160 # Create a 2D array to keep track of merged cellsCOMMENT
MEDIUMlegacy/autorag/data/qa/extract_evidence.py1# This module is about extracting evidence from the given retrieval gt passageCOMMENT
Cross-Language Confusion4 hits · 25 pts
SeverityFileLineSnippetContext
HIGH⚡legacy/tests/autorag/test_evaluator.py60 assert evaluator.qa_data.equals(loaded_qa_data)CODE
HIGH⚡legacy/tests/autorag/test_evaluator.py61 assert evaluator.corpus_data.equals(loaded_corpus_data)CODE
HIGHlegacy/tests/autorag/utils/test_util.py134 assert df.equals(summary_df)CODE
HIGHlegacy/tests/autorag/utils/test_util.py150 assert load_df.equals(df)CODE
Excessive Try-Catch Wrapping22 hits · 22 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/dashboard.py148 except Exception as e:STRING
MEDIUMlegacy/autorag/dashboard.py172 print(f"Error in {yaml_filepath}: {exc}")STRING
LOWlegacy/autorag/nodes/generator/base.py40 except Exception as e:CODE
LOWlegacy/autorag/nodes/passagereranker/nvidia.py56 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/nvidia.py60 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/openvino.py73 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/jina.py56 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/jina.py60 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/flag_embedding.py32 except Exception:CODE
LOWlegacy/autorag/embedding/vllm.py144 except Exception as e:CODE
LOWlegacy/autorag/vectordb/milvus.py86 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/pinecone.py37 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/pinecone.py65 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/qdrant.py81 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/weaviate.py52 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/weaviate.py89 except Exception as exc:CODE
LOW⚡legacy/autorag/vectordb/couchbase.py67 except Exception as e:CODE
LOW⚡legacy/autorag/vectordb/couchbase.py80 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/couchbase.py231 except Exception as e:CODE
LOWlegacy/autorag/schema/metricinput.py33 except Exception:CODE
LOWlegacy/autorag/data/__init__.py58 except Exception:CODE
LOWlegacy/autorag/data/__init__.py61 except Exception as exc:CODE
AI Structural Patterns22 hits · 22 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/nodes/generator/openai_llm.py224CODE
LOW…/autorag/nodes/passagereranker/tart/modeling_enc_t5.py104CODE
LOWlegacy/autorag/nodes/passagecompressor/longllmlingua.py115CODE
LOWlegacy/autorag/embedding/vllm.py58CODE
LOWlegacy/autorag/vectordb/milvus.py22CODE
LOWlegacy/autorag/vectordb/milvus.py164CODE
LOWlegacy/autorag/vectordb/pinecone.py15CODE
LOWlegacy/autorag/vectordb/pinecone.py110CODE
LOWlegacy/autorag/vectordb/qdrant.py22CODE
LOWlegacy/autorag/vectordb/weaviate.py17CODE
LOWlegacy/autorag/vectordb/weaviate.py154CODE
LOWlegacy/autorag/vectordb/chroma.py19CODE
LOWlegacy/autorag/vectordb/couchbase.py18CODE
LOWlegacy/autorag/utils/util.py43CODE
LOWlegacy/autorag/utils/util.py456CODE
LOWlegacy/autorag/evaluation/metric/generation.py73CODE
LOWlegacy/autorag/evaluation/metric/generation.py187CODE
LOWlegacy/autorag/evaluation/metric/generation.py233CODE
LOWlegacy/autorag/evaluation/metric/generation.py418CODE
LOWlegacy/autorag/data/parse/base.py71CODE
LOWlegacy/autorag/data/legacy/qacreation/simple.py48CODE
LOWlegacy/autorag/data/legacy/qacreation/base.py104CODE
Deep Nesting20 hits · 20 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/delete_tests.py8CODE
LOWlegacy/autorag/web.py9CODE
LOWlegacy/autorag/cli.py100CODE
LOWlegacy/autorag/nodes/generator/base.py56CODE
LOWlegacy/autorag/nodes/generator/base.py59CODE
LOW…/autorag/nodes/passagereranker/tart/modeling_enc_t5.py104CODE
LOWlegacy/autorag/vectordb/chroma.py19CODE
LOWlegacy/autorag/utils/preprocess.py23CODE
LOWlegacy/autorag/utils/preprocess.py131CODE
LOWlegacy/autorag/utils/preprocess.py24CODE
LOWlegacy/autorag/utils/util.py237CODE
LOWlegacy/autorag/utils/util.py263CODE
LOWlegacy/autorag/utils/util.py292CODE
LOWlegacy/autorag/utils/util.py500CODE
LOWlegacy/autorag/utils/util.py630CODE
LOWlegacy/autorag/schema/metricinput.py39CODE
LOWlegacy/autorag/data/parse/clova.py154CODE
LOWlegacy/autorag/data/parse/run.py38CODE
LOWlegacy/autorag/data/parse/llamaparse.py71CODE
LOWlegacy/autorag/data/parse/llamaparse.py81CODE
Fake / Example Data13 hits · 13 pts
SeverityFileLineSnippetContext
LOWtest/cloud/oauth-login.test.ts56 body: { access_token: "dz_token", token_type: "Bearer", email: "user@example.com" },CODE
LOWtest/cloud/oauth-login.test.ts74 expect(credentials).toMatchObject({ access: "dz_token", refresh: "", email: "user@example.com" });CODE
LOWtest/cloud/token.test.ts23 body: { access_token: "dz_secret", token_type: "Bearer", email: "user@example.com" },CODE
LOWtest/cloud/token.test.ts28 expect(token).toEqual({ accessToken: "dz_secret", email: "user@example.com" });CODE
LOWlegacy/tests/autorag/nodes/generator/test_openai.py313 name="John Doe",CODE
LOWlegacy/tests/autorag/nodes/generator/test_openai.py337 assert response[0].name == "John Doe"CODE
LOW…/tests/autorag/nodes/generator/test_llama_index_llm.py108 "name": "John Doe",CODE
LOW…/tests/autorag/nodes/generator/test_llama_index_llm.py137 assert output.name == "John Doe"CODE
LOWlegacy/tests/autorag/utils/test_util.py494 "Author": "John Doe",CODE
LOWscripts/manual-qa/run-qa-live.ts24writeFileSync(join(docsDir, "readme.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-github-gist-live.ts26writeFileSync(join(docsDir, "readme.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-tenant-live.ts51writeFileSync(join(docs, "placeholder.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-spotlight-live.ts45writeFileSync(join(docsDir, "readme.txt"), "placeholder");CODE
Structural Annotation Overuse7 hits · 12 pts
SeverityFileLineSnippetContext
LOW.github/copilot-instructions.md189 # WARNING: This test requires OpenAI API key and may cost ~$0.30COMMENT
LOW⚡src/web/fetch/render.ts82 // Step 0: Normalize URLCOMMENT
LOW⚡src/web/fetch/render.ts85 // Step 2: Fetch pageCOMMENT
LOWsrc/web/fetch/render.ts128 // Step 3: Handle convertible binary files (PDF, DOCX, etc.)COMMENT
LOWsrc/web/fetch/render.ts176 // Step 4: Handle non-HTML text contentCOMMENT
LOWsrc/web/fetch/render.ts241 // Step 5: For HTML, try digestible formats firstCOMMENT
LOWsrc/web/fetch/render.ts365 // Step 6: If rendered output is low quality, try more targeted fallbacksCOMMENT
Verbosity Indicators6 hits · 10 pts
SeverityFileLineSnippetContext
LOW⚡src/web/fetch/render.ts82 // Step 0: Normalize URLCOMMENT
LOW⚡src/web/fetch/render.ts85 // Step 2: Fetch pageCOMMENT
LOWsrc/web/fetch/render.ts128 // Step 3: Handle convertible binary files (PDF, DOCX, etc.)COMMENT
LOWsrc/web/fetch/render.ts176 // Step 4: Handle non-HTML text contentCOMMENT
LOWsrc/web/fetch/render.ts241 // Step 5: For HTML, try digestible formats firstCOMMENT
LOWsrc/web/fetch/render.ts365 // Step 6: If rendered output is low quality, try more targeted fallbacksCOMMENT
Docstring Block Structure2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHlegacy/autorag/embedding/vllm.py120 Generates embeddings with retry mechanism. Args: inputs: List of texts or images to embed Returns: STRING
HIGHlegacy/autorag/embedding/vllm.py151 Generates Embeddings with input validation and retry mechanism. Args: sentences: Texts or Sentences to embedSTRING
Redundant / Tautological Comments5 hits · 7 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/evaluator.py294 # Check if trial_path existsSTRING
LOWlegacy/autorag/evaluator.py297 # Check if trial is completedSTRING
LOWlegacy/autorag/vectordb/couchbase.py56 # Check if the bucket existsCOMMENT
LOW⚡legacy/autorag/vectordb/couchbase.py73 # Check if the index exists. Throws ValueError if it doesn'tCOMMENT
LOW⚡legacy/autorag/utils/util.py526 # Check if the input is a dictionaryCOMMENT
Over-Commented Block4 hits · 4 pts
SeverityFileLineSnippetContext
LOWlegacy/pyproject.toml221#COMMENT
LOW…le_config/rag/english/non_gpu/simple_azure_openai.yaml1# Azure OpenAI sample configuration for AutoRAGCOMMENT
LOWlegacy/autorag/data/qa/__init__.py1# This is v2 version, the next version of data creationCOMMENT
LOWsrc/parser/text.ts1import { detect } from "chardet";COMMENT
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/embedding/base.py46 # you can use your own model in this way.COMMENT
AI Slop Vocabulary2 hits · 3 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/evaluation/metric/deepeval_prompt.py5 return f"""Based on the given text, please generate a comprehensive list of FACTUAL claims that can inferred from theCODE
MEDIUMlegacy/autorag/evaluation/metric/deepeval_prompt.py91 return f"""Based on the given text, please generate a comprehensive list of FACTUAL, undisputed truths that can inferSTRING
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/autorag/utils/test_util.py298 # Example usageCOMMENT
Modern Structural Boilerplate1 hit · 1 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/nodes/promptmaker/__init__.py7__all__ = [CODE
Overly Generic Function Names1 hit · 1 pts
SeverityFileLineSnippetContext
LOWsrc/embedding-runtime/gateway.ts114async function handleRequest(CODE