Repository Analysis

Marker-Inc-Korea/AutoRAG

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

9.7 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Marker-Inc-Korea/AutoRAG, a TypeScript project with 4,963 GitHub stars. SynthScan v2.0 examined 106,783 lines of code across 772 source files, recording 756 pattern matches distributed across 22 syntactic categories. The overall adjusted score of 9.7 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

9.7
Adjusted Score
9.7
Raw Score
100%
Time Factor
2026-08-01
Last Push
5.0K
Stars
TypeScript
Language
106.8K
Lines of Code
772
Files
756
Pattern Hits
2026-08-02
Scan Date
0.05
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 1HIGH 34MEDIUM 63LOW 658

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 756 distinct pattern matches across 22 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers465 hits · 492 pts
SeverityFileLineSnippetContext
LOWtest/subagents/runtime.test.ts195function isRuntimeModelsWorkerMessage(value: unknown): value is RuntimeModelsWorkerMessage {CODE
LOWtest/subagents/runtime-models-process-fixture.ts30function releaseReadBarrierWhenAllWorkersArrive(): void {CODE
LOWtest/agent/search-documents.test.ts83function fauxModelWithExplorerArtifacts(CODE
LOWtest/agent/search-documents.test.ts102function fauxModelWithNestedExplorerTasks(explorerId: string, cwd: string, ...responses: FauxResponseStep[]) {CODE
LOWtest/agent/search-documents.test.ts117function fauxModelFromSubagentArgs(CODE
LOWtest/agent/search-documents.test.ts138function fauxModelForRepeatedSearches(explorerId: string, ...responses: FauxResponseStep[]) {CODE
LOWtest/agent/search-documents.test.ts219function piSubagentsExplorerResult(provider: string, handoff: ExplorerHandoff): AgentToolResult<unknown> {CODE
LOWtest/agent/search-documents.test.ts337function cleanupProbeSessionFactory(CODE
LOWtest/agent/search-documents.test.ts390function replaceRunLogWithDirectory(memoryPath: string): void {CODE
LOWtest/observability/run-log.test.ts86function fauxModelWithSubagentArgs(CODE
LOWtest/observability/run-log.test.ts106function fauxModelForRepeatedSearches(CODE
LOWlegacy/tests/mock.py137def mock_get_text_embedding_batch(CODE
LOWlegacy/tests/mock.py146async def mock_aget_text_embedding_batch(CODE
LOWlegacy/tests/autorag/test_parser.py83def test_start_parsing_specific_type_with_perfect_simple_yaml(simple_parser):CODE
LOWlegacy/tests/autorag/test_parser.py90def test_start_parser_specific_type_with_lack_simple_yaml(simple_parser):CODE
LOWlegacy/tests/autorag/test_parser.py138def test_start_parsing_specific_type_with_perfect_full_yaml(full_parser):CODE
LOWlegacy/tests/autorag/test_parser.py145def test_start_parsing_specific_type_with_lack_full_yaml(full_parser):CODE
LOWlegacy/tests/autorag/test_parser.py152def test_start_parsing_all_files(simple_parser):CODE
LOWlegacy/tests/autorag/test_strategy.py99def test_select_normalize_mean():CODE
LOWlegacy/tests/autorag/test_dashboard.py36def test_make_trial_summary_md():CODE
LOWlegacy/tests/autorag/test_web.py18def test_web_cli_yaml_project_dir():CODE
LOWlegacy/tests/autorag/test_evaluator.py503def test_restart_leads_start_trial(evaluator):CODE
LOWlegacy/tests/autorag/test_node_line.py9def test_run_node_line_reports_missing_best_module(tmp_path):CODE
LOWlegacy/tests/autorag/test_deploy.py41def evaluator_data_gen_by_autorag():CODE
LOWlegacy/tests/autorag/test_deploy.py163def test_extract_node_line_names(full_config):CODE
LOWlegacy/tests/autorag/test_deploy.py172def test_extract_node_strategy(full_config):CODE
LOWlegacy/tests/autorag/test_deploy.py353def test_runner_api_server_stream(evaluator_trial_done):CODE
LOWlegacy/tests/autorag/test_cli.py92def test_extract_best_config_cli():CODE
LOWlegacy/tests/autorag/test_cli.py121def test_restart_evaluate_leads_start_evaluate():CODE
LOW…/nodes/passageaugmenter/test_pass_passage_augmenter.py9def test_pass_passage_augmenter():CODE
LOW…g/nodes/passageaugmenter/test_run_passage_augmenter.py39def test_run_passage_augmenter_node(node_line_dir):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py19def prev_next_augmenter_instance():CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py23def test_prev_next_augmenter_next(prev_next_augmenter_instance):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py32def test_prev_next_augmenter_prev(prev_next_augmenter_instance):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py41def test_prev_next_augmenter_both(prev_next_augmenter_instance):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py50def test_prev_next_augmenter_multi_passages(prev_next_augmenter_instance):CODE
LOW…rag/nodes/passageaugmenter/test_prev_next_augmenter.py70def test_prev_next_augmenter_node():CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py14def long_context_reorder_instance():CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py18def test_long_context_reorder(long_context_reorder_instance):CODE
LOW…autorag/nodes/promptmaker/test_long_context_reorder.py34def test_long_context_reorder_node():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py52def test_evaluate_generator_result():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py63def test_evaluate_one_prompt_maker_node():CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py143def test_run_prompt_maker_node(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py193def test_run_prompt_maker_node_default(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py215def test_run_prompt_maker_one_module(node_line_dir):CODE
LOW…sts/autorag/nodes/promptmaker/test_prompt_maker_run.py249def test_summary_metric_name_at_threshold_cutoff():CODE
LOW…s/autorag/nodes/promptmaker/test_window_replacement.py27def window_replacement_instance(pseudo_project_dir):CODE
LOW…s/autorag/nodes/promptmaker/test_window_replacement.py47def test_window_replacement_node(pseudo_project_dir):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py66def project_dir_for_vectordb_node():CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py99def project_dir_for_vectordb_node_from_sample_project():CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py149def test_vectordb_retrieval_ids(vectordb_instance):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py161def test_vectordb_retrieval_ids_empty(vectordb_instance):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py207async def test_duplicate_id_vectordb_ingest(openai_chroma):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py234async def test_long_text_vectordb_ingest(openai_chroma):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py247def mock_get_text_embedding_batch(self, texts, **kwargs):CODE
LOW…tests/autorag/nodes/semanticretrieval/test_vectordb.py269async def test_filter_exist_ids_from_retrieval_gt(mock_chroma):CODE
LOW…nodes/semanticretrieval/test_run_semantic_retrieval.py75def test_run_semantic_retrieval_node(node_line_dir):CODE
LOW…tests/autorag/nodes/hybridretrieval/test_hybrid_rrf.py78def test_hybrid_rrf_node_deploy(pseudo_project_dir): # noqa: F811CODE
LOW…rag/nodes/hybridretrieval/test_run_hybrid_retrieval.py76def test_run_hybrid_retrieval_node(node_line_dir):CODE
LOW…/tests/autorag/nodes/hybridretrieval/test_hybrid_cc.py62def test_hybrid_cc_non_overlap():CODE
405 more matches not shown…
Unused Imports97 hits · 97 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/autorag/nodes/generator/test_vllm.py6CODE
LOWlegacy/autorag/nodes/passageaugmenter/__init__.py1CODE
LOWlegacy/autorag/nodes/passageaugmenter/__init__.py2CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py1CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py2CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py3CODE
LOWlegacy/autorag/nodes/promptmaker/__init__.py4CODE
LOWlegacy/autorag/nodes/semanticretrieval/__init__.py1CODE
LOWlegacy/autorag/nodes/hybridretrieval/__init__.py1CODE
LOWlegacy/autorag/nodes/hybridretrieval/__init__.py2CODE
LOWlegacy/autorag/nodes/generator/__init__.py1CODE
LOWlegacy/autorag/nodes/generator/__init__.py2CODE
LOWlegacy/autorag/nodes/generator/__init__.py3CODE
LOWlegacy/autorag/nodes/generator/__init__.py4CODE
LOWlegacy/autorag/nodes/generator/__init__.py5CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py1CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py2CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py3CODE
LOWlegacy/autorag/nodes/queryexpansion/__init__.py4CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py1CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py2CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py3CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py4CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py5CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py6CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py7CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py8CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py9CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py10CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py11CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py12CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py13CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py14CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py15CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py16CODE
LOWlegacy/autorag/nodes/passagereranker/__init__.py17CODE
LOWlegacy/autorag/nodes/passagereranker/tart/__init__.py1CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py1CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py2CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py3CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py4CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py5CODE
LOWlegacy/autorag/nodes/passagefilter/__init__.py6CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py1CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py2CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py3CODE
LOWlegacy/autorag/nodes/passagecompressor/__init__.py4CODE
LOWlegacy/autorag/nodes/lexicalretrieval/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py1CODE
LOWlegacy/autorag/deploy/__init__.py8CODE
LOWlegacy/autorag/deploy/__init__.py9CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
LOWlegacy/autorag/utils/__init__.py1CODE
37 more matches not shown…
Cross-File Repetition16 hits · 80 pts
SeverityFileLineSnippetContext
HIGH…tests/autorag/data/qa/evolve/base_test_query_evolve.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGH…torag/data/qa/generation_gt/base_test_generation_gt.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGH…acy/tests/autorag/data/qa/query/base_test_query_gen.py0filename: new jeans never die. newjeans (뉴진스) is a 5-member girl group under ador and hybe labels. the members consist oSTRING
HIGHlegacy/autorag/nodes/hybridretrieval/run.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/queryexpansion/run.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/retrieval/run_util.py0evaluate retrieval node from retrieval node result dataframe. :param result_df: the result dataframe from a retrieval noSTRING
HIGHlegacy/autorag/nodes/passagereranker/nvidia.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/mixedbreadai.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/jina.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGHlegacy/autorag/nodes/passagereranker/cohere.py0initialize cohere rerank node. :param project_dir: the project directory path. :param api_key: the api key for cohere reSTRING
HIGH…/autorag/nodes/passagereranker/sentence_transformer.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/openvino.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/monot5.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/koreranker.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGH…cy/autorag/nodes/passagereranker/flag_embedding_llm.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
HIGHlegacy/autorag/nodes/passagereranker/flag_embedding.py0rerank a list of contents based on their relevance to a query using baai normal-reranker model. :param queries: the listSTRING
Modern AI Meta-Vocabulary26 hits · 76 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/README.md222# RAG OptimizationCOMMENT
MEDIUMlegacy/README.md232## How AutoRAG optimizes RAG pipeline?COMMENT
MEDIUMlegacy/README.md244### 📌 Supporting RAG Optimization Nodes & modulesCOMMENT
MEDIUMlegacy/README.md363### 4. Deploy your optimal RAG pipelineCOMMENT
MEDIUMlegacy/tests/autorag/nodes/generator/test_openai.py109 # unknown gpt-5.4+ variants fall back to the family context windowCOMMENT
MEDIUMlegacy/tests/autorag/embedding/test_base.py19 # Test loading a supported embedding modelCOMMENT
MEDIUMlegacy/tests/autorag/embedding/test_base.py24 # Test loading an unsupported embedding modelCOMMENT
MEDIUMlegacy/tests/autorag/vectordb/test_pinecone.py21 dimension=768, # mock embedding model has 768 dimensionsCODE
MEDIUMlegacy/docs/source/tutorial.md51## Find Optimal RAG PipelineCOMMENT
MEDIUMlegacy/docs/source/tutorial.md213## Deploy your optimal RAG pipelineCOMMENT
MEDIUMlegacy/docs/source/test_your_rag.md1# Evaluate your RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md8# Road to Modular RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md10## 🤷‍♂️ What is Modular RAG?COMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md43## 🚀 Road to Modular RAGCOMMENT
MEDIUMlegacy/docs/source/roadmap/modular_rag.md113### Node line for Modular RAGCOMMENT
MEDIUM…/autorag/nodes/passageaugmenter/prev_next_augmenter.py41 # init embedding modelCOMMENT
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py21 1_050_000 # gpt-5.4 / gpt-5.5 / gpt-5.6 families share a 1.05M context windowCODE
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py24# gpt-5 family prefixes that support the 1.05M context window.COMMENT
MEDIUMlegacy/autorag/nodes/generator/openai_llm.py35 # gpt-5.6 family (July 2026) - 1.05M context windowCOMMENT
MEDIUMlegacy/autorag/utils/util.py551 openai_embedding_limit = 8000 # all openai embedding model has 8000 max token inputCODE
MEDIUMdocs/subagent-orchestration.md1# Subagent orchestrationCOMMENT
MEDIUM.github/copilot-instructions.md1# AutoRAG - AI-Powered RAG Pipeline OptimizationCOMMENT
MEDIUM.github/copilot-instructions.md235│ │ ├── nodes/ # RAG pipeline nodesCODE
MEDIUM.github/copilot-instructions.md239│ │ ├── rag/ # RAG pipeline configsCODE
MEDIUMpresentation_assets/SPEAKER_OUTLINE.md11## ACT 1 — AutoRAG: AutoML for RAG (slides 1–9, ~8 min)COMMENT
MEDIUMpresentation_assets/SPEAKER_OUTLINE.md45## ACT 2 — AutoRAG-Research: reproducible RAG (slides 10–13, ~4 min)COMMENT
Magic Placeholder Names12 hits · 60 pts
SeverityFileLineSnippetContext
HIGHlegacy/docs/source/troubleshooting.md82export OPENAI_API_KEY=your_api_keyCODE
HIGHlegacy/docs/source/troubleshooting.md102 api_key: your_api_keyCODE
HIGHlegacy/docs/source/local_model.md62 api_key: your_api_keyCODE
HIGHlegacy/docs/source/local_model.md87 api_key: your_api_keyCODE
HIGHlegacy/docs/source/install.md96export OPENAI_API_KEY="sk-...your-api-key..."CODE
HIGHlegacy/docs/source/install.md107OPENAI_API_KEY=sk-...your-api-key...CODE
HIGHlegacy/docs/source/install.md148 OPENAI_API_KEY=sk-...your-api-key...CODE
HIGHlegacy/docs/source/integration/llm/huggingface_llm.md24 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/llm/nvidia_nim.md41 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/llm/llm.md61 api_key: your_api_keyCODE
HIGHlegacy/docs/source/integration/vectordb/chroma.md110 api_key: YOUR_API_KEYCODE
HIGH.github/copilot-instructions.md92 OPENAI_API_KEY=sk-your-api-key-hereCODE
Dead Code23 hits · 43 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py148CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py152CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py161CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py162CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py169CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py170CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py173CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py179CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py180CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py184CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py185CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py189CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py190CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py192CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py193CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py202CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py211CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py220CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py224CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py225CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py227CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py236CODE
MEDIUMlegacy/autorag/data/legacy/qacreation/base.py239CODE
Self-Referential Comments7 hits · 24 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/tests/autorag/nodes/generator/test_minimax.py317 # Create a very long promptCOMMENT
MEDIUM…utorag/nodes/passagereranker/test_voyageai_reranker.py42 # Create a mock VoyageResponse objectCOMMENT
MEDIUM…utorag/nodes/passagereranker/test_voyageai_reranker.py51 # Create an instance of RerankingObject using the mock dataCOMMENT
MEDIUMlegacy/autorag/utils/util.py530 # Create the header of the tableCOMMENT
MEDIUMlegacy/autorag/utils/util.py533 # Create the rows of the tableCOMMENT
MEDIUMlegacy/autorag/data/parse/clova.py154 # Create a 2D array to keep track of merged cellsCOMMENT
MEDIUMlegacy/autorag/data/qa/extract_evidence.py1# This module is about extracting evidence from the given retrieval gt passageCOMMENT
AI Structural Patterns22 hits · 22 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/nodes/generator/openai_llm.py223CODE
LOW…/autorag/nodes/passagereranker/tart/modeling_enc_t5.py83CODE
LOWlegacy/autorag/nodes/passagecompressor/longllmlingua.py115CODE
LOWlegacy/autorag/embedding/vllm.py58CODE
LOWlegacy/autorag/vectordb/milvus.py22CODE
LOWlegacy/autorag/vectordb/milvus.py164CODE
LOWlegacy/autorag/vectordb/pinecone.py15CODE
LOWlegacy/autorag/vectordb/pinecone.py110CODE
LOWlegacy/autorag/vectordb/qdrant.py22CODE
LOWlegacy/autorag/vectordb/weaviate.py17CODE
LOWlegacy/autorag/vectordb/weaviate.py154CODE
LOWlegacy/autorag/vectordb/chroma.py19CODE
LOWlegacy/autorag/vectordb/couchbase.py18CODE
LOWlegacy/autorag/utils/util.py43CODE
LOWlegacy/autorag/utils/util.py456CODE
LOWlegacy/autorag/evaluation/metric/generation.py73CODE
LOWlegacy/autorag/evaluation/metric/generation.py187CODE
LOWlegacy/autorag/evaluation/metric/generation.py233CODE
LOWlegacy/autorag/evaluation/metric/generation.py418CODE
LOWlegacy/autorag/data/parse/base.py69CODE
LOWlegacy/autorag/data/legacy/qacreation/simple.py48CODE
LOWlegacy/autorag/data/legacy/qacreation/base.py104CODE
Deep Nesting20 hits · 20 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/delete_tests.py8CODE
LOWlegacy/autorag/web.py9CODE
LOWlegacy/autorag/cli.py100CODE
LOWlegacy/autorag/nodes/generator/base.py56CODE
LOWlegacy/autorag/nodes/generator/base.py59CODE
LOW…/autorag/nodes/passagereranker/tart/modeling_enc_t5.py83CODE
LOWlegacy/autorag/vectordb/chroma.py19CODE
LOWlegacy/autorag/utils/preprocess.py23CODE
LOWlegacy/autorag/utils/preprocess.py131CODE
LOWlegacy/autorag/utils/preprocess.py24CODE
LOWlegacy/autorag/utils/util.py237CODE
LOWlegacy/autorag/utils/util.py263CODE
LOWlegacy/autorag/utils/util.py292CODE
LOWlegacy/autorag/utils/util.py500CODE
LOWlegacy/autorag/utils/util.py630CODE
LOWlegacy/autorag/schema/metricinput.py39CODE
LOWlegacy/autorag/data/parse/clova.py148CODE
LOWlegacy/autorag/data/parse/run.py38CODE
LOWlegacy/autorag/data/parse/llamaparse.py71CODE
LOWlegacy/autorag/data/parse/llamaparse.py81CODE
Cross-Language Confusion4 hits · 20 pts
SeverityFileLineSnippetContext
HIGHlegacy/tests/autorag/test_evaluator.py59 assert evaluator.qa_data.equals(loaded_qa_data)CODE
HIGHlegacy/tests/autorag/test_evaluator.py60 assert evaluator.corpus_data.equals(loaded_corpus_data)CODE
HIGHlegacy/tests/autorag/utils/test_util.py134 assert df.equals(summary_df)CODE
HIGHlegacy/tests/autorag/utils/test_util.py150 assert load_df.equals(df)CODE
Excessive Try-Catch Wrapping19 hits · 20 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/autorag/nodes/generator/test_vllm.py8except Exception as exc: # noqa: BLE001 - skip when mock is incompatible with installed vllmCODE
LOWlegacy/autorag/dashboard.py148 except Exception as e:STRING
MEDIUMlegacy/autorag/dashboard.py172 print(f"Error in {yaml_filepath}: {exc}")STRING
LOWlegacy/autorag/nodes/generator/base.py40 except Exception as e:CODE
LOWlegacy/autorag/nodes/passagereranker/openvino.py73 except Exception:CODE
LOWlegacy/autorag/nodes/passagereranker/flag_embedding.py32 except Exception:CODE
LOWlegacy/autorag/embedding/vllm.py145 except Exception as e:CODE
LOWlegacy/autorag/vectordb/milvus.py86 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/pinecone.py37 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/pinecone.py65 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/qdrant.py81 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/weaviate.py52 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/weaviate.py89 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/couchbase.py67 except Exception as e:CODE
LOWlegacy/autorag/vectordb/couchbase.py80 except Exception as exc:CODE
LOWlegacy/autorag/vectordb/couchbase.py231 except Exception as e:CODE
LOWlegacy/autorag/schema/metricinput.py33 except Exception:CODE
LOWlegacy/autorag/data/__init__.py58 except Exception:CODE
LOWlegacy/autorag/data/__init__.py61 except Exception as exc:CODE
Structural Annotation Overuse8 hits · 15 pts
SeverityFileLineSnippetContext
LOW.github/copilot-instructions.md189 # WARNING: This test requires OpenAI API key and may cost ~$0.30COMMENT
LOWsrc/subagents/dispatch-validation.ts312 // Step 1: unknown/forbidden action (precedence #1)COMMENT
LOWsrc/subagents/dispatch-validation.ts322 // Step 2: diagnostic validation (precedence #2 — diagnostic field checks)COMMENT
LOWsrc/subagents/dispatch-validation.ts350 // Step 3: top-level type/enum (artifacts, agentScope, malformed containers)COMMENT
LOWsrc/subagents/dispatch-validation.ts440 // Step 5: leaf identity / model (traversal order: root → tasks[i] → chain[j] → parallel[k])COMMENT
LOWsrc/subagents/dispatch-validation.ts1146 // Step 1: Remove all existing exact canonical role linesCOMMENT
LOWsrc/subagents/dispatch-validation.ts1154 // Step 2: Find insertion pointCOMMENT
LOWsrc/subagents/dispatch-validation.ts1185 // Step 3: Insert the two role lines with LF between themCOMMENT
Verbosity Indicators7 hits · 14 pts
SeverityFileLineSnippetContext
LOWsrc/subagents/dispatch-validation.ts312 // Step 1: unknown/forbidden action (precedence #1)COMMENT
LOWsrc/subagents/dispatch-validation.ts322 // Step 2: diagnostic validation (precedence #2 — diagnostic field checks)COMMENT
LOWsrc/subagents/dispatch-validation.ts350 // Step 3: top-level type/enum (artifacts, agentScope, malformed containers)COMMENT
LOWsrc/subagents/dispatch-validation.ts440 // Step 5: leaf identity / model (traversal order: root → tasks[i] → chain[j] → parallel[k])COMMENT
LOWsrc/subagents/dispatch-validation.ts1146 // Step 1: Remove all existing exact canonical role linesCOMMENT
LOWsrc/subagents/dispatch-validation.ts1154 // Step 2: Find insertion pointCOMMENT
LOWsrc/subagents/dispatch-validation.ts1185 // Step 3: Insert the two role lines with LF between themCOMMENT
AI Slop Vocabulary5 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/evaluation/metric/deepeval_prompt.py5 return f"""Based on the given text, please generate a comprehensive list of FACTUAL claims that can inferred from theCODE
MEDIUMlegacy/autorag/evaluation/metric/deepeval_prompt.py91 return f"""Based on the given text, please generate a comprehensive list of FACTUAL, undisputed truths that can inferSTRING
MEDIUM…esentation_assets/reveal/plugin/highlight/highlight.js1!function(e,t){"object"==typeof exports&&"undefined"!=typeof module?module.exports=t():"function"==typeof define&&defineCODE
MEDIUM…esentation_assets/reveal/plugin/highlight/highlight.js1!function(e,t){"object"==typeof exports&&"undefined"!=typeof module?module.exports=t():"function"==typeof define&&defineCODE
MEDIUM…esentation_assets/reveal/plugin/highlight/highlight.js1!function(e,t){"object"==typeof exports&&"undefined"!=typeof module?module.exports=t():"function"==typeof define&&defineCODE
Fake / Example Data11 hits · 12 pts
SeverityFileLineSnippetContext
LOWtest/cli/commands.health.test.ts20const FAKE_API_KEY = "sk-test-fake-key-DO-NOT-LEAK-1234567890";CODE
LOWlegacy/tests/autorag/nodes/generator/test_openai.py226 name="John Doe",CODE
LOWlegacy/tests/autorag/nodes/generator/test_openai.py250 assert response[0].name == "John Doe"CODE
LOW…/tests/autorag/nodes/generator/test_llama_index_llm.py77 "name": "John Doe",CODE
LOW…/tests/autorag/nodes/generator/test_llama_index_llm.py106 assert output.name == "John Doe"CODE
LOWlegacy/tests/autorag/utils/test_util.py494 "Author": "John Doe",CODE
LOWscripts/manual-qa/run-qa-discord-live.ts57writeFileSync(join(docs, "placeholder.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-live.ts23writeFileSync(join(docsDir, "readme.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-tenant-live.ts56writeFileSync(join(docs, "placeholder.txt"), "placeholder");CODE
LOWscripts/manual-qa/run-qa-spotlight-live.ts44writeFileSync(join(docsDir, "readme.txt"), "placeholder");CODE
LOW…esentation_assets/reveal/plugin/highlight/highlight.js1!function(e,t){"object"==typeof exports&&"undefined"!=typeof module?module.exports=t():"function"==typeof define&&defineCODE
Docstring Block Structure2 hits · 10 pts
SeverityFileLineSnippetContext
HIGHlegacy/autorag/embedding/vllm.py121 Generates embeddings with retry mechanism. Args: inputs: List of texts or images to embed Returns: STRING
HIGHlegacy/autorag/embedding/vllm.py152 Generates Embeddings with input validation and retry mechanism. Args: sentences: Texts or Sentences to embedSTRING
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICALpresentation_assets/reveal/plugin/notes/notes.js1!function(t,e){"object"==typeof exports&&"undefined"!=typeof module?module.exports=e():"function"==typeof define&&defineCODE
Redundant / Tautological Comments5 hits · 7 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/evaluator.py291 # Check if trial_path existsSTRING
LOWlegacy/autorag/evaluator.py294 # Check if trial is completedSTRING
LOWlegacy/autorag/vectordb/couchbase.py56 # Check if the bucket existsCOMMENT
LOWlegacy/autorag/vectordb/couchbase.py73 # Check if the index exists. Throws ValueError if it doesn'tCOMMENT
LOWlegacy/autorag/utils/util.py526 # Check if the input is a dictionaryCOMMENT
Over-Commented Block3 hits · 3 pts
SeverityFileLineSnippetContext
LOWlegacy/pyproject.toml221#COMMENT
LOW…le_config/rag/english/non_gpu/simple_azure_openai.yaml1# Azure OpenAI sample configuration for AutoRAGCOMMENT
LOWlegacy/autorag/data/qa/__init__.py1# This is v2 version, the next version of data creationCOMMENT
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMlegacy/autorag/embedding/base.py46 # you can use your own model in this way.COMMENT
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOWlegacy/tests/autorag/utils/test_util.py298 # Example usageCOMMENT
Modern Structural Boilerplate1 hit · 1 pts
SeverityFileLineSnippetContext
LOWlegacy/autorag/nodes/promptmaker/__init__.py7__all__ = [CODE