Repository Analysis

neuml/txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

21.3 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of neuml/txtai, a Python project with 12,774 GitHub stars. SynthScan v2.0 examined 56,260 lines of code across 466 source files, recording 623 pattern matches distributed across 18 syntactic categories. The overall adjusted score of 21.3 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

21.3
Adjusted Score
21.3
Raw Score
100%
Time Factor
2026-08-01
Last Push
12.8K
Stars
Python
Language
56.3K
Lines of Code
466
Files
623
Pattern Hits
2026-08-02
Scan Date
0.18
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

Longitudinal tracking requires multiple scan runs. Once this repository is re-scanned after new commits land, this chart will visualise how the synthetic code signal evolves over time — enabling you to detect whether AI authorship is growing, stabilising, or being actively corrected by human engineers.

No multi-scan history yet — run the scanner again to build trend data.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 1HIGH 82MEDIUM 90LOW 450

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 623 distinct pattern matches across 18 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Cross-File Repetition66 hits · 330 pts
SeverityFileLineSnippetContext
HIGHdocs/agent/index.md0gets the current date and time returns: current date and timeSTRING
HIGHdocs/agent/configuration.md0gets the current date and time returns: current date and timeSTRING
HIGHexamples/agent_quickstart.py0gets the current date and time returns: current date and timeSTRING
HIGHexamples/similarity.py0creates and caches a streamlit application. returns: applicationSTRING
HIGHexamples/wiki.py0creates and caches a streamlit application. returns: applicationSTRING
HIGHexamples/baseball.py0creates and caches a streamlit application. returns: applicationSTRING
HIGHexamples/article.py0creates and caches a streamlit application. returns: applicationSTRING
HIGHsrc/python/txtai/database/client.py0creates a new database. args: config: database configurationSTRING
HIGHsrc/python/txtai/database/rdbms.py0creates a new database. args: config: database configurationSTRING
HIGHsrc/python/txtai/database/embedded.py0creates a new database. args: config: database configurationSTRING
HIGHsrc/python/txtai/database/base.py0creates a new database. args: config: database configurationSTRING
HIGHsrc/python/txtai/database/client.py0executes a sql statement based on the current sql dialect. args: sql: sql to execute parameters: optional bind parameterSTRING
HIGHsrc/python/txtai/ann/dense/pgvector.py0executes a sql statement based on the current sql dialect. args: sql: sql to execute parameters: optional bind parameterSTRING
HIGHsrc/python/txtai/scoring/pgtext.py0executes a sql statement based on the current sql dialect. args: sql: sql to execute parameters: optional bind parameterSTRING
HIGHsrc/python/txtai/database/factory.py0attempt to resolve a custom backend. args: backend: backend class config: index configuration parameters returns: scorinSTRING
HIGHsrc/python/txtai/ann/dense/factory.py0attempt to resolve a custom backend. args: backend: backend class config: index configuration parameters returns: scorinSTRING
HIGHsrc/python/txtai/ann/sparse/factory.py0attempt to resolve a custom backend. args: backend: backend class config: index configuration parameters returns: scorinSTRING
HIGHsrc/python/txtai/graph/factory.py0attempt to resolve a custom backend. args: backend: backend class config: index configuration parameters returns: scorinSTRING
HIGHsrc/python/txtai/scoring/factory.py0attempt to resolve a custom backend. args: backend: backend class config: index configuration parameters returns: scorinSTRING
HIGHsrc/python/txtai/database/rdbms.py0creates a new term database connection. args: path: path to term database file returns: connectionSTRING
HIGHsrc/python/txtai/ann/dense/sqlite.py0creates a new term database connection. args: path: path to term database file returns: connectionSTRING
HIGHsrc/python/txtai/scoring/terms.py0creates a new term database connection. args: path: path to term database file returns: connectionSTRING
HIGHsrc/python/txtai/pipeline/llm/generation.py0returns true if this model supports chat. returns: true if this a chat modelSTRING
HIGHsrc/python/txtai/pipeline/llm/llm.py0returns true if this model supports chat. returns: true if this a chat modelSTRING
HIGHsrc/python/txtai/pipeline/llm/huggingface.py0returns true if this model supports chat. returns: true if this a chat modelSTRING
HIGHsrc/python/txtai/pipeline/llm/opencode.py0checks if path is available on the hf hub. args: input path returns: true if this is a model on the hf hubSTRING
HIGHsrc/python/txtai/pipeline/llm/litellm.py0checks if path is available on the hf hub. args: input path returns: true if this is a model on the hf hubSTRING
HIGHsrc/python/txtai/vectors/dense/litellm.py0checks if path is available on the hf hub. args: input path returns: true if this is a model on the hf hubSTRING
HIGHsrc/python/txtai/pipeline/llm/llama.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/vectors/dense/llama.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/pipeline/llm/litellm.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/vectors/dense/litellm.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/pipeline/llm/litert.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/vectors/dense/litert.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/vectors/dense/m2v.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/vectors/dense/words.py0checks if path is a wordvectors model. args: path: input path returns: true if this is a wordvectors model, false otherwSTRING
HIGHsrc/python/txtai/pipeline/text/summary.py0applies a series of rules to clean generated text. args: text: input text returns: clean textSTRING
HIGHsrc/python/txtai/pipeline/data/segmentation.py0applies a series of rules to clean generated text. args: text: input text returns: clean textSTRING
HIGHsrc/python/txtai/embeddings/search/query.py0applies a series of rules to clean generated text. args: text: input text returns: clean textSTRING
HIGHsrc/python/txtai/ann/dense/sqlite.py0initializes a new database session. args: recreate: recreates the database tables if trueSTRING
HIGHsrc/python/txtai/ann/dense/pgvector.py0initializes a new database session. args: recreate: recreates the database tables if trueSTRING
HIGHsrc/python/txtai/scoring/pgtext.py0initializes a new database session. args: recreate: recreates the database tables if trueSTRING
HIGHsrc/python/txtai/embeddings/base.py0deletes from an embeddings cluster. returns list of ids deleted. args: ids: list of ids to delete returns: ids deletedSTRING
HIGHsrc/python/txtai/app/base.py0deletes from an embeddings cluster. returns list of ids deleted. args: ids: list of ids to delete returns: ids deletedSTRING
HIGHsrc/python/txtai/api/base.py0deletes from an embeddings cluster. returns list of ids deleted. args: ids: list of ids to delete returns: ids deletedSTRING
HIGHsrc/python/txtai/api/routers/embeddings.py0deletes from an embeddings cluster. returns list of ids deleted. args: ids: list of ids to delete returns: ids deletedSTRING
HIGHsrc/python/txtai/api/cluster.py0deletes from an embeddings cluster. returns list of ids deleted. args: ids: list of ids to delete returns: ids deletedSTRING
HIGHsrc/python/txtai/embeddings/base.py0total number of elements in this embeddings index. returns: number of elements in embeddings indexSTRING
HIGHsrc/python/txtai/app/base.py0total number of elements in this embeddings index. returns: number of elements in embeddings indexSTRING
HIGHsrc/python/txtai/api/base.py0total number of elements in this embeddings index. returns: number of elements in embeddings indexSTRING
HIGHsrc/python/txtai/api/routers/embeddings.py0total number of elements in this embeddings index. returns: number of elements in embeddings indexSTRING
HIGHsrc/python/txtai/app/base.py0finds documents most similar to the input queries. this method will run either an index search or an index + database seSTRING
HIGHsrc/python/txtai/api/cluster.py0finds documents most similar to the input queries. this method will run either an index search or an index + database seSTRING
HIGHsrc/python/txtai/api/routers/embeddings.py0finds documents most similar to the input queries. this method will run either an index search or an index + database seSTRING
HIGHsrc/python/txtai/app/base.py0builds an embeddings index for previously batched documents.STRING
HIGHsrc/python/txtai/api/cluster.py0builds an embeddings index for previously batched documents.STRING
HIGHsrc/python/txtai/api/base.py0builds an embeddings index for previously batched documents.STRING
HIGHsrc/python/txtai/api/routers/embeddings.py0builds an embeddings index for previously batched documents.STRING
HIGHsrc/python/txtai/app/base.py0runs an embeddings upsert operation for previously batched documents.STRING
HIGHsrc/python/txtai/api/cluster.py0runs an embeddings upsert operation for previously batched documents.STRING
6 more matches not shown…
Unused Imports263 hits · 262 pts
SeverityFileLineSnippetContext
LOWtest/python/testoptional.py9CODE
LOWtest/python/testoptional.py10CODE
LOWtest/python/testoptional.py167CODE
LOWtest/python/testlibrary.py9CODE
LOWtest/python/testann/testdense.py111CODE
LOWsrc/python/txtai/__init__.py8CODE
LOWsrc/python/txtai/__init__.py9CODE
LOWsrc/python/txtai/__init__.py10CODE
LOWsrc/python/txtai/__init__.py11CODE
LOWsrc/python/txtai/__init__.py11CODE
LOWsrc/python/txtai/__init__.py11CODE
LOWsrc/python/txtai/__init__.py12CODE
LOWsrc/python/txtai/database/__init__.py5CODE
LOWsrc/python/txtai/database/__init__.py6CODE
LOWsrc/python/txtai/database/__init__.py7CODE
LOWsrc/python/txtai/database/__init__.py8CODE
LOWsrc/python/txtai/database/__init__.py9CODE
LOWsrc/python/txtai/database/__init__.py10CODE
LOWsrc/python/txtai/database/__init__.py11CODE
LOWsrc/python/txtai/database/__init__.py12CODE
LOWsrc/python/txtai/database/__init__.py13CODE
LOWsrc/python/txtai/database/__init__.py14CODE
LOWsrc/python/txtai/database/encoder/__init__.py5CODE
LOWsrc/python/txtai/database/encoder/__init__.py6CODE
LOWsrc/python/txtai/database/encoder/__init__.py7CODE
LOWsrc/python/txtai/database/encoder/__init__.py8CODE
LOWsrc/python/txtai/database/schema/__init__.py5CODE
LOWsrc/python/txtai/database/schema/__init__.py6CODE
LOWsrc/python/txtai/database/sql/__init__.py5CODE
LOWsrc/python/txtai/database/sql/__init__.py6CODE
LOWsrc/python/txtai/database/sql/__init__.py7CODE
LOWsrc/python/txtai/database/sql/__init__.py8CODE
LOWsrc/python/txtai/database/sql/__init__.py9CODE
LOWsrc/python/txtai/pipeline/__init__.py5CODE
LOWsrc/python/txtai/pipeline/__init__.py6CODE
LOWsrc/python/txtai/pipeline/__init__.py7CODE
LOWsrc/python/txtai/pipeline/__init__.py8CODE
LOWsrc/python/txtai/pipeline/__init__.py9CODE
LOWsrc/python/txtai/pipeline/__init__.py10CODE
LOWsrc/python/txtai/pipeline/__init__.py11CODE
LOWsrc/python/txtai/pipeline/__init__.py12CODE
LOWsrc/python/txtai/pipeline/__init__.py13CODE
LOWsrc/python/txtai/pipeline/__init__.py14CODE
LOWsrc/python/txtai/pipeline/__init__.py15CODE
LOWsrc/python/txtai/pipeline/__init__.py16CODE
LOWsrc/python/txtai/pipeline/__init__.py17CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py5CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py6CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py7CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py8CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py9CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py10CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py11CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py12CODE
LOWsrc/python/txtai/pipeline/llm/__init__.py13CODE
LOWsrc/python/txtai/pipeline/image/__init__.py5CODE
LOWsrc/python/txtai/pipeline/image/__init__.py6CODE
LOWsrc/python/txtai/pipeline/image/__init__.py7CODE
LOWsrc/python/txtai/pipeline/audio/__init__.py5CODE
LOWsrc/python/txtai/pipeline/audio/__init__.py6CODE
203 more matches not shown…
Self-Referential Comments61 hits · 179 pts
SeverityFileLineSnippetContext
MEDIUMtest/python/testconsole.py47 # Create an index for the list of textSTRING
MEDIUMtest/python/testconsole.py101 # Create an index for the list of textSTRING
MEDIUMtest/python/testembeddings.py115 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testembeddings.py261 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testembeddings.py294 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testembeddings.py320 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testembeddings.py455 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testembeddings.py639 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py59 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py80 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py173 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py205 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py223 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py239 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py258 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py386 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py396 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py418 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py438 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py497 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testgraph.py570 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testcloud.py155 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py66 # Create an indexCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py81 # Create an index for the list of imagesCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py100 # Create an indexCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py116 # Create an indexCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py130 # Create an index for the list of imagesCOMMENT
MEDIUMtest/python/testdatabase/testencoder.py152 # Create an index for the list of imagesCOMMENT
MEDIUMtest/python/testdatabase/testduckdb.py70 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py64 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py166 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py178 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py275 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py338 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py351 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py364 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py447 # Create an index using mixed data (text and documents)COMMENT
MEDIUMtest/python/testdatabase/testrdbms.py465 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py591 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py604 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py623 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py649 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py662 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py704 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py885 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testrdbms.py909 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testdatabase/testsqlite.py59 # Create an index for the list of textCOMMENT
MEDIUMtest/python/testvectors/testdense/testvectors.py66 # Create the recovery instance with an empty checkpoint fileCOMMENT
MEDIUMsrc/python/txtai/pipeline/llm/litert.py51 # Create the engineCOMMENT
MEDIUMsrc/python/txtai/pipeline/text/entity.py25 # Create a new entity pipelineCOMMENT
MEDIUMsrc/python/txtai/pipeline/data/urlretrieve.py53 # Create a blank openerCOMMENT
MEDIUMsrc/python/txtai/pipeline/data/tokenizer.py58 # Create a tokenizer with backwards compatible settingsCOMMENT
MEDIUMsrc/python/txtai/pipeline/data/segmentation.py74 # Create a third-party chunker, if applicableCOMMENT
MEDIUMsrc/python/txtai/ann/dense/ggml.py143 # Initialize GGML objectsCOMMENT
MEDIUMsrc/python/txtai/ann/dense/ggml.py175 # Initialize GGML objectsCOMMENT
MEDIUMsrc/python/txtai/ann/dense/ggml.py194 # Initialize GGML objectsCOMMENT
MEDIUMsrc/python/txtai/ann/sparse/ivfsparse.py131 # This method is able to run as multiple threads due to a number of numpy/scipy method calls that drop the GIL.COMMENT
MEDIUMsrc/python/txtai/app/base.py66 # Initialize member variablesCOMMENT
MEDIUMsrc/python/txtai/agent/factory.py38 # Create the agent processCOMMENT
MEDIUMsrc/python/txtai/workflow/task/base.py243 # Create a copy of tuple, update data element and returnCOMMENT
1 more matches not shown…
Redundant / Tautological Comments56 hits · 87 pts
SeverityFileLineSnippetContext
LOWtest/python/testarchive.py48 # Check if file properly extractedCOMMENT
LOWexamples/baseball.py492 # Display resultsCOMMENT
LOWexamples/benchmarks.py84 # Increment offsetCOMMENT
LOWsrc/python/txtai/database/factory.py48 # Check if content is a URLCOMMENT
LOWsrc/python/txtai/database/sql/aggregate.py35 # Check if this is a SQL query with results. A sharded query that matchesCOMMENT
LOWsrc/python/txtai/database/sql/expression.py71 # Check if separator, increment clause indexCOMMENT
LOWsrc/python/txtai/database/sql/expression.py75 # Check if token is a square bracketCOMMENT
LOWsrc/python/txtai/database/sql/expression.py80 # Check if token is a similar functionCOMMENT
LOWsrc/python/txtai/database/sql/expression.py85 # Check if token is a functionCOMMENT
LOWsrc/python/txtai/database/sql/expression.py301 # Check if token is a square bracketCOMMENT
LOWsrc/python/txtai/database/sql/expression.py306 # Check if token is a similar functionCOMMENT
LOWsrc/python/txtai/database/sql/expression.py311 # Check if token is a functionCOMMENT
LOWsrc/python/txtai/pipeline/hfpipeline.py39 # Check if input model is a Pipeline or a HF pipelineCOMMENT
LOWsrc/python/txtai/pipeline/llm/llama.py45 # Check if this is a local path, otherwise download from the HF HubCOMMENT
LOWsrc/python/txtai/pipeline/llm/litert.py48 # Check if this is a local path, otherwise download from the HF HubCOMMENT
LOWsrc/python/txtai/pipeline/audio/transcription.py97 # Read file or file-like objectCOMMENT
LOWsrc/python/txtai/pipeline/audio/texttospeech.py133 # Check if file existsCOMMENT
LOWsrc/python/txtai/pipeline/audio/texttospeech.py220 # Check if token is a punctuation tokenCOMMENT
LOWsrc/python/txtai/pipeline/train/hfonnx.py116 # Read file back to bytes if temp file was createdCOMMENT
LOWsrc/python/txtai/pipeline/data/filetohtml.py118 # Check if Java binary is available on pathCOMMENT
LOWsrc/python/txtai/pipeline/data/textractor.py50 # Check if text is a valid file path or urlCOMMENT
LOWsrc/python/txtai/pipeline/data/safeopen.py53 # Check if this is a local file path or local file urlCOMMENT
LOWsrc/python/txtai/pipeline/data/htmltomd.py365 # Check if this node is valid or it's part of a table cellCOMMENT
LOWsrc/python/txtai/pipeline/data/htmltomd.py368 # Check if text is valid article textCOMMENT
LOWsrc/python/txtai/pipeline/data/htmltomd.py404 # Check if this is a link node or link containerCOMMENT
LOWsrc/python/txtai/ann/dense/ggml.py310 # Write file and free resourcesCOMMENT
LOWsrc/python/txtai/embeddings/base.py520 # Check if this exists in a cloud instanceCOMMENT
LOWsrc/python/txtai/embeddings/base.py525 # Check if this is an archive file and existsCOMMENT
LOWsrc/python/txtai/embeddings/base.py552 # Check if this is an archive file and extractCOMMENT
LOWsrc/python/txtai/embeddings/base.py618 # Check if this is an archive fileCOMMENT
LOWsrc/python/txtai/embeddings/base.py842 # Check if default model should be loadedCOMMENT
LOWsrc/python/txtai/embeddings/base.py936 # Check if path is an archive fileCOMMENT
LOWsrc/python/txtai/embeddings/index/autoid.py35 # Check if signature takes a namespace argument (deterministic)COMMENT
LOWsrc/python/txtai/embeddings/index/indexes.py35 # Check if top-level indexing is enabled for this embeddings instanceCOMMENT
LOWsrc/python/txtai/embeddings/index/transform.py54 # Check if top-level indexing is enabled for this embeddingsCOMMENT
LOWsrc/python/txtai/embeddings/index/transform.py207 # Increment offsetCOMMENT
LOWsrc/python/txtai/app/base.py360 # Check if function is a pipelineCOMMENT
LOWsrc/python/txtai/app/base.py364 # Check if function is a workflowCOMMENT
LOWsrc/python/txtai/archive/zip.py24 # Write file to zipCOMMENT
LOWsrc/python/txtai/graph/topics.py74 # Check if scoring index has dataCOMMENT
LOWsrc/python/txtai/agent/base.py135 # Check if this is a file path (i.e. agents.md)STRING
LOWsrc/python/txtai/agent/tool/skill.py68 # Read file contentSTRING
LOWsrc/python/txtai/models/pooling/late.py25 # Check if fixed dimensional encoder is enabledCOMMENT
LOWsrc/python/txtai/vectors/recovery.py35 # Open file an returnCOMMENT
LOWsrc/python/txtai/vectors/base.py99 # Check if model is cachedCOMMENT
LOWsrc/python/txtai/vectors/dense/llama.py50 # Check if this is a local path, otherwise download from the HF HubCOMMENT
LOWsrc/python/txtai/vectors/dense/words.py88 # Check if this is a SQLite databaseCOMMENT
LOWsrc/python/txtai/vectors/dense/external.py51 # Check if transform function resolution is allowedCOMMENT
LOWsrc/python/txtai/vectors/dense/litert.py51 # Check if this is a local path, otherwise download from the HF HubCOMMENT
LOWsrc/python/txtai/workflow/task/template.py38 # Check if element matches any processing rulesCOMMENT
LOWsrc/python/txtai/workflow/task/template.py91 # Check if any rules are matchedCOMMENT
LOWsrc/python/txtai/cloud/hub.py85 # Check if index files are lfs-tracked. Update .gitattributes, if necessary.COMMENT
LOWsrc/python/txtai/scoring/pgtext.py61 # Increment indexCOMMENT
LOWsrc/python/txtai/scoring/sif.py30 # Set freq to word frequencies across entire index when freq and idf shape don't matchCOMMENT
LOWsrc/python/txtai/scoring/tfidf.py90 # Increment indexCOMMENT
LOWsrc/python/txtai/scoring/tfidf.py162 # Check if term index availableCOMMENT
Docstring Block Structure15 hits · 75 pts
SeverityFileLineSnippetContext
HIGHsrc/python/txtai/database/base.py117 Runs a search against the database. Supports the following methods: 1. Standard similarity query. STRING
HIGHsrc/python/txtai/database/base.py206 Executes query against database. Args: query: input query limit: maximum numbeSTRING
HIGHsrc/python/txtai/embeddings/base.py357 Finds documents most similar to the input query. This method runs an index search, index + database search STRING
HIGHsrc/python/txtai/embeddings/base.py379 Finds documents most similar to the input query. This method runs an index search, index + database search STRING
HIGHsrc/python/txtai/embeddings/search/scan.py38 Executes a scan for a list of queries. Args: queries: list of queries to run pSTRING
HIGHsrc/python/txtai/embeddings/search/scan.py80 Parse index query clauses from a list of parsed queries. Args: queries: list of parsed queSTRING
HIGHsrc/python/txtai/embeddings/search/scan.py114 Resolves bind parameters for a similar function call. Args: similar: similar function callSTRING
HIGHsrc/python/txtai/embeddings/search/base.py45 Executes a batch search for queries. This method will run either an index search or an index + database search STRING
HIGHsrc/python/txtai/embeddings/search/base.py211 Executes an index + database search. Args: queries: list of queries limit: maxSTRING
HIGHsrc/python/txtai/app/base.py376 Finds documents most similar to the input query. This method will run either an index search or an indeSTRING
HIGHsrc/python/txtai/app/base.py402 Finds documents most similar to the input queries. This method will run either an index search or an inSTRING
HIGHsrc/python/txtai/graph/query.py161 Filters the input graph by uids. This method also adds similar match attributes. Args: graSTRING
HIGHsrc/python/txtai/api/cluster.py42 Finds documents most similar to the input query. This method will run either an index search or an indeSTRING
HIGHsrc/python/txtai/api/cluster.py83 Finds documents most similar to the input queries. This method will run either an index search or an inSTRING
HIGHsrc/python/txtai/api/routers/embeddings.py61 Finds documents most similar to the input queries. This method will run either an index search or an index + daSTRING
Modern AI Meta-Vocabulary22 hits · 62 pts
SeverityFileLineSnippetContext
MEDIUMtest/python/testapi/testapipipeline.py49# Enable pipeline similarity backed by zero shot classifierCOMMENT
MEDIUMtest/python/testapi/testapiembeddings.py74# Configuration for RAGSTRING
MEDIUMtest/python/testapi/testapiembeddings.py92# RAG settingsCOMMENT
MEDIUMtest/python/testapi/testapiembeddings.py431 # Re-create application with a RAG pipelineSTRING
MEDIUMtest/python/testpipeline/testtrain/testonnx.py159 # Test zero shot classificationCOMMENT
MEDIUMdocs/observability.md69### Retrieval Augmented Generation (RAG)COMMENT
MEDIUMdocs/observability.md88 # Create RAG pipelineCOMMENT
MEDIUMdocs/pipeline/llm/rag.md1# RAGCOMMENT
MEDIUMdocs/pipeline/llm/rag.md33# Create the RAG pipelineCOMMENT
MEDIUMdocs/pipeline/llm/rag.md44# Run RAG pipelineSTRING
MEDIUMdocs/pipeline/llm/rag.md83# - Streaming RAG response with `stream=True`STRING
MEDIUMdocs/pipeline/llm/rag.md179### ::: txtai.pipeline.RAG.__init__STRING
MEDIUMdocs/pipeline/llm/rag.md180### ::: txtai.pipeline.RAG.__call__STRING
MEDIUMdocs/agent/index.md64## Agentic RAGCOMMENT
MEDIUMexamples/rag_quickstart.py44# Step 4: Create RAG pipelineCOMMENT
MEDIUMexamples/benchmarks.py244 # Read RAG configurationCOMMENT
MEDIUMexamples/benchmarks.py247 # Load RAG pipelineCOMMENT
MEDIUMexamples/benchmarks.py251 # Set context window size to limit and runCOMMENT
MEDIUMexamples/agent_quickstart.py19# See RAG Quickstart for an example of building your own custom databaseCOMMENT
MEDIUMsrc/python/txtai/pipeline/text/labels.py16 # Set if labels are dynamic (zero shot) or fixed (standard text classification)COMMENT
MEDIUMsrc/python/txtai/pipeline/text/labels.py42 # Run zero shot classification pipelineCOMMENT
MEDIUMsrc/python/txtai/pipeline/text/similarity.py27 # Use zero-shot classification if dynamic is True and crossencode is False, otherwise use standard text clasCOMMENT
Deep Nesting55 hits · 55 pts
SeverityFileLineSnippetContext
LOWtest/python/testmodels/testpooling.py350CODE
LOWtest/python/testapi/testcluster.py34CODE
LOWtest/python/testpipeline/testtrain/testtrainer.py321CODE
LOWexamples/books.py47CODE
LOWexamples/workflows.py119CODE
LOWexamples/workflows.py146CODE
LOWexamples/workflows.py225CODE
LOWexamples/workflows.py409CODE
LOWexamples/workflows.py503CODE
LOWexamples/workflows.py676CODE
LOWexamples/baseball.py158CODE
LOWexamples/baseball.py297CODE
LOWsrc/python/txtai/database/factory.py21CODE
LOWsrc/python/txtai/database/rdbms.py37CODE
LOWsrc/python/txtai/database/rdbms.py177CODE
LOWsrc/python/txtai/database/rdbms.py479CODE
LOWsrc/python/txtai/database/sql/aggregate.py52CODE
LOWsrc/python/txtai/database/sql/expression.py53CODE
LOWsrc/python/txtai/database/sql/expression.py128CODE
LOWsrc/python/txtai/database/sql/expression.py285CODE
LOWsrc/python/txtai/pipeline/hfmodel.py87CODE
LOWsrc/python/txtai/pipeline/llm/factory.py58CODE
LOWsrc/python/txtai/pipeline/llm/rag.py178CODE
LOWsrc/python/txtai/pipeline/llm/rag.py399CODE
LOWsrc/python/txtai/pipeline/image/imagehash.py68CODE
LOWsrc/python/txtai/pipeline/audio/microphone.py93CODE
LOWsrc/python/txtai/pipeline/train/hftrainer.py208CODE
LOWsrc/python/txtai/pipeline/data/tokenizer.py100CODE
LOWsrc/python/txtai/pipeline/data/tokenizer.py143CODE
LOWsrc/python/txtai/pipeline/data/htmltomd.py165CODE
LOWsrc/python/txtai/pipeline/data/segmentation.py125CODE
LOWsrc/python/txtai/ann/dense/factory.py27CODE
LOWsrc/python/txtai/embeddings/search/scan.py79CODE
LOWsrc/python/txtai/embeddings/index/transform.py123CODE
LOWsrc/python/txtai/app/base.py96CODE
LOWsrc/python/txtai/app/base.py151CODE
LOWsrc/python/txtai/app/base.py186CODE
LOWsrc/python/txtai/app/base.py253CODE
LOWsrc/python/txtai/app/base.py308CODE
LOWsrc/python/txtai/graph/query.py122CODE
LOWsrc/python/txtai/graph/base.py444CODE
LOWsrc/python/txtai/graph/base.py515CODE
LOWsrc/python/txtai/graph/base.py592CODE
LOWsrc/python/txtai/graph/networkx.py123CODE
LOWsrc/python/txtai/agent/tool/grep.py39CODE
LOWsrc/python/txtai/agent/tool/factory.py51CODE
LOWsrc/python/txtai/models/models.py231CODE
LOWsrc/python/txtai/models/pooling/late.py164CODE
LOWsrc/python/txtai/vectors/dense/factory.py76CODE
LOWsrc/python/txtai/vectors/dense/words.py154CODE
LOWsrc/python/txtai/scoring/factory.py21CODE
LOWsrc/python/txtai/scoring/tfidf.py63CODE
LOWsrc/python/txtai/api/routers/openai.py25CODE
LOWsrc/python/txtai/data/base.py43CODE
LOWsrc/python/txtai/console/base.py66CODE
Decorative Section Separators6 hits · 27 pts
SeverityFileLineSnippetContext
MEDIUMdocs/workflow/schedule.md13# ┌─────────────── minute (0 - 59)COMMENT
MEDIUMdocs/workflow/schedule.md14# | ┌───────────── hour (0 - 23)COMMENT
MEDIUMdocs/workflow/schedule.md15# | | ┌─────────── day of the month (1 - 31)COMMENT
MEDIUMdocs/workflow/schedule.md16# | | | ┌───────── month (1 - 12)COMMENT
MEDIUMdocs/workflow/schedule.md17# | | | | ┌─────── day of the week (0 - 6)COMMENT
MEDIUMdocs/workflow/schedule.md18# | | | | | ┌───── second (0 - 59)COMMENT
Verbosity Indicators12 hits · 26 pts
SeverityFileLineSnippetContext
LOWexamples/rag_quickstart.py20# Step 1: Collect files from local directoryCOMMENT
LOWexamples/rag_quickstart.py26# Step 2: Text Extraction / ChunkingCOMMENT
LOWexamples/rag_quickstart.py37# Step 3: Build an embeddings databaseCOMMENT
LOWexamples/rag_quickstart.py44# Step 4: Create RAG pipelineCOMMENT
LOWexamples/workflow_quickstart.py16# Step 1: Define available pipelinesCOMMENT
LOWexamples/workflow_quickstart.py21# Step 2: Define workflow tasksCOMMENT
LOWexamples/workflow_quickstart.py24# Step 3: Run the workflowCOMMENT
LOWexamples/agent_quickstart.py16# Step 1: Define your Embeddings databaseCOMMENT
LOWexamples/agent_quickstart.py29# Step 2: Define other toolsCOMMENT
LOWexamples/agent_quickstart.py43# Step 3: Create a list of available toolsCOMMENT
LOWexamples/agent_quickstart.py53# Step 4: Set LLM configurationCOMMENT
LOWexamples/agent_quickstart.py72# Step 4: Create an AgentCOMMENT
Structural Annotation Overuse12 hits · 26 pts
SeverityFileLineSnippetContext
LOWexamples/rag_quickstart.py20# Step 1: Collect files from local directoryCOMMENT
LOWexamples/rag_quickstart.py26# Step 2: Text Extraction / ChunkingCOMMENT
LOWexamples/rag_quickstart.py37# Step 3: Build an embeddings databaseCOMMENT
LOWexamples/rag_quickstart.py44# Step 4: Create RAG pipelineCOMMENT
LOWexamples/workflow_quickstart.py16# Step 1: Define available pipelinesCOMMENT
LOWexamples/workflow_quickstart.py21# Step 2: Define workflow tasksCOMMENT
LOWexamples/workflow_quickstart.py24# Step 3: Run the workflowCOMMENT
LOWexamples/agent_quickstart.py16# Step 1: Define your Embeddings databaseCOMMENT
LOWexamples/agent_quickstart.py29# Step 2: Define other toolsCOMMENT
LOWexamples/agent_quickstart.py43# Step 3: Create a list of available toolsCOMMENT
LOWexamples/agent_quickstart.py53# Step 4: Set LLM configurationCOMMENT
LOWexamples/agent_quickstart.py72# Step 4: Create an AgentCOMMENT
Excessive Try-Catch Wrapping17 hits · 17 pts
SeverityFileLineSnippetContext
LOWsrc/python/txtai/database/factory.py77 except Exception as e:CODE
LOWsrc/python/txtai/database/base.py327 except Exception as e:CODE
LOWsrc/python/txtai/pipeline/llm/factory.py100 except Exception as e:CODE
LOWsrc/python/txtai/pipeline/data/urlretrieve.py102 except Exception:CODE
LOWsrc/python/txtai/ann/dense/milvus.py45 except Exception:CODE
LOWsrc/python/txtai/ann/dense/factory.py88 except Exception as e:CODE
LOWsrc/python/txtai/ann/dense/zvec.py44 except Exception:CODE
LOWsrc/python/txtai/ann/sparse/factory.py61 except Exception as e:CODE
LOWsrc/python/txtai/embeddings/index/indexes.py74 except Exception as e:CODE
LOWsrc/python/txtai/app/base.py332 except Exception:CODE
LOWsrc/python/txtai/graph/factory.py61 except Exception as e:CODE
LOWsrc/python/txtai/vectors/dense/factory.py128 except Exception as e:CODE
LOWsrc/python/txtai/vectors/sparse/factory.py55 except Exception as e:CODE
LOWsrc/python/txtai/workflow/base.py106 except Exception:CODE
LOWsrc/python/txtai/cloud/factory.py64 except Exception as e:CODE
LOWsrc/python/txtai/scoring/factory.py95 except Exception as e:CODE
LOWsrc/python/txtai/console/base.py92 except Exception:CODE
Modern Structural Boilerplate12 hits · 12 pts
SeverityFileLineSnippetContext
LOWsrc/python/txtai/__init__.py15logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/database/base.py12logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/pipeline/llm/llm.py12logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/pipeline/audio/texttospeech.py35logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/pipeline/audio/microphone.py28logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/embeddings/search/base.py12logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/graph/query.py16logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/serialize/pickle.py13logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/vectors/dense/words.py29logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/workflow/base.py22logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/workflow/task/base.py17logger = logging.getLogger(__name__)CODE
LOWsrc/python/txtai/scoring/terms.py21logger = logging.getLogger(__name__)CODE
Hallucination Indicators1 hit · 10 pts
SeverityFileLineSnippetContext
CRITICALsrc/python/txtai/pipeline/text/labels.py72 return list(self.pipeline.model.config.id2label.values())CODE
AI Structural Patterns9 hits · 9 pts
SeverityFileLineSnippetContext
LOWsrc/python/txtai/pipeline/llm/rag.py24CODE
LOWsrc/python/txtai/pipeline/audio/microphone.py37CODE
LOWsrc/python/txtai/pipeline/train/lemur.py17CODE
LOWsrc/python/txtai/pipeline/train/hftrainer.py39CODE
LOWsrc/python/txtai/pipeline/data/textractor.py20CODE
LOWsrc/python/txtai/pipeline/data/segmentation.py31CODE
LOWsrc/python/txtai/models/pooling/lemur.py82CODE
LOWsrc/python/txtai/workflow/task/base.py25CODE
LOWsrc/python/txtai/data/texts.py75CODE
Over-Commented Block8 hits · 8 pts
SeverityFileLineSnippetContext
LOWdocs/pipeline/text/reranker.md81### ::: txtai.pipeline.Reranker.__init__COMMENT
LOWdocs/pipeline/data/tokenizer.md81### ::: txtai.pipeline.Tokenizer.__init__COMMENT
LOWdocs/pipeline/data/urlretrieve.md61### ::: txtai.pipeline.URLRetrieve.__init__COMMENT
LOWdocs/pipeline/data/textractor.md81### ::: txtai.pipeline.Textractor.__init__COMMENT
LOWdocs/agent/methods.md1# MethodsCOMMENT
LOWexamples/rag_quickstart.py21#COMMENT
LOWexamples/agent_quickstart.py41COMMENT
LOWexamples/agent_quickstart.py61# model = "ollama/gpt-ossCOMMENT
Hyper-Verbose Identifiers6 hits · 5 pts
SeverityFileLineSnippetContext
LOWtest/python/testapi/testapiworkflow.py97class RequestHandler(BaseHTTPRequestHandler):STRING
LOWtest/python/testapi/testcluster.py29class RequestHandler(BaseHTTPRequestHandler):STRING
LOWtest/python/testpipeline/testdata/testurlretrieve.py16class RequestHandler(BaseHTTPRequestHandler):CODE
LOWtest/python/testpipeline/testllm/testopencode.py14class RequestHandler(BaseHTTPRequestHandler):CODE
LOWtest/python/testpipeline/testllm/testlitellm.py19class RequestHandler(BaseHTTPRequestHandler):CODE
LOWtest/python/testvectors/testdense/testlitellm.py17class RequestHandler(BaseHTTPRequestHandler):CODE
AI Slop Vocabulary1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMsrc/python/txtai/database/rdbms.py189 # Use JOIN when documents table is used to utilize indexes, default to LEFT JOINCOMMENT
Cross-Language Confusion1 hit · 2 pts
SeverityFileLineSnippetContext
HIGHexamples/books.py8 mkdir openlibrary && cd openlibrarySTRING