Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
This report presents the forensic synthetic code analysis of xorbitsai/inference, a Python project with 9,430 GitHub stars. SynthScan v2.0 examined 344,871 lines of code across 1307 source files, recording 4284 pattern matches distributed across 24 syntactic categories. The overall adjusted score of 15.7 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 4284 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | versioneer.py | 652 | def git_versions_from_keywords(keywords, tag_prefix, verbose): | CODE |
| LOW | versioneer.py | 1174 | def git_versions_from_keywords(keywords, tag_prefix, verbose): | STRING |
| LOW | benchmark/utils.py | 169 | def _num_special_tokens_to_add(tokenizer: "PreTrainedTokenizerBase") -> int: | CODE |
| LOW | benchmark/utils.py | 234 | def _gen_prompt_decode_to_target_len( | CODE |
| LOW | benchmark/utils.py | 300 | def _generate_prompt_with_target_len( | CODE |
| LOW | benchmark/benchmark_serving.py | 30 | def _validate_random_range_ratio(value: float, name: str) -> float: | CODE |
| LOW | …register-model/[modelType]/[modelName]/page-client.tsx | 8 | export default function RegisterModelEditPageClient() { | CODE |
| LOW | …ntend/src/app/running-model/[modelUid]/page-client.tsx | 7 | export default function RunningModelDetailPageClient() { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 215 | export function getLaunchModelEndpointType(type: RequestModelType) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 269 | function restoreNestedFormListObject(values: FormValues, parent: string, field: string) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 284 | function transformOnlyValueFormListToArray(values: FormValues, field: string) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 308 | function transformArrayToOnlyValueFormList(values: FormValues, field: string) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 358 | function applyNestedFormListObject(values: FormValues, parent: string, field: string) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 380 | function deleteNestedEmptyArrayField(values: FormValues, parent: string, field: string) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 602 | export function generateCommandLineStatement(params: FormValues) { | CODE |
| LOW | frontend/src/components/pages/launch-model/utils.tsx | 861 | export function isVisibleRequiredLaunchField(field: LaunchFieldConfig) { | CODE |
| LOW | …nents/pages/running-model-detail/capability-config.tsx | 124 | function appendCommonMediaFormData(formData: FormData, context: TransformContext) { | CODE |
| LOW | …nents/pages/running-model-detail/capability-config.tsx | 153 | function appendCommonVideoFormData(formData: FormData, context: TransformContext) { | CODE |
| LOW | …end/src/components/pages/running-model-detail/utils.ts | 142 | export function transformFileInfoForResult(message?: ChatChoicesMessage) { | CODE |
| LOW | xinference/conftest.py | 168 | def run_test_cluster_in_subprocess( | CODE |
| LOW | xinference/_version.py | 179 | def git_versions_from_keywords(keywords, tag_prefix, verbose): | CODE |
| LOW | xinference/constants.py | 114 | def _get_or_create_persisted_secret(env_name: str, file_name: str) -> str: | CODE |
| LOW | xinference/constants.py | 207 | def get_or_create_setup_token() -> str: | CODE |
| LOW | xinference/types.py | 314 | def get_pydantic_model_from_method( | CODE |
| LOW⚡ | xinference/device_utils.py | 53 | def _count_with_visible_devices(env_name: str, device_count: int) -> int: | CODE |
| LOW⚡ | xinference/device_utils.py | 273 | def _collect_gpu_info_with_env( | CODE |
| LOW⚡ | xinference/device_utils.py | 583 | def move_model_to_available_device(model): | CODE |
| LOW⚡ | xinference/device_utils.py | 590 | def get_device_preferred_dtype(device: str) -> Union[torch.dtype, None]: | CODE |
| LOW⚡ | xinference/device_utils.py | 599 | def is_hf_accelerate_supported(device: str) -> bool: | CODE |
| LOW⚡ | xinference/device_utils.py | 609 | def get_available_device_env_name(): | CODE |
| LOW | xinference/device_utils.py | 635 | def get_per_process_gpu_memory() -> Dict[int, Dict[int, int]]: | CODE |
| LOW⚡ | xinference/core/worker.py | 214 | def _snapshot_gpu_occupying_pids(device_indices: list) -> set: | CODE |
| LOW⚡ | xinference/core/worker.py | 307 | def _process_or_ancestor_has_uid(proc: Any, uid_lower: str) -> bool: | CODE |
| LOW⚡ | xinference/core/worker.py | 1348 | def _load_persisted_launch_args(self) -> dict: | CODE |
| LOW | xinference/core/worker.py | 122 | def _exclusive_venv_path_lock(env_path: str): | CODE |
| LOW | xinference/core/worker.py | 418 | async def _kill_gpu_orphans_by_ppid( | CODE |
| LOW | xinference/core/worker.py | 822 | async def _evict_replica_from_supervisor(self, model_uid: str) -> None: | CODE |
| LOW | xinference/core/worker.py | 855 | def _get_spec_dicts_with_cache_status( | CODE |
| LOW | xinference/core/worker.py | 897 | async def _cleanup_gpu_orphans_on_startup(self) -> None: | CODE |
| LOW | xinference/core/worker.py | 1241 | async def _refresh_supervisor_address(self): | CODE |
| LOW | xinference/core/worker.py | 1258 | def _get_running_replica_states(self) -> List[Dict[str, Any]]: | CODE |
| LOW | xinference/core/worker.py | 1331 | def _remove_persisted_launch_args(self, model_uid: str): | CODE |
| LOW | xinference/core/worker.py | 1492 | async def allocate_devices_with_gpu_idx( | CODE |
| LOW | xinference/core/worker.py | 1530 | async def get_gpu_allocation_status(self) -> Dict[str, Any]: | CODE |
| LOW | xinference/core/worker.py | 1572 | async def _append_sub_pool_protected( | CODE |
| LOW | xinference/core/worker.py | 1898 | async def _store_complete_model_configurations(self, model_type: str, model_data): | CODE |
| LOW | xinference/core/worker.py | 2349 | async def query_engines_by_model_name( | CODE |
| LOW | xinference/core/worker.py | 2396 | def _create_virtual_env_manager( | CODE |
| LOW | xinference/core/worker.py | 2701 | def _upload_download_progress( | CODE |
| LOW | xinference/core/worker.py | 3572 | async def _periodical_report_status(self): | CODE |
| LOW | xinference/core/worker.py | 3746 | async def list_virtual_env_packages(self, model_name: str) -> Dict[str, Any]: | CODE |
| LOW | xinference/core/metrics.py | 666 | def launch_metrics_export_server(q, host=None, port=None): | CODE |
| LOW⚡ | xinference/core/supervisor.py | 198 | def _refresh_replica_scheduler(replica_info: ReplicaInfo) -> None: | CODE |
| LOW⚡ | xinference/core/supervisor.py | 203 | def _iter_active_replica_model_uids(self, model_uid: str) -> List[str]: | CODE |
| LOW⚡ | xinference/core/supervisor.py | 213 | def _get_model_uid_and_replica_index( | CODE |
| LOW⚡ | xinference/core/supervisor.py | 428 | def _clear_unexpected_down_replicas(self, model_uid: str) -> None: | CODE |
| LOW⚡ | xinference/core/supervisor.py | 438 | def _rebuild_worker_replica_state( | CODE |
| LOW | xinference/core/supervisor.py | 93 | def callback_for_async_launch(model_uid: str): | CODE |
| LOW | xinference/core/supervisor.py | 235 | def _normalize_replica_states( | CODE |
| LOW | xinference/core/supervisor.py | 246 | def _remove_worker_from_replica_mappings(self, worker_address: str): | CODE |
| 1219 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | xinference/model/video/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | xinference/model/llm/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | xinference/model/embedding/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | xinference/model/image/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | xinference/model/audio/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | xinference/model/rerank/__init__.py | 0 | load downloaded json configurations from the builtin directory. | STRING |
| HIGH | …ence/model/llm/tool_parsers/deepseek_v3_tool_parser.py | 0 | extract tool calls from complete model output. parses the model output to find json code blocks containing tool calls an | STRING |
| HIGH | xinference/model/llm/tool_parsers/glm5_tool_parser.py | 0 | extract tool calls from complete model output. parses the model output to find json code blocks containing tool calls an | STRING |
| HIGH | …ce/model/llm/tool_parsers/deepseek_v3_1_tool_parser.py | 0 | extract tool calls from complete model output. parses the model output to find json code blocks containing tool calls an | STRING |
| HIGH | xinference/model/llm/tool_parsers/glm4_tool_parser.py | 0 | extract tool calls from complete model output. parses the model output to find json code blocks containing tool calls an | STRING |
| HIGH | …ference/thirdparty/cosyvoice/transformer/activation.py | 0 | implementation of a sine-based periodic activation function shape: - input: (b, c, t) - output: (b, c, t), same shape as | STRING |
| HIGH | xinference/thirdparty/indextts/BigVGAN/activations.py | 0 | implementation of a sine-based periodic activation function shape: - input: (b, c, t) - output: (b, c, t), same shape as | STRING |
| HIGH | …thirdparty/indextts/s2mel/modules/hifigan/generator.py | 0 | implementation of a sine-based periodic activation function shape: - input: (b, c, t) - output: (b, c, t), same shape as | STRING |
| HIGH | …irdparty/indextts/s2mel/modules/bigvgan/activations.py | 0 | implementation of a sine-based periodic activation function shape: - input: (b, c, t) - output: (b, c, t), same shape as | STRING |
| HIGH | …ference/thirdparty/cosyvoice/transformer/activation.py | 0 | initialization. input: - in_features: shape of the input - alpha: trainable parameter alpha is initialized to 1 by defau | STRING |
| HIGH | xinference/thirdparty/indextts/BigVGAN/activations.py | 0 | initialization. input: - in_features: shape of the input - alpha: trainable parameter alpha is initialized to 1 by defau | STRING |
| HIGH | …thirdparty/indextts/s2mel/modules/hifigan/generator.py | 0 | initialization. input: - in_features: shape of the input - alpha: trainable parameter alpha is initialized to 1 by defau | STRING |
| HIGH | …irdparty/indextts/s2mel/modules/bigvgan/activations.py | 0 | initialization. input: - in_features: shape of the input - alpha: trainable parameter alpha is initialized to 1 by defau | STRING |
| HIGH | …ference/thirdparty/cosyvoice/transformer/activation.py | 0 | forward pass of the function. applies the function to the input elementwise. snake ∶= x + 1/a * sin^2 (xa) | STRING |
| HIGH | xinference/thirdparty/indextts/BigVGAN/activations.py | 0 | forward pass of the function. applies the function to the input elementwise. snake ∶= x + 1/a * sin^2 (xa) | STRING |
| HIGH | …thirdparty/indextts/s2mel/modules/hifigan/generator.py | 0 | forward pass of the function. applies the function to the input elementwise. snake ∶= x + 1/a * sin^2 (xa) | STRING |
| HIGH | …irdparty/indextts/s2mel/modules/bigvgan/activations.py | 0 | forward pass of the function. applies the function to the input elementwise. snake ∶= x + 1/a * sin^2 (xa) | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 0 | make mask tensor containing indices of padded part. see description of make_non_pad_mask. args: lengths (torch.tensor): | STRING |
| HIGH | xinference/thirdparty/indextts/utils/common.py | 0 | make mask tensor containing indices of padded part. see description of make_non_pad_mask. args: lengths (torch.tensor): | STRING |
| HIGH | xinference/thirdparty/indextts/utils/utils.py | 0 | make mask tensor containing indices of padded part. see description of make_non_pad_mask. args: lengths (torch.tensor): | STRING |
| HIGH | …ference/thirdparty/deepseek_vl2/models/conversation.py | 0 | a class that manages prompt templates and keeps all conversation history. | STRING |
| HIGH | xinference/thirdparty/deepseek_vl/utils/conversation.py | 0 | a class that manages prompt templates and keeps all conversation history. | STRING |
| HIGH | xinference/thirdparty/internvl/conversation.py | 0 | a class that manages prompt templates and keeps all conversation history. | STRING |
| HIGH | …ference/thirdparty/deepseek_vl2/models/conversation.py | 0 | update the last output. the last message is typically set to be none when constructing the prompt, so we need to update | STRING |
| HIGH | xinference/thirdparty/deepseek_vl/utils/conversation.py | 0 | update the last output. the last message is typically set to be none when constructing the prompt, so we need to update | STRING |
| HIGH | xinference/thirdparty/internvl/conversation.py | 0 | update the last output. the last message is typically set to be none when constructing the prompt, so we need to update | STRING |
| HIGH | …ference/thirdparty/deepseek_vl2/models/conversation.py | 0 | convert the conversation to openai chat completion format. | STRING |
| HIGH | xinference/thirdparty/deepseek_vl/utils/conversation.py | 0 | convert the conversation to openai chat completion format. | STRING |
| HIGH | xinference/thirdparty/internvl/conversation.py | 0 | convert the conversation to openai chat completion format. | STRING |
| HIGH | …ish_speech/fish_speech/models/vqgan/modules/firefly.py | 0 | remove padding from x, handling properly zero padding. only for 1d! | STRING |
| HIGH | …s/maskgct/models/codec/speechtokenizer/modules/conv.py | 0 | remove padding from x, handling properly zero padding. only for 1d! | STRING |
| HIGH | …ference/thirdparty/indextts/s2mel/dac/model/encodec.py | 0 | remove padding from x, handling properly zero padding. only for 1d! | STRING |
| HIGH | xinference/thirdparty/indextts/s2mel/modules/encodec.py | 0 | remove padding from x, handling properly zero padding. only for 1d! | STRING |
| HIGH | …ish_speech/fish_speech/models/vqgan/modules/firefly.py | 0 | tiny wrapper around f.pad, just to allow for reflect padding on small input. if this is the case, we insert extra 0 padd | STRING |
| HIGH | …s/maskgct/models/codec/speechtokenizer/modules/conv.py | 0 | tiny wrapper around f.pad, just to allow for reflect padding on small input. if this is the case, we insert extra 0 padd | STRING |
| HIGH | …ference/thirdparty/indextts/s2mel/dac/model/encodec.py | 0 | tiny wrapper around f.pad, just to allow for reflect padding on small input. if this is the case, we insert extra 0 padd | STRING |
| HIGH | xinference/thirdparty/indextts/s2mel/modules/encodec.py | 0 | tiny wrapper around f.pad, just to allow for reflect padding on small input. if this is the case, we insert extra 0 padd | STRING |
| HIGH | xinference/thirdparty/melo/attentions.py | 0 | x: [b, h, l, d] y: [h or 1, m, d] ret: [b, h, l, m] | STRING |
| HIGH | …megatts3/tts/modules/ar_dur/commons/rel_transformer.py | 0 | x: [b, h, l, d] y: [h or 1, m, d] ret: [b, h, l, m] | STRING |
| HIGH | …ils/maskgct/models/codec/facodec/modules/attentions.py | 0 | x: [b, h, l, d] y: [h or 1, m, d] ret: [b, h, l, m] | STRING |
| HIGH | …rdparty/indextts/s2mel/modules/openvoice/attentions.py | 0 | x: [b, h, l, d] y: [h or 1, m, d] ret: [b, h, l, m] | STRING |
| HIGH | xinference/thirdparty/melo/attentions.py | 0 | bias for self-attention to encourage attention to close positions. args: length: an integer scalar. returns: a tensor wi | STRING |
| HIGH | …megatts3/tts/modules/ar_dur/commons/rel_transformer.py | 0 | bias for self-attention to encourage attention to close positions. args: length: an integer scalar. returns: a tensor wi | STRING |
| HIGH | …ils/maskgct/models/codec/facodec/modules/attentions.py | 0 | bias for self-attention to encourage attention to close positions. args: length: an integer scalar. returns: a tensor wi | STRING |
| HIGH | …rdparty/indextts/s2mel/modules/openvoice/attentions.py | 0 | bias for self-attention to encourage attention to close positions. args: length: an integer scalar. returns: a tensor wi | STRING |
| HIGH | xinference/thirdparty/melo/commons.py | 0 | sample from the gumbel distribution, protect from overflows. | STRING |
| HIGH | …/utils/maskgct/models/codec/facodec/modules/commons.py | 0 | sample from the gumbel distribution, protect from overflows. | STRING |
| HIGH | xinference/thirdparty/indextts/s2mel/modules/commons.py | 0 | sample from the gumbel distribution, protect from overflows. | STRING |
| HIGH | …thirdparty/indextts/s2mel/modules/openvoice/commons.py | 0 | sample from the gumbel distribution, protect from overflows. | STRING |
| HIGH | xinference/thirdparty/melo/text/cleaner_multiling.py | 0 | replace symbols based on the lenguage tag. args: text: input text. lang: lenguage identifier. ex: "en", "fr", "pt", "ca" | STRING |
| HIGH | …nference/thirdparty/melo/text/es_phonemizer/cleaner.py | 0 | replace symbols based on the lenguage tag. args: text: input text. lang: lenguage identifier. ex: "en", "fr", "pt", "ca" | STRING |
| HIGH | …nference/thirdparty/melo/text/fr_phonemizer/cleaner.py | 0 | replace symbols based on the lenguage tag. args: text: input text. lang: lenguage identifier. ex: "en", "fr", "pt", "ca" | STRING |
| HIGH | …ce/thirdparty/melo/text/es_phonemizer/gruut_wrapper.py | 0 | returns true if `language` is supported by the backend | STRING |
| HIGH | xinference/thirdparty/melo/text/es_phonemizer/base.py | 0 | returns true if `language` is supported by the backend | STRING |
| HIGH | …ce/thirdparty/melo/text/fr_phonemizer/gruut_wrapper.py | 0 | returns true if `language` is supported by the backend | STRING |
| 105 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/utils.py | 29 | CODE | |
| LOW | xinference/__init__.py | 29 | CODE | |
| LOW | xinference/device_utils.py | 131 | CODE | |
| LOW | xinference/device_utils.py | 140 | CODE | |
| LOW | xinference/device_utils.py | 149 | CODE | |
| LOW | xinference/device_utils.py | 158 | CODE | |
| LOW | xinference/device_utils.py | 159 | CODE | |
| LOW | xinference/device_utils.py | 168 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 22 | CODE | |
| LOW | xinference/_compat.py | 34 | CODE | |
| LOW | xinference/_compat.py | 35 | CODE | |
| LOW | xinference/_compat.py | 36 | CODE | |
| LOW | xinference/_compat.py | 37 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 39 | CODE | |
| LOW | xinference/_compat.py | 51 | CODE | |
| LOW | xinference/_compat.py | 52 | CODE | |
| LOW | xinference/_compat.py | 53 | CODE | |
| LOW | xinference/_compat.py | 54 | CODE | |
| LOW | xinference/core/supervisor.py | 53 | CODE | |
| LOW | xinference/core/supervisor.py | 77 | CODE | |
| LOW | xinference/core/supervisor.py | 78 | CODE | |
| LOW | xinference/core/supervisor.py | 80 | CODE | |
| LOW | xinference/core/supervisor.py | 81 | CODE | |
| LOW | xinference/core/supervisor.py | 82 | CODE | |
| LOW | xinference/core/supervisor.py | 83 | CODE | |
| LOW | xinference/core/launch_strategy.py | 22 | CODE | |
| LOW | xinference/core/model.py | 48 | CODE | |
| LOW | xinference/core/model.py | 49 | CODE | |
| LOW | xinference/deploy/cmdline.py | 54 | CODE | |
| LOW | xinference/deploy/utils.py | 42 | CODE | |
| LOW | xinference/model/custom.py | 24 | CODE | |
| LOW | xinference/model/cache_manager.py | 6 | CODE | |
| LOW | xinference/model/utils.py | 58 | CODE | |
| LOW | xinference/model/utils.py | 59 | CODE | |
| LOW | xinference/model/video/__init__.py | 22 | CODE | |
| LOW | xinference/model/video/diffusers.py | 36 | CODE | |
| LOW | xinference/model/llm/custom.py | 21 | CODE | |
| LOW | xinference/model/llm/cache_manager.py | 22 | CODE | |
| LOW | xinference/model/llm/__init__.py | 20 | CODE | |
| LOW | xinference/model/llm/__init__.py | 20 | CODE | |
| LOW | xinference/model/llm/__init__.py | 26 | CODE | |
| LOW | xinference/model/llm/__init__.py | 27 | CODE | |
| LOW | xinference/model/llm/__init__.py | 27 | CODE | |
| LOW | xinference/model/llm/__init__.py | 27 | CODE | |
| LOW | xinference/model/llm/__init__.py | 27 | CODE | |
| LOW | xinference/model/llm/__init__.py | 27 | CODE | |
| LOW | xinference/model/llm/core.py | 33 | CODE | |
| LOW | xinference/model/llm/core.py | 33 | CODE | |
| 649 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/benchmark_runner.py | 198 | except Exception: | CODE |
| MEDIUM | xinference/conftest.py | 117 | print(f"Error while checking endpoint: {e}") | CODE |
| LOW | xinference/conftest.py | 321 | except Exception: | CODE |
| LOW | xinference/__init__.py | 30 | except Exception: | CODE |
| MEDIUM | xinference/device_utils.py | 61 | def _mps_empty_cache(): | CODE |
| MEDIUM | xinference/device_utils.py | 313 | def get_nvidia_gpu_info() -> Dict[str, Any]: | CODE |
| MEDIUM | xinference/device_utils.py | 345 | def get_metax_gpu_info() -> Dict: | CODE |
| MEDIUM | xinference/device_utils.py | 360 | def get_rocm_gpu_info() -> Dict: | CODE |
| LOW | xinference/device_utils.py | 302 | except Exception as e: | CODE |
| LOW | xinference/device_utils.py | 309 | except Exception: | CODE |
| LOW | xinference/device_utils.py | 326 | except Exception as e: | CODE |
| LOW | xinference/device_utils.py | 340 | except Exception as e: | CODE |
| LOW | xinference/device_utils.py | 355 | except Exception as e: | CODE |
| LOW | xinference/device_utils.py | 369 | except Exception: | CODE |
| LOW | xinference/device_utils.py | 655 | except Exception: | CODE |
| LOW | xinference/device_utils.py | 678 | except Exception: | CODE |
| MEDIUM | xinference/core/worker.py | 1112 | def signal_handler(): | CODE |
| MEDIUM | xinference/core/worker.py | 1129 | def trigger_exit(self) -> bool: | CODE |
| LOW⚡ | xinference/core/worker.py | 209 | except Exception as e: | CODE |
| LOW⚡ | xinference/core/worker.py | 224 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 234 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 239 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 300 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 316 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 1345 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 1356 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 3534 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 3538 | except Exception: | CODE |
| LOW⚡ | xinference/core/worker.py | 3543 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 253 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 264 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 269 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 366 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 395 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 410 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 492 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 629 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 658 | except Exception as e: | CODE |
| LOW | xinference/core/worker.py | 683 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 702 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 704 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 745 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 770 | except Exception as e: | CODE |
| LOW | xinference/core/worker.py | 788 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 812 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 844 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 928 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 930 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 971 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1068 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1076 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1116 | except Exception as e: | CODE |
| LOW | xinference/core/worker.py | 1132 | except Exception as e: | CODE |
| LOW | xinference/core/worker.py | 1156 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1190 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1222 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1325 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1391 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1420 | except Exception: | CODE |
| LOW | xinference/core/worker.py | 1629 | except Exception: | CODE |
| 462 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | setup.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | versioneer.py | 1201 | if not tags: | COMMENT |
| LOW | benchmark/benchmark_long.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/utils.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/benchmark_embedding.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/benchmark_runner.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/benchmark_latency.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/benchmark_rerank.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | benchmark/benchmark_serving.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | frontend/next.config.ts | 1 | // Output mode (build only): | COMMENT |
| LOW | xinference/isolation.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/conftest.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/fields.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/constants.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/__init__.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/types.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/utils.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/device_utils.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/_compat.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/ui/__init__.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/worker.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/worker.py | 1661 | model_uid, model_type, gpu_idx # type: ignore | COMMENT |
| LOW | xinference/core/worker.py | 3821 | @no_type_check | COMMENT |
| LOW | xinference/core/metrics.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/event.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/progress_tracker.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/log.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/monitor_config_store.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/supervisor.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/virtual_env_manager.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/launch_strategy.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/resource.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/__init__.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/cache_tracker.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/autostart.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/model.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/utils.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/status_guard.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/exceptions.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/launch_history_store.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/otel.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_virtual_env_manager.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_model.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_continuous_batching.py | 1 | # Copyright 2022-2026 XProbe Inc. | COMMENT |
| LOW | xinference/core/tests/test_utils.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_launch_orphan_cleanup.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_metrics.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_restful_api.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_subpool_hardening.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/__init__.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_heartbeat.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_worker.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_progressor.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_launch_strategy.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_strip_test_envs.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_autostart.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_monitor_config_store.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_types.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| LOW | xinference/core/tests/test_types.py | 101 | # messages = [ | COMMENT |
| LOW | xinference/deploy/worker.py | 1 | # Copyright 2022-2026 Xinference Holdings Pte. Ltd | COMMENT |
| 422 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | versioneer.py | 1146 | CODE | |
| LOW | versioneer.py | 1385 | CODE | |
| LOW | versioneer.py | 1712 | CODE | |
| LOW | versioneer.py | 2160 | CODE | |
| LOW | benchmark/benchmark_runner.py | 88 | CODE | |
| LOW | benchmark/benchmark_runner.py | 206 | CODE | |
| LOW | xinference/_version.py | 151 | CODE | |
| LOW | xinference/_version.py | 602 | CODE | |
| LOW | xinference/constants.py | 114 | CODE | |
| LOW | xinference/utils.py | 42 | CODE | |
| LOW | xinference/device_utils.py | 273 | CODE | |
| LOW | xinference/device_utils.py | 385 | CODE | |
| LOW | xinference/device_utils.py | 635 | CODE | |
| LOW | xinference/core/worker.py | 214 | CODE | |
| LOW | xinference/core/worker.py | 244 | CODE | |
| LOW | xinference/core/worker.py | 287 | CODE | |
| LOW | xinference/core/worker.py | 321 | CODE | |
| LOW | xinference/core/worker.py | 515 | CODE | |
| LOW | xinference/core/worker.py | 624 | CODE | |
| LOW | xinference/core/worker.py | 897 | CODE | |
| LOW | xinference/core/worker.py | 1302 | CODE | |
| LOW | xinference/core/worker.py | 1572 | CODE | |
| LOW | xinference/core/worker.py | 1636 | CODE | |
| LOW | xinference/core/worker.py | 1803 | CODE | |
| LOW | xinference/core/worker.py | 1937 | CODE | |
| LOW | xinference/core/worker.py | 2258 | CODE | |
| LOW | xinference/core/worker.py | 2396 | CODE | |
| LOW | xinference/core/worker.py | 2514 | CODE | |
| LOW | xinference/core/worker.py | 2712 | CODE | |
| LOW | xinference/core/worker.py | 3209 | CODE | |
| LOW | xinference/core/worker.py | 3482 | CODE | |
| LOW | xinference/core/worker.py | 3694 | CODE | |
| LOW | xinference/core/metrics.py | 316 | CODE | |
| LOW | xinference/core/metrics.py | 613 | CODE | |
| LOW | xinference/core/monitor_config_store.py | 140 | CODE | |
| LOW | xinference/core/supervisor.py | 438 | CODE | |
| LOW | xinference/core/supervisor.py | 1157 | CODE | |
| LOW | xinference/core/supervisor.py | 1818 | CODE | |
| LOW | xinference/core/supervisor.py | 1914 | CODE | |
| LOW | xinference/core/supervisor.py | 2393 | CODE | |
| LOW | xinference/core/supervisor.py | 2654 | CODE | |
| LOW | xinference/core/supervisor.py | 2165 | CODE | |
| LOW | xinference/core/supervisor.py | 2468 | CODE | |
| LOW | xinference/core/virtual_env_manager.py | 228 | CODE | |
| LOW | xinference/core/virtual_env_manager.py | 285 | CODE | |
| LOW | xinference/core/virtual_env_manager.py | 475 | CODE | |
| LOW | xinference/core/launch_strategy.py | 57 | CODE | |
| LOW | xinference/core/cache_tracker.py | 51 | CODE | |
| LOW | xinference/core/cache_tracker.py | 79 | CODE | |
| LOW | xinference/core/cache_tracker.py | 111 | CODE | |
| LOW | xinference/core/cache_tracker.py | 133 | CODE | |
| LOW | xinference/core/cache_tracker.py | 147 | CODE | |
| LOW | xinference/core/model.py | 702 | CODE | |
| LOW | xinference/core/model.py | 750 | CODE | |
| LOW | xinference/core/utils.py | 225 | CODE | |
| LOW | xinference/core/utils.py | 342 | CODE | |
| LOW | xinference/core/tests/test_progressor.py | 25 | CODE | |
| LOW | xinference/deploy/cmdline.py | 485 | CODE | |
| LOW | xinference/deploy/cmdline.py | 903 | CODE | |
| LOW | xinference/deploy/cmdline.py | 1084 | CODE | |
| 393 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | xinference/device_utils.py | 29 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/device_utils.py | 31 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/device_utils.py | 48 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/device_utils.py | 50 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/device_utils.py | 268 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/device_utils.py | 270 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 90 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 92 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 175 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 177 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 449 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 451 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 558 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/device_utils.py | 560 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/metrics.py | 31 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | xinference/core/metrics.py | 33 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 52 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 54 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 96 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 98 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 164 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 166 | # =========================================================================== | COMMENT |
| MEDIUM | xinference/core/metrics.py | 193 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/metrics.py | 195 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/metrics.py | 219 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/metrics.py | 221 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/metrics.py | 235 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/metrics.py | 237 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/otel.py | 161 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/otel.py | 163 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/otel.py | 316 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/core/otel.py | 318 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 112 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 114 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 151 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 153 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 185 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 187 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 209 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 211 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 251 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 256 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 354 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 356 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 415 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 417 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 481 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_subpool_hardening.py | 483 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | xinference/deploy/docker/docker-compose.yml | 20 | # # ── OpenTelemetry (OTEL) ────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | …odel/llm/tool_parsers/tests/test_llama3_tool_parser.py | 12 | # ── Normal parsing (JSON format) ────────────────────────────────── | COMMENT |
| MEDIUM⚡ | …odel/llm/tool_parsers/tests/test_llama3_tool_parser.py | 65 | # ── Normal parsing (Python literal format) ──────────────────────── | COMMENT |
| MEDIUM⚡ | …odel/llm/tool_parsers/tests/test_llama3_tool_parser.py | 79 | # ── Security: RCE prevention ────────────────────────────────────── | COMMENT |
| MEDIUM | …odel/llm/tool_parsers/tests/test_llama3_tool_parser.py | 123 | # ── Edge cases: malformed input ─────────────────────────────────── | COMMENT |
| MEDIUM | …m/tool_parsers/tests/test_deepseek_v3_2_tool_parser.py | 296 | # ── Tests for plain (non-DSML) format ────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | xinference/model/llm/tests/test_utils.py | 2027 | # ── Security tests for Llama3ToolParser ──────────────────── | COMMENT |
| MEDIUM | …/sentence_transformers/tests/test_jina_task_mapping.py | 35 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …/sentence_transformers/tests/test_jina_task_mapping.py | 37 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …/sentence_transformers/tests/test_jina_task_mapping.py | 146 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | …/sentence_transformers/tests/test_jina_task_mapping.py | 148 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | xinference/api/utils.py | 31 | # --------------------------------------------------------------------------- | COMMENT |
| 6 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xinference/core/worker.py | 2712 | CODE | |
| LOW | xinference/core/worker.py | 3766 | CODE | |
| LOW | xinference/core/metrics.py | 679 | CODE | |
| LOW | xinference/core/supervisor.py | 1914 | CODE | |
| LOW | xinference/core/supervisor.py | 2393 | CODE | |
| LOW | xinference/core/supervisor.py | 3649 | CODE | |
| LOW | xinference/core/supervisor.py | 3665 | CODE | |
| LOW | xinference/deploy/utils.py | 217 | CODE | |
| LOW | xinference/model/llm/memory.py | 299 | CODE | |
| LOW | xinference/model/llm/lmdeploy/core.py | 306 | CODE | |
| LOW | xinference/model/llm/vllm/distributed_executor_v1.py | 100 | CODE | |
| LOW | …nference/model/embedding/sentence_transformers/core.py | 320 | CODE | |
| LOW | xinference/model/embedding/vllm/core.py | 280 | CODE | |
| LOW | xinference/model/image/core.py | 208 | CODE | |
| LOW | xinference/model/image/ocr/paddleocr_vl.py | 222 | CODE | |
| LOW | xinference/model/image/stable_diffusion/core.py | 88 | CODE | |
| LOW | xinference/model/rerank/sentence_transformers/core.py | 359 | CODE | |
| LOW | xinference/api/restful_api.py | 1799 | CODE | |
| LOW | xinference/api/restful_api.py | 1858 | CODE | |
| LOW | xinference/api/restful_api.py | 1956 | CODE | |
| LOW | xinference/api/restful_api.py | 440 | CODE | |
| LOW | xinference/api/routers/admin.py | 385 | CODE | |
| LOW | xinference/api/routers/admin.py | 836 | CODE | |
| LOW | xinference/client/restful/restful_client.py | 1180 | CODE | |
| LOW | xinference/client/restful/async_restful_client.py | 1294 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/dataset/dataset.py | 104 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/hifigan/generator.py | 397 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/transformer/decoder.py | 58 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/transformer/decoder.py | 276 | CODE | |
| LOW | …e/thirdparty/cosyvoice/transformer/upsample_encoder.py | 107 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/transformer/encoder.py | 39 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/transformer/encoder.py | 341 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/transformer/encoder.py | 390 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/utils/mask.py | 158 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/cli/model.py | 170 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/cli/model.py | 321 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/flow/decoder.py | 295 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/flow/flow.py | 25 | CODE | |
| LOW | xinference/thirdparty/cosyvoice/flow/flow.py | 152 | CODE | |
| LOW | xinference/thirdparty/deepseek_vl2/models/siglip_vit.py | 194 | CODE | |
| LOW | xinference/thirdparty/deepseek_vl2/models/siglip_vit.py | 249 | CODE | |
| LOW | …party/deepseek_vl2/models/processing_deepseek_vl_v2.py | 132 | CODE | |
| LOW | …ce/thirdparty/deepseek_vl2/models/modeling_deepseek.py | 264 | CODE | |
| LOW | …ce/thirdparty/deepseek_vl2/models/modeling_deepseek.py | 1472 | CODE | |
| LOW | …ce/thirdparty/deepseek_vl2/models/modeling_deepseek.py | 1657 | CODE | |
| LOW | …ce/thirdparty/deepseek_vl2/models/modeling_deepseek.py | 1878 | CODE | |
| LOW | …irdparty/deepseek_vl2/models/configuration_deepseek.py | 117 | CODE | |
| LOW | …rdparty/deepseek_vl2/models/modeling_deepseek_vl_v2.py | 134 | CODE | |
| LOW | …rdparty/deepseek_vl2/models/modeling_deepseek_vl_v2.py | 559 | CODE | |
| LOW | …rdparty/deepseek_vl2/models/modeling_deepseek_vl_v2.py | 642 | CODE | |
| LOW | xinference/thirdparty/audiotools/post.py | 90 | CODE | |
| LOW | xinference/thirdparty/audiotools/metrics/spectral.py | 41 | CODE | |
| LOW | xinference/thirdparty/audiotools/metrics/spectral.py | 124 | CODE | |
| LOW | xinference/thirdparty/audiotools/core/loudness.py | 100 | CODE | |
| LOW | xinference/thirdparty/audiotools/data/transforms.py | 755 | CODE | |
| LOW | xinference/thirdparty/audiotools/data/transforms.py | 892 | CODE | |
| LOW | xinference/thirdparty/audiotools/data/transforms.py | 1453 | CODE | |
| LOW | xinference/thirdparty/audiotools/data/transforms.py | 1565 | CODE | |
| LOW | xinference/thirdparty/audiotools/data/datasets.py | 358 | CODE | |
| LOW | …/thirdparty/fish_speech/tools/sensevoice/auto_model.py | 279 | CODE | |
| 170 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/benchmark_long.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/utils.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/benchmark_embedding.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/benchmark_runner.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/benchmark_latency.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/benchmark_rerank.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | benchmark/benchmark_serving.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | xinference/device_utils.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | xinference/core/metrics.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/metrics.py | 613 | def update_security_gauges(auth_service) -> None: | CODE |
| LOW | xinference/core/progress_tracker.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/monitor_config_store.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/virtual_env_manager.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/model.py | 53 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/utils.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/launch_history_store.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/core/otel.py | 44 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/deploy/worker.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/deploy/supervisor.py | 32 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/deploy/local.py | 36 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/deploy/utils.py | 44 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/custom.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/cache_manager.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/batch.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/utils.py | 61 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/video/core.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/video/diffusers.py | 39 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/video/tests/test_diffusers_video.py | 22 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/reasoning_parser.py | 12 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/custom.py | 24 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/cache_manager.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/llm_family.py | 43 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/core.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/utils.py | 59 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ence/model/llm/tool_parsers/deepseek_v4_tool_parser.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ence/model/llm/tool_parsers/deepseek_v3_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/tool_parsers/gemma_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | …nference/model/llm/tool_parsers/minimax_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/tool_parsers/glm5_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ce/model/llm/tool_parsers/deepseek_v3_1_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/tool_parsers/qwen_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ence/model/llm/tool_parsers/deepseek_r1_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/tool_parsers/glm4_tool_parser.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/tool_parsers/llama3_tool_parser.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ce/model/llm/tool_parsers/deepseek_v3_2_tool_parser.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/lmdeploy/core.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/distributed_executor_v1.py | 44 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/distributed_executor.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/core.py | 73 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/core.py | 267 | def _update_vllm_supported_lists() -> None: | CODE |
| LOW | xinference/model/llm/vllm/utils.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/collective.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/block_manager.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/transfer.py | 28 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/engine.py | 31 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/scheduler.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/block.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/xavier/collective_manager.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ce/model/llm/vllm/patches/hybrid_kv_cache_page_size.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | xinference/model/llm/vllm/patches/__init__.py | 15 | logger = logging.getLogger(__name__) | CODE |
| 116 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | versioneer.py | 491 | # This file is released into the public domain. | COMMENT |
| MEDIUM | xinference/_version.py | 7 | # This file is released into the public domain. | COMMENT |
| MEDIUM | xinference/core/virtual_env_manager.py | 467 | # This method is deprecated and no longer needed | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_restful_api.py | 1467 | # Create a mock handler with the conversion method | COMMENT |
| MEDIUM⚡ | xinference/core/tests/test_restful_api.py | 1474 | # Create a temporary RESTfulAPI instance to access the method | COMMENT |
| MEDIUM⚡ | xinference/deploy/test/test_log_rotation.py | 211 | # Create a file dated 100 days ago | COMMENT |
| MEDIUM | xinference/model/utils.py | 1975 | # Create a mapping of updated_at to model for comparison | COMMENT |
| MEDIUM | xinference/model/utils.py | 2044 | # Create a copy of built-in models for merging | COMMENT |
| MEDIUM | xinference/model/llm/__init__.py | 294 | # Create a copy of built-in models for merging | COMMENT |
| MEDIUM | xinference/model/llm/vllm/distributed_executor_v1.py | 157 | # Create the parallel GPU workers. | COMMENT |
| MEDIUM | xinference/model/llm/vllm/distributed_executor.py | 146 | # Create the parallel GPU workers. | COMMENT |
| MEDIUM | xinference/model/llm/transformers/chatglm.py | 126 | # This method is adapted from https://github.com/THUDM/GLM-4/blob/main/basic_demo/openai_api_server.py | COMMENT |
| MEDIUM⚡ | xinference/model/llm/transformers/core.py | 64 | # Define the decorator to support multiple names registration | COMMENT |
| MEDIUM⚡ | …erence/model/llm/transformers/tests/test_tensorizer.py | 100 | # Create a dummy cache file to simulate cache existence | COMMENT |
| MEDIUM | …ence/model/embedding/vllm/tests/test_vllm_embedding.py | 104 | # Create a long text that exceeds 512 tokens | COMMENT |
| MEDIUM | xinference/model/rerank/sentence_transformers/core.py | 230 | # Create a simple wrapper for return value conversion only | COMMENT |
| MEDIUM | xinference/thirdparty/audiotools/ml/accelerator.py | 14 | """This class is used to prepare models and dataloaders for | STRING |
| MEDIUM | xinference/thirdparty/fish_speech/tools/run_webui.py | 73 | # Create the inference engine | COMMENT |
| MEDIUM | …rence/thirdparty/fish_speech/tools/vqgan/extract_vq.py | 24 | # This file is used to convert the audio files to text files using the Whisper model. | COMMENT |
| MEDIUM | …fish_speech/tools/server/agent/pre_generation_utils.py | 39 | # Create a conversation object and encode it for inference | COMMENT |
| MEDIUM | …fish_speech/tools/inference_engine/reference_loader.py | 29 | # Define the torchaudio backend | COMMENT |
| MEDIUM | …rdparty/fish_speech/tools/inference_engine/__init__.py | 166 | # Create a queue to get the response | COMMENT |
| MEDIUM | …erence/thirdparty/fish_speech/fish_speech/i18n/scan.py | 55 | # Define the standard file name | COMMENT |
| MEDIUM | …erence/thirdparty/fish_speech/fish_speech/i18n/scan.py | 78 | # Define the standard file name | COMMENT |
| MEDIUM | xinference/thirdparty/melo/text/japanese.py | 540 | # Initialize kakasi object | COMMENT |
| MEDIUM | xinference/thirdparty/melo/text/japanese.py | 636 | # # Initialize kakasi object | COMMENT |
| MEDIUM | xinference/thirdparty/melo/text/korean.py | 181 | # # Initialize kakasi object | COMMENT |
| MEDIUM | xinference/thirdparty/f5_tts/infer/utils_infer.py | 509 | # Create a combined spectrogram | COMMENT |
| MEDIUM | xinference/thirdparty/deepseek_vl/serve/app_deepseek.py | 96 | # Create a copy of the conversation to avoid history truncation in the UI | COMMENT |
| MEDIUM⚡ | xinference/thirdparty/megatts3/tts/infer_cli.py | 49 | # Define the output path with a .wav extension | COMMENT |
| MEDIUM⚡ | …erence/thirdparty/megatts3/tts/utils/audio_utils/io.py | 63 | # Define the output path with a .wav extension | COMMENT |
| MEDIUM | xinference/thirdparty/mlx/flux/flux.py | 142 | # Create the latent variables | COMMENT |
| MEDIUM | xinference/thirdparty/matcha/onnx/export.py | 164 | # Create the output directory (if not exists) | COMMENT |
| MEDIUM | xinference/thirdparty/indextts/infer_v2.py | 926 | # Create a temporary file for the complete audio | COMMENT |
| MEDIUM | …irdparty/indextts/gpt/transformers_generation_utils.py | 496 | # Create the causal mask with fixed shape in advance, to reduce recompilations. If the function to create | COMMENT |
| MEDIUM | xinference/thirdparty/indextts/BigVGAN/ECAPA_TDNN.py | 246 | """This class implements an attentive statistic pooling layer for each channel. | STRING |
| MEDIUM | xinference/thirdparty/indextts/BigVGAN/ECAPA_TDNN.py | 585 | """This class implements the cosine similarity on the top of features. | STRING |
| MEDIUM | xinference/thirdparty/indextts/BigVGAN/nnet/CNN.py | 24 | """This function implements SincConv (SincNet). | STRING |
| MEDIUM | xinference/thirdparty/indextts/BigVGAN/nnet/CNN.py | 306 | """This function implements 1d convolution. | STRING |
| MEDIUM | …/utils/maskgct/models/codec/facodec/facodec_trainer.py | 521 | # Create the normalized F0 sequence with unvoiced frames | COMMENT |
| MEDIUM | xinference/thirdparty/indextts/s2mel/modules/commons.py | 380 | # Create the normalized F0 sequence with unvoiced frames | COMMENT |
| MEDIUM | doc/source/gen_docs.py | 67 | # Create a proper ModuleSpec that importlib.util.find_spec can find | COMMENT |
| MEDIUM | doc/source/norm_zh.py | 15 | # This file is derived from https://github.com/mars-project/mars/blob/master/docs/source/norm_zh.py | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | xinference/utils.py | 87 | Recursively convert an object into a hashable form. This function is useful for creating deterministic cache k | STRING |
| HIGH | xinference/deploy/utils.py | 996 | Convert CLI string arguments to appropriate Python types. Handles type conversion for Click command arguments with | STRING |
| HIGH | …ence/model/llm/tool_parsers/deepseek_v4_tool_parser.py | 95 | Extract tool calls from complete model output. Args: model_output: The complete output str | STRING |
| HIGH | …ce/model/llm/tool_parsers/deepseek_v3_2_tool_parser.py | 95 | Extract tool calls from complete model output. Args: model_output: The complete output str | STRING |
| HIGH | xinference/model/embedding/core.py | 352 | Extract the 'sentences' argument and remaining kwargs from (*args, **kwargs) for a given function. | STRING |
| HIGH | xinference/model/rerank/sentence_transformers/core.py | 640 | Extract the 'documents' and 'query' argument and remaining kwargs from (*args, **kwargs) for a given fu | STRING |
| HIGH | xinference/model/rerank/vllm/core.py | 303 | Extract the 'documents' and 'query' argument and remaining kwargs from (*args, **kwargs) for a given fu | STRING |
| HIGH | xinference/api/utils.py | 93 | Get a model with standardized error handling. Replaces the repeated pattern: ```python try: mo | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 18 | def subsequent_mask( size: int, device: torch.device = torch.device("cpu"), ) -> torch.Tensor: """C | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 57 | Create mask for subsequent steps (size, size). This mask is used only in decoder which works in an auto-regressive | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 95 | Create mask for subsequent steps (size, size) with chunk size, this is for streaming encoder Args: s | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 133 | Create mask for subsequent steps (size, size) with chunk size, this is for streaming encoder Args: s | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/mask.py | 240 | Make mask tensor containing indices of padded part. See description of make_non_pad_mask. Args: length | STRING |
| HIGH | xinference/thirdparty/cosyvoice/utils/common.py | 30 | Perform padding for the list of tensors. Args: xs (List): List of Tensors [(T_1, `*`), (T_2, `*`), ..., (T_ | STRING |
| HIGH | xinference/thirdparty/cosyvoice/flow/decoder.py | 211 | Forward pass of the UNet1DConditional model. Args: x (torch.Tensor): shape (batch_size, in_channels | STRING |
| HIGH | xinference/thirdparty/cosyvoice/flow/decoder.py | 406 | Forward pass of the UNet1DConditional model. Args: x (torch.Tensor): shape (batch_size, in_channels | STRING |
| HIGH | …party/megatts3/tts/modules/ar_dur/commons/seq_utils.py | 113 | Make mask tensor containing indices of padded part. Args: lengths (LongTensor or List): Batch of lengths (B, | STRING |
| HIGH | …party/megatts3/tts/modules/ar_dur/commons/seq_utils.py | 219 | Make mask tensor containing indices of non-padded part. Args: lengths (LongTensor or List): Batch of lengths | STRING |
| HIGH | …ference/thirdparty/matcha/models/components/decoder.py | 364 | Forward pass of the UNet1DConditional model. Args: x (torch.Tensor): shape (batch_size, in_channels | STRING |
| HIGH | xinference/thirdparty/indextts/utils/common.py | 85 | Make mask tensor containing indices of padded part. See description of make_non_pad_mask. Args: length | STRING |
| HIGH | xinference/thirdparty/indextts/utils/utils.py | 54 | Make mask tensor containing indices of padded part. See description of make_non_pad_mask. Args: length | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | benchmark/benchmark_runner.py | 142 | # "finish_reason": null, | COMMENT |
| HIGH⚡ | xinference/deploy/test/test_utils.py | 113 | arg = '{"int_val": 10, "float_val": 1.5, "bool_val": false, "null_val": null}' | CODE |
| HIGH | xinference/deploy/test/test_utils.py | 219 | result = handle_click_args_type('[1, "two", null, true, {"key": "value"}]') | CODE |
| HIGH | xinference/model/llm/tool_parsers/llama3_tool_parser.py | 53 | # (e.g., True/False/None instead of true/false/null). | COMMENT |
| HIGH⚡ | …odel/llm/tool_parsers/tests/test_llama3_tool_parser.py | 41 | model_output = '{"name": "test_func", "parameters": {"value": null}}' | CODE |
| HIGH | xinference/model/llm/tests/test_utils.py | 2116 | "arguments": None, # null, left as-is | CODE |
| HIGH | xinference/model/llm/tests/test_utils.py | 2134 | "arguments": "null", # valid JSON null, left as-is | CODE |
| HIGH | xinference/api/restful_api.py | 608 | "npm ci && npm run build" (this stages the export at the directory | CODE |
| HIGH | …nference/api/tests/test_frontend_static_real_export.py | 18 | (``cd frontend && npm run build``) and runs this module against | STRING |
| HIGH | xinference/thirdparty/audiotools/preference.py | 179 | if (region != null) { | CODE |
| HIGH | …ference/thirdparty/fish_speech/tools/webui/__init__.py | 18 | js="() => {const params = new URLSearchParams(window.location.search);if (!params.has('__theme')) {params.se | CODE |
| HIGH | …odels/codec/speechtokenizer/modules/quantization/ac.py | 138 | self.packer.push(b1) | CODE |
| HIGH | …odels/codec/speechtokenizer/modules/quantization/ac.py | 185 | self.packer.push(b1) | CODE |
| HIGH | …odels/codec/speechtokenizer/modules/quantization/ac.py | 304 | encoder.push(symbol, q_cdf) | CODE |
| HIGH | …nce/thirdparty/indextts/s2mel/modules/flow_matching.py | 88 | # Stack original and CFG (null) inputs for batched processing | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xinference/core/worker.py | 2565 | # Check if packages contain PyTorch system markers (#system_torch#, etc.) | COMMENT |
| LOW | xinference/core/worker.py | 2841 | # Check if cancelled while waiting in queue | COMMENT |
| LOW | xinference/model/utils.py | 1843 | # Check if flash_attn is installed | COMMENT |
| LOW | xinference/model/utils.py | 1851 | # Check if CUDA is available | COMMENT |
| LOW | xinference/model/llm/reasoning_parser.py | 55 | # Check if <think> is present in previous or delta. | COMMENT |
| LOW | xinference/model/llm/llm_family.py | 387 | # Append the class to the list of transformer classes | COMMENT |
| LOW | xinference/model/llm/harmony.py | 60 | # Check if buffer ends with partial 'assistantfinal' | COMMENT |
| LOW | xinference/model/llm/harmony.py | 76 | # Check if this is actually a new message starting with 'analysis' | COMMENT |
| LOW | xinference/model/llm/harmony.py | 102 | # Check if buffer ends with partial 'assistantfinal' | COMMENT |
| LOW | xinference/model/llm/tool_parsers/qwen_tool_parser.py | 329 | # Check if current output contains tool_call start token | COMMENT |
| LOW | …ence/model/llm/tool_parsers/deepseek_r1_tool_parser.py | 86 | # Check if this block is a tool call | COMMENT |
| LOW | xinference/model/llm/tests/test_llm_model.py | 311 | # Check if tool_calls is present and is a list | COMMENT |
| LOW | xinference/model/llm/tests/test_llm_model.py | 325 | # Check if arguments is a valid JSON string | COMMENT |
| LOW | xinference/model/llm/vllm/xavier/engine.py | 125 | # Check if we have a cached last_output from the previous iteration. | COMMENT |
| LOW | …ce/model/llm/vllm/patches/hybrid_kv_cache_page_size.py | 107 | # Check if the original problematic code exists | COMMENT |
| LOW | …ce/model/llm/vllm/patches/hybrid_kv_cache_page_size.py | 119 | # Check if all smaller pages divide max evenly | COMMENT |
| LOW | xinference/model/llm/transformers/core.py | 469 | # Check if streaming | COMMENT |
| LOW | xinference/model/llm/transformers/core.py | 1055 | # Check if streaming | COMMENT |
| LOW⚡ | …erence/model/llm/transformers/tests/test_tensorizer.py | 118 | # Check if the logger.info was called with the expected message, indicating early return due to cache existence | COMMENT |
| LOW | xinference/model/llm/mlx/core.py | 127 | # Check if next_generated method exists (new API) | COMMENT |
| LOW | xinference/model/llm/mlx/core.py | 274 | # Check if there are any pending results (early results that arrived before queue was ready) | COMMENT |
| LOW | xinference/model/llm/mlx/core.py | 322 | # Check if generation is finished | COMMENT |
| LOW | xinference/model/llm/mlx/core.py | 343 | # Check if request is still in active set | COMMENT |
| LOW | xinference/model/llm/mlx/core.py | 1534 | # Check if processor supports audio to avoid feature_extractor errors | COMMENT |
| LOW | xinference/model/embedding/core.py | 215 | # Check if sentences is a two-dimensional list of integers | COMMENT |
| LOW | xinference/model/image/stable_diffusion/core.py | 875 | # Check if we have a cancel callback for this request | COMMENT |
| LOW | xinference/api/restful_api.py | 1352 | # Check if iterator is actually an async iterator | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/run_webui.py | 48 | # Check if MPS or CUDA is available | COMMENT |
| LOW | …e/thirdparty/fish_speech/tools/server/model_manager.py | 37 | # Check if MPS or CUDA is available | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/server/views.py | 159 | # Check if the text is too long | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/server/views.py | 166 | # Check if streaming is enabled | COMMENT |
| LOW | …/thirdparty/fish_speech/tools/server/agent/generate.py | 64 | # Check if all samples are finished | COMMENT |
| LOW | …rty/fish_speech/tools/server/agent/generation_utils.py | 102 | # Check if the token is semantic | COMMENT |
| LOW | xinference/thirdparty/f5_tts/socket_server.py | 85 | # Check if it's the final chunk | COMMENT |
| LOW | xinference/thirdparty/f5_tts/train/finetune_gradio.py | 417 | # Check if a training process is already running | COMMENT |
| LOW | xinference/thirdparty/f5_tts/infer/infer_gradio.py | 504 | # Check if all speech types in text are available | STRING |
| LOW⚡ | xinference/thirdparty/megatts3/tts/infer_cli.py | 42 | # Check if the file exists | COMMENT |
| LOW⚡ | xinference/thirdparty/megatts3/tts/infer_cli.py | 47 | # Check if the file already has a .wav extension | COMMENT |
| LOW⚡ | …erence/thirdparty/megatts3/tts/utils/audio_utils/io.py | 56 | # Check if the file exists | COMMENT |
| LOW⚡ | …erence/thirdparty/megatts3/tts/utils/audio_utils/io.py | 61 | # Check if the file already has a .wav extension | COMMENT |
| LOW | xinference/thirdparty/indextts/infer_v2.py | 110 | # Check if it's a HuggingFace cache structure with snapshots | COMMENT |
| LOW | xinference/thirdparty/indextts/gpt/perceiver.py | 87 | # Check if mask exists and expand to compatible shape | COMMENT |
| LOW | xinference/thirdparty/indextts/gpt/perceiver.py | 94 | # Check if there is a compatible device for flash attention | COMMENT |
| LOW | …ce/thirdparty/indextts/gpt/transformers_beam_search.py | 307 | # Check if we are done so that we can save a pad step if all(done) | STRING |
| LOW | …ce/thirdparty/indextts/gpt/transformers_beam_search.py | 659 | # Check if we are done so that we can save a pad step if all(done) | STRING |
| LOW | …thirdparty/indextts/gpt/transformers_modeling_utils.py | 2477 | # Check if the covariance is positive definite. | COMMENT |
| LOW | …thirdparty/indextts/gpt/transformers_modeling_utils.py | 4060 | # Check if `_keep_in_fp32_modules` is not None | STRING |
| LOW | …ty/indextts/BigVGAN/alias_free_activation/cuda/load.py | 49 | # Check if cuda 11 is installed for compute capability 8.0 | COMMENT |
| LOW | …mel/modules/bigvgan/alias_free_activation/cuda/load.py | 18 | # Check if cuda 11 is installed for compute capability 8.0 | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | xinference/core/tests/test_model.py | 250 | # rerank/embedding model must run del + empty_cache so its VRAM is | COMMENT |
| MEDIUM | xinference/core/tests/test_worker.py | 926 | # test terminate LLM model, then launch embedding model | COMMENT |
| MEDIUM⚡ | xinference/model/embedding/embed_family.py | 113 | # { embedding model name -> { engine name -> engine params } } | COMMENT |
| MEDIUM | xinference/model/embedding/core.py | 90 | # this class define the basic info of embedding model | COMMENT |
| MEDIUM | …nference/model/embedding/sentence_transformers/core.py | 509 | # seems already support prompt in embedding model | COMMENT |
| MEDIUM⚡ | xinference/api/restful_api.py | 499 | # Attach API instance for dependency injection (Depends(get_api), etc.) | COMMENT |
| MEDIUM | xinference/api/schemas/requests.py | 33 | # <0 = cap at the model's max_tokens. Honored by the embedding model base | COMMENT |
| MEDIUM | …ference/thirdparty/deepseek_vl2/models/conversation.py | 33 | # The number of few shot examples | COMMENT |
| MEDIUM | xinference/thirdparty/deepseek_vl/utils/conversation.py | 65 | # The number of few shot examples | COMMENT |
| MEDIUM | xinference/thirdparty/internvl/conversation.py | 50 | # The number of few shot examples | COMMENT |
| MEDIUM | xinference/thirdparty/whisper/transcribe.py | 402 | # skip silence before possible hallucinations | COMMENT |
| MEDIUM⚡ | xinference/thirdparty/whisper/transcribe.py | 414 | # if first segment might be a hallucination, skip leading silence | COMMENT |
| MEDIUM⚡ | xinference/thirdparty/whisper/transcribe.py | 422 | # skip silence before any possible hallucination that is surrounded | COMMENT |
| MEDIUM⚡ | xinference/thirdparty/whisper/transcribe.py | 423 | # by silence or more hallucinations | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | versioneer.py | 510 | # each be defined on a line of their own. _version.py will just call | COMMENT |
| LOW | xinference/_version.py | 26 | # each be defined on a line of their own. _version.py will just call | COMMENT |
| LOW | xinference/core/supervisor.py | 2591 | # Not launched perhaps, just return 0.0 to prevent error | COMMENT |
| LOW | xinference/model/utils.py | 1969 | # New model from user, just add it | COMMENT |
| LOW⚡ | xinference/model/llm/llm_family.py | 613 | # TODO: If user does not specify quantization, just use the first one | COMMENT |
| MEDIUM | xinference/model/llm/core.py | 245 | # Use model_specs from huggingface, as HuggingFace is the most comprehensive. | COMMENT |
| LOW⚡ | xinference/model/embedding/embed_family.py | 103 | # TODO: If user does not specify quantization, just use the first one | COMMENT |
| LOW | xinference/model/rerank/rerank_family.py | 102 | # TODO: If user does not specify quantization, just use the first one | COMMENT |
| LOW | …erence/thirdparty/cosyvoice/transformer/convolution.py | 124 | # It's better we just return None if no cache is required, | COMMENT |
| MEDIUM | xinference/thirdparty/cosyvoice/utils/executor.py | 45 | # A context manager to be used in conjunction with an instance of | COMMENT |
| MEDIUM | xinference/thirdparty/cosyvoice/utils/executor.py | 97 | # A context manager to be used in conjunction with an instance of | COMMENT |
| LOW | xinference/thirdparty/f5_tts/model/cfm.py | 136 | duration = torch.maximum(lens + 1, duration) # just add one token so something is generated | CODE |
| LOW | xinference/thirdparty/f5_tts/model/dataset.py | 214 | # if want to have different batches between epochs, may just set a seed and log it in ckpt | COMMENT |
| MEDIUM | xinference/thirdparty/f5_tts/infer/speech_edit.py | 54 | # [leverage https://github.com/MahmoudAshraf97/ctc-forced-aligner to get char level alignment] | COMMENT |
| MEDIUM | …irdparty/indextts/gpt/transformers_generation_utils.py | 437 | # (this alternative is not as robust as calling `generate` and letting it create `cache_position`) | COMMENT |
| MEDIUM | …irdparty/indextts/gpt/transformers_generation_utils.py | 713 | # 1. Check whether the user has defined `decoder_input_ids` manually. To facilitate in terms of input naming, | COMMENT |
| LOW | …ce/thirdparty/indextts/gpt/transformers_beam_search.py | 854 | # generation. In these cases we simply return the highest scoring outputs. | STRING |
| LOW | …thirdparty/indextts/gpt/transformers_modeling_utils.py | 5402 | # We can probably just use the multi-head attention module of PyTorch >=1.1.0 | STRING |
| LOW | xinference/thirdparty/indextts/gpt/conformer_encoder.py | 146 | # It's better we just return None if no cache is required, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …tts/BigVGAN/alias_free_activation/cuda/activation1d.py | 31 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 149 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 150 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 151 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 153 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 154 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 155 | CODE | |
| MEDIUM | …nce/thirdparty/indextts/s2mel/modules/openvoice/api.py | 168 | CODE | |
| MEDIUM | …les/bigvgan/alias_free_activation/cuda/activation1d.py | 32 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …m/tool_parsers/tests/test_deepseek_v3_1_tool_parser.py | 281 | # Step 1: Part 1 of end token | COMMENT |
| LOW⚡ | …m/tool_parsers/tests/test_deepseek_v3_1_tool_parser.py | 288 | # Step 2: Part 2 of end token | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1016 | # Step 1: Get the initial response with stream=True | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1034 | # Step 2: Get the final response after tool calls with stream=True | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1052 | # Step 3: Get the initial response with stream=False | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1069 | # Step 4: Get the final response after tool calls with stream=False | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 106 | # Step 1: Encode audio using VQGAN | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 135 | # Step 2: Prepare LLM request | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 182 | # Step 3: Stream LLM response and decode audio | COMMENT |
| LOW | …irdparty/indextts/gpt/transformers_generation_utils.py | 3615 | # IMPORTANT: Note that this should appear BEFORE the call to _reorder_cache() to save the maximum memory | STRING |
| LOW | …irdparty/indextts/gpt/transformers_generation_utils.py | 3908 | # IMPORTANT: Note that this should appear BEFORE the call to _reorder_cache() to save the maximum memory | STRING |
| LOW | …irdparty/indextts/gpt/transformers_generation_utils.py | 4146 | # IMPORTANT: Note that this should appear BEFORE the call to _reorder_cache() to save the maximum memory | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …m/tool_parsers/tests/test_deepseek_v3_1_tool_parser.py | 281 | # Step 1: Part 1 of end token | COMMENT |
| LOW⚡ | …m/tool_parsers/tests/test_deepseek_v3_1_tool_parser.py | 288 | # Step 2: Part 2 of end token | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1016 | # Step 1: Get the initial response with stream=True | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1034 | # Step 2: Get the final response after tool calls with stream=True | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1052 | # Step 3: Get the initial response with stream=False | COMMENT |
| LOW | xinference/model/llm/tests/test_stream_options.py | 1069 | # Step 4: Get the final response after tool calls with stream=False | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 106 | # Step 1: Encode audio using VQGAN | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 135 | # Step 2: Prepare LLM request | COMMENT |
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 182 | # Step 3: Stream LLM response and decode audio | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | xinference/thirdparty/audiotools/core/util.py | 475 | batch[k] = torch.utils.data._utils.collate.default_collate(v) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | xinference/thirdparty/melo/text/chinese.py | 73 | assert len(word2ph) == len(text) # Sometimes it will crash,you can add a try-catch. | CODE |
| MEDIUM | xinference/thirdparty/melo/text/chinese_mix.py | 80 | # assert len(word2ph) == len(text) # Sometimes it will crash,you can add a try-catch. | COMMENT |
| MEDIUM | …nce/thirdparty/f5_tts/train/datasets/prepare_emilia.py | 2 | # if use updated new version, i.e. WebDataset, feel free to modify / draft your own script | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | xinference/thirdparty/fish_speech/tools/api_client.py | 176 | "authorization": "Bearer YOUR_API_KEY", | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | doc/source/norm_zh.py | 62 | ... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " | CODE |
| LOW⚡ | doc/source/norm_zh.py | 62 | ... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, " | CODE |
| LOW⚡ | doc/source/norm_zh.py | 66 | " \"Lorem ipsum dolor sit " | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | xinference/thirdparty/fish_speech/tools/fish_e2e.py | 263 | # Example usage: | COMMENT |
| LOW | …party/matcha/utils/get_durations_from_trained_model.py | 192 | # Example usage: | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …ce/thirdparty/fish_speech/tools/llama/build_dataset.py | 65 | def run_task(task): | CODE |