LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
This report presents the forensic synthetic code analysis of InternLM/lmdeploy, a Python project with 7,953 GitHub stars. SynthScan v2.0 examined 229,426 lines of code across 1292 source files, recording 3095 pattern matches distributed across 21 syntactic categories. The overall adjusted score of 18.3 places this repository in the Moderate AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 3095 distinct pattern matches across 21 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/benchmark_chat_completion.py | 175 | def _dataset_longest_prefix_match(dataset: str, selected: Sequence[str]) -> str | None: | CODE |
| LOW | benchmark/benchmark_chat_completion.py | 360 | def _cached_tokens_from_usage(usage: dict[str, Any] | None) -> int: | CODE |
| LOW | benchmark/profile_restful_api.py | 159 | async def async_request_openai_completions( | CODE |
| LOW | benchmark/profile_restful_api.py | 237 | async def async_request_openai_chat_completions( | CODE |
| LOW | benchmark/profile_restful_api.py | 345 | async def async_request_sglang_generate( | CODE |
| LOW | benchmark/profile_restful_api.py | 847 | def _gen_random_image_data_uri(width: int = width, height: int = height) -> tuple[Image.Image, str, int]: | CODE |
| LOW | lmdeploy/tokenizer.py | 70 | def _check_transformers_version(self, model_dir: str, trust_remote_code: bool = False): | CODE |
| LOW | lmdeploy/tokenizer.py | 234 | def _convert_tokens_to_string_with_added_encoders( | CODE |
| LOW | lmdeploy/utils.py | 638 | def init_custom_process_group(backend=None, | CODE |
| LOW | lmdeploy/messages.py | 154 | def convert_stop_bad_words_to_ids(self, tokenizer: Tokenizer): | CODE |
| LOW | lmdeploy/metrics/metrics_processor.py | 101 | def increase_succeeded_requests(self): | CODE |
| LOW | lmdeploy/metrics/metrics_processor.py | 114 | def increase_api_routed_requests(self): | CODE |
| LOW | lmdeploy/metrics/metrics_processor.py | 118 | def decrease_api_routed_requests(self): | CODE |
| LOW | lmdeploy/metrics/stats.py | 90 | def update_from_schedule_metrics(self, scheduled_metrics: ScheduleMetrics): | CODE |
| LOW | lmdeploy/lite/apis/calibrate.py | 184 | def make_compatible_internvl_config(model_path): | CODE |
| LOW | lmdeploy/lite/apis/calibrate.py | 194 | def _get_non_default_generation_parameters(self): | CODE |
| LOW | lmdeploy/lite/utils/calib_dataloader.py | 250 | def get_neuralmagic_calibration(dataset, tokenizer, nsamples, seed, seqlen): | CODE |
| LOW | lmdeploy/lite/utils/memory_efficient.py | 45 | def find_modules_by_return_value(model: nn.Module, value: str) -> list[nn.Module]: | CODE |
| LOW | lmdeploy/lite/utils/memory_efficient.py | 197 | def memory_efficient_inference(model: nn.Module, offload: bool = True, device: str = 'cuda') -> None: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 20 | def cal_qparams_per_channel_absmax(w: torch.Tensor, n_bits: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 36 | def cal_qparams_per_channel_minmax(w: torch.Tensor, n_bits: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 58 | def cal_qparams_per_group_absmax(w: torch.Tensor, n_bits: int, group_size: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 79 | def cal_qparams_per_group_minmax(w: torch.Tensor, n_bits: int, group_size: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 105 | def cal_qparams_per_tensor_minmax(w: torch.Tensor, n_bits: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/cal_qparams.py | 125 | def cal_qparams_per_tensor_absmax(w: torch.Tensor, n_bits: int, return_stats: bool = False) -> QParams: | CODE |
| LOW | lmdeploy/lite/utils/batch_split.py | 7 | def split_decoder_layer_inputs(batch_size, *args: torch.Tensor | Any, | CODE |
| LOW | lmdeploy/lite/utils/batch_split.py | 64 | def concat_decoder_layer_outputs(batch_outputs: list[Any]) -> Any: | CODE |
| LOW | lmdeploy/lite/quantization/calibration.py | 407 | def _wrap_decoder_layers_for_search(self): | CODE |
| LOW | lmdeploy/cli/utils.py | 502 | def allow_terminate_by_client(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 589 | def prefix_cache_state_budget(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 600 | def prefix_cache_decode_state_interval(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 644 | def cudagraph_capture_batch_sizes(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 773 | def dllm_confidence_threshold(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 781 | def enable_return_routed_experts(parser): | CODE |
| LOW | lmdeploy/cli/utils.py | 811 | def distributed_executor_backend(parser): | CODE |
| LOW | lmdeploy/vl/engine.py | 15 | def _get_hf_config_mm_feature_dtype(hf_config) -> torch.dtype | None: | CODE |
| LOW | lmdeploy/vl/engine.py | 44 | def _resolve_mm_feature_dtype(hf_config, backend_config) -> torch.dtype | None: | CODE |
| LOW | lmdeploy/vl/engine.py | 63 | def _raise_exception_on_finish(task: asyncio.Task) -> None: | CODE |
| LOW | lmdeploy/vl/model/internvl.py | 22 | def find_closest_aspect_ratio(aspect_ratio, target_ratios, width, height, image_size): | CODE |
| LOW | lmdeploy/vl/model/preprocess_utils.py | 77 | def _expand_bundled_image_items(item: dict, token_id: int) -> list[dict]: | CODE |
| LOW | lmdeploy/vl/model/preprocess_utils.py | 107 | def _expand_bundled_video_items(item: dict, token_id: int) -> list[dict]: | CODE |
| LOW | lmdeploy/vl/model/preprocess_utils.py | 189 | def _expand_bundled_audio_items(item: dict, token_id: int) -> list[dict]: | CODE |
| LOW | lmdeploy/vl/model/llava.py | 30 | def _clip_vision_tower_load_model(self, **kwargs): | CODE |
| LOW | lmdeploy/vl/model/utils.py | 11 | def disable_transformers_logging(): | CODE |
| LOW | lmdeploy/vl/model/deepseek.py | 14 | def check_deepseek_vl_install(): | CODE |
| LOW | lmdeploy/vl/model/qwen2.py | 8 | def check_qwen_vl_deps_install(): | CODE |
| LOW | lmdeploy/vl/model/base.py | 384 | def to_pytorch_with_input_ids(self, messages): | CODE |
| LOW | lmdeploy/vl/media/video.py | 46 | def _get_video_loader_backend(self) -> VideoLoader: | CODE |
| LOW | lmdeploy/turbomind/tokenizer_info.py | 119 | def _is_sentencepiece_tokenizer(tokenizer: PreTrainedTokenizerBase) -> bool: | STRING |
| LOW | lmdeploy/turbomind/converter.py | 95 | def _validate_quant_group_size(model_format: str | None, group_size: int | None) -> int | None: | CODE |
| LOW | lmdeploy/turbomind/turbomind.py | 40 | def _construct_stop_or_bad_words(words: list[int] = None): | CODE |
| LOW | lmdeploy/turbomind/turbomind.py | 591 | def _get_extra_output_processors(self, outputs: dict[str, torch.Tensor], gen_config: GenerationConfig, | CODE |
| LOW | lmdeploy/serve/parsers/_openai_harmony.py | 71 | def _convert_response_format_to_harmony(self): | CODE |
| LOW | lmdeploy/serve/parsers/response_parser.py | 54 | def _parse_tool_call_arguments_dict(arguments: Any) -> dict[str, Any] | None: | CODE |
| LOW | lmdeploy/serve/parsers/response_parser.py | 77 | def _normalize_request_messages(messages: list[dict]) -> list[dict] | None: | CODE |
| LOW | lmdeploy/serve/parsers/response_parser.py | 261 | def chat_template_kwargs_from_request(cls, request: ChatCompletionRequest) -> dict: | CODE |
| LOW | lmdeploy/serve/parsers/response_parser.py | 719 | def _longest_open_tag_prefix_suffix(text: str, tags: list[str]) -> int: | CODE |
| LOW | lmdeploy/serve/parsers/tool_parser/tool_parser.py | 116 | def _decode_tool_incremental_json(self, added_text: str, *, final: bool) -> list[DeltaToolCall]: | CODE |
| LOW | lmdeploy/serve/parsers/tool_parser/tool_parser.py | 172 | def _parse_tool_call_complete_json(payload: str) -> ToolCall | None: | CODE |
| LOW | …oy/serve/parsers/tool_parser/qwen3coder_tool_parser.py | 60 | def _extract_incremental_state(self, | CODE |
| 1334 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | lmdeploy/turbomind/linear.py | 29 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 31 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 67 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 69 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 104 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 106 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 221 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/linear.py | 223 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 42 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 44 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 83 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 85 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 172 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 174 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 426 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/weight_format.py | 428 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 10 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 12 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 26 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 28 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 45 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 47 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 116 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 118 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 192 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 194 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 210 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 212 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 223 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 225 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 320 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 322 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 335 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 337 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 387 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/_base.py | 389 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/attention.py | 17 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/attention.py | 19 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/attention.py | 79 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/attention.py | 81 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | lmdeploy/turbomind/builders/ffn.py | 23 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | lmdeploy/turbomind/builders/ffn.py | 25 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | lmdeploy/turbomind/builders/ffn.py | 47 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | lmdeploy/turbomind/builders/ffn.py | 49 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/ffn.py | 139 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/ffn.py | 141 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/ffn.py | 168 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/ffn.py | 170 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/deltanet.py | 63 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/deltanet.py | 65 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/moe.py | 6 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/moe.py | 8 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/mla.py | 9 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/mla.py | 11 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/mla.py | 62 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/builders/mla.py | 64 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | lmdeploy/turbomind/models/internlm2.py | 66 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/models/internlm2.py | 68 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/models/internlm2.py | 86 | # ------------------------------------------------------------------ | COMMENT |
| MEDIUM | lmdeploy/turbomind/models/internlm2.py | 88 | # ------------------------------------------------------------------ | COMMENT |
| 212 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/benchmark_parser.py | 9 | CODE | |
| LOW | benchmark/benchmark_parser.py | 19 | CODE | |
| LOW | benchmark/benchmark_parser.py | 22 | CODE | |
| LOW | benchmark/benchmark_chat_completion.py | 14 | CODE | |
| LOW | benchmark/benchmark_generate.py | 21 | CODE | |
| LOW | lmdeploy/__init__.py | 3 | CODE | |
| LOW | lmdeploy/__init__.py | 3 | CODE | |
| LOW | lmdeploy/__init__.py | 3 | CODE | |
| LOW | lmdeploy/__init__.py | 4 | CODE | |
| LOW | lmdeploy/__init__.py | 4 | CODE | |
| LOW | lmdeploy/__init__.py | 4 | CODE | |
| LOW | lmdeploy/__init__.py | 4 | CODE | |
| LOW | lmdeploy/__init__.py | 5 | CODE | |
| LOW | lmdeploy/__init__.py | 6 | CODE | |
| LOW | lmdeploy/__init__.py | 7 | CODE | |
| LOW | lmdeploy/__init__.py | 8 | CODE | |
| LOW | lmdeploy/__init__.py | 8 | CODE | |
| LOW | lmdeploy/api.py | 2 | CODE | |
| LOW | lmdeploy/utils.py | 511 | CODE | |
| LOW | lmdeploy/utils.py | 519 | CODE | |
| LOW | lmdeploy/utils.py | 470 | CODE | |
| LOW | lmdeploy/pipeline.py | 2 | CODE | |
| LOW | lmdeploy/lite/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 14 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 15 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 15 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 15 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 16 | CODE | |
| LOW | lmdeploy/lite/utils/__init__.py | 17 | CODE | |
| LOW | lmdeploy/lite/quantization/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/quantization/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/quantization/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/quantization/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/quantization/__init__.py | 4 | CODE | |
| LOW | lmdeploy/lite/quantization/weight/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/quantization/activation/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/quantization/activation/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/quantization/modules/__init__.py | 2 | CODE | |
| LOW | lmdeploy/lite/model/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/model/__init__.py | 3 | CODE | |
| LOW | lmdeploy/lite/model/__init__.py | 7 | CODE | |
| LOW | lmdeploy/cli/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| LOW | lmdeploy/vl/__init__.py | 2 | CODE | |
| 492 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | lmdeploy/vl/model/internvl.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/molmo.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/llama4.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/llava.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/deepseek.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/llava_hf.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/llava_next.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/internvl3_hf.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/gemma3_vl.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/minicpmv.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/deepseek_vl2.py | 0 | build the vision part of a vlm model when backend is turbomind, or load the whole vlm model when `self.with_llm==true` | STRING |
| HIGH | lmdeploy/vl/model/internvl.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/molmo.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/llama4.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/llava.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/deepseek.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/llava_hf.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/llava_next.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/internvl3_hf.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/gemma3_vl.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/qwen2.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/minicpmv.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/vl/model/deepseek_vl2.py | 0 | extract image feature. only implement it when the backend is turbomind engine. args: messages(list[dict]): the outputs o | STRING |
| HIGH | lmdeploy/serve/openai/protocol.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/engine.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base_worker.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/base_worker.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/ray_executor.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/base.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/serve/openai/api_server.py | 0 | tear down a previously initialized weights-update group. | STRING |
| HIGH | lmdeploy/pytorch/messages.py | 0 | update token ids, old token ids will be added to history. | STRING |
| HIGH | lmdeploy/pytorch/strategies/dllm/sequence.py | 0 | update token ids, old token ids will be added to history. | STRING |
| HIGH | lmdeploy/pytorch/strategies/ar_spec/sequence.py | 0 | update token ids, old token ids will be added to history. | STRING |
| HIGH | lmdeploy/pytorch/strategies/ar/sequence.py | 0 | update token ids, old token ids will be added to history. | STRING |
| HIGH | lmdeploy/pytorch/strategies/dllm/step_inputs.py | 0 | shrink batch — keep only sequences at delta.indices. | STRING |
| HIGH | lmdeploy/pytorch/strategies/ar_spec/step_inputs.py | 0 | shrink batch — keep only sequences at delta.indices. | STRING |
| HIGH | lmdeploy/pytorch/strategies/ar/step_inputs.py | 0 | shrink batch — keep only sequences at delta.indices. | STRING |
| HIGH | lmdeploy/pytorch/strategies/base/step_inputs.py | 0 | shrink batch — keep only sequences at delta.indices. | STRING |
| HIGH | lmdeploy/pytorch/models/qwen3_5.py | 0 | we might change the number of layers so we can debug the model with less gpus. | STRING |
| HIGH | lmdeploy/pytorch/models/qwen3_5_moe.py | 0 | we might change the number of layers so we can debug the model with less gpus. | STRING |
| HIGH | lmdeploy/pytorch/models/qwen3_next.py | 0 | we might change the number of layers so we can debug the model with less gpus. | STRING |
| HIGH | lmdeploy/pytorch/models/deepseek_v2.py | 0 | we might change the number of layers so we can debug the model with less gpus. | STRING |
| HIGH | …/pytorch/paging/block_manager/default_block_manager.py | 0 | return if physical block can be allocated for given message. | STRING |
| HIGH | …y/pytorch/paging/block_manager/window_block_manager.py | 0 | return if physical block can be allocated for given message. | STRING |
| HIGH | …loy/pytorch/paging/block_manager/base_block_manager.py | 0 | return if physical block can be allocated for given message. | STRING |
| HIGH | …/pytorch/paging/block_manager/default_block_manager.py | 0 | allocate physical blocks for given message according to logical blocks. | STRING |
| HIGH | …y/pytorch/paging/block_manager/window_block_manager.py | 0 | allocate physical blocks for given message according to logical blocks. | STRING |
| HIGH | …loy/pytorch/paging/block_manager/base_block_manager.py | 0 | allocate physical blocks for given message according to logical blocks. | STRING |
| HIGH | lmdeploy/pytorch/engine/engine.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base_worker.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/base_worker.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/ray_executor.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/executor/base.py | 0 | receive weights through the disaggregated process group. | STRING |
| HIGH | lmdeploy/pytorch/engine/base.py | 0 | drop connection. 1. drop engine connection (zmq connection) 2. todo(jimyma) drop rdma connection. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base_worker.py | 0 | drop connection. 1. drop engine connection (zmq connection) 2. todo(jimyma) drop rdma connection. | STRING |
| HIGH | lmdeploy/pytorch/engine/mp_engine/base.py | 0 | drop connection. 1. drop engine connection (zmq connection) 2. todo(jimyma) drop rdma connection. | STRING |
| HIGH | autotest/utils/run_restful_chat.py | 0 | get current temperature at a location. args: location: the location to get the temperature for, in the format "city, sta | STRING |
| HIGH | docs/zh_cn/llm/api_server_tools.md | 0 | get current temperature at a location. args: location: the location to get the temperature for, in the format "city, sta | STRING |
| 1 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 692 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 708 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 729 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 748 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 772 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 794 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 821 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 843 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 871 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 886 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 902 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 921 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 947 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 964 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 988 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 1005 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 1036 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 1057 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 1088 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | …/interface/restful/test_restful_chat_completions_v1.py | 1121 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{BASE_URL}/v1') | CODE |
| HIGH | autotest/utils/tool_reasoning_definitions.py | 205 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{url}/v1') | CODE |
| HIGH | autotest/utils/tool_reasoning_definitions.py | 787 | 'Authorization': 'Bearer YOUR_API_KEY', | CODE |
| HIGH | autotest/utils/tool_reasoning_definitions.py | 941 | 'Authorization': 'Bearer YOUR_API_KEY', | CODE |
| HIGH | autotest/utils/run_restful_chat.py | 156 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{url}/v1') | CODE |
| HIGH | autotest/utils/run_restful_chat.py | 485 | client = OpenAI(api_key='YOUR_API_KEY', base_url=http_url + '/v1') | CODE |
| HIGH | autotest/utils/run_restful_chat.py | 826 | client = OpenAI(api_key='YOUR_API_KEY', base_url=http_url + '/v1') | CODE |
| HIGH | autotest/utils/run_restful_chat.py | 1117 | client = OpenAI(api_key='YOUR_API_KEY', base_url=http_url + '/v1') | CODE |
| HIGH | docs/zh_cn/llm/api_server.md | 90 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/zh_cn/llm/api_server.md | 113 | client = AsyncOpenAI(api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/zh_cn/llm/codellama.md | 149 | api_key='YOUR_API_KEY', | STRING |
| HIGH | docs/zh_cn/llm/api_server_tools.md | 39 | client = OpenAI(api_key='YOUR_API_KEY',base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/zh_cn/llm/api_server_tools.md | 112 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/zh_cn/llm/api_server_tools.md | 186 | client = OpenAI(api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/zh_cn/llm/api_server_tools.md | 357 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/zh_cn/llm/api_server_lora.md | 77 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/zh_cn/advance/structed_output.md | 99 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/zh_cn/advance/spec_decoding.md | 188 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:24545/v1') | CODE |
| HIGH | docs/zh_cn/get_started/get_started.md | 131 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/zh_cn/get_started/get_started.md | 165 | client = OpenAI(api_key='YOUR_API_KEY', # A dummy api_key is required | CODE |
| HIGH | docs/zh_cn/multi_modal/api_server_vl.md | 60 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/zh_cn/multi_modal/phi3.md | 55 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/llm/api_server.md | 71 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/en/llm/api_server.md | 94 | client = AsyncOpenAI(api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/en/llm/codellama.md | 149 | api_key='YOUR_API_KEY', | STRING |
| HIGH | docs/en/llm/api_server_tools.md | 39 | client = OpenAI(api_key='YOUR_API_KEY',base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/llm/api_server_tools.md | 112 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/llm/api_server_tools.md | 186 | client = OpenAI(api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/en/llm/api_server_tools.md | 357 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/llm/api_server_lora.md | 77 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/en/advance/structed_output.md | 99 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/advance/spec_decoding.md | 189 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:24545/v1') | CODE |
| HIGH | docs/en/get_started/get_started.md | 134 | api_key='YOUR_API_KEY', | CODE |
| HIGH | docs/en/get_started/get_started.md | 169 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/multi_modal/api_server_vl.md | 83 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | docs/en/multi_modal/phi3.md | 56 | client = OpenAI(api_key='YOUR_API_KEY', base_url='http://0.0.0.0:23333/v1') | CODE |
| HIGH | eval/config.py | 57 | key='YOUR_API_KEY', | CODE |
| HIGH⚡ | eval/eval.py | 121 | client = OpenAI(api_key='YOUR_API_KEY', base_url=f'{server}/v1') | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/benchmark_chat_completion.py | 35 | except Exception: # noqa: BLE001 - tqdm is optional for CLI progress display. | CODE |
| LOW | benchmark/benchmark_chat_completion.py | 531 | except Exception as e: # noqa: BLE001 - record and keep consuming SSE. | CODE |
| LOW | benchmark/benchmark_chat_completion.py | 537 | except Exception as e: # noqa: BLE001 - benchmark should record failures and continue. | CODE |
| LOW | benchmark/benchmark_chat_completion.py | 772 | except Exception as e: | CODE |
| LOW | benchmark/benchmark_pipeline.py | 58 | except Exception as e: | CODE |
| LOW | benchmark/benchmark_throughput.py | 58 | except Exception as e: | CODE |
| LOW | benchmark/benchmark_serving.py | 87 | except Exception as e: | CODE |
| LOW | benchmark/benchmark_serving.py | 146 | except Exception as e: | CODE |
| LOW | benchmark/benchmark_generate.py | 56 | except Exception: # noqa: BLE001 | CODE |
| LOW | benchmark/benchmark_generate.py | 274 | except Exception as e: # noqa: BLE001 | CODE |
| MEDIUM | benchmark/profile_restful_api.py | 747 | print(f'Error applying chat template: {e}, fallback to <image> tag') | CODE |
| MEDIUM | benchmark/profile_restful_api.py | 1115 | print(f'Error running benchmark for request rate: {request_rate}') | CODE |
| LOW | benchmark/profile_restful_api.py | 148 | except Exception: | CODE |
| LOW | benchmark/profile_restful_api.py | 227 | except Exception: | CODE |
| LOW | benchmark/profile_restful_api.py | 335 | except Exception: | CODE |
| LOW | benchmark/profile_restful_api.py | 412 | except Exception: | CODE |
| LOW | benchmark/profile_restful_api.py | 744 | except Exception as e: | CODE |
| LOW | benchmark/profile_restful_api.py | 775 | except Exception: | CODE |
| LOW | benchmark/profile_restful_api.py | 1181 | except Exception as e: | CODE |
| LOW | benchmark/profile_restful_api.py | 1244 | except Exception as e: | CODE |
| LOW | lmdeploy/model.py | 636 | except Exception as e: | CODE |
| LOW | lmdeploy/model.py | 653 | except Exception as e: | CODE |
| LOW | lmdeploy/model.py | 735 | except Exception: | CODE |
| LOW | lmdeploy/model.py | 743 | except Exception: | CODE |
| LOW | lmdeploy/tokenizer.py | 430 | except Exception as e: # noqa | CODE |
| LOW | lmdeploy/utils.py | 471 | except Exception as e: | CODE |
| LOW | lmdeploy/utils.py | 512 | except Exception: | CODE |
| LOW | lmdeploy/utils.py | 520 | except Exception: | CODE |
| MEDIUM | lmdeploy/utils.py | 509 | def is_deep_ep_installed(): | CODE |
| MEDIUM | lmdeploy/utils.py | 517 | def is_deep_gemm_installed(): | CODE |
| LOW | lmdeploy/archs.py | 151 | except Exception as e: # noqa | CODE |
| LOW | lmdeploy/metrics/metrics_processor.py | 81 | except Exception as e: | CODE |
| LOW | lmdeploy/lite/apis/gptq.py | 43 | except Exception: | CODE |
| LOW | lmdeploy/cli/cli.py | 127 | except Exception: | CODE |
| LOW | lmdeploy/vl/engine.py | 69 | except Exception as e: | CODE |
| LOW | lmdeploy/vl/model/builder.py | 80 | except Exception as e: | CODE |
| LOW | lmdeploy/vl/model/utils.py | 44 | except Exception: | CODE |
| LOW | lmdeploy/vl/model/base.py | 101 | except Exception as e: | CODE |
| LOW | lmdeploy/vl/media/time_series.py | 42 | except Exception as e: | CODE |
| LOW | lmdeploy/vl/media/connection.py | 50 | except Exception as e: | CODE |
| LOW | lmdeploy/turbomind/turbomind.py | 817 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/parsers/_openai_harmony.py | 127 | except Exception: | CODE |
| LOW | lmdeploy/serve/core/health.py | 114 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 303 | except Exception: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 315 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 441 | except Exception: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 449 | except Exception: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 465 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/core/async_engine.py | 565 | except Exception: | CODE |
| LOW | lmdeploy/serve/proxy/streaming_response.py | 54 | except Exception: | CODE |
| LOW | lmdeploy/serve/proxy/proxy.py | 200 | except Exception as e: # noqa | CODE |
| LOW | lmdeploy/serve/proxy/proxy.py | 814 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/proxy/proxy.py | 832 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/proxy/proxy.py | 850 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/managers/session_manager.py | 95 | except Exception as e: | CODE |
| LOW | lmdeploy/serve/utils/request_cleanup.py | 18 | except Exception: | CODE |
| LOW | lmdeploy/serve/utils/request_cleanup.py | 37 | except Exception: | CODE |
| LOW | lmdeploy/serve/anthropic/endpoints/messages.py | 237 | except Exception as err: | CODE |
| LOW | lmdeploy/serve/openai/launch_server.py | 24 | except Exception: | CODE |
| LOW | lmdeploy/serve/openai/launch_server.py | 67 | except Exception: | CODE |
| 156 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | setup.py | 58 | CODE | |
| LOW | setup.py | 74 | CODE | |
| LOW | setup.py | 115 | CODE | |
| LOW | benchmark/benchmark_parser.py | 81 | CODE | |
| LOW | benchmark/benchmark_chat_completion.py | 266 | CODE | |
| LOW | benchmark/benchmark_chat_completion.py | 448 | CODE | |
| LOW | benchmark/benchmark_chat_completion.py | 1005 | CODE | |
| LOW | benchmark/benchmark_guided.py | 527 | CODE | |
| LOW | benchmark/benchmark_generate.py | 203 | CODE | |
| LOW | benchmark/benchmark_generate.py | 280 | CODE | |
| LOW | benchmark/profile_restful_api.py | 159 | CODE | |
| LOW | benchmark/profile_restful_api.py | 237 | CODE | |
| LOW | benchmark/profile_restful_api.py | 345 | CODE | |
| LOW | benchmark/profile_restful_api.py | 1186 | CODE | |
| LOW | lmdeploy/tokenizer.py | 152 | CODE | |
| LOW | lmdeploy/utils.py | 394 | CODE | |
| LOW | lmdeploy/utils.py | 420 | CODE | |
| LOW | lmdeploy/utils.py | 542 | CODE | |
| LOW | lmdeploy/archs.py | 56 | CODE | |
| LOW | lmdeploy/archs.py | 95 | CODE | |
| LOW | lmdeploy/archs.py | 168 | CODE | |
| LOW | lmdeploy/metrics/metrics_processor.py | 45 | CODE | |
| LOW | lmdeploy/metrics/stats.py | 146 | CODE | |
| LOW | lmdeploy/lite/apis/auto_awq.py | 18 | CODE | |
| LOW | lmdeploy/lite/apis/smooth_quant.py | 18 | CODE | |
| LOW | lmdeploy/lite/apis/calibrate.py | 201 | CODE | |
| LOW | lmdeploy/lite/apis/calibrate.py | 233 | CODE | |
| LOW | lmdeploy/lite/utils/calib_dataloader.py | 14 | CODE | |
| LOW | lmdeploy/lite/utils/memory_efficient.py | 197 | CODE | |
| LOW | lmdeploy/lite/utils/batch_split.py | 7 | CODE | |
| LOW | lmdeploy/cli/entrypoint.py | 10 | CODE | |
| LOW | lmdeploy/cli/chat.py | 72 | CODE | |
| LOW | lmdeploy/cli/utils.py | 14 | CODE | |
| LOW | lmdeploy/cli/utils.py | 832 | CODE | |
| LOW | lmdeploy/vl/model/internvl.py | 22 | CODE | |
| LOW | lmdeploy/vl/model/internvl.py | 238 | CODE | |
| LOW | lmdeploy/vl/model/molmo.py | 129 | CODE | |
| LOW | lmdeploy/vl/model/molmo.py | 151 | CODE | |
| LOW | lmdeploy/vl/model/preprocess_utils.py | 207 | CODE | |
| LOW | lmdeploy/vl/model/llava.py | 305 | CODE | |
| LOW | lmdeploy/vl/model/builder.py | 35 | CODE | |
| LOW | lmdeploy/vl/model/qwen3_5.py | 114 | CODE | |
| LOW | lmdeploy/vl/model/utils.py | 29 | CODE | |
| LOW | lmdeploy/vl/model/internvl3_hf.py | 57 | CODE | |
| LOW | lmdeploy/vl/model/qwen2.py | 125 | CODE | |
| LOW | lmdeploy/vl/model/base.py | 123 | CODE | |
| LOW | lmdeploy/vl/model/base.py | 364 | CODE | |
| LOW | lmdeploy/vl/model/minicpmv.py | 200 | CODE | |
| LOW | lmdeploy/vl/media/time_series.py | 31 | CODE | |
| LOW | lmdeploy/turbomind/checkpoint.py | 188 | CODE | |
| LOW | lmdeploy/turbomind/tokenizer_info.py | 133 | CODE | |
| LOW | lmdeploy/turbomind/linear.py | 109 | CODE | |
| LOW | lmdeploy/turbomind/linear.py | 160 | CODE | |
| LOW | lmdeploy/turbomind/linear.py | 121 | CODE | |
| LOW | lmdeploy/turbomind/linear.py | 171 | CODE | |
| LOW | lmdeploy/turbomind/converter.py | 29 | CODE | |
| LOW | lmdeploy/turbomind/converter.py | 154 | CODE | |
| LOW | lmdeploy/turbomind/supported_models.py | 35 | CODE | |
| LOW | lmdeploy/turbomind/turbomind.py | 687 | CODE | |
| LOW | lmdeploy/turbomind/builders/_base.py | 227 | CODE | |
| 168 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/profile_restful_api.py | 1166 | CODE | |
| LOW | lmdeploy/model.py | 116 | CODE | |
| LOW | lmdeploy/model.py | 209 | CODE | |
| LOW | lmdeploy/model.py | 585 | CODE | |
| LOW | lmdeploy/api.py | 83 | CODE | |
| LOW | lmdeploy/utils.py | 638 | CODE | |
| LOW | lmdeploy/lite/apis/auto_awq.py | 41 | CODE | |
| LOW | lmdeploy/lite/apis/smooth_quant.py | 18 | CODE | |
| LOW | lmdeploy/lite/apis/gptq.py | 11 | CODE | |
| LOW | lmdeploy/lite/apis/calibrate.py | 283 | CODE | |
| LOW | lmdeploy/lite/utils/memory_efficient.py | 124 | CODE | |
| LOW | lmdeploy/vl/model/base.py | 238 | CODE | |
| LOW | lmdeploy/turbomind/turbomind.py | 687 | CODE | |
| LOW | lmdeploy/turbomind/models/utils.py | 225 | CODE | |
| LOW | lmdeploy/serve/core/async_engine.py | 479 | CODE | |
| LOW | lmdeploy/serve/proxy/proxy.py | 884 | CODE | |
| LOW | lmdeploy/serve/proxy/proxy.py | 325 | CODE | |
| LOW | lmdeploy/serve/openai/api_server.py | 1505 | CODE | |
| LOW | lmdeploy/serve/openai/api_client.py | 90 | CODE | |
| LOW | lmdeploy/serve/openai/api_client.py | 175 | CODE | |
| LOW | lmdeploy/pytorch/config.py | 414 | CODE | |
| LOW | lmdeploy/pytorch/model_inputs.py | 179 | CODE | |
| LOW | lmdeploy/pytorch/model_inputs.py | 275 | CODE | |
| LOW | lmdeploy/pytorch/model_inputs.py | 406 | CODE | |
| LOW | lmdeploy/pytorch/messages.py | 430 | CODE | |
| LOW | lmdeploy/pytorch/messages.py | 547 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/pagedattention.py | 756 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/w8a8_fused_moe.py | 288 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/fused_lora.py | 159 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/blocked_fp8_fused_moe.py | 336 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/fused_moe.py | 543 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/flashattention.py | 475 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/utils.py | 49 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/gated_delta_rule.py | 256 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/gated_delta_rule.py | 575 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/w8a8_triton_kernels.py | 306 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/causal_conv1d.py | 212 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/rms_norm.py | 18 | CODE | |
| LOW | lmdeploy/pytorch/kernels/cuda/flatten_kv_cache.py | 397 | CODE | |
| LOW | lmdeploy/pytorch/nn/attention.py | 24 | CODE | |
| LOW | lmdeploy/pytorch/nn/rotary_embedding.py | 177 | CODE | |
| LOW | lmdeploy/pytorch/nn/nsa.py | 44 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/blocked_fp8.py | 19 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/blocked_fp8.py | 168 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/blocked_fp8.py | 276 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/__init__.py | 18 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/__init__.py | 103 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/__init__.py | 147 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/__init__.py | 184 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/__init__.py | 258 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/default.py | 18 | CODE | |
| LOW | lmdeploy/pytorch/nn/linear/base.py | 114 | CODE | |
| LOW | lmdeploy/pytorch/nn/moe/blocked_fp8.py | 146 | CODE | |
| LOW | lmdeploy/pytorch/nn/moe/__init__.py | 11 | CODE | |
| LOW | lmdeploy/pytorch/strategies/ar_spec/model_agent.py | 190 | CODE | |
| LOW | lmdeploy/pytorch/strategies/ar/model_inputs.py | 127 | CODE | |
| LOW | lmdeploy/pytorch/backends/attention.py | 32 | CODE | |
| LOW | lmdeploy/pytorch/backends/attention.py | 114 | CODE | |
| LOW | lmdeploy/pytorch/backends/rotary_embedding.py | 79 | CODE | |
| LOW | lmdeploy/pytorch/backends/gated_delta_rule.py | 40 | CODE | |
| 71 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | CMakeLists.txt | 1 | # Copyright (c) 2019-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | benchmark/benchmark_decode.py | 61 | if __name__ == '__main__': | COMMENT |
| LOW | benchmark/benchmark_decode.py | 81 | # Decoded 15991314 tokens in 242.7 seconds, 65893.38488718234 tokens/s. | COMMENT |
| LOW | lmdeploy/pytorch/utils.py | 161 | # When using `remote_code` in HF components like tokenizer or config | COMMENT |
| LOW | lmdeploy/pytorch/strategies/dllm/step_inputs.py | 1 | # Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | lmdeploy/pytorch/strategies/ar_spec/step_inputs.py | 1 | # Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | lmdeploy/pytorch/strategies/ar/step_inputs.py | 1 | # Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | tests/csrc/CMakeLists.txt | 1 | # Copyright (c) 2021-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | tests/csrc/unittests/unittest_utils.h | 21 | #include <float.h> // FLT_MAX | COMMENT |
| LOW | tests/csrc/unittests/CMakeLists.txt | 1 | # Copyright (c) 2021-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | tests/csrc/unittests/gtest_utils.h | 1 | #include <algorithm> // std::fill_n | COMMENT |
| LOW | tests/test_lmdeploy/test_model.py | 241 | add_generation_prompt=True, | COMMENT |
| LOW | tests/test_lmdeploy/test_model.py | 261 | # 'role': 'system', | COMMENT |
| LOW | tests/pytorch/test_internvl_lora.py | 21 | COMMENT | |
| LOW | docs/zh_cn/conf.py | 1 | # | COMMENT |
| LOW | docs/zh_cn/conf.py | 121 | # The language for content autogenerated by Sphinx. Refer to documentation | COMMENT |
| LOW | docs/zh_cn/conf.py | 161 | 'use_issues_button': True, | COMMENT |
| LOW | docs/zh_cn/conf.py | 181 | COMMENT | |
| LOW | docs/zh_cn/conf.py | 201 | # defined by theme itself. Builtin themes are using these templates by | COMMENT |
| LOW | docs/zh_cn/conf.py | 221 | # 'pointsize': '10pt', | COMMENT |
| LOW | docs/en/conf.py | 1 | # | COMMENT |
| LOW | docs/en/conf.py | 121 | # The language for content autogenerated by Sphinx. Refer to documentation | COMMENT |
| LOW | docs/en/conf.py | 161 | 'use_repository_button': True, | COMMENT |
| LOW | docs/en/conf.py | 181 | # Enable ::: for my_st | COMMENT |
| LOW | docs/en/conf.py | 201 | # default: ``['localtoc.html', 'relations.html', 'sourcelink.html', | COMMENT |
| LOW | docs/en/conf.py | 221 | COMMENT | |
| LOW | src/CMakeLists.txt | 1 | # Copyright (c) 2019-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | src/turbomind/turbomind.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/CMakeLists.txt | 1 | # Copyright (c) 2019-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/CMakeLists.txt | 1 | # Copyright (c) 2019-2023, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/attention/impl_simt.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/attention/iterator_sm80.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/attention/impl_884.h | 41 | static constexpr int V_N = HeadDim / OP_N; // 8 | COMMENT |
| LOW | src/turbomind/kernels/core/floating_point.h | 141 | // FloatingPoint<5, 2>::max_denormal; | COMMENT |
| LOW | src/turbomind/kernels/core/common.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/core/common.h | 21 | #endif | COMMENT |
| LOW | src/turbomind/kernels/core/common.h | 41 | #if defined(__CUDACC_RTC__) || (defined(__clang__) && defined(__CUDA__)) | COMMENT |
| LOW | src/turbomind/kernels/core/common.h | 61 | #define TM_HOST __forceinline__ __host__ | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v4.h | 1 | #pragma once | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v4.h | 21 | COMMENT | |
| LOW | src/turbomind/kernels/gemm/iterator_sm70.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/tiled_mma.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/CMakeLists.txt | 121 | # GIT_REPOSITORY https://github.com/NVIDIA/nvbench.git | COMMENT |
| LOW | src/turbomind/kernels/gemm/kernel_impl.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v3.h | 1 | #pragma once | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v3.h | 21 | COMMENT | |
| LOW | src/turbomind/kernels/gemm/mainloop_sm80_v2.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/iterator_sm80.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/matrix_ptr.h | 101 | COMMENT | |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v2.h | 1 | #pragma once | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v2.h | 21 | #include "src/turbomind/core/data_type.h" | COMMENT |
| LOW | src/turbomind/kernels/gemm/smem_copy.h | 181 | } | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90.h | 1 | #pragma once | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v5.h | 1 | #pragma once | COMMENT |
| LOW | src/turbomind/kernels/gemm/gemm_universal_sm90_v5.h | 21 | COMMENT | |
| LOW | src/turbomind/kernels/gemm/mainloop_sm70.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/kernel_impl_sm90.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/epilogue.h | 1 | // Copyright (c) OpenMMLab. All rights reserved. | COMMENT |
| LOW | src/turbomind/kernels/gemm/test/testbed_v3.h | 1 | COMMENT | |
| 39 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lmdeploy/__init__.py | 10 | __all__ = [ | CODE |
| LOW | lmdeploy/lite/utils/__init__.py | 19 | __all__ = [ | CODE |
| LOW | lmdeploy/lite/quantization/__init__.py | 6 | __all__ = ['WeightQuantizer', 'ActivationObserver', 'KVCacheObserver', 'CalibrationContext', 'CalibrationContextV2'] | CODE |
| LOW | lmdeploy/lite/quantization/weight/__init__.py | 4 | __all__ = ['WeightQuantizer'] | CODE |
| LOW | lmdeploy/lite/quantization/activation/__init__.py | 4 | __all__ = ['ActivationObserver', 'KVCacheObserver'] | CODE |
| LOW | lmdeploy/lite/quantization/modules/__init__.py | 4 | __all__ = ['WeightOnlyQLinear'] | CODE |
| LOW | lmdeploy/lite/model/__init__.py | 9 | __all__ = ['MODELS'] | CODE |
| LOW | lmdeploy/cli/__init__.py | 4 | __all__ = ['run'] | CODE |
| LOW | lmdeploy/vl/__init__.py | 13 | __all__ = [ | CODE |
| LOW | lmdeploy/turbomind/tokenizer_info.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | lmdeploy/turbomind/__init__.py | 54 | __all__ = ['TurboMind', 'update_parallel_config'] | CODE |
| LOW⚡ | lmdeploy/turbomind/builders/ffn.py | 18 | __all__ = [ | CODE |
| LOW | lmdeploy/turbomind/builders/__init__.py | 17 | __all__ = [ | CODE |
| LOW | lmdeploy/serve/__init__.py | 6 | __all__ = [ | CODE |
| LOW | lmdeploy/serve/parsers/__init__.py | 6 | __all__ = ['ResponseParser', 'ResponseParserManager', 'GptOssResponseParser', 'validate_parser_names'] | CODE |
| LOW | lmdeploy/serve/parsers/tool_parser/__init__.py | 12 | __all__ = [ | CODE |
| LOW | lmdeploy/serve/parsers/reasoning_parser/__init__.py | 5 | __all__ = [ | CODE |
| LOW | lmdeploy/serve/core/__init__.py | 6 | __all__ = ['AsyncEngine', 'EngineHealthMonitor', 'VLAsyncEngine'] | CODE |
| LOW | lmdeploy/serve/managers/__init__.py | 4 | __all__ = ['Session', 'SessionManager'] | CODE |
| LOW | lmdeploy/serve/processors/__init__.py | 4 | __all__ = ['MultimodalProcessor'] | CODE |
| LOW | lmdeploy/serve/anthropic/__init__.py | 6 | __all__ = ['create_anthropic_router'] | CODE |
| LOW | lmdeploy/serve/openai/responses/__init__.py | 13 | __all__ = [ | CODE |
| LOW | lmdeploy/pytorch/configurations/__init__.py | 7 | __all__ = [] | CODE |
| LOW | lmdeploy/pytorch/kernels/__init__.py | 10 | __all__ = [ | CODE |
| LOW | lmdeploy/pytorch/kernels/cuda/__init__.py | 14 | __all__ = [ | CODE |
| LOW | lmdeploy/pytorch/kernels/cuda/turbo_quant.py | 14 | logger = logging.getLogger(__name__) | CODE |
| LOW | lmdeploy/pytorch/kernels/default/__init__.py | 5 | __all__ = [ | CODE |
| LOW | lmdeploy/pytorch/kernels/dlinfer/__init__.py | 13 | __all__ = [ | CODE |
| LOW | lmdeploy/pytorch/models/__init__.py | 4 | __all__ = ['QLinear', 'QRMSNorm'] | CODE |
| LOW | lmdeploy/pytorch/disagg/backend/__init__.py | 18 | __all__ = ['DLSlimeBackend', 'MooncakeBackend'] | CODE |
| LOW | lmdeploy/pytorch/spec_decode/__init__.py | 42 | __all__ = ['build_spec_agent'] | CODE |
| LOW | lmdeploy/pytorch/multimodal/__init__.py | 4 | __all__ = ['MultiModalData'] | CODE |
| LOW | lmdeploy/pytorch/paging/__init__.py | 4 | __all__ = ['Scheduler'] | CODE |
| LOW | lmdeploy/pytorch/engine/__init__.py | 5 | __all__ = ['Engine', 'EngineInstance'] | CODE |
| LOW | lmdeploy/pytorch/engine/executor/base.py | 361 | def update_configs(self) -> None: | CODE |
| LOW | lmdeploy/pytorch/devices/__init__.py | 4 | __all__ = ['DeviceContext', 'DefaultContext', 'get_device_manager'] | CODE |
| LOW | autotest/utils/config_utils.py | 871 | def set_device_env_variable(worker_id: str | None, parallel_config: dict[str, int] | None = None) -> None: | CODE |
| LOW | scripts/test_turbomind_model.py | 59 | def _set_hf_cache(path: str) -> None: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | benchmark/profile_restful_api.py | 307 | # Check if this chunk contains content | COMMENT |
| LOW | benchmark/profile_restful_api.py | 519 | # Check if the cache file already exists | COMMENT |
| LOW | lmdeploy/model.py | 640 | # Verify if the model can perform apply_chat_template with different roles. | COMMENT |
| LOW⚡ | lmdeploy/lite/apis/calibrate.py | 153 | # Check if the child is an instance of the given layer type | COMMENT |
| LOW⚡ | lmdeploy/lite/apis/calibrate.py | 161 | # Check if the child contains the target module type | COMMENT |
| LOW⚡ | lmdeploy/lite/apis/calibrate.py | 164 | # Check if the child matches the head name | COMMENT |
| LOW | lmdeploy/lite/utils/batch_split.py | 102 | # Check if the current element is a past key-value pair. | COMMENT |
| LOW | lmdeploy/serve/processors/multimodal.py | 241 | # Check if multimodal input exists | COMMENT |
| LOW | lmdeploy/serve/openai/api_server.py | 334 | # Check if token_id is within the vocab size | COMMENT |
| LOW | lmdeploy/pytorch/engine/executor/ray_executor.py | 574 | # Check if all elements in ips are present in worker_ips and vice versa (ignoring order) | COMMENT |
| LOW | autotest/utils/run_restful_chat.py | 92 | # Check if process is still running | COMMENT |
| LOW | autotest/utils/run_restful_chat.py | 1265 | # Check if process is still running | COMMENT |
| LOW | autotest/utils/ray_distributed_utils.py | 58 | # Check if port is open | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | lmdeploy/api.py | 94 | """This function is deprecated and no longer available. | STRING |
| MEDIUM | lmdeploy/api.py | 107 | """This function is deprecated and no longer available. | STRING |
| MEDIUM | lmdeploy/lite/quantization/modules/linear.py | 16 | """This class implements weight only quantization linear. | STRING |
| MEDIUM | lmdeploy/turbomind/tokenizer_info.py | 3 | """This module provides the tokenizer info class to handle the tokenizer | STRING |
| MEDIUM | lmdeploy/serve/openai/api_server.py | 232 | # Define an async function that always returns success | COMMENT |
| MEDIUM | lmdeploy/pytorch/ray.py | 127 | # Create a new placement group | COMMENT |
| MEDIUM | lmdeploy/pytorch/tools/utils.py | 165 | # Create a clean table-like format | COMMENT |
| MEDIUM | lmdeploy/pytorch/models/llama4.py | 751 | """This function is used to fetch the first embedding layer to activate | STRING |
| MEDIUM | lmdeploy/pytorch/models/gemma3_vl.py | 240 | # Create a global causal mask. | STRING |
| MEDIUM | lmdeploy/pytorch/models/gemma3_vl.py | 261 | # Create a local causal mask with sliding window (1024). | STRING |
| MEDIUM | …_lite/test_quantization/test_utils/test_cal_qparams.py | 18 | # Create a dummy tensor | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | …rve/openai/chat_completions/test_delta_tool_call_id.py | 18 | # Step 1: feed partial JSON with name | COMMENT |
| LOW⚡ | …rve/openai/chat_completions/test_delta_tool_call_id.py | 27 | # Step 2: feed final chunk with arguments | COMMENT |
| LOW⚡ | …ts/pytorch/spec_decode/test_guided_spec_integration.py | 481 | # Step 2: original should be at correct state | COMMENT |
| LOW | docs/en/advance/update_weights.md | 5 | ## Step 1: Launch server | COMMENT |
| LOW | docs/en/advance/update_weights.md | 13 | ## Step 2: Offloads weights & kv cache | COMMENT |
| LOW | docs/en/advance/update_weights.md | 38 | ## Step 3: Update weights | COMMENT |
| LOW | docs/en/advance/update_weights.md | 71 | ## Step 4: Wakeup server | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | lmdeploy/pytorch/kernels/cuda/fused_noaux_tc.py | 98 | # Wrappers and Benchmarking Logic (Kept exactly as requested) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | lmdeploy/api.py | 23 | Create a pipeline for inference. Args: model_path: the path of a model. It could be one of the following op | STRING |
| HIGH | lmdeploy/lite/utils/memory_efficient.py | 46 | Finds modules in model that return given value. Args: model (nn.Module): Model to inspect value (st | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | lmdeploy/pytorch/models/utils/cudagraph.py | 28 | window_size=(-1, -1), # -1 means infinite context window | CODE |
| MEDIUM | autotest/tools/pipeline/mllm_case.py | 370 | # In-context few-shot learning | COMMENT |
| MEDIUM | docs/en/multi_modal/vl_pipeline.md | 66 | ### Set context window size | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | lmdeploy/turbomind/builders/ffn.py | 57 | act_type == SiLU && (int4 || mxfp4 || fp8 || moe) && !(fp8 && SM90) | STRING |
| HIGH⚡ | lmdeploy/turbomind/builders/ffn.py | 57 | act_type == SiLU && (int4 || mxfp4 || fp8 || moe) && !(fp8 && SM90) | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lmdeploy/serve/core/async_engine.py | 801 | The purpose of this function is to allow users to choose whether to use the synchronous interface or the | STRING |
| LOW⚡ | …rve/openai/chat_completions/test_delta_tool_call_id.py | 18 | # Step 1: feed partial JSON with name | COMMENT |
| LOW⚡ | …rve/openai/chat_completions/test_delta_tool_call_id.py | 27 | # Step 2: feed final chunk with arguments | COMMENT |
| LOW⚡ | …ts/pytorch/spec_decode/test_guided_spec_integration.py | 481 | # Step 2: original should be at correct state | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lmdeploy/pytorch/paging/scheduler.py | 749 | # No need to evict, just return True. | COMMENT |
| LOW | lmdeploy/pytorch/paging/scheduler.py | 752 | # Enough free blocks, just return True. | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/pytorch/engine/test_zmq_rpc.py | 65 | # Example usage | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | lmdeploy/model.py | 715 | messages = [{'role': 'user', 'content': 'placeholder'}, {'role': 'assistant', 'content': 'sentinel'}] | CODE |