The Triton Inference Server provides an optimized cloud and edge inferencing solution.
This report presents the forensic synthetic code analysis of triton-inference-server/server, a Python project with 10,831 GitHub stars. SynthScan v2.0 examined 182,760 lines of code across 790 source files, recording 2434 pattern matches distributed across 16 syntactic categories. The overall adjusted score of 14.6 places this repository in the Low AI signal band.
The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).
This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.
Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.
This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.
The scanner identified 2434 distinct pattern matches across 16 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | build.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | build.py | 41 | import distro | COMMENT |
| LOW | build.py | 61 | # upstream container version, | COMMENT |
| LOW | CMakeLists.txt | 1 | # Copyright 2020-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | compose.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | .pre-commit-config.yaml | 1 | # Copyright 2023-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | pyproject.toml | 1 | # Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | pyproject.toml | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | README.md | 1 | <!-- | COMMENT |
| LOW | CONTRIBUTING.md | 1 | <!-- | COMMENT |
| LOW | SECURITY.md | 1 | <!-- | COMMENT |
| LOW | tools/add_copyright.py | 1 | # Copyright (c) 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | tools/add_copyright.py | 161 | with open(path, "w") as f: | COMMENT |
| LOW | docker/entrypoint.d/99-check-run-aip-mode.sh | 1 | #!/bin/bash | COMMENT |
| LOW | docker/cpu_only/nvidia_entrypoint.sh | 1 | #!/bin/bash | COMMENT |
| LOW | python/openai/requirements.txt | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/requirements.txt | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/requirements-test.txt | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/requirements-test.txt | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/README.md | 1 | <!-- | COMMENT |
| LOW | python/openai/openai_frontend/__init__.py | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/openai_frontend/main.py | 1 | #!/usr/bin/env python3 | COMMENT |
| LOW | …on/openai/openai_frontend/frontend/fastapi_frontend.py | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/frontend/frontend.py | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/frontend/__init__.py | 1 | # Copyright (c) 2024, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/frontend/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | …on/openai/openai_frontend/frontend/fastapi/__init__.py | 1 | # Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …on/openai/openai_frontend/frontend/fastapi/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | …nai/openai_frontend/frontend/fastapi/routers/models.py | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …i/openai_frontend/frontend/fastapi/routers/__init__.py | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …i/openai_frontend/frontend/fastapi/routers/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | …nai_frontend/frontend/fastapi/routers/observability.py | 1 | # Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …penai_frontend/frontend/fastapi/routers/completions.py | 1 | # Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …penai/openai_frontend/frontend/fastapi/routers/chat.py | 1 | # Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …openai_frontend/frontend/fastapi/routers/embeddings.py | 1 | # Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …_frontend/frontend/fastapi/routers/model_management.py | 1 | # Copyright 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …i_frontend/frontend/fastapi/middleware/request_size.py | 1 | # Copyright 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …penai_frontend/frontend/fastapi/middleware/__init__.py | 1 | # Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | …penai_frontend/frontend/fastapi/middleware/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | …rontend/frontend/fastapi/middleware/api_restriction.py | 1 | # Copyright 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/utils/utils.py | 1 | # Copyright 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/schemas/__init__.py | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/schemas/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/openai_frontend/schemas/openai.py | 1 | # Copyright (c) 2024-2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/__init__.py | 1 | # Copyright (c) 2024, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/openai_frontend/engine/engine.py | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 1 | # Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/__init__.py | 1 | # Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/__init__.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/tokenizer.py | 1 | # Copyright (c) 2024-2026, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/chat.py | 1 | # Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | …end/engine/utils/tool_call_parsers/tool_call_parser.py | 1 | # Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 1 | # Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 1 | # Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | …penai_frontend/engine/utils/tool_call_parsers/utils.py | 1 | # Copyright (c) 2025-2026, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| LOW | …penai_frontend/engine/utils/tool_call_parsers/utils.py | 21 | # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR | COMMENT |
| LOW | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 1 | # Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved. | COMMENT |
| 772 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | build.py | 412 | def cmake_repoagent_extra_args(): | CODE |
| LOW | build.py | 794 | def fastertransformer_cmake_args(): | CODE |
| LOW | build.py | 881 | def create_dockerfile_buildbase_rhel(ddir, dockerfile_name, argmap): | STRING |
| LOW | build.py | 1006 | def create_dockerfile_buildbase(ddir, dockerfile_name, argmap): | STRING |
| LOW | build.py | 1266 | def dockerfile_prepare_container_linux(argmap, backends, enable_gpu, target_machine): | STRING |
| LOW | build.py | 1495 | def add_cpu_libs_to_linux_dockerfile(backends, target_machine): | STRING |
| LOW | build.py | 1557 | def change_default_python_version_rhel(version): | STRING |
| LOW | build.py | 1648 | def create_docker_build_script(script_name, container_install_dir, container_ci_dir): | STRING |
| LOW | compose.py | 174 | def get_container_version_if_not_specified(): | STRING |
| LOW | tools/add_copyright.py | 372 | def test_adding_new_copyrights(content, extension, expected): | CODE |
| LOW | tools/add_copyright.py | 376 | def test_license_has_current_year(): | CODE |
| LOW | python/openai/README.md | 803 | def get_n_day_weather_forecast(city: str, state: str, unit: str, num_days: int): | CODE |
| LOW | …on/openai/openai_frontend/frontend/fastapi_frontend.py | 138 | def _add_api_restriction_middleware(self, app: FastAPI): | CODE |
| LOW | …on/openai/openai_frontend/frontend/fastapi_frontend.py | 146 | def _add_request_size_limit_middleware(self, app: FastAPI): | CODE |
| LOW | …i_frontend/frontend/fastapi/middleware/request_size.py | 138 | def _oversized_request_message(actual_bytes: int, max_bytes: int) -> str: | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 299 | def _get_chat_completion_response_message( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 471 | def _determine_request_converter(self, backend: str, request_type: RequestKind): | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 616 | def _get_streaming_chat_response_chunk( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 634 | def _get_first_streaming_chat_response( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 792 | def _get_streaming_response_delta( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 959 | def _verify_chat_tool_call_settings(self, request: CreateChatCompletionRequest): | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 996 | async def _streaming_completion_iterator( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 1064 | def _validate_completion_request( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 1140 | def _validate_embedding_request( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 1166 | def _should_stream_with_auto_tool_parsing( | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 1176 | def _should_check_for_unstreamed_tool_arg_tokens( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 70 | def _create_vllm_generate_request( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 179 | def _create_trtllm_generate_request( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 252 | def _create_vllm_embedding_request( | CODE |
| LOW⚡ | python/openai/openai_frontend/engine/utils/triton.py | 272 | def _create_trtllm_embedding_request( | CODE |
| LOW⚡ | python/openai/openai_frontend/engine/utils/triton.py | 281 | def _construct_string_from_pointer(pointer: int, size: int) -> str: | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 429 | def _get_logprobs_from_response( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 468 | def _get_openai_chat_format_logprobs_from_vllm_response( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 526 | def _get_openai_completion_format_logprobs_from_vllm_response( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 584 | def _validate_triton_responses_non_streaming( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 597 | def _get_guided_json_from_tool( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 620 | def _validate_lora_path_trtllm(repo_path: str, lora_path: str, lora_name: str): | CODE |
| LOW | python/openai/openai_frontend/engine/utils/chat.py | 61 | def _frontend_schema_to_openai_schema_completion_tool_call( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/chat.py | 74 | def _parse_chat_message_content_parts( | CODE |
| LOW | python/openai/openai_frontend/engine/utils/chat.py | 91 | def _parse_chat_message_content( | CODE |
| LOW | …end/engine/utils/tool_call_parsers/tool_call_parser.py | 61 | def parse_tool_calls_streaming( | CODE |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 58 | def generate_mistral_random_id(): | CODE |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 144 | def parse_tool_calls_streaming( | CODE |
| LOW | …penai_frontend/engine/utils/tool_call_parsers/utils.py | 106 | def extract_intermediate_diff(curr: str, old: str) -> str: | CODE |
| LOW | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 137 | def parse_tool_calls_streaming( | CODE |
| LOW | python/openai/tests/conftest.py | 70 | def infer_test_model_repository(backend, tool_call_parser): | CODE |
| LOW | python/openai/tests/conftest.py | 167 | def fastapi_client_class_scope( | CODE |
| LOW | python/openai/tests/conftest.py | 187 | def pytest_collection_modifyitems(session, config, items): | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 151 | def validate_tool_calls_present( | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 162 | def validate_weather_tool_arguments(self, parsed_arguments: Dict): | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 171 | def validate_weather_forcast_tool_arguments(self, parsed_arguments: Dict): | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 182 | async def test_tool_call_and_choice( | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 297 | async def test_tool_call_with_reply_response( | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 357 | async def test_tool_call_with_named_tool_choice( | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 460 | async def test_tool_call_with_required_tool_choice( | CODE |
| LOW | python/openai/tests/test_tool_calling.py | 563 | async def test_inconsistent_tool_choice_and_tools( | CODE |
| LOW⚡ | python/openai/tests/test_tool_calling.py | 663 | def test_truncated_when_tool_call_exceeds_limit(self, client): | CODE |
| LOW⚡ | python/openai/tests/test_tool_calling.py | 668 | def test_not_truncated_within_limit(self, client): | CODE |
| LOW⚡ | python/openai/tests/test_tool_calling.py | 673 | def test_limit_ignored_without_tools(self, client): | CODE |
| LOW⚡ | python/openai/tests/test_model_management.py | 316 | def test_load_rejects_duplicate(self, base_url): | CODE |
| 761 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | build.py | 1309 | # Create a user that can be used to run triton as | COMMENT |
| MEDIUM⚡ | python/openai/openai_frontend/engine/utils/triton.py | 284 | # Create a ctypes string buffer | COMMENT |
| MEDIUM | qa/L0_nan_inf/models/nan_inf_output/1/model.py | 38 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/L0_lifecycle/lifecycle_test.py | 1828 | # Create a new version for reload | COMMENT |
| MEDIUM | qa/L0_model_namespacing/python_subadd/__init__.py | 97 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/L0_model_namespacing/python_addsub/__init__.py | 97 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/L0_http/test.sh | 253 | # Create a password file with username:password | COMMENT |
| MEDIUM | qa/L0_backend_python/setup_python_enviroment.sh | 54 | # Create a model with python 3.11 version | COMMENT |
| MEDIUM | …on/decoupled/models/decoupled_execute_error/1/model.py | 63 | """This function is called on inference request.""" | STRING |
| MEDIUM | …ython/decoupled/models/decoupled_bls_stream/1/model.py | 60 | """This function is called on inference request.""" | STRING |
| MEDIUM | …ckend_python/decoupled/models/decoupled_bls/1/model.py | 77 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/L0_sequence_batcher/test.sh | 282 | # Create the input_state_data file. | COMMENT |
| MEDIUM⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 199 | # Create a valid cuda shared memory region, fill data in it and register | COMMENT |
| MEDIUM⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 215 | # Create a valid cuda shared memory region and unregister before register | COMMENT |
| MEDIUM⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 226 | # Create a valid cuda shared memory region and unregister after register | COMMENT |
| MEDIUM⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 240 | # Create a valid cuda shared memory region and unregister after register | COMMENT |
| MEDIUM | qa/L0_perf_resnet/test.sh | 94 | # Create the TensorRT plan from ONNX model | COMMENT |
| MEDIUM | qa/L0_perf_resnet/test.sh | 156 | # Create the TensorRT plan from ONNX model | COMMENT |
| MEDIUM | qa/L0_trace/trace_stress_grpc_client.py | 61 | # Define the callback function. Note the last two parameters should be | COMMENT |
| MEDIUM | qa/L0_trace/models/input_all_required/1/model.py | 39 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/L0_string_io/string_client_test.py | 103 | # Create the data for the input tensor. Initialize the tensor to 8 | COMMENT |
| MEDIUM | qa/L0_nullchar_string/nullchar_string_client.py | 77 | # Create the inference context for the model. | COMMENT |
| MEDIUM | qa/L0_nullchar_string/nullchar_string_client.py | 85 | # Create the data for the input tensor. It contains a null character in | COMMENT |
| MEDIUM | qa/L0_sequence_stress/sequence_stress.py | 182 | # Create a variable length sequence with "start" and "end" flags. | COMMENT |
| MEDIUM | qa/L0_sequence_stress/sequence_stress.py | 305 | # Create a sequence without a "start" flag. Sequence should get an | COMMENT |
| MEDIUM | qa/L0_sequence_stress/sequence_stress.py | 344 | # Create a variable length sequence with "start" flag but that | COMMENT |
| MEDIUM | qa/L0_sequence_stress/sequence_stress.py | 609 | # Create the seed for the thread. Since these are created in | COMMENT |
| MEDIUM | qa/L0_libtorch_io_names/io_names_client.py | 46 | # Create the data for the two inputs. Initialize the first to unique | COMMENT |
| MEDIUM | qa/python_models/add_sub/model.py | 48 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/cuda_memory_consumer/1/model.py | 63 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/string_identity/model.py | 41 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/request_rescheduling_addsub/model.py | 49 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/sub_add/model.py | 51 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/execute_error/model.py | 32 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/execute_grpc_error/model.py | 36 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/python_version/model.py | 61 | """This function is called on inference request.""" | STRING |
| MEDIUM | qa/python_models/auto_complete/model.py | 63 | """This function is called on inference request.""" | STRING |
| MEDIUM | …_models/python_based_backends/add_sub_backend/model.py | 38 | """This function is called only once when loading the model assuming | STRING |
| MEDIUM | …_models/python_based_backends/add_sub_backend/model.py | 125 | """This function is called when an inference request is made | STRING |
| MEDIUM | qa/L0_grpc/test.sh | 407 | # Create a password file with username:password | COMMENT |
| MEDIUM | qa/L0_perf_deeprecommender/test.sh | 56 | # Create the TensorRT plan from ONNX | COMMENT |
| MEDIUM | qa/L0_perf_deeprecommender/test.sh | 125 | # Create the TensorRT plan from ONNX | COMMENT |
| MEDIUM | qa/common/libtorch_infer_client.py | 61 | # Create the data for the two input tensors. Initialize the first | COMMENT |
| MEDIUM | qa/common/gen_qa_ort_scalar_models.py | 44 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_ort_scalar_models.py | 78 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_ragged_models.py | 163 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_ragged_models.py | 292 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_ragged_models.py | 474 | # Create the model | STRING |
| MEDIUM | qa/common/gen_qa_ragged_models.py | 521 | # Create the model | STRING |
| MEDIUM | qa/common/gen_qa_dyna_sequence_models.py | 221 | # Create the model. For now don't implement a proper accumulator | COMMENT |
| MEDIUM | qa/common/gen_qa_dyna_sequence_models.py | 333 | # Create the model. For now don't implement a proper accumulator | COMMENT |
| MEDIUM | qa/common/gen_qa_dyna_sequence_models.py | 717 | # Create the model. For now don't implement a proper accumulator | STRING |
| MEDIUM | qa/common/gen_qa_sequence_models.py | 203 | # Create the model. For now don't implement a proper accumulator | COMMENT |
| MEDIUM | qa/common/gen_qa_sequence_models.py | 296 | # Create the model. For now don't implement a proper accumulator | COMMENT |
| MEDIUM | qa/common/gen_qa_sequence_models.py | 603 | # Create the model. For now don't implement a proper accumulator | STRING |
| MEDIUM | qa/common/gen_qa_trt_format_models.py | 83 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_identity_models.py | 90 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_identity_models.py | 179 | # Create the model | COMMENT |
| MEDIUM | qa/common/gen_qa_identity_models.py | 422 | # Create the model | STRING |
| MEDIUM | qa/common/gen_qa_identity_models.py | 531 | # Create the model | STRING |
| 51 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | build.py | 100 | except Exception: | CODE |
| LOW | compose.py | 41 | except Exception: | CODE |
| LOW | …penai_frontend/frontend/fastapi/routers/completions.py | 61 | except Exception as e: | CODE |
| LOW | …penai/openai_frontend/frontend/fastapi/routers/chat.py | 62 | except Exception as e: | CODE |
| LOW | …openai_frontend/frontend/fastapi/routers/embeddings.py | 59 | except Exception as e: | CODE |
| LOW | …_frontend/frontend/fastapi/routers/model_management.py | 59 | except Exception as e: | CODE |
| LOW | …_frontend/frontend/fastapi/routers/model_management.py | 88 | except Exception as e: | CODE |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 757 | except Exception: | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 700 | except Exception: | CODE |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 726 | except Exception as e: | CODE |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 138 | except Exception: | CODE |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 317 | except Exception: | CODE |
| LOW | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 131 | except Exception as e: | CODE |
| LOW | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 288 | except Exception: | CODE |
| LOW | python/openai/tests/utils.py | 151 | except Exception as err: | CODE |
| LOW | python/openai/tests/test_lora.py | 134 | except Exception as e: | CODE |
| MEDIUM | python/openai/tests/test_lora.py | 45 | def is_vllm_installed(): | CODE |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 481 | except Exception as e: | STRING |
| MEDIUM | qa/L0_lifecycle/lifecycle_test.py | 91 | def _infer_success_identity(self, model_base, versions, tensor_dtype, tensor_sha | CODE |
| MEDIUM | qa/L0_lifecycle/lifecycle_test.py | 132 | def _async_load(self, model_name, use_grpc): | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 451 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 459 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 1536 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 1546 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 1556 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2173 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2183 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2193 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2855 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2865 | except Exception as ex: | CODE |
| LOW⚡ | qa/L0_lifecycle/lifecycle_test.py | 2874 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 88 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 118 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 136 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 191 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 200 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 228 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 254 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 263 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 291 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 319 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 343 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 363 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 373 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 389 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 409 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 424 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 481 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 496 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 515 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 530 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 553 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 571 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 586 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 629 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 647 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 665 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 712 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 730 | except Exception as ex: | CODE |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 746 | except Exception as ex: | CODE |
| 256 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | build.py | 118 | CODE | |
| LOW | build.py | 550 | CODE | |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 357 | CODE | |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 648 | CODE | |
| LOW | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 144 | CODE | |
| LOW | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 137 | CODE | |
| LOW | python/openai/tests/conftest.py | 187 | CODE | |
| LOW | python/openai/tests/conftest.py | 188 | CODE | |
| LOW | python/openai/tests/test_tool_calling.py | 629 | CODE | |
| LOW | python/openai/tests/test_models/mock_llm/1/model.py | 73 | CODE | |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 186 | CODE | |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 240 | CODE | |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 335 | CODE | |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 407 | CODE | |
| LOW | qa/L0_trt_reformat_free/trt_reformat_free_test.py | 47 | CODE | |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 56 | CODE | |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 3005 | CODE | |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 3168 | CODE | |
| LOW | qa/L0_batcher/verify_timestamps.py | 34 | CODE | |
| LOW | qa/L0_http/http_test.py | 192 | CODE | |
| LOW | qa/L0_http/http_test.py | 414 | CODE | |
| LOW | qa/L0_http/http_request_many_chunks.py | 51 | CODE | |
| LOW | …equence_corrid_batcher/sequence_corrid_batcher_test.py | 87 | CODE | |
| LOW | …equence_corrid_batcher/sequence_corrid_batcher_test.py | 231 | CODE | |
| LOW | qa/L0_backend_python/python_test.py | 248 | CODE | |
| LOW | qa/L0_backend_python/python_test.py | 490 | CODE | |
| LOW | qa/L0_backend_python/decoupled/decoupled_test.py | 93 | CODE | |
| LOW | qa/L0_backend_python/decoupled/decoupled_test.py | 178 | CODE | |
| LOW | …ython/decoupled/models/decoupled_bls_stream/1/model.py | 77 | CODE | |
| LOW | …backend_python/response_sender/response_sender_test.py | 181 | CODE | |
| LOW | qa/L0_backend_python/io/io_test.py | 68 | CODE | |
| LOW | qa/L0_backend_python/io/requested_output_model/model.py | 70 | CODE | |
| LOW | qa/L0_backend_python/lifecycle/lifecycle_test.py | 93 | CODE | |
| LOW | …_backend_python/parameters/response_parameters_test.py | 48 | CODE | |
| LOW | …_python/model_readiness/test_models/readiness_model.py | 60 | CODE | |
| LOW | qa/L0_logging/log_format_test.py | 425 | CODE | |
| LOW | qa/L0_logging/log_format_test.py | 474 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 45 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 156 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 314 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 440 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 515 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 616 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 169 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 235 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 291 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 374 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 446 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 526 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 610 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 671 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 795 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 983 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 1166 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 1365 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 1561 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 1776 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 2013 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 2262 | CODE | |
| LOW | qa/L0_sequence_batcher/sequence_batcher_test.py | 2480 | CODE | |
| 77 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …ython/decoupled/models/decoupled_bls_cancel/1/model.py | 0 | this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responses | STRING |
| HIGH | …/models/decoupled_bls_cancel_after_complete/1/model.py | 0 | this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responses | STRING |
| HIGH | …decoupled/models/decoupled_bls_async_cancel/1/model.py | 0 | this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responses | STRING |
| HIGH | …on/decoupled/models/decoupled_execute_error/1/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | …ython/decoupled/models/decoupled_bls_stream/1/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | …led/models/decoupled_send_after_close_error/1/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | …pled/models/decoupled_return_response_error/1/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | …ckend_python/decoupled/models/decoupled_bls/1/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | qa/python_models/dlpack_square/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | qa/python_models/iterative_sequence/model.py | 0 | the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configurat | STRING |
| HIGH | …led/models/decoupled_send_after_close_error/1/model.py | 0 | tries to create a response sender object and use that for sending the response. | STRING |
| HIGH | …pled/models/decoupled_return_response_error/1/model.py | 0 | tries to create a response sender object and use that for sending the response. | STRING |
| HIGH | qa/python_models/response_sender_error/model.py | 0 | tries to create a response sender object and use that for sending the response. | STRING |
| HIGH | qa/common/gen_qa_trt_plugin_models.py | 0 | name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims: | STRING |
| HIGH | qa/common/gen_qa_trt_format_models.py | 0 | name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims: | STRING |
| HIGH | qa/common/gen_qa_models.py | 0 | name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims: | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | build.py | 1314 | RUN userdel tensorrt-server > /dev/null 2>&1 || true \\ | CODE |
| HIGH⚡ | build.py | 1315 | && userdel ubuntu > /dev/null 2>&1 || true \\ | CODE |
| HIGH | build.py | 984 | && (cd /tmp && tar xzf boost.tar.gz) \\ | CODE |
| HIGH | build.py | 1042 | "$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \\ | CODE |
| HIGH | build.py | 1098 | && (cd /tmp && tar xzf boost.tar.gz) \\ | CODE |
| HIGH | build.py | 1119 | && apt-get install -y --no-install-recommends ccache && ccache -p \\ | CODE |
| HIGH | build.py | 1464 | RUN dirname $(find /usr -name "libcudart*.so" -o -name "libnvinf*.so" -o -name "libnvshm*" -type f) | sort -u > /etc/l | CODE |
| HIGH⚡ | qa/L0_sequence_batcher/sequence_batcher_test.py | 3054 | # execution to be a batch of 'null, seq 2'. The second execution should | COMMENT |
| HIGH⚡ | qa/L0_sequence_batcher/sequence_batcher_test.py | 3165 | # execution to be a batch of 'null, seq 2'. Both executions should be | COMMENT |
| HIGH | qa/L0_sequence_batcher/sequence_batcher_test.py | 2943 | # execution to be a batch of 'null, seq 2'. The executions should not be | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …on/openai/openai_frontend/frontend/fastapi_frontend.py | 27 | CODE | |
| LOW | python/openai/openai_frontend/frontend/frontend.py | 27 | CODE | |
| LOW | python/openai/openai_frontend/schemas/openai.py | 31 | CODE | |
| LOW | python/openai/openai_frontend/engine/engine.py | 28 | CODE | |
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 28 | CODE | |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 31 | CODE | |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 32 | CODE | |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 33 | CODE | |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 33 | CODE | |
| LOW | python/openai/tests/test_lora.py | 47 | CODE | |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 3365 | CODE | |
| LOW | qa/L0_rate_limiter/rate_limiter_test.py | 42 | CODE | |
| LOW | …no_duplication/subadd_repo/composing_subadd/1/model.py | 6 | CODE | |
| LOW | …no_duplication/addsub_repo/composing_addsub/1/model.py | 6 | CODE | |
| LOW | …le_duplication/subadd_repo/composing_subadd/1/model.py | 6 | CODE | |
| LOW | …le_duplication/addsub_repo/composing_addsub/1/model.py | 6 | CODE | |
| LOW | …amic_resolution/subadd_repo/composing_model/1/model.py | 6 | CODE | |
| LOW | …amic_resolution/addsub_repo/composing_model/1/model.py | 6 | CODE | |
| LOW | …est_duplication/subadd_repo/composing_model/1/model.py | 6 | CODE | |
| LOW | …est_duplication/addsub_repo/composing_model/1/model.py | 6 | CODE | |
| LOW | qa/L0_http/python_http_aio_test.py | 31 | CODE | |
| LOW | qa/L0_http/http_input_size_limit_test.py | 40 | CODE | |
| LOW | qa/L0_backend_python/test_infer_shm_leak.py | 34 | CODE | |
| LOW | qa/L0_backend_python/test_infer_shm_leak.py | 39 | CODE | |
| LOW | qa/L0_backend_python/python_test.py | 41 | CODE | |
| LOW | qa/L0_backend_python/ensemble/ensemble_test.py | 39 | CODE | |
| LOW | qa/L0_backend_python/decoupled/decoupled_test.py | 42 | CODE | |
| LOW | …/models/decoupled_bls_cancel_after_complete/1/model.py | 26 | CODE | |
| LOW | …decoupled/models/decoupled_bls_async_cancel/1/model.py | 26 | CODE | |
| LOW | qa/L0_backend_python/io/io_test.py | 42 | CODE | |
| LOW | qa/L0_backend_python/lifecycle/lifecycle_test.py | 47 | CODE | |
| LOW | qa/L0_backend_python/restart/restart_test.py | 39 | CODE | |
| LOW | …/L0_backend_python/model_control/model_control_test.py | 42 | CODE | |
| LOW | …on/python_based_backends/python_based_backends_test.py | 34 | CODE | |
| LOW | qa/L0_backend_python/logging/logging_test.py | 38 | CODE | |
| LOW | qa/L0_server_status/server_status_test.py | 41 | CODE | |
| LOW | qa/L0_http_fuzz/fuzztest.py | 39 | CODE | |
| LOW | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 46 | CODE | |
| LOW | qa/L0_pytorch_python_runtime/infer.py | 35 | CODE | |
| LOW | qa/python_models/bls/model.py | 27 | CODE | |
| LOW | qa/L0_model_queue/model_queue_test.py | 38 | CODE | |
| LOW | qa/L0_grpc/python_grpc_aio_test.py | 31 | CODE | |
| LOW | qa/L0_response_cache/ensemble_cache_test.py | 40 | CODE | |
| LOW | qa/common/sequence_util.py | 41 | CODE | |
| LOW | qa/common/shm_util.py | 32 | CODE | |
| LOW | qa/common/shm_util.py | 41 | CODE | |
| LOW | qa/common/infer_util.py | 42 | CODE | |
| LOW | qa/L0_cuda_graph/trt_cuda_graph_test.py | 38 | CODE | |
| LOW | qa/L0_metrics/pinned_memory_metrics_test.py | 37 | CODE | |
| LOW | qa/L0_infer/infer_test.py | 39 | CODE | |
| LOW | qa/L0_long_running_stress/stress.py | 31 | CODE | |
| LOW | qa/L0_model_config/compare_status.py | 38 | CODE | |
| LOW | docs/conf.py | 50 | CODE | |
| LOW | docs/conf.py | 51 | CODE | |
| LOW | docs/conf.py | 53 | CODE | |
| LOW | src/python/tritonfrontend/__init__.py | 29 | CODE | |
| LOW | src/python/tritonfrontend/__init__.py | 30 | CODE | |
| LOW | src/python/tritonfrontend/__init__.py | 30 | CODE | |
| LOW | src/python/tritonfrontend/__init__.py | 33 | CODE | |
| LOW | src/python/tritonfrontend/__init__.py | 39 | CODE | |
| 5 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 195 | cshm.create_shared_memory_region("dummy_data", -1, 0) | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 200 | shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0) | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 205 | "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8 | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 216 | shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0) | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 217 | self.triton_client.unregister_cuda_shared_memory("dummy_data") | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 227 | shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0) | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 229 | "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8 | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 231 | self.triton_client.unregister_cuda_shared_memory("dummy_data") | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 241 | shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0) | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 243 | "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8 | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 247 | "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8 | CODE |
| LOW⚡ | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 251 | "shared memory region 'dummy_data' already in manager", str(ex) | CODE |
| LOW | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 159 | shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0) | CODE |
| LOW | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 173 | "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8 | CODE |
| LOW | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 180 | self.triton_client.unregister_cuda_shared_memory("dummy_data") | CODE |
| LOW | qa/L0_parameters/parameters_test.py | 288 | parameters = {reserved_key: "dummy-value"} | CODE |
| LOW⚡ | qa/L0_parameters/parameters_test.py | 338 | body, extra_headers={reserved_key: "dummy-value"} | CODE |
| LOW | qa/L0_parameters/parameters_test.py | 356 | headers={reserved_key: "dummy-value"}, | CODE |
| LOW | qa/L0_parameters/parameters_test.py | 363 | headers={reserved_key: "dummy-value"}, | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 186 | shm.create_shared_memory_region("dummy_data", "/dummy_data", -1) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 191 | shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 195 | self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 205 | shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 206 | self.triton_client.unregister_system_shared_memory("dummy_data") | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 216 | shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 217 | self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 218 | self.triton_client.unregister_system_shared_memory("dummy_data") | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 228 | shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 229 | self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8) | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 232 | "dummy_data", "/dummy_data", 8 | CODE |
| LOW⚡ | qa/L0_shared_memory/shared_memory_test.py | 236 | "shared memory region 'dummy_data' already in manager", str(ex) | CODE |
| LOW | qa/L0_shared_memory/shared_memory_test.py | 151 | shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8) | CODE |
| LOW | qa/L0_shared_memory/shared_memory_test.py | 165 | "dummy_data", "/dummy_data", 8 | CODE |
| LOW | qa/L0_shared_memory/shared_memory_test.py | 172 | self.triton_client.unregister_system_shared_memory("dummy_data") | CODE |
| LOW | qa/L0_storage_S3/test.sh | 97 | aws configure set aws_access_key_id "dummy_id" && \ | CODE |
| LOW | qa/L0_storage_S3/test.sh | 98 | aws configure set aws_secret_access_key "dummy_key" | CODE |
| LOW | qa/L0_storage_S3/test.sh | 140 | aws configure set aws_access_key_id "dummy_id" && \ | CODE |
| LOW | qa/L0_storage_S3/test.sh | 141 | aws configure set aws_secret_access_key "dummy_key" | CODE |
| LOW | qa/L0_storage_S3/test.sh | 199 | aws configure set aws_access_key_id "dummy_id" && \ | CODE |
| LOW | qa/L0_storage_S3/test.sh | 200 | aws configure set aws_secret_access_key "dummy_key" | CODE |
| LOW⚡ | qa/L0_client_timeout/client_non_infer_timeout_test.py | 305 | "dummy_data", byte_size=byteSize, device_id=0 | CODE |
| LOW⚡ | qa/L0_client_timeout/client_non_infer_timeout_test.py | 310 | "dummy_data", | CODE |
| LOW⚡ | qa/L0_client_timeout/client_non_infer_timeout_test.py | 319 | "dummy_data", | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …rontend/frontend/fastapi/middleware/api_restriction.py | 193 | # Check if the request matches any restricted patterns | COMMENT |
| LOW | python/openai/openai_frontend/engine/utils/triton.py | 639 | # Check if the files exist | COMMENT |
| LOW | python/openai/tests/test_chat_completions.py | 288 | # Check if the number of words is around max_completion_tokens | COMMENT |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 485 | # Check if the deployment directory exists | STRING |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 520 | # Check if the model name is empty or only contains whitespace, tabs, or newlines | STRING |
| LOW | qa/L0_lifecycle/retry_model/1/model.py | 50 | # Check if an special file has been created in the version directory, | COMMENT |
| LOW | qa/L0_batcher/queue_timeout_test.py | 81 | # Check if the request has timed-out | COMMENT |
| LOW | qa/L0_http/test.sh | 521 | # Check if the server is still working after the above bad requests | COMMENT |
| LOW | …equence_corrid_batcher/sequence_corrid_batcher_test.py | 236 | # Check if the corrid data type matches the expected corrid data type specified in the model config | COMMENT |
| LOW | …/L0_backend_python/model_control/model_control_test.py | 104 | # Check if curl is available | COMMENT |
| LOW | qa/L0_backend_python/logging/test.sh | 107 | # Check if correct # log messages are present [ non-verbose-msg-cnt | verbose-msg-cnt ] | COMMENT |
| LOW | qa/L0_logging/test.sh | 125 | # Check if the current settings are returned [ file | info | warn | error | verbosity |format ] | COMMENT |
| LOW | qa/L0_logging/test.sh | 370 | # Check if the current settings are returned [ file | info | warn | error | verbosity |format ] | COMMENT |
| LOW | qa/L0_trace/test.sh | 232 | # Check if the current setting is returned | COMMENT |
| LOW | qa/L0_trace/test.sh | 292 | # Check if the current setting is returned (not specified setting from global) | COMMENT |
| LOW | qa/L0_trace/test.sh | 302 | # Check if the current setting is returned (not specified setting from global) | COMMENT |
| LOW | qa/L0_trace/test.sh | 386 | # Check if the current setting is returned | COMMENT |
| LOW | qa/L0_trace/test.sh | 417 | # Check if the current setting (global) is returned | COMMENT |
| LOW | qa/L0_trace/test.sh | 514 | # Check if the current setting is returned | COMMENT |
| LOW | qa/L0_trace/test.sh | 562 | # Check if the indexed file has been generated when trace count reaches 0 | COMMENT |
| LOW | qa/L0_pytorch_python_runtime/test.sh | 150 | # Print result and exit | COMMENT |
| LOW | qa/python_models/bls/model.py | 313 | # Check if any of the threads had an exception | COMMENT |
| LOW | qa/L0_cmdline_trace/test.sh | 469 | # Check if the traces are captured with proper hierarchy | COMMENT |
| LOW | qa/L0_cmdline_trace/test.sh | 528 | # Check if the traces are captured with proper hierarchy | COMMENT |
| LOW | qa/L0_response_cache/test.sh | 412 | # Check if the JSON data file was generated | COMMENT |
| LOW | qa/common/check_copyright.py | 208 | # Check if the copyright year line matches the regex | STRING |
| LOW | qa/common/check_massif_log.py | 41 | # Read the file | COMMENT |
| LOW | qa/L0_storage_S3_local/mock_s3_service.py | 109 | # Print the result | COMMENT |
| LOW | qa/L0_simple_ensemble/ensemble_backpressure_test.py | 100 | # Add response to list if it has data (not empty final-only response) | COMMENT |
| LOW | qa/L0_simple_ensemble/ensemble_backpressure_test.py | 104 | # Check if this is the final response | COMMENT |
| LOW | qa/L0_metrics/test.sh | 192 | # Check if memory usage HAS reduced to 0 after using the --enable-peer-access flag | COMMENT |
| LOW | qa/L0_infer/test.sh | 323 | # Check if running a memory leak check | COMMENT |
| LOW | qa/L0_mlflow/plugin_test.py | 110 | # Check if the additional files are properly copied | COMMENT |
| LOW | qa/L0_model_update/instance_update_test.py | 69 | # Check if the test passed for this test case that is tearing down | COMMENT |
| LOW | docs/generate_docs.py | 230 | # Check if target is valid for conversion | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | python/openai/openai_frontend/engine/utils/triton.py | 303 | # FIXME: This could be a bit more robust by reading byte size from first | COMMENT |
| MEDIUM | …ne/utils/tool_call_parsers/mistral_tool_call_parser.py | 220 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | …gine/utils/tool_call_parsers/llama_tool_call_parser.py | 221 | # re-set stuff pertaining to progress in the current tool | COMMENT |
| MEDIUM | qa/L0_lifecycle/test.sh | 1442 | # some more comprehensive fuzz attacks. | COMMENT |
| MEDIUM | qa/L0_trace/opentelemetry_unittest.py | 102 | # Essentially, this is what will be injected to headers/metadata | COMMENT |
| MEDIUM | qa/python_models/bls_request_rescheduling/model.py | 38 | # TODO: Make this more robust to wait until fully unloaded | COMMENT |
| MEDIUM | qa/python_models/bls_model_loading/model.py | 42 | # TODO: Make this more robust to wait until fully unloaded | COMMENT |
| MEDIUM | qa/L0_response_cache/test.sh | 119 | # Redis >= 6.0 and is more comprehensive in what can be configured. | COMMENT |
| MEDIUM | qa/common/gen_qa_trt_plugin_models.py | 323 | # Linux can leverage LD_PRELOAD. We must load the Windows plugin manually | STRING |
| LOW | qa/common/gen_qa_dyna_sequence_models.py | 222 | # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID') | COMMENT |
| LOW | qa/common/gen_qa_dyna_sequence_models.py | 334 | # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID') | COMMENT |
| LOW | qa/common/gen_qa_dyna_sequence_models.py | 718 | # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID') | STRING |
| LOW | qa/common/gen_qa_sequence_models.py | 204 | # just return 0 if not-ready and 'INPUT'+'START' otherwise... the | COMMENT |
| LOW | qa/common/gen_qa_sequence_models.py | 297 | # just return 0 if not-ready and 'INPUT'+'START' otherwise... the | COMMENT |
| LOW | qa/common/gen_qa_sequence_models.py | 604 | # just return 0 if not-ready and 'INPUT'+'START' otherwise... the | STRING |
| LOW | qa/common/gen_qa_dyna_sequence_implicit_models.py | 54 | # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID') | COMMENT |
| MEDIUM | qa/L0_metrics/metrics_queue_size_test.py | 281 | # is less comprehensive on checking exact queue values, and just verifies | COMMENT |
| LOW | qa/L0_metrics/test.sh | 382 | # Don't use special debug env var for this, just set sufficient parameters for | COMMENT |
| MEDIUM | qa/L0_model_config/test.sh | 79 | # load the files provided in the version directory. Essentially, | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/openai/tests/test_openai_restricted_apis.py | 102 | CODE | |
| LOW | python/openai/tests/test_openai_restricted_apis.py | 124 | CODE | |
| LOW | python/openai/tests/test_openai_restricted_apis.py | 142 | CODE | |
| LOW | qa/L0_lifecycle/lifecycle_test.py | 3134 | CODE | |
| LOW | qa/L0_cuda_shared_memory/cuda_shared_memory_test.py | 742 | CODE | |
| LOW | qa/L0_storage_swiftstack/infer_test.py | 44 | CODE | |
| LOW | qa/L0_decoupled/decoupled_test.py | 246 | CODE | |
| LOW | qa/python_models/pytorch_fp32_fp32/model.py | 57 | CODE | |
| LOW | qa/python_models/response_sender/model_common.py | 114 | CODE | |
| LOW | qa/common/gen_ensemble_model_utils.py | 50 | CODE | |
| LOW | qa/common/gen_qa_models.py | 1531 | CODE | |
| LOW | qa/common/infer_test.py | 51 | CODE | |
| LOW | qa/common/infer_util.py | 99 | CODE | |
| LOW | qa/common/infer_util.py | 737 | CODE | |
| LOW | qa/common/infer_util.py | 1019 | CODE | |
| LOW | qa/common/infer_util.py | 1363 | CODE | |
| LOW | qa/L0_grpc_state_cleanup/cleanup_test.py | 333 | CODE | |
| LOW | qa/L0_infer_variable/infer_variable_test.py | 59 | CODE | |
| LOW | qa/L0_infer/infer_test.py | 92 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW⚡ | README.md | 92 | # Step 1: Create the example model repository | COMMENT |
| LOW⚡ | README.md | 97 | # Step 2: Launch triton from the NGC Triton container | COMMENT |
| LOW⚡ | README.md | 100 | # Step 3: Sending an Inference Request | COMMENT |
| LOW | qa/python_models/identity_bf16/model.py | 83 | # NOTE: The following helper function is for testing and example | COMMENT |
| LOW | qa/L0_simple_ensemble/test.sh | 434 | # Step 1 - decoupled_producer (batch size 2) | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | deploy/gke-marketplace-app/README.md | 59 | Users need to follow these [instructions](https://cloud.google.com/kubernetes-engine/docs/how-to/kubernetes-service-acco | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | python/openai/openai_frontend/engine/triton_engine.py | 101 | logger = logging.getLogger(__name__) | CODE |
| LOW | …ai_frontend/engine/utils/tool_call_parsers/__init__.py | 35 | __all__ = [ | CODE |
| LOW | …ploy/mlflow-triton-plugin/mlflow_triton/deployments.py | 50 | logger = logging.getLogger(__name__) | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | qa/L0_trace/test.sh | 214 | #======================================= | COMMENT |