Repository Analysis

triton-inference-server/server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

14.6 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of triton-inference-server/server, a Python project with 10,831 GitHub stars. SynthScan v2.0 examined 182,760 lines of code across 790 source files, recording 2434 pattern matches distributed across 16 syntactic categories. The overall adjusted score of 14.6 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

14.6
Adjusted Score
14.6
Raw Score
100%
Time Factor
2026-07-14
Last Push
10.8K
Stars
Python
Language
182.8K
Lines of Code
790
Files
2.4K
Pattern Hits
2026-07-14
Scan Date
0.03
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 0HIGH 27MEDIUM 144LOW 2263

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 2434 distinct pattern matches across 16 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Over-Commented Block832 hits · 824 pts
SeverityFileLineSnippetContext
LOWbuild.py1#!/usr/bin/env python3COMMENT
LOWbuild.py41import distroCOMMENT
LOWbuild.py61# upstream container version,COMMENT
LOWCMakeLists.txt1# Copyright 2020-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWcompose.py1#!/usr/bin/env python3COMMENT
LOW.pre-commit-config.yaml1# Copyright 2023-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpyproject.toml1# Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpyproject.toml21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWREADME.md1<!--COMMENT
LOWCONTRIBUTING.md1<!--COMMENT
LOWSECURITY.md1<!--COMMENT
LOWtools/add_copyright.py1# Copyright (c) 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWtools/add_copyright.py161 with open(path, "w") as f:COMMENT
LOWdocker/entrypoint.d/99-check-run-aip-mode.sh1#!/bin/bashCOMMENT
LOWdocker/cpu_only/nvidia_entrypoint.sh1#!/bin/bashCOMMENT
LOWpython/openai/requirements.txt1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/requirements.txt21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/requirements-test.txt1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/requirements-test.txt21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/README.md1<!--COMMENT
LOWpython/openai/openai_frontend/__init__.py1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/openai_frontend/main.py1#!/usr/bin/env python3COMMENT
LOW…on/openai/openai_frontend/frontend/fastapi_frontend.py1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/frontend/frontend.py1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/frontend/__init__.py1# Copyright (c) 2024, NVIDIA CORPORATION. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/frontend/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOW…on/openai/openai_frontend/frontend/fastapi/__init__.py1# Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…on/openai/openai_frontend/frontend/fastapi/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOW…nai/openai_frontend/frontend/fastapi/routers/models.py1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…i/openai_frontend/frontend/fastapi/routers/__init__.py1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…i/openai_frontend/frontend/fastapi/routers/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOW…nai_frontend/frontend/fastapi/routers/observability.py1# Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…penai_frontend/frontend/fastapi/routers/completions.py1# Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…penai/openai_frontend/frontend/fastapi/routers/chat.py1# Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…openai_frontend/frontend/fastapi/routers/embeddings.py1# Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…_frontend/frontend/fastapi/routers/model_management.py1# Copyright 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…i_frontend/frontend/fastapi/middleware/request_size.py1# Copyright 2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…penai_frontend/frontend/fastapi/middleware/__init__.py1# Copyright 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOW…penai_frontend/frontend/fastapi/middleware/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOW…rontend/frontend/fastapi/middleware/api_restriction.py1# Copyright 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/utils/utils.py1# Copyright 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/schemas/__init__.py1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/schemas/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/openai_frontend/schemas/openai.py1# Copyright (c) 2024-2025, NVIDIA CORPORATION. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/__init__.py1# Copyright (c) 2024, NVIDIA CORPORATION. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/openai_frontend/engine/engine.py1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/triton_engine.py1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/utils/triton.py1# Copyright 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/utils/__init__.py1# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/utils/__init__.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOWpython/openai/openai_frontend/engine/utils/tokenizer.py1# Copyright (c) 2024-2026, NVIDIA CORPORATION. All rights reserved.COMMENT
LOWpython/openai/openai_frontend/engine/utils/chat.py1# Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.COMMENT
LOW…end/engine/utils/tool_call_parsers/tool_call_parser.py1# Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.COMMENT
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py1# Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.COMMENT
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py1# Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.COMMENT
LOW…penai_frontend/engine/utils/tool_call_parsers/utils.py1# Copyright (c) 2025-2026, NVIDIA CORPORATION. All rights reserved.COMMENT
LOW…penai_frontend/engine/utils/tool_call_parsers/utils.py21# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, ORCOMMENT
LOW…gine/utils/tool_call_parsers/llama_tool_call_parser.py1# Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.COMMENT
772 more matches not shown…
Hyper-Verbose Identifiers821 hits · 796 pts
SeverityFileLineSnippetContext
LOWbuild.py412def cmake_repoagent_extra_args():CODE
LOWbuild.py794def fastertransformer_cmake_args():CODE
LOWbuild.py881def create_dockerfile_buildbase_rhel(ddir, dockerfile_name, argmap):STRING
LOWbuild.py1006def create_dockerfile_buildbase(ddir, dockerfile_name, argmap):STRING
LOWbuild.py1266def dockerfile_prepare_container_linux(argmap, backends, enable_gpu, target_machine):STRING
LOWbuild.py1495def add_cpu_libs_to_linux_dockerfile(backends, target_machine):STRING
LOWbuild.py1557def change_default_python_version_rhel(version):STRING
LOWbuild.py1648def create_docker_build_script(script_name, container_install_dir, container_ci_dir):STRING
LOWcompose.py174def get_container_version_if_not_specified():STRING
LOWtools/add_copyright.py372def test_adding_new_copyrights(content, extension, expected):CODE
LOWtools/add_copyright.py376def test_license_has_current_year():CODE
LOWpython/openai/README.md803def get_n_day_weather_forecast(city: str, state: str, unit: str, num_days: int):CODE
LOW…on/openai/openai_frontend/frontend/fastapi_frontend.py138 def _add_api_restriction_middleware(self, app: FastAPI):CODE
LOW…on/openai/openai_frontend/frontend/fastapi_frontend.py146 def _add_request_size_limit_middleware(self, app: FastAPI):CODE
LOW…i_frontend/frontend/fastapi/middleware/request_size.py138 def _oversized_request_message(actual_bytes: int, max_bytes: int) -> str:CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py299 def _get_chat_completion_response_message(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py471 def _determine_request_converter(self, backend: str, request_type: RequestKind):CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py616 def _get_streaming_chat_response_chunk(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py634 def _get_first_streaming_chat_response(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py792 def _get_streaming_response_delta(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py959 def _verify_chat_tool_call_settings(self, request: CreateChatCompletionRequest):CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py996 async def _streaming_completion_iterator(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py1064 def _validate_completion_request(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py1140 def _validate_embedding_request(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py1166 def _should_stream_with_auto_tool_parsing(CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py1176 def _should_check_for_unstreamed_tool_arg_tokens(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py70def _create_vllm_generate_request(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py179def _create_trtllm_generate_request(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py252def _create_vllm_embedding_request(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py272def _create_trtllm_embedding_request(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py281def _construct_string_from_pointer(pointer: int, size: int) -> str:CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py429def _get_logprobs_from_response(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py468def _get_openai_chat_format_logprobs_from_vllm_response(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py526def _get_openai_completion_format_logprobs_from_vllm_response(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py584def _validate_triton_responses_non_streaming(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py597def _get_guided_json_from_tool(CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py620def _validate_lora_path_trtllm(repo_path: str, lora_path: str, lora_name: str):CODE
LOWpython/openai/openai_frontend/engine/utils/chat.py61def _frontend_schema_to_openai_schema_completion_tool_call(CODE
LOWpython/openai/openai_frontend/engine/utils/chat.py74def _parse_chat_message_content_parts(CODE
LOWpython/openai/openai_frontend/engine/utils/chat.py91def _parse_chat_message_content(CODE
LOW…end/engine/utils/tool_call_parsers/tool_call_parser.py61 def parse_tool_calls_streaming(CODE
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py58def generate_mistral_random_id():CODE
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py144 def parse_tool_calls_streaming(CODE
LOW…penai_frontend/engine/utils/tool_call_parsers/utils.py106def extract_intermediate_diff(curr: str, old: str) -> str:CODE
LOW…gine/utils/tool_call_parsers/llama_tool_call_parser.py137 def parse_tool_calls_streaming(CODE
LOWpython/openai/tests/conftest.py70def infer_test_model_repository(backend, tool_call_parser):CODE
LOWpython/openai/tests/conftest.py167def fastapi_client_class_scope(CODE
LOWpython/openai/tests/conftest.py187def pytest_collection_modifyitems(session, config, items):CODE
LOWpython/openai/tests/test_tool_calling.py151 def validate_tool_calls_present(CODE
LOWpython/openai/tests/test_tool_calling.py162 def validate_weather_tool_arguments(self, parsed_arguments: Dict):CODE
LOWpython/openai/tests/test_tool_calling.py171 def validate_weather_forcast_tool_arguments(self, parsed_arguments: Dict):CODE
LOWpython/openai/tests/test_tool_calling.py182 async def test_tool_call_and_choice(CODE
LOWpython/openai/tests/test_tool_calling.py297 async def test_tool_call_with_reply_response(CODE
LOWpython/openai/tests/test_tool_calling.py357 async def test_tool_call_with_named_tool_choice(CODE
LOWpython/openai/tests/test_tool_calling.py460 async def test_tool_call_with_required_tool_choice(CODE
LOWpython/openai/tests/test_tool_calling.py563 async def test_inconsistent_tool_choice_and_tools(CODE
LOWpython/openai/tests/test_tool_calling.py663 def test_truncated_when_tool_call_exceeds_limit(self, client):CODE
LOWpython/openai/tests/test_tool_calling.py668 def test_not_truncated_within_limit(self, client):CODE
LOWpython/openai/tests/test_tool_calling.py673 def test_limit_ignored_without_tools(self, client):CODE
LOWpython/openai/tests/test_model_management.py316 def test_load_rejects_duplicate(self, base_url):CODE
761 more matches not shown…
Self-Referential Comments111 hits · 274 pts
SeverityFileLineSnippetContext
MEDIUMbuild.py1309# Create a user that can be used to run triton asCOMMENT
MEDIUMpython/openai/openai_frontend/engine/utils/triton.py284 # Create a ctypes string bufferCOMMENT
MEDIUMqa/L0_nan_inf/models/nan_inf_output/1/model.py38 """This function is called on inference request."""STRING
MEDIUMqa/L0_lifecycle/lifecycle_test.py1828 # Create a new version for reloadCOMMENT
MEDIUMqa/L0_model_namespacing/python_subadd/__init__.py97 """This function is called on inference request."""STRING
MEDIUMqa/L0_model_namespacing/python_addsub/__init__.py97 """This function is called on inference request."""STRING
MEDIUMqa/L0_http/test.sh253# Create a password file with username:passwordCOMMENT
MEDIUMqa/L0_backend_python/setup_python_enviroment.sh54# Create a model with python 3.11 versionCOMMENT
MEDIUM…on/decoupled/models/decoupled_execute_error/1/model.py63 """This function is called on inference request."""STRING
MEDIUM…ython/decoupled/models/decoupled_bls_stream/1/model.py60 """This function is called on inference request."""STRING
MEDIUM…ckend_python/decoupled/models/decoupled_bls/1/model.py77 """This function is called on inference request."""STRING
MEDIUMqa/L0_sequence_batcher/test.sh282 # Create the input_state_data file.COMMENT
MEDIUMqa/L0_cuda_shared_memory/cuda_shared_memory_test.py199 # Create a valid cuda shared memory region, fill data in it and registerCOMMENT
MEDIUMqa/L0_cuda_shared_memory/cuda_shared_memory_test.py215 # Create a valid cuda shared memory region and unregister before registerCOMMENT
MEDIUMqa/L0_cuda_shared_memory/cuda_shared_memory_test.py226 # Create a valid cuda shared memory region and unregister after registerCOMMENT
MEDIUMqa/L0_cuda_shared_memory/cuda_shared_memory_test.py240 # Create a valid cuda shared memory region and unregister after registerCOMMENT
MEDIUMqa/L0_perf_resnet/test.sh94# Create the TensorRT plan from ONNX modelCOMMENT
MEDIUMqa/L0_perf_resnet/test.sh156# Create the TensorRT plan from ONNX modelCOMMENT
MEDIUMqa/L0_trace/trace_stress_grpc_client.py61 # Define the callback function. Note the last two parameters should beCOMMENT
MEDIUMqa/L0_trace/models/input_all_required/1/model.py39 """This function is called on inference request."""STRING
MEDIUMqa/L0_string_io/string_client_test.py103 # Create the data for the input tensor. Initialize the tensor to 8COMMENT
MEDIUMqa/L0_nullchar_string/nullchar_string_client.py77 # Create the inference context for the model.COMMENT
MEDIUMqa/L0_nullchar_string/nullchar_string_client.py85 # Create the data for the input tensor. It contains a null character inCOMMENT
MEDIUMqa/L0_sequence_stress/sequence_stress.py182 # Create a variable length sequence with "start" and "end" flags.COMMENT
MEDIUMqa/L0_sequence_stress/sequence_stress.py305 # Create a sequence without a "start" flag. Sequence should get anCOMMENT
MEDIUMqa/L0_sequence_stress/sequence_stress.py344 # Create a variable length sequence with "start" flag but thatCOMMENT
MEDIUMqa/L0_sequence_stress/sequence_stress.py609 # Create the seed for the thread. Since these are created inCOMMENT
MEDIUMqa/L0_libtorch_io_names/io_names_client.py46 # Create the data for the two inputs. Initialize the first to uniqueCOMMENT
MEDIUMqa/python_models/add_sub/model.py48 """This function is called on inference request."""STRING
MEDIUMqa/python_models/cuda_memory_consumer/1/model.py63 """This function is called on inference request."""STRING
MEDIUMqa/python_models/string_identity/model.py41 """This function is called on inference request."""STRING
MEDIUMqa/python_models/request_rescheduling_addsub/model.py49 """This function is called on inference request."""STRING
MEDIUMqa/python_models/sub_add/model.py51 """This function is called on inference request."""STRING
MEDIUMqa/python_models/execute_error/model.py32 """This function is called on inference request."""STRING
MEDIUMqa/python_models/execute_grpc_error/model.py36 """This function is called on inference request."""STRING
MEDIUMqa/python_models/python_version/model.py61 """This function is called on inference request."""STRING
MEDIUMqa/python_models/auto_complete/model.py63 """This function is called on inference request."""STRING
MEDIUM…_models/python_based_backends/add_sub_backend/model.py38 """This function is called only once when loading the model assumingSTRING
MEDIUM…_models/python_based_backends/add_sub_backend/model.py125 """This function is called when an inference request is madeSTRING
MEDIUMqa/L0_grpc/test.sh407# Create a password file with username:passwordCOMMENT
MEDIUMqa/L0_perf_deeprecommender/test.sh56# Create the TensorRT plan from ONNXCOMMENT
MEDIUMqa/L0_perf_deeprecommender/test.sh125# Create the TensorRT plan from ONNXCOMMENT
MEDIUMqa/common/libtorch_infer_client.py61 # Create the data for the two input tensors. Initialize the firstCOMMENT
MEDIUMqa/common/gen_qa_ort_scalar_models.py44 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_ort_scalar_models.py78 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_ragged_models.py163 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_ragged_models.py292 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_ragged_models.py474 # Create the modelSTRING
MEDIUMqa/common/gen_qa_ragged_models.py521 # Create the modelSTRING
MEDIUMqa/common/gen_qa_dyna_sequence_models.py221 # Create the model. For now don't implement a proper accumulatorCOMMENT
MEDIUMqa/common/gen_qa_dyna_sequence_models.py333 # Create the model. For now don't implement a proper accumulatorCOMMENT
MEDIUMqa/common/gen_qa_dyna_sequence_models.py717 # Create the model. For now don't implement a proper accumulatorSTRING
MEDIUMqa/common/gen_qa_sequence_models.py203 # Create the model. For now don't implement a proper accumulatorCOMMENT
MEDIUMqa/common/gen_qa_sequence_models.py296 # Create the model. For now don't implement a proper accumulatorCOMMENT
MEDIUMqa/common/gen_qa_sequence_models.py603 # Create the model. For now don't implement a proper accumulatorSTRING
MEDIUMqa/common/gen_qa_trt_format_models.py83 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_identity_models.py90 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_identity_models.py179 # Create the modelCOMMENT
MEDIUMqa/common/gen_qa_identity_models.py422 # Create the modelSTRING
MEDIUMqa/common/gen_qa_identity_models.py531 # Create the modelSTRING
51 more matches not shown…
Excessive Try-Catch Wrapping316 hits · 266 pts
SeverityFileLineSnippetContext
LOWbuild.py100 except Exception:CODE
LOWcompose.py41 except Exception:CODE
LOW…penai_frontend/frontend/fastapi/routers/completions.py61 except Exception as e:CODE
LOW…penai/openai_frontend/frontend/fastapi/routers/chat.py62 except Exception as e:CODE
LOW…openai_frontend/frontend/fastapi/routers/embeddings.py59 except Exception as e:CODE
LOW…_frontend/frontend/fastapi/routers/model_management.py59 except Exception as e:CODE
LOW…_frontend/frontend/fastapi/routers/model_management.py88 except Exception as e:CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py757 except Exception:CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py700 except Exception:CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py726 except Exception as e:CODE
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py138 except Exception:CODE
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py317 except Exception:CODE
LOW…gine/utils/tool_call_parsers/llama_tool_call_parser.py131 except Exception as e:CODE
LOW…gine/utils/tool_call_parsers/llama_tool_call_parser.py288 except Exception:CODE
LOWpython/openai/tests/utils.py151 except Exception as err:CODE
LOWpython/openai/tests/test_lora.py134 except Exception as e:CODE
MEDIUMpython/openai/tests/test_lora.py45def is_vllm_installed():CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py481 except Exception as e:STRING
MEDIUMqa/L0_lifecycle/lifecycle_test.py91def _infer_success_identity(self, model_base, versions, tensor_dtype, tensor_shaCODE
MEDIUMqa/L0_lifecycle/lifecycle_test.py132def _async_load(self, model_name, use_grpc):CODE
LOWqa/L0_lifecycle/lifecycle_test.py451 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py459 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py1536 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py1546 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py1556 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2173 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2183 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2193 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2855 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2865 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py2874 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py88 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py118 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py136 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py191 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py200 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py228 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py254 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py263 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py291 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py319 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py343 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py363 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py373 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py389 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py409 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py424 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py481 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py496 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py515 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py530 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py553 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py571 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py586 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py629 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py647 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py665 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py712 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py730 except Exception as ex:CODE
LOWqa/L0_lifecycle/lifecycle_test.py746 except Exception as ex:CODE
256 more matches not shown…
Deep Nesting137 hits · 122 pts
SeverityFileLineSnippetContext
LOWbuild.py118CODE
LOWbuild.py550CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py357CODE
LOWpython/openai/openai_frontend/engine/utils/triton.py648CODE
LOW…ne/utils/tool_call_parsers/mistral_tool_call_parser.py144CODE
LOW…gine/utils/tool_call_parsers/llama_tool_call_parser.py137CODE
LOWpython/openai/tests/conftest.py187CODE
LOWpython/openai/tests/conftest.py188CODE
LOWpython/openai/tests/test_tool_calling.py629CODE
LOWpython/openai/tests/test_models/mock_llm/1/model.py73CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py186CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py240CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py335CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py407CODE
LOWqa/L0_trt_reformat_free/trt_reformat_free_test.py47CODE
LOWqa/L0_lifecycle/lifecycle_test.py56CODE
LOWqa/L0_lifecycle/lifecycle_test.py3005CODE
LOWqa/L0_lifecycle/lifecycle_test.py3168CODE
LOWqa/L0_batcher/verify_timestamps.py34CODE
LOWqa/L0_http/http_test.py192CODE
LOWqa/L0_http/http_test.py414CODE
LOWqa/L0_http/http_request_many_chunks.py51CODE
LOW…equence_corrid_batcher/sequence_corrid_batcher_test.py87CODE
LOW…equence_corrid_batcher/sequence_corrid_batcher_test.py231CODE
LOWqa/L0_backend_python/python_test.py248CODE
LOWqa/L0_backend_python/python_test.py490CODE
LOWqa/L0_backend_python/decoupled/decoupled_test.py93CODE
LOWqa/L0_backend_python/decoupled/decoupled_test.py178CODE
LOW…ython/decoupled/models/decoupled_bls_stream/1/model.py77CODE
LOW…backend_python/response_sender/response_sender_test.py181CODE
LOWqa/L0_backend_python/io/io_test.py68CODE
LOWqa/L0_backend_python/io/requested_output_model/model.py70CODE
LOWqa/L0_backend_python/lifecycle/lifecycle_test.py93CODE
LOW…_backend_python/parameters/response_parameters_test.py48CODE
LOW…_python/model_readiness/test_models/readiness_model.py60CODE
LOWqa/L0_logging/log_format_test.py425CODE
LOWqa/L0_logging/log_format_test.py474CODE
LOWqa/L0_server_status/server_status_test.py45CODE
LOWqa/L0_server_status/server_status_test.py156CODE
LOWqa/L0_server_status/server_status_test.py314CODE
LOWqa/L0_server_status/server_status_test.py440CODE
LOWqa/L0_server_status/server_status_test.py515CODE
LOWqa/L0_server_status/server_status_test.py616CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py169CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py235CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py291CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py374CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py446CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py526CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py610CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py671CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py795CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py983CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py1166CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py1365CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py1561CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py1776CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py2013CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py2262CODE
LOWqa/L0_sequence_batcher/sequence_batcher_test.py2480CODE
77 more matches not shown…
Cross-File Repetition16 hits · 80 pts
SeverityFileLineSnippetContext
HIGH…ython/decoupled/models/decoupled_bls_cancel/1/model.py0this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responsesSTRING
HIGH…/models/decoupled_bls_cancel_after_complete/1/model.py0this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responsesSTRING
HIGH…decoupled/models/decoupled_bls_async_cancel/1/model.py0this model sends a decoupled bls inference request to 'response_sender_until_cancelled' model, and sums up its responsesSTRING
HIGH…on/decoupled/models/decoupled_execute_error/1/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGH…ython/decoupled/models/decoupled_bls_stream/1/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGH…led/models/decoupled_send_after_close_error/1/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGH…pled/models/decoupled_return_response_error/1/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGH…ckend_python/decoupled/models/decoupled_bls/1/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGHqa/python_models/dlpack_square/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGHqa/python_models/iterative_sequence/model.py0the model `{}` can generate any number of responses per request, enable decoupled transaction policy in model configuratSTRING
HIGH…led/models/decoupled_send_after_close_error/1/model.py0tries to create a response sender object and use that for sending the response.STRING
HIGH…pled/models/decoupled_return_response_error/1/model.py0tries to create a response sender object and use that for sending the response.STRING
HIGHqa/python_models/response_sender_error/model.py0tries to create a response sender object and use that for sending the response.STRING
HIGHqa/common/gen_qa_trt_plugin_models.py0name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims:STRING
HIGHqa/common/gen_qa_trt_format_models.py0name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims:STRING
HIGHqa/common/gen_qa_models.py0name: "{}" platform: "tensorrt_plan" max_batch_size: {} version_policy: {} input [ {{ name: "input0" data_type: {} dims:STRING
Cross-Language Confusion10 hits · 70 pts
SeverityFileLineSnippetContext
HIGHbuild.py1314RUN userdel tensorrt-server > /dev/null 2>&1 || true \\CODE
HIGHbuild.py1315 && userdel ubuntu > /dev/null 2>&1 || true \\CODE
HIGHbuild.py984 && (cd /tmp && tar xzf boost.tar.gz) \\CODE
HIGHbuild.py1042 "$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \\CODE
HIGHbuild.py1098 && (cd /tmp && tar xzf boost.tar.gz) \\CODE
HIGHbuild.py1119 && apt-get install -y --no-install-recommends ccache && ccache -p \\CODE
HIGHbuild.py1464RUN dirname $(find /usr -name "libcudart*.so" -o -name "libnvinf*.so" -o -name "libnvshm*" -type f) | sort -u > /etc/lCODE
HIGHqa/L0_sequence_batcher/sequence_batcher_test.py3054 # execution to be a batch of 'null, seq 2'. The second execution shouldCOMMENT
HIGHqa/L0_sequence_batcher/sequence_batcher_test.py3165 # execution to be a batch of 'null, seq 2'. Both executions should beCOMMENT
HIGHqa/L0_sequence_batcher/sequence_batcher_test.py2943 # execution to be a batch of 'null, seq 2'. The executions should not beCOMMENT
Unused Imports65 hits · 64 pts
SeverityFileLineSnippetContext
LOW…on/openai/openai_frontend/frontend/fastapi_frontend.py27CODE
LOWpython/openai/openai_frontend/frontend/frontend.py27CODE
LOWpython/openai/openai_frontend/schemas/openai.py31CODE
LOWpython/openai/openai_frontend/engine/engine.py28CODE
LOWpython/openai/openai_frontend/engine/triton_engine.py28CODE
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py31CODE
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py32CODE
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py33CODE
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py33CODE
LOWpython/openai/tests/test_lora.py47CODE
LOWqa/L0_lifecycle/lifecycle_test.py3365CODE
LOWqa/L0_rate_limiter/rate_limiter_test.py42CODE
LOW…no_duplication/subadd_repo/composing_subadd/1/model.py6CODE
LOW…no_duplication/addsub_repo/composing_addsub/1/model.py6CODE
LOW…le_duplication/subadd_repo/composing_subadd/1/model.py6CODE
LOW…le_duplication/addsub_repo/composing_addsub/1/model.py6CODE
LOW…amic_resolution/subadd_repo/composing_model/1/model.py6CODE
LOW…amic_resolution/addsub_repo/composing_model/1/model.py6CODE
LOW…est_duplication/subadd_repo/composing_model/1/model.py6CODE
LOW…est_duplication/addsub_repo/composing_model/1/model.py6CODE
LOWqa/L0_http/python_http_aio_test.py31CODE
LOWqa/L0_http/http_input_size_limit_test.py40CODE
LOWqa/L0_backend_python/test_infer_shm_leak.py34CODE
LOWqa/L0_backend_python/test_infer_shm_leak.py39CODE
LOWqa/L0_backend_python/python_test.py41CODE
LOWqa/L0_backend_python/ensemble/ensemble_test.py39CODE
LOWqa/L0_backend_python/decoupled/decoupled_test.py42CODE
LOW…/models/decoupled_bls_cancel_after_complete/1/model.py26CODE
LOW…decoupled/models/decoupled_bls_async_cancel/1/model.py26CODE
LOWqa/L0_backend_python/io/io_test.py42CODE
LOWqa/L0_backend_python/lifecycle/lifecycle_test.py47CODE
LOWqa/L0_backend_python/restart/restart_test.py39CODE
LOW…/L0_backend_python/model_control/model_control_test.py42CODE
LOW…on/python_based_backends/python_based_backends_test.py34CODE
LOWqa/L0_backend_python/logging/logging_test.py38CODE
LOWqa/L0_server_status/server_status_test.py41CODE
LOWqa/L0_http_fuzz/fuzztest.py39CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py46CODE
LOWqa/L0_pytorch_python_runtime/infer.py35CODE
LOWqa/python_models/bls/model.py27CODE
LOWqa/L0_model_queue/model_queue_test.py38CODE
LOWqa/L0_grpc/python_grpc_aio_test.py31CODE
LOWqa/L0_response_cache/ensemble_cache_test.py40CODE
LOWqa/common/sequence_util.py41CODE
LOWqa/common/shm_util.py32CODE
LOWqa/common/shm_util.py41CODE
LOWqa/common/infer_util.py42CODE
LOWqa/L0_cuda_graph/trt_cuda_graph_test.py38CODE
LOWqa/L0_metrics/pinned_memory_metrics_test.py37CODE
LOWqa/L0_infer/infer_test.py39CODE
LOWqa/L0_long_running_stress/stress.py31CODE
LOWqa/L0_model_config/compare_status.py38CODE
LOWdocs/conf.py50CODE
LOWdocs/conf.py51CODE
LOWdocs/conf.py53CODE
LOWsrc/python/tritonfrontend/__init__.py29CODE
LOWsrc/python/tritonfrontend/__init__.py30CODE
LOWsrc/python/tritonfrontend/__init__.py30CODE
LOWsrc/python/tritonfrontend/__init__.py33CODE
LOWsrc/python/tritonfrontend/__init__.py39CODE
5 more matches not shown…
Fake / Example Data43 hits · 52 pts
SeverityFileLineSnippetContext
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py195 cshm.create_shared_memory_region("dummy_data", -1, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py200 shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py205 "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py216 shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py217 self.triton_client.unregister_cuda_shared_memory("dummy_data")CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py227 shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py229 "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py231 self.triton_client.unregister_cuda_shared_memory("dummy_data")CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py241 shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py243 "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py247 "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py251 "shared memory region 'dummy_data' already in manager", str(ex)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py159 shm_op0_handle = cshm.create_shared_memory_region("dummy_data", 8, 0)CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py173 "dummy_data", cshm.get_raw_handle(shm_op0_handle), 0, 8CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py180 self.triton_client.unregister_cuda_shared_memory("dummy_data")CODE
LOWqa/L0_parameters/parameters_test.py288 parameters = {reserved_key: "dummy-value"}CODE
LOWqa/L0_parameters/parameters_test.py338 body, extra_headers={reserved_key: "dummy-value"}CODE
LOWqa/L0_parameters/parameters_test.py356 headers={reserved_key: "dummy-value"},CODE
LOWqa/L0_parameters/parameters_test.py363 headers={reserved_key: "dummy-value"},CODE
LOWqa/L0_shared_memory/shared_memory_test.py186 shm.create_shared_memory_region("dummy_data", "/dummy_data", -1)CODE
LOWqa/L0_shared_memory/shared_memory_test.py191 shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py195 self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py205 shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py206 self.triton_client.unregister_system_shared_memory("dummy_data")CODE
LOWqa/L0_shared_memory/shared_memory_test.py216 shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py217 self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py218 self.triton_client.unregister_system_shared_memory("dummy_data")CODE
LOWqa/L0_shared_memory/shared_memory_test.py228 shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py229 self.triton_client.register_system_shared_memory("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py232 "dummy_data", "/dummy_data", 8CODE
LOWqa/L0_shared_memory/shared_memory_test.py236 "shared memory region 'dummy_data' already in manager", str(ex)CODE
LOWqa/L0_shared_memory/shared_memory_test.py151 shm_op0_handle = shm.create_shared_memory_region("dummy_data", "/dummy_data", 8)CODE
LOWqa/L0_shared_memory/shared_memory_test.py165 "dummy_data", "/dummy_data", 8CODE
LOWqa/L0_shared_memory/shared_memory_test.py172 self.triton_client.unregister_system_shared_memory("dummy_data")CODE
LOWqa/L0_storage_S3/test.sh97 aws configure set aws_access_key_id "dummy_id" && \CODE
LOWqa/L0_storage_S3/test.sh98 aws configure set aws_secret_access_key "dummy_key"CODE
LOWqa/L0_storage_S3/test.sh140 aws configure set aws_access_key_id "dummy_id" && \CODE
LOWqa/L0_storage_S3/test.sh141 aws configure set aws_secret_access_key "dummy_key"CODE
LOWqa/L0_storage_S3/test.sh199 aws configure set aws_access_key_id "dummy_id" && \CODE
LOWqa/L0_storage_S3/test.sh200 aws configure set aws_secret_access_key "dummy_key"CODE
LOWqa/L0_client_timeout/client_non_infer_timeout_test.py305 "dummy_data", byte_size=byteSize, device_id=0CODE
LOWqa/L0_client_timeout/client_non_infer_timeout_test.py310 "dummy_data",CODE
LOWqa/L0_client_timeout/client_non_infer_timeout_test.py319 "dummy_data",CODE
Redundant / Tautological Comments35 hits · 50 pts
SeverityFileLineSnippetContext
LOW…rontend/frontend/fastapi/middleware/api_restriction.py193 # Check if the request matches any restricted patternsCOMMENT
LOWpython/openai/openai_frontend/engine/utils/triton.py639 # Check if the files existCOMMENT
LOWpython/openai/tests/test_chat_completions.py288 # Check if the number of words is around max_completion_tokensCOMMENT
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py485 # Check if the deployment directory existsSTRING
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py520 # Check if the model name is empty or only contains whitespace, tabs, or newlinesSTRING
LOWqa/L0_lifecycle/retry_model/1/model.py50 # Check if an special file has been created in the version directory,COMMENT
LOWqa/L0_batcher/queue_timeout_test.py81 # Check if the request has timed-outCOMMENT
LOWqa/L0_http/test.sh521# Check if the server is still working after the above bad requestsCOMMENT
LOW…equence_corrid_batcher/sequence_corrid_batcher_test.py236 # Check if the corrid data type matches the expected corrid data type specified in the model configCOMMENT
LOW…/L0_backend_python/model_control/model_control_test.py104 # Check if curl is availableCOMMENT
LOWqa/L0_backend_python/logging/test.sh107# Check if correct # log messages are present [ non-verbose-msg-cnt | verbose-msg-cnt ]COMMENT
LOWqa/L0_logging/test.sh125# Check if the current settings are returned [ file | info | warn | error | verbosity |format ]COMMENT
LOWqa/L0_logging/test.sh370# Check if the current settings are returned [ file | info | warn | error | verbosity |format ]COMMENT
LOWqa/L0_trace/test.sh232# Check if the current setting is returnedCOMMENT
LOWqa/L0_trace/test.sh292# Check if the current setting is returned (not specified setting from global)COMMENT
LOWqa/L0_trace/test.sh302# Check if the current setting is returned (not specified setting from global)COMMENT
LOWqa/L0_trace/test.sh386# Check if the current setting is returnedCOMMENT
LOWqa/L0_trace/test.sh417# Check if the current setting (global) is returnedCOMMENT
LOWqa/L0_trace/test.sh514# Check if the current setting is returnedCOMMENT
LOWqa/L0_trace/test.sh562# Check if the indexed file has been generated when trace count reaches 0COMMENT
LOWqa/L0_pytorch_python_runtime/test.sh150# Print result and exitCOMMENT
LOWqa/python_models/bls/model.py313 # Check if any of the threads had an exceptionCOMMENT
LOWqa/L0_cmdline_trace/test.sh469# Check if the traces are captured with proper hierarchyCOMMENT
LOWqa/L0_cmdline_trace/test.sh528# Check if the traces are captured with proper hierarchyCOMMENT
LOWqa/L0_response_cache/test.sh412 # Check if the JSON data file was generatedCOMMENT
LOWqa/common/check_copyright.py208 # Check if the copyright year line matches the regexSTRING
LOWqa/common/check_massif_log.py41 # Read the fileCOMMENT
LOWqa/L0_storage_S3_local/mock_s3_service.py109 # Print the resultCOMMENT
LOWqa/L0_simple_ensemble/ensemble_backpressure_test.py100 # Add response to list if it has data (not empty final-only response)COMMENT
LOWqa/L0_simple_ensemble/ensemble_backpressure_test.py104 # Check if this is the final responseCOMMENT
LOWqa/L0_metrics/test.sh192# Check if memory usage HAS reduced to 0 after using the --enable-peer-access flagCOMMENT
LOWqa/L0_infer/test.sh323 # Check if running a memory leak checkCOMMENT
LOWqa/L0_mlflow/plugin_test.py110 # Check if the additional files are properly copiedCOMMENT
LOWqa/L0_model_update/instance_update_test.py69 # Check if the test passed for this test case that is tearing downCOMMENT
LOWdocs/generate_docs.py230 # Check if target is valid for conversionCOMMENT
AI Slop Vocabulary19 hits · 41 pts
SeverityFileLineSnippetContext
MEDIUMpython/openai/openai_frontend/engine/utils/triton.py303 # FIXME: This could be a bit more robust by reading byte size from firstCOMMENT
MEDIUM…ne/utils/tool_call_parsers/mistral_tool_call_parser.py220 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUM…gine/utils/tool_call_parsers/llama_tool_call_parser.py221 # re-set stuff pertaining to progress in the current toolCOMMENT
MEDIUMqa/L0_lifecycle/test.sh1442# some more comprehensive fuzz attacks.COMMENT
MEDIUMqa/L0_trace/opentelemetry_unittest.py102 # Essentially, this is what will be injected to headers/metadataCOMMENT
MEDIUMqa/python_models/bls_request_rescheduling/model.py38 # TODO: Make this more robust to wait until fully unloadedCOMMENT
MEDIUMqa/python_models/bls_model_loading/model.py42 # TODO: Make this more robust to wait until fully unloadedCOMMENT
MEDIUMqa/L0_response_cache/test.sh119 # Redis >= 6.0 and is more comprehensive in what can be configured.COMMENT
MEDIUMqa/common/gen_qa_trt_plugin_models.py323 # Linux can leverage LD_PRELOAD. We must load the Windows plugin manuallySTRING
LOWqa/common/gen_qa_dyna_sequence_models.py222 # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID')COMMENT
LOWqa/common/gen_qa_dyna_sequence_models.py334 # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID')COMMENT
LOWqa/common/gen_qa_dyna_sequence_models.py718 # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID')STRING
LOWqa/common/gen_qa_sequence_models.py204 # just return 0 if not-ready and 'INPUT'+'START' otherwise... theCOMMENT
LOWqa/common/gen_qa_sequence_models.py297 # just return 0 if not-ready and 'INPUT'+'START' otherwise... theCOMMENT
LOWqa/common/gen_qa_sequence_models.py604 # just return 0 if not-ready and 'INPUT'+'START' otherwise... theSTRING
LOWqa/common/gen_qa_dyna_sequence_implicit_models.py54 # just return 0 if not-ready and 'INPUT'+'START'*('END'*'CORRID')COMMENT
MEDIUMqa/L0_metrics/metrics_queue_size_test.py281 # is less comprehensive on checking exact queue values, and just verifiesCOMMENT
LOWqa/L0_metrics/test.sh382# Don't use special debug env var for this, just set sufficient parameters forCOMMENT
MEDIUMqa/L0_model_config/test.sh79 # load the files provided in the version directory. Essentially,COMMENT
AI Structural Patterns19 hits · 18 pts
SeverityFileLineSnippetContext
LOWpython/openai/tests/test_openai_restricted_apis.py102CODE
LOWpython/openai/tests/test_openai_restricted_apis.py124CODE
LOWpython/openai/tests/test_openai_restricted_apis.py142CODE
LOWqa/L0_lifecycle/lifecycle_test.py3134CODE
LOWqa/L0_cuda_shared_memory/cuda_shared_memory_test.py742CODE
LOWqa/L0_storage_swiftstack/infer_test.py44CODE
LOWqa/L0_decoupled/decoupled_test.py246CODE
LOWqa/python_models/pytorch_fp32_fp32/model.py57CODE
LOWqa/python_models/response_sender/model_common.py114CODE
LOWqa/common/gen_ensemble_model_utils.py50CODE
LOWqa/common/gen_qa_models.py1531CODE
LOWqa/common/infer_test.py51CODE
LOWqa/common/infer_util.py99CODE
LOWqa/common/infer_util.py737CODE
LOWqa/common/infer_util.py1019CODE
LOWqa/common/infer_util.py1363CODE
LOWqa/L0_grpc_state_cleanup/cleanup_test.py333CODE
LOWqa/L0_infer_variable/infer_variable_test.py59CODE
LOWqa/L0_infer/infer_test.py92CODE
Structural Annotation Overuse5 hits · 10 pts
SeverityFileLineSnippetContext
LOWREADME.md92# Step 1: Create the example model repositoryCOMMENT
LOWREADME.md97# Step 2: Launch triton from the NGC Triton containerCOMMENT
LOWREADME.md100# Step 3: Sending an Inference RequestCOMMENT
LOWqa/python_models/identity_bf16/model.py83 # NOTE: The following helper function is for testing and exampleCOMMENT
LOWqa/L0_simple_ensemble/test.sh434# Step 1 - decoupled_producer (batch size 2)COMMENT
AI Response Leakage1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHdeploy/gke-marketplace-app/README.md59Users need to follow these [instructions](https://cloud.google.com/kubernetes-engine/docs/how-to/kubernetes-service-accoCODE
Modern Structural Boilerplate3 hits · 3 pts
SeverityFileLineSnippetContext
LOWpython/openai/openai_frontend/engine/triton_engine.py101logger = logging.getLogger(__name__)CODE
LOW…ai_frontend/engine/utils/tool_call_parsers/__init__.py35__all__ = [CODE
LOW…ploy/mlflow-triton-plugin/mlflow_triton/deployments.py50logger = logging.getLogger(__name__)CODE
Decorative Section Separators1 hit · 3 pts
SeverityFileLineSnippetContext
MEDIUMqa/L0_trace/test.sh214#=======================================COMMENT