Repository Analysis

Arize-ai/phoenix

AI Observability & Evaluation

12.1 Low AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Arize-ai/phoenix, a Python project with 10,557 GitHub stars. SynthScan v2.0 examined 913,583 lines of code across 4739 source files, recording 8733 pattern matches distributed across 26 syntactic categories. The overall adjusted score of 12.1 places this repository in the Low AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

12.1
Adjusted Score
12.1
Raw Score
100%
Time Factor
2026-07-14
Last Push
10.6K
Stars
Python
Language
913.6K
Lines of Code
4.7K
Files
8.7K
Pattern Hits
2026-07-14
Scan Date
0.07
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 7HIGH 331MEDIUM 783LOW 7612

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 8733 distinct pattern matches across 26 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers5597 hits · 5009 pts
SeverityFileLineSnippetContext
LOWevals/pxi/tests/test_gate.py56def test_zero_scored_rows_with_completed_examples_fails_closed(tmp_path: Path) -> None:CODE
LOWevals/pxi/tests/test_gate.py62def test_fewer_scored_rows_than_completed_fails_closed(tmp_path: Path) -> None:CODE
LOWevals/pxi/tests/test_gate.py81def test_expected_recording_not_bootstrapped_still_fails_closed(tmp_path: Path) -> None:CODE
LOWevals/pxi/tests/test_gate.py94def test_valid_artifact_below_threshold_returns_breach(tmp_path: Path) -> None:CODE
LOWevals/pxi/evaluators/tools.py173def tool_call_count_within_limit(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/tools.py197def _bash_command_expectations(expected: Any) -> list[dict[str, Any]] | None:CODE
LOWevals/pxi/evaluators/tools.py208def evaluate_bash_command_substrings(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/tools.py258def bash_command_substrings_match(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/tools.py408def _matcher_validation_failures(variants: list[dict[str, Any]]) -> dict[str, str]:CODE
LOWevals/pxi/evaluators/tools.py443def _invalid_arg_expectation_reason(expected_for_tool: Any) -> str | None:CODE
LOWevals/pxi/evaluators/tools.py519def evaluate_forbidden_tool_call_args(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/tools.py572def forbidden_tool_call_args_match(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/links.py27def _expects_route_info_before_in_app_links(expected: Any) -> bool:CODE
LOWevals/pxi/evaluators/links.py57def _absolute_app_link_reason(href: str, required_paths: list[str]) -> str | None:CODE
LOWevals/pxi/evaluators/links.py76def _is_root_relative_app_href(href: str) -> bool:CODE
LOWevals/pxi/evaluators/links.py80def _in_app_hrefs_before_tool(output: Any, tool_name: str) -> list[str]:CODE
LOWevals/pxi/evaluators/text.py125def evaluate_assistant_text_substrings(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/evaluators/text.py186def assistant_text_substrings_match(output: Any, expected: Any) -> dict[str, Any]:CODE
LOWevals/pxi/harness/run_experiment.py165def _warn_if_split_smoke_check_fails(phoenix_dataset: Any, expected_splits: set[str]) -> None:CODE
LOWevals/pxi/harness/run_experiment.py175async def _get_split_filtered_dataset(CODE
LOWevals/pxi/harness/run_experiment.py201def _rewrite_stable_example_ids(experiment: RanExperiment, experiment_dataset: Any) -> None:CODE
LOWevals/pxi/harness/agent_task.py121def _warn_placeholder_api_key(provider: str, base_url: str) -> None:CODE
LOWevals/pxi/harness/agent_task.py201def should_build_docs_mcp_server() -> bool:CODE
LOWevals/pxi/harness/agent_task.py210def build_shared_docs_mcp_server() -> MCPToolset[Any] | None:CODE
LOWevals/pxi/harness/agent_task.py470def _assistant_text_from_messages(messages: list[dict[str, Any]]) -> str | None:CODE
LOWevals/pxi/harness/reporting.py166def _has_regression_evaluator_failure(CODE
LOWevals/pxi/harness/reporting.py337def _strip_static_instructions(actual_output: Any) -> tuple[Any, bool]:CODE
LOWapp/tests/playground.spec.ts4function isGraphQLMutationResponse(response: Response, operationName: string) {CODE
LOWapp/tests/settings-general-tables.spec.ts3async function clickSortableHeaderAndExpect(CODE
LOWapp/tests/datasets.spec.ts35async function clickSortableHeaderAndExpect(CODE
LOWapp/tests/label-list-management.spec.ts4function isGraphQLMutationResponse(response: Response, operationName: string) {CODE
LOWapp/tests/projects.spec.ts21async function clickSortableHeaderAndExpect(CODE
LOWapp/tests/settings-sandboxes.spec.ts10function isGraphQLMutationResponse(response: Response, operationName: string) {CODE
LOWapp/tests/code-evaluators.spec.ts10function isGraphQLMutationResponse(response: Response, operationName: string) {CODE
LOWapp/tests/code-evaluators.spec.ts260async function createCustomCodeEvaluator({CODE
LOWapp/tests/code-evaluators.spec.ts305async function expectEvaluatorDetailsPage(page: Page, evaluatorName: string) {CODE
LOWapp/tests/settings-labels-tables.spec.ts4function isGraphQLMutationResponse(response: Response, operationName: string) {CODE
LOWapp/tests/playground-prompt-configuration.spec.ts321async function expectToolChoiceOneOrMore({CODE
LOWapp/tests/playground-prompt-configuration.spec.ts368async function expectFunctionAndRawTools({CODE
LOWapp/tests/playground-prompt-configuration.spec.ts396async function reloadAndExpectPlayground(page: Page): Promise<void> {CODE
LOWapp/tests/settings-secrets.spec.ts4function isSecretsMutationResponse(response: Response) {CODE
LOWapp/tests/pxi/judge.ts28export function getRequiredJudgeApiKeyEnv({CODE
LOWapp/tests/pxi/route-link-smoke.spec.ts26async function waitForLatestAssistantTurnWithText(page: Page) {CODE
LOWapp/.storybook/preview.tsx59function getLegacyStorySurfaceLayout(CODE
LOWapp/stories/PlaygroundOutputHeader.stories.tsx43function RunningPlaygroundProvider({CODE
LOWapp/stories/FileDropZone.stories.tsx289function FileListWithRenderFunctionRender(args: FileDropZoneProps) {CODE
LOWapp/stories/FileDropZone.stories.tsx471function FileInputWithDescriptionRender() {CODE
LOWapp/stories/FileDropZone.stories.tsx526function DropZoneWithOverlayRender() {CODE
LOWapp/stories/TableColumnOrdering.stories.tsx254 render: function SelectorMenuWithSectionsStory() {CODE
LOWapp/scripts/setup-remote-export.ts101export function normalizeCollectorEndpoint(value: string): string {CODE
LOWapp/scripts/generate-generative-ui-catalog.ts71function getToolFriendlyJsonSchema(schema: object): object {CODE
LOWapp/src/typeUtils.ts30export function isStringOrNullOrUndefined(CODE
LOWapp/src/relayDebugInstrumentation.ts172export function instrumentRelayEnvironment({CODE
LOWapp/src/types/code.ts56export function isTypescriptPackageManager(CODE
LOWapp/src/contexts/createTablePreferencesContext.tsx16export function createTablePreferencesContext({CODE
LOWapp/src/contexts/ExperimentCompareContext.tsx80export function ExperimentCompareDetailsProvider({CODE
LOWapp/src/contexts/ExperimentCompareContext.tsx254export function useExperimentCompareDetailsContext() {CODE
LOWapp/src/contexts/ExperimentCompareContext.tsx308function sortRepetitionsByAnnotation(CODE
LOWapp/src/contexts/ExperimentCompareContext.tsx327export function areAllExperimentRunsSelected(CODE
LOWapp/src/contexts/ExperimentCompareContext.tsx336export function areSomeExperimentRunsSelected(CODE
5537 more matches not shown…
Decorative Section Separators465 hits · 1411 pts
SeverityFileLineSnippetContext
MEDIUMevals/pxi/harness/reporting.py232# ---------------------------------------------------------------------------COMMENT
MEDIUMevals/pxi/harness/reporting.py239# ---------------------------------------------------------------------------COMMENT
MEDIUMapp/stories/BorderAndDividerLines.stories.tsx231// ─────────────────────────────────────────────────────────────────────────────COMMENT
MEDIUMapp/stories/BorderAndDividerLines.stories.tsx233// ─────────────────────────────────────────────────────────────────────────────COMMENT
MEDIUMjs/packages/phoenix-cli/src/commands/formatTable.ts23 * // ┌────────────┬──────────┬──────────┐COMMENT
MEDIUMjs/packages/phoenix-cli/src/commands/formatTable.ts25 * // ├────────────┼──────────┼──────────┤COMMENT
MEDIUMjs/packages/phoenix-cli/src/commands/formatTable.ts28 * // └────────────┴──────────┴──────────┘COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md194# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md196# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md206# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md208# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md123# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md125# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md149# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md151# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md162# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md164# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md178# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md180# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md238# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md240# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md281# ==============================================================================COMMENT
MEDIUM…ternal_docs/specs/ldap-authentication/configuration.md283# ==============================================================================COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py46# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py48# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py168# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py170# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py218# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py220# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py318# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py320# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py358# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py360# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py716# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py718# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py751# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py753# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py923# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py925# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py1003# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py1005# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py119# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/trace/gen_ai/test_conversion.py121# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/server/test_app_evaluations.py249# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/server/test_app_evaluations.py251# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py212# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py214# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py248# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py250# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py834# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py836# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py870# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py872# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py890# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py892# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py920# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py922# ===========================================================================COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py28# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/server/daemons/test_experiment_runner.py30# ---------------------------------------------------------------------------COMMENT
MEDIUMtests/unit/server/sandbox/test_vercel_backend.py429# ---------------------------------------------------------------------------COMMENT
405 more matches not shown…
Docstring Block Structure198 hits · 968 pts
SeverityFileLineSnippetContext
HIGHtests/unit/_helpers.py188 Verify that the experiments_dataset_examples junction table contains the expected entries. This function uses STRING
HIGHtests/integration/_helpers.py2002If no_wait, run the query once. Otherwise, retry it if it returns None and raise if retries are exhausted. ArgsSTRING
HIGHtests/integration/db_migrations/__init__.py93Get schema information for a database table. Retrieves comprehensive schema information for a table, including its STRING
HIGH…igration_6a88424799fe_update_users_with_auth_method.py283Create a new local authentication user. Creates a user with: - Local authentication method ('LOCAL') - PassSTRING
HIGH…igration_6a88424799fe_update_users_with_auth_method.py333Create a new OAuth2 user. Creates a user with: - External authentication method ('OAUTH2') - OAuth2 credentSTRING
HIGH…generate_data_via_plpgsql/generate_span_annotations.py178Run a SQL script file using psql. Args: db_name (str): Database name db_user (str): Database user STRING
HIGH…ripts/llm_token_pricing_tables/litellm_model_prices.py41Process the model prices JSON file from a URL into a pandas DataFrame. Args: url: URL to fetch the JSON datSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/utils.py180 Remap eval_input keys based on required_fields and an optional input_mapping. Args: eval_input: The inSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/utils.py275 Extract a value from a nested JSON structure using jsonpath-ng. Args: data: The input dictionary to beSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/utils.py415Format scores as annotations for logging to Phoenix. This function takes the output of evaluate_dataframe, and a liSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py129Remap and validate evaluation input. Args: eval_input: The raw evaluation input dictionary. requireSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py602 LLM-based evaluator for classification-style judgements. Supports label-only or label+score mappings, and retuSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py834 Decorator that turns a simple function into an Evaluator instance. The decorated function should accept keyworSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py1142 Factory to create a `ClassificationEvaluator`. Note: The evaluator requires the LLM to have tool calling or stSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py1226 Helper to bind an evaluator with a fixed input mapping. This function allows you to create a version of an evaSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py1417 Evaluate a dataframe with a list of evaluators and return an augmented dataframe. This function uses a synchroSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/evaluators.py1568 Evaluate a dataframe with a list of evaluators and return an augmented dataframe. This function uses an asynchSTRING
HIGH…ges/phoenix-evals/src/phoenix/evals/metrics/refusal.py14 An evaluator for detecting when an LLM refuses or declines to answer a query. Args: llm (LLM): The LLMSTRING
HIGH…hoenix-evals/src/phoenix/evals/metrics/faithfulness.py14 A specialized evaluator for detecting faithfulness in grounded LLM responses. Args: llm (LLM): The LLMSTRING
HIGH…phoenix-evals/src/phoenix/evals/metrics/exact_match.py6Return exact_match score: 1.0 if output == expected else 0.0. Note: No text normalization is performed. Args: STRING
HIGH…ix-evals/src/phoenix/evals/metrics/precision_recall.py67 Code evaluator that computes precision, recall, and F-beta score given lists of expected and output labels. STRING
HIGH…phoenix-evals/src/phoenix/evals/metrics/correctness.py14 An evaluator for assessing factual accuracy and completeness of model outputs. Args: llm (LLM): The LLSTRING
HIGH…enix-evals/src/phoenix/evals/metrics/tool_selection.py14 A specialized evaluator for determining if the correct tool was selected for a given context. Args: llSTRING
HIGH…nix-evals/src/phoenix/evals/metrics/tool_invocation.py14 Determines if a tool was invoked correctly with proper arguments, formatting, and safe content. Args: STRING
HIGH…-evals/src/phoenix/evals/metrics/document_relevance.py14 A specialized evaluator for determining document relevance to a given question. Args: llm (LLM): TSTRING
HIGH…oenix-evals/src/phoenix/evals/metrics/hallucination.py23 A specialized evaluator for detecting hallucinations in grounded LLM responses. .. deprecated:: HallucSTRING
HIGH…phoenix-evals/src/phoenix/evals/metrics/conciseness.py14 An evaluator for assessing whether model outputs are concise and free of unnecessary content. Args: llSTRING
HIGH…ls/src/phoenix/evals/metrics/tool_response_handling.py14 Determines if an AI agent properly handled a tool's response, including error handling, data extraction, transfSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/wrapper.py318Generate a classification given a prompt and a set of labels. Args: prompt (Union[str, List[Dict[stSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/wrapper.py456Generate a JSON Schema for an LLM function/structured output call that classifies a single criterion. Args: STRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/prompts.py608Factory function to create appropriate ContentPartTemplate from a dict. Args: content_part: Dictionary withSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/prompts.py827Render the template with the given variables. Args: variables (Dict[str, Any]): The variables to suSTRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/prompts.py1001Render the template with the given variables. Args: variables: The variables to substitute into theSTRING
HIGHpackages/phoenix-client/scripts/codegen/transform.py349 Sort class definitions so that each parent class appears before its children. Args: class_nodes: MappiSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py33 Run an experiment using a given dataset of examples. An experiment is a user-defined task that runs on each exSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py224 Run an experiment using a given dataset of examples. An experiment is a user-defined task that runs on each exSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py408 Get a completed experiment by ID. This function retrieves a completed experiment with all its task runs and evSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py475 Resume an incomplete experiment by running only the missing or failed runs. This method identifies which (examSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py547 Get a completed experiment by ID. This function retrieves a completed experiment with all its task runs and STRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py614 Resume an incomplete experiment by running only the missing or failed runs. This method identifies which (examSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py695 Run evaluators on a completed experiment. An evaluator is either a synchronous or asynchronous function that rSTRING
HIGH…enix-client/src/phoenix/client/experiments/__init__.py889 Run evaluators on a completed experiment. An `evaluator` is either a synchronous or asynchronous function thatSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py105Add a single trace annotation. Args: trace_id (str): The ID of the trace to annotate. aSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py195Log multiple trace annotations. Args: trace_annotations (Iterable[TraceAnnotationData]): An iterablSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py263Log multiple trace annotations from a pandas DataFrame. This method allows you to create multiple trace annotatSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py352Retrieves traces for a project. Args: project_identifier (str): The project identifier (name or ID)STRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py501Add a single trace annotation asynchronously. Args: trace_id (str): The ID of the trace to annotateSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py591Log multiple trace annotations asynchronously. Args: trace_annotations (Iterable[TraceAnnotationDatSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py659Log multiple trace annotations from a pandas DataFrame asynchronously. This method allows you to create multiplSTRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py748Retrieves traces for a project asynchronously. Args: project_identifier (str): The project identifiSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py183Retrieves spans based on the provided filter conditions. Args: query (Optional[SpanQuery]): A SpanQSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py262Fetches span annotations and returns them as a pandas DataFrame. Exactly one of *spans_dataframe*, *span_ids*, STRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py387Fetches span annotations and returns them as a list of SpanAnnotation objects. Exactly one of *span_ids* or *spSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py491Retrieves spans with simple filtering options. Args: project_identifier (str): The project identifiSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py593Logs spans to a project. If any spans are invalid or duplicates, no spans will be logged and a SpanCreaSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py635Logs spans to a project from a pandas DataFrame. If any spans are invalid or duplicates, no spans will be loggeSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py764Add a single span annotation. Args: span_id (str): The ID of the span to annotate. annoSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py830Add a note to a span. Notes are append-only: each call creates a new note with an auto-generated UUIDv4STRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py917Log multiple span annotations from a pandas DataFrame. This method allows you to create multiple span annotatioSTRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py1034Log multiple span annotations. Args: span_annotations (Iterable[SpanAnnotationData]): An iterable oSTRING
138 more matches not shown…
Unused Imports519 hits · 504 pts
SeverityFileLineSnippetContext
LOWevals/pxi/conftest.py10CODE
LOWevals/pxi/gate.py14CODE
LOWevals/pxi/tests/test_pxi_evals.py10CODE
LOWevals/pxi/tests/test_gate.py11CODE
LOWevals/pxi/evaluators/tools.py1CODE
LOWevals/pxi/evaluators/links.py1CODE
LOWevals/pxi/evaluators/text.py1CODE
LOWevals/pxi/harness/datasets.py1CODE
LOWevals/pxi/harness/run_experiment.py1CODE
LOWevals/pxi/harness/agent_task.py1CODE
LOWevals/pxi/harness/reporting.py8CODE
LOW…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py41CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py54CODE
LOWtests/unit/pxi/evals/test_run_experiment.py8CODE
LOWtests/unit/pxi/evals/conftest.py3CODE
LOWtests/unit/pxi/evals/test_evaluators.py8CODE
LOWtests/unit/pxi/evals/test_datasets.py8CODE
LOWtests/unit/pxi/evals/test_evaluator_matchers.py8CODE
LOWtests/unit/pxi/evals/test_reporting.py10CODE
LOWtests/unit/pxi/evals/test_agent_task_inputs.py1CODE
LOWtests/unit/server/test_app_docs_mcp_lifespan.py11CODE
LOWtests/unit/server/daemons/test_system_settings.py3CODE
LOWtests/unit/server/daemons/test_experiment_runner.py1CODE
LOWtests/unit/server/agents/test_agent_factory.py1CODE
LOWtests/unit/server/agents/test_server_agents.py1CODE
LOWtests/unit/server/agents/test_data_stream_protocol.py1CODE
LOWtests/unit/server/agents/test_skill_requests.py1CODE
LOW…t/server/agents/capabilities/test_native_tool_retry.py1CODE
LOW…ents/capabilities/tools/internal/test_call_subagent.py1CODE
LOW…er/agents/capabilities/skills/test_skill_capability.py1CODE
LOW…agents/pydantic_ai/test_openinference_model_wrapper.py1CODE
LOW…ents/pydantic_ai/test_openinference_toolset_wrapper.py1CODE
LOW…s/pydantic_ai/test_openinference_capability_wrapper.py1CODE
LOW…agents/pydantic_ai/test_openinference_agent_wrapper.py1CODE
LOWtests/unit/server/agents/skills/test_phoenix_graphql.py1CODE
LOWtests/unit/server/sandbox/test_modal_backend.py1CODE
LOWtests/unit/server/sandbox/test_vercel_backend.py1CODE
LOWtests/unit/server/sandbox/test_vercel_backend.py9CODE
LOWtests/unit/server/sandbox/test_env_var_resolution.py1CODE
LOWtests/unit/server/sandbox/test_wasm_download.py7CODE
LOWtests/unit/server/sandbox/test_e2b_backend.py1CODE
LOWtests/unit/server/sandbox/test_build_sandbox_backend.py1CODE
LOWtests/unit/server/sandbox/test_build_sandbox_backend.py25CODE
LOWtests/unit/server/sandbox/test_app_lifecycle.py21CODE
LOWtests/unit/server/sandbox/test_app_lifecycle.py48CODE
LOWtests/unit/server/sandbox/test_app_lifecycle.py55CODE
LOWtests/unit/server/sandbox/test_app_lifecycle.py55CODE
LOWtests/unit/server/sandbox/test_app_lifecycle.py55CODE
LOWtests/unit/server/sandbox/test_credential_resolution.py1CODE
LOW…ts/unit/server/sandbox/test_unified_config_contract.py1CODE
LOWtests/unit/server/sandbox/test_daytona_backend.py1CODE
LOWtests/unit/server/sandbox/test_session_manager.py15CODE
LOW…/unit/server/sandbox/test_sandbox_config_validation.py1CODE
LOWtests/unit/server/sandbox/test_deno_backend.py1CODE
LOWtests/unit/server/api/test_coerce_output.py1CODE
LOWtests/unit/server/api/test_code_evaluator_runner.py1CODE
LOWtests/unit/server/api/test_wasm_backend.py1CODE
LOWtests/unit/server/api/test_wasm_backend.py7CODE
LOWtests/unit/server/api/test_evaluators_timeout.py1CODE
LOWtests/unit/server/api/test_capability_advertisement.py1CODE
459 more matches not shown…
Self-Referential Comments172 hits · 448 pts
SeverityFileLineSnippetContext
MEDIUM…/src/components/experiment/RunExperimentCodeDialog.tsx43 `# Define an evaluator. This just an example.\n` +CODE
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py24 # Create a local userSTRING
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py29 # Create an external userSTRING
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py286 # Create an in-memory SQLite databaseCOMMENT
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py295 # Create a sessionCOMMENT
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py299 # Create a local user with passwordCOMMENT
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py307 # Create an external userCOMMENT
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py323 # Create a sessionCOMMENT
MEDIUMtests/unit/test_tracers.py710 # Create a hierarchy:COMMENT
MEDIUMtests/unit/test_config.py2157 # Create a dummy CA cert fileCOMMENT
MEDIUMtests/unit/server/api/test_cancellation.py88 # Create a tracker that shares the operation_order listCOMMENT
MEDIUMtests/unit/server/api/test_cancellation.py92 # Create a real async generatorCOMMENT
MEDIUMtests/unit/server/api/test_cancellation.py102 # Create a task that takes time to process cancellationCOMMENT
MEDIUMtests/unit/server/api/test_cancellation.py145 # Create an already-completed taskCOMMENT
MEDIUMtests/unit/server/api/test_cancellation.py353 # Create a task for the in-progress generatorCOMMENT
MEDIUMtests/unit/server/api/test_queries.py2509 # Create a builtin evaluator without a dataset associationCOMMENT
MEDIUMtests/unit/server/api/test_queries.py614 # Create a prompt version for each promptSTRING
MEDIUMtests/unit/server/api/routers/v1/test_traces.py374 # Create a trace with multiple spans (parent and child)COMMENT
MEDIUMtests/unit/server/api/routers/v1/test_traces.py517 # Create a relay GlobalID for a non-existent traceCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py67 # Create a dictionary of projects by ID for easy lookupCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py574 # Create a valid cursor format (base64-encoded project ID)COMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py598 # Create a small number of test projectsCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py754 # Create a regular experiment project - this should be filtered by defaultCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py774 # Create an experiment for the regular experiment projectCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py786 # Create the playground project - this should always be visibleCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_projects.py794 # Create an experiment using the playground project - this shouldn't affect visibilityCOMMENT
MEDIUM…unit/server/api/routers/v1/test_list_project_traces.py77 # Create a lightweight Trace object for assertionsCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_experiments.py624 # Create a fresh experiment and verify the create response has correct countsCOMMENT
MEDIUMtests/unit/server/api/routers/v1/test_spans.py280 # Create the hierarchy: parent -> children -> grandchild + siblingCOMMENT
MEDIUM…/unit/server/api/routers/v1/test_annotation_configs.py91 # Create a categorical annotation configCOMMENT
MEDIUM…t/server/api/types/test_ProjectTraceRetentionPolicy.py47 # Create a project with default trace retention policyCOMMENT
MEDIUM…t/server/api/types/test_ProjectTraceRetentionPolicy.py50 # Create a custom trace retention policyCOMMENT
MEDIUMtests/unit/server/api/types/test_Trace.py316 # Create a trace with 5 spansCOMMENT
MEDIUMtests/unit/server/api/types/test_Dataset.py1346 # Create a prompt for the evaluatorsSTRING
MEDIUMtests/unit/server/api/types/test_Dataset.py1351 # Create a prompt versionSTRING
MEDIUMtests/unit/server/api/types/test_Project.py2014 # Create a test projectCOMMENT
MEDIUMtests/unit/server/api/types/test_Project.py2773 # Create a test projectCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py1454 # Create a different prompt with a versionCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py1861 # Create a second version for the same promptCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py1867 # Create a second versionCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py2866 # Create a builtin dataset evaluatorCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py2997 # Create an LLM evaluator with dataset relationshipCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py3104 # Create a builtin dataset evaluatorCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py3122 # Create an LLM evaluatorCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py3284 # Create an LLM evaluator with promptCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py3396 # Create an LLM evaluator with promptCOMMENT
MEDIUM…/unit/server/api/mutations/test_evaluator_mutations.py3940 # Create the builtin evaluator and verify continuous config is returnedCOMMENT
MEDIUM…tions/test_project_trace_retention_policy_mutations.py138 # Create a new retention policySTRING
MEDIUM…tions/test_project_trace_retention_policy_mutations.py324 # Create a GlobalID for the default policy to use in GraphQL operationsSTRING
MEDIUM…rver/api/mutations/test_annotation_config_mutations.py269 # Create a categorical annotation configSTRING
MEDIUM…rver/api/mutations/test_annotation_config_mutations.py833 # Create a categorical annotation configSTRING
MEDIUM…rver/api/mutations/test_annotation_config_mutations.py894 # Create a categorical annotation configSTRING
MEDIUMtests/unit/server/api/mutations/test_trace_mutations.py263 # Create a sessionSTRING
MEDIUMtests/unit/server/api/mutations/test_trace_mutations.py290 # Create a span for the first traceSTRING
MEDIUMtests/unit/server/api/mutations/test_trace_mutations.py330 # Create a span for the second traceSTRING
MEDIUMtests/unit/server/api/mutations/test_trace_mutations.py375 # Create a span for the third traceSTRING
MEDIUM…ts/unit/server/api/mutations/test_project_mutations.py57 # Create a new projectSTRING
MEDIUM…ts/unit/server/api/mutations/test_project_mutations.py71 # Create a project session for the first two tracesSTRING
MEDIUM…ts/unit/server/api/mutations/test_project_mutations.py83 # Create a traceSTRING
MEDIUMtests/unit/server/api/helpers/test_evaluators.py2104 # Create a custom output config with different labelsCOMMENT
112 more matches not shown…
Excessive Try-Catch Wrapping405 hits · 446 pts
SeverityFileLineSnippetContext
LOWevals/pxi/harness/run_experiment.py330 except Exception as cleanup_exc: # pragma: no cover - best-effort cleanupCODE
LOWevals/pxi/harness/agent_task.py102 except Exception as exc: # noqa: BLE001CODE
LOWevals/pxi/harness/agent_task.py117 except Exception: # noqa: BLE001CODE
LOWevals/pxi/harness/agent_task.py596 except Exception as exc:CODE
LOW…al_docs/vignettes/postgresql/advisory-lock-analysis.md273 except Exception:CODE
LOW…al_docs/vignettes/postgresql/advisory-lock-analysis.md461 except Exception:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py642 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py648 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py654 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py660 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py676 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py682 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py688 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py694 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py354 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py394 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py431 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py468 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py499 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py532 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py565 except Exception as e:CODE
LOW…ernal_docs/vignettes/postgresql_tls/test_connection.py598 except Exception as e:CODE
MEDIUM…nal_docs/vignettes/postgresql_tls/generate_pg_certs.py60 print(f"Error writing to file {filename}: {e}")CODE
MEDIUM…nal_docs/vignettes/postgresql_tls/generate_pg_certs.py173 print("Error: Failed to generate certificates")STRING
LOWinternal_docs/specs/ldap-authentication/security.md95 except Exception:CODE
LOW…nt-runner-background-process/appendix-rate-limiting.md317 except Exception as e:CODE
LOW…nt-runner-background-process/appendix-rate-limiting.md365 except Exception as e:CODE
LOWtests/unit/conftest.py255 except Exception:CODE
LOWtests/unit/conftest.py259 except Exception:CODE
LOWtests/integration/conftest.py217 except Exception:CODE
LOWtests/integration/_mock_ldap_server.py319 except Exception as e:CODE
LOWtests/integration/_mock_llm_server.py451 except Exception as e:CODE
LOWtests/integration/_mock_llm_server.py636 except Exception as e:CODE
LOWtests/integration/_helpers.py1549 except Exception:CODE
LOWtests/integration/client/test_experiments.py339 except Exception:CODE
LOWtests/integration/client/test_experiments.py389 except Exception:CODE
LOW…ation_e76cbd66ffc3_add_experiments_dataset_examples.py264 except Exception:CODE
LOW…ation_e76cbd66ffc3_add_experiments_dataset_examples.py370 except Exception:CODE
LOWexamples/rag_agent/tools.py159 except Exception as e:STRING
LOWexamples/agents/run_scaled.py89 except Exception as e:CODE
LOWexamples/agents/run_scaled.py161 except Exception as e:CODE
LOWexamples/agents/run_scaled.py237 except Exception as e:CODE
LOWexamples/agents/tau_bench_openai_agents/run.py131 except Exception as e:CODE
LOWexamples/agents/traject_bench_langgraph/run.py141 except Exception as e:CODE
LOWexamples/agents/traject_bench_langgraph/agent.py206 except Exception as e:CODE
LOWexamples/agents/tau_bench_langgraph/run.py135 except Exception as e:CODE
LOWexamples/computer_use_agent/agent.py75 except Exception as e:CODE
LOWexamples/computer_use_agent/tools/edit.py239 except Exception as e:CODE
LOWexamples/computer_use_agent/tools/edit.py246 except Exception as e:CODE
LOWexamples/code_gen_agent/tools.py41 except Exception as e:CODE
LOWexamples/code_gen_agent/tools.py65 except Exception as e:STRING
LOWexamples/code_gen_agent/tools.py89 except Exception as e:STRING
LOWexamples/code_gen_agent/tools.py125 except Exception as e:STRING
MEDIUM…/agent_framework_comparison/code_based_agent/router.py75 print("Error: Invalid JSON, treating arguments as string")CODE
LOWexamples/agent_framework_comparison/db/database.py23 except Exception as e:CODE
MEDIUMexamples/agent_framework_comparison/db/database.py24 print(f"Error handling nested type: {e}")CODE
MEDIUMexamples/agent_framework_comparison/db/database.py11def handle_nested_types(y):CODE
MEDIUMscripts/update_helm.py47 print("Error: could not find appVersion in Chart.yaml", file=sys.stderr)CODE
MEDIUMscripts/update_helm.py54 print("Error: could not find chart version in Chart.yaml", file=sys.stderr)CODE
LOWscripts/docker/devops/scripts/test_ldap_tls.py175 except Exception as e:CODE
345 more matches not shown…
Deep Nesting322 hits · 262 pts
SeverityFileLineSnippetContext
LOWevals/pxi/conftest.py53CODE
LOWevals/pxi/gate.py90CODE
LOWevals/pxi/gate.py124CODE
LOWevals/pxi/evaluators/tools.py408CODE
LOWevals/pxi/harness/run_experiment.py90CODE
LOWevals/pxi/harness/agent_task.py294CODE
LOWevals/pxi/harness/reporting.py141CODE
LOWtests/unit/conftest.py54CODE
LOWtests/unit/graphql.py98CODE
LOWtests/unit/server/api/test_wasm_backend.py136CODE
LOWtests/unit/server/api/test_wasm_backend.py200CODE
LOWtests/unit/server/api/test_wasm_backend.py270CODE
LOWtests/unit/server/api/test_wasm_backend.py340CODE
LOWtests/unit/server/api/test_wasm_backend.py414CODE
LOWtests/unit/server/api/test_wasm_backend.py453CODE
LOWtests/unit/server/api/test_wasm_backend.py481CODE
LOWtests/unit/server/api/test_wasm_backend.py719CODE
LOWtests/unit/server/api/test_subscriptions.py1932CODE
LOWtests/unit/server/api/types/test_Span.py356CODE
LOWtests/unit/server/api/types/test_Project.py1998CODE
LOWtests/unit/server/api/types/test_Project.py2827CODE
LOWtests/unit/server/api/dataloaders/conftest.py12CODE
LOWtests/unit/server/api/helpers/test_evaluators.py2502CODE
LOWtests/unit/server/api/helpers/test_evaluators.py3008CODE
LOWtests/unit/server/api/helpers/test_evaluators.py3229CODE
LOW…t/server/cost_tracking/test_cost_details_calculator.py811CODE
LOWtests/unit/db/test_helpers.py65CODE
LOWtests/integration/conftest.py159CODE
LOWtests/integration/conftest.py162CODE
LOWtests/integration/_mock_ldap_server.py283CODE
LOWtests/integration/_mock_ldap_server.py498CODE
LOWtests/integration/_mock_llm_server.py344CODE
LOWtests/integration/_mock_llm_server.py460CODE
LOWtests/integration/_mock_llm_server.py208CODE
LOWtests/integration/_mock_llm_server.py602CODE
LOWtests/integration/_helpers.py690CODE
LOWtests/integration/_helpers.py2389CODE
LOWtests/integration/experiments/conftest.py431CODE
LOWtests/integration/experiments/test_playground.py161CODE
LOWtests/integration/experiments/test_playground.py330CODE
LOWtests/integration/experiments/test_playground.py266CODE
LOWtests/integration/experiments/test_playground.py375CODE
LOW…/integration/project_sessions/test_project_sessions.py34CODE
LOWtests/integration/client/test_datasets.py889CODE
LOWtests/integration/client/test_annotations.py2957CODE
LOWtests/integration/client/test_users.py101CODE
LOWtests/integration/client/test_experiments.py277CODE
LOWtests/integration/client/test_experiments.py482CODE
LOWtests/integration/client/test_experiments.py2953CODE
LOWtests/integration/client/test_experiments.py3087CODE
LOWtests/integration/client/test_spans.py745CODE
LOWtests/integration/db_migrations/__init__.py87CODE
LOW.agents/skills/phoenix-frontend/scripts/scale-svg.py39CODE
LOW.agents/skills/phoenix-frontend/scripts/scale-svg.py84CODE
LOWapi_reference/source/conf.py27CODE
LOWexamples/agents/tau_bench_openai_agents/agent.py83CODE
LOWexamples/agents/traject_bench_langgraph/agent.py150CODE
LOWexamples/agents/tau_bench_langgraph/agent.py124CODE
LOWexamples/computer_use_agent/utils.py94CODE
LOWexamples/computer_use_agent/tools/edit.py41CODE
262 more matches not shown…
Magic Placeholder Names40 hits · 242 pts
SeverityFileLineSnippetContext
HIGH…ts/project/integrationSnippets/environmentVariables.ts17 const apiKeyValue = apiKey || "<your-api-key>";CODE
HIGH…/src/components/experiment/RunExperimentCodeDialog.tsx30 `os.environ["PHOENIX_API_KEY"] = "<your-api-key>"`;CODE
HIGHjs/examples/apps/mastra-agent/README.md441. Be sure to include: PHOENIX_API_KEY=your-api-keyCODE
HIGHjs/packages/phoenix-mcp/README.md57 "your-api-key"CODE
HIGHjs/packages/phoenix-cli/README.md43export PHOENIX_API_KEY=your-api-key # if authentication is enabledCODE
HIGHjs/packages/phoenix-config/README.md60PHOENIX_API_KEY=your-api-keyCODE
HIGHjs/packages/phoenix-config/src/env.ts50 * process.env[ENV_PHOENIX_API_KEY] = "your-api-key";COMMENT
HIGHjs/packages/phoenix-otel/README.md93export PHOENIX_API_KEY="your-api-key"CODE
HIGHjs/packages/phoenix-otel/examples/register_example.ts6 apiKey: "your-api-key",CODE
HIGHjs/packages/phoenix-otel/src/register.ts51 * apiKey: "your-api-key",COMMENT
HIGHjs/packages/phoenix-otel/src/register.ts443 * headers: { 'Authorization': 'Bearer your-api-key' }COMMENT
HIGHjs/packages/phoenix-otel/src/register.ts553 * apiKey: 'your-api-key',COMMENT
HIGH.agents/skills/phoenix-cli/SKILL.md60export PHOENIX_API_KEY=your-api-key # if auth is enabledCODE
HIGH…/skills/phoenix-tracing/references/setup-typescript.md41export PHOENIX_API_KEY="your-api-key"CODE
HIGH…ents/skills/phoenix-tracing/references/setup-python.md34export PHOENIX_API_KEY="your-api-key" # Required for Phoenix CloudCODE
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/wrapper.py167 api_key="your-api-key",STRING
HIGHpackages/phoenix-evals/src/phoenix/evals/llm/wrapper.py176 api_key="your-api-key",STRING
HIGHpackages/phoenix-client/README.md55export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-client/README.md60export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-client/README.md63export PHOENIX_CLIENT_HEADERS="Authorization=Bearer your-api-key,custom-header=value"CODE
HIGHpackages/phoenix-client/README.md76PHOENIX_API_KEY=your-api-keyCODE
HIGHpackages/phoenix-client/README.md109 api_key="your-api-key"CODE
HIGHpackages/phoenix-client/README.md115 headers={"Authorization": "Bearer your-api-key"}CODE
HIGHpackages/phoenix-client/README.md123 api_key="your-api-key"CODE
HIGHpackages/phoenix-client/docs/source/index.md31export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-client/docs/source/index.md36export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-client/docs/source/index.md39export PHOENIX_CLIENT_HEADERS="Authorization=Bearer your-api-key,custom-header=value"CODE
HIGHpackages/phoenix-client/docs/source/index.md57 api_key="your-api-key"CODE
HIGHpackages/phoenix-client/docs/source/index.md63 headers={"Authorization": "Bearer your-api-key"}CODE
HIGHpackages/phoenix-client/docs/source/index.md71 api_key="your-api-key"CODE
HIGHpackages/phoenix-otel/README.md90export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-otel/README.md95tracer_provider = register(api_key="your-api-key")CODE
HIGHpackages/phoenix-otel/README.md136 api_key="your-api-key", # AuthenticationCODE
HIGHpackages/phoenix-otel/README.md179| `PHOENIX_API_KEY` | Authentication key | `your-api-key` |CODE
HIGHpackages/phoenix-otel/README.md194PHOENIX_API_KEY=your-api-keyCODE
HIGHpackages/phoenix-otel/docs/source/index.md97# export PHOENIX_API_KEY=your-api-keyCOMMENT
HIGHpackages/phoenix-otel/docs/source/index.md261export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-otel/docs/source/index.md267export PHOENIX_API_KEY="your-api-key"CODE
HIGHpackages/phoenix-otel/docs/source/index.md268export PHOENIX_CLIENT_HEADERS="Authorization=Bearer your-api-key,custom-header=value"CODE
HIGHpackages/phoenix-otel/src/phoenix/otel/otel.py127 api_key="your-api-key"STRING
Cross-File Repetition47 hits · 235 pts
SeverityFileLineSnippetContext
HIGHtests/unit/server/sandbox/test_modal_backend.py0a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no signSTRING
HIGHtests/unit/server/sandbox/test_vercel_backend.py0a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no signSTRING
HIGHtests/unit/server/sandbox/test_e2b_backend.py0a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no signSTRING
HIGHtests/unit/server/api/routers/v1/test_traces.py0contains a project with a single trace and a single span.STRING
HIGHtests/unit/server/api/routers/v1/test_spans.py0contains a project with a single trace and a single span.STRING
HIGHtests/unit/server/api/types/test_SpanAnnotation.py0contains a project with a single trace and a single span.STRING
HIGHtests/unit/server/api/types/test_Span.py0contains a project with a single trace and a single span.STRING
HIGHtests/unit/server/api/types/test_TraceAnnotation.py0contains a project with a single trace and a single span.STRING
HIGHtests/integration/dataset_labels/conftest.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/auth/conftest.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/experiments/conftest.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/project_sessions/conftest.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/server/test_db_disk_usage_monitor.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/client/conftest.py0combine all environment variable configurations for testing.STRING
HIGHtests/integration/annotation_configs/conftest.py0combine all environment variable configurations for testing.STRING
HIGHexamples/agents/tau_bench_openai_agents/run.py0return a timestamped default output path under examples/results.STRING
HIGHexamples/agents/traject_bench_langgraph/run.py0return a timestamped default output path under examples/results.STRING
HIGHexamples/agents/tau_bench_langgraph/run.py0return a timestamped default output path under examples/results.STRING
HIGH…amples/agents/tau_bench_openai_agents/phoenix_setup.py0resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. appends `/v1/traces` if the env var points STRING
HIGH…amples/agents/traject_bench_langgraph/phoenix_setup.py0resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. appends `/v1/traces` if the env var points STRING
HIGHexamples/agents/tau_bench_langgraph/phoenix_setup.py0resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. appends `/v1/traces` if the env var points STRING
HIGH…amples/agents/tau_bench_openai_agents/phoenix_setup.py0return the phoenix ui base url (without the otlp `/v1/traces` suffix). uses phoenix_collector_endpoint if set, otherwiseSTRING
HIGH…amples/agents/traject_bench_langgraph/phoenix_setup.py0return the phoenix ui base url (without the otlp `/v1/traces` suffix). uses phoenix_collector_endpoint if set, otherwiseSTRING
HIGHexamples/agents/tau_bench_langgraph/phoenix_setup.py0return the phoenix ui base url (without the otlp `/v1/traces` suffix). uses phoenix_collector_endpoint if set, otherwiseSTRING
HIGH…t_calculations/generate_spans_for_cost_calculations.py0generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the geneSTRING
HIGH…_for_large_session/generate_spans_for_large_session.py0generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the geneSTRING
HIGHscripts/generate_spans/generate_spans_deeply_nested.py0generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the geneSTRING
HIGH…ripts/generate_spans/generate_spans_for_time_series.py0generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the geneSTRING
HIGH…t_calculations/generate_spans_for_cost_calculations.py0generate a synthetic llm span with random token counts and model information. creates a span with the following attributSTRING
HIGH…_for_large_session/generate_spans_for_large_session.py0generate a synthetic llm span with random token counts and model information. creates a span with the following attributSTRING
HIGHscripts/generate_spans/generate_spans_deeply_nested.py0generate a synthetic llm span with random token counts and model information. creates a span with the following attributSTRING
HIGH…ripts/generate_spans/generate_spans_for_time_series.py0generate a synthetic llm span with random token counts and model information. creates a span with the following attributSTRING
HIGH…_llama_index_with_recursive_character_text_splitter.py0loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list ofSTRING
HIGHscripts/data/build_langchain_vector_store.py0loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list ofSTRING
HIGHscripts/data/fetch_arize_documentation.py0loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list ofSTRING
HIGH…kages/phoenix-evals/src/phoenix/evals/rate_limiters.py0an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not needSTRING
HIGH…oenix-client/src/phoenix/client/utils/rate_limiters.py0an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not needSTRING
HIGHsrc/phoenix/server/rate_limiters.py0an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not needSTRING
HIGH…kages/phoenix-evals/src/phoenix/evals/rate_limiters.py0lazily initialize async primitives to ensure they are created in the correct event loop.STRING
HIGH…oenix-client/src/phoenix/client/utils/rate_limiters.py0lazily initialize async primitives to ensure they are created in the correct event loop.STRING
HIGHsrc/phoenix/server/rate_limiters.py0lazily initialize async primitives to ensure they are created in the correct event loop.STRING
HIGH…client/src/phoenix/client/resources/traces/__init__.py0log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method STRING
HIGH…-client/src/phoenix/client/resources/spans/__init__.py0log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method STRING
HIGH…ient/src/phoenix/client/resources/sessions/__init__.py0log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method STRING
HIGHsrc/phoenix/server/api/types/Trace.py0retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and labelSTRING
HIGHsrc/phoenix/server/api/types/ProjectSession.py0retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and labelSTRING
HIGHsrc/phoenix/server/api/types/Span.py0retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and labelSTRING
Structural Annotation Overuse135 hits · 231 pts
SeverityFileLineSnippetContext
LOWjs/examples/apps/tracing-tutorial/support-agent.ts244 // Step 1: Classify the queryCOMMENT
LOWjs/examples/apps/tracing-tutorial/support-agent.ts292 // Step 2: Route based on classificationCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts142 // Step 1: Fetch spans from PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts162 // Step 2: Filter spans by typeCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts192 // Step 3: Evaluate tool spans (simple code-based check)COMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts264 // Step 4: Log annotations to PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts280 // Step 5: SummaryCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts337 // Step 1: Fetch spans from PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts359 // Step 2: Group spans by session IDCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts395 // Step 3: Evaluate each sessionCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts486 // Step 4: Log session annotations to PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts504 // Step 5: SummaryCOMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts10// Step 1: define the task to run (we call the agent with the question)COMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts21// Step 2: define the dataset of questions to ask the agentCOMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts45// Step 3: Define the evaluatorsCOMMENT
LOW…s/apps/mastra-agent/src/experiments/run-experiments.ts7//Step 4: Run the experimentCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts117 // Step 1: Fetch spans from the projectCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts138 // Step 2: Transform spans into dataset examples with span ID linksCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts172 // Step 3: Create the dataset with span associationsCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts36// Step 1: Define the agent's toolsCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts60// Step 2: Define the agentCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts80// Step 3: Build the evaluatorCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts126// Step 4: Run the experiment and evaluateCOMMENT
LOW…ernal_docs/specs/ldap-authentication/migration-plan.md89 # Step 1: Update CHECK constraint to allow 'LDAP'COMMENT
LOW…ernal_docs/specs/ldap-authentication/migration-plan.md97 # Step 2: Migrate LDAP usersCOMMENT
LOW…_docs/specs/ldap-authentication/future-improvements.md387 # Step 1: Get tokenGroups (binary SIDs)COMMENT
LOW…_docs/specs/ldap-authentication/future-improvements.md400 # Step 2: Resolve SIDs to DNsCOMMENT
LOW…ernal_docs/specs/ldap-authentication/optional-email.md181 # Step 1: Lookup by unique_id first (always, when configured)COMMENT
LOW…ernal_docs/specs/ldap-authentication/optional-email.md186 # Step 2: Fallback to email lookup (only for real emails)COMMENT
LOW…ernal_docs/specs/ldap-authentication/optional-email.md193 # Step 3: Return existing user (update email if changed)COMMENT
LOW…ernal_docs/specs/ldap-authentication/optional-email.md199 # Step 4: Create new userCOMMENT
LOWtests/unit/_helpers.py235 # Step 1: Get ALL revisions up to and including this dataset versionCOMMENT
LOWtests/unit/_helpers.py248 # Step 2: Find the latest revision for each example (simple Python logic)COMMENT
LOWtests/unit/_helpers.py256 # Step 3: Filter out DELETE revisionsCOMMENT
LOWtests/unit/_helpers.py263 # Step 4: Check if experiment has assigned splitsCOMMENT
LOWtests/unit/_helpers.py272 # Step 5: Filter by splits if any are assignedCOMMENT
LOWtests/integration/_helpers.py1559 # Step 2: Validate PKCE (if required)COMMENT
LOWtests/integration/_helpers.py1538 # Step 1: Validate client authentication (if required)COMMENT
LOWtests/integration/_helpers.py1595 # Step 3: Determine authentication mode and validateCOMMENT
LOWtests/integration/auth/test_ldap.py503 # Step 1: Create LDAP user via loginCOMMENT
LOWtests/integration/auth/test_ldap.py509 # Step 2: Query GraphQL to verify authMethod is 'LDAP'COMMENT
LOWtests/integration/auth/test_ldap.py664 # Step 1: Admin pre-creates LDAP user (only needs email)COMMENT
LOWtests/integration/auth/test_ldap.py698 # Step 2: Add user to LDAP with matching emailSTRING
LOWtests/integration/auth/test_ldap.py707 # Step 3: User logs in via LDAP (email lookup finds pre-created user)STRING
LOWtests/integration/auth/test_ldap.py713 # Step 4: Verify username remains stable (not synced from LDAP)STRING
LOWtests/integration/auth/test_ldap.py721 # Step 5: Verify subsequent logins workSTRING
LOWtests/integration/client/test_experiments.py2621 # Step 1: Run experiment WITHOUT evaluators (task execution only)COMMENT
LOWtests/integration/client/test_experiments.py2640 # Step 2: Add evaluations to the completed experimentCOMMENT
LOW…/skills/phoenix-server/references/database-patterns.md35 # Step 1: Add column as nullableCOMMENT
LOW…/skills/phoenix-server/references/database-patterns.md39 # Step 2: BackfillCOMMENT
LOW…/skills/phoenix-server/references/database-patterns.md42 # Step 3: Add constraintsCOMMENT
LOW.agents/skills/phoenix-typescript-package-docs/SKILL.md172### Step 1: Determine the affected package and modulesCOMMENT
LOW.agents/skills/phoenix-typescript-package-docs/SKILL.md182### Step 2: Update canonical Mintlify docsCOMMENT
LOW.agents/skills/phoenix-typescript-package-docs/SKILL.md195### Step 3: Sync generated package docsCOMMENT
LOW.agents/skills/phoenix-typescript-package-docs/SKILL.md221### Step 4: Verify the npm artifactCOMMENT
LOW.agents/skills/phoenix-typescript-package-docs/SKILL.md236### Step 5: Check for nav and path regressionsCOMMENT
LOW…x-evals/references/experiments-synthetic-typescript.md26// Step 1: Create tuplesCOMMENT
LOW…x-evals/references/experiments-synthetic-typescript.md33// Step 2: Convert to natural queryCOMMENT
LOW…oenix-evals/references/experiments-synthetic-python.md23# Step 1: Create tuplesCOMMENT
LOW…oenix-evals/references/experiments-synthetic-python.md29# Step 2: Convert to natural queryCOMMENT
75 more matches not shown…
Fake / Example Data205 hits · 199 pts
SeverityFileLineSnippetContext
LOWapp/stories/Dialog.stories.tsx72 Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam,CODE
LOWapp/stories/Dialog.stories.tsx72 Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam,CODE
LOWapp/stories/Dialog.stories.tsx109 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Dialog.stories.tsx109 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Dialog.stories.tsx140 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Dialog.stories.tsx140 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/TableColumnOrdering.stories.tsx38 name: "John Doe",CODE
LOWapp/stories/Table.stories.tsx70 name: "John Doe",CODE
LOWapp/stories/Table.stories.tsx719 for (const name of ["John Doe", "David Kim"]) {CODE
LOWapp/stories/ExpandableContent.stories.tsx78Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut laboreCODE
LOWapp/stories/ExpandableContent.stories.tsx78Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut laboreCODE
LOWapp/stories/ExpandableContent.stories.tsx91 name: "John Doe",CODE
LOWapp/stories/Modal.stories.tsx44 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Modal.stories.tsx44 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Modal.stories.tsx74 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Modal.stories.tsx74 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Modal.stories.tsx104 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOWapp/stories/Modal.stories.tsx104 Lorem ipsum dolor sit amet consectetur adipisicing elit.CODE
LOW…ks/evals-benchmarks/src/tool_response_handling.eval.ts133 address: "123 Main St",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts10 name: "John Doe",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts14 street: "123 Main St",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts46 userName: "John Doe", // Added mapped fieldCODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts88 extractedName: "John Doe",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts105 extractedStreet: "123 Main St",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts202 extractedName: "John Doe",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts203 extractedStreet: "123 Main St",CODE
LOW…es/phoenix-evals/test/utils/objectMappingUtils.test.ts315 fullName: "John Doe",CODE
LOW…packages/phoenix-evals/src/utils/objectMappingUtils.ts117 * // fullName: "John Doe",COMMENT
LOW…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py25 local_user = LocalUser(email="user@example.com", password="secret")STRING
LOW…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py181 user = LocalUser(email="user@example.com", password="secret")STRING
LOW…l_docs/vignettes/sqlalchemy/polymorphic_user/README.md33 - During object creation (e.g., `LocalUser(email="user@example.com", password="secret")`):CODE
LOW…l_docs/vignettes/sqlalchemy/polymorphic_user/README.md93local_user = LocalUser(email="user@example.com", password="secret")CODE
LOW…rnal_docs/vignettes/json-jsonb-demo/src/performance.ts61 name: 'John Doe',CODE
LOW…rnal_docs/vignettes/json-jsonb-demo/src/performance.ts64 street: '123 Main St',CODE
LOW…rnal_docs/vignettes/json-jsonb-demo/src/performance.ts135 WHERE data_json->'user'->>'name' = 'John Doe'CODE
LOW…rnal_docs/vignettes/json-jsonb-demo/src/performance.ts148 WHERE data_jsonb->'user'->>'name' = 'John Doe'CODE
LOW…rnal_docs/vignettes/json-jsonb-demo/src/performance.ts179 WHERE data_jsonb->'user'->>'name' = 'John Doe'CODE
LOW…l_docs/vignettes/json-jsonb-demo/src/query-examples.ts31 name: 'John Doe',CODE
LOW…rnal_docs/specs/ldap-authentication/database-schema.md12 username = 'John Doe' ← Display name (synced from LDAP)CODE
LOWtests/unit/test_config.py200 "user@example.com": "User=With=Equals",CODE
LOWtests/unit/server/test_ldap.py822 mock_attr.values = ["user@example.com"]CODE
LOWtests/unit/server/test_ldap.py826 assert result == "user@example.com"CODE
LOWtests/unit/server/test_ldap.py172 mock_display_name.values = ["John Doe"]CODE
LOWtests/unit/server/test_ldap.py188 assert result.display_name == "John Doe"CODE
LOWtests/unit/server/test_ldap.py274 mock_display_name.values = ["John Doe"]CODE
LOWtests/unit/server/test_ldap.py324 mock_display_name.values = ["John Doe"]CODE
LOWtests/unit/server/test_ldap.py405 mock_display_name.values = ["John Doe"]CODE
LOWtests/unit/server/test_rate_limiters.py541 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py542 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py543 limiter.check("user@example.com") # 2 failures < 3 max, should not raiseCODE
LOWtests/unit/server/test_rate_limiters.py555 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py556 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py557 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py559 limiter.check("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py568 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py569 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py570 limiter.record_success("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py572 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py573 limiter.record_failure("user@example.com")CODE
LOWtests/unit/server/test_rate_limiters.py574 limiter.check("user@example.com") # should not raiseCODE
145 more matches not shown…
Modern Structural Boilerplate160 hits · 164 pts
SeverityFileLineSnippetContext
LOWevals/pxi/evaluators/__init__.py31__all__ = [CODE
LOW…ents/capabilities/tools/internal/test_call_subagent.py50 def set_subagent_final_tool_output(chunk: ToolOutputAvailableChunk) -> None:CODE
LOW…ents/capabilities/tools/internal/test_call_subagent.py91 def set_subagent_final_tool_output(chunk: ToolOutputAvailableChunk) -> None:CODE
LOWtests/unit/server/api/routers/test_oauth2.py29 async def _setup_role_ids(self, asgi_app: ASGIApp, db: DbSessionFactory) -> None:CODE
LOWtests/unit/server/api/routers/test_oauth2.py161 async def _setup_role_ids(self, asgi_app: ASGIApp, db: DbSessionFactory) -> None:CODE
LOWtests/unit/db/test_facilitator.py299 def _update_manifest(self, manifest_path: Path, models: list[dict[str, Any]]) -> None:CODE
LOWtests/integration/_mock_ldap_server.py40logger = logging.getLogger(__name__)CODE
LOWtests/integration/_mock_llm_server.py145logger = logging.getLogger(__name__)CODE
LOWtests/integration/_helpers.py1442 def _setup_routes(self) -> None:CODE
LOWtests/integration/_helpers.py1878 def set_role(self, role: Optional[str], num_logins: int) -> None:CODE
LOWtests/integration/_helpers.py1896 def set_email(self, email: str, num_logins: int) -> None:CODE
LOWtests/integration/_helpers.py1920 def set_picture(self, picture: str, num_logins: int) -> None:CODE
LOWexamples/agents/tau_bench_openai_agents/tools.py58def set_data(data: dict[str, Any]) -> None:CODE
LOWexamples/agents/tau_bench_langgraph/tools.py58def set_data(data: dict[str, Any]) -> None:CODE
LOWscripts/update_helm.py30def update_helm_values(new_version: str) -> None:CODE
LOWscripts/update_helm.py41def update_helm_chart(new_version: str) -> None:CODE
LOWscripts/docker/devops/scripts/test_ldap_tls.py45logger = logging.getLogger(__name__)CODE
LOWscripts/docker/devops/scripts/ldap_mitm_proxy.py44logger = logging.getLogger(__name__)CODE
LOWscripts/prompts/compile_python_prompts.py62__all__ = [CODE
LOWscripts/data/build_llama_index_with_markdown_reader.py17logger = logging.getLogger(__name__)CODE
LOWpackages/phoenix-evals/src/phoenix/evals/tracing.py25logger = logging.getLogger(__name__)CODE
LOWpackages/phoenix-evals/src/phoenix/evals/__init__.py35__all__ = [CODE
LOWpackages/phoenix-evals/src/phoenix/evals/executors.py30logger = logging.getLogger(__name__)CODE
LOWpackages/phoenix-evals/src/phoenix/evals/executors.py129 def _update_concurrency_target(self) -> None:CODE
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py509__all__ = [CODE
LOWpackages/phoenix-evals/src/phoenix/evals/evaluators.py1736__all__ = [CODE
LOW…es/phoenix-evals/src/phoenix/evals/metrics/__init__.py14__all__ = [CODE
LOW…ckages/phoenix-evals/src/phoenix/evals/llm/__init__.py13__all__ = [CODE
LOWpackages/phoenix-evals/src/phoenix/evals/llm/types.py8__all__ = [CODE
LOW…ages/phoenix-evals/src/phoenix/evals/llm/registries.py9logger = logging.getLogger(__name__)CODE
LOW…oenix-evals/src/phoenix/evals/llm/adapters/__init__.py11__all__ = [CODE
LOW…ls/src/phoenix/evals/llm/adapters/langchain/adapter.py21logger = logging.getLogger(__name__)CODE
LOW…s/src/phoenix/evals/llm/adapters/langchain/__init__.py5__all__ = [CODE
LOW…evals/src/phoenix/evals/llm/adapters/google/adapter.py17logger = logging.getLogger(__name__)CODE
LOW…vals/src/phoenix/evals/llm/adapters/google/__init__.py3__all__ = ["GoogleGenAIAdapter"]CODE
LOW…ls/src/phoenix/evals/llm/adapters/anthropic/adapter.py16logger = logging.getLogger(__name__)CODE
LOW…s/src/phoenix/evals/llm/adapters/anthropic/__init__.py3__all__ = ["AnthropicAdapter"]CODE
LOW…vals/src/phoenix/evals/llm/adapters/litellm/adapter.py27logger = logging.getLogger(__name__)CODE
LOW…als/src/phoenix/evals/llm/adapters/litellm/__init__.py5__all__ = [CODE
LOW…evals/src/phoenix/evals/llm/adapters/openai/adapter.py21logger = logging.getLogger(__name__)CODE
LOW…vals/src/phoenix/evals/llm/adapters/openai/__init__.py3__all__ = [CODE
LOW…phoenix-evals/src/phoenix/evals/templating/__init__.py31__all__ = [CODE
LOWpackages/phoenix-client/src/phoenix/client/__init__.py7__all__ = [CODE
LOW…es/phoenix-client/src/phoenix/client/types/__init__.py3__all__ = [CODE
LOW…es/phoenix-client/src/phoenix/client/pytest/tracing.py26logger = logging.getLogger(__name__)CODE
LOW…es/phoenix-client/src/phoenix/client/pytest/tracing.py158def _set_io(span: Any, input_value: Any, output_value: Any) -> None:CODE
LOW…es/phoenix-client/src/phoenix/client/pytest/session.py24logger = logging.getLogger(__name__)CODE
LOW…s/phoenix-client/src/phoenix/client/pytest/__init__.py23__all__ = ["log_output", "log_evaluation", "evaluate"]CODE
LOW…es/phoenix-client/src/phoenix/client/pytest/context.py13logger = logging.getLogger(__name__)CODE
LOW…es/phoenix-client/src/phoenix/client/pytest/context.py28 def set_output(self, value: Any) -> None:CODE
LOW…ges/phoenix-client/src/phoenix/client/pytest/plugin.py37logger = logging.getLogger(__name__)CODE
LOW…enix-client/src/phoenix/client/experiments/__init__.py1027__all__ = [CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py40logger = logging.getLogger(__name__)CODE
LOW…t/src/phoenix/client/resources/experiments/__init__.py62logger = logging.getLogger(__name__)CODE
LOW…ient/src/phoenix/client/resources/projects/__init__.py15logger = logging.getLogger(__name__)CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py40logger = logging.getLogger(__name__)CODE
LOW…lient/src/phoenix/client/resources/prompts/__init__.py17logger = logging.getLogger(__name__)CODE
LOW…ages/phoenix-client/src/phoenix/client/utils/config.py27logger = logging.getLogger(__name__)CODE
LOW…s/phoenix-client/src/phoenix/client/utils/executors.py30logger = logging.getLogger(__name__)CODE
LOW…s/phoenix-client/src/phoenix/client/utils/executors.py140 def _update_concurrency_target(self) -> None:CODE
100 more matches not shown…
Cross-Language Confusion34 hits · 156 pts
SeverityFileLineSnippetContext
HIGHtests/unit/server/test_oauth2.py1341 email_attribute_path="contains(email_aliases[*], 'primary') && email || alternate_email",CODE
HIGHtests/unit/server/test_oauth2.py1350 "contains(email_aliases[*], 'primary') && email || alternate_email"CODE
HIGHtests/unit/server/test_oauth2.py632 """Test that edge case claim values are handled gracefully (null, empty, unicode, nested objects)."""STRING
HIGHtests/unit/server/api/routers/v1/test_datasets.py1019 jsonl_content = b'{"a": null, "b": "x"}\n{"b": "y"}\n'CODE
HIGHtests/unit/server/api/routers/v1/test_datasets.py2859 jsonl_content = b'{"a": null, "b": 2}\n'CODE
HIGHtests/unit/server/api/routers/v1/test_datasets.py2990 b'"metadata": {"difficulty": null}}\n'CODE
HIGHtests/unit/server/api/routers/v1/test_datasets.py1424 """Test JSON upload with various split formats: string, list, null, and mixed."""STRING
HIGHtests/unit/server/api/types/test_Evaluator.py347 """When dataset evaluator description is null, it should return base evaluator's description."""STRING
HIGHtests/unit/server/api/types/test_Evaluator.py368 """When both dataset evaluator and base evaluator descriptions are null, it returns null."""STRING
HIGHtests/unit/server/api/types/test_Dataset.py34 query ($exampleId: ID!, $datasetVersionId: ID = null) {CODE
HIGHtests/unit/server/api/types/test_Dataset.py175 query ($datasetId: ID!, $datasetVersionId: ID = null) {CODE
HIGHtests/unit/server/api/types/test_Dataset.py281 query ($datasetId: ID!, $datasetVersionId: ID = null, $revisionDatasetVersionId: ID = null, $filter: String = nullCODE
HIGHtests/unit/server/api/types/test_Dataset.py734 query ($datasetId: ID!, $datasetVersionId: ID = null, $includeEphemeral: Boolean = false) {CODE
HIGHtests/unit/server/api/types/test_Project.py1110 query ($projectId: ID!, $after: String = null, $before: String = null, $filterCondition: String = null, $first: InCODE
HIGH…mutations/test_project_session_annotation_mutations.py51 - Setting values to null (score/label/explanation to null)STRING
HIGH…mutations/test_project_session_annotation_mutations.py622 # B5. Update with score=null, label=null, explanation="" should fail validationSTRING
HIGH…mutations/test_project_session_annotation_mutations.py645 # Fields not provided in the input are reset to their default values (null)STRING
HIGH…sts/unit/server/api/mutations/test_secret_mutations.py323 # Test 12: Delete existing secret (by passing value: null)STRING
HIGHtests/integration/client/test_spans.py1385 'the capital of France?"}, "format": "MUSTACHE"}, "prompt_name": null}'CODE
HIGHtests/integration/client/test_spans.py1392 '"prompt_name": null}'CODE
HIGHscripts/ci/test_helm.py2693 # (--set attrEmail=null would be interpreted as YAML null, becoming empty string)COMMENT
HIGH…/phoenix-evals/tests/phoenix/evals/llm/test_prompts.py181 ("Mixed: {None} and {null}", TemplateFormat.F_STRING),CODE
HIGH…ents/capabilities/tools/external/write_prompt_tools.py59 "A function tool to create or update. Omit `id` (or pass null) to create a new "CODE
HIGHsrc/phoenix/server/sandbox/daytona_backend.py149 f"${{r.stderr || r.stdout}}`);\n"CODE
HIGHsrc/phoenix/server/api/routers/v1/experiments.py412 # dropped — otherwise `{"name": null, "description": "x"}` would 200 and ignore the name.COMMENT
HIGHsrc/phoenix/server/api/routers/v1/secrets.py46 """Values, when non-null, must be non-empty strings (after trimming)."""STRING
HIGHsrc/phoenix/server/api/types/Span.py209 description="the parent span ID. If null, it is a root span",CODE
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py50 {"key": "OPENAI_API_KEY", "value": null}STRING
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py55 description="The value of the secret. If null, the secret will be deleted."CODE
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py82 determines the final action (upsert with that value, or delete if value is null).STRING
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py82 determines the final action (upsert with that value, or delete if value is null).STRING
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py89 "or delete if value is null)."CODE
HIGHsrc/phoenix/server/api/mutations/secret_mutations.py89 "or delete if value is null)."CODE
HIGHsrc/phoenix/db/facilitator.py371 applies to all projects without a specific policy (i.e. foreign key is null).STRING
Verbosity Indicators78 hits · 138 pts
SeverityFileLineSnippetContext
LOWjs/examples/apps/tracing-tutorial/support-agent.ts244 // Step 1: Classify the queryCOMMENT
LOWjs/examples/apps/tracing-tutorial/support-agent.ts292 // Step 2: Route based on classificationCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts142 // Step 1: Fetch spans from PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts162 // Step 2: Filter spans by typeCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts192 // Step 3: Evaluate tool spans (simple code-based check)COMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts264 // Step 4: Log annotations to PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts280 // Step 5: SummaryCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts337 // Step 1: Fetch spans from PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts359 // Step 2: Group spans by session IDCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts395 // Step 3: Evaluate each sessionCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts486 // Step 4: Log session annotations to PhoenixCOMMENT
LOWjs/examples/apps/tracing-tutorial/evaluate-traces.ts504 // Step 5: SummaryCOMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts10// Step 1: define the task to run (we call the agent with the question)COMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts21// Step 2: define the dataset of questions to ask the agentCOMMENT
LOW…/mastra-agent/src/experiments/configure-experiments.ts45// Step 3: Define the evaluatorsCOMMENT
LOW…s/apps/mastra-agent/src/experiments/run-experiments.ts7//Step 4: Run the experimentCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts117 // Step 1: Fetch spans from the projectCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts138 // Step 2: Transform spans into dataset examples with span ID linksCOMMENT
LOW…s/phoenix-client/examples/create_dataset_from_spans.ts172 // Step 3: Create the dataset with span associationsCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts36// Step 1: Define the agent's toolsCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts60// Step 2: Define the agentCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts80// Step 3: Build the evaluatorCOMMENT
LOW…/phoenix-client/examples/experiment_trace_evaluator.ts126// Step 4: Run the experiment and evaluateCOMMENT
LOWtests/unit/_helpers.py235 # Step 1: Get ALL revisions up to and including this dataset versionCOMMENT
LOWtests/unit/_helpers.py248 # Step 2: Find the latest revision for each example (simple Python logic)COMMENT
LOWtests/unit/_helpers.py256 # Step 3: Filter out DELETE revisionsCOMMENT
LOWtests/unit/_helpers.py263 # Step 4: Check if experiment has assigned splitsCOMMENT
LOWtests/unit/_helpers.py272 # Step 5: Filter by splits if any are assignedCOMMENT
LOWtests/integration/_helpers.py1559 # Step 2: Validate PKCE (if required)COMMENT
LOWtests/integration/_helpers.py1538 # Step 1: Validate client authentication (if required)COMMENT
LOWtests/integration/_helpers.py1595 # Step 3: Determine authentication mode and validateCOMMENT
LOWtests/integration/auth/test_ldap.py503 # Step 1: Create LDAP user via loginCOMMENT
LOWtests/integration/auth/test_ldap.py509 # Step 2: Query GraphQL to verify authMethod is 'LDAP'COMMENT
LOWtests/integration/auth/test_ldap.py664 # Step 1: Admin pre-creates LDAP user (only needs email)COMMENT
LOWtests/integration/auth/test_ldap.py698 # Step 2: Add user to LDAP with matching emailSTRING
LOWtests/integration/auth/test_ldap.py707 # Step 3: User logs in via LDAP (email lookup finds pre-created user)STRING
LOWtests/integration/auth/test_ldap.py713 # Step 4: Verify username remains stable (not synced from LDAP)STRING
LOWtests/integration/auth/test_ldap.py721 # Step 5: Verify subsequent logins workSTRING
LOWtests/integration/client/test_experiments.py2621 # Step 1: Run experiment WITHOUT evaluators (task execution only)COMMENT
LOWtests/integration/client/test_experiments.py2640 # Step 2: Add evaluations to the completed experimentCOMMENT
LOW…ts/uv/type_check/get_phoenix_modules_with_ty_errors.py53# Step 1: Import phoenix to trace import orderCOMMENT
LOW…ts/uv/type_check/get_phoenix_modules_with_ty_errors.py59# Step 2: Run ty checkCOMMENT
LOW…ts/uv/type_check/get_phoenix_modules_with_ty_errors.py68# Step 3: Parse ty output to find files with errorsCOMMENT
LOW…ts/uv/type_check/get_phoenix_modules_with_ty_errors.py87# Step 4: Order files by import orderCOMMENT
LOW…ts/uv/type_check/get_phoenix_modules_with_ty_errors.py104# Step 5: Write to fileCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py450 # Step 1: Identify all span_id sourcesCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py454 # Step 2: Create a working copy and preserve all span infoCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py468 # Step 3: Reset index to avoid conflicts during concatenationCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py471 # Step 4: Validate we have span_id informationCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py475 # Step 5: Process each score nameCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py488 # Step 6: Concatenate with new sequential indicesCOMMENT
LOW…ent/examples/experiments/experiment_trace_evaluator.py47# Step 1: Define the agent's toolsCOMMENT
LOW…ent/examples/experiments/experiment_trace_evaluator.py81# Step 2: Define the agentCOMMENT
LOW…ent/examples/experiments/experiment_trace_evaluator.py104# Step 3: Build the evaluatorCOMMENT
LOW…ent/examples/experiments/experiment_trace_evaluator.py155# Step 4: Run the experiment and evaluateCOMMENT
LOW…examples/datasets/create_dataset_from_spans_example.py38# Step 1: Set up Tracing with phoenix-otelCOMMENT
LOW…examples/datasets/create_dataset_from_spans_example.py53# Step 2: Simulate LLM Calls using OpenInference DecoratorsCOMMENT
LOW…examples/datasets/create_dataset_from_spans_example.py138# Step 3: Query Spans from Phoenix using get_spans_dataframeCOMMENT
LOW…examples/datasets/create_dataset_from_spans_example.py218# Step 4: Create Dataset with Span AssociationsCOMMENT
LOW…examples/datasets/create_dataset_from_spans_example.py301 # Step 1: Log LLM spans using OpenInference decorators/context managersCOMMENT
18 more matches not shown…
Modern AI Meta-Vocabulary53 hits · 118 pts
SeverityFileLineSnippetContext
MEDIUMREADME.md130| | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatioCODE
MEDIUMsitemap.xml1060 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc>CODE
MEDIUMsitemap.xml1064 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc>CODE
MEDIUMsitemap.xml1896 <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc>CODE
MEDIUMsitemap.xml1988 <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc>CODE
MEDIUMsitemap.xml1992 <loc>https://arize.com/docs/phoenix/cookbook/guardrails/designing-realtime-guardrails</loc>CODE
MEDIUMsitemap.xml2640 <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc>CODE
MEDIUMevals/pxi/evaluators/tools.py293# scaffold keys an earlier write left behind.COMMENT
MEDIUMinternal_docs/specs/online-evals.md203[feedback use case](#evaluate-on-user-feedback)). The third is event-driven, notCODE
MEDIUMtests/unit/trace/dsl/test_filter.py350 # shapes that bypass the structural guardrails ``SpanFilter`` enforces.COMMENT
MEDIUMtests/unit/pxi/evals/test_datasets.py321 # The preservation case must assert the scaffold keys survive aSTRING
MEDIUMtests/unit/pxi/evals/test_evaluator_matchers.py246 # The preservation case: scaffold keys must survive a whole-metadataCOMMENT
MEDIUMtests/unit/pxi/evals/test_evaluator_matchers.py280 # Clobbering the scaffold (dropping ``hypothesis``) must fail the check.COMMENT
MEDIUM…ents/skills/phoenix-evals/references/evaluators-rag.md1# Evaluators: RAG SystemsCOMMENT
MEDIUM…ents/skills/phoenix-evals/references/evaluators-rag.md85## RAG Failure TaxonomyCOMMENT
MEDIUM…phoenix-evals/references/experiments-running-python.md35# With context (RAG)COMMENT
MEDIUM…lls/phoenix-evals/references/common-mistakes-python.md118# RIGHT for RAG evaluation — fetch child spans for retriever/LLM metricsCOMMENT
MEDIUM…kills/phoenix-tracing/references/annotations-python.md85## RAG Pipeline ExampleCOMMENT
MEDIUM…s/phoenix-tracing/references/annotations-typescript.md126## RAG Pipeline ExampleCOMMENT
MEDIUMdocs/PROMPT.md95| `guardrails` | Guardrails AI | https://arize.com/docs/phoenix/integrations/python/guardrails-ai |CODE
MEDIUMdocs/sitemap.xml134 <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc>CODE
MEDIUMdocs/sitemap.xml199 <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc>CODE
MEDIUMdocs/sitemap.xml787 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc>CODE
MEDIUMdocs/sitemap.xml792 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc>CODE
MEDIUMdocs/sitemap.xml1617 <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc>CODE
MEDIUMdocs/phoenix/llms.txt266- [Guardrails AI Tracing](https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing): Auto-CODE
MEDIUMdocs/phoenix/llms.txt289- [OpenAI Agents SDK (TypeScript)](https://arize.com/docs/phoenix/integrations/typescript/openai-agents): Trace @openai/CODE
MEDIUMdocs/phoenix/llms.txt349- [Agent Spec](https://arize.com/docs/phoenix/integrations/python/agentspec): Open Agent Spec (Agent Spec) is a portableCODE
MEDIUMdocs/phoenix/llms.txt357- [Guardrails AI](https://arize.com/docs/phoenix/integrations/python/guardrails-ai): Guardrails is an open-source PythonCODE
MEDIUMdocs/phoenix/llms.txt365- [Portkey](https://arize.com/docs/phoenix/integrations/python/portkey): Portkey is an AI Gateway and observability platCODE
MEDIUMdocs/phoenix/llms.txt709- [Designing Realtime Guardrails: Input, Output, and the Cost of Blocking](https://arize.com/docs/phoenix/cookbook/guardCODE
MEDIUMdocs/phoenix/llms.txt714- [Jailbreak and Prompt Injection Defense](https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injecCODE
MEDIUMdocs/phoenix/llms.txt724- [Agentic RAG Tracing](https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing): Build and trace an agenticCODE
MEDIUMdocs/phoenix/llms.txt741- [07.18.2024: Guardrails AI integrations](https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-inCODE
MEDIUMdocs/phoenix/sitemap.xml1060 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc>CODE
MEDIUMdocs/phoenix/sitemap.xml1064 <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc>CODE
MEDIUMdocs/phoenix/sitemap.xml1896 <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc>CODE
MEDIUMdocs/phoenix/sitemap.xml1988 <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc>CODE
MEDIUMdocs/phoenix/sitemap.xml1992 <loc>https://arize.com/docs/phoenix/cookbook/guardrails/designing-realtime-guardrails</loc>CODE
MEDIUMdocs/phoenix/sitemap.xml2640 <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc>CODE
MEDIUMexamples/rag_agent/README.md1# Agentic RAG ExamplesCOMMENT
MEDIUMexamples/rag_agent/app.py110 gr.Markdown("## Chat with RAG Agent 🔥")STRING
MEDIUMexamples/rag_agent/app.py143 gr.Markdown("### Chat with RAG Agent 💬")STRING
MEDIUMscripts/docker/devops/LDAP-TLS-TESTING.md47│ └── test_ldap_tls.py # Test orchestration (all tests here)CODE
MEDIUMpackages/phoenix-evals/src/phoenix/evals/utils.py441 # Log only hallucination annotationsSTRING
MEDIUM…evals/src/phoenix/evals/llm/adapters/openai/adapter.py489 # documented ``name`` field used to label few-shot exemplars orCOMMENT
MEDIUMpackages/phoenix-client/docs/source/index.md252#### RAG Retrieval EvaluationSTRING
MEDIUMpackages/phoenix-client/docs/source/index.md289#### RAG Q&A EvaluationSTRING
MEDIUMpackages/phoenix-client/docs/source/index.md321#### Time-Filtered RAG SpansSTRING
MEDIUMtutorials/ai_evals_course/hw3_phoenix/README.md227│ ├── develop_judge.py # Develop LLM judge with few-shot examplesCODE
MEDIUMtutorials/ai_evals_course/hw3_phoenix/README.md234│ ├── train_set.csv # Training examples for few-shot (~23)CODE
MEDIUM…s/ai_evals_course/hw3_phoenix/scripts/develop_judge.py106 # Add few-shot examplesSTRING
MEDIUMsrc/phoenix/server/agents/prompts/templating.py14 autoescape=False, # escaping `<` to `&lt;` would corrupt the XML scaffoldingCODE
Redundant / Tautological Comments76 hits · 106 pts
SeverityFileLineSnippetContext
LOW…s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh30# Check if docker is runningCOMMENT
LOW…s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh44# Check if Phoenix container is runningCOMMENT
LOW…s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh69# Check if Phoenix container exists but is stoppedCOMMENT
LOWtests/unit/server/api/conftest.py1183 # Assign examples to splitsCOMMENT
LOWtests/unit/db/test_helpers.py1122 # Assign examples to splitsCOMMENT
LOWtests/unit/db/test_helpers.py1357 # Assign splits to experimentsCOMMENT
LOWtests/integration/_mock_llm_server.py2121 # Check if SSE format is requested (alt=sse query param)COMMENT
LOWtests/integration/_helpers.py2465 # Check if we have a complete partSTRING
LOWtests/integration/client/test_prompts.py1531 # Assign labels to prompts using GraphQL mutationSTRING
LOWtests/integration/client/test_prompts.py1542 # Assign label1 to prompt1STRING
LOWtests/integration/client/test_prompts.py1558 # Assign label2 to prompt3STRING
LOWtests/integration/client/test_prompts.py1688 # Assign labels to promptsSTRING
LOWtests/integration/client/test_annotations.py813 # Check if we have all expected annotationsSTRING
LOWtests/integration/client/test_annotations.py2064 # Check if we have all expected annotationsSTRING
LOWtests/integration/client/test_annotations.py2793 # Check if we have all expected annotationsSTRING
LOWtests/integration/client/test_spans.py1406 # Set index to span_id so dataframe_to_spans uses the right span IDsCOMMENT
LOWtests/integration/db_migrations/__init__.py122 # Check if table existsCOMMENT
LOWtests/integration/db_migrations/__init__.py194 # Check if table existsCOMMENT
LOWapi_reference/source/conf.py40 # Check if we are still in the automodule blockCOMMENT
LOWapi_reference/source/conf.py45 # Check if we are out of the automodule blockCOMMENT
LOWexamples/computer_use_agent/tools/edit.py83 # Check if its an absolute pathCOMMENT
LOWexamples/computer_use_agent/tools/edit.py89 # Check if path existsCOMMENT
LOWexamples/computer_use_agent/tools/edit.py96 # Check if the path points to a directoryCOMMENT
LOWexamples/computer_use_agent/tools/edit.py146 # Read the file contentCOMMENT
LOWexamples/computer_use_agent/tools/edit.py151 # Check if old_str is unique in the fileCOMMENT
LOWexamples/computer_use_agent/image/xvfb_startup.sh30# Check if Xvfb is already runningCOMMENT
LOWscripts/docker/devops/dev.sh69 # Add profile to the listCOMMENT
LOWscripts/docker/devops/dev.sh562 # Check if Phoenix container is runningCOMMENT
LOWscripts/docker/devops/scripts/test_ldap_tls.py604 # Check if any Phase 2 application tests failed - we can't claim securityCOMMENT
LOWscripts/generate_data_via_plpgsql/generate_spans.py127 # Check if the command was successfulCOMMENT
LOWscripts/generate_data_via_plpgsql/generate_spans.py133 # Print the output if requestedCOMMENT
LOWscripts/generate_data_via_plpgsql/generate_spans.py213 print_output=True, # Print output for report_spans_table_sizes.sqlCODE
LOW…/generate_data_via_plpgsql/report_spans_table_sizes.py103 # Check if the command was successfulCOMMENT
LOW…generate_data_via_plpgsql/generate_span_annotations.py239 # Check if the command was successfulCOMMENT
LOW…generate_data_via_plpgsql/generate_span_annotations.py245 # Print the output if requestedCOMMENT
LOWscripts/ci/test_helm.py2099 # Check if the error contains the expected substringCOMMENT
LOWscripts/ddl/generate_ddl_postgresql.py1012 # Check if identifier needs quotes to preserve case/special charsCOMMENT
LOWscripts/ddl/generate_ddl_postgresql.py1157 # Check if line ends with semicolon (end of statement)COMMENT
LOWscripts/uv/type_check/type_check.py57 # Check if we have fewer errors than expected (good news!)COMMENT
LOW…ripts/generate_spans/generate_spans_for_time_series.py249# Set pandas to display all rows without truncationSTRING
LOWpackages/phoenix-evals/src/phoenix/evals/tracing.py144 # Check if function has a trace_id parameterCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/tracing.py241 # Check if function has a trace_id parameterCOMMENT
LOW…vals/src/phoenix/evals/llm/adapters/litellm/adapter.py580 # Check if schema has properties and required fieldsCOMMENT
LOW…kages/phoenix-client/src/phoenix/client/types/spans.py36 # Check if the key is a legacy name that should be replaced.COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py1241 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py1431 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py1543 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py3091 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py3285 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…t/src/phoenix/client/resources/experiments/__init__.py3399 # Check if response is HTML (endpoint doesn't exist on old server)COMMENT
LOW…ient/src/phoenix/client/resources/datasets/__init__.py2271 # Check if there's at least one data rowCOMMENT
LOW…lient/src/phoenix/client/resources/prompts/__init__.py297 # Check if a specific tag existsSTRING
LOW…lient/src/phoenix/client/resources/prompts/__init__.py586 # Check if a specific tag existsSTRING
LOW…nix-client/src/phoenix/client/helpers/atif/_convert.py609 # Output messageCOMMENT
LOW…ix-client/src/phoenix/client/helpers/spans/__init__.py356 # Check if events is not null/nan using pandas-safe methodCOMMENT
LOWsrc/phoenix/config.py1003 # Check if TLS is enabledCOMMENT
LOWsrc/phoenix/trace/trace_dataset.py94 # Check if the dataframe has any document columnsCOMMENT
LOWsrc/phoenix/trace/trace_dataset.py330 # Append the evaluations to the list of evaluationsCOMMENT
LOWsrc/phoenix/trace/span_json_decoder.py41 # Check if the dict can be interpreted as a SpanCOMMENT
LOWsrc/phoenix/server/ldap.py1039 # Check if results were truncated by server's size limitCOMMENT
16 more matches not shown…
AI Slop Vocabulary41 hits · 106 pts
SeverityFileLineSnippetContext
MEDIUMevals/pxi/pytest.ini6# doctest-collect the eval harness and this suite's conftest, which it must not.COMMENT
MEDIUMevals/pxi/thresholds.yaml1# Per-(evaluator, split) pass-rate gate policy for the PXI eval harness.COMMENT
MEDIUMevals/pxi/datasets/set_spans_filter.yaml707 # We do NOT require any specific tool be called (the eval harness mayCOMMENT
MEDIUMevals/pxi/datasets/product_knowledge.yaml642 # deferred tool ends the single-shot harness run before any text isCOMMENT
MEDIUMevals/pxi/datasets/experiments_skill_trigger.yaml261 # Given a primed experiment id and a compare question under the harness'sCOMMENT
MEDIUMevals/pxi/datasets/experiments_skill_trigger.yaml264 # to the known harness toolset on purpose; the skill itself staysCOMMENT
MEDIUMapp/tests/code-evaluators.spec.ts310 // is robust to that prefix.COMMENT
MEDIUMtests/unit/test_auth.py99 # Test comprehensive sanitizationCOMMENT
MEDIUMtests/unit/server/api/routers/test_oauth2.py36 """Single comprehensive test covering all sign-in scenarios."""STRING
MEDIUMtests/unit/server/api/routers/v1/test_experiments.py1092 # Create specific scenarios for comprehensive testingCOMMENT
MEDIUMtests/unit/server/api/types/test_Project.py276 # Full time range for comprehensive testingCOMMENT
MEDIUMtests/unit/server/api/types/test_Project.py116 """Create comprehensive test data for cost and token testing.STRING
MEDIUMtests/unit/db/test_models.py76 # Create comprehensive test data that covers various Unicode and special character scenariosCOMMENT
MEDIUMtests/unit/db/test_models.py252 # Single comprehensive payload testing ALL serialization scenarios:COMMENT
MEDIUMtests/unit/db/test_models.py277 # NaN/Inf values (consolidated comprehensive coverage from test_json_sanitization)COMMENT
MEDIUMtests/unit/db/test_models.py396 # Create all metadata entities with the comprehensive payloadCOMMENT
MEDIUMtests/unit/db/test_models.py225 """Test comprehensive orjson serialization of all special object types across JSON columns.STRING
MEDIUMtests/unit/db/test_helpers.py391 # Create dataset versions for comprehensive evolution testingCOMMENT
MEDIUMtests/unit/db/test_helpers.py433 # Create comprehensive split structureCOMMENT
MEDIUMtests/unit/db/test_helpers.py466 # Create overlapping split assignments for comprehensive testingCOMMENT
MEDIUMtests/unit/db/test_helpers.py507 # Create comprehensive revision patterns with direct object referencesCOMMENT
MEDIUMtests/unit/db/test_helpers.py642 # Return comprehensive mapping for all test scenariosCOMMENT
MEDIUMtests/unit/db/test_helpers.py1000 # Collect IDs for comprehensive duplicate analysisCOMMENT
MEDIUMtests/unit/db/test_helpers.py1020 # Expected examples based on our comprehensive fixture:COMMENT
MEDIUMtests/integration/server/test_db_disk_usage_monitor.py348 # This ensures the blocking behavior is comprehensive and not bypass-able.COMMENT
MEDIUMtests/integration/client/test_annotations.py2298 # Ensure we have different sessions for a more robust testSTRING
MEDIUMtests/integration/client/test_experiments.py2079 # Create first dataset for comprehensive mixed scenarios (examples 0-4)STRING
MEDIUMtests/integration/client/test_spans.py1287 # Create comprehensive test DataFrame with nested attributesCOMMENT
MEDIUMtests/integration/client/test_spans.py1297 # Create comprehensive test data with nested attributes and complex typesCOMMENT
MEDIUM…/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh77# --skip-git-repo-check: harness may be invoked from non-git working dirs.COMMENT
MEDIUMscripts/docker/devops/scripts/test_ldap_tls.py507 """Run comprehensive security test suite."""STRING
MEDIUMscripts/docker/devops/scripts/ldap_mitm_proxy.py580 """Print comprehensive security summary."""STRING
LOWpackages/phoenix-evals/src/phoenix/evals/utils.py464 # Index name matches existing column - just add the index valuesCOMMENT
MEDIUM…_evals_course/hw3_phoenix/results/dev_predictions.json1{"llm_as_judge_label":{"0":"FAIL","1":"FAIL","2":"FAIL","3":"FAIL","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"PASSCODE
MEDIUM…_evals_course/hw3_phoenix/results/dev_predictions.json1{"llm_as_judge_label":{"0":"FAIL","1":"FAIL","2":"FAIL","3":"FAIL","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"PASSCODE
MEDIUM…evals_course/hw3_phoenix/results/test_predictions.json1{"ground_truth_label":{"0":"FAIL","1":"PASS","2":"PASS","3":"PASS","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"FAILCODE
MEDIUM…ls/mcp/tracing_between_mcp_client_and_server/server.py216 """Generates a comprehensive investment report based on client profile and market analysis."""STRING
LOWsrc/phoenix/server/api/routers/ldap.py161 # Null email mode: email column is nullable, so just use NoneCOMMENT
LOW…x/server/api/dataloaders/document_retrieval_metrics.py45 # it simple and just use one approach for all backends.COMMENT
MEDIUMsrc/phoenix/server/api/helpers/message_helpers.py24# This makes it easier to leverage openinference.instrumentation helpersCOMMENT
MEDIUMsrc/phoenix/db/models.py659 # Enforce best practices for naming constraintsCOMMENT
Over-Commented Block88 hits · 80 pts
SeverityFileLineSnippetContext
LOWrender.yaml1# Render Blueprint for Arize PhoenixCOMMENT
LOW.readthedocs.yaml21 # builder: "dirhtml"COMMENT
LOWevals/pxi/thresholds.yaml1# Per-(evaluator, split) pass-rate gate policy for the PXI eval harness.COMMENT
LOWevals/pxi/thresholds.yaml21# regression, not flake. gate.py compares with STRICT less-than, so for a cellCOMMENT
LOWevals/pxi/thresholds.yaml101 # This dataset (n=6) proved nondeterministic: correct_tools_called andCOMMENT
LOWevals/pxi/evaluators/tools.py261COMMENT
LOWevals/pxi/evaluators/tools.py281# - ``non_empty: true`` -- the key must be present and contain non-whitespace text.COMMENT
LOWapp/src/components/core/tabs/Tabs.tsx141 // dissolves together.COMMENT
LOWapp/src/components/agent/agentFabPositioning.ts1import type { AgentFabPlacement } from "@phoenix/store/agentStore";COMMENT
LOWapp/src/components/agent/SkillHighlightOverlay.tsx41 mark {COMMENT
LOWjs/packages/phoenix-config/README.md81re-discover it.COMMENT
LOWjs/packages/phoenix-client/src/testing/runner.ts141 );COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md121COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md141# - starttls: Start with plaintext, upgrade to TLS (port 389)COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md161COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md181COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md201# - OpenLDAP: "entryUUID"COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md221# When set: Reads the specified attribute from the user's LDAP entryCOMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md241COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md261# - "MEMBER" → MEMBER role (Phoenix)COMMENT
LOW…ternal_docs/specs/ldap-authentication/configuration.md281# ==============================================================================COMMENT
LOWtests/unit/test_tracers.py701 assert fetched_span.cumulative_llm_token_count_prompt == 0COMMENT
LOWtests/unit/test_tracers.py721 #COMMENT
LOWtests/integration/server/test_db_disk_usage_monitor.py161 # an alert was properly sent to the configured admin email address.COMMENT
LOWtests/integration/server/test_db_disk_usage_monitor.py241 # ========================================================================COMMENT
LOWtests/integration/server/test_db_disk_usage_monitor.py341 _gql(_app, access_token, query=query)COMMENT
LOW…/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh1#!/usr/bin/env bashCOMMENT
LOWscripts/capabilities_poc.py41 print(part.content)COMMENT
LOWscripts/docker/devops/overrides/ldap-test.yml1# Docker Compose override for LDAP testingCOMMENT
LOWscripts/docker/devops/overrides/ldap-test.yml21# 6. POSIX mode (GROUP_SEARCH_FILTER) - phoenix-posix → ldap-posixCOMMENT
LOWscripts/docker/devops/overrides/ldap-test.yml401COMMENT
LOW…son-canonicalization-schema/verify-canonicalization.py1##############################################################################COMMENT
LOW…ipts/ci/json-canonicalization-schema/verify-numbers.py1##############################################################################COMMENT
LOW…pts/ci/json-canonicalization-schema/testdata/numgen.js1//COMMENT
LOW…pts/ci/json-canonicalization-schema/testdata/numgen.go1//COMMENT
LOWscripts/perf/postgres/postgres_explain_analyze.py1# /// scriptCOMMENT
LOWpackages/phoenix-evals/src/phoenix/evals/llm/prompts.py581# """Initialize an image URL content part template.COMMENT
LOW…ls/src/phoenix/evals/llm/adapters/anthropic/adapter.py321 if not prompt:COMMENT
LOWpackages/phoenix-client/examples/pytest/eval-ci.yml41 # OPTIONAL example: post the printed summary back to the PR as a single,COMMENT
LOWpackages/phoenix-client/examples/pytest/eval-ci.yml61 # PHOENIX_API_KEY: ${{ secrets.PHOENIX_API_KEY }}COMMENT
LOWpackages/phoenix-client/examples/pytest/eval-ci.yml81 # } else {COMMENT
LOW…ent/examples/experiments/experiment_trace_evaluator.py101COMMENT
LOWpackages/phoenix-client/scripts/codegen/transform.py1import astCOMMENT
LOWpackages/phoenix-client/scripts/codegen/transform.py21# Supported transformations:COMMENT
LOW…nix-client/src/phoenix/client/helpers/atif/_convert.py1# pyright: reportUnknownMemberType=false, reportUnknownVariableType=false, reportUnknownArgumentType=falseCOMMENT
LOW.github/workflows/claude-code-review.yml21 # Same-repo PRs only: fork-origin pull_request runs get neither repositoryCOMMENT
LOW.github/workflows/claude.yml101COMMENT
LOWhelm/values.yaml21 nodeSelector: {}COMMENT
LOWhelm/values.yaml61 enabled: falseCOMMENT
LOWhelm/values.yaml161 workingDir: "/data"COMMENT
LOWhelm/values.yaml181COMMENT
LOWhelm/values.yaml201 # version: stableCOMMENT
LOWhelm/values.yaml241# 3. Leave database.url empty (Phoenix will automatically use SQLite in the persistent volume)COMMENT
LOWhelm/values.yaml281 port: 5432COMMENT
LOWhelm/values.yaml301 useAzureManagedIdentity: falseCOMMENT
LOWhelm/values.yaml381 secret:COMMENT
LOWhelm/values.yaml421 # Server connection settingsCOMMENT
LOWhelm/values.yaml461 # -- List of base DNs for user searches (required when enabled). Searched in order.COMMENT
LOWhelm/values.yaml481COMMENT
LOWhelm/values.yaml501COMMENT
28 more matches not shown…
Hallucination Indicators7 hits · 70 pts
SeverityFileLineSnippetContext
CRITICAL…als/test/template/createTemplateVariablesProxy.test.ts192 expect(proxied.level1.level2.level3.level4.toString()).toBe(CODE
CRITICAL…_docs/specs/ldap-authentication/future-improvements.md142from ldap3.core.exceptions import LDAPSocketOpenError, LDAPSocketReceiveErrorCODE
CRITICAL…ment-runner-background-process/appendix-error-types.md219from azure.core.exceptions import HttpResponseErrorCODE
CRITICALtests/unit/vcr.py31 module_name = self._request.node.module.__name__.split(".")[-1]CODE
CRITICALtests/unit/server/sandbox/test_modal_backend.py406 modal_mock.Image.debian_slim.return_value.pip_install.assert_called_once_with(packages)CODE
CRITICALtests/integration/_mock_ldap_server.py22from ldap3.core.exceptions import LDAPInvalidDnErrorCODE
CRITICALsrc/phoenix/config.py28from ldap3.core.exceptions import LDAPInvalidDnErrorCODE
Cross-Language Confusion (JS/TS)11 hits · 55 pts
SeverityFileLineSnippetContext
HIGH…c/components/evaluators/ContainsEvaluatorCodeBlock.tsx15 return FalseCODE
HIGHapp/src/pages/prompt/promptCodeSnippets.tsx102print(completion.choices[0].message)CODE
HIGHapp/src/pages/prompt/promptCodeSnippets.tsx132print(response.choices[0].message.content)CODE
HIGHapp/src/pages/prompt/promptCodeSnippets.tsx181print(completion.content)CODE
HIGH…/prompt/__tests__/promptCodeSnippets.anthropic.test.ts274 print(completion.content)"CODE
HIGH…/prompt/__tests__/promptCodeSnippets.anthropic.test.ts392 print(completion.content)"CODE
HIGH…/prompt/__tests__/promptCodeSnippets.anthropic.test.ts436 print(completion.content)"CODE
HIGH…ges/prompt/__tests__/promptCodeSnippets.openai.test.ts295 print(completion.choices[0].message)"CODE
HIGH…ges/prompt/__tests__/promptCodeSnippets.openai.test.ts402 print(completion.choices[0].message)"CODE
HIGH…ges/prompt/__tests__/promptCodeSnippets.openai.test.ts439 print(completion.choices[0].message)"CODE
HIGH…ges/prompt/__tests__/promptCodeSnippets.openai.test.ts487 print(completion.choices[0].message)"CODE
AI Structural Patterns53 hits · 41 pts
SeverityFileLineSnippetContext
LOWtests/unit/_helpers.py96CODE
LOWtests/unit/server/api/test_code_evaluator_runner.py96CODE
LOWexamples/agent_framework_comparison/li_workflow/main.py16CODE
LOW…generate_data_via_plpgsql/generate_span_annotations.py162CODE
LOWscripts/ci/test_helm.py747CODE
LOWscripts/ci/test_helm.py1099CODE
LOW…kages/phoenix-evals/src/phoenix/evals/rate_limiters.py180CODE
LOWpackages/phoenix-evals/src/phoenix/evals/executors.py198CODE
LOW…enix-client/src/phoenix/client/experiments/__init__.py17CODE
LOW…enix-client/src/phoenix/client/experiments/__init__.py207CODE
LOW…client/src/phoenix/client/resources/traces/__init__.py339CODE
LOW…client/src/phoenix/client/resources/traces/__init__.py735CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py171CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py250CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py476CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py626CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py1447CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py1754CODE
LOW…-client/src/phoenix/client/resources/spans/__init__.py1903CODE
LOW…t/src/phoenix/client/resources/experiments/__init__.py633CODE
LOW…t/src/phoenix/client/resources/experiments/__init__.py2134CODE
LOW…t/src/phoenix/client/resources/experiments/__init__.py2476CODE
LOW…t/src/phoenix/client/resources/experiments/__init__.py3968CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py785CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py953CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py1151CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py1254CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py1711CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py1852CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py2032CODE
LOW…ient/src/phoenix/client/resources/datasets/__init__.py2133CODE
LOW…oenix-client/src/phoenix/client/utils/rate_limiters.py165CODE
LOW…s/phoenix-client/src/phoenix/client/utils/executors.py209CODE
LOWpackages/phoenix-otel/src/phoenix/otel/otel.py65CODE
LOWsrc/phoenix/server/oauth2.py64CODE
LOWsrc/phoenix/server/rate_limiters.py193CODE
LOWsrc/phoenix/server/app.py570CODE
LOWsrc/phoenix/server/app.py832CODE
LOWsrc/phoenix/server/agents/server_agents.py55CODE
LOWsrc/phoenix/server/agents/agent_factory.py65CODE
LOWsrc/phoenix/server/api/context.py117CODE
LOWsrc/phoenix/server/api/routers/auth.py212CODE
LOWsrc/phoenix/server/api/routers/auth.py394CODE
LOWsrc/phoenix/server/api/routers/oauth2.py290CODE
LOWsrc/phoenix/server/api/routers/oauth2.py875CODE
LOWsrc/phoenix/server/api/routers/v1/spans.py727CODE
LOWsrc/phoenix/server/api/routers/v1/spans.py904CODE
LOWsrc/phoenix/server/api/routers/v1/traces.py122CODE
LOWsrc/phoenix/server/api/types/Dataset.py221CODE
LOWsrc/phoenix/server/api/types/Project.py472CODE
LOWsrc/phoenix/db/models.py1111CODE
LOWsrc/phoenix/db/models.py1122CODE
LOWsrc/phoenix/db/models.py1132CODE
Slop Phrases16 hits · 36 pts
SeverityFileLineSnippetContext
MEDIUMjs/examples/apps/tracing-tutorial/support-agent.ts305 system: `You are a helpful customer support agent. When customers ask about order status, use the lookupOrCODE
MEDIUMjs/benchmarks/evals-benchmarks/src/refusal.eval.ts32 "I'm sorry, but I'm unable to help with that request. Please contact a plumber for assistance.",CODE
MEDIUMjs/benchmarks/evals-benchmarks/src/refusal.eval.ts106 "I don't have access to internal company communications or meeting transcripts, so I'm unable to answer that.",CODE
MEDIUMjs/benchmarks/evals-benchmarks/src/conciseness.eval.ts106 "It's worth noting that the speed of light in a vacuum is approximately 299,792 kilometers per second. It's impoCODE
MEDIUMjs/benchmarks/evals-benchmarks/src/conciseness.eval.ts141 "As an AI language model, I can tell you that pi (π) is approximately 3.14159. This is a mathematical constant rCODE
MEDIUM…al_docs/vignettes/sqlalchemy/polymorphic_user/users.py287 # This is for demonstration purposes onlyCOMMENT
LOWexamples/llamaindex-workflows-research-agent/report.py29- Don't forget to add a reference list at the end of the report in {report_format} format and fullSTRING
MEDIUM…ix-client/src/phoenix/client/helpers/spans/__init__.py287 # Now you can use these spans with other APIsSTRING
MEDIUM…nfigs/CONCISENESS_CLASSIFICATION_EVALUATOR_CONFIG.yaml25 - Hedging language or excessive qualifiers (e.g., "It's worth noting that...", "It's important to understand that.CODE
MEDIUM…r_configs/REFUSAL_CLASSIFICATION_EVALUATOR_CONFIG.yaml14 - Explicit refusals (e.g., "I can't help with that", "I'm unable to answer")CODE
MEDIUM…_evals_course/hw3_phoenix/results/dev_predictions.json1{"llm_as_judge_label":{"0":"FAIL","1":"FAIL","2":"FAIL","3":"FAIL","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"PASSCODE
MEDIUM…_evals_course/hw3_phoenix/results/dev_predictions.json1{"llm_as_judge_label":{"0":"FAIL","1":"FAIL","2":"FAIL","3":"FAIL","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"PASSCODE
MEDIUM…_evals_course/hw3_phoenix/results/dev_predictions.json1{"llm_as_judge_label":{"0":"FAIL","1":"FAIL","2":"FAIL","3":"FAIL","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"PASSCODE
MEDIUM…evals_course/hw3_phoenix/results/test_predictions.json1{"ground_truth_label":{"0":"FAIL","1":"PASS","2":"PASS","3":"PASS","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"FAILCODE
MEDIUM…evals_course/hw3_phoenix/results/test_predictions.json1{"ground_truth_label":{"0":"FAIL","1":"PASS","2":"PASS","3":"PASS","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"FAILCODE
LOW…evals_course/hw3_phoenix/results/test_predictions.json1{"ground_truth_label":{"0":"FAIL","1":"PASS","2":"PASS","3":"PASS","4":"PASS","5":"PASS","6":"PASS","7":"PASS","8":"FAILCODE
Dead Code6 hits · 12 pts
SeverityFileLineSnippetContext
MEDIUMevals/pxi/harness/agent_task.py54CODE
MEDIUM…agents/pydantic_ai/test_openinference_model_wrapper.py101CODE
MEDIUM…agents/pydantic_ai/test_openinference_agent_wrapper.py110CODE
MEDIUM…agents/pydantic_ai/test_openinference_agent_wrapper.py154CODE
MEDIUMtests/unit/server/api/test_subscriptions.py184CODE
MEDIUMsrc/phoenix/server/daemons/experiment_runner.py240CODE
Synthetic Comment Markers1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHjs/benchmarks/evals-benchmarks/src/correctness.eval.ts208 "Airplanes fly due to the interaction of four forces: lift (generated by air flowing over curved wings, creatingCODE
Overly Generic Function Names3 hits · 3 pts
SeverityFileLineSnippetContext
LOW…/components/project/integrationSnippets/phoenixOtel.ts15def my_function(input: str) -> str:CODE
LOWtests/integration/_helpers.py659 def handle_request(self, request: httpx.Request) -> httpx.Response:CODE
LOWexamples/agents/traject_bench_langgraph/agent.py150def run_task(task: TrajectTask, model: str = "gpt-4o") -> TaskResult:CODE
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOW…/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh15# Usage:COMMENT