AI Observability & Evaluation
This report summarizes scanner evidence for Arize-ai/phoenix, a Python project with 11,783 GitHub stars. SynthScan examined 1,293,528 lines of code across 6185 source files, recording 12639 pattern matches distributed across 27 syntactic categories. The legacy adjusted pattern signal is 11.8 (Moderate pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Can maintainers explain intent, assumptions, and trade-offs? 10156 finding(s).
Are imports declared and package/API names verified? 1112 finding(s).
Are wrappers, guards, and repeated structures necessary? 10121 finding(s).
Which changes need focused human review? 12639 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 12639 distinct pattern matches across 27 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | evals/harbor/agents/chat_client.py | 86 | async def accumulate_assistant_message( | CODE |
| LOW | evals/harbor/agents/atif.py | 32 | def trajectory_from_ui_messages( | CODE |
| LOW | evals/harbor/agents/phoenix_chat_agent.py | 67 | def populate_context_post_run(self, context: AgentContext) -> None: | CODE |
| LOW | evals/pxi/online_evals/run.py | 127 | def _existing_annotation_keys( | CODE |
| LOW | evals/pxi/online_evals/run.py | 368 | def _append_github_step_summary(path: Path, report: dict[str, Any]) -> None: | CODE |
| LOW | …als/pxi/online_evals/evaluators/tool_count_per_turn.py | 19 | async def evaluate_tool_count_per_turn(root: v1.Span, spans: Sequence[v1.Span]) -> Score: | CODE |
| LOW | …als/pxi/online_evals/evaluators/suggestion_accepted.py | 30 | async def evaluate_suggestion_accepted(target: v1.Span, _spans: Sequence[v1.Span]) -> Score | None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 431 | def test_partial_retry_artifact_is_unmeasurable() -> None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 441 | def test_unexpected_retry_node_is_unmeasurable() -> None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 451 | def test_threshold_still_applies_after_confirmation() -> None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 496 | def test_old_schema_is_rejected() -> None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 502 | def test_missing_policy_is_unmeasurable_not_regression() -> None: | CODE |
| LOW⚡ | evals/pxi/tests/test_gate.py | 509 | def test_task_error_then_retry_miss_does_not_red_a_cell_with_other_passes() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 122 | def test_artifact_aggregates_assessed_and_infra_rows_separately() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 149 | def test_provider_error_never_enters_behavioral_denominator() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 167 | def test_missing_evaluator_score_is_counted_as_infra() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 180 | def test_gating_cell_with_zero_assessable_rows_is_unmeasurable() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 191 | def test_first_miss_then_pass_is_flaky_recovery(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 205 | def test_same_assessable_evaluator_miss_twice_confirms_regression(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 220 | def test_different_evaluator_miss_on_retry_does_not_confirm_first_miss() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 241 | def test_incidental_retry_infra_is_still_reported() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 261 | def test_retry_infra_is_visible_but_not_regression_when_cell_remains_measurable() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 276 | def test_retry_infra_that_leaves_zero_assessable_rows_is_unmeasurable() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 286 | def test_task_error_on_first_attempt_is_retried(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 297 | def test_task_error_recovers_on_retry() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 309 | def test_recurring_task_error_is_unmeasurable_not_a_regression() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 324 | def test_task_error_then_single_retry_miss_cannot_be_confirmed() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 343 | def test_zero_assessable_cell_gets_a_retry_chance_before_unmeasurable(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 354 | def test_bystander_evaluator_task_error_on_retry_is_still_reported() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 390 | def test_retry_skipped_and_gate_fails_when_failures_exceed_cap(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 411 | def test_failures_within_cap_still_retry_normally(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 420 | def test_retry_scope_contains_only_initial_failed_nodeids(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 462 | def test_invalid_or_partial_initial_run_is_unmeasurable(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 473 | def test_vacuous_artifact_with_completed_examples_fails_closed() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 482 | def test_expected_recording_not_bootstrapped_still_fails_closed() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 533 | def test_mass_task_errors_over_cap_are_unmeasurable_not_a_pass(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 551 | def test_mass_behavioral_misses_over_cap_still_fail_not_unmeasurable(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 564 | def test_evaluator_error_on_initial_run_is_unmeasurable_not_a_pass() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 583 | def test_confirmed_miss_within_tolerated_threshold_is_surfaced_not_silent_pass() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 598 | def test_planning_and_reconciliation_modes_are_mutually_exclusive() -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 613 | def test_decision_out_writes_structured_summary(tmp_path: Path) -> None: | CODE |
| LOW | evals/pxi/tests/test_gate.py | 648 | def test_digest_includes_evaluator_details_and_both_phoenix_links() -> None: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 63 | def _execute_browser_action_scripts(calls: list[dict[str, Any]]) -> list[str]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 75 | def _invoked_ui_operation_names(scripts: list[str]) -> list[str]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 83 | def _extract_ui_operation_arguments(script: str, operation_name: str) -> list[str]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 150 | def _expected_ui_operation_args(expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 318 | def tool_call_count_within_limit(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 342 | def _bash_command_expectations(expected: Any) -> list[dict[str, Any]] | None: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 353 | def evaluate_bash_command_substrings(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 403 | def bash_command_substrings_match(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 561 | def _matcher_validation_failures(variants: list[dict[str, Any]]) -> dict[str, str]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 596 | def _invalid_arg_expectation_reason(expected_for_tool: Any) -> str | None: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 701 | def _ui_operation_variant_passes(source: str, variant: dict[str, Any], script: str = "") -> bool: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 813 | def evaluate_forbidden_tool_call_args(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/tools.py | 896 | def forbidden_tool_call_args_match(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| LOW | evals/pxi/evaluators/links.py | 28 | def _expects_route_info_before_in_app_links(expected: Any) -> bool: | CODE |
| LOW | evals/pxi/evaluators/links.py | 75 | def _absolute_app_link_reason(href: str, required_paths: list[str]) -> str | None: | CODE |
| LOW | evals/pxi/evaluators/links.py | 97 | def _is_root_relative_app_href(href: str) -> bool: | CODE |
| LOW | evals/pxi/evaluators/links.py | 101 | def _in_app_hrefs_before_tool(output: Any, tool_name: str) -> list[str]: | CODE |
| LOW | evals/pxi/evaluators/text.py | 125 | def evaluate_assistant_text_substrings(output: Any, expected: Any) -> dict[str, Any]: | CODE |
| 8637 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | evals/pxi/harness/reporting.py | 232 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | evals/pxi/harness/reporting.py | 239 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 14 | // ── The frame: planes, blocking state, portal re-homing ────────────────── | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 26 | // ── Tier 1: viewport modal (blocks the workspace, not the rail) ────────── | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 42 | // ── Non-modal surfaces: popovers (and, via Popover, menus) ──────────────── | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 49 | // ── Non-modal surfaces: the drawer ──────────────────────────────────────── | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 67 | // ── Stacking: bands and the CSS token contract ──────────────────────────── | COMMENT |
| MEDIUM | js/app/src/components/core/overlay/index.ts | 78 | // ── Shared vocabulary ───────────────────────────────────────────────────── | COMMENT |
| MEDIUM⚡ | js/packages/phoenix-cli/src/commands/formatTable.ts | 23 | * // ┌────────────┬──────────┬──────────┐ | COMMENT |
| MEDIUM⚡ | js/packages/phoenix-cli/src/commands/formatTable.ts | 25 | * // ├────────────┼──────────┼──────────┤ | COMMENT |
| MEDIUM⚡ | js/packages/phoenix-cli/src/commands/formatTable.ts | 28 | * // └────────────┴──────────┴──────────┘ | COMMENT |
| MEDIUM⚡ | …ternal_docs/specs/ldap-authentication/configuration.md | 194 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | …ternal_docs/specs/ldap-authentication/configuration.md | 196 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | …ternal_docs/specs/ldap-authentication/configuration.md | 206 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | …ternal_docs/specs/ldap-authentication/configuration.md | 208 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 123 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 125 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 149 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 151 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 162 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 164 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 178 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 180 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 238 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 240 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 281 | # ============================================================================== | COMMENT |
| MEDIUM | …ternal_docs/specs/ldap-authentication/configuration.md | 283 | # ============================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 46 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 48 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 168 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 170 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 218 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 220 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 318 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 320 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 358 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 360 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 764 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 766 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 799 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 801 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 971 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 973 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 1051 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/trace/gen_ai/test_conversion.py | 1053 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/unit/trace/gen_ai/test_conversion.py | 119 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/unit/trace/gen_ai/test_conversion.py | 121 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/unit/server/test_app_evaluations.py | 249 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM | tests/unit/server/test_app_evaluations.py | 251 | # --------------------------------------------------------------------------- | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 222 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 224 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 258 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 260 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1005 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1007 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1040 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1042 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1083 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1085 | # =========================================================================== | COMMENT |
| MEDIUM⚡ | tests/unit/server/daemons/test_experiment_runner.py | 1223 | # =========================================================================== | COMMENT |
| 404 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/unit/_helpers.py | 210 | Verify that the experiments_dataset_examples junction table contains the expected entries. This function uses | STRING |
| HIGH | tests/integration/_helpers.py | 2021 | If no_wait, run the query once. Otherwise, retry it if it returns None and raise if retries are exhausted. Args | STRING |
| HIGH | tests/integration/db_migrations/__init__.py | 93 | Get schema information for a database table. Retrieves comprehensive schema information for a table, including its | STRING |
| HIGH | …igration_6a88424799fe_update_users_with_auth_method.py | 283 | Create a new local authentication user. Creates a user with: - Local authentication method ('LOCAL') - Pass | STRING |
| HIGH | …igration_6a88424799fe_update_users_with_auth_method.py | 333 | Create a new OAuth2 user. Creates a user with: - External authentication method ('OAUTH2') - OAuth2 credent | STRING |
| HIGH | …generate_data_via_plpgsql/generate_span_annotations.py | 178 | Run a SQL script file using psql. Args: db_name (str): Database name db_user (str): Database user | STRING |
| HIGH | …ripts/llm_token_pricing_tables/litellm_model_prices.py | 41 | Process the model prices JSON file from a URL into a pandas DataFrame. Args: url: URL to fetch the JSON dat | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/utils.py | 180 | Remap eval_input keys based on required_fields and an optional input_mapping. Args: eval_input: The in | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/utils.py | 275 | Extract a value from a nested JSON structure using jsonpath-ng. Args: data: The input dictionary to be | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/utils.py | 415 | Format scores as annotations for logging to Phoenix. This function takes the output of evaluate_dataframe, and a li | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 129 | Remap and validate evaluation input. Args: eval_input: The raw evaluation input dictionary. require | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 602 | LLM-based evaluator for classification-style judgements. Supports label-only or label+score mappings, and retu | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 834 | Decorator that turns a simple function into an Evaluator instance. The decorated function should accept keywor | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 1142 | Factory to create a `ClassificationEvaluator`. Note: The evaluator requires the LLM to have tool calling or st | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 1226 | Helper to bind an evaluator with a fixed input mapping. This function allows you to create a version of an eva | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 1417 | Evaluate a dataframe with a list of evaluators and return an augmented dataframe. This function uses a synchro | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 1568 | Evaluate a dataframe with a list of evaluators and return an augmented dataframe. This function uses an asynch | STRING |
| HIGH | …ges/phoenix-evals/src/phoenix/evals/metrics/refusal.py | 14 | An evaluator for detecting when an LLM refuses or declines to answer a query. Args: llm (LLM): The LLM | STRING |
| HIGH | …oenix-evals/src/phoenix/evals/metrics/pii_detection.py | 14 | An evaluator for detecting personally identifiable information (PII) in a conversation record. Args: | STRING |
| HIGH | …es/phoenix-evals/src/phoenix/evals/metrics/toxicity.py | 14 | An evaluator for detecting toxic text — hateful, demeaning, abusive, or threatening. Args: llm (LLM): | STRING |
| HIGH | …hoenix-evals/src/phoenix/evals/metrics/faithfulness.py | 14 | A specialized evaluator for detecting faithfulness in grounded LLM responses. Args: llm (LLM): The LLM | STRING |
| HIGH | …phoenix-evals/src/phoenix/evals/metrics/exact_match.py | 6 | Return exact_match score: 1.0 if output == expected else 0.0. Note: No text normalization is performed. Args: | STRING |
| HIGH | …ix-evals/src/phoenix/evals/metrics/precision_recall.py | 68 | Code evaluator that computes precision, recall, and F-beta score given lists of expected and output labels. | STRING |
| HIGH | …phoenix-evals/src/phoenix/evals/metrics/correctness.py | 14 | An evaluator for assessing factual accuracy and completeness of model outputs. Args: llm (LLM): The LL | STRING |
| HIGH | …enix-evals/src/phoenix/evals/metrics/tool_selection.py | 14 | A specialized evaluator for determining if the correct tool was selected for a given context. Args: ll | STRING |
| HIGH | …nix-evals/src/phoenix/evals/metrics/tool_invocation.py | 14 | Determines if a tool was invoked correctly with proper arguments, formatting, and safe content. Args: | STRING |
| HIGH | …hoenix-evals/src/phoenix/evals/metrics/completeness.py | 14 | An evaluator for whether every active user request in a conversation was actually completed. Args: | STRING |
| HIGH | …evals/src/phoenix/evals/metrics/retrieval_relevance.py | 14 | An evaluator for whether the external information retrieved during a step is relevant to the request it was ser | STRING |
| HIGH | …oenix-evals/src/phoenix/evals/metrics/user_friction.py | 14 | An evaluator for detecting when a user expresses friction with an assistant's preceding behavior. Args: | STRING |
| HIGH | …oenix-evals/src/phoenix/evals/metrics/hallucination.py | 14 | An evaluator for detecting hallucinations in an assistant's latest response, judged against the conversation it | STRING |
| HIGH | …phoenix-evals/src/phoenix/evals/metrics/conciseness.py | 14 | An evaluator for assessing whether model outputs are concise and free of unnecessary content. Args: ll | STRING |
| HIGH | …ls/src/phoenix/evals/metrics/tool_response_handling.py | 14 | Determines if an AI agent properly handled a tool's response, including error handling, data extraction, transf | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/wrapper.py | 318 | Generate a classification given a prompt and a set of labels. Args: prompt (Union[str, List[Dict[st | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/wrapper.py | 456 | Generate a JSON Schema for an LLM function/structured output call that classifies a single criterion. Args: | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/prompts.py | 616 | Factory function to create appropriate ContentPartTemplate from a dict. Args: content_part: Dictionary with | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/prompts.py | 831 | Render the template with the given variables. Args: variables (Dict[str, Any]): The variables to su | STRING |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/prompts.py | 1005 | Render the template with the given variables. Args: variables: The variables to substitute into the | STRING |
| HIGH | packages/phoenix-client/scripts/codegen/transform.py | 405 | Sort class definitions so that each parent class appears before its children. Args: class_nodes: Mappi | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 33 | Run an experiment using a given dataset of examples. An experiment is a user-defined task that runs on each ex | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 224 | Run an experiment using a given dataset of examples. An experiment is a user-defined task that runs on each ex | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 408 | Get a completed experiment by ID. This function retrieves a completed experiment with all its task runs and ev | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 475 | Resume an incomplete experiment by running only the missing or failed runs. This method identifies which (exam | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 547 | Get a completed experiment by ID. This function retrieves a completed experiment with all its task runs and | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 614 | Resume an incomplete experiment by running only the missing or failed runs. This method identifies which (exam | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 695 | Run evaluators on a completed experiment. An evaluator is either a synchronous or asynchronous function that r | STRING |
| HIGH | …enix-client/src/phoenix/client/experiments/__init__.py | 888 | Run evaluators on a completed experiment. An `evaluator` is either a synchronous or asynchronous function that | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 172 | Add a single trace annotation. Args: trace_id (str): The ID of the trace to annotate. a | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 262 | Log multiple trace annotations. Args: trace_annotations (Iterable[TraceAnnotationData]): An iterabl | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 330 | Log multiple trace annotations from a pandas DataFrame. This method allows you to create multiple trace annotat | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 423 | Retrieves traces for a project. Args: project_identifier (str): The project identifier (name or ID) | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 596 | Add a single trace annotation asynchronously. Args: trace_id (str): The ID of the trace to annotate | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 686 | Log multiple trace annotations asynchronously. Args: trace_annotations (Iterable[TraceAnnotationDat | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 754 | Log multiple trace annotations from a pandas DataFrame asynchronously. This method allows you to create multipl | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 847 | Retrieves traces for a project asynchronously. Args: project_identifier (str): The project identifi | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 189 | Retrieves spans based on the provided filter conditions. Args: query (Optional[SpanQuery]): A SpanQ | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 281 | Fetches span annotations and returns them as a pandas DataFrame. Exactly one of *spans_dataframe*, *span_ids*, | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 406 | Fetches span annotations and returns them as a list of SpanAnnotation objects. Exactly one of *span_ids* or *sp | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 513 | Retrieves spans with simple filtering options. Args: project_identifier (str): The project identifi | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 635 | Logs spans to a project. If any spans are invalid or duplicates, no spans will be logged and a SpanCrea | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 677 | Logs spans to a project from a pandas DataFrame. If any spans are invalid or duplicates, no spans will be logge | STRING |
| 146 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | evals/harbor/verifiers/harbor_verifiers/llm_judge.py | 7 | CODE | |
| LOW | evals/harbor/verifiers/harbor_verifiers/verify.py | 20 | CODE | |
| LOW | evals/harbor/agents/coding_agents.py | 1 | CODE | |
| LOW | evals/harbor/agents/atif.py | 3 | CODE | |
| LOW | evals/harbor/scripts/check_job_staged.py | 18 | CODE | |
| LOW | evals/harbor/scripts/subset_job.py | 16 | CODE | |
| LOW | evals/pxi/conftest.py | 12 | CODE | |
| LOW | evals/pxi/gate.py | 15 | CODE | |
| LOW | evals/pxi/rowstate.py | 11 | CODE | |
| LOW | evals/pxi/online_evals/rendering.py | 16 | CODE | |
| LOW | evals/pxi/online_evals/rendering.py | 20 | CODE | |
| LOW | evals/pxi/online_evals/conversation.py | 21 | CODE | |
| LOW | evals/pxi/online_evals/judge.py | 9 | CODE | |
| LOW | evals/pxi/online_evals/topology.py | 3 | CODE | |
| LOW | evals/pxi/online_evals/message_origin.py | 10 | CODE | |
| LOW | …als/pxi/online_evals/evaluators/tool_count_per_turn.py | 1 | CODE | |
| LOW | …als/pxi/online_evals/evaluators/suggestion_accepted.py | 3 | CODE | |
| LOW | evals/pxi/online_evals/evaluators/user_friction.py | 13 | CODE | |
| LOW | evals/pxi/tests/test_pxi_evals.py | 12 | CODE | |
| LOW | evals/pxi/tests/test_gate.py | 3 | CODE | |
| LOW | evals/pxi/evaluators/tools.py | 1 | CODE | |
| LOW | evals/pxi/evaluators/links.py | 1 | CODE | |
| LOW | evals/pxi/evaluators/text.py | 1 | CODE | |
| LOW | evals/pxi/evaluators/filters.py | 3 | CODE | |
| LOW | evals/pxi/harness/backend.py | 3 | CODE | |
| LOW | evals/pxi/harness/datastream_protocol_messages.py | 3 | CODE | |
| LOW | evals/pxi/harness/datasets.py | 1 | CODE | |
| LOW | evals/pxi/harness/run_experiment.py | 1 | CODE | |
| LOW | evals/pxi/harness/agent_task.py | 1 | CODE | |
| LOW | evals/pxi/harness/reporting.py | 8 | CODE | |
| LOW | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 41 | CODE | |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 54 | CODE | |
| LOW | tests/unit/_warm_rewrite_cache.py | 22 | CODE | |
| LOW | tests/unit/harbor/test_atif.py | 1 | CODE | |
| LOW | tests/unit/pxi/evals/test_run_experiment.py | 8 | CODE | |
| LOW | tests/unit/pxi/evals/conftest.py | 3 | CODE | |
| LOW | tests/unit/pxi/evals/test_evaluators.py | 8 | CODE | |
| LOW | tests/unit/pxi/evals/test_datasets.py | 8 | CODE | |
| LOW | tests/unit/pxi/evals/test_evaluator_matchers.py | 8 | CODE | |
| LOW | tests/unit/pxi/evals/test_reporting.py | 10 | CODE | |
| LOW | tests/unit/pxi/evals/test_agent_backend.py | 3 | CODE | |
| LOW | tests/unit/pxi/evals/test_agent_task_inputs.py | 3 | CODE | |
| LOW | …nit/pxi/evals/online_evals/test_tool_count_per_turn.py | 1 | CODE | |
| LOW | …unit/pxi/evals/online_evals/test_real_trace_fixture.py | 16 | CODE | |
| LOW | tests/unit/pxi/evals/online_evals/test_user_friction.py | 1 | CODE | |
| LOW | …nit/pxi/evals/online_evals/test_suggestion_accepted.py | 1 | CODE | |
| LOW | tests/unit/server/test_oauth2_rate_limiter_wiring.py | 14 | CODE | |
| LOW | tests/unit/server/test_static_well_known.py | 9 | CODE | |
| LOW | tests/unit/server/test_oauth2_grant_claims.py | 6 | CODE | |
| LOW | tests/unit/server/test_well_known_path_inserted.py | 10 | CODE | |
| LOW | tests/unit/server/test_anonymous_cors.py | 9 | CODE | |
| LOW | tests/unit/server/test_mcp_code_mode.py | 7 | CODE | |
| LOW | tests/unit/server/test_app_docs_mcp_lifespan.py | 11 | CODE | |
| LOW | …s/unit/server/test_oauth2_authorization_server_flag.py | 11 | CODE | |
| LOW | …/test_graphql_write_mutations_require_is_not_viewer.py | 1 | CODE | |
| LOW | tests/unit/server/test_bearer_auth.py | 11 | CODE | |
| LOW | …s/unit/server/middleware/test_js_sandbox_worker_csp.py | 12 | CODE | |
| LOW | tests/unit/server/daemons/test_system_settings.py | 3 | CODE | |
| LOW | tests/unit/server/daemons/test_experiment_runner.py | 1 | CODE | |
| LOW | tests/unit/server/agents/test_agent_factory.py | 1 | CODE | |
| 633 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …gression/error-analysis/tests/error_analysis_checks.py | 84 | except Exception: | CODE |
| LOW | …egression/prompt-hill-climb/tests/hill_climb_checks.py | 242 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | evals/pxi/online_evals/run.py | 246 | except Exception: | CODE |
| LOW | evals/pxi/online_evals/run.py | 308 | except Exception: | CODE |
| LOW | evals/pxi/tests/test_pxi_evals.py | 166 | except Exception as exc: | CODE |
| LOW | evals/pxi/harness/run_experiment.py | 330 | except Exception as cleanup_exc: # pragma: no cover - best-effort cleanup | CODE |
| LOW | evals/pxi/harness/agent_task.py | 94 | except Exception as exc: # noqa: BLE001 | CODE |
| LOW | evals/pxi/harness/agent_task.py | 109 | except Exception: # noqa: BLE001 | CODE |
| LOW | evals/pxi/harness/agent_task.py | 439 | except Exception as exc: | CODE |
| LOW | …al_docs/vignettes/postgresql/advisory-lock-analysis.md | 273 | except Exception: | CODE |
| LOW | …al_docs/vignettes/postgresql/advisory-lock-analysis.md | 462 | except Exception: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 642 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 648 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 654 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 660 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 676 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 682 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 688 | except Exception as e: | CODE |
| LOW⚡ | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 694 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 354 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 394 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 431 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 468 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 499 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 532 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 565 | except Exception as e: | CODE |
| LOW | …ernal_docs/vignettes/postgresql_tls/test_connection.py | 598 | except Exception as e: | CODE |
| MEDIUM | …nal_docs/vignettes/postgresql_tls/generate_pg_certs.py | 60 | print(f"Error writing to file {filename}: {e}") | CODE |
| MEDIUM | …nal_docs/vignettes/postgresql_tls/generate_pg_certs.py | 173 | print("Error: Failed to generate certificates") | STRING |
| LOW | internal_docs/specs/ldap-authentication/security.md | 96 | except Exception: | CODE |
| LOW | …nt-runner-background-process/appendix-rate-limiting.md | 323 | except Exception as e: | CODE |
| LOW | …nt-runner-background-process/appendix-rate-limiting.md | 371 | except Exception as e: | CODE |
| LOW | tests/unit/conftest.py | 885 | except Exception: | CODE |
| LOW | tests/unit/conftest.py | 889 | except Exception: | CODE |
| LOW⚡ | tests/unit/server/mcp/sql/test_parse.py | 923 | except Exception: | CODE |
| LOW | tests/unit/server/mcp/sql/test_sqlite_authorizer.py | 181 | except Exception: | CODE |
| LOW | tests/unit/server/mcp/sql/test_node_coverage.py | 153 | except Exception: | CODE |
| LOW | tests/integration/conftest.py | 217 | except Exception: | CODE |
| LOW | tests/integration/_mock_ldap_server.py | 319 | except Exception as e: | CODE |
| LOW | tests/integration/_mock_llm_server.py | 451 | except Exception as e: | CODE |
| LOW | tests/integration/_mock_llm_server.py | 636 | except Exception as e: | CODE |
| LOW⚡ | tests/integration/_helpers.py | 1568 | except Exception: | CODE |
| LOW | tests/integration/harbor/run_plugin_e2e.py | 823 | except Exception as error: | CODE |
| LOW | tests/integration/client/test_experiments.py | 339 | except Exception: | CODE |
| LOW | tests/integration/client/test_experiments.py | 389 | except Exception: | CODE |
| LOW | …ation_e76cbd66ffc3_add_experiments_dataset_examples.py | 264 | except Exception: | CODE |
| LOW | …ation_e76cbd66ffc3_add_experiments_dataset_examples.py | 370 | except Exception: | CODE |
| MEDIUM | .agents/skills/daytona/references/python-sdk/pty.md | 287 | print(f"Error: {pty_handle.error}") | CODE |
| MEDIUM | .agents/skills/daytona/references/python-sdk/pty.md | 312 | print(f"Error: {result.error}") | CODE |
| MEDIUM | …aytona/references/python-sdk/process-code-execution.md | 273 | print(f"Error output: {response.result}") | STRING |
| MEDIUM | …aytona/references/python-sdk/file-system-operations.md | 149 | print(f"Error downloading {result.source}: {result.error}") | CODE |
| MEDIUM⚡ | …kills/daytona/references/python-sdk/vpn-connections.md | 71 | print(f"Error installing Tailscale: {response.result}") | CODE |
| MEDIUM⚡ | …kills/daytona/references/python-sdk/vpn-connections.md | 200 | print(f"Error installing Tailscale: {response.result}") | CODE |
| MEDIUM⚡ | …kills/daytona/references/python-sdk/vpn-connections.md | 219 | print(f"Error connecting: {response.result}") | CODE |
| MEDIUM⚡ | …kills/daytona/references/python-sdk/vpn-connections.md | 391 | print(f"Error installing OpenVPN: {response.result}") | STRING |
| MEDIUM | …kills/daytona/references/python-sdk/vpn-connections.md | 522 | print("Error: please set NETBIRD_SETUP_KEY to a valid setup key.") | STRING |
| MEDIUM | …kills/daytona/references/python-sdk/vpn-connections.md | 536 | print(f"Error installing NetBird: {response.result}") | STRING |
| MEDIUM | …kills/daytona/references/python-sdk/vpn-connections.md | 545 | print(f"Error running 'netbird up': {response.result}") | STRING |
| MEDIUM | …kills/daytona/references/python-sdk/vpn-connections.md | 597 | print(f"Error installing NetBird: {response.result}") | STRING |
| MEDIUM | …lls/daytona/references/python-sdk/async/file-system.md | 267 | print(f"Error downloading {result.source}: {result.error}") | CODE |
| 464 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …ts/project/integrationSnippets/environmentVariables.ts | 17 | const apiKeyValue = apiKey || "<your-api-key>"; | CODE |
| HIGH | …/src/components/experiment/RunExperimentCodeDialog.tsx | 30 | `os.environ["PHOENIX_API_KEY"] = "<your-api-key>"`; | CODE |
| HIGH | js/app/src/pages/settings/SettingsMCPPage.tsx | 108 | headers: { Authorization: "Bearer <your-api-key>" }, | CODE |
| HIGH | js/app/src/pages/settings/SettingsMCPPage.tsx | 133 | ? { headers: { Authorization: "Bearer <your-api-key>" } } | CODE |
| HIGH | js/examples/apps/mastra-agent/README.md | 49 | `PHOENIX_API_KEY=your-api-key` and point both variables at that instance: | CODE |
| HIGH | js/packages/phoenix-mcp/README.md | 57 | "your-api-key" | CODE |
| HIGH | js/packages/phoenix-cli/README.md | 43 | export PHOENIX_API_KEY=your-api-key # if authentication is enabled | CODE |
| HIGH | js/packages/phoenix-config/README.md | 61 | PHOENIX_API_KEY=your-api-key | CODE |
| HIGH | js/packages/phoenix-config/src/env.ts | 121 | * process.env[ENV_PHOENIX_API_KEY] = "your-api-key"; | COMMENT |
| HIGH | js/packages/phoenix-otel/README.md | 95 | export PHOENIX_API_KEY="your-api-key" | CODE |
| HIGH | js/packages/phoenix-otel/examples/register_example.ts | 6 | apiKey: "your-api-key", | CODE |
| HIGH | js/packages/phoenix-otel/src/register.ts | 53 | * apiKey: "your-api-key", | COMMENT |
| HIGH | js/packages/phoenix-otel/src/register.ts | 445 | * headers: { 'Authorization': 'Bearer your-api-key' } | COMMENT |
| HIGH | js/packages/phoenix-otel/src/register.ts | 556 | * apiKey: 'your-api-key', | COMMENT |
| HIGH | .agents/skills/phoenix-cli/SKILL.md | 83 | export PHOENIX_API_KEY=your-api-key # if auth is enabled | CODE |
| HIGH | .agents/skills/phoenix-harbor/SKILL.md | 47 | export PHOENIX_API_KEY=your-api-key | CODE |
| HIGH | …/skills/phoenix-tracing/references/setup-typescript.md | 41 | export PHOENIX_API_KEY="your-api-key" | CODE |
| HIGH | …/skills/phoenix-tracing/references/setup-typescript.md | 60 | PHOENIX_API_KEY=your-api-key | CODE |
| HIGH | …ents/skills/phoenix-tracing/references/setup-python.md | 34 | export PHOENIX_API_KEY="your-api-key" # Required for Phoenix Cloud | CODE |
| HIGH | …ents/skills/phoenix-tracing/references/setup-python.md | 53 | PHOENIX_API_KEY=your-api-key | CODE |
| HIGH | .agents/skills/daytona/references/ruby-sdk/README.md | 67 | api_key: 'your-api-key', | CODE |
| HIGH | .agents/skills/daytona/references/ruby-sdk/regions.md | 35 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | .agents/skills/daytona/references/python-sdk/README.md | 89 | api_key="YOUR_API_KEY", | CODE |
| HIGH | .agents/skills/daytona/references/python-sdk/README.md | 113 | api_key="YOUR_API_KEY", | CODE |
| HIGH | .agents/skills/daytona/references/python-sdk/regions.md | 35 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH⚡ | …kills/daytona/references/python-sdk/vpn-connections.md | 48 | DAYTONA_API_KEY = "YOUR_API_KEY" # Replace with your API key | CODE |
| HIGH | …kills/daytona/references/python-sdk/vpn-connections.md | 175 | DAYTONA_API_KEY = "YOUR_API_KEY" # Replace with your API key | CODE |
| HIGH | …kills/daytona/references/python-sdk/vpn-connections.md | 364 | DAYTONA_API_KEY = "YOUR_API_KEY" # Replace with your API key | CODE |
| HIGH | …kills/daytona/references/python-sdk/vpn-connections.md | 507 | DAYTONA_API_KEY = "YOUR_API_KEY" | STRING |
| HIGH | …kills/daytona/references/python-sdk/vpn-connections.md | 573 | DAYTONA_API_KEY = "YOUR_API_KEY" | STRING |
| HIGH | …/skills/daytona/references/python-sdk/async/daytona.md | 44 | api_key="your-api-key", | CODE |
| HIGH | …/skills/daytona/references/python-sdk/async/daytona.md | 58 | api_key="your-api-key", | CODE |
| HIGH | …/skills/daytona/references/python-sdk/async/daytona.md | 99 | api_key="your-api-key", | CODE |
| HIGH | …/skills/daytona/references/python-sdk/async/daytona.md | 472 | config = DaytonaConfig(api_key="your-api-key") | CODE |
| HIGH | …s/skills/daytona/references/python-sdk/sync/daytona.md | 44 | api_key="your-api-key", | CODE |
| HIGH | …s/skills/daytona/references/python-sdk/sync/daytona.md | 55 | api_key="your-api-key", | CODE |
| HIGH | …s/skills/daytona/references/python-sdk/sync/daytona.md | 96 | api_key="your-api-key", | CODE |
| HIGH | …s/skills/daytona/references/python-sdk/sync/daytona.md | 418 | config = DaytonaConfig(api_key="your-api-key") | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 57 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 72 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 83 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 102 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 121 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 163 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 179 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 192 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 209 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 224 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 242 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 263 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 281 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 299 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 310 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 327 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 347 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 358 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 377 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 400 | --header 'Authorization: Bearer YOUR_API_KEY' | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 419 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| HIGH | …ts/skills/daytona/references/platform/organizations.md | 435 | --header 'Authorization: Bearer YOUR_API_KEY' \ | CODE |
| 53 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …gression/error-analysis/tests/error_analysis_checks.py | 84 | except Exception: | CODE |
| HIGH | evals/pxi/harness/agent_task.py | 109 | except Exception: # noqa: BLE001 | CODE |
| HIGH | …s/otel-contextvars-async/contextvars_async_gen_demo.py | 265 | except RuntimeError: | CODE |
| HIGH | …s/otel-contextvars-async/contextvars_async_gen_demo.py | 279 | except RuntimeError: | CODE |
| HIGH | …s/otel-contextvars-async/contextvars_async_gen_demo.py | 289 | except RuntimeError: | CODE |
| HIGH | …s/otel-contextvars-async/contextvars_async_gen_demo.py | 297 | except RuntimeError: | CODE |
| HIGH | …s/otel-contextvars-async/contextvars_async_gen_demo.py | 316 | except RuntimeError: | CODE |
| HIGH | tests/unit/conftest.py | 885 | except Exception: | CODE |
| HIGH | tests/unit/conftest.py | 889 | except Exception: | CODE |
| HIGH | tests/integration/conftest.py | 217 | except Exception: | CODE |
| HIGH | tests/integration/_mock_ldap_server.py | 485 | except (IndexError, TypeError): | CODE |
| HIGH | tests/integration/_helpers.py | 1568 | except Exception: | CODE |
| HIGH | tests/integration/harbor/run_plugin_e2e.py | 123 | except (urllib.error.URLError, TimeoutError): | CODE |
| HIGH | tests/integration/client/test_experiments.py | 389 | except Exception: | CODE |
| HIGH | tests/integration/client/test_experiments.py | 339 | except Exception: | CODE |
| HIGH | …ation_e76cbd66ffc3_add_experiments_dataset_examples.py | 264 | except Exception: | CODE |
| HIGH | …ation_e76cbd66ffc3_add_experiments_dataset_examples.py | 370 | except Exception: | CODE |
| HIGH | examples/computer_use_agent/tools/run.py | 38 | except ProcessLookupError: | CODE |
| HIGH | scripts/load_patronus_trail.py | 365 | except Exception: # noqa: BLE001 — 404 if absent; fall through to create | CODE |
| HIGH | scripts/generate_sitemap.py | 92 | except ET.ParseError: | CODE |
| HIGH | scripts/docker/devops/scripts/test_ldap_integration.py | 77 | except requests.RequestException: | CODE |
| HIGH | scripts/docker/devops/scripts/test_ldap_tls.py | 473 | except Exception: | CODE |
| HIGH | scripts/docker/devops/scripts/ldap_mitm_proxy.py | 438 | except (ConnectionResetError, BrokenPipeError, OSError): | CODE |
| HIGH | scripts/docker/devops/scripts/ldap_mitm_proxy.py | 483 | except OSError: | CODE |
| HIGH | scripts/docker/devops/scripts/ldap_mitm_proxy.py | 489 | except OSError: | CODE |
| HIGH | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 43 | except ValueError: | CODE |
| HIGH | scripts/perf/postgres/postgres_explain_analyze.py | 737 | except KeyboardInterrupt: | CODE |
| HIGH | …hoenix/evals/llm/adapters/google/test_build_content.py | 21 | except AttributeError: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 142 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 239 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 175 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 193 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 272 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 290 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 204 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/tracing.py | 301 | except Exception: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/executors.py | 320 | except asyncio.CancelledError: | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/executors.py | 332 | except (asyncio.TimeoutError, asyncio.CancelledError): | CODE |
| HIGH | packages/phoenix-evals/src/phoenix/evals/llm/prompts.py | 445 | except ValueError: | CODE |
| HIGH | …evals/src/phoenix/evals/llm/adapters/google/adapter.py | 548 | except ImportError: | CODE |
| HIGH | …evals/src/phoenix/evals/llm/adapters/google/adapter.py | 82 | except Exception: | CODE |
| HIGH | …evals/src/phoenix/evals/llm/adapters/google/adapter.py | 89 | except Exception: | CODE |
| HIGH | …evals/src/phoenix/evals/llm/adapters/google/adapter.py | 96 | except Exception: | CODE |
| HIGH | packages/phoenix-sqlean/tests/regression.py | 97 | except sqlite.DatabaseError: | CODE |
| HIGH | packages/phoenix-sqlean/tests/transactions.py | 34 | except OSError: | CODE |
| HIGH | packages/phoenix-sqlean/tests/transactions.py | 52 | except OSError: | CODE |
| HIGH | packages/phoenix-sqlean/tests/transactions.py | 219 | except OSError: | CODE |
| HIGH | packages/phoenix-sqlean/tests/ttypes.py | 347 | except: | CODE |
| HIGH | packages/phoenix-sqlean/tests/driver_regressions.py | 33 | except sqlite.ProgrammingError: | CODE |
| HIGH | packages/phoenix-client/src/phoenix/client/client.py | 275 | except BaseException: | CODE |
| HIGH | …s/phoenix-client/src/phoenix/client/harbor/_adapter.py | 183 | except (KeyError, TypeError): | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 2062 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 2072 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 3921 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 3931 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 1398 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 1588 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 3248 | except Exception: | CODE |
| HIGH | …t/src/phoenix/client/resources/experiments/__init__.py | 3442 | except Exception: | CODE |
| HIGH | …client/src/phoenix/client/utils/server_requirements.py | 110 | except (ValueError, IndexError): | CODE |
| 41 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …/src/components/experiment/RunExperimentCodeDialog.tsx | 43 | `# Define an evaluator. This just an example.\n` + | CODE |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 24 | # Create a local user | STRING |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 29 | # Create an external user | STRING |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 286 | # Create an in-memory SQLite database | COMMENT |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 295 | # Create a session | COMMENT |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 299 | # Create a local user with password | COMMENT |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 307 | # Create an external user | COMMENT |
| MEDIUM | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 323 | # Create a session | COMMENT |
| MEDIUM | tests/unit/test_tracers.py | 723 | # Create a hierarchy: | COMMENT |
| MEDIUM | tests/unit/test_config.py | 2158 | # Create a dummy CA cert file | COMMENT |
| MEDIUM⚡ | tests/unit/server/api/test_cancellation.py | 88 | # Create a tracker that shares the operation_order list | COMMENT |
| MEDIUM⚡ | tests/unit/server/api/test_cancellation.py | 92 | # Create a real async generator | COMMENT |
| MEDIUM⚡ | tests/unit/server/api/test_cancellation.py | 102 | # Create a task that takes time to process cancellation | COMMENT |
| MEDIUM | tests/unit/server/api/test_cancellation.py | 145 | # Create an already-completed task | COMMENT |
| MEDIUM | tests/unit/server/api/test_cancellation.py | 353 | # Create a task for the in-progress generator | COMMENT |
| MEDIUM | tests/unit/server/api/test_queries.py | 2670 | # Create a builtin evaluator without a dataset association | COMMENT |
| MEDIUM | tests/unit/server/api/test_queries.py | 614 | # Create a prompt version for each prompt | STRING |
| MEDIUM | tests/unit/server/api/routers/v1/test_traces.py | 374 | # Create a trace with multiple spans (parent and child) | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_traces.py | 517 | # Create a relay GlobalID for a non-existent trace | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 74 | # Create a dictionary of projects by ID for easy lookup | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 581 | # Create a valid cursor format (base64-encoded project ID) | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 605 | # Create a small number of test projects | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 761 | # Create a regular experiment project - this should be filtered by default | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 781 | # Create an experiment for the regular experiment project | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 793 | # Create the playground project - this should always be visible | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_projects.py | 801 | # Create an experiment using the playground project - this shouldn't affect visibility | COMMENT |
| MEDIUM | …unit/server/api/routers/v1/test_list_project_traces.py | 80 | # Create a lightweight Trace object for assertions | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_experiments.py | 748 | # Create a fresh experiment and verify the create response has correct counts | COMMENT |
| MEDIUM | tests/unit/server/api/routers/v1/test_spans.py | 280 | # Create the hierarchy: parent -> children -> grandchild + sibling | COMMENT |
| MEDIUM | …/unit/server/api/routers/v1/test_annotation_configs.py | 91 | # Create a categorical annotation config | COMMENT |
| MEDIUM | …t/server/api/types/test_ProjectTraceRetentionPolicy.py | 47 | # Create a project with default trace retention policy | COMMENT |
| MEDIUM | …t/server/api/types/test_ProjectTraceRetentionPolicy.py | 50 | # Create a custom trace retention policy | COMMENT |
| MEDIUM | tests/unit/server/api/types/test_Trace.py | 346 | # Create a trace with 5 spans | COMMENT |
| MEDIUM | tests/unit/server/api/types/test_Dataset.py | 1471 | # Create a prompt for the evaluators | STRING |
| MEDIUM | tests/unit/server/api/types/test_Dataset.py | 1476 | # Create a prompt version | STRING |
| MEDIUM | tests/unit/server/api/types/test_Project.py | 2283 | # Create a test project | COMMENT |
| MEDIUM | tests/unit/server/api/types/test_Project.py | 3082 | # Create a test project | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 1454 | # Create a different prompt with a version | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 1861 | # Create a second version for the same prompt | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 1867 | # Create a second version | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 2866 | # Create a builtin dataset evaluator | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 2997 | # Create an LLM evaluator with dataset relationship | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 3104 | # Create a builtin dataset evaluator | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 3122 | # Create an LLM evaluator | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 3284 | # Create an LLM evaluator with prompt | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 3396 | # Create an LLM evaluator with prompt | COMMENT |
| MEDIUM | …/unit/server/api/mutations/test_evaluator_mutations.py | 3940 | # Create the builtin evaluator and verify continuous config is returned | COMMENT |
| MEDIUM | …tions/test_project_trace_retention_policy_mutations.py | 138 | # Create a new retention policy | STRING |
| MEDIUM | …tions/test_project_trace_retention_policy_mutations.py | 324 | # Create a GlobalID for the default policy to use in GraphQL operations | STRING |
| MEDIUM | …rver/api/mutations/test_annotation_config_mutations.py | 269 | # Create a categorical annotation config | STRING |
| MEDIUM | …rver/api/mutations/test_annotation_config_mutations.py | 833 | # Create a categorical annotation config | STRING |
| MEDIUM | …rver/api/mutations/test_annotation_config_mutations.py | 894 | # Create a categorical annotation config | STRING |
| MEDIUM | tests/unit/server/api/mutations/test_trace_mutations.py | 263 | # Create a session | STRING |
| MEDIUM | tests/unit/server/api/mutations/test_trace_mutations.py | 290 | # Create a span for the first trace | STRING |
| MEDIUM | tests/unit/server/api/mutations/test_trace_mutations.py | 330 | # Create a span for the second trace | STRING |
| MEDIUM | tests/unit/server/api/mutations/test_trace_mutations.py | 375 | # Create a span for the third trace | STRING |
| MEDIUM | …ts/unit/server/api/mutations/test_project_mutations.py | 57 | # Create a new project | STRING |
| MEDIUM | …ts/unit/server/api/mutations/test_project_mutations.py | 71 | # Create a project session for the first two traces | STRING |
| MEDIUM | …ts/unit/server/api/mutations/test_project_mutations.py | 83 | # Create a trace | STRING |
| MEDIUM | tests/unit/server/api/helpers/test_evaluators.py | 2168 | # Create a custom output config with different labels | COMMENT |
| 119 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …egression/prompt-hill-climb/tests/hill_climb_checks.py | 211 | CODE | |
| LOW | evals/harbor/verifiers/harbor_verifiers/phoenix_api.py | 71 | CODE | |
| LOW | evals/harbor/agents/atif.py | 98 | CODE | |
| LOW | evals/pxi/conftest.py | 55 | CODE | |
| LOW | evals/pxi/conftest.py | 166 | CODE | |
| LOW | evals/pxi/gate.py | 400 | CODE | |
| LOW | evals/pxi/online_evals/run.py | 210 | CODE | |
| LOW | evals/pxi/online_evals/rendering.py | 84 | CODE | |
| LOW | evals/pxi/evaluators/tools.py | 83 | CODE | |
| LOW | evals/pxi/evaluators/tools.py | 561 | CODE | |
| LOW | evals/pxi/harness/run_experiment.py | 90 | CODE | |
| LOW | evals/pxi/harness/reporting.py | 141 | CODE | |
| LOW | tests/unit/conftest.py | 496 | CODE | |
| LOW | tests/unit/conftest.py | 606 | CODE | |
| LOW | tests/unit/graphql.py | 98 | CODE | |
| LOW | tests/unit/trace/dsl/trace_filter_reference.py | 378 | CODE | |
| LOW | tests/unit/trace/dsl/test_session_filter.py | 763 | CODE | |
| LOW | tests/unit/pxi/evals/test_agent_backend.py | 187 | CODE | |
| LOW | tests/unit/pxi/evals/test_agent_backend.py | 199 | CODE | |
| LOW | tests/unit/pxi/evals/test_agent_task_inputs.py | 155 | CODE | |
| LOW | tests/unit/pxi/evals/online_evals/test_user_friction.py | 51 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 136 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 200 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 270 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 340 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 414 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 453 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 481 | CODE | |
| LOW | tests/unit/server/api/test_wasm_backend.py | 736 | CODE | |
| LOW | tests/unit/server/api/test_subscriptions.py | 2084 | CODE | |
| LOW | tests/unit/server/api/test_queries.py | 1217 | CODE | |
| LOW | tests/unit/server/api/test_schema_search.py | 2866 | CODE | |
| LOW | tests/unit/server/api/types/test_Span.py | 366 | CODE | |
| LOW | tests/unit/server/api/types/test_Project.py | 2267 | CODE | |
| LOW | tests/unit/server/api/types/test_Project.py | 3136 | CODE | |
| LOW | tests/unit/server/api/dataloaders/conftest.py | 12 | CODE | |
| LOW | tests/unit/server/api/helpers/test_evaluators.py | 2600 | CODE | |
| LOW | tests/unit/server/api/helpers/test_evaluators.py | 3106 | CODE | |
| LOW | tests/unit/server/api/helpers/test_evaluators.py | 3327 | CODE | |
| LOW | …t/server/cost_tracking/test_cost_details_calculator.py | 811 | CODE | |
| LOW | tests/unit/db/test_helpers.py | 65 | CODE | |
| LOW | tests/integration/conftest.py | 159 | CODE | |
| LOW | tests/integration/conftest.py | 162 | CODE | |
| LOW | tests/integration/_mock_ldap_server.py | 283 | CODE | |
| LOW | tests/integration/_mock_ldap_server.py | 498 | CODE | |
| LOW | tests/integration/_mock_llm_server.py | 344 | CODE | |
| LOW | tests/integration/_mock_llm_server.py | 460 | CODE | |
| LOW | tests/integration/_mock_llm_server.py | 208 | CODE | |
| LOW | tests/integration/_mock_llm_server.py | 602 | CODE | |
| LOW | tests/integration/_helpers.py | 690 | CODE | |
| LOW | tests/integration/_helpers.py | 2477 | CODE | |
| LOW | tests/integration/harbor/run_plugin_e2e.py | 110 | CODE | |
| LOW | tests/integration/experiments/conftest.py | 431 | CODE | |
| LOW | tests/integration/experiments/test_playground.py | 161 | CODE | |
| LOW | tests/integration/experiments/test_playground.py | 330 | CODE | |
| LOW | tests/integration/experiments/test_playground.py | 266 | CODE | |
| LOW | tests/integration/experiments/test_playground.py | 375 | CODE | |
| LOW | …/integration/project_sessions/test_project_sessions.py | 35 | CODE | |
| LOW | tests/integration/client/test_datasets.py | 889 | CODE | |
| LOW | tests/integration/client/test_annotations.py | 2957 | CODE | |
| 335 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/unit/server/test_app_fastapi_dependants.py | 0 | a second app built the way the ``app`` fixture builds its own. | STRING |
| HIGH | tests/unit/server/test_app_fastapi_type_adapters.py | 0 | a second app built the way the ``app`` fixture builds its own. | STRING |
| HIGH | tests/unit/server/test_app_routers.py | 0 | a second app built the way the ``app`` fixture builds its own. | STRING |
| HIGH | tests/unit/server/sandbox/test_modal_backend.py | 0 | a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no sign | STRING |
| HIGH | tests/unit/server/sandbox/test_vercel_backend.py | 0 | a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no sign | STRING |
| HIGH | tests/unit/server/sandbox/test_e2b_backend.py | 0 | a classified sdk exception inside run_code must propagate, not wrap. without the narrow re-raise the manager has no sign | STRING |
| HIGH | tests/unit/server/api/routers/v1/test_traces.py | 0 | contains a project with a single trace and a single span. | STRING |
| HIGH | tests/unit/server/api/routers/v1/test_spans.py | 0 | contains a project with a single trace and a single span. | STRING |
| HIGH | tests/unit/server/api/types/test_SpanAnnotation.py | 0 | contains a project with a single trace and a single span. | STRING |
| HIGH | tests/unit/server/api/types/test_Span.py | 0 | contains a project with a single trace and a single span. | STRING |
| HIGH | tests/unit/server/api/types/test_TraceAnnotation.py | 0 | contains a project with a single trace and a single span. | STRING |
| HIGH | tests/integration/dataset_labels/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/auth/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/experiments/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/project_sessions/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/server/test_db_disk_usage_monitor.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/experiment_tags/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/client/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | tests/integration/annotation_configs/conftest.py | 0 | combine all environment variable configurations for testing. | STRING |
| HIGH | examples/agents/tau_bench_openai_agents/run.py | 0 | return a timestamped default output path under examples/results. | STRING |
| HIGH | examples/agents/traject_bench_langgraph/run.py | 0 | return a timestamped default output path under examples/results. | STRING |
| HIGH | examples/agents/tau_bench_langgraph/run.py | 0 | return a timestamped default output path under examples/results. | STRING |
| HIGH | …amples/agents/tau_bench_openai_agents/phoenix_setup.py | 0 | resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. falls back to phoenix_endpoint (the phoenix | STRING |
| HIGH | …amples/agents/traject_bench_langgraph/phoenix_setup.py | 0 | resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. falls back to phoenix_endpoint (the phoenix | STRING |
| HIGH | examples/agents/tau_bench_langgraph/phoenix_setup.py | 0 | resolve otlp traces endpoint, preferring phoenix_collector_endpoint env var. falls back to phoenix_endpoint (the phoenix | STRING |
| HIGH | …amples/agents/tau_bench_openai_agents/phoenix_setup.py | 0 | return the phoenix ui base url (without the otlp `/v1/traces` suffix). prefers phoenix_endpoint, then phoenix_collector_ | STRING |
| HIGH | …amples/agents/traject_bench_langgraph/phoenix_setup.py | 0 | return the phoenix ui base url (without the otlp `/v1/traces` suffix). prefers phoenix_endpoint, then phoenix_collector_ | STRING |
| HIGH | examples/agents/tau_bench_langgraph/phoenix_setup.py | 0 | return the phoenix ui base url (without the otlp `/v1/traces` suffix). prefers phoenix_endpoint, then phoenix_collector_ | STRING |
| HIGH | …t_calculations/generate_spans_for_cost_calculations.py | 0 | generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the gene | STRING |
| HIGH | …_for_large_session/generate_spans_for_large_session.py | 0 | generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the gene | STRING |
| HIGH | scripts/generate_spans/generate_spans_deeply_nested.py | 0 | generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the gene | STRING |
| HIGH | …ripts/generate_spans/generate_spans_for_time_series.py | 0 | generate n random numbers that sum to total using dirichlet distribution. args: total (int): the total sum that the gene | STRING |
| HIGH | …t_calculations/generate_spans_for_cost_calculations.py | 0 | generate a synthetic llm span with random token counts and model information. creates a span with the following attribut | STRING |
| HIGH | …_for_large_session/generate_spans_for_large_session.py | 0 | generate a synthetic llm span with random token counts and model information. creates a span with the following attribut | STRING |
| HIGH | scripts/generate_spans/generate_spans_deeply_nested.py | 0 | generate a synthetic llm span with random token counts and model information. creates a span with the following attribut | STRING |
| HIGH | …ripts/generate_spans/generate_spans_for_time_series.py | 0 | generate a synthetic llm span with random token counts and model information. creates a span with the following attribut | STRING |
| HIGH | scripts/testing/otel_gen_ai/send_openai_traces.py | 0 | otlp traces url for the exporter below. ``phoenix_collector_endpoint`` may be a base url or already carry the otlp path; | STRING |
| HIGH | scripts/testing/otel_gen_ai/send_google_traces.py | 0 | otlp traces url for the exporter below. ``phoenix_collector_endpoint`` may be a base url or already carry the otlp path; | STRING |
| HIGH | scripts/testing/otel_gen_ai/send_anthropic_traces.py | 0 | otlp traces url for the exporter below. ``phoenix_collector_endpoint`` may be a base url or already carry the otlp path; | STRING |
| HIGH | …_llama_index_with_recursive_character_text_splitter.py | 0 | loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list of | STRING |
| HIGH | scripts/data/build_langchain_vector_store.py | 0 | loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list of | STRING |
| HIGH | scripts/data/fetch_arize_documentation.py | 0 | loads documents from a gitbook url. args: docs_url (str): url to gitbook docs. returns: list[langchaindocument]: list of | STRING |
| HIGH | …kages/phoenix-evals/src/phoenix/evals/rate_limiters.py | 0 | an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not need | STRING |
| HIGH | …oenix-client/src/phoenix/client/utils/rate_limiters.py | 0 | an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not need | STRING |
| HIGH | src/phoenix/server/rate_limiters.py | 0 | an adaptive rate-limiter that adjusts the rate based on the number of rate limit errors. this rate limiter does not need | STRING |
| HIGH | …kages/phoenix-evals/src/phoenix/evals/rate_limiters.py | 0 | lazily initialize async primitives to ensure they are created in the correct event loop. | STRING |
| HIGH | …oenix-client/src/phoenix/client/utils/rate_limiters.py | 0 | lazily initialize async primitives to ensure they are created in the correct event loop. | STRING |
| HIGH | src/phoenix/server/rate_limiters.py | 0 | lazily initialize async primitives to ensure they are created in the correct event loop. | STRING |
| HIGH | …client/src/phoenix/client/resources/traces/__init__.py | 0 | log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method | STRING |
| HIGH | …-client/src/phoenix/client/resources/spans/__init__.py | 0 | log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method | STRING |
| HIGH | …ient/src/phoenix/client/resources/sessions/__init__.py | 0 | log multiple session annotations from a pandas dataframe asynchronously. requires phoenix server >= 12.0.0. this method | STRING |
| HIGH | src/phoenix/server/api/types/Trace.py | 0 | retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and label | STRING |
| HIGH | src/phoenix/server/api/types/ProjectSession.py | 0 | retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and label | STRING |
| HIGH | src/phoenix/server/api/types/Span.py | 0 | retrieves and summarizes annotations associated with this span. this method aggregates annotation data by name and label | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | js/examples/apps/tracing-tutorial/support-agent.ts | 244 | // Step 1: Classify the query | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/support-agent.ts | 292 | // Step 2: Route based on classification | COMMENT |
| LOW⚡ | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 202 | // Step 1: Fetch spans from Phoenix | COMMENT |
| LOW⚡ | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 209 | // Step 2: Filter spans by type | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 232 | // Step 3: Evaluate tool spans (simple code-based check) | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 304 | // Step 4: Log annotations to Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 320 | // Step 5: Summary | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 377 | // Step 1: Fetch spans from Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 409 | // Step 3: Evaluate each session | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 500 | // Step 4: Log session annotations to Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 518 | // Step 5: Summary | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 10 | // Step 1: define the task to run (we call the agent with the question) | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 21 | // Step 2: define the dataset of questions to ask the agent | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 45 | // Step 3: Define the evaluators | COMMENT |
| LOW | …s/apps/mastra-agent/src/experiments/run-experiments.ts | 7 | //Step 4: Run the experiment | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 118 | // Step 1: Fetch spans from the project | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 139 | // Step 2: Transform spans into dataset examples with span ID links | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 173 | // Step 3: Create the dataset with span associations | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 36 | // Step 1: Define the agent's tools | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 60 | // Step 2: Define the agent | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 80 | // Step 3: Build the evaluator | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 126 | // Step 4: Run the experiment and evaluate | COMMENT |
| LOW | …ernal_docs/specs/ldap-authentication/migration-plan.md | 92 | # Step 1: Update CHECK constraint to allow 'LDAP' | COMMENT |
| LOW | …ernal_docs/specs/ldap-authentication/migration-plan.md | 98 | # Step 2: Migrate LDAP users | COMMENT |
| LOW | …_docs/specs/ldap-authentication/future-improvements.md | 384 | # Step 1: Get tokenGroups (binary SIDs) | COMMENT |
| LOW | …_docs/specs/ldap-authentication/future-improvements.md | 397 | # Step 2: Resolve SIDs to DNs | COMMENT |
| LOW⚡ | …ernal_docs/specs/ldap-authentication/optional-email.md | 183 | # Step 1: Lookup by unique_id first (always, when configured) | COMMENT |
| LOW⚡ | …ernal_docs/specs/ldap-authentication/optional-email.md | 188 | # Step 2: Fallback to email lookup (only for real emails) | COMMENT |
| LOW⚡ | …ernal_docs/specs/ldap-authentication/optional-email.md | 195 | # Step 3: Return existing user (update email if changed) | COMMENT |
| LOW⚡ | …ernal_docs/specs/ldap-authentication/optional-email.md | 201 | # Step 4: Create new user | COMMENT |
| LOW | tests/unit/_helpers.py | 257 | # Step 1: Get ALL revisions up to and including this dataset version | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 270 | # Step 2: Find the latest revision for each example (simple Python logic) | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 278 | # Step 3: Filter out DELETE revisions | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 285 | # Step 4: Check if experiment has assigned splits | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 294 | # Step 5: Filter by splits if any are assigned | COMMENT |
| LOW⚡ | tests/integration/_helpers.py | 1578 | # Step 2: Validate PKCE (if required) | COMMENT |
| LOW | tests/integration/_helpers.py | 1557 | # Step 1: Validate client authentication (if required) | COMMENT |
| LOW | tests/integration/_helpers.py | 1614 | # Step 3: Determine authentication mode and validate | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 503 | # Step 1: Create LDAP user via login | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 509 | # Step 2: Query GraphQL to verify authMethod is 'LDAP' | COMMENT |
| LOW | tests/integration/auth/test_ldap.py | 664 | # Step 1: Admin pre-creates LDAP user (only needs email) | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 698 | # Step 2: Add user to LDAP with matching email | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 707 | # Step 3: User logs in via LDAP (email lookup finds pre-created user) | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 713 | # Step 4: Verify username remains stable (not synced from LDAP) | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 721 | # Step 5: Verify subsequent logins work | STRING |
| LOW | tests/integration/client/test_experiments.py | 2662 | # Step 1: Run experiment WITHOUT evaluators (task execution only) | COMMENT |
| LOW | tests/integration/client/test_experiments.py | 2681 | # Step 2: Add evaluations to the completed experiment | COMMENT |
| LOW⚡ | …/skills/phoenix-server/references/database-patterns.md | 35 | # Step 1: Add column as nullable | COMMENT |
| LOW⚡ | …/skills/phoenix-server/references/database-patterns.md | 39 | # Step 2: Backfill | COMMENT |
| LOW⚡ | …/skills/phoenix-server/references/database-patterns.md | 42 | # Step 3: Add constraints | COMMENT |
| LOW | .agents/skills/phoenix-typescript-package-docs/SKILL.md | 172 | ### Step 1: Determine the affected package and modules | COMMENT |
| LOW | .agents/skills/phoenix-typescript-package-docs/SKILL.md | 182 | ### Step 2: Update canonical Mintlify docs | COMMENT |
| LOW | .agents/skills/phoenix-typescript-package-docs/SKILL.md | 195 | ### Step 3: Sync generated package docs | COMMENT |
| LOW | .agents/skills/phoenix-typescript-package-docs/SKILL.md | 221 | ### Step 4: Verify the npm artifact | COMMENT |
| LOW | .agents/skills/phoenix-typescript-package-docs/SKILL.md | 236 | ### Step 5: Check for nav and path regressions | COMMENT |
| LOW | …x-evals/references/experiments-synthetic-typescript.md | 26 | // Step 1: Create tuples | COMMENT |
| LOW | …x-evals/references/experiments-synthetic-typescript.md | 33 | // Step 2: Convert to natural query | COMMENT |
| LOW | …oenix-evals/references/experiments-synthetic-python.md | 23 | # Step 1: Create tuples | COMMENT |
| LOW | …oenix-evals/references/experiments-synthetic-python.md | 29 | # Step 2: Convert to natural query | COMMENT |
| LOW | .agents/skills/phoenix-release-notes/SKILL.md | 50 | ## Step 1: Identify Undocumented Releases | COMMENT |
| 88 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …tories/design-system/tables/ColumnOrdering.stories.tsx | 38 | name: "John Doe", | CODE |
| LOW | js/app/stories/design-system/tables/Table.stories.tsx | 69 | name: "John Doe", | CODE |
| LOW | js/app/stories/design-system/tables/Table.stories.tsx | 719 | for (const name of ["John Doe", "David Kim"]) { | CODE |
| LOW | …/app/stories/design-system/forms/TextField.stories.tsx | 48 | { label: "placeholder", props: {}, placeholder: "e.g. correctness" }, | CODE |
| LOW | js/app/stories/design-system/forms/TextArea.stories.tsx | 34 | { label: "placeholder", props: {}, placeholder: "A short description" }, | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 72 | Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam, | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 72 | Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam, | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 109 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 109 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 140 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | …/app/stories/design-system/overlays/Dialog.stories.tsx | 140 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | js/app/stories/design-system/overlays/Modal.stories.tsx | 50 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | js/app/stories/design-system/overlays/Modal.stories.tsx | 50 | Lorem ipsum dolor sit amet consectetur adipisicing elit. | CODE |
| LOW | js/app/stories/design-system/overlays/Modal.stories.tsx | 227 | Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam, | CODE |
| LOW | js/app/stories/design-system/overlays/Modal.stories.tsx | 227 | Lorem ipsum dolor sit amet consectetur adipisicing elit. Quisquam, | CODE |
| LOW | js/app/scripts/lint-storybook.ts | 393 | "placeholder", | CODE |
| LOW | …ks/evals-benchmarks/src/tool_response_handling.eval.ts | 133 | address: "123 Main St", | CODE |
| LOW | …marks/evals-benchmarks/src/retrieval_relevance.eval.ts | 202 | context: "Acme Corp's 2019 Q1 earnings were $2.1M, up 4% year over year.", | CODE |
| LOW | js/packages/phoenix-cli/src/pxi/client.ts | 632 | agentSessionId: "placeholder", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 10 | name: "John Doe", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 14 | street: "123 Main St", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 46 | userName: "John Doe", // Added mapped field | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 88 | extractedName: "John Doe", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 105 | extractedStreet: "123 Main St", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 202 | extractedName: "John Doe", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 203 | extractedStreet: "123 Main St", | CODE |
| LOW | …es/phoenix-evals/test/utils/objectMappingUtils.test.ts | 315 | fullName: "John Doe", | CODE |
| LOW | …packages/phoenix-evals/src/utils/objectMappingUtils.ts | 117 | * // fullName: "John Doe", | COMMENT |
| LOW⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 25 | local_user = LocalUser(email="user@example.com", password="secret") | STRING |
| LOW | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 181 | user = LocalUser(email="user@example.com", password="secret") | STRING |
| LOW | …l_docs/vignettes/sqlalchemy/polymorphic_user/README.md | 33 | - During object creation (e.g., `LocalUser(email="user@example.com", password="secret")`): | CODE |
| LOW | …l_docs/vignettes/sqlalchemy/polymorphic_user/README.md | 93 | local_user = LocalUser(email="user@example.com", password="secret") | CODE |
| LOW | …rnal_docs/vignettes/json-jsonb-demo/src/performance.ts | 61 | name: 'John Doe', | CODE |
| LOW | …rnal_docs/vignettes/json-jsonb-demo/src/performance.ts | 64 | street: '123 Main St', | CODE |
| LOW | …rnal_docs/vignettes/json-jsonb-demo/src/performance.ts | 135 | WHERE data_json->'user'->>'name' = 'John Doe' | CODE |
| LOW | …rnal_docs/vignettes/json-jsonb-demo/src/performance.ts | 148 | WHERE data_jsonb->'user'->>'name' = 'John Doe' | CODE |
| LOW | …rnal_docs/vignettes/json-jsonb-demo/src/performance.ts | 179 | WHERE data_jsonb->'user'->>'name' = 'John Doe' | CODE |
| LOW | …l_docs/vignettes/json-jsonb-demo/src/query-examples.ts | 31 | name: 'John Doe', | CODE |
| LOW | …rnal_docs/specs/ldap-authentication/database-schema.md | 12 | username = 'John Doe' ← Display name (synced from LDAP) | CODE |
| LOW | tests/unit/test_config.py | 201 | "user@example.com": "User=With=Equals", | CODE |
| LOW⚡ | tests/unit/server/test_ldap.py | 822 | mock_attr.values = ["user@example.com"] | CODE |
| LOW⚡ | tests/unit/server/test_ldap.py | 826 | assert result == "user@example.com" | CODE |
| LOW | tests/unit/server/test_ldap.py | 172 | mock_display_name.values = ["John Doe"] | CODE |
| LOW | tests/unit/server/test_ldap.py | 188 | assert result.display_name == "John Doe" | CODE |
| LOW | tests/unit/server/test_ldap.py | 274 | mock_display_name.values = ["John Doe"] | CODE |
| LOW | tests/unit/server/test_ldap.py | 324 | mock_display_name.values = ["John Doe"] | CODE |
| LOW | tests/unit/server/test_ldap.py | 405 | mock_display_name.values = ["John Doe"] | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 615 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 616 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 617 | limiter.check("user@example.com") # 2 failures < 3 max, should not raise | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 629 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 630 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 631 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 633 | limiter.check("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 642 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 643 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 644 | limiter.record_success("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 646 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 647 | limiter.record_failure("user@example.com") | CODE |
| LOW⚡ | tests/unit/server/test_rate_limiters.py | 648 | limiter.check("user@example.com") # should not raise | CODE |
| 181 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | evals/pxi/online_evals/run.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | evals/pxi/online_evals/rendering.py | 127 | __all__ = ["Message", "render_conversation", "render_turn_compact", "render_turn_detailed"] | CODE |
| LOW | evals/pxi/online_evals/conversation.py | 33 | logger = logging.getLogger(__name__) | CODE |
| LOW | evals/pxi/online_evals/conversation.py | 204 | __all__ = ["Message", "Turn", "messages_from_attributes", "segment_turns", "transcript"] | CODE |
| LOW | evals/pxi/online_evals/message_origin.py | 36 | __all__ = ["is_human_message"] | CODE |
| LOW | evals/pxi/online_evals/evaluators/__init__.py | 11 | __all__ = ["EVALUATORS", "SUGGESTION_ACCEPTED", "TOOL_COUNT_PER_TURN", "USER_FRICTION"] | CODE |
| LOW | evals/pxi/online_evals/evaluators/user_friction.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | evals/pxi/evaluators/__init__.py | 31 | __all__ = [ | CODE |
| LOW⚡ | …ents/capabilities/tools/internal/test_call_subagent.py | 58 | def set_subagent_final_tool_output(chunk: ToolOutputAvailableChunk) -> None: | CODE |
| LOW⚡ | …ents/capabilities/tools/internal/test_call_subagent.py | 99 | def set_subagent_final_tool_output(chunk: ToolOutputAvailableChunk) -> None: | CODE |
| LOW | tests/unit/server/mcp/sql/test_liveness.py | 751 | def set_authorizer(self, *args: Any) -> None: | CODE |
| LOW | tests/unit/server/api/routers/test_oauth2.py | 31 | async def _setup_role_ids(self, asgi_app: ASGIApp, db: DbSessionFactory) -> None: | CODE |
| LOW | tests/unit/server/api/routers/test_oauth2.py | 163 | async def _setup_role_ids(self, asgi_app: ASGIApp, db: DbSessionFactory) -> None: | CODE |
| LOW | tests/unit/db/test_facilitator.py | 358 | def _update_manifest(self, manifest_path: Path, models: list[dict[str, Any]]) -> None: | CODE |
| LOW | tests/integration/_mock_ldap_server.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | tests/integration/_mock_llm_server.py | 145 | logger = logging.getLogger(__name__) | CODE |
| LOW | tests/integration/_helpers.py | 1461 | def _setup_routes(self) -> None: | CODE |
| LOW | tests/integration/_helpers.py | 1897 | def set_role(self, role: Optional[str], num_logins: int) -> None: | CODE |
| LOW | tests/integration/_helpers.py | 1915 | def set_email(self, email: str, num_logins: int) -> None: | CODE |
| LOW | tests/integration/_helpers.py | 1939 | def set_picture(self, picture: str, num_logins: int) -> None: | CODE |
| LOW | .agents/skills/phoenix-github/scripts/_board.py | 313 | def set_sprint(project_id: str, item_id: str, field_id: str, iteration_id: str) -> None: | STRING |
| LOW | examples/agents/tau_bench_openai_agents/tools.py | 58 | def set_data(data: dict[str, Any]) -> None: | CODE |
| LOW | examples/agents/tau_bench_langgraph/tools.py | 58 | def set_data(data: dict[str, Any]) -> None: | CODE |
| LOW | scripts/update_helm.py | 30 | def update_helm_values(new_version: str) -> None: | CODE |
| LOW⚡ | scripts/update_helm.py | 41 | def update_helm_chart(new_version: str) -> None: | CODE |
| LOW | scripts/docker/devops/scripts/test_ldap_tls.py | 45 | logger = logging.getLogger(__name__) | CODE |
| LOW | scripts/docker/devops/scripts/ldap_mitm_proxy.py | 44 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | scripts/prompts/compile_python_prompts.py | 62 | __all__ = [ | CODE |
| LOW | scripts/data/build_llama_index_with_markdown_reader.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/tracing.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/__init__.py | 35 | __all__ = [ | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/executors.py | 30 | logger = logging.getLogger(__name__) | CODE |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/executors.py | 129 | def _update_concurrency_target(self) -> None: | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/utils.py | 509 | __all__ = [ | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/evaluators.py | 1737 | __all__ = [ | CODE |
| LOW | …es/phoenix-evals/src/phoenix/evals/metrics/__init__.py | 19 | __all__ = [ | CODE |
| LOW | …ckages/phoenix-evals/src/phoenix/evals/llm/__init__.py | 13 | __all__ = [ | CODE |
| LOW | packages/phoenix-evals/src/phoenix/evals/llm/types.py | 8 | __all__ = [ | CODE |
| LOW | …ages/phoenix-evals/src/phoenix/evals/llm/registries.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | …oenix-evals/src/phoenix/evals/llm/adapters/__init__.py | 11 | __all__ = [ | CODE |
| LOW | …ls/src/phoenix/evals/llm/adapters/langchain/adapter.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | …s/src/phoenix/evals/llm/adapters/langchain/__init__.py | 5 | __all__ = [ | CODE |
| LOW⚡ | …evals/src/phoenix/evals/llm/adapters/google/adapter.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | …vals/src/phoenix/evals/llm/adapters/google/__init__.py | 3 | __all__ = ["GoogleGenAIAdapter"] | CODE |
| LOW | …ls/src/phoenix/evals/llm/adapters/anthropic/adapter.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW | …s/src/phoenix/evals/llm/adapters/anthropic/__init__.py | 3 | __all__ = ["AnthropicAdapter"] | CODE |
| LOW | …vals/src/phoenix/evals/llm/adapters/litellm/adapter.py | 27 | logger = logging.getLogger(__name__) | CODE |
| LOW | …als/src/phoenix/evals/llm/adapters/litellm/__init__.py | 5 | __all__ = [ | CODE |
| LOW | …evals/src/phoenix/evals/llm/adapters/openai/adapter.py | 21 | logger = logging.getLogger(__name__) | CODE |
| LOW | …vals/src/phoenix/evals/llm/adapters/openai/__init__.py | 3 | __all__ = [ | CODE |
| LOW | …phoenix-evals/src/phoenix/evals/templating/__init__.py | 31 | __all__ = [ | CODE |
| LOW | packages/phoenix-client/src/phoenix/client/__init__.py | 7 | __all__ = [ | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/types/__init__.py | 4 | __all__ = [ | CODE |
| LOW | …s/phoenix-client/src/phoenix/client/types/sentinels.py | 5 | __all__ = [ | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_traces.py | 38 | logger = logging.getLogger(__name__) | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_traces.py | 40 | __all__ = [ | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_traces.py | 393 | def _update_metadata(span: v1.Span, values: Mapping[str, Any]) -> None: | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_scores.py | 12 | __all__ = [ | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_errors.py | 3 | __all__ = ["HarborPluginError"] | CODE |
| LOW | …es/phoenix-client/src/phoenix/client/harbor/_plugin.py | 50 | logger = logging.getLogger(__name__) | CODE |
| 158 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | tests/unit/pxi/evals/online_evals/test_user_friction.py | 304 | '{"data": null, "errors": [{"message": "boom"}]}', # tool error payload | CODE |
| HIGH⚡ | tests/unit/pxi/evals/online_evals/test_user_friction.py | 321 | ('{"data": null, "errors": [{"message": "boom"}]}', False), # tool error payload | CODE |
| HIGH⚡ | tests/unit/server/test_oauth2.py | 1353 | email_attribute_path="contains(email_aliases[*], 'primary') && email || alternate_email", | CODE |
| HIGH⚡ | tests/unit/server/test_oauth2.py | 1362 | "contains(email_aliases[*], 'primary') && email || alternate_email" | CODE |
| HIGH⚡ | tests/unit/server/test_oauth2.py | 644 | """Test that edge case claim values are handled gracefully (null, empty, unicode, nested objects).""" | STRING |
| HIGH | tests/unit/server/api/test_schema_search.py | 92 | spanAnnotations(filter: AnnotationFilter = null): [SpanAnnotation!]! | CODE |
| HIGH⚡ | tests/unit/server/api/test_schema_search.py | 557 | "Span.spanAnnotations(filter: AnnotationFilter = null): [SpanAnnotation!]!" | STRING |
| HIGH⚡ | tests/unit/server/api/test_schema_search.py | 977 | sdl = 'scalar JSON type Query { ok(x: JSON = {a: [1, "b", null, true]}): Int }' | STRING |
| HIGH⚡ | tests/unit/server/api/test_schema_search.py | 981 | == 'Query.ok(x: JSON = {a: [1, "b", null, true]}): Int' | STRING |
| HIGH | tests/unit/server/api/test_schema_search.py | 1128 | assert line == 'Query.ok(x: Opt = {payload: {a: [1, "b", null]}, choice: A}): String' | STRING |
| HIGH | tests/unit/server/api/routers/v1/test_datasets.py | 1019 | jsonl_content = b'{"a": null, "b": "x"}\n{"b": "y"}\n' | CODE |
| HIGH | tests/unit/server/api/routers/v1/test_datasets.py | 2859 | jsonl_content = b'{"a": null, "b": 2}\n' | CODE |
| HIGH | tests/unit/server/api/routers/v1/test_datasets.py | 2990 | b'"metadata": {"difficulty": null}}\n' | CODE |
| HIGH | tests/unit/server/api/routers/v1/test_datasets.py | 1424 | """Test JSON upload with various split formats: string, list, null, and mixed.""" | STRING |
| HIGH | tests/unit/server/api/types/test_Evaluator.py | 348 | """When dataset evaluator description is null, it should return base evaluator's description.""" | STRING |
| HIGH | tests/unit/server/api/types/test_Evaluator.py | 369 | """When both dataset evaluator and base evaluator descriptions are null, it returns null.""" | STRING |
| HIGH | tests/unit/server/api/types/test_Dataset.py | 34 | query ($exampleId: ID!, $datasetVersionId: ID = null) { | CODE |
| HIGH | tests/unit/server/api/types/test_Dataset.py | 175 | query ($datasetId: ID!, $datasetVersionId: ID = null) { | CODE |
| HIGH | tests/unit/server/api/types/test_Dataset.py | 281 | query ($datasetId: ID!, $datasetVersionId: ID = null, $revisionDatasetVersionId: ID = null, $filter: String = null | CODE |
| HIGH | tests/unit/server/api/types/test_Dataset.py | 734 | query ($datasetId: ID!, $datasetVersionId: ID = null, $includeEphemeral: Boolean = false) { | CODE |
| HIGH | tests/unit/server/api/types/test_Project.py | 1304 | query ($projectId: ID!, $after: String = null, $before: String = null, $filterCondition: String = null, $first: In | CODE |
| HIGH | …mutations/test_project_session_annotation_mutations.py | 52 | - Setting values to null (score/label/explanation to null) | STRING |
| HIGH | …mutations/test_project_session_annotation_mutations.py | 631 | # B5. Update with score=null, label=null, explanation="" should fail validation | STRING |
| HIGH | …mutations/test_project_session_annotation_mutations.py | 656 | # Fields not provided in the input are reset to their default values (null) | STRING |
| HIGH | tests/unit/server/api/mutations/test_model_mutations.py | 327 | already exists" whenever the provider was null, because the non-nullable | CODE |
| HIGH | …sts/unit/server/api/mutations/test_secret_mutations.py | 323 | # Test 12: Delete existing secret (by passing value: null) | STRING |
| HIGH⚡ | …r/api/helpers/test_experiment_run_filters_execution.py | 183 | # e5 stores JSON null, e6 omits the key. `json_extract` returns SQL NULL | COMMENT |
| HIGH | tests/integration/client/test_spans.py | 1385 | 'the capital of France?"}, "format": "MUSTACHE"}, "prompt_name": null}' | CODE |
| HIGH | tests/integration/client/test_spans.py | 1392 | '"prompt_name": null}' | CODE |
| HIGH | scripts/ci/test_helm.py | 2706 | # (--set attrEmail=null would be interpreted as YAML null, becoming empty string) | COMMENT |
| HIGH | …/phoenix-evals/tests/phoenix/evals/llm/test_prompts.py | 182 | ("Mixed: {None} and {null}", TemplateFormat.F_STRING), | CODE |
| HIGH | src/phoenix/trace/dsl/session_filter.py | 408 | "exact; a session with no such value is SQL null, so `not in` and comparisons " | CODE |
| HIGH | src/phoenix/trace/dsl/session_filter.py | 415 | "case, `==` is exact; a session with no such value is SQL null, so " | CODE |
| HIGH | src/phoenix/trace/dsl/session_filter.py | 426 | "null, so comparisons and `not in` exclude those sessions (target them with " | CODE |
| HIGH | src/phoenix/server/mcp/graphql/tools.py | 146 | field is non-null, and keeps the rest of `data` -- so check `errors` | STRING |
| HIGH | src/phoenix/server/mcp/sql/normalize.py | 30 | "A non-finite number (infinity or NaN) was returned as null, because JSON " | CODE |
| HIGH | src/phoenix/server/sandbox/daytona_backend.py | 150 | f"${{r.stderr || r.stdout}}`);\n" | CODE |
| HIGH | src/phoenix/server/api/routers/v1/experiments.py | 412 | # dropped — otherwise `{"name": null, "description": "x"}` would 200 and ignore the name. | COMMENT |
| HIGH | src/phoenix/server/api/routers/v1/secrets.py | 46 | """Values, when non-null, must be non-empty strings (after trimming).""" | STRING |
| HIGH | src/phoenix/server/api/types/Span.py | 210 | description="the parent span ID. If null, it is a root span", | CODE |
| HIGH | src/phoenix/server/api/mutations/secret_mutations.py | 50 | {"key": "OPENAI_API_KEY", "value": null} | STRING |
| HIGH | src/phoenix/server/api/mutations/secret_mutations.py | 55 | description="The value of the secret. If null, the secret will be deleted." | CODE |
| HIGH⚡ | src/phoenix/server/api/mutations/secret_mutations.py | 82 | determines the final action (upsert with that value, or delete if value is null). | STRING |
| HIGH⚡ | src/phoenix/server/api/mutations/secret_mutations.py | 82 | determines the final action (upsert with that value, or delete if value is null). | STRING |
| HIGH⚡ | src/phoenix/server/api/mutations/secret_mutations.py | 89 | "or delete if value is null)." | CODE |
| HIGH⚡ | src/phoenix/server/api/mutations/secret_mutations.py | 89 | "or delete if value is null)." | CODE |
| HIGH | src/phoenix/db/facilitator.py | 419 | applies to all projects without a specific policy (i.e. foreign key is null). | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | README.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | sitemap.xml | 1088 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc> | CODE |
| MEDIUM | sitemap.xml | 1092 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc> | CODE |
| MEDIUM | sitemap.xml | 2080 | <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc> | CODE |
| MEDIUM | sitemap.xml | 2160 | <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc> | CODE |
| MEDIUM | sitemap.xml | 2164 | <loc>https://arize.com/docs/phoenix/cookbook/guardrails/designing-realtime-guardrails</loc> | CODE |
| MEDIUM | sitemap.xml | 2864 | <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc> | CODE |
| MEDIUM | evals/pxi/thresholds.yaml | 173 | # stage-scaffold-named-with-baseline is exposed to a real but | COMMENT |
| MEDIUM | evals/pxi/datasets/experiment_observations.yaml | 166 | # value matchers) and pick free-form scaffold key names, so the | COMMENT |
| MEDIUM | evals/pxi/datasets/experiment_observations.yaml | 306 | # staged metadata object. A script that carries the scaffold forward | COMMENT |
| MEDIUM | evals/pxi/datasets/experiment_observations.yaml | 309 | # example (the failure mode is dropping the scaffold entirely). | COMMENT |
| MEDIUM | evals/pxi/evaluators/tools.py | 440 | # scaffold keys an earlier write left behind. | COMMENT |
| MEDIUM | js/app/stories/constants/spanInfoFixtures.ts | 694 | 'Frequently Asked Questions\nCan I use Azure OpenAI?\nYes, in fact this is probably the preferred way to i | CODE |
| MEDIUM | internal_docs/specs/online-evals.md | 203 | [feedback use case](#evaluate-on-user-feedback)). The third is event-driven, not | CODE |
| MEDIUM | tests/unit/trace/dsl/test_filter.py | 1206 | # shapes that bypass the structural guardrails ``SpanFilter`` enforces. | COMMENT |
| MEDIUM | tests/unit/pxi/evals/test_datasets.py | 323 | # The preservation case must assert the scaffold keys survive a | STRING |
| MEDIUM⚡ | tests/unit/pxi/evals/test_evaluator_matchers.py | 246 | # The preservation case: scaffold keys must survive a whole-metadata | COMMENT |
| MEDIUM | tests/unit/pxi/evals/test_evaluator_matchers.py | 280 | # Clobbering the scaffold (dropping ``hypothesis``) must fail the check. | COMMENT |
| MEDIUM | …ents/skills/phoenix-evals/references/evaluators-rag.md | 1 | # Evaluators: RAG Systems | COMMENT |
| MEDIUM | …ents/skills/phoenix-evals/references/evaluators-rag.md | 92 | ## RAG Failure Taxonomy | COMMENT |
| MEDIUM | …phoenix-evals/references/experiments-running-python.md | 35 | # With context (RAG) | COMMENT |
| MEDIUM | …lls/phoenix-evals/references/common-mistakes-python.md | 120 | # RIGHT for RAG evaluation — fetch child spans for retriever/LLM metrics | COMMENT |
| MEDIUM | …kills/phoenix-tracing/references/annotations-python.md | 85 | ## RAG Pipeline Example | COMMENT |
| MEDIUM | …s/phoenix-tracing/references/annotations-typescript.md | 126 | ## RAG Pipeline Example | COMMENT |
| MEDIUM⚡ | .agents/skills/phoenix-github/scripts/board.json | 1 | [{"data":{"organization":{"projectV2":{"title":"phoenix","items":{"pageInfo":{"hasNextPage":true,"endCursor":"Y3Vyc29yOn | CODE |
| MEDIUM⚡ | .agents/skills/phoenix-github/scripts/board.json | 1 | [{"data":{"organization":{"projectV2":{"title":"phoenix","items":{"pageInfo":{"hasNextPage":true,"endCursor":"Y3Vyc29yOn | CODE |
| MEDIUM⚡ | .agents/skills/phoenix-github/scripts/board.json | 1 | [{"data":{"organization":{"projectV2":{"title":"phoenix","items":{"pageInfo":{"hasNextPage":true,"endCursor":"Y3Vyc29yOn | CODE |
| MEDIUM⚡ | .agents/skills/phoenix-github/scripts/board.json | 1 | [{"data":{"organization":{"projectV2":{"title":"phoenix","items":{"pageInfo":{"hasNextPage":true,"endCursor":"Y3Vyc29yOn | CODE |
| MEDIUM | .agents/skills/phoenix-github/scripts/_board.py | 35 | # Ticket-load guardrails: everyone should be fed, nobody should be buried. | COMMENT |
| MEDIUM | docs/PROMPT.md | 96 | | `guardrails` | Guardrails AI | https://arize.com/docs/phoenix/integrations/python/guardrails-ai | | CODE |
| MEDIUM | docs/sitemap.xml | 119 | <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc> | CODE |
| MEDIUM | docs/sitemap.xml | 184 | <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc> | CODE |
| MEDIUM | docs/sitemap.xml | 748 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc> | CODE |
| MEDIUM | docs/sitemap.xml | 753 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc> | CODE |
| MEDIUM | docs/sitemap.xml | 1563 | <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc> | CODE |
| MEDIUM | docs/phoenix/llms.txt | 283 | - [Guardrails AI Tracing](https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing): Auto- | CODE |
| MEDIUM | docs/phoenix/llms.txt | 306 | - [OpenAI Agents SDK (TypeScript)](https://arize.com/docs/phoenix/integrations/typescript/openai-agents): Trace @openai/ | CODE |
| MEDIUM | docs/phoenix/llms.txt | 371 | - [Agent Spec Integration](https://arize.com/docs/phoenix/integrations/python/agentspec): Connect Open Agent Spec agenti | CODE |
| MEDIUM | docs/phoenix/llms.txt | 379 | - [Guardrails AI Integration](https://arize.com/docs/phoenix/integrations/python/guardrails-ai): Connect Guardrails AI i | CODE |
| MEDIUM | docs/phoenix/llms.txt | 744 | - [OpenAI Agents Cookbook](https://arize.com/docs/phoenix/cookbook/agent-workflow-patterns/openai-agents): Trace and eva | CODE |
| MEDIUM⚡ | docs/phoenix/llms.txt | 761 | - [Designing Realtime Guardrails: Input, Output, and the Cost of Blocking](https://arize.com/docs/phoenix/cookbook/guard | CODE |
| MEDIUM⚡ | docs/phoenix/llms.txt | 764 | - [Jailbreak and Prompt Injection Defense](https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injec | CODE |
| MEDIUM⚡ | docs/phoenix/llms.txt | 774 | - [Agentic RAG Tracing](https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing): Build and trace an agentic | CODE |
| MEDIUM | docs/phoenix/llms.txt | 790 | - [07.18.2024: Guardrails AI integrations](https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-in | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 1088 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai</loc> | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 1092 | <loc>https://arize.com/docs/phoenix/integrations/python/guardrails-ai/guardrails-ai-tracing</loc> | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 2080 | <loc>https://arize.com/docs/phoenix/cookbook/tracing/agentic-rag-tracing</loc> | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 2160 | <loc>https://arize.com/docs/phoenix/cookbook/guardrails/jailbreak-and-prompt-injection-defense</loc> | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 2164 | <loc>https://arize.com/docs/phoenix/cookbook/guardrails/designing-realtime-guardrails</loc> | CODE |
| MEDIUM | docs/phoenix/sitemap.xml | 2864 | <loc>https://arize.com/docs/phoenix/release-notes/2024/07-18-2024-guardrails-ai-integrations</loc> | CODE |
| MEDIUM | docs/i18n/README.uk.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.zh.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.hi.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.cs.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.nl.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.fr.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.sv.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.hu.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.it.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| MEDIUM | docs/i18n/README.bn.md | 170 | | | [Guardrails](https://arize.com/docs/phoenix/tracing/integrations-tracing/guardrails) | `openinference-instrumentatio | CODE |
| 32 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | render.yaml | 1 | # Render Blueprint for Arize Phoenix | COMMENT |
| LOW | .readthedocs.yaml | 21 | # builder: "dirhtml" | COMMENT |
| LOW | evals/pxi/gate.py | 541 | COMMENT | |
| LOW | evals/pxi/thresholds.yaml | 1 | # Per-(evaluator, split) pass-rate gate policy for the PXI eval harness. | COMMENT |
| LOW | evals/pxi/thresholds.yaml | 21 | # regression, not flake. gate.py compares with STRICT less-than, so for a cell | COMMENT |
| LOW | evals/pxi/thresholds.yaml | 161 | # quarantined regression -> dev. | COMMENT |
| LOW | evals/pxi/evaluators/tools.py | 401 | COMMENT | |
| LOW | evals/pxi/evaluators/tools.py | 421 | # - ``contains_any: [<substr>, ...]`` -- observed must be a string containing | COMMENT |
| LOW | js/app/stories/domains/pxi/ToolPart.stories.tsx | 681 | }); | COMMENT |
| LOW | …/app/src/agent/uiOperations/runtime/jsSandboxBridge.ts | 161 | // `maxPausedMs` of total time spent awaiting timer-pausing operations | COMMENT |
| LOW | js/app/src/components/core/tabs/Tabs.tsx | 161 | // active the line fades along with the rest of that edge — the whole edge | COMMENT |
| LOW | js/app/src/components/agent/agentFabPositioning.ts | 1 | import type { AgentFabPlacement } from "@phoenix/store/agentStore"; | COMMENT |
| LOW | js/app/src/components/agent/SkillHighlightOverlay.tsx | 41 | mark { | COMMENT |
| LOW | …/app/src/components/filter/DSLFilterConditionField.tsx | 581 | // completion menu outside the input's row. Reparent all editor tooltips to | COMMENT |
| LOW | js/app/src/pages/project/ProjectPage.tsx | 401 | // read at load time (via an effect event, so it is not a reactive trigger) | COMMENT |
| LOW | js/app/src/store/agentStore.ts | 501 | // | COMMENT |
| LOW | js/packages/phoenix-cli/src/config.ts | 341 | // If we spread those over envConfig we would accidentally clobber env vars. | COMMENT |
| LOW | js/packages/phoenix-cli/src/pxi/App.tsx | 981 | const [draft, setDraft] = useState<DraftEditorState>( | COMMENT |
| LOW | js/packages/phoenix-config/README.md | 81 | the file after the first configuration lookup can call `clearEnvFileCache()` to | COMMENT |
| LOW | js/packages/phoenix-client/src/testing/runner.ts | 141 | ); | COMMENT |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 121 | COMMENT | |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 141 | # - starttls: Start with plaintext, upgrade to TLS (port 389) | COMMENT |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 161 | COMMENT | |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 181 | COMMENT | |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 201 | # - OpenLDAP: "entryUUID" | COMMENT |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 221 | # When set: Reads the specified attribute from the user's LDAP entry | COMMENT |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 241 | COMMENT | |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 261 | # - "MEMBER" → MEMBER role (Phoenix) | COMMENT |
| LOW | …ternal_docs/specs/ldap-authentication/configuration.md | 281 | # ============================================================================== | COMMENT |
| LOW | tests/unit/test_tracers.py | 721 | self, db: DbSessionFactory, project: models.Project, tracer: Tracer | COMMENT |
| LOW | tests/unit/trace/dsl/test_filter_spec_conformance.py | 101 | # casts | COMMENT |
| LOW | tests/unit/trace/dsl/test_filter_spec_conformance.py | 201 | ("str(1.5) == '1.5'", "cannot cast number to text"), | COMMENT |
| LOW | tests/unit/trace/dsl/test_filter.py | 1521 | # COMPLETENESS, covered by the scope tests above: supported root-only forms must | COMMENT |
| LOW | tests/unit/server/mcp/sql/test_node_coverage.py | 101 | "WithinGroup", | COMMENT |
| LOW | tests/integration/auth/conftest.py | 461 | **_env_database, | COMMENT |
| LOW | tests/integration/server/test_db_disk_usage_monitor.py | 161 | # an alert was properly sent to the configured admin email address. | COMMENT |
| LOW | tests/integration/server/test_db_disk_usage_monitor.py | 241 | # ======================================================================== | COMMENT |
| LOW | tests/integration/server/test_db_disk_usage_monitor.py | 341 | _gql(_app, access_token, query=query) | COMMENT |
| LOW | …/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | .agents/skills/daytona/references/go-sdk/types.md | 221 | OrganizationID string | COMMENT |
| LOW | .agents/skills/daytona/references/go-sdk/types.md | 641 | // OtelEndpointOverride is the OTel collector endpoint override for the sandbox. | COMMENT |
| LOW | .agents/skills/phoenix-github/scripts/snapshot.sh | 1 | #!/usr/bin/env bash | COMMENT |
| LOW | scripts/capabilities_poc.py | 41 | print(part.content) | COMMENT |
| LOW | scripts/docker/devops/overrides/ldap-test.yml | 1 | # Docker Compose override for LDAP testing | COMMENT |
| LOW | scripts/docker/devops/overrides/ldap-test.yml | 21 | # 6. POSIX mode (GROUP_SEARCH_FILTER) - phoenix-posix → ldap-posix | COMMENT |
| LOW | scripts/docker/devops/overrides/ldap-test.yml | 401 | COMMENT | |
| LOW | …son-canonicalization-schema/verify-canonicalization.py | 1 | ############################################################################## | COMMENT |
| LOW | …ipts/ci/json-canonicalization-schema/verify-numbers.py | 1 | ############################################################################## | COMMENT |
| LOW | …pts/ci/json-canonicalization-schema/testdata/numgen.js | 1 | // | COMMENT |
| LOW | …pts/ci/json-canonicalization-schema/testdata/numgen.go | 1 | // | COMMENT |
| LOW | scripts/ddl/generate_ddl_sqlite.py | 101 | # A bare identifier in the output must re-parse as the same identifier: ASCII | COMMENT |
| LOW | scripts/testing/otel_gen_ai/send_anthropic_traces.py | 1 | # /// script | COMMENT |
| LOW | scripts/perf/postgres/postgres_explain_analyze.py | 1 | # /// script | COMMENT |
| LOW | packages/phoenix-evals/src/phoenix/evals/llm/prompts.py | 581 | # Future enhancement could support templating in URL strings. | COMMENT |
| LOW | …ls/src/phoenix/evals/llm/adapters/anthropic/adapter.py | 321 | COMMENT | |
| LOW | packages/phoenix-sqlean/sqlean/__init__.py | 1 | # Copyright (C) 2005 Gerhard Haring <gh@ghaering.de> | COMMENT |
| LOW | packages/phoenix-sqlean/sqlean/dbapi2.py | 1 | # Copyright (C) 2004-2005 Gerhard Häring <gh@ghaering.de> | COMMENT |
| LOW | packages/phoenix-sqlean/tests/hooks.py | 1 | #-*- coding: iso-8859-1 -*- | COMMENT |
| LOW | packages/phoenix-sqlean/tests/regression.py | 1 | #-*- coding: iso-8859-1 -*- | COMMENT |
| LOW | packages/phoenix-sqlean/tests/dbapi.py | 1 | #-*- coding: iso-8859-1 -*- | COMMENT |
| 115 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | js/examples/apps/tracing-tutorial/support-agent.ts | 244 | // Step 1: Classify the query | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/support-agent.ts | 292 | // Step 2: Route based on classification | COMMENT |
| LOW⚡ | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 202 | // Step 1: Fetch spans from Phoenix | COMMENT |
| LOW⚡ | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 209 | // Step 2: Filter spans by type | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 232 | // Step 3: Evaluate tool spans (simple code-based check) | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 304 | // Step 4: Log annotations to Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 320 | // Step 5: Summary | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 377 | // Step 1: Fetch spans from Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 409 | // Step 3: Evaluate each session | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 500 | // Step 4: Log session annotations to Phoenix | COMMENT |
| LOW | js/examples/apps/tracing-tutorial/evaluate-traces.ts | 518 | // Step 5: Summary | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 10 | // Step 1: define the task to run (we call the agent with the question) | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 21 | // Step 2: define the dataset of questions to ask the agent | COMMENT |
| LOW | …/mastra-agent/src/experiments/configure-experiments.ts | 45 | // Step 3: Define the evaluators | COMMENT |
| LOW | …s/apps/mastra-agent/src/experiments/run-experiments.ts | 7 | //Step 4: Run the experiment | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 118 | // Step 1: Fetch spans from the project | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 139 | // Step 2: Transform spans into dataset examples with span ID links | COMMENT |
| LOW | …s/phoenix-client/examples/create_dataset_from_spans.ts | 173 | // Step 3: Create the dataset with span associations | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 36 | // Step 1: Define the agent's tools | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 60 | // Step 2: Define the agent | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 80 | // Step 3: Build the evaluator | COMMENT |
| LOW | …/phoenix-client/examples/experiment_trace_evaluator.ts | 126 | // Step 4: Run the experiment and evaluate | COMMENT |
| LOW | tests/unit/_helpers.py | 257 | # Step 1: Get ALL revisions up to and including this dataset version | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 270 | # Step 2: Find the latest revision for each example (simple Python logic) | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 278 | # Step 3: Filter out DELETE revisions | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 285 | # Step 4: Check if experiment has assigned splits | COMMENT |
| LOW⚡ | tests/unit/_helpers.py | 294 | # Step 5: Filter by splits if any are assigned | COMMENT |
| LOW⚡ | tests/integration/_helpers.py | 1578 | # Step 2: Validate PKCE (if required) | COMMENT |
| LOW | tests/integration/_helpers.py | 1557 | # Step 1: Validate client authentication (if required) | COMMENT |
| LOW | tests/integration/_helpers.py | 1614 | # Step 3: Determine authentication mode and validate | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 503 | # Step 1: Create LDAP user via login | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 509 | # Step 2: Query GraphQL to verify authMethod is 'LDAP' | COMMENT |
| LOW | tests/integration/auth/test_ldap.py | 664 | # Step 1: Admin pre-creates LDAP user (only needs email) | COMMENT |
| LOW⚡ | tests/integration/auth/test_ldap.py | 698 | # Step 2: Add user to LDAP with matching email | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 707 | # Step 3: User logs in via LDAP (email lookup finds pre-created user) | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 713 | # Step 4: Verify username remains stable (not synced from LDAP) | STRING |
| LOW⚡ | tests/integration/auth/test_ldap.py | 721 | # Step 5: Verify subsequent logins work | STRING |
| LOW | tests/integration/client/test_experiments.py | 2662 | # Step 1: Run experiment WITHOUT evaluators (task execution only) | COMMENT |
| LOW | tests/integration/client/test_experiments.py | 2681 | # Step 2: Add evaluations to the completed experiment | COMMENT |
| LOW⚡ | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 53 | # Step 1: Import phoenix to trace import order | COMMENT |
| LOW⚡ | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 59 | # Step 2: Run ty check | COMMENT |
| LOW⚡ | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 68 | # Step 3: Parse ty output to find files with errors | COMMENT |
| LOW⚡ | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 87 | # Step 4: Order files by import order | COMMENT |
| LOW | …ts/uv/type_check/get_phoenix_modules_with_ty_errors.py | 104 | # Step 5: Write to file | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 450 | # Step 1: Identify all span_id sources | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 454 | # Step 2: Create a working copy and preserve all span info | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 468 | # Step 3: Reset index to avoid conflicts during concatenation | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 471 | # Step 4: Validate we have span_id information | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 475 | # Step 5: Process each score name | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 488 | # Step 6: Concatenate with new sequential indices | COMMENT |
| LOW⚡ | …ent/examples/experiments/experiment_trace_evaluator.py | 47 | # Step 1: Define the agent's tools | COMMENT |
| LOW⚡ | …ent/examples/experiments/experiment_trace_evaluator.py | 81 | # Step 2: Define the agent | COMMENT |
| LOW⚡ | …ent/examples/experiments/experiment_trace_evaluator.py | 104 | # Step 3: Build the evaluator | COMMENT |
| LOW⚡ | …ent/examples/experiments/experiment_trace_evaluator.py | 155 | # Step 4: Run the experiment and evaluate | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 38 | # Step 1: Set up Tracing with phoenix-otel | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 53 | # Step 2: Simulate LLM Calls using OpenInference Decorators | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 138 | # Step 3: Query Spans from Phoenix using get_spans_dataframe | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 218 | # Step 4: Create Dataset with Span Associations | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 301 | # Step 1: Log LLM spans using OpenInference decorators/context managers | COMMENT |
| LOW⚡ | …examples/datasets/create_dataset_from_spans_example.py | 309 | # Step 2: Query spans back from Phoenix using get_spans_dataframe | COMMENT |
| 16 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | …/environments/container_assets/start_phoenix_server.sh | 15 | # Force PXI tracing so the phoenix-chat-agent harness can read every model call's usage. | COMMENT |
| MEDIUM | …/environments/container_assets/start_phoenix_server.sh | 16 | # Without it, the harness sees only the final call and undercounts PXI tokens and cost. | COMMENT |
| MEDIUM | evals/pxi/pytest.ini | 6 | # doctest-collect the eval harness and this suite's conftest, which it must not. | COMMENT |
| MEDIUM | evals/pxi/thresholds.yaml | 1 | # Per-(evaluator, split) pass-rate gate policy for the PXI eval harness. | COMMENT |
| MEDIUM | evals/pxi/datasets/product_knowledge.yaml | 642 | # deferred tool ends the single-shot harness run before any text is | COMMENT |
| MEDIUM⚡ | evals/pxi/datasets/experiments_skill_trigger.yaml | 279 | # Given a primed experiment id and a compare question under the harness's | COMMENT |
| MEDIUM⚡ | evals/pxi/datasets/experiments_skill_trigger.yaml | 282 | # to the known harness toolset on purpose; the skill itself stays | COMMENT |
| MEDIUM⚡ | evals/pxi/datasets/experiments_skill_trigger.yaml | 288 | # to production-agent behavior was unsupported. The harness now exposes | COMMENT |
| MEDIUM | js/app/tests/code-evaluators.spec.ts | 310 | // is robust to that prefix. | COMMENT |
| MEDIUM⚡ | tests/unit/test_auth.py | 99 | # Test comprehensive sanitization | COMMENT |
| MEDIUM | tests/unit/server/api/routers/test_oauth2.py | 38 | """Single comprehensive test covering all sign-in scenarios.""" | STRING |
| MEDIUM | tests/unit/server/api/routers/v1/test_experiments.py | 1216 | # Create specific scenarios for comprehensive testing | COMMENT |
| MEDIUM | tests/unit/server/api/types/test_Project.py | 284 | # Full time range for comprehensive testing | COMMENT |
| MEDIUM | tests/unit/server/api/types/test_Project.py | 124 | """Create comprehensive test data for cost and token testing. | STRING |
| MEDIUM | tests/unit/db/test_models.py | 78 | # Create comprehensive test data that covers various Unicode and special character scenarios | COMMENT |
| MEDIUM | tests/unit/db/test_models.py | 254 | # Single comprehensive payload testing ALL serialization scenarios: | COMMENT |
| MEDIUM | tests/unit/db/test_models.py | 279 | # NaN/Inf values (consolidated comprehensive coverage from test_json_sanitization) | COMMENT |
| MEDIUM | tests/unit/db/test_models.py | 398 | # Create all metadata entities with the comprehensive payload | COMMENT |
| MEDIUM | tests/unit/db/test_models.py | 227 | """Test comprehensive orjson serialization of all special object types across JSON columns. | STRING |
| MEDIUM | tests/unit/db/test_helpers.py | 391 | # Create dataset versions for comprehensive evolution testing | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 433 | # Create comprehensive split structure | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 466 | # Create overlapping split assignments for comprehensive testing | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 507 | # Create comprehensive revision patterns with direct object references | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 642 | # Return comprehensive mapping for all test scenarios | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 1000 | # Collect IDs for comprehensive duplicate analysis | COMMENT |
| MEDIUM | tests/unit/db/test_helpers.py | 1020 | # Expected examples based on our comprehensive fixture: | COMMENT |
| MEDIUM⚡ | tests/integration/server/test_db_disk_usage_monitor.py | 348 | # This ensures the blocking behavior is comprehensive and not bypass-able. | COMMENT |
| MEDIUM⚡ | tests/integration/client/test_annotations.py | 2298 | # Ensure we have different sessions for a more robust test | STRING |
| MEDIUM | tests/integration/client/test_experiments.py | 2120 | # Create first dataset for comprehensive mixed scenarios (examples 0-4) | STRING |
| MEDIUM | tests/integration/client/test_spans.py | 1287 | # Create comprehensive test DataFrame with nested attributes | COMMENT |
| MEDIUM | tests/integration/client/test_spans.py | 1297 | # Create comprehensive test data with nested attributes and complex types | COMMENT |
| MEDIUM | …/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh | 77 | # --skip-git-repo-check: harness may be invoked from non-git working dirs. | COMMENT |
| MEDIUM⚡ | .agents/skills/phoenix-github/scripts/board.json | 1 | [{"data":{"organization":{"projectV2":{"title":"phoenix","items":{"pageInfo":{"hasNextPage":true,"endCursor":"Y3Vyc29yOn | CODE |
| MEDIUM | scripts/docker/devops/scripts/test_ldap_tls.py | 507 | """Run comprehensive security test suite.""" | STRING |
| MEDIUM | scripts/docker/devops/scripts/ldap_mitm_proxy.py | 580 | """Print comprehensive security summary.""" | STRING |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/utils.py | 464 | # Index name matches existing column - just add the index values | COMMENT |
| MEDIUM | …ls/mcp/tracing_between_mcp_client_and_server/server.py | 216 | """Generates a comprehensive investment report based on client profile and market analysis.""" | STRING |
| MEDIUM | src/phoenix/server/mcp/sql/parse.py | 3240 | # entry for such a shape would error out of the harness rather than record | COMMENT |
| LOW | src/phoenix/server/api/routers/ldap.py | 161 | # Null email mode: email column is nullable, so just use None | COMMENT |
| LOW | …x/server/api/dataloaders/document_retrieval_metrics.py | 45 | # it simple and just use one approach for all backends. | COMMENT |
| MEDIUM | src/phoenix/server/api/helpers/message_helpers.py | 24 | # This makes it easier to leverage openinference.instrumentation helpers | COMMENT |
| MEDIUM | src/phoenix/db/models.py | 704 | # Enforce best practices for naming constraints | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh | 30 | # Check if docker is running | COMMENT |
| LOW | …s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh | 44 | # Check if Phoenix container is running | COMMENT |
| LOW | …s/apps/cli-agent-starter-kit/scripts/ensure-phoenix.sh | 69 | # Check if Phoenix container exists but is stopped | COMMENT |
| LOW | tests/unit/server/api/conftest.py | 1183 | # Assign examples to splits | COMMENT |
| LOW | tests/unit/db/test_helpers.py | 1122 | # Assign examples to splits | COMMENT |
| LOW | tests/unit/db/test_helpers.py | 1357 | # Assign splits to experiments | COMMENT |
| LOW | tests/integration/_mock_llm_server.py | 2121 | # Check if SSE format is requested (alt=sse query param) | COMMENT |
| LOW | tests/integration/_helpers.py | 2553 | # Check if we have a complete part | STRING |
| LOW | tests/integration/client/test_prompts.py | 1687 | # Assign labels to prompts using GraphQL mutation | STRING |
| LOW | tests/integration/client/test_prompts.py | 1698 | # Assign label1 to prompt1 | STRING |
| LOW | tests/integration/client/test_prompts.py | 1714 | # Assign label2 to prompt3 | STRING |
| LOW | tests/integration/client/test_prompts.py | 1844 | # Assign labels to prompts | STRING |
| LOW | tests/integration/client/test_annotations.py | 813 | # Check if we have all expected annotations | STRING |
| LOW | tests/integration/client/test_annotations.py | 2064 | # Check if we have all expected annotations | STRING |
| LOW | tests/integration/client/test_annotations.py | 2793 | # Check if we have all expected annotations | STRING |
| LOW | tests/integration/client/test_spans.py | 1406 | # Set index to span_id so dataframe_to_spans uses the right span IDs | COMMENT |
| LOW | tests/integration/db_migrations/__init__.py | 122 | # Check if table exists | COMMENT |
| LOW | tests/integration/db_migrations/__init__.py | 194 | # Check if table exists | COMMENT |
| LOW | api_reference/source/conf.py | 40 | # Check if we are still in the automodule block | COMMENT |
| LOW | api_reference/source/conf.py | 45 | # Check if we are out of the automodule block | COMMENT |
| LOW⚡ | examples/computer_use_agent/tools/edit.py | 83 | # Check if its an absolute path | COMMENT |
| LOW⚡ | examples/computer_use_agent/tools/edit.py | 89 | # Check if path exists | COMMENT |
| LOW⚡ | examples/computer_use_agent/tools/edit.py | 96 | # Check if the path points to a directory | COMMENT |
| LOW | examples/computer_use_agent/tools/edit.py | 146 | # Read the file content | COMMENT |
| LOW | examples/computer_use_agent/tools/edit.py | 151 | # Check if old_str is unique in the file | COMMENT |
| LOW | examples/computer_use_agent/image/xvfb_startup.sh | 30 | # Check if Xvfb is already running | COMMENT |
| LOW | scripts/docker/devops/dev.sh | 69 | # Add profile to the list | COMMENT |
| LOW | scripts/docker/devops/dev.sh | 562 | # Check if Phoenix container is running | COMMENT |
| LOW | scripts/docker/devops/scripts/test_ldap_tls.py | 604 | # Check if any Phase 2 application tests failed - we can't claim security | COMMENT |
| LOW⚡ | scripts/generate_data_via_plpgsql/generate_spans.py | 127 | # Check if the command was successful | COMMENT |
| LOW⚡ | scripts/generate_data_via_plpgsql/generate_spans.py | 133 | # Print the output if requested | COMMENT |
| LOW⚡ | scripts/generate_data_via_plpgsql/generate_spans.py | 213 | print_output=True, # Print output for report_spans_table_sizes.sql | CODE |
| LOW | …/generate_data_via_plpgsql/report_spans_table_sizes.py | 103 | # Check if the command was successful | COMMENT |
| LOW⚡ | …generate_data_via_plpgsql/generate_span_annotations.py | 239 | # Check if the command was successful | COMMENT |
| LOW⚡ | …generate_data_via_plpgsql/generate_span_annotations.py | 245 | # Print the output if requested | COMMENT |
| LOW | scripts/ci/test_helm.py | 2112 | # Check if the error contains the expected substring | COMMENT |
| LOW | scripts/ddl/generate_ddl_postgresql.py | 1019 | # Check if identifier needs quotes to preserve case/special chars | COMMENT |
| LOW | scripts/ddl/generate_ddl_postgresql.py | 1164 | # Check if line ends with semicolon (end of statement) | COMMENT |
| LOW | scripts/uv/type_check/type_check.py | 57 | # Check if we have fewer errors than expected (good news!) | COMMENT |
| LOW | …ripts/generate_spans/generate_spans_for_time_series.py | 249 | # Set pandas to display all rows without truncation | STRING |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/tracing.py | 144 | # Check if function has a trace_id parameter | COMMENT |
| LOW⚡ | packages/phoenix-evals/src/phoenix/evals/tracing.py | 241 | # Check if function has a trace_id parameter | COMMENT |
| LOW | …vals/src/phoenix/evals/llm/adapters/litellm/adapter.py | 582 | # Check if schema has properties and required fields | COMMENT |
| LOW | packages/phoenix-sqlean/tests/ttypes.py | 282 | # Check if the stripping of colnames works. Everything after the first | COMMENT |
| LOW | …kages/phoenix-client/src/phoenix/client/types/spans.py | 36 | # Check if the key is a legacy name that should be replaced. | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 1388 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 1578 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 1690 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 3238 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 3432 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 3546 | # Check if response is HTML (endpoint doesn't exist on old server) | COMMENT |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 2271 | # Check if there's at least one data row | COMMENT |
| LOW | …lient/src/phoenix/client/resources/prompts/__init__.py | 413 | # Check if a specific tag exists | STRING |
| LOW | …lient/src/phoenix/client/resources/prompts/__init__.py | 797 | # Check if a specific tag exists | STRING |
| LOW | …ix-client/src/phoenix/client/helpers/spans/__init__.py | 356 | # Check if events is not null/nan using pandas-safe method | COMMENT |
| LOW | src/phoenix/config.py | 1080 | # Check if TLS is enabled | COMMENT |
| LOW | src/phoenix/trace/trace_dataset.py | 94 | # Check if the dataframe has any document columns | COMMENT |
| LOW | src/phoenix/trace/trace_dataset.py | 330 | # Append the evaluations to the list of evaluations | COMMENT |
| LOW | src/phoenix/trace/span_json_decoder.py | 41 | # Check if the dict can be interpreted as a Span | COMMENT |
| LOW | src/phoenix/server/ldap.py | 1039 | # Check if results were truncated by server's size limit | COMMENT |
| 16 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| CRITICAL | …als/test/template/createTemplateVariablesProxy.test.ts | 192 | expect(proxied.level1.level2.level3.level4.toString()).toBe( | CODE |
| CRITICAL | …_docs/specs/ldap-authentication/future-improvements.md | 146 | from ldap3.core.exceptions import LDAPSocketOpenError, LDAPSocketReceiveError | CODE |
| CRITICAL | …ment-runner-background-process/appendix-error-types.md | 214 | from azure.core.exceptions import HttpResponseError | CODE |
| CRITICAL | tests/unit/vcr.py | 31 | module_name = self._request.node.module.__name__.split(".")[-1] | CODE |
| CRITICAL | tests/unit/server/sandbox/test_modal_backend.py | 406 | modal_mock.Image.debian_slim.return_value.pip_install.assert_called_once_with(packages) | CODE |
| CRITICAL | tests/integration/_mock_ldap_server.py | 22 | from ldap3.core.exceptions import LDAPInvalidDnError | CODE |
| CRITICAL | src/phoenix/config.py | 27 | from ldap3.core.exceptions import LDAPInvalidDnError | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | …c/components/evaluators/ContainsEvaluatorCodeBlock.tsx | 15 | return False | CODE |
| HIGH | js/app/src/pages/prompt/promptCodeSnippets.tsx | 102 | print(completion.choices[0].message) | CODE |
| HIGH | js/app/src/pages/prompt/promptCodeSnippets.tsx | 132 | print(response.choices[0].message.content) | CODE |
| HIGH | js/app/src/pages/prompt/promptCodeSnippets.tsx | 181 | print(completion.content) | CODE |
| HIGH | …/prompt/__tests__/promptCodeSnippets.anthropic.test.ts | 274 | print(completion.content)" | CODE |
| HIGH | …/prompt/__tests__/promptCodeSnippets.anthropic.test.ts | 392 | print(completion.content)" | CODE |
| HIGH | …/prompt/__tests__/promptCodeSnippets.anthropic.test.ts | 436 | print(completion.content)" | CODE |
| HIGH | …ges/prompt/__tests__/promptCodeSnippets.openai.test.ts | 295 | print(completion.choices[0].message)" | CODE |
| HIGH | …ges/prompt/__tests__/promptCodeSnippets.openai.test.ts | 402 | print(completion.choices[0].message)" | CODE |
| HIGH | …ges/prompt/__tests__/promptCodeSnippets.openai.test.ts | 439 | print(completion.choices[0].message)" | CODE |
| HIGH | …ges/prompt/__tests__/promptCodeSnippets.openai.test.ts | 487 | print(completion.choices[0].message)" | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | tests/unit/_helpers.py | 118 | CODE | |
| LOW | tests/unit/server/api/test_code_evaluator_runner.py | 98 | CODE | |
| LOW | examples/agent_framework_comparison/li_workflow/main.py | 16 | CODE | |
| LOW | …generate_data_via_plpgsql/generate_span_annotations.py | 162 | CODE | |
| LOW | scripts/ci/test_helm.py | 760 | CODE | |
| LOW | scripts/ci/test_helm.py | 1112 | CODE | |
| LOW | …kages/phoenix-evals/src/phoenix/evals/rate_limiters.py | 210 | CODE | |
| LOW | packages/phoenix-evals/src/phoenix/evals/executors.py | 198 | CODE | |
| LOW | …enix-client/src/phoenix/client/experiments/__init__.py | 17 | CODE | |
| LOW | …enix-client/src/phoenix/client/experiments/__init__.py | 207 | CODE | |
| LOW | …client/src/phoenix/client/resources/traces/__init__.py | 406 | CODE | |
| LOW | …client/src/phoenix/client/resources/traces/__init__.py | 830 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 177 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 269 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 495 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 668 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 1489 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 1809 | CODE | |
| LOW | …-client/src/phoenix/client/resources/spans/__init__.py | 1981 | CODE | |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 780 | CODE | |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 2281 | CODE | |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 2623 | CODE | |
| LOW | …t/src/phoenix/client/resources/experiments/__init__.py | 4115 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 785 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 953 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 1151 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 1254 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 1711 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 1852 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 2032 | CODE | |
| LOW | …ient/src/phoenix/client/resources/datasets/__init__.py | 2133 | CODE | |
| LOW | …oenix-client/src/phoenix/client/utils/rate_limiters.py | 165 | CODE | |
| LOW | …s/phoenix-client/src/phoenix/client/utils/executors.py | 209 | CODE | |
| LOW | packages/phoenix-otel/src/phoenix/otel/otel.py | 65 | CODE | |
| LOW | src/phoenix/server/oauth2.py | 260 | CODE | |
| LOW | src/phoenix/server/rate_limiters.py | 194 | CODE | |
| LOW | src/phoenix/server/app.py | 639 | CODE | |
| LOW | src/phoenix/server/app.py | 931 | CODE | |
| LOW | src/phoenix/server/agents/vercel_ui_message_stream.py | 613 | CODE | |
| LOW | src/phoenix/server/agents/agent_factory.py | 69 | CODE | |
| LOW | src/phoenix/server/api/context.py | 119 | CODE | |
| LOW | src/phoenix/server/api/routers/auth.py | 212 | CODE | |
| LOW | src/phoenix/server/api/routers/auth.py | 394 | CODE | |
| LOW | src/phoenix/server/api/routers/oauth2.py | 287 | CODE | |
| LOW | src/phoenix/server/api/routers/oauth2.py | 872 | CODE | |
| LOW | src/phoenix/server/api/routers/v1/spans.py | 753 | CODE | |
| LOW | src/phoenix/server/api/routers/v1/spans.py | 992 | CODE | |
| LOW | src/phoenix/server/api/routers/v1/traces.py | 148 | CODE | |
| LOW | src/phoenix/server/api/types/Dataset.py | 222 | CODE | |
| LOW | src/phoenix/server/api/types/Dataset.py | 392 | CODE | |
| LOW | src/phoenix/db/models.py | 1238 | CODE | |
| LOW | src/phoenix/db/models.py | 1249 | CODE | |
| LOW | src/phoenix/db/models.py | 1260 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | js/examples/apps/tracing-tutorial/support-agent.ts | 305 | system: `You are a helpful customer support agent. When customers ask about order status, use the lookupOr | CODE |
| MEDIUM | js/benchmarks/evals-benchmarks/src/refusal.eval.ts | 32 | "I'm sorry, but I'm unable to help with that request. Please contact a plumber for assistance.", | CODE |
| MEDIUM | js/benchmarks/evals-benchmarks/src/refusal.eval.ts | 106 | "I don't have access to internal company communications or meeting transcripts, so I'm unable to answer that.", | CODE |
| MEDIUM | js/benchmarks/evals-benchmarks/src/conciseness.eval.ts | 106 | "It's worth noting that the speed of light in a vacuum is approximately 299,792 kilometers per second. It's impo | CODE |
| MEDIUM | js/benchmarks/evals-benchmarks/src/conciseness.eval.ts | 141 | "As an AI language model, I can tell you that pi (π) is approximately 3.14159. This is a mathematical constant r | CODE |
| LOW | js/benchmarks/evals-benchmarks/src/completeness.eval.ts | 542 | "Don't forget to cc legal@northwind.example on whatever you send Harbor Steel about INV-8891.", | CODE |
| MEDIUM⚡ | …al_docs/vignettes/sqlalchemy/polymorphic_user/users.py | 287 | # This is for demonstration purposes only | COMMENT |
| LOW | examples/llamaindex-workflows-research-agent/report.py | 29 | - Don't forget to add a reference list at the end of the report in {report_format} format and full | STRING |
| MEDIUM | …ix-client/src/phoenix/client/helpers/spans/__init__.py | 287 | # Now you can use these spans with other APIs | STRING |
| MEDIUM | …nfigs/CONCISENESS_CLASSIFICATION_EVALUATOR_CONFIG.yaml | 25 | - Hedging language or excessive qualifiers (e.g., "It's worth noting that...", "It's important to understand that. | CODE |
| MEDIUM | …r_configs/REFUSAL_CLASSIFICATION_EVALUATOR_CONFIG.yaml | 14 | - Explicit refusals (e.g., "I can't help with that", "I'm unable to answer") | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | evals/pxi/harness/backend.py | 43 | CODE | |
| MEDIUM | …agents/pydantic_ai/test_openinference_model_wrapper.py | 101 | CODE | |
| MEDIUM | …agents/pydantic_ai/test_openinference_agent_wrapper.py | 110 | CODE | |
| MEDIUM | …agents/pydantic_ai/test_openinference_agent_wrapper.py | 154 | CODE | |
| MEDIUM | tests/unit/server/mcp/sql/test_execute.py | 214 | CODE | |
| MEDIUM | tests/unit/server/mcp/sql/test_execute.py | 226 | CODE | |
| MEDIUM | tests/unit/server/mcp/sql/test_execute.py | 452 | CODE | |
| MEDIUM | tests/unit/server/api/test_subscriptions.py | 192 | CODE | |
| MEDIUM | …ts/unit/server/api/routers/v1/test_chat_completions.py | 315 | CODE | |
| MEDIUM | src/phoenix/server/daemons/experiment_runner.py | 244 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | README.md | 260 | | [E2B](https://arize.com/docs/phoenix/integrations/sandboxes/e2b) | Hosted micro-VM sandboxes for AI-ge | CODE |
| HIGH | js/benchmarks/evals-benchmarks/src/correctness.eval.ts | 208 | "Airplanes fly due to the interaction of four forces: lift (generated by air flowing over curved wings, creating | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …/components/project/integrationSnippets/phoenixOtel.ts | 15 | def my_function(input: str) -> str: | CODE |
| LOW | tests/integration/_helpers.py | 659 | def handle_request(self, request: httpx.Request) -> httpx.Response: | CODE |
| LOW | examples/agents/traject_bench_langgraph/agent.py | 150 | def run_task(task: TrajectTask, model: str = "gpt-4o") -> TaskResult: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | …/skills/pxi-eval-dataset/scripts/annotate_via_codex.sh | 15 | # Usage: | COMMENT |