microsoft/agent-lightning

Pattern Findings

1822 matches across 20 categories. Click a row to expand file-level details.

Hyper-Verbose Identifiers1078 hits · 954 pts

Severity	File	Line	Snippet
LOW	tests/test_env_var.py	15	def test_resolve_bool_env_var_override_takes_precedence(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_env_var.py	33	def test_resolve_bool_env_var_parses_truthy_and_falsy_values(
LOW	tests/test_env_var.py	42	def test_resolve_bool_env_var_returns_fallback_when_unset(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_env_var.py	49	def test_resolve_bool_env_var_rejects_invalid_value(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_env_var.py	57	def test_resolve_int_env_var_reads_from_environment(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_env_var.py	64	def test_resolve_int_env_var_invalid_input(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_env_var.py	72	def test_resolve_str_env_var_override_and_fallback(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/test_logging.py	167	def _logging_worker_files_string(queue: Queue[Dict[str, Any]], base_dir: str) -> None:
LOW	tests/test_logging.py	207	def _logging_worker_files_mapping(queue: Queue[Dict[str, Any]], base_dir: str) -> None:
LOW	tests/test_logging.py	286	def test_to_level_value_int_and_str() -> None:
LOW	tests/test_logging.py	296	def test_setup_module_plain_console_spawn() -> None:
LOW	tests/test_logging.py	310	def test_setup_module_color_rich_spawn() -> None:
LOW	tests/test_logging.py	323	def test_setup_with_submodules_apply_to_and_capture_warnings_spawn() -> None:
LOW	tests/test_logging.py	343	def test_setup_with_console_and_extra_handler_spawn() -> None:
LOW	tests/test_logging.py	355	def test_setup_files_string_spawn(tmp_path: Path) -> None:
LOW	tests/test_logging.py	383	def test_setup_files_mapping_spawn(tmp_path: Path) -> None:
LOW	tests/test_config.py	185	def test_get_param_type_details(
LOW	tests/test_config.py	226	def test_determine_argparse_type_and_nargs(
LOW	tests/test_config.py	324	def test_add_argument_for_parameter(
LOW	tests/test_config.py	360	def test_add_arguments_for_class(mock_parser: Any) -> None:
LOW	tests/test_config.py	388	def test_add_arguments_for_class_no_init_params(mock_parser: Any) -> None:
LOW	tests/test_config.py	397	def test_create_argument_parser() -> None:
LOW	tests/test_config.py	455	def test_instantiate_classes_error_handling(caplog):
LOW	tests/test_config.py	484	def test_lightning_cli_no_classes():
LOW	tests/test_config.py	489	def test_lightning_cli_simple_config():
LOW	tests/test_config.py	502	def test_lightning_cli_complex_config_types():
LOW	tests/test_config.py	543	def test_lightning_cli_complex_config_defaults():
LOW	tests/test_config.py	560	def test_lightning_cli_multiple_classes():
LOW	tests/test_config.py	587	def test_lightning_cli_missing_required_arg_exits(capsys):
LOW	tests/test_config.py	596	def test_lightning_cli_optional_no_default_behavior():
LOW	tests/test_client.py	70	async def test_uri_and_semantic_correctness(server_setup: Dict[str, Any], sample_resources: NamedResources):
LOW	tests/test_client.py	102	async def test_full_lifecycle_async(
LOW	tests/test_client.py	200	async def test_task_timeout_and_requeue(server_setup: Dict[str, Any]):
LOW	tests/test_client.py	238	async def test_error_handling_no_resources(server_setup: Dict[str, Any]):
LOW	tests/test_client.py	257	async def test_client_with_bad_endpoint():
LOW	tests/test_client.py	274	def test_local_client_core_functionality(sample_resources: NamedResources):
LOW	tests/test_client.py	338	def test_local_client_error_handling(sample_resources: NamedResources):
LOW	tests/test_client.py	369	async def test_local_client_async_methods(sample_resources: NamedResources):
LOW	tests/benchmark/analysis.py	254	def histogram_sum_metric_name(bucket_metric: str) -> str:
LOW	tests/benchmark/analysis.py	260	def histogram_count_metric_name(bucket_metric: str) -> str:
LOW	tests/benchmark/analysis.py	407	def gather_collection_throughput(
LOW	tests/benchmark/analysis.py	747	def render_metric_group_table(
LOW	tests/benchmark/benchmark_store.py	228	async def algorithm_batch_with_completion_threshold(self, total_tasks: int, batch_size: int, remaining_tasks: int):
LOW	tests/benchmark/micro_benchmark.py	123	def simulate_many_update_workers(store_url: str) -> BenchmarkSummary:
LOW	tests/benchmark/micro_benchmark.py	162	def simulate_dequeue_empty_and_update_workers(store_url: str) -> BenchmarkSummary:
LOW	tests/benchmark/micro_benchmark.py	214	def simulate_rollout_with_spans(store_url: str, spans_per_attempt: int = 4) -> BenchmarkSummary:
LOW	tests/benchmark/micro_benchmark.py	349	def dequeue_and_update_attempts(store_url: str, spans_per_attempt: int = 4) -> BenchmarkSummary:
LOW	tests/benchmark/micro_benchmark.py	27	async def _enqueue_rollouts_for_benchmark(store_url: str, *, total_rollouts: int, task_prefix: str) -> None:
LOW	tests/benchmark/micro_benchmark.py	143	def _dequeue_empty_and_update_workers_task(args: tuple[str, str, str]) -> bool:
LOW	tests/benchmark/micro_benchmark.py	273	async def _query_remaining_rollouts() -> List[str]:
LOW	tests/benchmark/micro_benchmark.py	294	def _dequeue_and_update_attempt_task(args: tuple[str, str, str, int]) -> bool:
LOW	tests/benchmark/micro_benchmark.py	381	def benchmark_multi_metrics_backend(iterations: int = 10_000_000) -> BenchmarkSummary:
LOW	tests/tracer/test_dummy.py	18	def test_dummy_tracer_create_span_uses_defaults(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/tracer/test_dummy.py	32	def test_dummy_tracer_operation_context_records_span(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/tracer/test_dummy.py	49	def test_dummy_tracer_operation_context_records_exceptions(monkeypatch: pytest.MonkeyPatch) -> None:
LOW	tests/tracer/test_dummy.py	71	def test_set_active_tracer_returns_same_instance() -> None:
LOW	tests/tracer/test_dummy.py	77	def test_set_active_tracer_raises_when_existing() -> None:
LOW	tests/tracer/test_dummy.py	83	def test_clear_active_tracer_removes_current() -> None:
LOW	tests/tracer/test_agentops.py	134	def test_agentops_tracer_create_span(agentops_tracer: AgentOpsTracer) -> None:
LOW	tests/tracer/test_agentops.py	152	def test_agentops_tracer_operation_context_records_exception(agentops_tracer: AgentOpsTracer) -> None:
1018 more matches not shown…

Docstring Block Structure66 hits · 330 pts

Severity	File	Line	Snippet
HIGH	contrib/recipes/webshop/agl/tasks.py	47	Load tasks from a JSON or Parquet file. Args: path: Path to the tasks file (JSON or Parquet format). R
HIGH	contrib/recipes/envs/add_instruction.py	35	Retrieve an instruction string from INSTRUCTION_MAP based on the given type. Args: type (str): Instruc
HIGH	contrib/recipes/envs/add_instruction.py	88	Append an instruction to a single prompt or a chat-style prompt. - If `prompt` is a string, the instruction is
HIGH	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	261	Compute reference log probability using the correct worker based on LoRA configuration. In verl 0.6.0+, when Lo
HIGH	examples/chartqa/multimodal_utils.py	28	Encode an image to base64 string for multimodal LLM APIs. Args: image: Image source (file path, URL, o
HIGH	examples/chartqa/multimodal_utils.py	87	Create an OpenAI-compatible multimodal message. Args: text: The text prompt/question image: Im
HIGH	examples/claude_code/claude_code_controller.py	186	Runs the agent on a specific SWE-bench instance. This method orchestrates the agent execution via the specified
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	377	Start a Docker container session for repository testing. Args: image_name (str): Base Dock
HIGH	agentlightning/logging.py	19	Create or reset a namespaced logger with a consistent console format. This helper clears any previously attached ha
HIGH	agentlightning/logging.py	109	Configures logging for the `agentlightning` logger hierarchy. This function provides a one-stop setup utility for c
HIGH	agentlightning/llm_proxy.py	84	Extract LiteLLM request payload from hook args. The LiteLLM logger hooks receive `(args, *kwargs)` whose third po
HIGH	agentlightning/llm_proxy.py	1321	Create an `LLM` resource pointing at this proxy with rollout context. The returned endpoint is: `ht
HIGH	agentlightning/tracer/base.py	141	Notify the tracer that a span should be created here. It uses a fire-and-forget approach and doesn't wait for t
HIGH	agentlightning/tracer/base.py	163	Start to record an operation to a span. Args: name: The name of the operation. attribut
HIGH	agentlightning/types/resources.py	111	Return the routed endpoint for a specific rollout/attempt pair. Args: rollout_id: Identifier of the
HIGH	agentlightning/types/tracer.py	390	Build a synthetic span from raw attributes. Different from the [`from_opentelemetry`][agentlightning.Span.from_o
HIGH	agentlightning/emitter/annotation.py	315	Entry point for tracking operations. This helper can be used either as a decorator or as a context manager. The
HIGH	agentlightning/emitter/reward.py	155	Emit a reward value as an OpenTelemetry span. Examples: Emit a single-dimensional reward: >>> emit_
HIGH	agentlightning/runner/agent.py	802	Execute a single task directly, bypassing the task queue. This method creates a new rollout for the given input
HIGH	agentlightning/runner/base.py	165	Execute a single task with the given input. This method provides fine-grained control for executing individual
HIGH	agentlightning/utils/metrics.py	41	Validates label keys against the metric definition. Args: kind: Metric kind for error messages ("counter" o
HIGH	agentlightning/utils/id.py	10	Generate a random hexadecimal ID of the given length. Args: length: The desired length of the generated ID.
HIGH	agentlightning/utils/otel.py	146	Resolve the OpenTelemetry tracer configured for Agent Lightning. Args: use_active_span_processor: Whether t
HIGH	agentlightning/utils/otel.py	291	Filter attributes that start with the given prefix. The attribute must start with `prefix.` or be exactly `prefix`
HIGH	agentlightning/utils/otel.py	306	Filter attributes that start with the given prefix and unflatten them. The prefix will be removed during unflattenin
HIGH	agentlightning/adapter/messages.py	212	Yield tool call payloads for a completion span. Args: completion: The completion span whose descend
HIGH	agentlightning/adapter/triplet.py	227	Construct a tree from a flat list of spans. Args: spans: Spans that collectively form a single trac
HIGH	agentlightning/algorithm/decorator.py	159	Execute the wrapped function with injected dependencies. Args: train_dataset: Optional training dat
HIGH	agentlightning/algorithm/decorator.py	226	Convert a callable into a [`FunctionalAlgorithm`][agentlightning.algorithm.decorator.FunctionalAlgorithm]. The deco
HIGH	agentlightning/algorithm/fast.py	38	Reference implementation that streams the full dataset through the rollout queue. The baseline algorithm batches ta
HIGH	agentlightning/algorithm/apo/apo.py	517	Initialize the beam search with seed prompt and dataset iterators. Args: train_dataset: Da
HIGH	agentlightning/algorithm/apo/apo.py	696	Evaluate all candidate prompts on validation data and select top-k for the beam. Args: can
HIGH	agentlightning/verl/trainer.py	209	Compute reference log probability using the correct worker based on LoRA configuration. In verl 0.6.0+, when Lo
HIGH	agentlightning/litagent/decorator.py	141	Execute a synchronous rollout using the wrapped function. Args: task: Task input data.
HIGH	agentlightning/litagent/decorator.py	161	Execute an asynchronous rollout using the wrapped function. Args: task: Task input data.
HIGH	agentlightning/litagent/decorator.py	207	Retrieve the first LLM resource from the available resources. Strip the ProxyLLM resource into a LLM resource i
HIGH	agentlightning/litagent/decorator.py	238	Retrieve the first prompt template resource from the available resources. Args: resources: Mapping
HIGH	agentlightning/litagent/decorator.py	266	Convert [`ProxyLLM`][agentlightning.ProxyLLM] instances into concrete LLMs. It resolves ProxyLLM instances to t
HIGH	agentlightning/litagent/decorator.py	307	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] for LLM-based rollouts. Args:
HIGH	agentlightning/litagent/decorator.py	353	Validate the function signature of an LLM rollout function. Ensures the function follows the expected pattern for L
HIGH	agentlightning/litagent/decorator.py	394	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] for prompt-based rollouts. Th
HIGH	agentlightning/litagent/decorator.py	435	Validate the function signature of a prompt rollout function. Ensures the function follows the expected pattern for
HIGH	agentlightning/litagent/decorator.py	466	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] from an arbitrary rollout function
HIGH	agentlightning/trainer/init_utils.py	152	Build and return a component instance from a flexible specification. This function provides a flexible way to creat
HIGH	agentlightning/store/base.py	167	Register a rollout and immediately create its first attempt. !!! note Use [`enqueue_rollout()`][age
HIGH	agentlightning/store/base.py	208	Persist a rollout in `queuing` state so runners can claim it later. !!! note Different from [`start
HIGH	agentlightning/store/base.py	251	Claim the oldest queued rollout and transition it to `preparing`. This function do not block. Retrieva
HIGH	agentlightning/store/base.py	301	Create a manual retry attempt for an existing rollout. This is typically invoked by runners that wish to retry
HIGH	agentlightning/store/base.py	331	Persist a pre-constructed span emitted during rollout execution. The provided [`Span`][agentlightning.Span] mus
HIGH	agentlightning/store/base.py	362	Convert and persist an OpenTelemetry span for a particular attempt. Implementations must transform the `readabl
HIGH	agentlightning/store/base.py	401	Retrieve rollouts filtered by status and/or explicit identifiers. This interface supports structured filtering,
HIGH	agentlightning/store/base.py	442	Return every attempt ever created for `rollout_id` in ascending sequence order. The parameters allow callers to
HIGH	agentlightning/store/base.py	466	Fetch a rollout by identifier without mutating its state. Args: rollout_id: Identifier to retrieve.
HIGH	agentlightning/store/base.py	480	Fetch the attempt with the highest `sequence_id` for `rollout_id`. Args: rollout_id: Identifier to
HIGH	agentlightning/store/base.py	505	List every stored resource snapshot in insertion order. Supports lightweight filtering, sorting, and pagination
HIGH	agentlightning/store/base.py	530	Return a specific named resource snapshot by identifier. Args: resources_id: Identifier of the snap
HIGH	agentlightning/store/base.py	556	Allocate the next strictly increasing sequence number used to order spans. Implementations must retain counters
HIGH	agentlightning/store/base.py	594	Block until the targeted rollouts reach a terminal status or the timeout expires. Terminal statuses are `"succe
HIGH	agentlightning/store/base.py	641	Return the stored spans for a rollout, optionally scoped to one attempt. Supports a handful of filters that cov
HIGH	agentlightning/store/base.py	682	Persist a new immutable snapshot of named resources and mark it as latest. Implementations must assign a fresh
6 more matches not shown…

Unused Imports229 hits · 224 pts

Severity	File	Line
LOW	tests/test_env_var.py	3
LOW	tests/test_logging.py	3
LOW	tests/test_config.py	16
LOW	tests/test_config.py	17
LOW	tests/benchmark/analysis.py	5
LOW	tests/benchmark/collection_benchmark.py	5
LOW	tests/benchmark/micro_benchmark.py	5
LOW	tests/tracer/test_dummy.py	3
LOW	tests/tracer/test_agentops.py	3
LOW	tests/tracer/test_weave.py	3
LOW	tests/tracer/test_otel.py	5
LOW	tests/emitter/test_message.py	3
LOW	tests/emitter/test_exception.py	3
LOW	tests/emitter/test_object.py	3
LOW	tests/emitter/test_annotation.py	3
LOW	tests/emitter/test_operation.py	3
LOW	tests/llm_proxy/test_stream.py	3
LOW	tests/utils/test_otlp.py	5
LOW	tests/utils/test_system_snapshot.py	3
LOW	tests/utils/test_metrics.py	5
LOW	tests/utils/test_server_launcher.py	3
LOW	tests/utils/test_otel.py	3
LOW	tests/algorithm/test_utils.py	3
LOW	tests/common/prometheus_stub.py	3
LOW	tests/common/tracer.py	3
LOW	tests/execution/test_client_server.py	3
LOW	tests/trainer/test_trainer_init.py	3
LOW	tests/trainer/test_trainer_dev.py	5
LOW	tests/trainer/sample_components.py	3
LOW	tests/store/conftest.py	3
LOW	tests/store/test_collection.py	3
LOW	docs/macros/source_links.py	3
LOW	contrib/recipes/search_r1/search_r1_agent.py	3
LOW	contrib/recipes/search_r1/train_search_r1_agent.py	4
LOW	contrib/recipes/agentos/demo_governed_training.py	23
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	14
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	19
LOW	contrib/recipes/webshop/server/webshop_server.py	71
LOW	contrib/recipes/webshop/agl/tasks.py	17
LOW	contrib/recipes/webshop/agl/config.py	16
LOW	contrib/recipes/webshop/agl/generate_tasks.py	26
LOW	contrib/recipes/webshop/agl/run_training.py	39
LOW	contrib/recipes/envs/prompt_builder.py	3
LOW	contrib/recipes/envs/empo2_server/server_bert.py	4
LOW	contrib/recipes/envs/empo2_server/server_bert.py	9
LOW	contrib/agentlightning/contrib/runner/agentos.py	10
LOW	contrib/agentlightning/contrib/agent/env_agent.py	3
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	3
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	5
LOW	contrib/agentlightning/contrib/adapter/agentos.py	10
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	5
LOW	contrib/agentlightning/contrib/reward/agentos.py	10
LOW	examples/chartqa/chartqa_agent.py	17
LOW	examples/chartqa/debug_chartqa_agent.py	26
LOW	examples/chartqa/multimodal_utils.py	10
LOW	examples/chartqa/train_chartqa_agent.py	20
LOW	examples/tinker/hello.py	35
LOW	examples/tinker/q20_agent.py	13
LOW	examples/tinker/q20_evaluate.py	33
LOW	examples/tinker/q20_train.py	33
169 more matches not shown…

Decorative Section Separators56 hits · 204 pts

Severity	File	Line	Snippet
MEDIUM	tests/execution/test_client_server.py	151	# =========================
MEDIUM	tests/execution/test_client_server.py	153	# =========================
MEDIUM	tests/execution/test_client_server.py	291	# =========================
MEDIUM	tests/execution/test_client_server.py	293	# =========================
MEDIUM	tests/execution/test_client_server.py	423	# =========================
MEDIUM	tests/execution/test_client_server.py	425	# =========================
MEDIUM	tests/execution/test_client_server.py	665	# =========================
MEDIUM	tests/execution/test_client_server.py	667	# =========================
MEDIUM	tests/execution/test_client_server.py	886	# =========================
MEDIUM	tests/execution/test_client_server.py	888	# =========================
MEDIUM	tests/execution/test_client_server.py	28	# =========================
MEDIUM	tests/execution/test_client_server.py	30	# =========================
MEDIUM	tests/execution/test_client_server.py	67	# =========================
MEDIUM	tests/execution/test_client_server.py	69	# =========================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	94	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	96	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	140	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	142	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	154	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	156	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	173	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	175	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	181	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	183	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	210	# ==============================================================================
MEDIUM	contrib/recipes/webshop/scripts/run_stack.sh	212	# ==============================================================================
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	1	# ==========================
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	3	# ==========================
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	16	# ==========================
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	18	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	1	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	3	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	16	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	18	# ==========================
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	1	# ==========================
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	3	# ==========================
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	19	# ==========================
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	21	# ==========================
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	1	# ==========================
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	3	# ==========================
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	18	# ==========================
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	20	# ==========================
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	1	# ==========================
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	3	# ==========================
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	17	# ==========================
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	19	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	1	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	3	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	17	# ==========================
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	19	# ==========================
MEDIUM	agentlightning/tracer/otel.py	408	# ---------------------------------------------------------------------------
MEDIUM	agentlightning/tracer/otel.py	427	# ---------------------------------------------------------------------------
MEDIUM	agentlightning/instrumentation/weave.py	309	# ==========================================
MEDIUM	agentlightning/instrumentation/weave.py	311	# ==========================================
MEDIUM	agentlightning/store/collection/memory.py	243	# -------------------------------------------------------------------------
MEDIUM	agentlightning/store/collection/memory.py	245	# -------------------------------------------------------------------------

Excessive Try-Catch Wrapping163 hits · 178 pts

Severity	File	Line	Snippet
LOW	tests/benchmark/collection_benchmark.py	410	except Exception as exc:
LOW	tests/benchmark/collection_benchmark.py	439	except Exception:
LOW	tests/benchmark/collection_benchmark.py	464	except Exception:
MEDIUM	tests/benchmark/micro_benchmark.py	117	console.print(f"Error updating worker {worker_id} for task {task_id}: {e}")
MEDIUM	tests/benchmark/micro_benchmark.py	156	console.print(f"Error dequeueing empty and updating worker {worker_id} for task {task_id}: {e}")
MEDIUM	tests/benchmark/micro_benchmark.py	208	console.print(f"Error running rollout task {task_id}: {e}")
MEDIUM	tests/benchmark/micro_benchmark.py	343	console.print(f"Error dequeueing and updating worker {worker_id} for task {task_id}: {e}")
MEDIUM	tests/benchmark/micro_benchmark.py	248	console.print(f"Error dequeueing only worker {worker_id} for task {task_id}: {e}")
LOW	tests/benchmark/micro_benchmark.py	116	except Exception as e:
LOW	tests/benchmark/micro_benchmark.py	155	except Exception as e:
LOW	tests/benchmark/micro_benchmark.py	207	except Exception as e:
LOW	tests/benchmark/micro_benchmark.py	342	except Exception as e:
LOW	tests/benchmark/micro_benchmark.py	42	except Exception:
LOW	tests/benchmark/micro_benchmark.py	247	except Exception as e:
LOW	tests/tracer/test_integration.py	121	except Exception:
LOW	tests/tracer/test_otel.py	416	except Exception as e:
LOW	tests/tracer/test_otel.py	568	except Exception as exc: # pragma: no cover - defensive path
LOW	tests/tracer/test_otel.py	571	except Exception:
LOW	tests/llm_proxy/test_stream.py	65	except Exception:
LOW	tests/llm_proxy/test_stream.py	100	except Exception:
LOW	tests/llm_proxy/test_stream.py	121	except Exception:
LOW	tests/llm_proxy/test_stream.py	143	except Exception:
LOW	tests/llm_proxy/test_stream.py	156	except Exception:
LOW	tests/llm_proxy/test_stream.py	169	except Exception:
LOW	tests/utils/test_system_snapshot.py	120	except Exception:
LOW	tests/utils/test_server_launcher.py	114	except Exception as exc: # server may not be up yet
LOW	tests/common/vllm.py	148	except Exception:
LOW	tests/store/conftest.py	204	except Exception as exc: # depends on external service
LOW	tests/store/test_client_server.py	1212	except Exception as e:
LOW	docs/tutorials/debug.md	215	except Exception:
LOW	contrib/recipes/search_r1/retrieval_server.py	222	except Exception: # pragma: no cover - typing convenience
LOW	contrib/recipes/search_r1/retrieval_server.py	236	except Exception:
LOW	contrib/recipes/search_r1/search_r1_agent.py	175	except Exception as e:
LOW	contrib/recipes/agentos/demo_governed_training.py	110	except Exception:
LOW	contrib/recipes/webshop/server/webshop_server.py	206	except Exception as e:
LOW	contrib/recipes/webshop/server/webshop_server.py	262	except Exception as e:
LOW	contrib/recipes/webshop/server/webshop_server.py	313	except Exception as e:
LOW	contrib/agentlightning/contrib/agent/env_agent.py	115	except Exception as e:
LOW	contrib/agentlightning/contrib/agent/empo2_agent.py	164	except Exception as e:
LOW	contrib/agentlightning/contrib/adapter/agentos.py	112	except Exception as e:
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	457	except Exception as e:
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	571	except Exception as e:
MEDIUM	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	572	print(f"Error while waiting for tasks to finish: {e}")
LOW	examples/calc_x/legacy_calc_agent.py	77	except Exception as e:
LOW	examples/calc_x/eval_utils.py	57	except Exception:
LOW	examples/calc_x/calc_agent.py	100	except Exception as e:
LOW	examples/chartqa/chartqa_agent.py	125	except Exception as e:
LOW	examples/chartqa/chartqa_agent.py	166	except Exception as e:
LOW	examples/chartqa/chartqa_agent.py	370	except Exception as e:
LOW	examples/chartqa/chartqa_agent.py	406	except Exception as e:
LOW	examples/tinker/q20_agent.py	288	except Exception as e:
LOW	examples/tinker/q20_evaluate.py	170	except Exception as e:
LOW	examples/tinker/q20_train.py	121	except Exception:
MEDIUM	examples/tinker/q20_train.py	122	console.print(f"Error in q20_agent: {traceback.format_exc()}")
LOW	examples/claude_code/claude_code_agent.py	188	except Exception as e:
LOW	examples/claude_code/claude_code_agent.py	302	except Exception as e:
LOW	examples/claude_code/claude_code_agent.py	416	except Exception as e:
LOW	examples/claude_code/swebench_utils/evaluation.py	217	except Exception as e:
LOW	examples/claude_code/swebench_utils/docker_runtime.py	207	except Exception as e:
LOW	examples/claude_code/swebench_utils/docker_runtime.py	346	except Exception as e:
103 more matches not shown…

Self-Referential Comments47 hits · 160 pts

Severity	File	Line	Snippet
MEDIUM	tests/test_client.py	169	# Define the synchronous client workflow
MEDIUM	tests/tracer/test_integration.py	398	# Create a team with the primary and critic agents.
MEDIUM	tests/tracer/test_otel.py	442	# Create a slow async function that exceeds timeout
MEDIUM	tests/runner/test_agent_runner.py	776	# Create an attempted rollout
MEDIUM	tests/runner/test_agent_runner.py	803	# Create an attempted rollout with invalid resources_id
MEDIUM	tests/llm_proxy/test_stream.py	401	# Create a synthetic long content split into ~20-40 char pieces as the merger would see
MEDIUM	tests/algorithm/test_baseline.py	178	# Create a dataset with 5 samples
MEDIUM	tests/litagent/test_decorator.py	168	# Create a ProxyLLM resource
MEDIUM	tests/litagent/test_decorator.py	174	# Create an AttemptedRollout
MEDIUM	tests/litagent/test_decorator.py	204	# Create a ProxyLLM resource
MEDIUM	tests/litagent/test_decorator.py	210	# Create an AttemptedRollout
MEDIUM	tests/litagent/test_decorator.py	239	# Create a ProxyLLM resource
MEDIUM	tests/litagent/test_decorator.py	245	# Create an AttemptedRollout
MEDIUM	tests/litagent/test_decorator.py	329	# Create a rollout object
MEDIUM	tests/litagent/test_decorator.py	402	# Create a rollout object
MEDIUM	tests/litagent/test_decorator.py	435	# Create a rollout object
MEDIUM	tests/store/test_utils.py	80	# Create a valid attempt first, then modify its status
MEDIUM	tests/store/test_utils.py	258	# Create a valid attempt first, then set it to None
MEDIUM	tests/store/test_core.py	2564	# Create a valid attempt to ensure rollout exists in store
MEDIUM	tests/store/test_core.py	446	# Create a rollout
MEDIUM	tests/store/test_core.py	2096	# Create the first attempt
MEDIUM	tests/store/test_core.py	2810	# Create a rollout
MEDIUM	tests/store/test_core.py	2831	# Create a rollout and dequeue to create first attempt
MEDIUM	tests/store/test_core.py	2494	rollout = await store_fixture.dequeue_rollout() # Create an attempt
MEDIUM	contrib/recipes/webshop/server/webshop_server.py	308	# Create a test session to trigger loading
MEDIUM	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	109	# This function is adapted from verl.
MEDIUM	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	512	# Create the Rollout object (without trace and logs as per user's note)
MEDIUM	examples/claude_code/swebench_utils/docker_runtime.py	109	# Create a copy of metadata to avoid modifying the original
MEDIUM	examples/minimal/llm_proxy.py	41	# Create a store to store the traces
MEDIUM	examples/minimal/llm_proxy.py	46	# Create a vLLM server
MEDIUM	examples/minimal/llm_proxy.py	51	# Create an LLM proxy to guard the vLLM server and catch the traces
MEDIUM	examples/minimal/llm_proxy.py	80	# Create a store to store the traces
MEDIUM	examples/minimal/llm_proxy.py	88	# Create an LLM proxy to guard the OpenAI server and catch the traces
MEDIUM	examples/unsloth/sft_algorithm.py	360	# Create the LLM proxy for rollout worker access and trace data collection
MEDIUM	.github/workflows/pypi-nightly.yml	46	# Create a dev version with timestamp
MEDIUM	agentlightning/llm_proxy.py	675	# Creating a new request won't work because request is cached in the base class
MEDIUM	agentlightning/tracer/weave.py	366	# Create a new trace call object in Weave
MEDIUM	agentlightning/runner/legacy.py	142	# Create the RolloutLegacy object with standardized fields
MEDIUM	agentlightning/utils/server_launcher.py	423	# Create the arbiter up-front so the watchdog can inspect it.
MEDIUM	agentlightning/adapter/triplet.py	290	# Create a virtual root span if multiple root spans are found
MEDIUM	agentlightning/verl/trainer.py	57	# This function is adapted from verl.
MEDIUM	agentlightning/verl/daemon.py	659	# Create the Rollout object (without trace and logs as per user's note)
MEDIUM	agentlightning/store/collection_based.py	198	# The following methods should live inside one lock.
MEDIUM	agentlightning/store/collection_based.py	429	# Create the initial attempt
MEDIUM	agentlightning/store/collection_based.py	596	# Create a new attempt (could be first attempt or retry)
MEDIUM	agentlightning/store/collection/mongo.py	301	# Create a new client for this loop.
MEDIUM	agentlightning/store/collection/mongo.py	318	# Create a new collection for this loop.

Deep Nesting98 hits · 94 pts

Severity	File	Line
LOW	tests/test_logging.py	23
LOW	tests/benchmark/benchmark_store.py	89
LOW	tests/benchmark/benchmark_store.py	91
LOW	tests/benchmark/benchmark_store.py	169
LOW	tests/benchmark/benchmark_store.py	285
LOW	tests/benchmark/benchmark_store.py	307
LOW	tests/benchmark/micro_benchmark.py	435
LOW	tests/tracer/test_agentops.py	166
LOW	tests/tracer/test_integration.py	738
LOW	tests/tracer/test_integration.py	113
LOW	tests/llm_proxy/test_llm_proxy_cpu.py	301
LOW	tests/llm_proxy/test_llm_proxy_gpu.py	403
LOW	tests/llm_proxy/test_llm_proxy_gpu.py	511
LOW	tests/llm_proxy/test_stream.py	13
LOW	tests/llm_proxy/test_stream.py	71
LOW	tests/utils/test_otlp.py	85
LOW	contrib/agentlightning/contrib/agent/env_agent.py	49
LOW	contrib/agentlightning/contrib/agent/env_agent.py	68
LOW	contrib/agentlightning/contrib/agent/empo2_agent.py	73
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	29
LOW	contrib/agentlightning/contrib/adapter/agentos.py	94
LOW	…gentlightning/contrib/algorithm/env_verl/core_empo2.py	14
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	291
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	538
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	461
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	660
LOW	examples/calc_x/train_calc_agent.py	110
LOW	examples/chartqa/chartqa_agent.py	295
LOW	examples/tinker/q20_evaluate.py	53
LOW	examples/tinker/agl_tinker/train.py	111
LOW	examples/azure/aoai_finetune.py	590
LOW	examples/claude_code/claude_code_agent.py	230
LOW	examples/claude_code/claude_code_agent.py	312
LOW	examples/claude_code/extended_adapter.py	30
LOW	examples/claude_code/extended_adapter.py	63
LOW	examples/minimal/vllm_server.py	18
LOW	examples/spider/sql_agent.py	346
LOW	examples/spider/spider_eval/evaluation.py	533
LOW	examples/spider/spider_eval/process_sql.py	276
LOW	examples/spider/spider_eval/exec_eval.py	65
LOW	examples/spider/spider_eval/exec_eval.py	187
LOW	examples/unsloth/sft_algorithm.py	61
LOW	examples/unsloth/sft_algorithm.py	135
LOW	scripts/wandb_download_result.py	171
LOW	agentlightning/config.py	118
LOW	agentlightning/llm_proxy.py	722
LOW	agentlightning/llm_proxy.py	1314
LOW	agentlightning/tracer/agentops.py	142
LOW	agentlightning/tracer/otel.py	250
LOW	agentlightning/tracer/otel.py	472
LOW	agentlightning/types/resources.py	80
LOW	agentlightning/emitter/annotation.py	187
LOW	agentlightning/emitter/annotation.py	209
LOW	agentlightning/emitter/object.py	87
LOW	agentlightning/emitter/reward.py	148
LOW	agentlightning/emitter/reward.py	213
LOW	agentlightning/runner/agent.py	270
LOW	agentlightning/runner/agent.py	484
LOW	agentlightning/runner/agent.py	737
LOW	agentlightning/runner/agent.py	526
38 more matches not shown…

Hallucination Indicators4 hits · 40 pts

Severity	File	Line	Snippet
CRITICAL	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	559	model = "/".join(self.config.actor_rollout_ref.model.path.split("/")[-2:])
CRITICAL	agentlightning/verl/trainer.py	260	if self.config.agentlightning.trace_aggregator.level.startswith("trajectory")
CRITICAL	agentlightning/verl/trainer.py	265	if self.config.agentlightning.trace_aggregator.level.startswith("trajectory")
CRITICAL	agentlightning/verl/trainer.py	459	model = "/".join(self.config.actor_rollout_ref.model.path.split("/")[-2:])

Redundant / Tautological Comments24 hits · 38 pts

Severity	File	Line	Snippet
LOW	tests/test_config.py	375	# Check if mock_add_param_func was called with these specific arguments
LOW	tests/utils/test_server_launcher.py	211	# Check if the port is still occupied.
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	152	# Check if reward was associated with any triplet
LOW	…gentlightning/contrib/algorithm/env_verl/core_empo2.py	23	# Check if the start pattern matches at the current position
LOW	examples/chartqa/chartqa_agent.py	317	# Check if the graph is already built
LOW	examples/claude_code/swebench_utils/evaluation.py	190	# Check if git diff changed after running eval script
LOW	scripts/bump_version.sh	8	# Check if version argument is provided
LOW	scripts/bump_version.sh	30	# Check if pyproject.toml exists
LOW	agentlightning/config.py	110	# Check if the (potentially unwrapped) type is a List
LOW	agentlightning/config.py	146	# Check if the list item itself is, e.g., Optional[str] or bool
LOW	agentlightning/llm_proxy.py	612	# Check if it's a chat completions or messages endpoint
LOW	agentlightning/llm_proxy.py	632	# Check if streaming is requested
LOW	agentlightning/llm_proxy.py	1424	# Check if tracer provider is malformed due to global tracer clear in tests.
LOW	agentlightning/client.py	325	# Check if tasks are mixture of TaskInput and Task
LOW	agentlightning/types/resources.py	82	# Check if we're accessing endpoint after initialization and not from base_url
LOW	agentlightning/emitter/reward.py	94	# Check if the function is async
LOW	agentlightning/utils/server_launcher.py	482	# Check if the server is healthy.
LOW	agentlightning/utils/otel.py	443	# Check if keys are all numeric strings
LOW	agentlightning/verl/daemon.py	274	# Check if model requires multimodal position_ids (e.g., Qwen2-VL)
LOW	agentlightning/litagent/decorator.py	517	# Check if it matches the LLM rollout API pattern
LOW	agentlightning/store/collection_based.py	189	# Check if healthcheck is already running to prevent recursion
LOW	agentlightning/store/collection_based.py	194	# Set flag to prevent recursive healthcheck calls
LOW	agentlightning/store/collection_based.py	593	# Check if rollout is still in a queuing state
LOW	agentlightning/store/utils.py	75	# Check if this status should trigger a retry

Cross-File Repetition7 hits · 35 pts

Severity	File	Snippet
HIGH	tests/tracer/test_agentops.py	function that always executed successfully to test success tracing.
HIGH	tests/tracer/test_weave.py	function that always executed successfully to test success tracing.
HIGH	tests/tracer/test_weave.py	function that always executed successfully to test success tracing.
HIGH	tests/tracer/test_weave.py	function that always executed successfully to test success tracing.
HIGH	agentlightning/types/tracer.py	mapping from attribute names to their values. same as opentelemetry `attributes` type.
HIGH	agentlightning/types/tracer.py	mapping from attribute names to their values. same as opentelemetry `attributes` type.
HIGH	agentlightning/types/tracer.py	mapping from attribute names to their values. same as opentelemetry `attributes` type.

Cross-Language Confusion5 hits · 22 pts

Severity	File	Line	Snippet
HIGH	examples/claude_code/claude_code_controller.py	152	if ! command -v python3 &> /dev/null; then
HIGH	examples/claude_code/claude_code_controller.py	154	sudo apt-get update -qq && sudo apt-get install -y -qq python3.12
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	188	"py_interpreter_path": r'$(which python 2>/dev/null \|\| echo "")',
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	194	self.send_command("apt update -qq && apt install -y -qq git")
HIGH	agentlightning/utils/otel.py	474	# This include null, dict, etc.

AI Slop Vocabulary9 hits · 21 pts

Severity	File	Line	Snippet
MEDIUM	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	647	# This exit logic is to ensure a robust CI.
MEDIUM	examples/tinker/agl_tinker/llm.py	188	# NOTE(yuge): I thought about adding this to make it more robust to empty responses,
MEDIUM	scripts/wandb_download_result.py	82	# We fetch all runs in the project once, then pick matching ones to be robust across filters/backends.
MEDIUM	agentlightning/logging.py	192	# TODO: More comprehensive Windows support may be needed in the future.
LOW	agentlightning/llm_proxy.py	635	# Simple case: no streaming requested, just return the response
MEDIUM	agentlightning/verl/trainer.py	542	# This exit logic is to ensure a robust CI.
LOW	agentlightning/store/client_server.py	479	# If not API request, just pass through
LOW	agentlightning/store/client_server.py	1016	# If the store is zero-copy, we can just call the method directly.
LOW	agentlightning/store/client_server.py	1026	# If it's already thread-safe, we can just call the method directly.

Verbosity Indicators6 hits · 14 pts

Severity	File	Line	Snippet
LOW	contrib/recipes/webshop/scripts/run_stack.sh	95	# Step 1: Initialize WebShop Data (if needed)
LOW	contrib/recipes/webshop/scripts/run_stack.sh	141	# Step 2: Start WebShop Server
LOW	contrib/recipes/webshop/scripts/run_stack.sh	155	# Step 3: Start Agent Lightning Coordinator
LOW	contrib/recipes/webshop/scripts/run_stack.sh	174	# Step 4: Wait for Services
LOW	contrib/recipes/webshop/scripts/run_stack.sh	182	# Step 5: Build and Start Runners
LOW	contrib/recipes/webshop/scripts/run_stack.sh	211	# Step 6: Wait for Training to Complete

Over-Commented Block14 hits · 13 pts

Severity	File	Line	Snippet
LOW	contrib/recipes/search_r1/qa_em.py	1	# Copyright (c) Microsoft. All rights reserved.
LOW	contrib/recipes/webshop/aml/run_webshop_aml.sh	1	#!/usr/bin/env bash
LOW	contrib/recipes/webshop/scripts/run_stack.sh	1	#!/usr/bin/env bash
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	481	"""
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	721	#
LOW	examples/rag/metric_utils.py	161	# # search acc
LOW	examples/spider/spider_eval/evaluation.py	1	# Copyright (c) Microsoft. All rights reserved.
LOW	examples/spider/spider_eval/process_sql.py	1	# Copyright (c) Microsoft. All rights reserved.
LOW	examples/spider/spider_eval/exec_eval.py	181	# db is the database path
LOW	examples/unsloth/sft_algorithm.py	221	console.print(
LOW	agentlightning/tracer/otel.py	401	def _await_in_loop(self, coro: Awaitable[Any], timeout: Optional[float] = None) -> Any:
LOW	agentlightning/verl/daemon.py	421	if resp.status_code == 200:
LOW	agentlightning/store/client_server.py	1021	if method_name == "wait_for_rollouts":
LOW	agentlightning/store/client_server.py	1421	self._request_timeout = state["_request_timeout"]

Magic Placeholder Names3 hits · 12 pts

Severity	File	Line	Snippet
HIGH	docs/how-to/train-sql-agent.md	370	export OPENAI_API_KEY=<your_api_key>
HIGH	examples/chartqa/README.md	60	export OPENAI_API_KEY=<your-api-key>
HIGH	examples/unsloth/math_agent.py	8	export OPENAI_API_KEY=your_api_key

Example Usage Blocks4 hits · 6 pts

Severity	File	Line	Snippet
LOW	tests/benchmark/utils.py	123	# Example usage
LOW	contrib/recipes/webshop/aml/run_webshop_aml.sh	9	# Usage:
LOW	contrib/recipes/webshop/aml/compute.yml	6	# Usage:
LOW	contrib/recipes/webshop/scripts/run_stack.sh	8	# Usage:

Slop Phrases2 hits · 6 pts

Severity	File	Line	Snippet
MEDIUM	tests/trainer/test_trainer_init.py	66	# By default, strategy is client-server, but you can also use a string alias to specify it again
MEDIUM	examples/apo/apo_debug.py	28	# If you don't need any tracing functionality yet, you can use a dummy OtelTracer.

Synthetic Comment Markers1 hit · 5 pts

Severity	File	Line	Snippet
HIGH	RAI_README.md	44	Outputs generated by AI may include factual errors, fabrication, or speculation. Users are responsible for assessing the

Fake / Example Data4 hits · 4 pts

Severity	File	Line	Snippet
LOW	docs/tutorials/emitter.md	63	"name": "John Doe",
LOW	docs/tutorials/emitter.md	79	'agentlightning.object.json': '{"name": "John Doe", "age": 30, "email": "john.doe@example.com"}',
LOW	dashboard/src/pages/Rollouts.page.story.tsx	544	const veryLongInput = `{"prompt":"${'Lorem ipsum dolor sit amet, consectetur adipiscing elit. '.repeat(12)}"}`;
LOW	dashboard/src/pages/Rollouts.page.story.tsx	544	const veryLongInput = `{"prompt":"${'Lorem ipsum dolor sit amet, consectetur adipiscing elit. '.repeat(12)}"}`;

Overly Generic Function Names2 hits · 2 pts

Severity	File	Line	Snippet
LOW	dashboard/static/mockServiceWorker.js	123	async function handleRequest(event, requestId, requestInterceptedAt) {
LOW	examples/calc_x/tests/test_agentops.py	10	def process_data(data: str) -> float:

Score History

Severity Breakdown

Pattern Findings