microsoft/agent-lightning

17.3

Adjusted Score

17.3

Raw Score

100%

Time Factor

2026-04-29

Last Push

17.4K

Stars

Python

Language

144.3K

Lines of Code

527

Files

2.0K

Pattern Hits

2026-07-14

Scan Date

0.15

HC Hit Rate

What These Metrics Mean

Adjusted Score: Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score: The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor: The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits: Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate: High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files: Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 4HIGH 75MEDIUM 123LOW 1782

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 1984 distinct pattern matches across 24 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers1078 hits · 952 pts

Severity	File	Line	Snippet	Context
LOW	tests/test_env_var.py	15	def test_resolve_bool_env_var_override_takes_precedence(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/test_env_var.py	33	def test_resolve_bool_env_var_parses_truthy_and_falsy_values(	CODE
LOW⚡	tests/test_env_var.py	42	def test_resolve_bool_env_var_returns_fallback_when_unset(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/test_env_var.py	49	def test_resolve_bool_env_var_rejects_invalid_value(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/test_env_var.py	57	def test_resolve_int_env_var_reads_from_environment(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/test_env_var.py	64	def test_resolve_int_env_var_invalid_input(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/test_env_var.py	72	def test_resolve_str_env_var_override_and_fallback(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW	tests/test_logging.py	167	def _logging_worker_files_string(queue: Queue[Dict[str, Any]], base_dir: str) -> None:	CODE
LOW	tests/test_logging.py	207	def _logging_worker_files_mapping(queue: Queue[Dict[str, Any]], base_dir: str) -> None:	CODE
LOW	tests/test_logging.py	286	def test_to_level_value_int_and_str() -> None:	CODE
LOW	tests/test_logging.py	296	def test_setup_module_plain_console_spawn() -> None:	CODE
LOW	tests/test_logging.py	310	def test_setup_module_color_rich_spawn() -> None:	CODE
LOW	tests/test_logging.py	323	def test_setup_with_submodules_apply_to_and_capture_warnings_spawn() -> None:	CODE
LOW	tests/test_logging.py	343	def test_setup_with_console_and_extra_handler_spawn() -> None:	CODE
LOW	tests/test_logging.py	355	def test_setup_files_string_spawn(tmp_path: Path) -> None:	CODE
LOW	tests/test_logging.py	383	def test_setup_files_mapping_spawn(tmp_path: Path) -> None:	CODE
LOW	tests/test_config.py	185	def test_get_param_type_details(	CODE
LOW	tests/test_config.py	226	def test_determine_argparse_type_and_nargs(	CODE
LOW	tests/test_config.py	324	def test_add_argument_for_parameter(	CODE
LOW	tests/test_config.py	360	def test_add_arguments_for_class(mock_parser: Any) -> None:	CODE
LOW	tests/test_config.py	388	def test_add_arguments_for_class_no_init_params(mock_parser: Any) -> None:	CODE
LOW	tests/test_config.py	397	def test_create_argument_parser() -> None:	CODE
LOW	tests/test_config.py	455	def test_instantiate_classes_error_handling(caplog):	CODE
LOW	tests/test_config.py	484	def test_lightning_cli_no_classes():	CODE
LOW	tests/test_config.py	489	def test_lightning_cli_simple_config():	CODE
LOW	tests/test_config.py	502	def test_lightning_cli_complex_config_types():	CODE
LOW	tests/test_config.py	543	def test_lightning_cli_complex_config_defaults():	CODE
LOW	tests/test_config.py	560	def test_lightning_cli_multiple_classes():	CODE
LOW	tests/test_config.py	587	def test_lightning_cli_missing_required_arg_exits(capsys):	CODE
LOW	tests/test_config.py	596	def test_lightning_cli_optional_no_default_behavior():	CODE
LOW	tests/test_client.py	70	async def test_uri_and_semantic_correctness(server_setup: Dict[str, Any], sample_resources: NamedResources):	CODE
LOW	tests/test_client.py	102	async def test_full_lifecycle_async(	CODE
LOW	tests/test_client.py	200	async def test_task_timeout_and_requeue(server_setup: Dict[str, Any]):	CODE
LOW	tests/test_client.py	238	async def test_error_handling_no_resources(server_setup: Dict[str, Any]):	CODE
LOW	tests/test_client.py	257	async def test_client_with_bad_endpoint():	CODE
LOW	tests/test_client.py	274	def test_local_client_core_functionality(sample_resources: NamedResources):	CODE
LOW	tests/test_client.py	338	def test_local_client_error_handling(sample_resources: NamedResources):	CODE
LOW	tests/test_client.py	369	async def test_local_client_async_methods(sample_resources: NamedResources):	CODE
LOW	tests/benchmark/analysis.py	254	def histogram_sum_metric_name(bucket_metric: str) -> str:	CODE
LOW	tests/benchmark/analysis.py	260	def histogram_count_metric_name(bucket_metric: str) -> str:	CODE
LOW	tests/benchmark/analysis.py	407	def gather_collection_throughput(	CODE
LOW	tests/benchmark/analysis.py	747	def render_metric_group_table(	CODE
LOW	tests/benchmark/benchmark_store.py	228	async def algorithm_batch_with_completion_threshold(self, total_tasks: int, batch_size: int, remaining_tasks: int):	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	123	def simulate_many_update_workers(store_url: str) -> BenchmarkSummary:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	162	def simulate_dequeue_empty_and_update_workers(store_url: str) -> BenchmarkSummary:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	214	def simulate_rollout_with_spans(store_url: str, spans_per_attempt: int = 4) -> BenchmarkSummary:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	349	def dequeue_and_update_attempts(store_url: str, spans_per_attempt: int = 4) -> BenchmarkSummary:	CODE
LOW	tests/benchmark/micro_benchmark.py	27	async def _enqueue_rollouts_for_benchmark(store_url: str, *, total_rollouts: int, task_prefix: str) -> None:	CODE
LOW	tests/benchmark/micro_benchmark.py	143	def _dequeue_empty_and_update_workers_task(args: tuple[str, str, str]) -> bool:	CODE
LOW	tests/benchmark/micro_benchmark.py	273	async def _query_remaining_rollouts() -> List[str]:	CODE
LOW	tests/benchmark/micro_benchmark.py	294	def _dequeue_and_update_attempt_task(args: tuple[str, str, str, int]) -> bool:	CODE
LOW	tests/benchmark/micro_benchmark.py	381	def benchmark_multi_metrics_backend(iterations: int = 10_000_000) -> BenchmarkSummary:	CODE
LOW	tests/tracer/test_dummy.py	18	def test_dummy_tracer_create_span_uses_defaults(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW	tests/tracer/test_dummy.py	32	def test_dummy_tracer_operation_context_records_span(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW	tests/tracer/test_dummy.py	49	def test_dummy_tracer_operation_context_records_exceptions(monkeypatch: pytest.MonkeyPatch) -> None:	CODE
LOW⚡	tests/tracer/test_dummy.py	71	def test_set_active_tracer_returns_same_instance() -> None:	CODE
LOW⚡	tests/tracer/test_dummy.py	77	def test_set_active_tracer_raises_when_existing() -> None:	CODE
LOW⚡	tests/tracer/test_dummy.py	83	def test_clear_active_tracer_removes_current() -> None:	CODE
LOW	tests/tracer/test_agentops.py	134	def test_agentops_tracer_create_span(agentops_tracer: AgentOpsTracer) -> None:	CODE
LOW	tests/tracer/test_agentops.py	152	def test_agentops_tracer_operation_context_records_exception(agentops_tracer: AgentOpsTracer) -> None:	CODE
1018 more matches not shown…

Docstring Block Structure66 hits · 330 pts

Severity	File	Line	Snippet	Context
HIGH	contrib/recipes/webshop/agl/tasks.py	47	Load tasks from a JSON or Parquet file. Args: path: Path to the tasks file (JSON or Parquet format). R	STRING
HIGH	contrib/recipes/envs/add_instruction.py	35	Retrieve an instruction string from INSTRUCTION_MAP based on the given type. Args: type (str): Instruc	STRING
HIGH	contrib/recipes/envs/add_instruction.py	88	Append an instruction to a single prompt or a chat-style prompt. - If `prompt` is a string, the instruction is	STRING
HIGH	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	261	Compute reference log probability using the correct worker based on LoRA configuration. In verl 0.6.0+, when Lo	STRING
HIGH	examples/chartqa/multimodal_utils.py	28	Encode an image to base64 string for multimodal LLM APIs. Args: image: Image source (file path, URL, o	STRING
HIGH	examples/chartqa/multimodal_utils.py	87	Create an OpenAI-compatible multimodal message. Args: text: The text prompt/question image: Im	STRING
HIGH	examples/claude_code/claude_code_controller.py	186	Runs the agent on a specific SWE-bench instance. This method orchestrates the agent execution via the specified	STRING
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	377	Start a Docker container session for repository testing. Args: image_name (str): Base Dock	STRING
HIGH	agentlightning/logging.py	19	Create or reset a namespaced logger with a consistent console format. This helper clears any previously attached ha	STRING
HIGH	agentlightning/logging.py	109	Configures logging for the `agentlightning` logger hierarchy. This function provides a one-stop setup utility for c	STRING
HIGH	agentlightning/llm_proxy.py	84	Extract LiteLLM request payload from hook args. The LiteLLM logger hooks receive `(args, *kwargs)` whose third po	STRING
HIGH	agentlightning/llm_proxy.py	1321	Create an `LLM` resource pointing at this proxy with rollout context. The returned endpoint is: `ht	STRING
HIGH	agentlightning/tracer/base.py	141	Notify the tracer that a span should be created here. It uses a fire-and-forget approach and doesn't wait for t	STRING
HIGH	agentlightning/tracer/base.py	163	Start to record an operation to a span. Args: name: The name of the operation. attribut	STRING
HIGH	agentlightning/types/resources.py	111	Return the routed endpoint for a specific rollout/attempt pair. Args: rollout_id: Identifier of the	STRING
HIGH	agentlightning/types/tracer.py	390	Build a synthetic span from raw attributes. Different from the [`from_opentelemetry`][agentlightning.Span.from_o	STRING
HIGH	agentlightning/emitter/annotation.py	315	Entry point for tracking operations. This helper can be used either as a decorator or as a context manager. The	STRING
HIGH	agentlightning/emitter/reward.py	155	Emit a reward value as an OpenTelemetry span. Examples: Emit a single-dimensional reward: >>> emit_	STRING
HIGH	agentlightning/runner/agent.py	802	Execute a single task directly, bypassing the task queue. This method creates a new rollout for the given input	STRING
HIGH	agentlightning/runner/base.py	165	Execute a single task with the given input. This method provides fine-grained control for executing individual	STRING
HIGH	agentlightning/utils/metrics.py	41	Validates label keys against the metric definition. Args: kind: Metric kind for error messages ("counter" o	STRING
HIGH	agentlightning/utils/id.py	10	Generate a random hexadecimal ID of the given length. Args: length: The desired length of the generated ID.	STRING
HIGH	agentlightning/utils/otel.py	146	Resolve the OpenTelemetry tracer configured for Agent Lightning. Args: use_active_span_processor: Whether t	STRING
HIGH	agentlightning/utils/otel.py	291	Filter attributes that start with the given prefix. The attribute must start with `prefix.` or be exactly `prefix`	STRING
HIGH	agentlightning/utils/otel.py	306	Filter attributes that start with the given prefix and unflatten them. The prefix will be removed during unflattenin	STRING
HIGH	agentlightning/adapter/messages.py	212	Yield tool call payloads for a completion span. Args: completion: The completion span whose descend	STRING
HIGH	agentlightning/adapter/triplet.py	227	Construct a tree from a flat list of spans. Args: spans: Spans that collectively form a single trac	STRING
HIGH	agentlightning/algorithm/decorator.py	159	Execute the wrapped function with injected dependencies. Args: train_dataset: Optional training dat	STRING
HIGH	agentlightning/algorithm/decorator.py	226	Convert a callable into a [`FunctionalAlgorithm`][agentlightning.algorithm.decorator.FunctionalAlgorithm]. The deco	STRING
HIGH	agentlightning/algorithm/fast.py	38	Reference implementation that streams the full dataset through the rollout queue. The baseline algorithm batches ta	STRING
HIGH	agentlightning/algorithm/apo/apo.py	517	Initialize the beam search with seed prompt and dataset iterators. Args: train_dataset: Da	STRING
HIGH	agentlightning/algorithm/apo/apo.py	696	Evaluate all candidate prompts on validation data and select top-k for the beam. Args: can	STRING
HIGH	agentlightning/verl/trainer.py	209	Compute reference log probability using the correct worker based on LoRA configuration. In verl 0.6.0+, when Lo	STRING
HIGH	agentlightning/litagent/decorator.py	141	Execute a synchronous rollout using the wrapped function. Args: task: Task input data.	STRING
HIGH	agentlightning/litagent/decorator.py	161	Execute an asynchronous rollout using the wrapped function. Args: task: Task input data.	STRING
HIGH	agentlightning/litagent/decorator.py	207	Retrieve the first LLM resource from the available resources. Strip the ProxyLLM resource into a LLM resource i	STRING
HIGH	agentlightning/litagent/decorator.py	238	Retrieve the first prompt template resource from the available resources. Args: resources: Mapping	STRING
HIGH	agentlightning/litagent/decorator.py	266	Convert [`ProxyLLM`][agentlightning.ProxyLLM] instances into concrete LLMs. It resolves ProxyLLM instances to t	STRING
HIGH	agentlightning/litagent/decorator.py	307	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] for LLM-based rollouts. Args:	STRING
HIGH	agentlightning/litagent/decorator.py	353	Validate the function signature of an LLM rollout function. Ensures the function follows the expected pattern for L	STRING
HIGH	agentlightning/litagent/decorator.py	394	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] for prompt-based rollouts. Th	STRING
HIGH	agentlightning/litagent/decorator.py	435	Validate the function signature of a prompt rollout function. Ensures the function follows the expected pattern for	STRING
HIGH	agentlightning/litagent/decorator.py	466	Create a [`FunctionalLitAgent`][agentlightning.litagent.decorator.FunctionalLitAgent] from an arbitrary rollout function	STRING
HIGH	agentlightning/trainer/init_utils.py	152	Build and return a component instance from a flexible specification. This function provides a flexible way to creat	STRING
HIGH	agentlightning/store/base.py	167	Register a rollout and immediately create its first attempt. !!! note Use [`enqueue_rollout()`][age	STRING
HIGH	agentlightning/store/base.py	208	Persist a rollout in `queuing` state so runners can claim it later. !!! note Different from [`start	STRING
HIGH	agentlightning/store/base.py	251	Claim the oldest queued rollout and transition it to `preparing`. This function do not block. Retrieva	STRING
HIGH	agentlightning/store/base.py	301	Create a manual retry attempt for an existing rollout. This is typically invoked by runners that wish to retry	STRING
HIGH	agentlightning/store/base.py	331	Persist a pre-constructed span emitted during rollout execution. The provided [`Span`][agentlightning.Span] mus	STRING
HIGH	agentlightning/store/base.py	362	Convert and persist an OpenTelemetry span for a particular attempt. Implementations must transform the `readabl	STRING
HIGH	agentlightning/store/base.py	401	Retrieve rollouts filtered by status and/or explicit identifiers. This interface supports structured filtering,	STRING
HIGH	agentlightning/store/base.py	442	Return every attempt ever created for `rollout_id` in ascending sequence order. The parameters allow callers to	STRING
HIGH	agentlightning/store/base.py	466	Fetch a rollout by identifier without mutating its state. Args: rollout_id: Identifier to retrieve.	STRING
HIGH	agentlightning/store/base.py	480	Fetch the attempt with the highest `sequence_id` for `rollout_id`. Args: rollout_id: Identifier to	STRING
HIGH	agentlightning/store/base.py	505	List every stored resource snapshot in insertion order. Supports lightweight filtering, sorting, and pagination	STRING
HIGH	agentlightning/store/base.py	530	Return a specific named resource snapshot by identifier. Args: resources_id: Identifier of the snap	STRING
HIGH	agentlightning/store/base.py	556	Allocate the next strictly increasing sequence number used to order spans. Implementations must retain counters	STRING
HIGH	agentlightning/store/base.py	594	Block until the targeted rollouts reach a terminal status or the timeout expires. Terminal statuses are `"succe	STRING
HIGH	agentlightning/store/base.py	641	Return the stored spans for a rollout, optionally scoped to one attempt. Supports a handful of filters that cov	STRING
HIGH	agentlightning/store/base.py	682	Persist a new immutable snapshot of named resources and mark it as latest. Implementations must assign a fresh	STRING
6 more matches not shown…

Unused Imports229 hits · 224 pts

Severity	File	Line	Context
LOW	tests/test_env_var.py	3	CODE
LOW	tests/test_logging.py	3	CODE
LOW	tests/test_config.py	16	CODE
LOW	tests/test_config.py	17	CODE
LOW	tests/benchmark/analysis.py	5	CODE
LOW	tests/benchmark/collection_benchmark.py	5	CODE
LOW	tests/benchmark/micro_benchmark.py	5	CODE
LOW	tests/tracer/test_dummy.py	3	CODE
LOW	tests/tracer/test_agentops.py	3	CODE
LOW	tests/tracer/test_weave.py	3	CODE
LOW	tests/tracer/test_otel.py	5	CODE
LOW	tests/emitter/test_message.py	3	CODE
LOW	tests/emitter/test_exception.py	3	CODE
LOW	tests/emitter/test_object.py	3	CODE
LOW	tests/emitter/test_annotation.py	3	CODE
LOW	tests/emitter/test_operation.py	3	CODE
LOW	tests/llm_proxy/test_stream.py	3	CODE
LOW	tests/utils/test_otlp.py	5	CODE
LOW	tests/utils/test_system_snapshot.py	3	CODE
LOW	tests/utils/test_metrics.py	5	CODE
LOW	tests/utils/test_server_launcher.py	3	CODE
LOW	tests/utils/test_otel.py	3	CODE
LOW	tests/algorithm/test_utils.py	3	CODE
LOW	tests/common/prometheus_stub.py	3	CODE
LOW	tests/common/tracer.py	3	CODE
LOW	tests/execution/test_client_server.py	3	CODE
LOW	tests/trainer/test_trainer_init.py	3	CODE
LOW	tests/trainer/test_trainer_dev.py	5	CODE
LOW	tests/trainer/sample_components.py	3	CODE
LOW	tests/store/conftest.py	3	CODE
LOW	tests/store/test_collection.py	3	CODE
LOW	docs/macros/source_links.py	3	CODE
LOW	contrib/recipes/search_r1/search_r1_agent.py	3	CODE
LOW	contrib/recipes/search_r1/train_search_r1_agent.py	4	CODE
LOW	contrib/recipes/agentos/demo_governed_training.py	23	CODE
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	14	CODE
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	19	CODE
LOW	contrib/recipes/webshop/server/webshop_server.py	71	CODE
LOW	contrib/recipes/webshop/agl/tasks.py	17	CODE
LOW	contrib/recipes/webshop/agl/config.py	16	CODE
LOW	contrib/recipes/webshop/agl/generate_tasks.py	26	CODE
LOW	contrib/recipes/webshop/agl/run_training.py	39	CODE
LOW	contrib/recipes/envs/prompt_builder.py	3	CODE
LOW	contrib/recipes/envs/empo2_server/server_bert.py	4	CODE
LOW	contrib/recipes/envs/empo2_server/server_bert.py	9	CODE
LOW	contrib/agentlightning/contrib/runner/agentos.py	10	CODE
LOW	contrib/agentlightning/contrib/agent/env_agent.py	3	CODE
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	3	CODE
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	5	CODE
LOW	contrib/agentlightning/contrib/adapter/agentos.py	10	CODE
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	5	CODE
LOW	contrib/agentlightning/contrib/reward/agentos.py	10	CODE
LOW	examples/chartqa/chartqa_agent.py	17	CODE
LOW	examples/chartqa/debug_chartqa_agent.py	26	CODE
LOW	examples/chartqa/multimodal_utils.py	10	CODE
LOW	examples/chartqa/train_chartqa_agent.py	20	CODE
LOW	examples/tinker/hello.py	35	CODE
LOW	examples/tinker/q20_agent.py	13	CODE
LOW	examples/tinker/q20_evaluate.py	33	CODE
LOW	examples/tinker/q20_train.py	33	CODE
169 more matches not shown…

Decorative Section Separators56 hits · 204 pts

Severity	File	Line	Snippet	Context
MEDIUM⚡	tests/execution/test_client_server.py	151	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	153	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	291	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	293	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	423	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	425	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	665	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	667	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	886	# =========================	COMMENT
MEDIUM⚡	tests/execution/test_client_server.py	888	# =========================	COMMENT
MEDIUM	tests/execution/test_client_server.py	28	# =========================	COMMENT
MEDIUM	tests/execution/test_client_server.py	30	# =========================	COMMENT
MEDIUM	tests/execution/test_client_server.py	67	# =========================	COMMENT
MEDIUM	tests/execution/test_client_server.py	69	# =========================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	94	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	96	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	140	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	142	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	154	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	156	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	173	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	175	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	181	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	183	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	210	# ==============================================================================	COMMENT
MEDIUM⚡	contrib/recipes/webshop/scripts/run_stack.sh	212	# ==============================================================================	COMMENT
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	1	# ==========================	COMMENT
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	3	# ==========================	COMMENT
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	16	# ==========================	COMMENT
MEDIUM	…envs/config_verl/alfworld/grpo_qwen_1.5b_instruct.yaml	18	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	1	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	3	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	16	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/alfworld/grpo.yaml	18	# ==========================	COMMENT
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	1	# ==========================	COMMENT
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	3	# ==========================	COMMENT
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	19	# ==========================	COMMENT
MEDIUM	…s/config_verl/scienceworld/empo2_qwen_7b_instruct.yaml	21	# ==========================	COMMENT
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	1	# ==========================	COMMENT
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	3	# ==========================	COMMENT
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	18	# ==========================	COMMENT
MEDIUM	…vs/config_verl/scienceworld/grpo_qwen_7b_instruct.yaml	20	# ==========================	COMMENT
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	1	# ==========================	COMMENT
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	3	# ==========================	COMMENT
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	17	# ==========================	COMMENT
MEDIUM	…/config_verl/scienceworld/grpo_qwen_1.5b_instruct.yaml	19	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	1	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	3	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	17	# ==========================	COMMENT
MEDIUM	contrib/recipes/envs/config_verl/scienceworld/grpo.yaml	19	# ==========================	COMMENT
MEDIUM	agentlightning/tracer/otel.py	408	# ---------------------------------------------------------------------------	COMMENT
MEDIUM	agentlightning/tracer/otel.py	427	# ---------------------------------------------------------------------------	COMMENT
MEDIUM	agentlightning/instrumentation/weave.py	309	# ==========================================	COMMENT
MEDIUM	agentlightning/instrumentation/weave.py	311	# ==========================================	COMMENT
MEDIUM⚡	agentlightning/store/collection/memory.py	243	# -------------------------------------------------------------------------	COMMENT
MEDIUM⚡	agentlightning/store/collection/memory.py	245	# -------------------------------------------------------------------------	COMMENT

Excessive Try-Catch Wrapping163 hits · 178 pts

Severity	File	Line	Snippet	Context
LOW	tests/benchmark/collection_benchmark.py	410	except Exception as exc:	CODE
LOW	tests/benchmark/collection_benchmark.py	439	except Exception:	CODE
LOW	tests/benchmark/collection_benchmark.py	464	except Exception:	CODE
MEDIUM⚡	tests/benchmark/micro_benchmark.py	117	console.print(f"Error updating worker {worker_id} for task {task_id}: {e}")	CODE
MEDIUM⚡	tests/benchmark/micro_benchmark.py	156	console.print(f"Error dequeueing empty and updating worker {worker_id} for task {task_id}: {e}")	CODE
MEDIUM⚡	tests/benchmark/micro_benchmark.py	208	console.print(f"Error running rollout task {task_id}: {e}")	CODE
MEDIUM⚡	tests/benchmark/micro_benchmark.py	343	console.print(f"Error dequeueing and updating worker {worker_id} for task {task_id}: {e}")	CODE
MEDIUM	tests/benchmark/micro_benchmark.py	248	console.print(f"Error dequeueing only worker {worker_id} for task {task_id}: {e}")	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	116	except Exception as e:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	155	except Exception as e:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	207	except Exception as e:	CODE
LOW⚡	tests/benchmark/micro_benchmark.py	342	except Exception as e:	CODE
LOW	tests/benchmark/micro_benchmark.py	42	except Exception:	CODE
LOW	tests/benchmark/micro_benchmark.py	247	except Exception as e:	CODE
LOW	tests/tracer/test_integration.py	121	except Exception:	CODE
LOW	tests/tracer/test_otel.py	416	except Exception as e:	CODE
LOW	tests/tracer/test_otel.py	568	except Exception as exc: # pragma: no cover - defensive path	CODE
LOW	tests/tracer/test_otel.py	571	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	65	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	100	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	121	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	143	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	156	except Exception:	CODE
LOW	tests/llm_proxy/test_stream.py	169	except Exception:	CODE
LOW	tests/utils/test_system_snapshot.py	120	except Exception:	CODE
LOW	tests/utils/test_server_launcher.py	114	except Exception as exc: # server may not be up yet	CODE
LOW	tests/common/vllm.py	148	except Exception:	CODE
LOW	tests/store/conftest.py	204	except Exception as exc: # depends on external service	CODE
LOW	tests/store/test_client_server.py	1212	except Exception as e:	CODE
LOW	docs/tutorials/debug.md	215	except Exception:	CODE
LOW	contrib/recipes/search_r1/retrieval_server.py	222	except Exception: # pragma: no cover - typing convenience	CODE
LOW	contrib/recipes/search_r1/retrieval_server.py	236	except Exception:	CODE
LOW	contrib/recipes/search_r1/search_r1_agent.py	175	except Exception as e:	CODE
LOW	contrib/recipes/agentos/demo_governed_training.py	110	except Exception:	CODE
LOW	contrib/recipes/webshop/server/webshop_server.py	206	except Exception as e:	CODE
LOW	contrib/recipes/webshop/server/webshop_server.py	262	except Exception as e:	CODE
LOW	contrib/recipes/webshop/server/webshop_server.py	313	except Exception as e:	CODE
LOW	contrib/agentlightning/contrib/agent/env_agent.py	115	except Exception as e:	CODE
LOW	contrib/agentlightning/contrib/agent/empo2_agent.py	164	except Exception as e:	CODE
LOW	contrib/agentlightning/contrib/adapter/agentos.py	112	except Exception as e:	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	457	except Exception as e:	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	571	except Exception as e:	CODE
MEDIUM	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	572	print(f"Error while waiting for tasks to finish: {e}")	CODE
LOW	examples/calc_x/legacy_calc_agent.py	77	except Exception as e:	CODE
LOW	examples/calc_x/eval_utils.py	57	except Exception:	CODE
LOW	examples/calc_x/calc_agent.py	100	except Exception as e:	CODE
LOW	examples/chartqa/chartqa_agent.py	125	except Exception as e:	CODE
LOW	examples/chartqa/chartqa_agent.py	166	except Exception as e:	CODE
LOW	examples/chartqa/chartqa_agent.py	370	except Exception as e:	CODE
LOW	examples/chartqa/chartqa_agent.py	406	except Exception as e:	CODE
LOW	examples/tinker/q20_agent.py	288	except Exception as e:	CODE
LOW	examples/tinker/q20_evaluate.py	170	except Exception as e:	CODE
LOW	examples/tinker/q20_train.py	121	except Exception:	CODE
MEDIUM	examples/tinker/q20_train.py	122	console.print(f"Error in q20_agent: {traceback.format_exc()}")	CODE
LOW	examples/claude_code/claude_code_agent.py	188	except Exception as e:	CODE
LOW	examples/claude_code/claude_code_agent.py	302	except Exception as e:	CODE
LOW	examples/claude_code/claude_code_agent.py	416	except Exception as e:	CODE
LOW	examples/claude_code/swebench_utils/evaluation.py	217	except Exception as e:	CODE
LOW	examples/claude_code/swebench_utils/docker_runtime.py	207	except Exception as e:	STRING
LOW	examples/claude_code/swebench_utils/docker_runtime.py	346	except Exception as e:	STRING
103 more matches not shown…

Self-Referential Comments47 hits · 160 pts

Severity	File	Line	Snippet	Context
MEDIUM	tests/test_client.py	169	# Define the synchronous client workflow	COMMENT
MEDIUM	tests/tracer/test_integration.py	398	# Create a team with the primary and critic agents.	COMMENT
MEDIUM	tests/tracer/test_otel.py	442	# Create a slow async function that exceeds timeout	COMMENT
MEDIUM	tests/runner/test_agent_runner.py	776	# Create an attempted rollout	COMMENT
MEDIUM	tests/runner/test_agent_runner.py	803	# Create an attempted rollout with invalid resources_id	COMMENT
MEDIUM	tests/llm_proxy/test_stream.py	401	# Create a synthetic long content split into ~20-40 char pieces as the merger would see	COMMENT
MEDIUM	tests/algorithm/test_baseline.py	178	# Create a dataset with 5 samples	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	168	# Create a ProxyLLM resource	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	174	# Create an AttemptedRollout	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	204	# Create a ProxyLLM resource	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	210	# Create an AttemptedRollout	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	239	# Create a ProxyLLM resource	COMMENT
MEDIUM⚡	tests/litagent/test_decorator.py	245	# Create an AttemptedRollout	COMMENT
MEDIUM	tests/litagent/test_decorator.py	329	# Create a rollout object	COMMENT
MEDIUM	tests/litagent/test_decorator.py	402	# Create a rollout object	COMMENT
MEDIUM	tests/litagent/test_decorator.py	435	# Create a rollout object	COMMENT
MEDIUM	tests/store/test_utils.py	80	# Create a valid attempt first, then modify its status	COMMENT
MEDIUM	tests/store/test_utils.py	258	# Create a valid attempt first, then set it to None	COMMENT
MEDIUM⚡	tests/store/test_core.py	2564	# Create a valid attempt to ensure rollout exists in store	COMMENT
MEDIUM	tests/store/test_core.py	446	# Create a rollout	COMMENT
MEDIUM	tests/store/test_core.py	2096	# Create the first attempt	COMMENT
MEDIUM	tests/store/test_core.py	2810	# Create a rollout	COMMENT
MEDIUM	tests/store/test_core.py	2831	# Create a rollout and dequeue to create first attempt	COMMENT
MEDIUM	tests/store/test_core.py	2494	rollout = await store_fixture.dequeue_rollout() # Create an attempt	CODE
MEDIUM	contrib/recipes/webshop/server/webshop_server.py	308	# Create a test session to trigger loading	COMMENT
MEDIUM	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	109	# This function is adapted from verl.	COMMENT
MEDIUM	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	512	# Create the Rollout object (without trace and logs as per user's note)	COMMENT
MEDIUM	examples/claude_code/swebench_utils/docker_runtime.py	109	# Create a copy of metadata to avoid modifying the original	COMMENT
MEDIUM⚡	examples/minimal/llm_proxy.py	41	# Create a store to store the traces	COMMENT
MEDIUM⚡	examples/minimal/llm_proxy.py	46	# Create a vLLM server	COMMENT
MEDIUM⚡	examples/minimal/llm_proxy.py	51	# Create an LLM proxy to guard the vLLM server and catch the traces	COMMENT
MEDIUM⚡	examples/minimal/llm_proxy.py	80	# Create a store to store the traces	COMMENT
MEDIUM⚡	examples/minimal/llm_proxy.py	88	# Create an LLM proxy to guard the OpenAI server and catch the traces	COMMENT
MEDIUM	examples/unsloth/sft_algorithm.py	360	# Create the LLM proxy for rollout worker access and trace data collection	COMMENT
MEDIUM	.github/workflows/pypi-nightly.yml	46	# Create a dev version with timestamp	COMMENT
MEDIUM	agentlightning/llm_proxy.py	675	# Creating a new request won't work because request is cached in the base class	COMMENT
MEDIUM	agentlightning/tracer/weave.py	366	# Create a new trace call object in Weave	COMMENT
MEDIUM	agentlightning/runner/legacy.py	142	# Create the RolloutLegacy object with standardized fields	COMMENT
MEDIUM	agentlightning/utils/server_launcher.py	423	# Create the arbiter up-front so the watchdog can inspect it.	COMMENT
MEDIUM	agentlightning/adapter/triplet.py	290	# Create a virtual root span if multiple root spans are found	COMMENT
MEDIUM	agentlightning/verl/trainer.py	57	# This function is adapted from verl.	COMMENT
MEDIUM	agentlightning/verl/daemon.py	659	# Create the Rollout object (without trace and logs as per user's note)	COMMENT
MEDIUM⚡	agentlightning/store/collection_based.py	198	# The following methods should live inside one lock.	COMMENT
MEDIUM	agentlightning/store/collection_based.py	429	# Create the initial attempt	COMMENT
MEDIUM	agentlightning/store/collection_based.py	596	# Create a new attempt (could be first attempt or retry)	COMMENT
MEDIUM	agentlightning/store/collection/mongo.py	301	# Create a new client for this loop.	COMMENT
MEDIUM	agentlightning/store/collection/mongo.py	318	# Create a new collection for this loop.	COMMENT

Modern Structural Boilerplate115 hits · 113 pts

Severity	File	Line	Snippet	Context
LOW	tests/utils/test_otlp.py	85	def _set_any_value(av: AnyValue, value: object) -> None:	CODE
LOW	tests/store/conftest.py	28	__all__ = [	CODE
LOW	tests/store/test_core.py	2514	async def update_resource(ver: int) -> None:	CODE
LOW	contrib/recipes/webshop/server/webshop_server.py	32	logger = logging.getLogger(__name__)	CODE
LOW	contrib/recipes/webshop/agl/generate_tasks.py	37	logger = logging.getLogger(__name__)	CODE
LOW	contrib/recipes/webshop/agl/run_training.py	136	logger = logging.getLogger(__name__)	CODE
LOW	contrib/agentlightning/contrib/runner/agentos.py	17	logger = logging.getLogger(__name__)	CODE
LOW	contrib/agentlightning/contrib/runner/agentos.py	116	def _setup_hooks(self) -> None:	CODE
LOW	contrib/agentlightning/contrib/adapter/agentos.py	16	logger = logging.getLogger(__name__)	CODE
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	45	__all__ = [	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	13	logger = logging.getLogger(__name__)	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	33	__all__ = [	CODE
LOW	contrib/agentlightning/contrib/reward/agentos.py	15	logger = logging.getLogger(__name__)	CODE
LOW	examples/chartqa/env_var.py	5	__all__ = [	CODE
LOW	examples/chartqa/chartqa_agent.py	96	def update_llm_config(self, model_name: str, endpoint: str \| None, temperature: float \| None) -> None:	CODE
LOW	examples/chartqa/multimodal_utils.py	21	__all__ = [	CODE
LOW	examples/tinker/agl_tinker/env.py	34	logger = logging.getLogger(__name__)	CODE
LOW	examples/tinker/agl_tinker/llm.py	37	logger = logging.getLogger(__name__)	CODE
LOW	examples/tinker/agl_tinker/llm.py	100	def update_sampling_client(self, sampling_client: tinker.SamplingClient) -> None:	CODE
LOW	examples/tinker/agl_tinker/rollout.py	36	logger = logging.getLogger(__name__)	CODE
LOW	examples/tinker/agl_tinker/train.py	46	logger = logging.getLogger(__name__)	CODE
LOW	examples/tinker/agl_tinker/algo.py	23	logger = logging.getLogger(__name__)	CODE
LOW	examples/claude_code/extended_adapter.py	17	logger = logging.getLogger(__name__)	CODE
LOW	examples/spider/sql_agent.py	35	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/logging.py	15	__all__ = ["setup", "configure_logger", "setup_module"]	CODE
LOW	agentlightning/server.py	33	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/env_var.py	11	__all__ = [	CODE
LOW	agentlightning/config.py	32	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/config.py	34	__all__ = ["lightning_cli"]	CODE
LOW	agentlightning/llm_proxy.py	61	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/llm_proxy.py	63	__all__ = [	CODE
LOW	agentlightning/llm_proxy.py	1144	def set_store(self, store: LightningStore) -> None:	CODE
LOW	agentlightning/llm_proxy.py	1152	def update_model_list(self, model_list: List[ModelConfig]) -> None:	CODE
LOW	agentlightning/llm_proxy.py	1384	def set_active_llm_proxy(proxy: LLMProxy) -> None:	CODE
LOW	agentlightning/client.py	23	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/tracer/weave.py	55	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/tracer/__init__.py	8	__all__ = [	CODE
LOW	agentlightning/tracer/agentops.py	29	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/tracer/dummy.py	24	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/tracer/otel.py	28	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/tracer/base.py	16	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/types/core.py	38	__all__ = [	CODE
LOW	agentlightning/types/resources.py	22	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/types/resources.py	25	__all__ = [	CODE
LOW	agentlightning/types/tracer.py	23	__all__ = [	CODE
LOW	agentlightning/emitter/annotation.py	32	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/emitter/annotation.py	143	def set_input(self, args: Any, *kwargs: Any) -> None:	CODE
LOW	agentlightning/emitter/annotation.py	173	def set_output(self, output: Any) -> None:	CODE
LOW	agentlightning/emitter/exception.py	12	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/emitter/object.py	14	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/emitter/__init__.py	28	__all__ = [	CODE
LOW	agentlightning/emitter/message.py	12	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/emitter/reward.py	31	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/emitter/reward.py	33	__all__ = [	CODE
LOW	agentlightning/runner/legacy.py	19	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/runner/legacy.py	21	__all__ = [	CODE
LOW	agentlightning/runner/__init__.py	7	__all__ = [	CODE
LOW	agentlightning/runner/agent.py	57	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/runner/base.py	22	logger = logging.getLogger(__name__)	CODE
LOW	agentlightning/utils/metrics.py	32	logger = logging.getLogger(__name__)	CODE
55 more matches not shown…

Deep Nesting98 hits · 93 pts

Severity	File	Line	Context
LOW	tests/test_logging.py	23	CODE
LOW	tests/benchmark/benchmark_store.py	89	CODE
LOW	tests/benchmark/benchmark_store.py	91	CODE
LOW	tests/benchmark/benchmark_store.py	169	CODE
LOW	tests/benchmark/benchmark_store.py	285	CODE
LOW	tests/benchmark/benchmark_store.py	307	CODE
LOW	tests/benchmark/micro_benchmark.py	435	CODE
LOW	tests/tracer/test_agentops.py	166	CODE
LOW	tests/tracer/test_integration.py	738	CODE
LOW	tests/tracer/test_integration.py	113	CODE
LOW	tests/llm_proxy/test_llm_proxy_cpu.py	301	CODE
LOW	tests/llm_proxy/test_llm_proxy_gpu.py	403	CODE
LOW	tests/llm_proxy/test_llm_proxy_gpu.py	511	CODE
LOW	tests/llm_proxy/test_stream.py	13	CODE
LOW	tests/llm_proxy/test_stream.py	71	CODE
LOW	tests/utils/test_otlp.py	85	CODE
LOW	contrib/agentlightning/contrib/agent/env_agent.py	49	CODE
LOW	contrib/agentlightning/contrib/agent/env_agent.py	68	CODE
LOW	contrib/agentlightning/contrib/agent/empo2_agent.py	73	CODE
LOW	contrib/agentlightning/contrib/adapter/triplet_group.py	29	CODE
LOW	contrib/agentlightning/contrib/adapter/agentos.py	94	CODE
LOW	…gentlightning/contrib/algorithm/env_verl/core_empo2.py	14	CODE
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	291	CODE
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	538	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	461	CODE
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	660	CODE
LOW	examples/calc_x/train_calc_agent.py	110	CODE
LOW	examples/chartqa/chartqa_agent.py	295	CODE
LOW	examples/tinker/q20_evaluate.py	53	CODE
LOW	examples/tinker/agl_tinker/train.py	111	CODE
LOW	examples/azure/aoai_finetune.py	590	CODE
LOW	examples/claude_code/claude_code_agent.py	230	CODE
LOW	examples/claude_code/claude_code_agent.py	312	CODE
LOW	examples/claude_code/extended_adapter.py	30	CODE
LOW	examples/claude_code/extended_adapter.py	63	CODE
LOW	examples/minimal/vllm_server.py	18	CODE
LOW	examples/spider/sql_agent.py	346	CODE
LOW	examples/spider/spider_eval/evaluation.py	533	CODE
LOW	examples/spider/spider_eval/process_sql.py	276	CODE
LOW	examples/spider/spider_eval/exec_eval.py	65	CODE
LOW	examples/spider/spider_eval/exec_eval.py	187	CODE
LOW	examples/unsloth/sft_algorithm.py	61	CODE
LOW	examples/unsloth/sft_algorithm.py	135	CODE
LOW	scripts/wandb_download_result.py	171	CODE
LOW	agentlightning/config.py	118	CODE
LOW	agentlightning/llm_proxy.py	722	CODE
LOW	agentlightning/llm_proxy.py	1314	CODE
LOW	agentlightning/tracer/agentops.py	142	CODE
LOW	agentlightning/tracer/otel.py	250	CODE
LOW	agentlightning/tracer/otel.py	472	CODE
LOW	agentlightning/types/resources.py	80	CODE
LOW	agentlightning/emitter/annotation.py	187	CODE
LOW	agentlightning/emitter/annotation.py	209	CODE
LOW	agentlightning/emitter/object.py	87	CODE
LOW	agentlightning/emitter/reward.py	148	CODE
LOW	agentlightning/emitter/reward.py	213	CODE
LOW	agentlightning/runner/agent.py	270	CODE
LOW	agentlightning/runner/agent.py	484	CODE
LOW	agentlightning/runner/agent.py	737	CODE
LOW	agentlightning/runner/agent.py	526	CODE
38 more matches not shown…

Hallucination Indicators4 hits · 40 pts

Severity	File	Line	Snippet	Context
CRITICAL	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	559	model = "/".join(self.config.actor_rollout_ref.model.path.split("/")[-2:])	CODE
CRITICAL	agentlightning/verl/trainer.py	260	if self.config.agentlightning.trace_aggregator.level.startswith("trajectory")	CODE
CRITICAL	agentlightning/verl/trainer.py	265	if self.config.agentlightning.trace_aggregator.level.startswith("trajectory")	CODE
CRITICAL	agentlightning/verl/trainer.py	459	model = "/".join(self.config.actor_rollout_ref.model.path.split("/")[-2:])	CODE

Redundant / Tautological Comments24 hits · 38 pts

Severity	File	Line	Snippet	Context
LOW	tests/test_config.py	375	# Check if mock_add_param_func was called with these specific arguments	COMMENT
LOW	tests/utils/test_server_launcher.py	211	# Check if the port is still occupied.	COMMENT
LOW	contrib/recipes/webshop/tests/test_span_adapter.py	152	# Check if reward was associated with any triplet	COMMENT
LOW	…gentlightning/contrib/algorithm/env_verl/core_empo2.py	23	# Check if the start pattern matches at the current position	COMMENT
LOW	examples/chartqa/chartqa_agent.py	317	# Check if the graph is already built	COMMENT
LOW	examples/claude_code/swebench_utils/evaluation.py	190	# Check if git diff changed after running eval script	COMMENT
LOW	scripts/bump_version.sh	8	# Check if version argument is provided	COMMENT
LOW	scripts/bump_version.sh	30	# Check if pyproject.toml exists	COMMENT
LOW	agentlightning/config.py	110	# Check if the (potentially unwrapped) type is a List	COMMENT
LOW	agentlightning/config.py	146	# Check if the list item itself is, e.g., Optional[str] or bool	COMMENT
LOW	agentlightning/llm_proxy.py	612	# Check if it's a chat completions or messages endpoint	COMMENT
LOW	agentlightning/llm_proxy.py	632	# Check if streaming is requested	COMMENT
LOW	agentlightning/llm_proxy.py	1424	# Check if tracer provider is malformed due to global tracer clear in tests.	COMMENT
LOW	agentlightning/client.py	325	# Check if tasks are mixture of TaskInput and Task	COMMENT
LOW	agentlightning/types/resources.py	82	# Check if we're accessing endpoint after initialization and not from base_url	COMMENT
LOW	agentlightning/emitter/reward.py	94	# Check if the function is async	COMMENT
LOW	agentlightning/utils/server_launcher.py	482	# Check if the server is healthy.	COMMENT
LOW	agentlightning/utils/otel.py	443	# Check if keys are all numeric strings	COMMENT
LOW	agentlightning/verl/daemon.py	274	# Check if model requires multimodal position_ids (e.g., Qwen2-VL)	COMMENT
LOW	agentlightning/litagent/decorator.py	517	# Check if it matches the LLM rollout API pattern	COMMENT
LOW⚡	agentlightning/store/collection_based.py	189	# Check if healthcheck is already running to prevent recursion	COMMENT
LOW⚡	agentlightning/store/collection_based.py	194	# Set flag to prevent recursive healthcheck calls	COMMENT
LOW	agentlightning/store/collection_based.py	593	# Check if rollout is still in a queuing state	COMMENT
LOW	agentlightning/store/utils.py	75	# Check if this status should trigger a retry	COMMENT

AI Structural Patterns33 hits · 28 pts

Severity	File	Line	Context
LOW	contrib/recipes/search_r1/retrieval_server.py	159	CODE
LOW	examples/azure/aoai_finetune.py	40	CODE
LOW	examples/claude_code/claude_code_agent.py	128	CODE
LOW	examples/rag/metric_utils.py	346	CODE
LOW	examples/rag/metric_utils.py	360	CODE
LOW	examples/rag/metric_utils.py	374	CODE
LOW	examples/rag/metric_utils.py	388	CODE
LOW	examples/rag/metric_utils.py	402	CODE
LOW	examples/rag/metric_utils.py	416	CODE
LOW	examples/rag/metric_utils.py	430	CODE
LOW	examples/spider/sql_agent.py	321	CODE
LOW	agentlightning/logging.py	95	CODE
LOW	agentlightning/llm_proxy.py	577	CODE
LOW	agentlightning/llm_proxy.py	1064	CODE
LOW	agentlightning/types/tracer.py	374	CODE
LOW	agentlightning/algorithm/apo/apo.py	101	CODE
LOW	agentlightning/instrumentation/vllm.py	63	CODE
LOW	agentlightning/verl/daemon.py	213	CODE
LOW	agentlightning/execution/client_server.py	65	CODE
LOW	agentlightning/trainer/init_utils.py	122	CODE
LOW	agentlightning/trainer/init_utils.py	138	CODE
LOW	agentlightning/trainer/trainer.py	120	CODE
LOW	agentlightning/store/collection_based.py	762	CODE
LOW	agentlightning/store/collection_based.py	1313	CODE
LOW	agentlightning/store/threading.py	107	CODE
LOW	agentlightning/store/threading.py	227	CODE
LOW	agentlightning/store/client_server.py	1105	CODE
LOW	agentlightning/store/client_server.py	1219	CODE
LOW	agentlightning/store/client_server.py	1691	CODE
LOW	agentlightning/store/client_server.py	1951	CODE
LOW	agentlightning/store/base.py	386	CODE
LOW	agentlightning/store/base.py	619	CODE
LOW	agentlightning/store/collection/mongo.py	1086	CODE

Structural Annotation Overuse14 hits · 28 pts

Severity	File	Line	Snippet	Context
LOW⚡	docs/tutorials/emitter.md	31	# Step 1: Initial planning	COMMENT
LOW⚡	docs/tutorials/emitter.md	40	# Step 2: Execute the plan	COMMENT
LOW⚡	docs/tutorials/emitter.md	44	# Step 3: Final evaluation	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	95	# Step 1: Initialize WebShop Data (if needed)	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	141	# Step 2: Start WebShop Server	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	155	# Step 3: Start Agent Lightning Coordinator	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	174	# Step 4: Wait for Services	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	182	# Step 5: Build and Start Runners	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	211	# Step 6: Wait for Training to Complete	COMMENT
LOW⚡	examples/rag/README.md	67	### Step 1: Collecting Text Chunks	COMMENT
LOW⚡	examples/rag/README.md	71	### Step 2: Creating the FAISS Index (`nq_hnsw_faiss_n32e40.index`)	COMMENT
LOW⚡	examples/rag/README.md	78	### Step 3: Creating the Chunk List (`nq_list.pkl`)	COMMENT
LOW	examples/rag/README.md	105	### Step 4: Code Example - Building Index and Chunk List	COMMENT
LOW	examples/rag/rag_agent.py	112	# NOTE: The following dummy data can also be used if you don't have the dataset.	COMMENT

Cross-Language Confusion5 hits · 22 pts

Severity	File	Line	Snippet	Context
HIGH	examples/claude_code/claude_code_controller.py	152	if ! command -v python3 &> /dev/null; then	CODE
HIGH	examples/claude_code/claude_code_controller.py	154	sudo apt-get update -qq && sudo apt-get install -y -qq python3.12	CODE
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	188	"py_interpreter_path": r'$(which python 2>/dev/null \|\| echo "")',	STRING
HIGH	examples/claude_code/swebench_utils/docker_runtime.py	194	self.send_command("apt update -qq && apt install -y -qq git")	STRING
HIGH	agentlightning/utils/otel.py	474	# This include null, dict, etc.	COMMENT

AI Slop Vocabulary9 hits · 21 pts

Severity	File	Line	Snippet	Context
MEDIUM	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	647	# This exit logic is to ensure a robust CI.	COMMENT
MEDIUM	examples/tinker/agl_tinker/llm.py	188	# NOTE(yuge): I thought about adding this to make it more robust to empty responses,	COMMENT
MEDIUM	scripts/wandb_download_result.py	82	# We fetch all runs in the project once, then pick matching ones to be robust across filters/backends.	COMMENT
MEDIUM	agentlightning/logging.py	192	# TODO: More comprehensive Windows support may be needed in the future.	COMMENT
LOW	agentlightning/llm_proxy.py	635	# Simple case: no streaming requested, just return the response	COMMENT
MEDIUM	agentlightning/verl/trainer.py	542	# This exit logic is to ensure a robust CI.	COMMENT
LOW	agentlightning/store/client_server.py	479	# If not API request, just pass through	COMMENT
LOW	agentlightning/store/client_server.py	1016	# If the store is zero-copy, we can just call the method directly.	COMMENT
LOW	agentlightning/store/client_server.py	1026	# If it's already thread-safe, we can just call the method directly.	COMMENT

Magic Placeholder Names3 hits · 12 pts

Severity	File	Line	Snippet	Context
HIGH	docs/how-to/train-sql-agent.md	370	export OPENAI_API_KEY=<your_api_key>	CODE
HIGH	examples/chartqa/README.md	60	export OPENAI_API_KEY=<your-api-key>	CODE
HIGH	examples/unsloth/math_agent.py	8	export OPENAI_API_KEY=your_api_key	STRING

Over-Commented Block14 hits · 12 pts

Severity	File	Line	Snippet	Context
LOW	contrib/recipes/search_r1/qa_em.py	1	# Copyright (c) Microsoft. All rights reserved.	COMMENT
LOW	contrib/recipes/webshop/aml/run_webshop_aml.sh	1	#!/usr/bin/env bash	COMMENT
LOW	contrib/recipes/webshop/scripts/run_stack.sh	1	#!/usr/bin/env bash	COMMENT
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	481	"""	COMMENT
LOW	…ib/agentlightning/contrib/algorithm/env_verl/daemon.py	721	#	COMMENT
LOW	examples/rag/metric_utils.py	161	# # search acc	COMMENT
LOW	examples/spider/spider_eval/evaluation.py	1	# Copyright (c) Microsoft. All rights reserved.	COMMENT
LOW	examples/spider/spider_eval/process_sql.py	1	# Copyright (c) Microsoft. All rights reserved.	COMMENT
LOW	examples/spider/spider_eval/exec_eval.py	181	# db is the database path	COMMENT
LOW	examples/unsloth/sft_algorithm.py	221	console.print(	COMMENT
LOW	agentlightning/tracer/otel.py	401	def _await_in_loop(self, coro: Awaitable[Any], timeout: Optional[float] = None) -> Any:	COMMENT
LOW	agentlightning/verl/daemon.py	421	if resp.status_code == 200:	COMMENT
LOW	agentlightning/store/client_server.py	1021	if method_name == "wait_for_rollouts":	COMMENT
LOW	agentlightning/store/client_server.py	1421	self._request_timeout = state["_request_timeout"]	COMMENT

Verbosity Indicators6 hits · 11 pts

Severity	File	Line	Snippet	Context
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	95	# Step 1: Initialize WebShop Data (if needed)	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	141	# Step 2: Start WebShop Server	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	155	# Step 3: Start Agent Lightning Coordinator	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	174	# Step 4: Wait for Services	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	182	# Step 5: Build and Start Runners	COMMENT
LOW⚡	contrib/recipes/webshop/scripts/run_stack.sh	211	# Step 6: Wait for Training to Complete	COMMENT

Modern AI Meta-Vocabulary3 hits · 9 pts

Severity	File	Line	Snippet	Context
MEDIUM	examples/tinker/q20_agent.py	31	# Keep this short; do NOT ask for chain-of-thought	COMMENT
MEDIUM	examples/rag/README.md	1	# RAG Agent Example	COMMENT
MEDIUM	examples/rag/README.md	122	# 2. Load embedding model	COMMENT

Slop Phrases2 hits · 6 pts

Severity	File	Line	Snippet	Context
MEDIUM	tests/trainer/test_trainer_init.py	66	# By default, strategy is client-server, but you can also use a string alias to specify it again	COMMENT
MEDIUM	examples/apo/apo_debug.py	28	# If you don't need any tracing functionality yet, you can use a dummy OtelTracer.	COMMENT

Fake / Example Data6 hits · 6 pts

Severity	File	Line	Snippet	Context
LOW	docs/tutorials/emitter.md	63	"name": "John Doe",	CODE
LOW	docs/tutorials/emitter.md	79	'agentlightning.object.json': '{"name": "John Doe", "age": 30, "email": "john.doe@example.com"}',	CODE
LOW	docs/tutorials/write-agents.md	91	api_key=llm.api_key or "dummy-key",	CODE
LOW	dashboard/src/pages/Rollouts.page.story.tsx	544	const veryLongInput = `{"prompt":"${'Lorem ipsum dolor sit amet, consectetur adipiscing elit. '.repeat(12)}"}`;	CODE
LOW	dashboard/src/pages/Rollouts.page.story.tsx	544	const veryLongInput = `{"prompt":"${'Lorem ipsum dolor sit amet, consectetur adipiscing elit. '.repeat(12)}"}`;	CODE
LOW	agentlightning/instrumentation/weave.py	225	wb_user_id="dummy_user",	CODE

Example Usage Blocks4 hits · 5 pts

Severity	File	Line	Snippet	Context
LOW	tests/benchmark/utils.py	123	# Example usage	COMMENT
LOW	contrib/recipes/webshop/aml/run_webshop_aml.sh	9	# Usage:	COMMENT
LOW	contrib/recipes/webshop/aml/compute.yml	6	# Usage:	COMMENT
LOW	contrib/recipes/webshop/scripts/run_stack.sh	8	# Usage:	COMMENT

Synthetic Comment Markers1 hit · 5 pts

Severity	File	Line	Snippet	Context
HIGH	RAI_README.md	44	Outputs generated by AI may include factual errors, fabrication, or speculation. Users are responsible for assessing the	CODE

TODO Padding2 hits · 3 pts

Severity	File	Line	Snippet	Context
LOW	…b/agentlightning/contrib/algorithm/env_verl/trainer.py	532	# TODO: implement actual tflpo and theoretical tflpo	COMMENT
LOW	agentlightning/verl/trainer.py	432	# TODO: implement actual tflpo and theoretical tflpo	COMMENT

Overly Generic Function Names2 hits · 2 pts

Severity	File	Line	Snippet	Context
LOW	dashboard/static/mockServiceWorker.js	123	async function handleRequest(event, requestId, requestInterceptedAt) {	CODE
LOW	examples/calc_x/tests/test_agentops.py	10	def process_data(data: str) -> float:	CODE

Analysis Overview

What These Metrics Mean

Score History

Severity Breakdown

Directory Score Breakdown

Pattern Findings