Repository Analysis

Cloud-CV/EvalAI

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

17.6 Moderate AI signal View on GitHub

Analysis Overview

This report presents the forensic synthetic code analysis of Cloud-CV/EvalAI, a Python project with 2,030 GitHub stars. SynthScan v2.0 examined 128,931 lines of code across 674 source files, recording 2237 pattern matches distributed across 19 syntactic categories. The overall adjusted score of 17.6 places this repository in the Moderate AI signal band.

The scanner applied 160+ deterministic lexical heuristics, multi-line block detectors, abstract syntax tree depth profilers, and a cross-file Jaccard similarity matrix to construct a statistically normalised synthetic code estimate. All matches are individually weighted by severity coefficient and contextual multiplier before summation, and the resulting headline score is temporally discounted to account for the repository's development history relative to the commercial emergence of large language model coding tooling (November 2022 onward).

17.6
Adjusted Score
17.6
Raw Score
100%
Time Factor
2026-07-09
Last Push
2.0K
Stars
Python
Language
128.9K
Lines of Code
674
Files
2.2K
Pattern Hits
2026-07-14
Scan Date
0.04
HC Hit Rate

What These Metrics Mean

Adjusted Score
Primary synthetic code indicator. Raw score normalised per 1,000 lines of code and multiplied by the temporal discount factor. This is the definitive comparative metric — use it to rank repositories by AI authorship density.
Raw Score
The unmodified sum of all severity-weighted, context-multiplied pattern match scores before temporal discounting. Reflects the absolute signal strength independent of when the repository was last active.
Time Factor
The temporal discount multiplier (0–100%) applied to the raw score. Repositories last updated before ChatGPT's launch (Nov 2022) receive a 5% factor. Full signal is only assigned to repositories active in the post-adoption era (Jan 2024+).
Pattern Hits
Total count of individual pattern matches across all files and categories. A high hit count with a low score may indicate a very large codebase with isolated AI snippets; a low count with a high score indicates dense, concentrated AI signatures.
HC Hit Rate
High+Critical pattern hits per file, averaged across the repository. This orthogonal signal catches repositories where a few files are densely packed with high-severity AI tells — a strong indicator even when the normalised score appears moderate due to codebase size.
Lines of Code / Files
Total lines and files analysed. The scanner examines 94 file extensions. These denominators are used to normalise the score, enabling fair comparison between repositories of vastly different sizes.

Score History

This chart maps the temporal evolution of the adjusted synthetic code score across successive scan runs. An upward trajectory indicates ongoing incorporation of AI-generated code or expanding LLM-assisted scaffolding; a stable or declining trajectory may reflect active human refactoring, code removal, or the adoption of stricter authorship policies. The dashed secondary line (right axis) independently tracks total raw pattern hit count, which can diverge from the normalised score when codebase size changes significantly between scans.

Severity Breakdown

Classifies detected patterns by their diagnostic confidence and structural impact. CRITICAL patterns (coefficient 10) represent definitive synthetic signatures — hallucinated imports, explicit LLM attribution metadata — virtually never produced by human authors. HIGH (5) indicates strong structural tells such as cross-file repetition or cross-linguistic idioms. MEDIUM (2) covers recognisable conversational padding and AI-specific vocabulary. LOW (1) captures subtle indicators like tautological comments and generic boilerplate that require density to carry independent signal.

CRITICAL 5HIGH 25MEDIUM 48LOW 2159

Directory Score Breakdown

This horizontal bar chart decomposes the repository's raw synthetic code score by top-level directory, allowing you to pinpoint precisely which modules or components carry the highest AI authorship density. Directories with disproportionately high scores relative to their size warrant targeted manual review: concentrated AI signatures often trace back to mass-generated configuration layers, auto-ported test suites, LLM-scaffolded boilerplate classes, or entire subsystems authored under heavy copilot assistance. Use this view to prioritise your human code-review effort.

Pattern Findings

The scanner identified 2237 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a statistically significant AI authorship indicator. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.

Reading the findings table: The Severity column indicates the diagnostic confidence level (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — comment-context matches receive a ×1.5 weight because LLMs systematically over-annotate. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier as dense clusters constitute far stronger evidence of synthetic authorship than isolated hits.

Hyper-Verbose Identifiers1719 hits · 1464 pts
SeverityFileLineSnippetContext
LOW…d/tests/controllers-test/featuredChallengeCtrl.test.js230 function leaderboardWithSubmissionAt(date) {CODE
LOWfrontend/src/js/directives/directives.js164function dashboardFooterController($scope) {CODE
LOWtests/unit/participants/test_utils.py300 def test_get_participant_team_member_count(self):CODE
LOWtests/unit/participants/test_utils.py305 def test_get_effective_max_team_members_returns_none_without_limits(self):CODE
LOWtests/unit/participants/test_utils.py314 def test_get_effective_max_team_members_returns_strictest_limit(self):CODE
LOWtests/unit/participants/test_utils.py350 def test_team_can_add_member_when_below_limit(self):CODE
LOWtests/unit/participants/test_utils.py359 def test_team_can_add_member_when_at_limit(self):CODE
LOWtests/unit/participants/test_utils.py368 def test_team_exceeds_challenge_max_members(self):CODE
LOWtests/unit/participants/test_utils.py24 def test_field_error_for_wrong_related_name(self):CODE
LOWtests/unit/participants/test_utils.py62 def test_returns_team_id_when_user_participated_in_challenge(self):CODE
LOWtests/unit/participants/test_utils.py77 def test_returns_none_when_user_team_not_in_challenge(self):CODE
LOWtests/unit/participants/test_utils.py90 def test_returns_none_when_user_has_no_teams(self):CODE
LOWtests/unit/participants/test_utils.py98 def test_returns_correct_team_when_user_has_multiple_teams(self):CODE
LOWtests/unit/participants/test_utils.py122 def test_returns_none_for_different_user(self):CODE
LOWtests/unit/participants/test_utils.py187 def test_returns_true_when_participated_in_active_require_complete_profile_challenge(CODE
LOWtests/unit/participants/test_utils.py204 def test_returns_false_when_challenge_has_ended(self):CODE
LOWtests/unit/participants/test_utils.py220 def test_returns_true_when_one_active_and_one_ended(self):CODE
LOWtests/unit/participants/test_utils.py244 def test_returns_false_when_participated_in_normal_challenge(self):CODE
LOWtests/unit/participants/test_utils.py259 def test_returns_false_when_not_participated(self):CODE
LOWtests/unit/participants/test_utils.py331 def test_get_team_capacity_blocking_challenge_titles(self):CODE
LOWtests/unit/participants/test_utils.py380 def test_team_does_not_exceed_challenge_when_limit_unset(self):CODE
LOWtests/unit/participants/test_utils.py390 def test_host_only_team_exempt_from_own_challenge_limit(self):CODE
LOWtests/unit/participants/test_utils.py427 def test_mixed_team_not_exempt_from_organizer_challenge(self):CODE
LOWtests/unit/participants/test_utils.py450 def test_team_with_denied_host_not_exempt_from_organizer_challenge(self):CODE
LOWtests/unit/participants/test_utils.py473 def test_host_challenge_exempt_but_other_challenge_still_limits(self):CODE
LOWtests/unit/participants/test_serializers.py30 def test_get_team_members_empty_team(self):CODE
LOWtests/unit/participants/test_serializers.py36 def test_get_team_members_email_ids_empty_team(self):CODE
LOWtests/unit/participants/test_serializers.py42 def test_get_team_members_with_participants(self):CODE
LOWtests/unit/participants/test_serializers.py57 def test_get_team_members_email_ids_with_participants(self):CODE
LOWtests/unit/participants/test_serializers.py74 def test_validate_email_user_does_not_exist(self):CODE
LOWtests/unit/participants/test_serializers.py87 def test_validate_email_self_invite(self):CODE
LOWtests/unit/participants/test_serializers.py133 def test_get_members_returns_all_team_members(self):CODE
LOWtests/unit/participants/test_serializers.py143 def test_get_members_with_prefetched_data(self):CODE
LOWtests/unit/participants/test_serializers.py170 def test_get_members_with_prefetch_avoids_n_plus_one_queries(self):CODE
LOWtests/unit/participants/test_serializers.py200 def test_serializer_includes_all_expected_fields(self):CODE
LOWtests/unit/participants/test_serializers.py239 def test_get_profile_returns_user_profile(self):CODE
LOWtests/unit/participants/test_serializers.py255 def test_get_profile_with_prefetched_profile(self):CODE
LOWtests/unit/participants/test_serializers.py271 def test_member_fields_are_correct(self):CODE
LOWtests/unit/participants/test_serializers.py282 def test_get_profile_creates_profile_when_missing(self):CODE
LOWtests/unit/participants/test_apps.py5def test_participants_config_direct_import():CODE
LOWtests/unit/participants/test_views.py433 # def test_particular_participant_team_delete(self):COMMENT
LOWtests/unit/participants/test_views.py475 def test_invite_participant_to_team_with_all_data(self):CODE
LOWtests/unit/participants/test_views.py481 def test_invite_participant_to_team_with_no_data(self):CODE
LOWtests/unit/participants/test_views.py486 def test_invite_blocked_when_team_at_max_members_for_participated_challenge(CODE
LOWtests/unit/participants/test_views.py682 def test_invite_user_which_does_not_exist_to_team(self):CODE
LOWtests/unit/participants/test_views.py689 def test_particular_participant_team_for_invite_does_not_exist(self):CODE
LOWtests/unit/participants/test_views.py699 def test_invite_when_team_participants_emails_are_banned(self):CODE
LOWtests/unit/participants/test_views.py1368 def test_get_teams_and_corresponding_challenges_for_a_participant_team_with_no_challenges( # noqa: E501CODE
LOWtests/unit/participants/test_views.py1810 def test_remove_participant_team_success(self):CODE
LOWtests/unit/participants/test_views.py1815 def test_remove_participant_team_when_user_is_not_authorized(self):CODE
LOWtests/unit/participants/test_views.py1824 def test_remove_participant_team_when_not_participated(self):CODE
LOWtests/unit/participants/test_views.py1832 def test_remove_participant_team_when_team_has_submissions(self):CODE
LOWtests/unit/participants/test_views.py144 def test_no_n_plus_one_queries_for_participant_teams(self):CODE
LOWtests/unit/participants/test_views.py259 def test_create_participant_team_with_all_data(self):CODE
LOWtests/unit/participants/test_views.py263 def test_create_participant_team_with_team_name_same_as_with_existing_team(CODE
LOWtests/unit/participants/test_views.py280 def test_create_participant_team_with_no_data(self):CODE
LOWtests/unit/participants/test_views.py315 def test_get_particular_participant_team(self):CODE
LOWtests/unit/participants/test_views.py368 def test_particular_participant_team_does_not_exist(self):CODE
LOWtests/unit/participants/test_views.py393 def test_particular_participant_team_partial_update(self):CODE
LOWtests/unit/participants/test_views.py407 def test_particular_participant_team_update(self):CODE
1659 more matches not shown…
Excessive Try-Catch Wrapping104 hits · 112 pts
SeverityFileLineSnippetContext
LOWtests/unit/worker/test_code_upload_submission_worker.py214 except Exception as e:CODE
LOWdocs/superpowers/plans/2026-06-06-scout.md2166 except Exception:CODE
LOWscripts/seed.py777 except Exception as exc:CODE
LOWscripts/tools/list_ongoing_challenges_s3_usage.py97 except Exception:CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py279 except Exception as e:CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py362 except Exception:CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py396 except Exception as e:CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py427 except Exception as e:CODE
LOWscripts/tools/cleanup_data/s3_orphans.py370 except Exception as e:CODE
LOWscripts/tools/cleanup_data/s3_orphans.py491 except Exception as e:CODE
LOWscripts/tools/cleanup_data/s3_orphans.py512 except Exception as e:CODE
LOWscripts/tools/cleanup_data/s3.py224 except Exception:CODE
LOWscripts/tools/cleanup_data/s3.py304 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py121 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py452 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py570 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py575 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py663 except Exception as e:CODE
LOWscripts/workers/code_upload_submission_worker.py795 except Exception as e:CODE
MEDIUMscripts/workers/code_upload_submission_worker.py107def create_configmap(core_v1_api_instance, config_map):CODE
MEDIUMscripts/workers/remote_submission_worker.py258def process_submission_callback(body):CODE
LOWscripts/workers/remote_submission_worker.py112 except Exception as e:CODE
LOWscripts/workers/remote_submission_worker.py129 except Exception as e:CODE
LOWscripts/workers/remote_submission_worker.py250 except Exception:CODE
LOWscripts/workers/remote_submission_worker.py262 except Exception as e:CODE
LOWscripts/workers/remote_submission_worker.py147 except Exception as e:CODE
LOWscripts/workers/remote_submission_worker.py190 except Exception:CODE
LOWscripts/workers/remote_submission_worker.py539 except Exception:CODE
MEDIUMscripts/workers/submission_worker.py846def process_submission_callback(body):CODE
LOWscripts/workers/submission_worker.py197 except Exception as e:CODE
LOWscripts/workers/submission_worker.py215 except Exception as e:CODE
LOWscripts/workers/submission_worker.py250 except Exception as e:CODE
LOWscripts/workers/submission_worker.py261 except Exception as e:CODE
LOWscripts/workers/submission_worker.py644 except Exception:CODE
LOWscripts/workers/submission_worker.py657 except Exception:CODE
LOWscripts/workers/submission_worker.py157 except Exception as e:CODE
LOWscripts/workers/submission_worker.py236 except Exception as e:CODE
LOWscripts/workers/submission_worker.py359 except Exception as e:CODE
LOWscripts/workers/submission_worker.py397 except Exception:CODE
LOWscripts/workers/submission_worker.py550 except Exception:CODE
LOWscripts/workers/submission_worker.py692 except Exception:CODE
LOWscripts/workers/submission_worker.py856 except Exception as e:CODE
LOWscripts/monitoring/monitor_containers.py43 except Exception:CODE
LOWscripts/monitoring/monitor_containers.py109 except Exception:CODE
LOWscripts/monitoring/monitor_containers.py143 except Exception:CODE
MEDIUMscripts/monitoring/monitor_containers.py105def get_docker_client():CODE
LOWscripts/monitoring/auto_scale_ec2_workers.py92 except Exception as e: # noqa: F841CODE
LOWscripts/monitoring/auto_scale_ec2_workers.py121 except Exception as e:CODE
MEDIUMscripts/monitoring/auto_scale_ec2_workers.py84def start_or_stop_workers(challenge, evalai_interface):CODE
LOWscripts/monitoring/auto_cancel_submissions.py59 except Exception as e:CODE
LOWscripts/monitoring/auto_scale_eks_nodes.py189 except Exception as e: # noqa: F841CODE
LOWscripts/monitoring/auto_scale_eks_nodes.py286 except Exception as e:CODE
MEDIUMscripts/monitoring/auto_scale_eks_nodes.py175def scale_up_or_down_workers(CODE
LOWscripts/monitoring/auto_scale_workers.py64 except Exception: # noqa: F841CODE
LOWscripts/monitoring/auto_scale_workers.py96 except Exception as e:CODE
LOWscripts/monitoring/auto_scale_workers.py101 except Exception as e:CODE
LOWscripts/monitoring/auto_scale_workers.py116 except Exception as e:CODE
MEDIUMscripts/monitoring/auto_scale_workers.py61def scale_up_or_down_workers(challenge, challenge_metrics):CODE
LOWscripts/migration/set_phase_slug_as_unique.py25 except Exception as e:CODE
LOWscripts/migration/set_monthly_submission_limit.py11except Exception as e:CODE
44 more matches not shown…
Self-Referential Comments31 hits · 101 pts
SeverityFileLineSnippetContext
MEDIUMtests/unit/participants/test_views.py1372 # Create a second team for the user that has no challengesCOMMENT
MEDIUMtests/unit/participants/test_views.py164 # Create a new user for each teamCOMMENT
MEDIUMtests/unit/participants/test_views.py177 # Create the teamCOMMENT
MEDIUMtests/unit/challenges/test_serializers.py888 # Create an existing ChallengeConfigurationCOMMENT
MEDIUMtests/unit/challenges/test_serializers.py911 # Create an existing ChallengeConfigurationCOMMENT
MEDIUMtests/unit/challenges/test_admin_filters.py11 # Create a userCOMMENT
MEDIUMtests/unit/challenges/test_admin_filters.py16 # Create a challenge host teamCOMMENT
MEDIUMtests/unit/challenges/test_challenge_config_utils.py44 # Create a zip file in memory with no YAML filesCOMMENT
MEDIUMtests/unit/challenges/test_challenge_config_utils.py68 # Create a mock exception with problem and problem_mark attributesCOMMENT
MEDIUMtests/unit/challenges/test_challenge_config_utils.py89 # Create a mock exception without problem and problem_mark attributesCOMMENT
MEDIUMtests/unit/challenges/test_challenge_config_utils.py217 # Create a challenge host teamCOMMENT
MEDIUMtests/unit/challenges/test_views.py7067 # Create a annotation using multipart uploadCOMMENT
MEDIUMtests/unit/challenges/test_views.py6598 # Create a user who unstarred (is_starred=False)COMMENT
MEDIUMtests/unit/challenges/test_views.py7454 # Create a different user who is not a challenge hostCOMMENT
MEDIUMtests/unit/challenges/test_views.py7560 # Create a finished submission for the additional phase to satisfy the submission check # noqa: C0301COMMENT
MEDIUMtests/unit/challenges/test_views.py7613 # Create a challenge phase without finished submissionsCOMMENT
MEDIUMtests/unit/challenges/test_aws_utils.py784 # Creating a mock challenge objectCOMMENT
MEDIUMtests/unit/challenges/test_aws_utils.py824 # Creating a mock challenge objectCOMMENT
MEDIUMtests/unit/challenges/test_aws_utils.py854 # Creating a mock challenge objectCOMMENT
MEDIUMtests/unit/challenges/test_aws_utils.py879 # Creating a mock challenge objectCOMMENT
MEDIUMtests/unit/hosts/test_views.py557 # Create a new user and make a request using this user which doesn'tCOMMENT
MEDIUMtests/unit/jobs/test_views.py2898 # Create a submission using multipart uploadCOMMENT
MEDIUMtests/unit/worker/test_code_upload_submission_worker.py174 # Define the mock config mapCOMMENT
MEDIUMtests/unit/worker/test_code_upload_submission_worker.py195 # Define the mock config mapCOMMENT
MEDIUMtests/unit/worker/test_code_upload_submission_worker.py284 ) # Create a mock for V1JobSpec or provide a mock spec if you have oneCODE
MEDIUMdocs/source/conf.py6# This file is execfile()d with the current directory set to itsCOMMENT
MEDIUMscripts/seed.py673 # Create a leaderboard object for each challengeCOMMENT
MEDIUMscripts/workers/code_upload_submission_worker.py269 # Create the specification of deploymentCOMMENT
MEDIUMscripts/workers/code_upload_submission_worker.py385 # Create the specification of deploymentCOMMENT
MEDIUMapps/base/utils.py55 # Create a new paginator instance for each request to avoid shared stateCOMMENT
MEDIUMapps/base/utils.py69 # Create a new paginator instance for each request to avoid shared stateCOMMENT
Structural Annotation Overuse47 hits · 100 pts
SeverityFileLineSnippetContext
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md26### Step 1: Use templateCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md33### Step 2: Generate github tokenCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md39### Step 3: Setup host configurationCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md48### Step 4: Setup automated update pushCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md56### Step 5: Update challenge detailsCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md60### Step 6: Push changes to the challengeCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md68### Step 7: Verify challengeCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md76### Step 1: Setup challenge configurationCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md80### Step 2: Edit challenge configurationCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md86### Step 3: Edit evaluation scriptCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md92### Step 4: Edit challenge HTML templatesCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md98### Step 5: Upload configuration on EvalAICOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md108### Step 1: Set up the challengeCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md112### Step 2: Edit challenge configurationCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md124### Step 3: Edit remote evaluation scriptCOMMENT
LOW…02-for-challenge-hosts/hosting-guide/host-challenge.md129### Step 4: Set up remote evaluation workerCOMMENT
LOW…-for-challenge-hosts/hosting-guide/approval-process.md11### Step 1: Approve challenge using django adminCOMMENT
LOW…-for-challenge-hosts/hosting-guide/approval-process.md26### Step 2: Reload submission workerCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md11## Step 1: Create a repository from EvalAI-StartersCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md19## Step 2: Configure GitHub secretsCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md24## Step 3: Collect EvalAI credentialsCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md34## Step 4: Use the `challenge` branchCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md42## Step 5: Configure the challengeCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md50## Step 6: Push and verify the buildCOMMENT
LOW…2-for-challenge-hosts/hosting-guide/getting-started.md61## Step 7: ApprovalCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md20### Step 1: Prepare Your Baseline SubmissionCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md25### Step 2: Submit the BaselineCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md32### Step 3: Open the My Submissions TabCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md36### Step 4: Locate the SubmissionCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md40### Step 5: Mark the Submission as BaselineCOMMENT
LOW…03-for-participants/visibility/baseline-submissions.md44### Step 6: Confirm Baseline DisplayCOMMENT
LOW…or-participants/participation-guide/getting-started.md5## Step 1: Visit EvalAICOMMENT
LOW…or-participants/participation-guide/getting-started.md11## Step 2: Sign up or log inCOMMENT
LOW…or-participants/participation-guide/getting-started.md21## Step 3: Choose a challengeCOMMENT
LOW…or-participants/participation-guide/getting-started.md27## Step 4: Read the challenge pageCOMMENT
LOW…or-participants/participation-guide/getting-started.md33## Step 5: Create or select a participant teamCOMMENT
LOW…or-participants/participation-guide/getting-started.md39## Step 6: ParticipateCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh3# Step 1: Updating package repositoryCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh7# Step 2: Cloning EvalAI repository at /home/ubuntuCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh13# Step 3: Installing awscliCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh17# Step 4: Installing Docker Compose plugin (v2)COMMENT
LOWscripts/deployment/deploy_ec2_worker.sh22# Step 5: Adding user to docker groupCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh28# Step 6: Configuring AWS credentialsCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh39# Step 7: Copying Docker environment fileCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh57 # Step 8: Pulling worker Docker imageCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh67# Step 9: Running worker Docker containerCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh85# Step 10: Setting up crontabCOMMENT
Redundant / Tautological Comments48 hits · 76 pts
SeverityFileLineSnippetContext
LOWsettings/prod.py104 # Set traces_sample_rate to 1.0 to capture 100% of transactions forCOMMENT
LOWsettings/prod.py107 # Set profiles_sample_rate to 1.0 to profile 100% of sampled transactions.COMMENT
LOWtests/unit/challenges/test_utils.py450 # Check if send_email was called for each emailCOMMENT
LOWtests/unit/challenges/test_views.py7011 # Check if all fields for cli existsCOMMENT
LOWtests/unit/challenges/test_aws_utils.py3193 # Check if the first argument of logger.exception contains the correctCOMMENT
LOWtests/unit/challenges/test_aws_utils.py3403 # Check if the actual error message contains the expected messageCOMMENT
LOWtests/unit/challenges/test_aws_utils.py3647 # Check if start_ec2_instance was called since the EC2 instance alreadyCOMMENT
LOWtests/unit/challenges/test_aws_utils.py3667 # Check if create_ec2_instance was called since the EC2 instanceCOMMENT
LOWtests/unit/worker/test_remote_submission_worker.py404 # Check if logger.info was calledCOMMENT
LOWtests/unit/worker/test_remote_submission_worker.py354 # Check if logger.info was calledCOMMENT
LOWtests/unit/worker/test_remote_submission_worker.py379 # Check if logger.info was calledCOMMENT
LOWtests/unit/worker/test_code_upload_submission_worker.py114 # Check if V1ObjectMeta was called with the right parametersCOMMENT
LOWtests/unit/worker/test_code_upload_submission_worker.py117 # Check if V1ConfigMap was called with the right parametersCOMMENT
LOWtests/unit/worker/test_code_upload_submission_worker.py125 # Check if the correct ConfigMap object is returnedCOMMENT
LOWtests/unit/worker/test_code_upload_submission_worker.py185 # Check if the CoreV1Api method was called with the right parametersCOMMENT
LOWscripts/tools/cleanup_code.sh14 # Check if file is stagedCOMMENT
LOWscripts/tools/cleanup_data/set_challenge_end_date.py61 # Set time to 23:59:59 UTCCOMMENT
LOWscripts/tools/cleanup_data/s3_orphans.py347 # Check if referenced (check both with and without prefix)COMMENT
LOWscripts/workers/submission_worker.py637 # Check if the challenge_phase_split exists for theCOMMENT
LOWscripts/workers/submission_worker.py653 # Check if the dataset_split exists for the codename in theCOMMENT
LOWscripts/workers/submission_worker.py695 # Set submission_output to None to handle case when evaluation script throws exceptionCOMMENT
LOWscripts/workers/submission_worker.py894 # Check if the queue exists. If no, then create oneCOMMENT
LOWapps/participants/views.py257 # Check if team participants emails are bannedCOMMENT
LOWapps/participants/views.py275 # Check if invited user is bannedCOMMENT
LOWapps/participants/views.py286 # Check if user is in allowed list.COMMENT
LOWapps/participants/views.py299 # Check if user is in blocked list.COMMENT
LOWapps/challenges/aws_utils.py1248 ): # Verify if the challenge is new (i.e, service not yet created.).CODE
LOWapps/challenges/utils.py852 # Check if the sponsor exist in database. but not in the YAML file.COMMENT
LOWapps/challenges/views.py583 # Check if user is bannedCOMMENT
LOWapps/challenges/views.py596 # Check if user is in allowed list.COMMENT
LOWapps/challenges/views.py617 # Check if user is in blocked list.COMMENT
LOWapps/challenges/views.py627 # Check if challenge requires complete profileCOMMENT
LOWapps/challenges/views.py1305 # Check if user is a challenge host or staffCOMMENT
LOWapps/challenges/views.py4203 # Check if the challenge phase exists or notCOMMENT
LOWapps/challenges/views.py4287 # Check if the challenge phase exists or notCOMMENT
LOWapps/challenges/views.py5322 # Check if the user is a host of this challengeCOMMENT
LOWapps/hosts/views.py285 # Check if the user requesting this API is part of host teamCOMMENT
LOWapps/jobs/sender.py56 # Check if the queue exists. If not, then create one.COMMENT
LOWapps/jobs/utils.py384 # Check if challenge phase leaderboard is public for participant user orCOMMENT
LOWapps/jobs/views.py2930 # Check if the challenge phase exists or notCOMMENT
LOWapps/jobs/views.py2943 # Check if challenge phase is activeCOMMENT
LOWapps/jobs/views.py2954 # Check if user is a challenge host or a participantCOMMENT
LOWapps/jobs/views.py2957 # Check if challenge phase is public and accepting solutionsCOMMENT
LOWapps/jobs/views.py3123 # Check if the challenge phase exists or notCOMMENT
LOWapps/jobs/views.py3136 # Check if challenge phase is activeCOMMENT
LOWapps/jobs/views.py3147 # Check if user is a challenge host or a participantCOMMENT
LOWapps/jobs/views.py3149 # Check if challenge phase is public and accepting solutionsCOMMENT
LOWapps/base/utils.py378 # Check if the queue exists. If no, then create oneCOMMENT
Cross-File Repetition12 hits · 60 pts
SeverityFileLineSnippetContext
HIGHdocs/superpowers/plans/2026-06-06-scout.md0one row per webhook delivery — audit trail of raw yutori payloads.STRING
HIGH…superpowers/specs/2026-06-06-yutori-scouting-design.md0one row per webhook delivery — audit trail of raw yutori payloads.STRING
HIGHapps/scout/models.py0one row per webhook delivery — audit trail of raw yutori payloads.STRING
HIGHdocs/superpowers/plans/2026-06-06-scout.md0a deduped benchmark/challenge discovered by the scout.STRING
HIGH…superpowers/specs/2026-06-06-yutori-scouting-design.md0a deduped benchmark/challenge discovered by the scout.STRING
HIGHapps/scout/models.py0a deduped benchmark/challenge discovered by the scout.STRING
HIGH…ripts/tools/cleanup_data/orphaned_challenge_configs.py0simple logger that writes to both console and file.STRING
HIGHscripts/tools/cleanup_data/s3_orphans.py0simple logger that writes to both console and file.STRING
HIGHscripts/tools/cleanup_data/s3.py0simple logger that writes to both console and file.STRING
HIGH…ripts/tools/cleanup_data/orphaned_challenge_configs.py0get boto3 s3 client and bucket name from django-storages settings.STRING
HIGHscripts/tools/cleanup_data/s3_orphans.py0get boto3 s3 client and bucket name from django-storages settings.STRING
HIGHscripts/tools/cleanup_data/s3.py0get boto3 s3 client and bucket name from django-storages settings.STRING
Fake / Example Data67 hits · 58 pts
SeverityFileLineSnippetContext
LOWfrontend/tests/controllers-test/challengeCtrl.test.js3140 userKey = 'dummy-token';CODE
LOWfrontend/tests/controllers-test/challengeCtrl.test.js3377 var userKey = "dummy-token";CODE
LOWfrontend/tests/controllers-test/challengeCtrl.test.js3419 expect(opts.headers.Authorization).toBe("Token dummy-token");CODE
LOWfrontend/tests/controllers-test/challengeCtrl.test.js4042 userKey = 'dummy-token';CODE
LOWtests/unit/participants/test_views.py711 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py711 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py747 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py747 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py780 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py780 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py815 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py815 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py1201 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py1201 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py1789 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/participants/test_views.py1789 leaderboard_description="Lorem ipsum dolor sit amet, consectetur adipiscing elit",CODE
LOWtests/unit/challenges/test_admin.py285 email="admin@example.com",CODE
LOWtests/unit/challenges/test_utils.py628 profile.address_street = "123 Main St"CODE
LOWtests/unit/challenges/test_views.py545 "leaderboard_description": "Lorem ipsum dolor sit amet, consectetur adipiscing elit.", # noqa: C0301CODE
LOWtests/unit/challenges/test_views.py545 "leaderboard_description": "Lorem ipsum dolor sit amet, consectetur adipiscing elit.", # noqa: C0301CODE
LOWtests/unit/challenges/test_views.py7077 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/challenges/test_views.py1471 profile.address_street = "123 Main St"CODE
LOWtests/unit/challenges/test_views.py7042 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/accounts/test_adapter.py96 self.adapter.clean_email("admin@example.com")CODE
LOWtests/unit/accounts/test_throttles.py46 self.assertIn("user@example.com", cache_key)CODE
LOWtests/unit/accounts/test_models.py41 self.profile.address_street = "123 Main St"CODE
LOWtests/unit/accounts/test_models.py63 self.profile.address_street = "123 Main St"CODE
LOWtests/unit/accounts/test_models.py76 self.profile.address_street = "123 Main St"CODE
LOWtests/unit/accounts/test_models.py89 self.profile.address_street = "123 Main St"CODE
LOWtests/unit/accounts/test_models.py102 self.assertEqual(self.profile.get_full_name(), "John Doe")CODE
LOWtests/unit/jobs/test_serializer.py120 email="test@test.com",CODE
LOWtests/unit/jobs/test_views.py2906 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py2869 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py2981 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py3017 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py3048 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py3113 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py3189 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/jobs/test_views.py3256 "AWS_ACCESS_KEY_ID": "dummy-key",CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py835 "aws_eks_bearer_token": "fake-token"CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py850 MockConfiguration().api_key["authorization"] = "fake-token"CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py865 "aws_eks_bearer_token": "fake-token"CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py880 MockConfiguration().api_key["authorization"] = "fake-token"CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py897 "aws_eks_bearer_token": "fake-token"CODE
LOWtests/unit/worker/test_code_upload_submission_worker.py912 MockConfiguration().api_key["authorization"] = "fake-token"CODE
LOWtests/unit/worker/test_worker_utils.py11 self.AUTH_TOKEN = "dummy_token"CODE
LOWtests/unit/worker/test_worker_utils.py23 self.assertEqual(headers, {"Authorization": "Bearer dummy_token"})CODE
LOWtests/unit/monitoring/test_evalai_interface.py11 self.AUTH_TOKEN = "dummy_token"CODE
LOWtests/unit/monitoring/test_evalai_interface.py17 self.assertEqual(headers, {"Authorization": "Bearer dummy_token"})CODE
LOWtests/unit/monitoring/test_evalai_interface.py24 "Authorization": "Bearer dummy_token",CODE
LOWexamples/example2/test_zip_file/evaluation_details.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…xample2/test_zip_file/challenge_phase_description.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…ples/example2/test_zip_file/submission_guidelines.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOWexamples/example2/test_zip_file/description.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…mples/example2/test_zip_file/terms_and_conditions.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOWexamples/example4/test_zip_file/evaluation_details.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…xample4/test_zip_file/challenge_phase_description.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…ples/example4/test_zip_file/submission_guidelines.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOWexamples/example4/test_zip_file/description.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
LOW…mples/example4/test_zip_file/terms_and_conditions.html2 <p><span style="font-weight: 400;">Lorem Ipsum is simply dummy text of the printing and typesetting industry. LoCODE
7 more matches not shown…
Hallucination Indicators5 hits · 55 pts
SeverityFileLineSnippetContext
CRITICALtests/unit/participants/test_utils.py5from django.core.exceptions import FieldErrorCODE
CRITICALtests/unit/accounts/test_adapter.py7from django.core.exceptions import ValidationErrorCODE
CRITICALapps/challenges/serializers.py9from django.core.exceptions import ValidationError as DjangoValidationErrorCODE
CRITICALapps/challenges/utils.py16from django.core.exceptions import ValidationErrorCODE
CRITICALapps/accounts/adapter.py8from django.core.exceptions import ValidationErrorCODE
Cross-Language Confusion12 hits · 50 pts
SeverityFileLineSnippetContext
HIGHtests/unit/participants/test_views.py1371 """Participant team with no challenges returns (null, team) entry."""STRING
HIGHtests/unit/worker/test_code_upload_submission_worker.py321 "apt update && apt install -y curl && curl_command",CODE
HIGHtests/unit/worker/test_code_upload_submission_worker.py631 "apt update && apt install -y curl && sh /evalai_scripts/monitor_submission.sh",CODE
HIGHscripts/seed.py69 "To force re-seed, run: python manage.py flush && python manage.py seed"CODE
HIGHscripts/tools/list_ongoing_challenges_s3_usage.py133 and (end_date >= now or end_date is null).STRING
HIGHscripts/tools/list_ongoing_challenges_s3_usage.py136 "Fetching present/ongoing challenges (approved_by_admin, start_date <= now, end_date >= now or null)..."CODE
HIGHscripts/workers/code_upload_submission_worker.py182 "apt update && apt install -y curl && {}".format(curl_request),CODE
HIGHscripts/workers/code_upload_submission_worker.py360 "apt update && apt install -y curl && sh /evalai_scripts/monitor_submission.sh",CODE
HIGHapps/jobs/views.py812 "next": null,STRING
HIGHapps/jobs/views.py813 "previous": null,STRING
HIGHapps/jobs/views.py826 "error": null,STRING
HIGHapps/jobs/views.py836 "submission__submission_metadata": null,STRING
Deep Nesting54 hits · 38 pts
SeverityFileLineSnippetContext
LOWtests/unit/challenges/test_views.py5173CODE
LOWtests/unit/challenges/test_views.py6054CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py237CODE
LOW…ripts/tools/cleanup_data/orphaned_challenge_configs.py292CODE
LOWscripts/tools/cleanup_data/set_challenge_end_date.py106CODE
LOWscripts/tools/cleanup_data/s3_orphans.py299CODE
LOWscripts/tools/cleanup_data/s3_orphans.py386CODE
LOWscripts/tools/cleanup_data/s3_orphans.py426CODE
LOWscripts/tools/cleanup_data/s3.py234CODE
LOWscripts/workers/code_upload_submission_worker.py583CODE
LOWscripts/workers/code_upload_submission_worker.py707CODE
LOWscripts/workers/remote_submission_worker.py343CODE
LOWscripts/workers/remote_submission_worker.py589CODE
LOWscripts/workers/submission_worker.py150CODE
LOWscripts/workers/submission_worker.py223CODE
LOWscripts/workers/submission_worker.py254CODE
LOWscripts/workers/submission_worker.py483CODE
LOWscripts/workers/submission_worker.py932CODE
LOWscripts/monitoring/auto_stop_workers.py72CODE
LOWapps/participants/views.py143CODE
LOWapps/participants/views.py202CODE
LOWapps/participants/views.py596CODE
LOWapps/challenges/aws_utils.py1366CODE
LOWapps/challenges/aws_utils.py1492CODE
LOWapps/challenges/aws_utils.py2277CODE
LOWapps/challenges/aws_utils.py2794CODE
LOWapps/challenges/utils.py46CODE
LOWapps/challenges/utils.py816CODE
LOWapps/challenges/permissions.py14CODE
LOWapps/challenges/challenge_config_utils.py664CODE
LOWapps/challenges/challenge_config_utils.py741CODE
LOWapps/challenges/challenge_config_utils.py818CODE
LOWapps/challenges/challenge_config_utils.py990CODE
LOWapps/challenges/challenge_config_utils.py1162CODE
LOWapps/challenges/views.py241CODE
LOWapps/challenges/views.py379CODE
LOWapps/challenges/views.py1212CODE
LOWapps/challenges/views.py1324CODE
LOWapps/challenges/views.py2485CODE
LOWapps/challenges/views.py3333CODE
LOWapps/challenges/views.py3415CODE
LOWapps/challenges/views.py3873CODE
LOWapps/challenges/views.py4272CODE
LOWapps/challenges/views.py4359CODE
LOWapps/challenges/views.py5212CODE
LOWapps/scout/views.py18CODE
LOWapps/accounts/serializers.py129CODE
LOW…accounts/management/commands/merge_duplicate_emails.py135CODE
LOWapps/jobs/s3_retention.py207CODE
LOWapps/jobs/views.py149CODE
LOWapps/jobs/views.py455CODE
LOWapps/jobs/views.py1057CODE
LOWapps/jobs/views.py1267CODE
LOWapps/jobs/views.py1748CODE
AI Structural Patterns45 hits · 35 pts
SeverityFileLineSnippetContext
LOWscripts/workers/worker_utils.py54CODE
LOWscripts/workers/worker_utils.py61CODE
LOWscripts/workers/worker_utils.py67CODE
LOWscripts/workers/worker_utils.py75CODE
LOWscripts/workers/worker_utils.py81CODE
LOWscripts/workers/worker_utils.py89CODE
LOWscripts/workers/worker_utils.py95CODE
LOWscripts/workers/worker_utils.py101CODE
LOWscripts/workers/worker_utils.py107CODE
LOWscripts/workers/worker_utils.py113CODE
LOWscripts/workers/remote_submission_worker.py410CODE
LOWscripts/workers/remote_submission_worker.py419CODE
LOWscripts/workers/remote_submission_worker.py426CODE
LOWscripts/workers/remote_submission_worker.py433CODE
LOWscripts/workers/remote_submission_worker.py440CODE
LOWscripts/workers/remote_submission_worker.py449CODE
LOWscripts/workers/remote_submission_worker.py456CODE
LOWscripts/workers/remote_submission_worker.py463CODE
LOWscripts/monitoring/monitor_containers.py87CODE
LOWscripts/monitoring/monitor_containers.py102CODE
LOWscripts/monitoring/evalai_interface.py63CODE
LOWscripts/monitoring/evalai_interface.py70CODE
LOWscripts/monitoring/evalai_interface.py76CODE
LOWscripts/monitoring/evalai_interface.py84CODE
LOWscripts/monitoring/evalai_interface.py90CODE
LOWscripts/monitoring/evalai_interface.py98CODE
LOWscripts/monitoring/evalai_interface.py104CODE
LOWscripts/monitoring/evalai_interface.py110CODE
LOWscripts/monitoring/evalai_interface.py116CODE
LOWscripts/monitoring/evalai_interface.py122CODE
LOWscripts/monitoring/evalai_interface.py128CODE
LOWscripts/monitoring/evalai_interface.py134CODE
LOWscripts/monitoring/evalai_interface.py143CODE
LOWscripts/monitoring/evalai_interface.py149CODE
LOWscripts/monitoring/evalai_interface.py156CODE
LOWscripts/monitoring/evalai_interface.py163CODE
LOWscripts/monitoring/evalai_interface.py170CODE
LOWscripts/monitoring/evalai_interface.py177CODE
LOWscripts/monitoring/evalai_interface.py185CODE
LOWscripts/monitoring/auto_stop_workers.py28CODE
LOWscripts/monitoring/auto_stop_workers.py36CODE
LOWscripts/monitoring/auto_stop_workers.py48CODE
LOWscripts/monitoring/auto_scale_eks_nodes.py101CODE
LOWscripts/monitoring/auto_scale_eks_nodes.py118CODE
LOWapps/challenges/utils.py513CODE
Modern Structural Boilerplate27 hits · 28 pts
SeverityFileLineSnippetContext
LOWscripts/workers/worker_utils.py5logger = logging.getLogger(__name__)CODE
LOWscripts/workers/code_upload_submission_worker.py35logger = logging.getLogger(__name__)CODE
LOWscripts/workers/remote_submission_worker.py28logger = logging.getLogger(__name__)CODE
LOWscripts/workers/submission_worker.py65logger = logging.getLogger(__name__)CODE
LOWscripts/monitoring/evalai_interface.py5logger = logging.getLogger(__name__)CODE
LOWapps/web/views.py22logger = logging.getLogger(__name__)CODE
LOWapps/challenges/challenge_notification_util.py5logger = logging.getLogger(__name__)CODE
LOWapps/challenges/aws_utils.py46logger = logging.getLogger(__name__)CODE
LOWapps/challenges/utils.py33logger = logging.getLogger(__name__)CODE
LOWapps/challenges/challenge_config_utils.py38logger = logging.getLogger(__name__)CODE
LOWapps/challenges/views.py178logger = logging.getLogger(__name__)CODE
LOWapps/scout/tasks.py10logger = logging.getLogger(__name__)CODE
LOWapps/scout/views.py13logger = logging.getLogger(__name__)CODE
LOWapps/accounts/tasks.py10logger = logging.getLogger(__name__)CODE
LOWapps/accounts/adapter.py10logger = logging.getLogger(__name__)CODE
LOWapps/accounts/bounce_handler.py11logger = logging.getLogger(__name__)CODE
LOWapps/accounts/views.py34logger = logging.getLogger(__name__)CODE
LOW…accounts/management/commands/merge_duplicate_emails.py18logger = logging.getLogger(__name__)CODE
LOWapps/jobs/sender.py17logger = logging.getLogger(__name__)CODE
LOWapps/jobs/tasks.py20logger = logging.getLogger(__name__)CODE
LOWapps/jobs/models.py19logger = logging.getLogger(__name__)CODE
LOWapps/jobs/admin.py18logger = logging.getLogger(__name__)CODE
LOWapps/jobs/utils.py29logger = logging.getLogger(__name__)CODE
LOWapps/jobs/s3_retention.py10logger = logging.getLogger(__name__)CODE
LOWapps/jobs/views.py98logger = logging.getLogger(__name__)CODE
LOWapps/base/models.py8logger = logging.getLogger(__name__)CODE
LOWapps/base/utils.py26logger = logging.getLogger(__name__)CODE
Unused Imports31 hits · 27 pts
SeverityFileLineSnippetContext
LOWmanage.py14CODE
LOWsettings/test.py1CODE
LOWsettings/dev.py3CODE
LOWsettings/prod.py7CODE
LOWsettings/staging.py1CODE
LOWscripts/workers/remote_submission_worker.py1CODE
LOWscripts/workers/remote_submission_worker.py1CODE
LOWscripts/workers/remote_submission_worker.py1CODE
LOWscripts/workers/remote_submission_worker.py1CODE
LOWscripts/workers/submission_worker.py1CODE
LOWscripts/workers/submission_worker.py1CODE
LOWscripts/workers/submission_worker.py1CODE
LOWscripts/workers/submission_worker.py1CODE
LOWapps/participants/models.py1CODE
LOWapps/participants/apps.py1CODE
LOWapps/web/models.py1CODE
LOWapps/web/apps.py1CODE
LOWapps/challenges/models.py1CODE
LOWapps/challenges/apps.py1CODE
LOWapps/scout/models.py1CODE
LOWapps/scout/apps.py1CODE
LOWapps/accounts/models.py1CODE
LOWapps/accounts/apps.py1CODE
LOWapps/hosts/models.py1CODE
LOWapps/hosts/apps.py1CODE
LOWapps/jobs/sender.py1CODE
LOWapps/jobs/models.py1CODE
LOWapps/jobs/apps.py1CODE
LOWapps/base/models.py1CODE
LOWapps/base/apps.py1CODE
LOWapps/analytics/apps.py1CODE
Verbosity Indicators10 hits · 21 pts
SeverityFileLineSnippetContext
LOWscripts/deployment/deploy_ec2_worker.sh3# Step 1: Updating package repositoryCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh7# Step 2: Cloning EvalAI repository at /home/ubuntuCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh13# Step 3: Installing awscliCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh17# Step 4: Installing Docker Compose plugin (v2)COMMENT
LOWscripts/deployment/deploy_ec2_worker.sh22# Step 5: Adding user to docker groupCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh28# Step 6: Configuring AWS credentialsCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh39# Step 7: Copying Docker environment fileCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh57 # Step 8: Pulling worker Docker imageCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh67# Step 9: Running worker Docker containerCOMMENT
LOWscripts/deployment/deploy_ec2_worker.sh85# Step 10: Setting up crontabCOMMENT
Decorative Section Separators6 hits · 18 pts
SeverityFileLineSnippetContext
MEDIUMscripts/tools/cleanup_data/s3_orphans.py88# =============================================================================COMMENT
MEDIUMscripts/tools/cleanup_data/s3_orphans.py90# =============================================================================COMMENT
MEDIUMscripts/tools/cleanup_data/s3_orphans.py107# =============================================================================COMMENT
MEDIUMscripts/tools/cleanup_data/s3.py54# =============================================================================COMMENT
MEDIUMscripts/tools/cleanup_data/s3.py56# =============================================================================COMMENT
MEDIUMscripts/tools/cleanup_data/s3.py76# =============================================================================COMMENT
Over-Commented Block15 hits · 15 pts
SeverityFileLineSnippetContext
LOW.coderabbit.yaml1# yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.jsonCOMMENT
LOWfrontend/src/css/modules/error_404.scss101 circle,COMMENT
LOWdocs/source/conf.py1# -*- coding: utf-8 -*-COMMENT
LOWdocs/source/conf.py81# for a list of supported languages.COMMENT
LOWdocs/source/conf.py101# The reST default role (used for this markup: `text`) to use for allCOMMENT
LOWdocs/source/conf.py141# further. For a list of options available for each theme, see theCOMMENT
LOWdocs/source/conf.py161# html_logo = NoneCOMMENT
LOWdocs/source/conf.py181# bottom, using the given strftime format.COMMENT
LOWdocs/source/conf.py201#COMMENT
LOWdocs/source/conf.py221#COMMENT
LOWdocs/source/conf.py241# 'ja' uses this config value.COMMENT
LOWdocs/source/conf.py261 #COMMENT
LOWdocs/source/conf.py281 )COMMENT
LOWdocs/source/conf.py301COMMENT
LOWdocs/source/conf.py341 "Miscellaneous",COMMENT
Docstring Block Structure1 hit · 5 pts
SeverityFileLineSnippetContext
HIGHapps/challenges/views.py3293 Endpoint to generate AWS Credentails for CLI Args: - challenge: Challenge model - participant_tSTRING
TODO Padding2 hits · 3 pts
SeverityFileLineSnippetContext
LOWtests/unit/hosts/test_views.py251 # TODO: Add test back with APICOMMENT
LOWscripts/workers/code_upload_submission_worker.py11# TODO: Add exception in all the commandsCOMMENT
Example Usage Blocks1 hit · 2 pts
SeverityFileLineSnippetContext
LOWscripts/monitoring/auto_cancel_submissions.py63# Example usage:COMMENT