Home / apache / hadoop
Repository Analysis

apache/hadoop

Apache Hadoop

1.7 Likely human-written View on GitHub
1.7
Adjusted Score
1.7
Raw Score
100%
Time Factor
2026-05-28
Last Push
15,554
Stars
Java
Language
4,000,774
Lines of Code
15333
Files
1835
Pattern Hits
2026-05-31
Scan Date

Score History

Severity Breakdown

CRITICAL 473HIGH 4MEDIUM 70LOW 1288

Pattern Findings

1835 matches across 13 categories. Click a row to expand file-level details.

Hallucination Indicators473 hits · 5198 pts
SeverityFileLineSnippet
CRITICAL…n/applications/distributedshell/ApplicationMaster.java1780 new org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent();
CRITICAL…n/applications/distributedshell/ApplicationMaster.java1866 new org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent();
CRITICAL…n/applications/distributedshell/ApplicationMaster.java1904 new org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent();
CRITICAL…vice/timelineservice/TestServiceTimelinePublisher.java226 new org.apache.hadoop.yarn.service.api.records.Configuration());
CRITICAL…vice/timelineservice/TestServiceTimelinePublisher.java246 new org.apache.hadoop.yarn.service.api.records.Configuration());
CRITICAL…apache/hadoop/yarn/service/provider/ProviderUtils.java469 org.apache.commons.io.IOUtils.write(content, output, StandardCharsets.UTF_8);
CRITICAL…rg/apache/hadoop/yarn/service/component/Component.java760 org.apache.hadoop.yarn.api.records.ResourceInformation.newInstance(
CRITICAL…yarn/service/component/instance/ComponentInstance.java217 new org.apache.hadoop.yarn.service.api.records.Container();
CRITICAL…org/apache/hadoop/yarn/service/utils/ServiceUtils.java518 org.apache.commons.io.IOUtils.copy(in, taos);
CRITICAL…ineservice/collector/NodeTimelineCollectorManager.java235 return org.apache.hadoop.yarn.api.records.Token.newInstance(
CRITICAL…he/hadoop/yarn/server/resourcemanager/Application.java292 org.apache.hadoop.yarn.server.utils.BuilderUtils.newResourceRequest(
CRITICAL…p/yarn/server/resourcemanager/TestResourceManager.java97 new org.apache.hadoop.yarn.server.resourcemanager.NodeManager(
CRITICAL…he/hadoop/yarn/server/resourcemanager/NodeManager.java160 org.apache.hadoop.yarn.server.resourcemanager.NodeManager.createNodeStatus(
CRITICAL…e/hadoop/yarn/server/resourcemanager/AdminService.java275 org.apache.hadoop.ipc.Server.getRemoteAddress() +
CRITICAL…e/hadoop/yarn/server/resourcemanager/AdminService.java284 org.apache.hadoop.ipc.Server.getRemoteAddress() + " denied " +
CRITICAL…adoop/yarn/server/resourcemanager/ClientRMService.java769 if (!org.apache.commons.lang3.StringUtils.isAsciiPrintable(tag)) {
CRITICAL…n/server/resourcemanager/webapp/RMAppAttemptBlock.java489 org.apache.hadoop.util.StringUtils.formatTime(Times.elapsed(
CRITICAL…resourcemanager/placement/QueuePlacementRuleUtils.java127 if (!org.apache.commons.lang3.StringUtils.isEmpty(mapping.getParentQueue())) {
CRITICAL…a/org/apache/hadoop/yarn/TestYarnServerApiClasses.java428 org.apache.hadoop.yarn.api.records.Token.newInstance(new byte[0],
CRITICAL…oop/yarn/server/util/timeline/TimelineServerUtils.java72 org.apache.commons.lang3.StringUtils.join(target, ",");
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1572 org.apache.commons.lang3.StringUtils.repeat("A", 1024)));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1574 org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1578 org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1587 org.apache.commons.lang3.StringUtils.repeat("A", 1024),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1588 org.apache.commons.lang3.StringUtils.repeat("A", 1024),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1589 org.apache.commons.lang3.StringUtils.repeat("A", 1024)));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1593 org.apache.commons.lang3.StringUtils.repeat("E", 4095),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1594 org.apache.commons.lang3.StringUtils.repeat("E", 2047),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1595 org.apache.commons.lang3.StringUtils.repeat("E", 2047 - callCmd.length())));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1599 org.apache.commons.lang3.StringUtils.repeat("X", 4095),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1600 org.apache.commons.lang3.StringUtils.repeat("X", 2047),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1601 org.apache.commons.lang3.StringUtils.repeat("X", 2048 - callCmd.length())));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1620 builder.env("somekey", org.apache.commons.lang3.StringUtils.repeat("A", 1024));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1621 builder.env("somekey", org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1624 builder.env("somekey", org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1646 builder.mkdir(new Path(org.apache.commons.lang3.StringUtils.repeat("A", 1024)));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1647 builder.mkdir(new Path(org.apache.commons.lang3.StringUtils.repeat("E",
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1650 builder.mkdir(new Path(org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1671 builder.link(new Path(org.apache.commons.lang3.StringUtils.repeat("A", 1024)),
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1672 new Path(org.apache.commons.lang3.StringUtils.repeat("B", 1024)));
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1674 new Path(org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1676 new Path(org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1680 new Path(org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…ger/containermanager/launcher/TestContainerLaunch.java1682 new Path(org.apache.commons.lang3.StringUtils.repeat(
CRITICAL…server/nodemanager/WindowsSecureContainerExecutor.java338 org.apache.hadoop.util.StringUtils.stringifyException(e)));
CRITICAL…server/nodemanager/WindowsSecureContainerExecutor.java714 org.apache.hadoop.util.StringUtils.stringifyException(e)));
CRITICAL…nodemanager/containermanager/ContainerManagerImpl.java1417 org.apache.hadoop.yarn.api.records.Container.newInstance(
CRITICAL…in/resources/webapps/static/jquery/jquery-3.6.0.min.js2!function(e,t){"use strict";"object"==typeof module&&"object"==typeof module.exports?module.exports=e.document?t(e,!0):f
CRITICAL…s/webapps/static/jquery/jquery-ui-1.13.2.custom.min.js6!function(t){"use strict";"function"==typeof define&&define.amd?define(["jquery"],t):t(jQuery)}(function(V){"use strict"
CRITICAL…rg/apache/hadoop/yarn/util/ProcfsBasedProcessTree.java812 org.apache.hadoop.io.IOUtils.closeStream(in);
CRITICAL…hadoop/yarn/util/Log4jWarningErrorMetricsAppender.java156 org.apache.commons.lang3.StringUtils.left(message, MAX_MESSAGE_SIZE);
CRITICAL…/yarn/security/client/RMDelegationTokenIdentifier.java168 return org.apache.hadoop.yarn.api.records.Token.newInstance(
CRITICAL…rg/apache/hadoop/yarn/logaggregation/LogToolUtils.java101 org.apache.hadoop.io.IOUtils.skipFully(fis, toSkip);
CRITICAL…rg/apache/hadoop/yarn/logaggregation/LogToolUtils.java129 org.apache.hadoop.io.IOUtils.skipFully(fis, skipAfterRead);
CRITICAL…he/hadoop/yarn/logaggregation/AggregatedLogFormat.java842 org.apache.hadoop.io.IOUtils.skipFully(
CRITICAL…he/hadoop/yarn/logaggregation/AggregatedLogFormat.java865 org.apache.hadoop.io.IOUtils.skipFully(
CRITICAL…he/hadoop/yarn/logaggregation/AggregatedLogFormat.java973 org.apache.hadoop.io.IOUtils.skipFully(
CRITICAL…he/hadoop/yarn/logaggregation/AggregatedLogFormat.java994 org.apache.hadoop.io.IOUtils.skipFully(
CRITICAL…in/java/org/apache/hadoop/yarn/client/cli/NodeCLI.java131 org.apache.hadoop.util.StringUtils.toUpperCase(
CRITICAL…apache/hadoop/yarn/client/api/impl/AMRMClientImpl.java149 new org.apache.hadoop.yarn.api.records.ResourceRequest.ResourceRequestComparator());
413 more matches not shown…
Over-Commented Block1179 hits · 1058 pts
SeverityFileLineSnippet
LOW.asf.yaml1# Licensed to the Apache Software Foundation (ASF) under one or more
LOWstart-build-env.sh1#!/usr/bin/env bash
LOW…applications-distributedshell/src/test/resources/b.txt1# Licensed under the Apache License, Version 2.0 (the "License");
LOW…applications-distributedshell/src/test/resources/a.txt1# Licensed under the Apache License, Version 2.0 (the "License");
LOW…/yarn/applications/distributedshell/PlacementSpec.java61 */
LOW…apache/hadoop/yarn/service/TestYarnNativeServices.java721 }
LOW…inition/YARN-Simplified-V1-API-Layer-For-Services.yaml1# Hadoop YARN REST APIs for services v1 spec in YAML
LOW…cations-catalog-docker/src/main/scripts/setup-image.sh1#!/bin/bash
LOW…ications-catalog-docker/src/main/scripts/entrypoint.sh1#!/bin/bash -x
LOW…ources/configsets/exampleCollection/conf/protwords.txt1# The ASF licenses this file to You under the Apache License, Version 2.0
LOW…sources/configsets/exampleCollection/conf/synonyms.txt1# The ASF licenses this file to You under the Apache License, Version 2.0
LOW…ources/configsets/exampleCollection/conf/stopwords.txt1# Licensed to the Apache Software Foundation (ASF) under one or more
LOW…onfigsets/exampleCollection/conf/lang/stopwords_en.txt1# Licensed to the Apache Software Foundation (ASF) under one or more
LOWhadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh1#!/usr/bin/env bash
LOWhadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh1#!/usr/bin/env bash
LOWhadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh1#!/usr/bin/env bash
LOWhadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh1#!/usr/bin/env bash
LOWhadoop-yarn-project/hadoop-yarn/bin/yarn-config.sh1# Licensed to the Apache Software Foundation (ASF) under one or more
LOW…arn/server/resourcemanager/TestApplicationCleanup.java441
LOW…emanager/scheduler/capacity/TestApplicationLimits.java961 // can be used for AMs is 30%. So, 30% of <memory: 100GB, vCores: 1000> is
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java3861 // host_0_1: < null >
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java3901 applyCSAssignment(clusterResource, assignment, a, nodes, apps);
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java3941 // rack_0: < null >
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java3961
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java4001 // rack_0: < null >
LOW…/resourcemanager/scheduler/capacity/TestLeafQueue.java4021 // Now sanity-check node_local
LOW…ager/scheduler/capacity/TestCapacitySchedulerPerf.java101 return retVal;
LOW…ySchedulerNewQueueAutoCreationWithCapacityVectors.java121
LOW…esourcemanager/nodelabels/TestRMNodeLabelsManager.java201 isEqualTo(Resources.multiply(SMALL_RESOURCE, 1));
LOW…ourcemanager/nodelabels/TestNodeAttributesManager.java181 // A2=host1_v1_2
LOW…oop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java1381 rmNode.updateClusterUtilizationMetrics();
LOW…r/monitor/capacity/FifoIntraQueuePreemptionPlugin.java521
LOW…r/resourcemanager/scheduler/capacity/UsersManager.java781 // - maxUserLimit = total-partition-resource (IGNORE_PARTITION_EXCLUSIVITY)
LOW…uler/capacity/allocator/RegularContainerAllocator.java601 // some containers to meet this queue, its parents', or the users'
LOW…n/server/resourcemanager/reservation/InMemoryPlan.java641 long periodicSearchEnd = (endTime - shift) % period;
LOW…erver/resourcemanager/rmcontainer/RMContainerImpl.java641 Resource rmContainerResource = container.getAllocatedResource();
LOW…erver/resourcemanager/rmcontainer/RMContainerImpl.java661 // 4. When NM reports 5G to RM, RM now sees its own allocation as 4G
LOW…ver/federation/store/impl/SQLFederationStateStore.java1301 try {
LOW…ver/federation/store/impl/SQLFederationStateStore.java1581
LOW…rver/hadoop-yarn-server-nodemanager/src/CMakeLists.txt1# Licensed to the Apache Software Foundation (ASF) under one
LOW…n/server/nodemanager/TestDefaultContainerExecutor.java661
LOW…n/server/nodemanager/TestDefaultContainerExecutor.java681// }
LOW…n/server/nodemanager/TestDefaultContainerExecutor.java701// r.setSeed(jobSeed);
LOW…n/server/nodemanager/TestDefaultContainerExecutor.java721// DefaultContainerExecutor dce = new DefaultContainerExecutor(lfs);
LOW…n/server/nodemanager/TestDefaultContainerExecutor.java741// verify(spylfs).mkdir(jobdir,
LOW…in/native/container-executor/impl/container-executor.c21#include "utils/docker-util.h"
LOW…in/native/container-executor/impl/container-executor.c41#include <stdio.h>
LOW…in/native/container-executor/impl/container-executor.c61#ifndef HAVE_FDOPENDIR
LOW…rc/main/native/container-executor/impl/configuration.h21
LOW…in/native/container-executor/impl/container-executor.h61#define USER_DIR_PATTERN "%s/usercache/%s"
LOW…manager/src/main/native/container-executor/impl/main.c21#include "container-executor.h"
LOW…rc/main/native/container-executor/impl/configuration.c21
LOW…ain/native/container-executor/impl/utils/docker-util.c21#include <sys/wait.h>
LOW…main/native/container-executor/impl/utils/file-utils.c21#include <sys/types.h>
LOW…ain/native/container-executor/impl/utils/docker-util.h21
LOW…ain/native/container-executor/impl/utils/cJSON/cJSON.h61#endif
LOW…ain/native/container-executor/impl/utils/cJSON/cJSON.h81/* project version */
LOW…ain/native/container-executor/impl/utils/cJSON/cJSON.c21*/
LOW…ain/native/container-executor/impl/utils/cJSON/cJSON.c41#include <stdio.h>
LOW…main/native/container-executor/impl/runc/runc_config.h21// Section for all runC config keys
1119 more matches not shown…
Decorative Section Separators48 hits · 153 pts
SeverityFileLineSnippet
MEDIUM…ources/configsets/exampleCollection/conf/protwords.txt13#-----------------------------------------------------------------------
MEDIUM…sources/configsets/exampleCollection/conf/synonyms.txt13#-----------------------------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1231# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1233# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1253# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1255# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1286# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1288# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1300# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1302# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1315# ---------------------------------------------------
MEDIUM…doop-aws/src/site/markdown/tools/hadoop-aws/testing.md1319# ---------------------------------------------------
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java71 // ┌─────────────────────────────────────────┐
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java79 // └─────────────────────────────────────────┘
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java81 // ┌─────────────────────────────────────────────────────────────────┐
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java88 // └─────────────────────────────────────────────────────────────────┘
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java90 // ┌─────────────────────────────────┐
MEDIUM…oop/fs/s3a/statistics/impl/AwsStatisticsCollector.java97 // └─────────────────────────────────┘
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh23# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh25# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh54# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh56# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh105# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh107# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh139# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh141# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh198# ------------------------------------------------------------------------------
MEDIUM…oop-azure/dev-support/testrun-scripts/configsupport.sh200# ------------------------------------------------------------------------------
MEDIUM…ject/hadoop-hdfs/src/test/resources/hadoop-dfs-dir.txt23# ---------------------
MEDIUM…ject/hadoop-hdfs/src/test/resources/hadoop-dfs-dir.txt35# ---------------------------------------
MEDIUM…project/hadoop-hdfs/src/main/bin/distribute-exclude.sh19# ------------------------------------------------------------------
MEDIUM…doop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh51#---------------------------------------------------------
MEDIUM…doop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh69#---------------------------------------------------------
MEDIUM…doop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh80#---------------------------------------------------------
MEDIUM…doop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh100#---------------------------------------------------------
MEDIUM…doop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh116#---------------------------------------------------------
MEDIUM…oop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh84#---------------------------------------------------------
MEDIUM…oop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh103#---------------------------------------------------------
MEDIUM…oop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh114#---------------------------------------------------------
MEDIUM…oop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh144#---------------------------------------------------------
MEDIUM…oop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh161#---------------------------------------------------------
MEDIUM…-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh19# ------------------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh21# -------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh41# -------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh58# -------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh83# -------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh111# -------------------------------------------------------
MEDIUMdev-support/docker/hadoop_env_checks.sh117# -------------------------------------------------------
Verbosity Indicators49 hits · 85 pts
SeverityFileLineSnippet
LOW…server/resourcemanager/TestResourceTrackerService.java3298 // Step 1: Create a Configuration object to hold the settings.
LOW…server/resourcemanager/TestResourceTrackerService.java3301 // Step 2: Setup the host files.
LOW…server/resourcemanager/TestResourceTrackerService.java3313 // Step 3: Create a MockRM (ResourceManager) instance to simulate RM behavior
LOW…server/resourcemanager/TestResourceTrackerService.java3319 // Step 4: Register and simulate node activity for "test_host1"
LOW…server/resourcemanager/TestResourceTrackerService.java3325 // Step 5: Validate that test_host3 is marked as a LOST node
LOW…server/resourcemanager/TestResourceTrackerService.java3332 // Step 6: Validate node metrics for lost, active, and decommissioned nodes
LOW…server/resourcemanager/TestResourceTrackerService.java3341 // Step 7: Register and simulate node activity for "test_host3"
LOW…server/resourcemanager/TestResourceTrackerService.java3346 // Step 8: Validate updated node metrics after registering test_host3
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java139 // Step 1: Launch an App in Default Queue which utilizes the entire cluster
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java151 // Step 2: Wait till the nodes utilization are full
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java162 // Step 3: Launch another App in Queue A which will be Reserved
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java187 // Step 4: Wait for Preemption to happen. It will preempt Node1 (1GB)
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java204 // Step 5: Don't release the container from NodeManager so that Reservation
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java242 // Step 6: Okay, now preempted node is Node1 and reserved node is Node3
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java261 // Step 7: Wait for app-2 to get ALLOCATED
LOW…ity/TestCapacitySchedulerMultiNodesWithPreemption.java266 // Step 8: Validate if app-2 has got 1 live container and
LOW…rcemanager/scheduler/capacity/AbstractParentQueue.java521 // We need to check if the parent of the child queue is exactly this
LOW…/src/main/resources/webapps/static/jt/jquery.jstree.js1413 // this variable stores the path to the themes folder - if left as false - it will be autodetected
LOW…he/hadoop/yarn/client/api/impl/TestYarnClientImpl.java183 // Step 1: Start a MiniDFSCluster for Log Aggregation Path
LOW…he/hadoop/yarn/client/api/impl/TestYarnClientImpl.java195 // Step 2: Prepare a Mock FileSystem which returns Delegation Token
LOW…he/hadoop/yarn/client/api/impl/TestYarnClientImpl.java216 // Step 3: Prepare a Mock YarnClientImpl
LOW…he/hadoop/yarn/client/api/impl/TestYarnClientImpl.java245 // Step 4: Prepare a ApplicationSubmissionContext and submit the app
LOW…he/hadoop/yarn/client/api/impl/TestYarnClientImpl.java262 // Step 5: Verify automatic addition of HDFS DT for log aggregation path
LOW…pache/hadoop/io/compress/bzip2/CBZip2OutputStream.java1827 // Step 1:
LOW…pache/hadoop/io/compress/bzip2/CBZip2OutputStream.java1851 // Step 2:
LOW…pache/hadoop/io/compress/bzip2/CBZip2OutputStream.java1871 // Step 3:
LOW…/apache/hadoop/fs/gs/GoogleCloudStorageFileSystem.java119 // we need to check if there are no conflicting items in the directory tree:
LOW…/apache/hadoop/fs/gs/GoogleCloudStorageFileSystem.java220 // Before creating a leaf directory we need to check if there are no conflicting files
LOW…hadoop/fs/azurebfs/services/ITestAbfsOutputStream.java411 // Step 2: Mock the clientHandler to return the blobClient when getBlobClient is called
LOW…a/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java1013 for (T enumConstant : defaultValue.getDeclaringClass().getEnumConstants()) { // Step 3: Iterate over enum constant
LOW…che/hadoop/fs/azurebfs/services/AbfsRestOperation.java130 * This variable stores the tracing context used for last Rest Operation.
LOW…apache/hadoop/fs/azurebfs/services/AbfsBlobClient.java414 // If the list operation returns no paths, we need to check if the path is a file.
LOW…src/main/java/org/apache/hadoop/hdfs/StripeReader.java439 // Step 1: prepare indices and output buffers for missing data units
LOW…src/main/java/org/apache/hadoop/hdfs/StripeReader.java450 // Step 2: decode into prepared output buffers
LOW…src/main/java/org/apache/hadoop/hdfs/StripeReader.java453 // Step 3: fill original application buffer with decoded data
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java349 // Step 1: map the byte range to StripingCells
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java353 // Step 2: get the unmerged ranges on each internal block
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java357 // Step 3: merge into stripes
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java361 // Step 4: calculate each chunk's position in destination buffer. Since the
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java384 // Step 5: prepare ALLZERO blocks
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java408 // Step 0: analyze range and calculate basic parameters
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java411 // Step 1: map the byte range to StripingCells
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java415 // Step 2: get the unmerged ranges on each internal block
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java419 // Step 3: merge into at most 5 stripes
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java423 // Step 4: calculate each chunk's position in destination buffer
LOW…java/org/apache/hadoop/hdfs/util/StripedBlockUtil.java426 // Step 5: prepare ALLZERO blocks
LOW…e/hadoop/hdfs/server/blockmanagement/BlockManager.java2150 // Step 1: categorize at-risk blocks into replication and EC tasks
LOW…e/hadoop/hdfs/server/blockmanagement/BlockManager.java2171 // Step 2: choose target nodes for each reconstruction task
LOW…e/hadoop/hdfs/server/blockmanagement/BlockManager.java2192 // Step 3: add tasks to the DN
AI Slop Vocabulary16 hits · 47 pts
SeverityFileLineSnippet
MEDIUM…eservice/storage/common/HBaseTimelineStorageUtils.java95 // Essentially we are treating it like an 'unsigned very very long' and
MEDIUM…org/apache/hadoop/registry/server/dns/RegistryDNS.java222 // registryDNS can utilize local DNS server as upstream lookup.
MEDIUM…oop-common/src/main/native/gtest/include/gtest/gtest.h9436// This implementation is *not* meant to be as highly tuned or robust
MEDIUM…oop-common/src/main/native/gtest/include/gtest/gtest.h9508// In practice, this can be used to test functions that utilize the
MEDIUM…main/java/org/apache/hadoop/util/DirectBufferPool.java48 // Essentially implement a multimap with weak values.
MEDIUM…g/apache/hadoop/fs/statistics/IOStatisticsLogging.java232 // robust extract and convert to string
MEDIUM…mmon-project/hadoop-common/src/main/conf/hadoop-env.sh127# Similarly, end users should utilize ${HOME}/.hadooprc .
MEDIUM…/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java4451 // Essentially: no DTs, no canonical service name.
MEDIUM…tools/hadoop-sls/src/main/html/js/thirdparty/jquery.js10821// understands anonymous AMD modules. A named AMD is safest and most robust
MEDIUM…azurebfs/services/AbfsManagedApacheHttpConnection.java119 return true; // Definitely stale
MEDIUM…n/java/org/apache/hadoop/tools/dynamometer/Client.java502 // Store a temporary config to leverage Configuration's time duration
MEDIUM…s/src/test/java/org/apache/hadoop/hdfs/TestHFlush.java309 // Make sure we work with DFS in order to utilize all its functionality
MEDIUM…c/test/java/org/apache/hadoop/hdfs/TestDFSUpgrade.java64 // TODO: Avoid hard-coding expected_txid. The test should be more robust.
MEDIUM…e/hadoop/hdfs/server/namenode/TestCacheDirectives.java965 // the NameNode be robust against this.
MEDIUM…s/server/datanode/erasurecode/ErasureCodingWorker.java78 // Essentially, this is a cachedThreadPool.
MEDIUM…rg/apache/hadoop/hdfs/server/namenode/FSEditLogOp.java5076 // robust.
Hyper-Verbose Identifiers44 hits · 44 pts
SeverityFileLineSnippet
LOW…ain/webapp/docs/development/adding-validation-rules.md243export function getAffectedQueuesForValidation(
LOW…ain/webapp/docs/development/adding-validation-rules.md355function evaluateWithStagedChanges(context: ValidationContext): ValidationIssue[] {
LOW…ain/webapp/docs/development/adding-validation-rules.md445function evaluateDefaultLifetimeConstraint(context: ValidationContext): ValidationIssue[] {
LOW…acity-scheduler-ui/src/main/webapp/src/types/guards.ts35export function getQueueNameValidationError(name: string): string | null {
LOW…uler-ui/src/main/webapp/src/config/validation-rules.ts102function evaluateCapacityTypeConsistency(context: ValidationContext): ValidationIssue[] {
LOW…uler-ui/src/main/webapp/src/config/validation-rules.ts237function evaluateMaxCapacityRelationship(context: ValidationContext): ValidationIssue[] {
LOW…uler-ui/src/main/webapp/src/config/validation-rules.ts331function evaluateParentChildCapacityConstraints(context: ValidationContext): ValidationIssue[] {
LOW…uler-ui/src/main/webapp/src/config/validation-rules.ts397function evaluateParentChildCapacityMode(context: ValidationContext): ValidationIssue[] {
LOW…uler-ui/src/main/webapp/src/config/validation-rules.ts476function evaluateWeightModeTransitionFlexibleAQC(context: ValidationContext): ValidationIssue[] {
LOW…er-ui/src/main/webapp/src/config/properties/helpers.ts27export function getTemplatePropertyDefinitions(): PropertyDescriptor[] {
LOW…er-ui/src/main/webapp/src/config/properties/helpers.ts31export function getTemplatePropertiesByCategory(category: PropertyCategory): PropertyDescriptor[] {
LOW…rc/features/property-editor/hooks/usePropertyEditor.ts36function mergeFormAndValidationErrors(
LOW…gement/components/QueueVisualizationContainer.test.tsx109function createSchedulerStoreState() {
LOW…gement/components/QueueVisualizationContainer.test.tsx176function defaultSchedulerStoreImpl(
LOW…rc/features/queue-management/hooks/useQueueTreeData.ts618function augmentQueueTreeWithStagedQueues(
LOW…ebapp/src/features/template-config/utils/scopeUtils.ts136function stagedTemplatePathsForSuffix(
LOW…src/features/staged-changes/utils/queueStateManager.ts18export function getParentQueuesForAdditions(
LOW…src/features/staged-changes/utils/queueStateManager.ts66export function getQueuesForAutoCreationEnable(changes: StagedChange[]): string[] {
LOW…src/features/staged-changes/utils/queueStateManager.ts105export function prepareMutationRequestForSubmission(request: SchedConfUpdateInfo): {
LOW…src/features/staged-changes/utils/queueStateManager.ts140export function prepareMutationRequestWithVersion(
LOW…/features/placement-rules/utils/placementRulesUtils.ts42export function extractPlacementRulesFromConfig(
LOW…acement-rules/components/CustomPlacementHelpDialog.tsx39export function CustomPlacementHelpDialog({
LOW…s/global-settings/hooks/useGlobalPropertyValidation.ts24export function useGlobalPropertyValidation() {
LOW…webapp/src/features/validation/utils/affectedQueues.ts25export function getAffectedQueuesForValidation(
LOW…-scheduler-ui/src/main/webapp/src/utils/configUtils.ts60export function getEffectivePropertyValue(
LOW…-scheduler-ui/src/main/webapp/src/utils/configUtils.ts96export function buildEffectivePropertyKey(queuePath: string, propertyName: string): string {
LOW…cheduler-ui/src/main/webapp/src/utils/propertyUtils.ts65export function buildNodeLabelPropertyKey(
LOW…ler-ui/src/main/webapp/src/lib/errors/readOnlyGuard.ts15export function createReadOnlyBlockedError(operation: string): {
LOW…duler-ui/src/main/webapp/src/lib/errors/error-utils.ts68export function createDetailedErrorMessage(
LOW…n/server/resourcemanager/webapp/RMAppAttemptBlock.java77 .append("function getTableDataFromObjectArray(objectArray, fields) {")
LOW…n/server/resourcemanager/webapp/RMAppAttemptBlock.java242 .append("function handleRefreshSchedulerActDone(data){")
LOW…n/server/resourcemanager/webapp/RMAppAttemptBlock.java249 .append("function handleQuerySchedulerActDone(data){")
LOW…n/server/resourcemanager/webapp/RMAppAttemptBlock.java279 .append("function refreshSchedulerDiagnostics() {")
LOW…n/server/resourcemanager/webapp/RMAppAttemptBlock.java284 .append("function querySchedulerDiagnostics() {")
LOW…ache/hadoop/yarn/server/AMHeartbeatRequestHandler.java44public class AMHeartbeatRequestHandler extends SubjectInheritingThread {
LOW…doop/yarn/server/timeline/TestTimelineDataManager.java43public class TestTimelineDataManager extends TimelineStoreTestUtils {
LOW…e/hadoop/yarn/server/timeline/TimelineDataManager.java55public class TimelineDataManager extends AbstractService {
LOW…adoop-yarn-ui/src/main/webapp/app/adapters/yarn-log.js21function createEmptyContainerLogInfo(location) {
LOW…rn-ui/src/main/webapp/app/components/sunburst-chart.js195function initializeBreadcrumbTrail() {
LOW…n-ui/src/main/webapp/app/helpers/log-adapter-helper.js19export function createEmptyContainerLogInfo(location) {
LOW…oop-yarn-ui/src/main/webapp/app/initializers/loader.js61function getYarnHttpProtocolScheme(rmhost, application) {
LOW…tools/hadoop-sls/src/main/html/js/thirdparty/jquery.js9039function addToPrefiltersOrTransports( structure ) {
LOW…tools/hadoop-sls/src/main/html/js/thirdparty/jquery.js9073function inspectPrefiltersOrTransports( structure, options, originalOptions, jqXHR ) {
LOW…oject/hadoop-hdfs/src/main/webapps/static/rest-csrf.js39 function getTrimmedStringArrayValue(element) {
Synthetic Comment Markers4 hits · 30 pts
SeverityFileLineSnippet
HIGH…/hadoop/fs/gs/GoogleCloudStorageClientReadChannel.java521 // close existing contentChannel as requested bytes can't be served from current
HIGH…doop/fs/azurebfs/services/ITestAbfsPositionedRead.java160 // disabled, it will only read the exact bytes as requested and no data
HIGH…e/hadoop/hdfs/server/namenode/TestCacheDirectives.java1097 // only 3 because the file only has 3 replicas, not 4 as requested.
HIGH…p/hdfs/server/blockmanagement/LowRedundancyBlocks.java257 //there is less than a third as many blocks as requested;
Self-Referential Comments5 hits · 15 pts
SeverityFileLineSnippet
MEDIUM…ge-project/hadoop-gcp/src/test/resources/core-site.xml40 # Create a file auth-keys.xml - DO NOT ADD TO REVISION CONTROL
MEDIUM…ct/hadoop-huaweicloud/src/test/resources/core-site.xml128 # Create a file auth-keys.xml - DO NOT ADD TO REVISION CONTROL
MEDIUM…doop-tools/hadoop-aws/src/test/resources/core-site.xml225 # Create a file auth-keys.xml - DO NOT ADD TO REVISION CONTROL
MEDIUM…p-tools/hadoop-aliyun/src/test/resources/core-site.xml38 # Create a file auth-keys.xml - DO NOT ADD TO REVISION CONTROL
MEDIUM…ools/hadoop-azure-datalake/src/test/resources/adls.xml17 # Create a file auth-keys.xml - DO NOT ADD TO REVISION CONTROL
Fake / Example Data10 hits · 12 pts
SeverityFileLineSnippet
LOW…applications-catalog-webapp/src/main/webapp/theme.html631 <p>Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas sed diam eget risus varius blandit sit amet non
LOW…applications-catalog-webapp/src/main/webapp/theme.html631 <p>Lorem ipsum dolor sit amet, consectetur adipiscing elit. Maecenas sed diam eget risus varius blandit sit amet non
LOW…applications-catalog-webapp/src/main/webapp/theme.html632 magna. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Praesent commodo cursus magna, vel scelerisque
LOW…applications-catalog-webapp/src/main/webapp/theme.html632 magna. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Praesent commodo cursus magna, vel scelerisque
LOW…nager/placement/csmappingrule/TestVariableContext.java188 .put("%userPhone", "555-3221")
LOW…nager/placement/csmappingrule/TestVariableContext.java202 testCases.put("%userPhone", "555-3221");
LOW…va/org/apache/hadoop/yarn/webapp/view/LipsumBlock.java30 __("Lorem ipsum dolor sit amet, consectetur adipiscing elit.",
LOW…va/org/apache/hadoop/yarn/webapp/view/LipsumBlock.java30 __("Lorem ipsum dolor sit amet, consectetur adipiscing elit.",
LOW…t/java/org/apache/hadoop/example/ITUseMiniCluster.java65 private static final String TEXT = "Lorem ipsum dolor sit amet, consectetur "
LOW…t/java/org/apache/hadoop/example/ITUseMiniCluster.java65 private static final String TEXT = "Lorem ipsum dolor sit amet, consectetur "
Slop Phrases1 hit · 3 pts
SeverityFileLineSnippet
MEDIUM…/timelineservice/reader/filter/TimelineFilterList.java31 * operator {@link Operator#AND} or {@link Operator#OR}. Since you can use
Redundant / Tautological Comments2 hits · 3 pts
SeverityFileLineSnippet
LOW…project/hadoop-common/src/main/bin/hadoop-functions.sh1946 # Check if jsvc -help has entry for option -cwd
LOWdev-support/jenkins.sh246 # Check if the CI needs to be run, if so, do so :)
Overly Generic Function Names2 hits · 2 pts
SeverityFileLineSnippet
LOW…heduler-ui/src/main/webapp/public/mockServiceWorker.js122async function handleRequest(event, requestId) {
LOW…tools/hadoop-sls/src/main/html/js/thirdparty/jquery.js4401function getData( data ) {
Deep Nesting2 hits · 2 pts
SeverityFileLineSnippet
LOWdev-support/docker/pkg-resolver/resolve.py29
LOWdev-support/docker/pkg-resolver/resolve.py42