hadoop提供了一个跑在yarn上的示例，可以运行

最新推荐文章于 2022-12-30 13:40:54 发布

qq_29467751

最新推荐文章于 2022-12-30 13:40:54 发布

阅读量1k

点赞数

分类专栏： hadoop

本文链接：https://blog.csdn.net/qq_29467751/article/details/47403129

版权

hadoop 专栏收录该内容

2 篇文章 0 订阅

订阅专栏

执行命令

bin/hadoop jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.5.2.jar org.apache.hadoop.yarn.applications.distributedshell.Client --jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.5.2.jar --shell_command ls --num_containers 10 --container_memory 350 --master_memory 350 --priority 10

执行日志-----日志

15/07/21 18:13:23 INFO distributedshell.Client: Initializing Client

15/07/21 18:13:23 INFO distributedshell.Client: Running Client

15/07/21 18:13:24 INFO client.RMProxy: Connecting to ResourceManager at Hadoop-Master/192.168.70.65:8032

15/07/21 18:13:24 INFO distributedshell.Client: Got Cluster metric info from ASM, numNodeManagers=3

15/07/21 18:13:24 INFO distributedshell.Client: Got Cluster node info from ASM

15/07/21 18:13:24 INFO distributedshell.Client: Got node report from ASM for, nodeId=Hadoop-Node2:38911, nodeAddressHadoop-Node2:8042, nodeRackName/default-rack, nodeNumContainers0

15/07/21 18:13:24 INFO distributedshell.Client: Got node report from ASM for, nodeId=Hadoop-Node1:45191, nodeAddressHadoop-Node1:8042, nodeRackName/default-rack, nodeNumContainers0

15/07/21 18:13:24 INFO distributedshell.Client: Got node report from ASM for, nodeId=Hadoop-Node0:44608, nodeAddressHadoop-Node0:8042, nodeRackName/default-rack, nodeNumContainers0

15/07/21 18:13:24 INFO distributedshell.Client: Queue info, queueName=default, queueCurrentCapacity=0.0, queueMaxCapacity=1.0, queueApplicationCount=0, queueChildQueueCount=0

15/07/21 18:13:24 INFO distributedshell.Client: User ACL Info for Queue, queueName=root, userAcl=SUBMIT_APPLICATIONS

15/07/21 18:13:24 INFO distributedshell.Client: User ACL Info for Queue, queueName=root, userAcl=ADMINISTER_QUEUE

15/07/21 18:13:24 INFO distributedshell.Client: User ACL Info for Queue, queueName=default, userAcl=SUBMIT_APPLICATIONS

15/07/21 18:13:24 INFO distributedshell.Client: User ACL Info for Queue, queueName=default, userAcl=ADMINISTER_QUEUE

15/07/21 18:13:24 INFO distributedshell.Client: Max mem capabililty of resources in this cluster 8192

15/07/21 18:13:24 INFO distributedshell.Client: Max virtual cores capabililty of resources in this cluster 32

15/07/21 18:13:24 INFO distributedshell.Client: Copy App Master jar from local filesystem and add to local environment

15/07/21 18:13:25 INFO distributedshell.Client: Set the environment for the application master

15/07/21 18:13:25 INFO distributedshell.Client: Setting up app master command

15/07/21 18:13:25 INFO distributedshell.Client: Completed setting up app master command {{JAVA_HOME}}/bin/java -Xmx350m org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster --container_memory 350 --container_vcores 1 --num_containers 10 --priority 0 1>/AppMaster.stdout 2>/AppMaster.stderr

15/07/21 18:13:25 INFO distributedshell.Client: Submitting application to ASM

15/07/21 18:13:25 INFO impl.YarnClientImpl: Submitted application application_1430970937754_0008

15/07/21 18:13:26 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=N/A, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=ACCEPTED, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/, appUser=hadoop

15/07/21 18:13:27 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=N/A, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=ACCEPTED, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/, appUser=hadoop

15/07/21 18:13:28 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:29 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:30 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:31 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:32 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:33 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=RUNNING, distributedFinalState=UNDEFINED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:34 INFO distributedshell.Client: Got application report from ASM for, appId=8, clientToAMToken=null, appDiagnostics=, appMasterHost=Hadoop-Node1/192.168.70.61, appQueue=default, appMasterRpcPort=-1, appStartTime=1437473605691, yarnAppState=FINISHED, distributedFinalState=SUCCEEDED, appTrackingUrl=http://Hadoop-Master:8088/proxy/application_1430970937754_0008/A, appUser=hadoop

15/07/21 18:13:34 INFO distributedshell.Client: Application has completed successfully. Breaking monitoring loop

15/07/21 18:13:34 INFO distributedshell.Client: Application completed successfully