Hadoop 系列YARN：资源调度平台（YARN的命令）

最新推荐文章于 2022-07-04 20:41:04 发布
最新推荐文章于 2022-07-04 20:41:04 发布
阅读量531 收藏
点赞数
文章标签： 大数据 java git
原文链接：http://www.cnblogs.com/mtime2004/p/10037446.html
版权

yarn命令的用法

[root@node1 ~]# yarn
Usage: yarn [--config confdir] [COMMAND | CLASSNAME]
  CLASSNAME                             run the class named CLASSNAME
 or
  where COMMAND is one of:
  resourcemanager -format-state-store   deletes the RMStateStore
  resourcemanager                       run the ResourceManager
  nodemanager                           run a nodemanager on each slave
  timelineserver                        run the timeline server
  rmadmin                               admin tools
  sharedcachemanager                    run the SharedCacheManager daemon
  scmadmin                              SharedCacheManager admin tools
  version                               print the version
  jar <jar>                             run a jar file
  application                           prints application(s)
                                        report/kill application
  applicationattempt                    prints applicationattempt(s)
                                        report
  container                             prints container(s) report
  node                                  prints node report(s)
  queue                                 prints queue information
  logs                                  dump container logs
  classpath                             prints the class path needed to
                                        get the Hadoop jar and the
                                        required libraries
  cluster                               prints cluster information
  daemonlog                             get/set the log level for each
                                        daemon

 

classpath

使用: yarn classpath
打印需要得到Hadoop的jar和所需要的lib包路径

查看节点列表

[root@node1 ~]# yarn node -list
18/11/28 22:37:03 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:8032
Total Nodes:3
         Node-Id	     Node-State	Node-Http-Address	Number-of-Running-Containers
     node2:45474	        RUNNING	       node2:8042	                           0
     node3:40652	        RUNNING	       node3:8042	                           0
     node1:46541	        RUNNING	       node1:8042	                           0

 查看节点状况

[root@node1 ~]# yarn node -status node3:40652
18/11/28 22:38:29 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:8032
Node Report : 
	Node-Id : node3:40652
	Rack : /default-rack
	Node-State : RUNNING
	Node-Http-Address : node3:8042
	Last-Health-Update : Wed 28/Nov/18 10:37:10:693EST
	Health-Report : 
	Containers : 0
	Memory-Used : 0MB
	Memory-Capacity : 27640MB
	CPU-Used : 0 vcores
	CPU-Capacity : 10 vcores
	Node-Labels :

 先停止YARN，然后通过yarn命令来启动resourcemanager和nodemanager

 

[root@node1 ~]# stop-yarn.sh
stopping yarn daemons
stopping resourcemanager
node2: stopping nodemanager
node1: stopping nodemanager
node3: stopping nodemanager
no proxyserver to stop

 JPS命令，已经没有YARN的相关服务了

[root@node1 ~]# yarn resourcemanger
Error: Could not find or load main class resourcemanger
[root@node1 ~]# yarn resourcemanager
18/11/28 22:44:13 INFO resourcemanager.ResourceManager: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting ResourceManager
STARTUP_MSG:   host = node1/192.168.55.128
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 2.7.3
STARTUP_MSG:   classpath = /opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/opt/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/etc/hadoop/rm-config/log4j.properties
STARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r baa91f7c6bc9cb92be5982de4719c1c8af91ccff; compiled by 'root' on 2016-08-18T01:41Z
STARTUP_MSG:   java = 1.8.0_112
************************************************************/
18/11/28 22:44:13 INFO resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
18/11/28 22:44:14 INFO conf.Configuration: found resource core-site.xml at file:/opt/hadoop-2.7.3/etc/hadoop/core-site.xml
18/11/28 22:44:14 INFO security.Groups: clearing userToGroupsMap cache
18/11/28 22:44:15 INFO conf.Configuration: found resource yarn-site.xml at file:/opt/hadoop-2.7.3/etc/hadoop/yarn-site.xml
18/11/28 22:44:15 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
18/11/28 22:44:16 INFO security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
18/11/28 22:44:16 INFO security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
18/11/28 22:44:16 INFO security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
18/11/28 22:44:16 INFO resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
18/11/28 22:44:16 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
18/11/28 22:44:16 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
18/11/28 22:44:16 INFO impl.MetricsSystemImpl: ResourceManager metrics system started
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
18/11/28 22:44:16 INFO resourcemanager.RMNMInfo: Registered RMNMInfo MBean
18/11/28 22:44:17 INFO security.YarnAuthorizationProvider: org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instiantiated.
18/11/28 22:44:17 INFO util.HostsFileReader: Refreshing hosts (include/exclude) list
18/11/28 22:44:17 INFO conf.Configuration: found resource capacity-scheduler.xml at file:/opt/hadoop-2.7.3/etc/hadoop/capacity-scheduler.xml
18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root is undefined
18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root is undefined
18/11/28 22:44:17 INFO capacity.ParentQueue: root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APP:*, labels=*,
, reservationsContinueLooking=true
18/11/28 22:44:17 INFO capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root
18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.default is undefined
18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.default is undefined
18/11/28 22:44:17 INFO capacity.LeafQueue: Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.33333334 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
maximumAllocation = <memory:3000, vCores:96> [= configuredMaxAllocation ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APP:* [= configuredAcls ]
nodeLocalityDelay = 40
labels=*,
nodeLocalityDelay = 40
reservationsContinueLooking = true
preemptionDisabled = true

18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue mappings, override: false
18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:2000, vCores:1>>, maximumAllocation=<<memory:3000, vCores:96>>, asynchronousScheduling=false, asyncScheduleInterval=5ms
18/11/28 22:44:17 INFO metrics.SystemMetricsPublisher: YARN system metrics publishing service is not enabled
18/11/28 22:44:17 INFO resourcemanager.ResourceManager: Transitioning to active state
18/11/28 22:44:17 INFO recovery.RMStateStore: Updating AMRMToken
18/11/28 22:44:17 INFO security.RMContainerTokenSecretManager: Rolling master-key for container-tokens
18/11/28 22:44:17 INFO security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens
18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
18/11/28 22:44:17 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 1
18/11/28 22:44:17 INFO recovery.RMStateStore: Storing RMDTMasterKey.
18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
18/11/28 22:44:17 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 2
18/11/28 22:44:17 INFO recovery.RMStateStore: Storing RMDTMasterKey.
18/11/28 22:44:17 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler
18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 8031
18/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8031: starting
18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 8030
18/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8030: starting
18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 8032
18/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8032: starting
18/11/28 22:44:17 INFO resourcemanager.ResourceManager: Transitioned to active state
18/11/28 22:44:18 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
18/11/28 22:44:18 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
18/11/28 22:44:18 INFO http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined
18/11/28 22:44:18 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster
18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs
18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static
18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
18/11/28 22:44:18 INFO http.HttpServer2: adding path spec: /cluster/*
18/11/28 22:44:18 INFO http.HttpServer2: adding path spec: /ws/*
18/11/28 22:44:19 INFO webapp.WebApps: Registered webapp guice modules
18/11/28 22:44:19 INFO http.HttpServer2: Jetty bound to port 8088
18/11/28 22:44:19 INFO mortbay.log: jetty-6.1.26
18/11/28 22:44:19 INFO mortbay.log: Extract jar:file:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar!/webapps/cluster to /tmp/Jetty_node1_8088_cluster____uqk9cr/webapp
18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
Nov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Nov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Nov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 28, 2018 10:44:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 28, 2018 10:44:21 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 28, 2018 10:44:22 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
18/11/28 22:44:22 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@node1:8088
18/11/28 22:44:22 INFO webapp.WebApps: Web app cluster started at 8088
18/11/28 22:44:22 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:44:22 INFO ipc.Server: Starting Socket Reader #1 for port 8033
18/11/28 22:44:22 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
18/11/28 22:44:22 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:44:22 INFO ipc.Server: IPC Server listener on 8033: starting

 

[root@node1 ~]# yarn nodemanager
18/11/28 22:53:58 INFO nodemanager.NodeManager: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NodeManager
STARTUP_MSG:   host = node1/192.168.55.128
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 2.7.3
STARTUP_MSG:   classpath = /opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/opt/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/etc/hadoop/nm-config/log4j.properties
STARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r baa91f7c6bc9cb92be5982de4719c1c8af91ccff; compiled by 'root' on 2016-08-18T01:41Z
STARTUP_MSG:   java = 1.8.0_112
************************************************************/
18/11/28 22:53:58 INFO nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager
18/11/28 22:54:00 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
18/11/28 22:54:01 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
18/11/28 22:54:01 INFO impl.MetricsSystemImpl: NodeManager metrics system started
18/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService
18/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService
18/11/28 22:54:01 INFO localizer.ResourceLocalizationService: per directory file limit = 8192
18/11/28 22:54:01 INFO localizer.ResourceLocalizationService: usercache path : file:/hadoop/yarn/local/usercache_DEL_1543463641176
18/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
18/11/28 22:54:01 WARN containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
18/11/28 22:54:01 INFO containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"
18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@7ac296f6
18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorProcessTree : null
18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl: Physical memory check enabled: false
18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl: Virtual memory check enabled: false
18/11/28 22:54:01 INFO nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=27640 virtual-memory=58044 virtual-cores=10
18/11/28 22:54:01 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:54:01 INFO ipc.Server: Starting Socket Reader #1 for port 38538
18/11/28 22:54:01 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
18/11/28 22:54:01 INFO containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.
18/11/28 22:54:01 INFO security.NMContainerTokenSecretManager: Updating node address : node1:38538
18/11/28 22:54:01 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:54:01 INFO ipc.Server: IPC Server listener on 38538: starting
18/11/28 22:54:01 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
18/11/28 22:54:01 INFO ipc.Server: Starting Socket Reader #1 for port 8040
18/11/28 22:54:01 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
18/11/28 22:54:01 INFO ipc.Server: IPC Server Responder: starting
18/11/28 22:54:01 INFO ipc.Server: IPC Server listener on 8040: starting
18/11/28 22:54:01 INFO localizer.ResourceLocalizationService: Localizer started on port 8040
18/11/28 22:54:02 INFO mapred.IndexCache: IndexCache created with max memory = 10485760
18/11/28 22:54:02 INFO mapred.ShuffleHandler: httpshuffle listening on port 13562
18/11/28 22:54:02 INFO monitor.ContainersMonitorImpl: Neither virutal-memory nor physical-memory monitoring is needed. Not running the monitor-thread
18/11/28 22:54:02 INFO containermanager.ContainerManagerImpl: ContainerManager started at node1/192.168.55.128:38538
18/11/28 22:54:02 INFO containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0
18/11/28 22:54:02 INFO webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
18/11/28 22:54:02 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
18/11/28 22:54:02 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
18/11/28 22:54:02 INFO http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined
18/11/28 22:54:02 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
18/11/28 22:54:02 INFO http.HttpServer2: adding path spec: /node/*
18/11/28 22:54:02 INFO http.HttpServer2: adding path spec: /ws/*
18/11/28 22:54:03 INFO webapp.WebApps: Registered webapp guice modules
18/11/28 22:54:03 INFO http.HttpServer2: Jetty bound to port 8042
18/11/28 22:54:03 INFO mortbay.log: jetty-6.1.26
18/11/28 22:54:03 INFO mortbay.log: Extract jar:file:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
Nov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 28, 2018 10:54:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 28, 2018 10:54:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 28, 2018 10:54:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 28, 2018 10:54:05 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
18/11/28 22:54:05 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
18/11/28 22:54:05 INFO webapp.WebApps: Web app node started at 8042
18/11/28 22:54:05 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:8031
18/11/28 22:54:05 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
18/11/28 22:54:05 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
18/11/28 22:54:06 INFO security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 2133688738
18/11/28 22:54:06 INFO security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 961971060
18/11/28 22:54:06 INFO nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as node1:38538 with total resource of <memory:27640, vCores:10>
18/11/28 22:54:06 INFO nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests

 查看YARN版本

 

转载于:https://www.cnblogs.com/mtime2004/p/10037446.html

weixin_33814685
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
yarn常用命令
扛麻袋的少年的博客
04-29 496
二十二、yarn常用命令 1.yarn application 查看任务 Ⅰ.列出所有 Application Ⅱ.根据 Application 状态过滤 Ⅲ.Kill杀死某个任务 2.yarn logs 查看日志 Ⅰ.查看application(任务)日志 Ⅱ.查看Container(容器)日志 3.yarn applicationattempt 查看尝试运行的任务 Ⅰ.列出某个application尝试的列表 Ⅱ.查询ApplicationAttempt状态 4.yarn container 查看容器
hadoop-yarn-api-python-client:Hadoop:registered:YARN API的Python客户端
05-08
hadoop-yarn-api-python-client 适用于ApacheHadoop:registered:YARN API的Python客户端 软件包文档： REST API文档： 兼容性库与Apache Hadoop 3.2.1兼容。 如果您使用的版本不是上述版本（或类似Hortonworks的供应...
yarn 常用命令
衣乌安、随笔
12-28 308
初始化新项目 yarn init 添加依赖包 yarn add [package] yarn add [package]@[version] yarn add [package]@[tag] 将依赖项添加到不同依赖项类别 分别添加到 devDependencies、peerDependencies 和 optionalDependencies： yarn add [packag...
Hadoop-yarn命令
nituoge的博客
12-13 458
一. yarn命令 [ruoze@rzdata001 ~]$ which yarn ~/app/hadoop/bin/yarn [ruoze@rzdata001 ~]$ yarn -help yarn查看帮助 [ruoze@rzdata001 ~]$ yarn -help Usage: yarn [--config confdir] COMMAND where COMMAND is one...
SecondaryNameNode
luyee2010的专栏
03-01 598
SecondaryNameNode有两个作用，一是镜像备份，二是日志与镜像的定期合并。两个过程同时进行，称为checkpoint  总共分五步：  1.SecondaryNameNode通知NameNode准备提交edits文件，此时主节点产生edits.new  2.SecondaryNameNode通过http get方式获取NameNode的fsimage与edits文件（在Secon
Hadoop技术-YARN资源调度器.pptx
11-02
"Hadoop技术-YARN资源调度器" Hadoop技术作为大数据处理的重要技术之一，YARN（Yet Another Resource Negotiator）作为Hadoop的资源管理层，负责管理和分配集群资源。YARN资源调度器是Hadoop YARN中最核心的组件之...
Apache Hadoop YARN:【Hadoop YARN权威指南】
11-16
Apache Hadoop YARN:Moving beyond MapReduce and Batch Processing with Apach 2 【yarn权威指南】
hadoop-yarn-api-2.5.1-API文档-中文版.zip
04-23
赠送jar包：hadoop-yarn-api-2.5.1.jar； 赠送原API文档：hadoop-yarn-api-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-api-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-api-2.5.1.pom； 包含翻译后...
hadoop-yarn-client-2.6.5-API文档-中文版.zip
05-01
赠送jar包：hadoop-yarn-client-2.6.5.jar； 赠送原API文档：hadoop-yarn-client-2.6.5-javadoc.jar； 赠送源代码：hadoop-yarn-client-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-client-2.6.5.pom；...
Hadoop2.0构成之HDFS2.0
weixin_33868027的博客
08-02 391
HDFS2.0之HA 主备NameNode：　　1、主NameNode对外提供服务，备NameNode同步主NameNode元数据，以待切换；　　2、主NameNode的信息发生变化后，会将信息写到共享数据存储系统中让备NameNode合并到自己的内存中；　　3、所有DataNode同时向两个NameNode发送心跳信息（块信息）； 两种切换方式：　　1、手动切换：通过命令实现主备之间的切...
Git Extensions 尚未提供文件名,因此无法启动进程
热门推荐
希望能找到你的答案
05-09 14万+
根据别人的博客按照步骤安装
yarn安装及配置(nodejs16.10以上版本)
IT聚合号
12-31 6490
yarn安装及配置 安装yarn nodejs16.10以上版本安装时自带了yarn，通过corepack 即可安装，执行命令如下： corepack enable 此时nodejs的目录结构如下，可以看出yarn已经被安装 此时在cmd命令下即可进行yarn操作了： yarn -version 1.22.15 更新yarn时可以执行如下命令： yarn set version stable 配置yarn 参考官方文档： Install Corepack The preferred way to m
Hadoop启动过程中执行start-all.sh，后台发生了什么
红叶幽香的博客
11-15 1万+
Hadoop启动执行start-all.sh，后台发生了什么 start-all.sh脚本 , start-dfs.sh,start-yarn.sh, hdfs, hadoop start-daemons.sh
为什么在Nodes of the cluster页面没有显示所有的node？
qingyang0320的专栏
05-15 6874
启动整个Hadoop集群： [root@sparkmaster ~]# start-dfs.sh [root@sparkmaster ~]# yarn-daemon.sh start resourcemanager starting resourcemanager, logging to /opt/hadoop-2.6.0//logs/yarn-root-resourcemana
【job排错】记一次flink on hadoop with per-job 报错排查
hiliang521的博客
07-04 2001
flink job突然提交不到yarn上，本文通过排查日志，查找一些hadoop内部通讯信息，来指导对hadoop内各daemon进程的一些检查和操作。
YARN监控管理与资源管理.pdf
最新发布
04-10
"Apache Hadoop YARN 是一种资源管理器，负责集群的统一管理和调度，为上层应用如 MapReduce 提供计算资源。YARN Web UI 提供了监控和管理应用的功能，包括 V1 和 V2 版本的界面，展示应用程序的状态、日志和集群...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值