64位windows安装hadoop没必要倒腾Cygwin，直接解压官网下载hadoop安装包到本地->最小化配置4个基本文件->执行1条启动命令->完事。一个前提是你的电脑上已经安装了jdk，设置了java环境变量，本人用的是jdk1.7.0_15。下面把这几步细化贴出来，以hadoop2.6.1为例
1、下载hadoop安装包就不细说了：https://archive.apache.org/dist/hadoop/common/，里面有所有hadoop版本，请自行下载，本人用的是hadoop-2.6.1.tar.gz；
2、解压也不细说了：复制到D盘根目录直接解压，出来一个目录D:\hadoop-2.6.1，（如果windows解压有问题，可以去linux环境解压，再下载至windows环境），配置到环境变量HADOOP_HOME中，在PATH里加上%HADOOP_HOME%\bin；点击http://download.csdn.net/download/abcdefg0929/10153550下载相关工具类，直接解压后把文件丢到D:\hadoop-2.6.1\bin目录中去，将其中的hadoop.dll在c:/windows/System32下也放一份；
3、去D:\hadoop-2.6.1\etc\hadoop找到下面4个文件并按如下最小配置粘贴上去：
core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/hadoop/data/dfs/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/hadoop/data/dfs/datanode</value>
</property>
</configuration>mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>yarn-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>4、启动windows命令行窗口，进入hadoop-2.6.1\bin目录，执行下面2条命令，先格式化namenode再启动hadoop
D:\hadoop-2.6.1\bin>hadoop namenode -format
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
17/05/13 07:16:40 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = *****/192.168.8.5
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 2.6.1
STARTUP_MSG: classpath = D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\share\hado
op\common\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apached
s-i18n-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-kerberos-c
odec-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M2
0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\hadoop-2
.6.1\share\hadoop\common\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib
\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-1.7.0.
jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\
hadoop-2.6.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\h
adoop\common\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\c
ommons-collections-3.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-com
press-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-configuration-1.
6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\hadoop
-2.6.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\
hadoop\common\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\com
mons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-logging-1.1.3.
jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\hadoop-2.
7.2\share\hadoop\common\lib\commons-net-3.1.jar;D:\hadoop-2.6.1\share\hadoop\com
mon\lib\curator-client-2.7.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator
-framework-2.7.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-recipes-2.7
.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\hadoop-2.6.1\sh
are\hadoop\common\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\h
adoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-auth-
2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\hadoo
p-2.6.1\share\hadoop\common\lib\htrace-core-3.1.0-incubating.jar;D:\hadoop-2.6.1
\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\commo
n\lib\httpcore-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-core-as
l-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:
\hadoop-2.6.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.
7.2\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\c
ommon\lib\java-xmlbuilder-0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-a
pi-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\ha
doop-2.6.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\had
oop\common\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jerse
y-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\had
oop-2.6.1\share\hadoop\common\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\
common\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-util-6
.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\hadoop-2.7.
2\share\hadoop\common\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\li
b\jsr305-3.0.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\junit-4.11.jar;D:\had
oop-2.6.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\
common\lib\mockito-all-1.8.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\netty-3
.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\hado
op-2.6.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\h
adoop\common\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf
4j-api-1.7.10.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-log4j12-1.7.10.j
ar;D:\hadoop-2.6.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.7
.2\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\commo
n\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xz-1.0.jar;D:\hado
op-2.6.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoo
p\common\hadoop-common-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoo
p-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-nfs-2.6.1.jar;D:\h
adoop-2.6.1\share\hadoop\hdfs;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\asm-3.2.jar;
D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\
hadoop\hdfs\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\comm
ons-daemon-1.0.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D
:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\
hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\
guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\htrace-core-3.1.0-incubat
ing.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\had
oop-2.6.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\sh
are\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\je
rsey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\ha
doop-2.6.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\had
oop\hdfs\lib\jsr305-3.0.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\leveldbjni-a
ll-1.8.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\hadoop-2.7.
2\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\
lib\netty-all-4.0.23.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\protobuf-ja
va-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\hadoop
-2.6.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\hadoop-2.6.1\share\hadoop\h
dfs\lib\xml-apis-1.3.04.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xmlenc-0.52.ja
r;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1-tests.jar;D:\hadoop-2.6.1\
share\hadoop\hdfs\hadoop-hdfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop
-hdfs-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\
hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\had
oop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.j
ar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\s
hare\hadoop\yarn\lib\commons-collections-3.2.2.jar;D:\hadoop-2.6.1\share\hadoop\
yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\common
s-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoo
p-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\ha
doop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.j
ar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\s
hare\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\ya
rn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-ma
pper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;
D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\h
adoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-imp
l-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\had
oop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop
\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json
-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2
.7.2\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\li
b\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D
:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-3.0.0.jar;D:\hadoop-2.6.1\share\hado
op\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1
.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-
2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop
\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0
-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\ha
doop\yarn\lib\zookeeper-3.4.6-tests.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zo
okeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:
\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.
jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-laun
cher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:
\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\sha
re\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\
hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\had
oop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\h
adoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop
-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-
yarn-server-sharedcachemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoo
p-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-serv
er-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\aopalliance-1.
0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\hadoop-2.6.1\sha
re\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\li
b\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-
io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\hadoop-2.
7.2\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoo
p\mapreduce\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapred
uce\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson
-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-mapper-a
sl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\h
adoop-2.6.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share
\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduc
e\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\junit-4.1
1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\hadoo
p-2.6.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop
\mapreduce\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\
paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0
.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\hadoo
p-2.6.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapre
duce\hadoop-mapreduce-client-app-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduc
e\hadoop-mapreduce-client-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduc
e\hadoop-mapreduce-client-core-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\
hadoop-mapreduce-client-hs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hado
op-mapreduce-client-hs-plugins-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\
hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\m
apreduce\hadoop-mapreduce-client-jobclient-2.6.1.jar;D:\hadoop-2.6.1\share\hadoo
p\mapreduce\hadoop-mapreduce-client-shuffle-2.6.1.jar;D:\hadoop-2.6.1\share\hado
op\mapreduce\hadoop-mapreduce-examples-2.6.1.jar
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b16
5c4fe8a74265c792ce23f546c64604acf0e41; compiled by 'jenkins' on 2016-01-26T00:08
Z
STARTUP_MSG: java = 1.8.0_101
************************************************************/
17/05/13 07:16:40 INFO namenode.NameNode: createNameNode [-format]
Formatting using clusterid: CID-1284c5d0-592a-4a41-b185-e53fb57dcfbf
17/05/13 07:16:42 INFO namenode.FSNamesystem: No KeyProvider found.
17/05/13 07:16:42 INFO namenode.FSNamesystem: fsLock is fair:true
17/05/13 07:16:42 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.lim
it=1000
17/05/13 07:16:42 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.re
gistration.ip-hostname-check=true
17/05/13 07:16:42 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.
block.deletion.sec is set to 000:00:00:00.000
17/05/13 07:16:42 INFO blockmanagement.BlockManager: The block deletion will sta
rt around 2017 五月 13 07:16:42
17/05/13 07:16:42 INFO util.GSet: Computing capacity for map BlocksMap
17/05/13 07:16:42 INFO util.GSet: VM type = 64-bit
17/05/13 07:16:42 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
17/05/13 07:16:42 INFO util.GSet: capacity = 2^21 = 2097152 entries
17/05/13 07:16:42 INFO blockmanagement.BlockManager: dfs.block.access.token.enab
le=false
17/05/13 07:16:42 INFO blockmanagement.BlockManager: defaultReplication
= 1
17/05/13 07:16:42 INFO blockmanagement.BlockManager: maxReplication
= 512
17/05/13 07:16:42 INFO blockmanagement.BlockManager: minReplication
= 1
17/05/13 07:16:42 INFO blockmanagement.BlockManager: maxReplicationStreams
= 2
17/05/13 07:16:42 INFO blockmanagement.BlockManager: replicationRecheckInterval
= 3000
17/05/13 07:16:42 INFO blockmanagement.BlockManager: encryptDataTransfer
= false
17/05/13 07:16:42 INFO blockmanagement.BlockManager: maxNumBlocksToLog
= 1000
17/05/13 07:16:42 INFO namenode.FSNamesystem: fsOwner = Administrato
r (auth:SIMPLE)
17/05/13 07:16:42 INFO namenode.FSNamesystem: supergroup = supergroup
17/05/13 07:16:42 INFO namenode.FSNamesystem: isPermissionEnabled = true
17/05/13 07:16:42 INFO namenode.FSNamesystem: HA Enabled: false
17/05/13 07:16:42 INFO namenode.FSNamesystem: Append Enabled: true
17/05/13 07:16:43 INFO util.GSet: Computing capacity for map INodeMap
17/05/13 07:16:43 INFO util.GSet: VM type = 64-bit
17/05/13 07:16:43 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
17/05/13 07:16:43 INFO util.GSet: capacity = 2^20 = 1048576 entries
17/05/13 07:16:43 INFO namenode.FSDirectory: ACLs enabled? false
17/05/13 07:16:43 INFO namenode.FSDirectory: XAttrs enabled? true
17/05/13 07:16:43 INFO namenode.FSDirectory: Maximum size of an xattr: 16384
17/05/13 07:16:43 INFO namenode.NameNode: Caching file names occuring more than
times
17/05/13 07:16:43 INFO util.GSet: Computing capacity for map cachedBlocks
17/05/13 07:16:43 INFO util.GSet: VM type = 64-bit
17/05/13 07:16:43 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
17/05/13 07:16:43 INFO util.GSet: capacity = 2^18 = 262144 entries
17/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pc
t = 0.9990000128746033
17/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanode
s = 0
17/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension
= 30000
17/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.n
um.buckets = 10
17/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.user
s = 10
17/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.
minutes = 1,5,25
17/05/13 07:16:43 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
17/05/13 07:16:43 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total
heap and retry cache entry expiry time is 600000 millis
17/05/13 07:16:43 INFO util.GSet: Computing capacity for map NameNodeRetryCache
17/05/13 07:16:43 INFO util.GSet: VM type = 64-bit
17/05/13 07:16:43 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.
KB
17/05/13 07:16:43 INFO util.GSet: capacity = 2^15 = 32768 entries
17/05/13 07:16:43 INFO namenode.FSImage: Allocated new BlockPoolId: BP-664414510
-192.168.8.5-1494631003212
17/05/13 07:16:43 INFO common.Storage: Storage directory \hadoop\data\dfs\nameno
de has been successfully formatted.
17/05/13 07:16:43 INFO namenode.NNStorageRetentionManager: Going to retain 1 ima
ges with txid >= 0
17/05/13 07:16:43 INFO util.ExitUtil: Exiting with status 0
17/05/13 07:16:43 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at ******/192.168.8.5
************************************************************/
D:\hadoop-2.6.1\bin>cd ..\sbin
D:\hadoop-2.6.1\sbin>start-all.cmd
This script is Deprecated. Instead use start-dfs.cmd and start-yarn.cmd
starting yarn daemons
D:\hadoop-2.6.1\sbin>jps
DataNode
NodeManager
Jps
NameNode
ResourceManager
D:\hadoop-2.6.1\sbin>通过jps命令可以看到4个进程都拉起来了，到这里hadoop的安装启动已经完事了。接着我们可以用浏览器到localhost:8088看mapreduce任务，到localhost:50070->Utilites->Browse the file system看hdfs文件。如果重启hadoop无需再格式化namenode，只要stop-all.cmd再start-all.cmd就可以了。
上面拉起4个进程时会弹出4个窗口，我们可以看看这4个进程启动时都干了啥:
DataNode
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
17/12/11 10:31:24 INFO datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = n-*********/169.254.194.63
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.6.1
STARTUP_MSG: classpath = D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\share\hadoop\common\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-configuration-1.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-net-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-client-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-framework-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-recipes-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-auth-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpcore-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-compiler-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\java-xmlbuilder-0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\mockito-all-1.8.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-api-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-log4j12-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-daemon-1.0.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xml-apis-1.3.04.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-app-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-core-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-shuffle-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.6.1.jar
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07Z
STARTUP_MSG: java = 1.7.0_15
************************************************************/NameNode
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
17/12/11 10:31:24 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = n-*********/169.254.194.63
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.6.1
STARTUP_MSG: classpath = D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\share\hadoop\common\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-configuration-1.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-net-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-client-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-framework-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-recipes-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-auth-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpcore-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-compiler-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\java-xmlbuilder-0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\mockito-all-1.8.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-api-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-log4j12-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-daemon-1.0.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xml-apis-1.3.04.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-app-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-core-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-shuffle-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.6.1.jar
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07Z
STARTUP_MSG: java = 1.7.0_15
************************************************************/
17/12/11 10:31:24 INFO namenode.NameNode: createNameNode []
17/12/11 10:31:24 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
17/12/11 10:31:24 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
17/12/11 10:31:24 INFO impl.MetricsSystemImpl: NameNode metrics system started
17/12/11 10:31:24 INFO namenode.NameNode: fs.defaultFS is hdfs://localhost:9000
17/12/11 10:31:24 INFO namenode.NameNode: Clients are to use localhost:9000 to access this namenode/service.
17/12/11 10:31:34 INFO hdfs.DFSUtil: Starting Web-server for hdfs at: http://0.0.0.0:50070
17/12/11 10:31:34 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
17/12/11 10:31:34 INFO http.HttpRequestLog: Http request log for http.requests.namenode is not defined
17/12/11 10:31:34 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17/12/11 10:31:34 INFO http.HttpServer2: Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
17/12/11 10:31:34 INFO http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
17/12/11 10:31:34 INFO http.HttpServer2: Jetty bound to port 50070
17/12/11 10:31:34 INFO mortbay.log: jetty-6.1.26
17/12/11 10:31:34 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
17/12/11 10:31:34 WARN namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
17/12/11 10:31:34 WARN namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!
17/12/11 10:31:34 INFO namenode.FSNamesystem: No KeyProvider found.
17/12/11 10:31:34 INFO namenode.FSNamesystem: fsLock is fair:true
17/12/11 10:31:34 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
17/12/11 10:31:34 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
17/12/11 10:31:34 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
17/12/11 10:31:34 INFO blockmanagement.BlockManager: The block deletion will start around 2017 十二月 11 10:31:34
17/12/11 10:31:34 INFO util.GSet: Computing capacity for map BlocksMap
17/12/11 10:31:34 INFO util.GSet: VM type = 64-bit
17/12/11 10:31:34 INFO util.GSet: 2.0% max memory 888.9 MB = 17.8 MB
17/12/11 10:31:34 INFO util.GSet: capacity = 2^21 = 2097152 entries
17/12/11 10:31:34 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
17/12/11 10:31:34 INFO blockmanagement.BlockManager: defaultReplication = 1
17/12/11 10:31:34 INFO blockmanagement.BlockManager: maxReplication = 512
17/12/11 10:31:34 INFO blockmanagement.BlockManager: minReplication = 1
17/12/11 10:31:34 INFO blockmanagement.BlockManager: maxReplicationStreams = 2
17/12/11 10:31:34 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
17/12/11 10:31:34 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
17/12/11 10:31:34 INFO blockmanagement.BlockManager: encryptDataTransfer = false
17/12/11 10:31:34 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000
17/12/11 10:31:34 INFO namenode.FSNamesystem: fsOwner = ********* (auth:SIMPLE)
17/12/11 10:31:34 INFO namenode.FSNamesystem: supergroup = supergroup
17/12/11 10:31:34 INFO namenode.FSNamesystem: isPermissionEnabled = true
17/12/11 10:31:34 INFO namenode.FSNamesystem: HA Enabled: false
17/12/11 10:31:34 INFO namenode.FSNamesystem: Append Enabled: true
17/12/11 10:31:35 INFO util.GSet: Computing capacity for map INodeMap
17/12/11 10:31:35 INFO util.GSet: VM type = 64-bit
17/12/11 10:31:35 INFO util.GSet: 1.0% max memory 888.9 MB = 8.9 MB
17/12/11 10:31:35 INFO util.GSet: capacity = 2^20 = 1048576 entries
17/12/11 10:31:35 INFO namenode.NameNode: Caching file names occuring more than 10 times
17/12/11 10:31:35 INFO util.GSet: Computing capacity for map cachedBlocks
17/12/11 10:31:35 INFO util.GSet: VM type = 64-bit
17/12/11 10:31:35 INFO util.GSet: 0.25% max memory 888.9 MB = 2.2 MB
17/12/11 10:31:35 INFO util.GSet: capacity = 2^18 = 262144 entries
17/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
17/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
17/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
17/12/11 10:31:35 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
17/12/11 10:31:35 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
17/12/11 10:31:35 INFO util.GSet: Computing capacity for map NameNodeRetryCache
17/12/11 10:31:35 INFO util.GSet: VM type = 64-bit
17/12/11 10:31:35 INFO util.GSet: 0.029999999329447746% max memory 888.9 MB = 273.1 KB
17/12/11 10:31:35 INFO util.GSet: capacity = 2^15 = 32768 entries
17/12/11 10:31:35 INFO namenode.NNConf: ACLs enabled? false
17/12/11 10:31:35 INFO namenode.NNConf: XAttrs enabled? true
17/12/11 10:31:35 INFO namenode.NNConf: Maximum size of an xattr: 16384
17/12/11 10:31:35 INFO common.Storage: Lock on \hadoop\data\dfs\namenode\in_use.lock acquired by nodename 14240@n-*********
17/12/11 10:31:35 INFO namenode.FileJournalManager: Recovering unfinalized segments in \hadoop\data\dfs\namenode\current
17/12/11 10:31:35 INFO namenode.FileJournalManager: Finalizing edits file \hadoop\data\dfs\namenode\current\edits_inprogress_0000000000000000150 -> \hadoop\data\dfs\namenode\current\edits_0000000000000000150-0000000000000000210
17/12/11 10:31:35 INFO namenode.FSImageFormatPBINode: Loading 8 INodes.
17/12/11 10:31:35 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
17/12/11 10:31:35 INFO namenode.FSImage: Loaded image for txid 149 from \hadoop\data\dfs\namenode\current\fsimage_0000000000000000149
17/12/11 10:31:35 INFO namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@27a1882 expecting start txid #150
17/12/11 10:31:35 INFO namenode.FSImage: Start loading edits file \hadoop\data\dfs\namenode\current\edits_0000000000000000150-0000000000000000210
17/12/11 10:31:35 INFO namenode.EditLogInputStream: Fast-forwarding stream '\hadoop\data\dfs\namenode\current\edits_0000000000000000150-0000000000000000210' to transaction ID 150
17/12/11 10:31:35 INFO namenode.FSImage: Edits file \hadoop\data\dfs\namenode\current\edits_0000000000000000150-0000000000000000210 of size 1048576 edits # 61 loaded in 0 seconds
17/12/11 10:31:35 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
17/12/11 10:31:35 INFO namenode.FSEditLog: Starting log segment at 211
17/12/11 10:31:35 INFO namenode.NameCache: initialized with 0 entries 0 lookups
17/12/11 10:31:35 INFO namenode.FSNamesystem: Finished loading FSImage in 416 msecs
17/12/11 10:31:35 INFO namenode.NameNode: RPC server is binding to localhost:9000
17/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 9000
17/12/11 10:31:35 INFO namenode.FSNamesystem: Registered FSNamesystemState MBean
17/12/11 10:31:35 INFO namenode.LeaseManager: Number of blocks under construction: 0
17/12/11 10:31:35 INFO namenode.LeaseManager: Number of blocks under construction: 0
17/12/11 10:31:35 INFO hdfs.StateChange: STATE* Safe mode ON.
The reported blocks 0 needs additional 2 blocks to reach the threshold 0.9990 of total blocks 2.
The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 9000: starting
17/12/11 10:31:36 INFO namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:9000
17/12/11 10:31:36 INFO namenode.FSNamesystem: Starting services required for active state
17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds
17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 4782753 milliseconds
17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 5 millisecond(s).
17/12/11 10:32:06 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
17/12/11 10:32:06 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
17/12/11 10:32:36 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 30004 milliseconds
1NodeManager
17/12/11 10:31:24 INFO nodemanager.NodeManager: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NodeManager
STARTUP_MSG: host = n-*********/169.254.194.63
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.6.1
STARTUP_MSG: classpath = D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\share\hadoop\common\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-configuration-1.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-net-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-client-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-framework-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-recipes-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-auth-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpcore-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-compiler-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\java-xmlbuilder-0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\mockito-all-1.8.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-api-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-log4j12-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-daemon-1.0.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xml-apis-1.3.04.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-app-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-core-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-shuffle-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\etc\hadoop\nm-config\log4j.properties
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07Z
STARTUP_MSG: java = 1.7.0_15
************************************************************/
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager
17/12/11 10:31:34 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
17/12/11 10:31:34 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
17/12/11 10:31:34 INFO impl.MetricsSystemImpl: NodeManager metrics system started
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
17/12/11 10:31:34 INFO localizer.ResourceLocalizationService: per directory file limit = 8192
17/12/11 10:31:35 INFO localizer.ResourceLocalizationService: usercache path : file:/tmp/hadoop-*********/nm-local-dir/usercache_DEL_1512959494692
17/12/11 10:31:35 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
17/12/11 10:31:35 WARN containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
17/12/11 10:31:35 INFO containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"
17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.WindowsResourceCalculatorPlugin@52c9a2e5
17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null
17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Physical memory check enabled: true
17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Virtual memory check enabled: true
17/12/11 10:31:35 WARN monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (7.9 G). Thrashing might happen.
17/12/11 10:31:35 INFO nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8
17/12/11 10:31:44 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:44 INFO ipc.Server: Starting Socket Reader #1 for port 1499
17/12/11 10:31:45 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
17/12/11 10:31:45 INFO containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.
17/12/11 10:31:45 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:45 INFO ipc.Server: IPC Server listener on 1499: starting
17/12/11 10:31:54 INFO security.NMContainerTokenSecretManager: Updating node address : n-*********.cattsoft.com:1499
17/12/11 10:31:54 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:54 INFO ipc.Server: Starting Socket Reader #1 for port 8040
17/12/11 10:31:54 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
17/12/11 10:31:54 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:54 INFO ipc.Server: IPC Server listener on 8040: starting
17/12/11 10:31:54 INFO localizer.ResourceLocalizationService: Localizer started on port 8040
17/12/11 10:31:54 INFO mapred.IndexCache: IndexCache created with max memory = 10485760
17/12/11 10:31:54 INFO mapred.ShuffleHandler: httpshuffle listening on port 13562
17/12/11 10:31:54 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
17/12/11 10:31:54 INFO containermanager.ContainerManagerImpl: ContainerManager started at n-*********/169.254.194.63:1499
17/12/11 10:31:54 INFO containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0
17/12/11 10:31:54 INFO webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
17/12/11 10:31:54 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
17/12/11 10:31:54 INFO http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined
17/12/11 10:31:54 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
17/12/11 10:31:54 INFO http.HttpServer2: adding path spec: /node/*
17/12/11 10:31:54 INFO http.HttpServer2: adding path spec: /ws/*
17/12/11 10:31:54 INFO http.HttpServer2: Jetty bound to port 8042
17/12/11 10:31:54 INFO mortbay.log: jetty-6.1.26
17/12/11 10:31:54 INFO mortbay.log: Extract jar:file:/D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/node to C:\Users\ZHANGY~1\AppData\Local\Temp\Jetty_0_0_0_0_8042_node____19tj0x\webapp
17/12/11 10:31:54 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
17/12/11 10:31:54 INFO webapp.WebApps: Web app /node started at 8042
17/12/11 10:31:54 INFO webapp.WebApps: Registered webapp guice modules
17/12/11 10:31:55 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031
17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
17/12/11 10:31:55 INFO security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 497745216
17/12/11 10:31:55 INFO security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 1830901777
17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as n-*********.cattsoft.com:1499 with total resource of <memory:8192, vCores:8>
17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requestsResourceManager
17/12/11 10:31:24 INFO resourcemanager.ResourceManager: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting ResourceManager
STARTUP_MSG: host = n-*********/169.254.194.63
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.6.1
STARTUP_MSG: classpath = D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\etc\hadoop;D:\hadoop-2.6.1\share\hadoop\common\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-configuration-1.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\commons-net-3.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-client-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-framework-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\curator-recipes-2.6.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hadoop-auth-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\httpcore-4.2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-compiler-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\java-xmlbuilder-0.4.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\mockito-all-1.8.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-api-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\slf4j-log4j12-1.7.5.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\common\hadoop-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-daemon-1.0.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-el-1.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\htrace-core-3.0.4.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jasper-runtime-5.5.23.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsp-api-2.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xml-apis-1.3.04.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\lib\xmlenc-0.52.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\hdfs\hadoop-hdfs-nfs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hadoop-annotations-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\hamcrest-core-1.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\junit-4.11.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\paranamer-2.3.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-app-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-core-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-client-shuffle-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-api-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-client-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-registry-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-common-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-tests-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.6.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-httpclient-3.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jline-0.9.94.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\jsr305-1.3.9.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\hadoop-2.6.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\hadoop-2.6.1\etc\hadoop\rm-config\log4j.properties
STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07Z
STARTUP_MSG: java = 1.7.0_15
************************************************************/
17/12/11 10:31:24 INFO conf.Configuration: found resource core-site.xml at file:/D:/hadoop-2.6.1/etc/hadoop/core-site.xml
17/12/11 10:31:24 INFO security.Groups: clearing userToGroupsMap cache
17/12/11 10:31:24 INFO conf.Configuration: found resource yarn-site.xml at file:/D:/hadoop-2.6.1/etc/hadoop/yarn-site.xml
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
17/12/11 10:31:34 INFO security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
17/12/11 10:31:34 INFO security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
17/12/11 10:31:34 INFO security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
17/12/11 10:31:34 INFO resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
17/12/11 10:31:34 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
17/12/11 10:31:34 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
17/12/11 10:31:34 INFO impl.MetricsSystemImpl: ResourceManager metrics system started
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
17/12/11 10:31:34 INFO resourcemanager.RMNMInfo: Registered RMNMInfo MBean
17/12/11 10:31:34 INFO util.HostsFileReader: Refreshing hosts (include/exclude) list
17/12/11 10:31:34 INFO conf.Configuration: found resource capacity-scheduler.xml at file:/D:/hadoop-2.6.1/etc/hadoop/capacity-scheduler.xml
17/12/11 10:31:34 INFO capacity.ParentQueue: root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*, labels=*,
, reservationsContinueLooking=true
17/12/11 10:31:34 INFO capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root
17/12/11 10:31:34 INFO capacity.LeafQueue: Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]
nodeLocalityDelay = 40
labels=*,
nodeLocalityDelay = 40
reservationsContinueLooking = true
17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue mappings, override: false
17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>, asynchronousScheduling=false, asyncScheduleInterval=5ms
17/12/11 10:31:34 INFO metrics.SystemMetricsPublisher: YARN system metrics publishing service is not enabled
17/12/11 10:31:34 INFO resourcemanager.ResourceManager: Transitioning to active state
17/12/11 10:31:34 INFO security.RMContainerTokenSecretManager: Rolling master-key for container-tokens
17/12/11 10:31:34 INFO security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens
17/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:34 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 1
17/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
17/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:34 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 2
17/12/11 10:31:34 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:34 INFO ipc.Server: Starting Socket Reader #1 for port 8031
17/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8031: starting
17/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 8030
17/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8030: starting
17/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 8032
17/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8032: starting
17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:35 INFO resourcemanager.ResourceManager: Transitioned to active state
17/12/11 10:31:35 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
17/12/11 10:31:35 INFO http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined
17/12/11 10:31:35 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster
17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static
17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs
17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
17/12/11 10:31:44 INFO http.HttpServer2: adding path spec: /cluster/*
17/12/11 10:31:44 INFO http.HttpServer2: adding path spec: /ws/*
17/12/11 10:31:44 INFO http.HttpServer2: Jetty bound to port 8088
17/12/11 10:31:44 INFO mortbay.log: jetty-6.1.26
17/12/11 10:31:44 INFO mortbay.log: Extract jar:file:/D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to C:\Users\ZHANGY~1\AppData\Local\Temp\Jetty_0_0_0_0_8088_cluster____u0rgz3\webapp
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
17/12/11 10:31:45 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088
17/12/11 10:31:45 INFO webapp.WebApps: Web app /cluster started at 8088
17/12/11 10:31:45 INFO webapp.WebApps: Registered webapp guice modules
17/12/11 10:31:45 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
17/12/11 10:31:45 INFO ipc.Server: Starting Socket Reader #1 for port 8033
17/12/11 10:31:45 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
17/12/11 10:31:45 INFO ipc.Server: IPC Server Responder: starting
17/12/11 10:31:45 INFO ipc.Server: IPC Server listener on 8033: starting
17/12/11 10:31:55 INFO util.RackResolver: Resolved n-*********.cattsoft.com to /default-rack
17/12/11 10:31:55 INFO resourcemanager.ResourceTrackerService: NodeManager from node n-*********.cattsoft.com(cmPort: 1499 httpPort: 8042) registered with capability: <memory:8192, vCores:8>, assigned nodeId n-*********.cattsoft.com:1499
17/12/11 10:31:55 INFO rmnode.RMNodeImpl: n-*********.cattsoft.com:1499 Node Transitioned from NEW to RUNNING
17/12/11 10:31:55 INFO capacity.CapacityScheduler: Added node n-*********.cattsoft.com:1499 clusterResource: <memory:8192, vCores:8>如果hadoop datanode无法正常启动，核查配置，直接删除本地dfs，格式化hdfs即可（hadoop namenode -format）
转载自：http://www.cnblogs.com/wuxun1997/p/6847950.html
438
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
