Java hadoop 守护进程 小白教程

一、五大守护进程

hadoop1.x

NameNode

DataNode

SecondaryNameNode

TaskTracker

JobTracker

hadoop2.x

SecondaryNameNode

ResourceManager

NodeManager

NameNode

DataNode

二、三种启动与关闭方式

1、sbin/start-all.sh

sbin/stop-all.sh

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps

31355 Jps

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/start-all.sh

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh

17/05/29 09:14:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

Starting namenodes on [localhost]

localhost: starting namenode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-namenode-zhaojunyandeMacBook-Pro.local.out

localhost: starting datanode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-datanode-zhaojunyandeMacBook-Pro.local.out

Starting secondary namenodes [0.0.0.0]

0.0.0.0: starting secondarynamenode, logging to /myFile/04.BigData/hadoop-2.7.0/logs/hadoop-zhaojunyan-secondarynamenode-zhaojunyandeMacBook-Pro.local.out

17/05/29 09:14:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

starting yarn daemons

starting resourcemanager, logging to /myFile/04.BigData/hadoop-2.7.0/logs/yarn-zhaojunyan-resourcemanager-zhaojunyandeMacBook-Pro.local.out

localhost: starting nodemanager, logging to /myFile/04.BigData/hadoop-2.7.0/logs/yarn-zhaojunyan-nodemanager-zhaojunyandeMacBook-Pro.local.out

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps

31888 Jps

31650 SecondaryNameNode

31762 ResourceManager

31847 NodeManager

31466 NameNode

31547 DataNode

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/stop-all.sh

This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh

17/05/29 09:15:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

Stopping namenodes on [localhost]

localhost: stopping namenode

localhost: stopping datanode

Stopping secondary namenodes [0.0.0.0]

0.0.0.0: stopping secondarynamenode

17/05/29 09:15:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

stopping yarn daemons

stopping resourcemanager

localhost: stopping nodemanager

no proxyserver to stop

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$

2、sbin/start-dfs.sh

sbin/start-yarn.sh(hadoop2.x) sbin/start-mapred.sh(hadoop1.x)

sbin/stop-yarn.sh(hadoop2.x) sbin/stop-mapred.sh(hadoop1.x)

sbin/stop-dfs.sh

dfs: DataNode SecondaryNameNode NameNode

yarn: ResourceManager NodeManager

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ jps

33595 Jps

zhaojunyandeMacBook-Pro:hadoop-2.7.0 zhaojunyan$ sbin/start-dfs.sh

17/05/29 09:27:31 WARN ut