Hadoop 集群群起

文章目录

• • 配置 slaves
  • 启动 HDFS
  • 启动 Yarn
  • 查看
  • 停止

hadoop102

hadoop103

hadoop104

HDFS

NameNode
DataNode

DataNode

SecondaryNameNode
DataNode

YARN

NodeManager

ResourceManager
NodeManager

NodeManager

配置 slaves

/opt/module/hadoop-2.7.2/etc/hadoop/slaves

[root@hadoop102 hadoop] vim slaves 
hadoop102
hadoop103
hadoop104

分发

[root@hadoop102 hadoop] xsync slaves 
fname=slaves
pdir=/opt/module/hadoop-2.7.2/etc/hadoop
--------------------- hadoop102 ----------------
sending incremental file list

sent 29 bytes  received 12 bytes  82.00 bytes/sec
total size is 30  speedup is 0.73
--------------------- hadoop103 ----------------
sending incremental file list
slaves

sent 102 bytes  received 37 bytes  92.67 bytes/sec
total size is 30  speedup is 0.22
--------------------- hadoop104 ----------------
sending incremental file list
slaves

sent 102 bytes  received 37 bytes  278.00 bytes/sec
total size is 30  speedup is 0.22

确认103配置已更新

[root@hadoop103 hadoop] cat slaves 
hadoop102
hadoop103
hadoop104

启动 HDFS

[root@hadoop102 hadoop] start-dfs.sh 
Starting namenodes on [hadoop102]
hadoop102: starting namenode, logging to /opt/module/hadoop-2.7.2/logs/hadoop-root-namenode-hadoop102.out
hadoop102: starting datanode, logging to /opt/module/hadoop-2.7.2/logs/hadoop-root-datanode-hadoop102.out
hadoop104: starting datanode, logging to /opt/module/hadoop-2.7.2/logs/hadoop-root-datanode-hadoop104.out
hadoop103: starting datanode, logging to /opt/module/hadoop-2.7.2/logs/hadoop-root-datanode-hadoop103.out
Starting secondary namenodes [hadoop104]
hadoop104: starting secondarynamenode, logging to /opt/module/hadoop-2.7.2/logs/hadoop-root-secondarynamenode-hadoop104.out

查看

[root@hadoop102 hadoop] jps
2896 NameNode
3025 DataNode
3226 Jps
[root@hadoop103 hadoop] jps
2614 Jps
2541 DataNode
[root@hadoop104 ~] jps
2885 Jps
2742 DataNode
2838 SecondaryNameNode

启动 Yarn

[root@hadoop103 hadoop] start-yarn.sh 
starting yarn daemons
starting resourcemanager, logging to /opt/module/hadoop-2.7.2/logs/yarn-root-resourcemanager-hadoop103.out
hadoop102: starting nodemanager, logging to /opt/module/hadoop-2.7.2/logs/yarn-root-nodemanager-hadoop102.out
hadoop104: starting nodemanager, logging to /opt/module/hadoop-2.7.2/logs/yarn-root-nodemanager-hadoop104.out
hadoop103: starting nodemanager, logging to /opt/module/hadoop-2.7.2/logs/yarn-root-nodemanager-hadoop103.out

查看

[root@hadoop103 hadoop] jps
2674 ResourceManager
2773 NodeManager
3068 Jps
2541 DataNode
[root@hadoop102 hadoop] jps
2896 NameNode
3025 DataNode
3379 Jps
3277 NodeManager
[root@hadoop104 ~] jps
2742 DataNode
2838 SecondaryNameNode
3081 Jps
2972 NodeManager

查看

停止

先在hadoop103停止yarn

[root@hadoop103 ~]# stop-yarn.sh
stopping yarn daemons
stopping resourcemanager
hadoop103: stopping nodemanager
hadoop102: stopping nodemanager
hadoop104: stopping nodemanager
no proxyserver to stop

然后在hadoop102停止hdfs

[root@hadoop102 ~]# stop-dfs.sh 
Stopping namenodes on [hadoop102]
hadoop102: stopping namenode
hadoop103: stopping datanode
hadoop102: stopping datanode
hadoop104: stopping datanode
Stopping secondary namenodes [hadoop104]
hadoop104: stopping secondarynamenode