【实验】Hadoop-2.7.2+zookeeper-3.4.6完全分布式环境搭建(HDFS、YARN HA)

最新推荐文章于 2023-05-16 18:07:15 发布
最新推荐文章于 2023-05-16 18:07:15 发布
阅读量335 收藏 1
点赞数 1

Hadoop-2.7.2+Zookeeper-3.4.6完全分布式环境搭建

一.版本

组件名版本说明
JREjava version "1.7.0_67"
Java™ SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot™ 64-Bit Server VM (build 24.65-b04, mixed mode)
Hadoophadoop-2.7.2.tar.gz主程序包
Zookeeperzookeeper-3.4.6.tar.gz热切,Yarn 存储数据使用的协调服务

二.主机规划

IPHost 及安装软件部署模块进程
172.16.101.55sht-sgmhadoopnn-01
hadoop		NameNode
ResourceManager		NameNode
DFSZKFailoverController
ResourceManager
172.16.101.56sht-sgmhadoopnn-02
hadoop		NameNode
ResourceManager		NameNode
DFSZKFailoverController
ResourceManager
172.16.101.58sht-sgmhadoopdn-01
hadoop、zookeeper		DataNode
NodeManager
Zookeeper		DataNode
NodeManager
JournalNode
QuorumPeerMain
172.16.101.59sht-sgmhadoopdn-02
Hadoop、zookeeper		DataNode
NodeManager
Zookeeper		DataNode
NodeManager
JournalNode
QuorumPeerMain
172.16.101.60sht-sgmhadoopdn-03
Hadoop、zookeeper		DataNode
NodeManager
Zookeeper		DataNode
NodeManager
JournalNode
QuorumPeerMain

三.目录规划

名称路径
$HADOOP_HOME/hadoop/hadoop-2.7.2
Data$ HADOOP_HOME/data
Log$ HADOOP_HOME/logs

四.常用脚本及命令

1.启动集群

start-dfs.sh

start-yarn.sh

2.关闭集群

stop-yarn.sh

stop-dfs.sh

3.监控集群

hdfs dfsadmin -report

4.单个进程启动/关闭

hadoop-daemon.sh start|stop namenode|datanode| journalnode

yarn-daemon.sh start |stop resourcemanager|nodemanager

http://blog.chinaunix.net/uid-25723371-id-4943894.html

五.环境准备

1 .设置ip地址(5台)


[root@sht-sgmhadoopnn-01 ~]# vi /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE="eth0"
BOOTPROTO="static"
DNS1="172.16.101.63"
DNS2="172.16.101.64"
GATEWAY="172.16.101.1"
HWADDR="00:50:56:82:50:1E"
IPADDR="172.16.101.55"
NETMASK="255.255.255.0"
NM_CONTROLLED="yes"
ONBOOT="yes"
TYPE="Ethernet"
UUID="257c075f-6c6a-47ef-a025-e625367cbd9c"

执行命令: service network restart

验证:ifconfig

2 .关闭防火墙(5台)

执行命:service iptables stop

验证:service iptables status

3.关闭防火墙的自动运行(5台)

执行命令:chkconfig iptables off

验证:chkconfig --list | grep iptables

4 设置主机名(5台)

执行命令
(1)hostname sht-sgmhadoopnn-01

(2)vi /etc/sysconfig/network


[root@sht-sgmhadoopnn-01 ~]# vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=sht-sgmhadoopnn-01.telenav.cn
GATEWAY=172.16.101.1

5 ip与hostname绑定(5台)

[root@sht-sgmhadoopnn-01 ~]# vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
172.16.101.55 sht-sgmhadoopnn-01.telenav.cn sht-sgmhadoopnn-01
172.16.101.56 sht-sgmhadoopnn-02.telenav.cn sht-sgmhadoopnn-02
172.16.101.58 sht-sgmhadoopdn-01.telenav.cn sht-sgmhadoopdn-01
172.16.101.59 sht-sgmhadoopdn-02.telenav.cn sht-sgmhadoopdn-02
172.16.101.60 sht-sgmhadoopdn-03.telenav.cn sht-sgmhadoopdn-03

验证:ping sht-sgmhadoopnn-01
6. 设置5台machines,SSH互相通信
http://blog.itpub.net/30089851/viewspace-1992210/

7 .安装JDK(5台)


(1)执行命令
[root@sht-sgmhadoopnn-01 ~]# cd /usr/java
[root@sht-sgmhadoopnn-01 java]# cp /tmp/jdk-7u67-linux-x64.gz ./
[root@sht-sgmhadoopnn-01 java]# tar -xzvf jdk-7u67-linux-x64.gz
(2)vi /etc/profile 增加内容如下:
export JAVA_HOME=/usr/java/jdk1.7.0_67
export HADOOP_HOME=/hadoop/hadoop-2.7.2
export ZOOKEEPER_HOME=/hadoop/zookeeper
export PATH=.:$HADOOP_HOME/bin:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$PATH
#先把HADOOP_HOME, ZOOKEEPER_HOME配置了
#本次实验机器已经配置好了jdk1.7.0_67-cloudera
(3)执行 source /etc/profile
(4)验证:java –version

8.创建文件夹(5台)

mkdir /hadoop

六.安装Zookeeper

sht-sgmhadoopdn-01/02/03

1.下载解压zookeeper-3.4.6.tar.gz


[root@sht-sgmhadoopdn-01 tmp]# wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-02 tmp]# wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-03 tmp]# wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-01 tmp]# tar -xvf zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-02 tmp]# tar -xvf zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-03 tmp]# tar -xvf zookeeper-3.4.6.tar.gz
[root@sht-sgmhadoopdn-01 tmp]# mv zookeeper-3.4.6 /hadoop/zookeeper
[root@sht-sgmhadoopdn-02 tmp]# mv zookeeper-3.4.6 /hadoop/zookeeper
[root@sht-sgmhadoopdn-03 tmp]# mv zookeeper-3.4.6 /hadoop/zookeeper

2.修改配置


[root@sht-sgmhadoopdn-01 tmp]# cd /hadoop/zookeeper/conf
[root@sht-sgmhadoopdn-01 conf]# cp zoo_sample.cfg zoo.cfg
[root@sht-sgmhadoopdn-01 conf]# vi zoo.cfg
修改dataDir
dataDir=/hadoop/zookeeper/data
添加下面三行
server.1=sht-sgmhadoopdn-01:2888:3888
server.2=sht-sgmhadoopdn-02:2888:3888
server.3=sht-sgmhadoopdn-03:2888:3888
[root@sht-sgmhadoopdn-01 conf]# cd ../
[root@sht-sgmhadoopdn-01 zookeeper]# mkdir data
[root@sht-sgmhadoopdn-01 zookeeper]# touch data/myid
[root@sht-sgmhadoopdn-01 zookeeper]# echo 1 > data/myid
[root@sht-sgmhadoopdn-01 zookeeper]# more data/myid
1
## sht-sgmhadoopdn-02/03,也修改配置,就如下不同
[root@sht-sgmhadoopdn-02 zookeeper]# echo 2 > data/myid
[root@sht-sgmhadoopdn-03 zookeeper]# echo 3 > data/myid

七.安装Hadoop(HDFS HA+YARN HA)

#step3~7,用SecureCRT ssh 到 linux的环境中,假如copy 内容从window 到 linux 中,中文乱码,请参照修改http://www.cnblogs.com/qi09/archive/2013/02/05/2892922.html

1.下载解压hadoop-2.7.2.tar.gz


[root@sht-sgmhadoopdn-01 tmp]# cd /hadoop/zookeeper/conf
[root@sht-sgmhadoopdn-01 conf]# cp zoo_sample.cfg zoo.cfg
[root@sht-sgmhadoopdn-01 conf]# vi zoo.cfg
修改dataDir
dataDir=/hadoop/zookeeper/data
添加下面三行
server.1=sht-sgmhadoopdn-01:2888:3888
server.2=sht-sgmhadoopdn-02:2888:3888
server.3=sht-sgmhadoopdn-03:2888:3888
[root@sht-sgmhadoopdn-01 conf]# cd ../
[root@sht-sgmhadoopdn-01 zookeeper]# mkdir data
[root@sht-sgmhadoopdn-01 zookeeper]# touch data/myid
[root@sht-sgmhadoopdn-01 zookeeper]# echo 1 > data/myid
[root@sht-sgmhadoopdn-01 zookeeper]# more data/myid
1
## sht-sgmhadoopdn-02/03,也修改配置,就如下不同
[root@sht-sgmhadoopdn-02 zookeeper]# echo 2 > data/myid
[root@sht-sgmhadoopdn-03 zookeeper]# echo 3 > data/myid

2.修改$HADOOP_HOME/etc/hadoop/hadoop-env.sh

export JAVA_HOME="/usr/java/jdk1.7.0_67-cloudera"

3.修改$HADOOP_HOME/etc/hadoop/core-site.xml


<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <!--Yarn 需要使用 fs.defaultFS 指定NameNode URI -->
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://mycluster</value>
    </property>
    <!--HDFS超级用户 -->
    <property>
        <name>dfs.permissions.superusergroup</name>
        <value>root</value>
    </property>
    <!--==============================Trash机制======================================= -->
    <property>
        <!--多长时间创建CheckPoint NameNode截点上运行的CheckPointer 从Current文件夹创建CheckPoint;默认：0 由fs.trash.interval项指定 -->
        <name>fs.trash.checkpoint.interval</name>
        <value>0</value>
    </property>
    <property>
        <!--多少分钟.Trash下的CheckPoint目录会被删除,该配置服务器设置优先级大于客户端，默认：0 不删除 -->
        <name>fs.trash.interval</name>
        <value>1440</value>
    </property>
</configuration>

4.修改$HADOOP_HOME/etc/hadoop/hdfs-site.xml


<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <!--开启web hdfs -->
    <property>
        <name>dfs.webhdfs.enabled</name>
        <value>true</value>
    </property>
    <property>
        <name>dfs.namenode.name.dir</name>
        <value>/hadoop/hadoop-2.7.2/data/dfs/name</value>
        <description> namenode 存放name table(fsimage)本地目录（需要修改）</description>
    </property>
    <property>
        <name>dfs.namenode.edits.dir</name>
        <value>${dfs.namenode.name.dir}</value>
        <description>namenode粗放 transaction file(edits)本地目录（需要修改）</description>
    </property>
    <property>
        <name>dfs.datanode.data.dir</name>
        <value>/hadoop/hadoop-2.7.2/data/dfs/data</value>
        <description>datanode存放block本地目录（需要修改）</description>
    </property>
    <property>
        <name>dfs.replication</name>
        <value>3</value>
    </property>
    <!-- 块大小 （默认） -->
    <property>
        <name>dfs.blocksize</name>
        <value>268435456</value>
    </property>
    <!--======================================================================= -->
    <!--HDFS高可用配置 -->
    <!--nameservices逻辑名 -->
    <property>
        <name>dfs.nameservices</name>
        <value>mycluster</value>
    </property>
    <property>
        <!--设置NameNode IDs 此版本最大只支持两个NameNode -->
        <name>dfs.ha.namenodes.mycluster</name>
        <value>nn1,nn2</value>
    </property>

    <!-- Hdfs HA: dfs.namenode.rpc-address.[nameservice ID] rpc 通信地址 -->
    <property>
        <name>dfs.namenode.rpc-address.mycluster.nn1</name>
        <value>sht-sgmhadoopnn-01:8020</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.mycluster.nn2</name>
        <value>sht-sgmhadoopnn-02:8020</value>
    </property>

    <!-- Hdfs HA: dfs.namenode.http-address.[nameservice ID] http 通信地址 -->
    <property>
        <name>dfs.namenode.http-address.mycluster.nn1</name>
        <value>sht-sgmhadoopnn-01:50070</value>
    </property>
    <property>
        <name>dfs.namenode.http-address.mycluster.nn2</name>
        <value>sht-sgmhadoopnn-02:50070</value>
    </property>

    <!--==================Namenode editlog同步 ============================================ -->
    <!--保证数据恢复 -->
    <property>
        <name>dfs.journalnode.http-address</name>
        <value>0.0.0.0:8480</value>
    </property>
    <property>
        <name>dfs.journalnode.rpc-address</name>
        <value>0.0.0.0:8485</value>
    </property>
    <property>
        <!--设置JournalNode服务器地址，QuorumJournalManager 用于存储editlog -->
        <!--格式：qjournal://<host1:port1>;<host2:port2>;<host3:port3>/<journalId> 端口同journalnode.rpc-address -->
        <name>dfs.namenode.shared.edits.dir</name>
        <value>qjournal://sht-sgmhadoopdn-01:8485;sht-sgmhadoopdn-02:8485;sht-sgmhadoopdn-03:8485/mycluster</value>
    </property>

    <property>
        <!--JournalNode存放数据地址 -->
        <name>dfs.journalnode.edits.dir</name>
        <value>/hadoop/hadoop-2.7.2/data/dfs/jn</value>
    </property>
    <!--==================DataNode editlog同步 ============================================ -->
    <property>
        <!--DataNode,Client连接Namenode识别选择Active NameNode策略 -->
        <name>dfs.client.failover.proxy.provider.mycluster</name>
        <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
    </property>
    <!--==================Namenode fencing：=============================================== -->
    <!--Failover后防止停掉的Namenode启动，造成两个服务 -->
    <property>
        <name>dfs.ha.fencing.methods</name>
        <value>sshfence</value>
    </property>
    <property>
        <name>dfs.ha.fencing.ssh.private-key-files</name>
        <value>/root/.ssh/id_rsa</value>
    </property>
    <property>
        <!--多少milliseconds 认为fencing失败 -->
        <name>dfs.ha.fencing.ssh.connect-timeout</name>
        <value>30000</value>
    </property>

    <!--==================NameNode auto failover base ZKFC and Zookeeper====================== -->
    <!--开启基于Zookeeper及ZKFC进程的自动备援设置,监视进程是否死掉 -->
    <property>
        <name>dfs.ha.automatic-failover.enabled</name>
        <value>true</value>
    </property>
    <property>
        <name>ha.zookeeper.quorum</name>
        <value>sht-sgmhadoopdn-01:2181,sht-sgmhadoopdn-02:2181,sht-sgmhadoopdn-03:2181</value>
    </property>
    <property>
        <!--指定ZooKeeper超时间隔，单位毫秒 -->
        <name>ha.zookeeper.session-timeout.ms</name>
        <value>2000</value>
    </property>
</configuration>

5.修改$HADOOP_HOME/etc/hadoop/yarn-env.sh

#Yarn Daemon Options

#export YARN_RESOURCEMANAGER_OPTS

#export YARN_NODEMANAGER_OPTS

#export YARN_PROXYSERVER_OPTS

#export HADOOP_JOB_HISTORYSERVER_OPTS

#Yarn Logs

export YARN_LOG_DIR="/hadoop/hadoop-2.7.2/logs"

6.修改$HADOOP_HOEM/etc/hadoop/mapred-site.xml


[root@sht-sgmhadoopnn-01 hadoop]# cp mapred-site.xml.template mapred-site.xml
[root@sht-sgmhadoopnn-01 hadoop]# vi mapred-site.xml
<configuration>
    <!-- 配置 MapReduce Applications -->
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
    <!-- JobHistory Server ============================================================== -->
    <!-- 配置 MapReduce JobHistory Server 地址 ，默认: 0.0.0.0:10020 -->
    <property>
        <name>mapreduce.jobhistory.address</name>
        <value>sht-sgmhadoopnn-01:10020</value>
    </property>
    <!-- 配置 MapReduce JobHistory Server web ui 地址， 默认: 0.0.0.0:19888 -->
    <property>
        <name>mapreduce.jobhistory.webapp.address</name>
        <value>sht-sgmhadoopnn-01:19888</value>
    </property>
</configuration>

7.修改$HADOOP_HOME/etc/hadoop/yarn-site.xml


<configuration>
    <!-- nodemanager 配置 ================================================= -->
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
        <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
        <description>Address where the localizer IPC is.</description>
        <name>yarn.nodemanager.localizer.address</name>
        <value>0.0.0.0:23344</value>
    </property>
    <property>
        <description>NM Webapp address.</description>
        <name>yarn.nodemanager.webapp.address</name>
        <value>0.0.0.0:23999</value>
    </property>

    <!-- HA 配置 =============================================================== -->
    <!-- Resource Manager Configs -->
    <property>
        <name>yarn.resourcemanager.connect.retry-interval.ms</name>
        <value>2000</value>
    </property>
    <property>
        <name>yarn.resourcemanager.ha.enabled</name>
        <value>true</value>
    </property>
    <property>
        <name>yarn.resourcemanager.ha.automatic-failover.enabled</name>
        <value>true</value>
    </property>
    <!-- 使嵌入式自动故障转移。HA环境启动，与 ZKRMStateStore 配合 处理fencing -->
    <property>
        <name>yarn.resourcemanager.ha.automatic-failover.embedded</name>
        <value>true</value>
    </property>
    <!-- 集群名称，确保HA选举时对应的集群 -->
    <property>
        <name>yarn.resourcemanager.cluster-id</name>
        <value>yarn-cluster</value>
    </property>
    <property>
        <name>yarn.resourcemanager.ha.rm-ids</name>
        <value>rm1,rm2</value>
    </property>
    <!--这里RM主备结点需要单独指定,（可选）
    <property>
        <name>yarn.resourcemanager.ha.id</name>
        <value>rm2</value>
</property>
 -->
    <property>
        <name>yarn.resourcemanager.scheduler.class</name>
        <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
    </property>
    <property>
        <name>yarn.resourcemanager.recovery.enabled</name>
        <value>true</value>
    </property>
    <property>
        <name>yarn.app.mapreduce.am.scheduler.connection.wait.interval-ms</name>
        <value>5000</value>
    </property>
    <!-- ZKRMStateStore 配置 -->
    <property>
        <name>yarn.resourcemanager.store.class</name>
        <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>
    </property>
    <property>
        <name>yarn.resourcemanager.zk-address</name>
        <value>sht-sgmhadoopdn-01:2181,sht-sgmhadoopdn-02:2181,sht-sgmhadoopdn-03:2181</value>
    </property>
    <property>
        <name>yarn.resourcemanager.zk.state-store.address</name>
        <value>sht-sgmhadoopdn-01:2181,sht-sgmhadoopdn-02:2181,sht-sgmhadoopdn-03:2181</value>
    </property>
    <!-- Client访问RM的RPC地址 (applications manager interface) -->
    <property>
        <name>yarn.resourcemanager.address.rm1</name>
        <value>sht-sgmhadoopnn-01:23140</value>
    </property>
    <property>
        <name>yarn.resourcemanager.address.rm2</name>
        <value>sht-sgmhadoopnn-02:23140</value>
    </property>
    <!-- AM访问RM的RPC地址(scheduler interface) -->
    <property>
        <name>yarn.resourcemanager.scheduler.address.rm1</name>
        <value>sht-sgmhadoopnn-01:23130</value>
    </property>
    <property>
        <name>yarn.resourcemanager.scheduler.address.rm2</name>
        <value>sht-sgmhadoopnn-02:23130</value>
    </property>
    <!-- RM admin interface -->
    <property>
        <name>yarn.resourcemanager.admin.address.rm1</name>
        <value>sht-sgmhadoopnn-01:23141</value>
    </property>
    <property>
        <name>yarn.resourcemanager.admin.address.rm2</name>
        <value>sht-sgmhadoopnn-02:23141</value>
    </property>
    <!--NM访问RM的RPC端口 -->
    <property>
        <name>yarn.resourcemanager.resource-tracker.address.rm1</name>
        <value>sht-sgmhadoopnn-01:23125</value>
    </property>
    <property>
        <name>yarn.resourcemanager.resource-tracker.address.rm2</name>
        <value>sht-sgmhadoopnn-02:23125</value>
    </property>
    <!-- RM web application 地址 -->
    <property>
        <name>yarn.resourcemanager.webapp.address.rm1</name>
        <value>sht-sgmhadoopnn-01:8088</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.address.rm2</name>
        <value>sht-sgmhadoopnn-02:8088</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.https.address.rm1</name>
        <value>sht-sgmhadoopnn-01:23189</value>
    </property>
    <property>
        <name>yarn.resourcemanager.webapp.https.address.rm2</name>
        <value>sht-sgmhadoopnn-02:23189</value>
    </property>
</configuration>

8.修改slaves

[root@sht-sgmhadoopnn-01 hadoop]# vi slaves

sht-sgmhadoopdn-01

sht-sgmhadoopdn-02

sht-sgmhadoopdn-03

9.分发文件夹

[root@sht-sgmhadoopnn-01 hadoop]# scp -r hadoop-2.7.2 root@sht-sgmhadoopnn-02:/hadoop

[root@sht-sgmhadoopnn-01 hadoop]# scp -r hadoop-2.7.2 root@sht-sgmhadoopdn-01:/hadoop

[root@sht-sgmhadoopnn-01 hadoop]# scp -r hadoop-2.7.2 root@sht-sgmhadoopdn-02:/hadoop

[root@sht-sgmhadoopnn-01 hadoop]# scp -r hadoop-2.7.2 root@sht-sgmhadoopdn-03:/hadoop

八.启动集群

另外一种启动方式:http://www.micmiu.com/bigdata/hadoop/hadoop2-cluster-ha-setup/

1.启动zookeeper


command: ./zkServer.sh start|stop|status
[root@sht-sgmhadoopdn-01 bin]# ./zkServer.sh start
JMX enabled by default
Using config: /hadoop/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@sht-sgmhadoopdn-01 bin]# jps
2073 QuorumPeerMain
2106 Jps
[root@sht-sgmhadoopdn-02 bin]# ./zkServer.sh start
JMX enabled by default
Using config: /hadoop/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@sht-sgmhadoopdn-02 bin]# jps
2073 QuorumPeerMain
2106 Jps
[root@sht-sgmhadoopdn-03 bin]# ./zkServer.sh start
JMX enabled by default
Using config: /hadoop/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@sht-sgmhadoopdn-03 bin]# jps
2073 QuorumPeerMain
2106 Jps

2.启动hadoop(HDFS+YARN)

a.格式化前,先在journalnode 节点机器上先启动JournalNode进程


[root@sht-sgmhadoopdn-01 ~]# cd /hadoop/hadoop-2.7.2/sbin
[root@sht-sgmhadoopdn-01 sbin]# hadoop-daemon.sh start journalnode
starting journalnode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-journalnode-sht-sgmhadoopdn-03.telenav.cn.out
[root@sht-sgmhadoopdn-03 sbin]# jps
16722 JournalNode
16775 Jps
15519 QuorumPeerMain
[root@sht-sgmhadoopdn-02 ~]# cd /hadoop/hadoop-2.7.2/sbin
[root@sht-sgmhadoopdn-02 sbin]# hadoop-daemon.sh start journalnode
starting journalnode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-journalnode-sht-sgmhadoopdn-03.telenav.cn.out
[root@sht-sgmhadoopdn-03 sbin]# jps
16722 JournalNode
16775 Jps
15519 QuorumPeerMain
[root@sht-sgmhadoopdn-03 ~]# cd /hadoop/hadoop-2.7.2/sbin
[root@sht-sgmhadoopdn-03 sbin]# hadoop-daemon.sh start journalnode
starting journalnode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-journalnode-sht-sgmhadoopdn-03.telenav.cn.out
[root@sht-sgmhadoopdn-03 sbin]# jps
16722 JournalNode
16775 Jps
15519 QuorumPeerMain

b.NameNode格式化


[root@sht-sgmhadoopnn-01 bin]# hadoop namenode -format
16/02/25 14:05:04 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = sht-sgmhadoopnn-01.telenav.cn/172.16.101.55
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 2.7.2
STARTUP_MSG: classpath =
……………..
………………
16/02/25 14:05:07 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
16/02/25 14:05:07 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
16/02/25 14:05:07 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
16/02/25 14:05:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
16/02/25 14:05:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
16/02/25 14:05:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
16/02/25 14:05:07 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
16/02/25 14:05:07 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
16/02/25 14:05:07 INFO util.GSet: Computing capacity for map NameNodeRetryCache
16/02/25 14:05:07 INFO util.GSet: VM type = 64-bit
16/02/25 14:05:07 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
16/02/25 14:05:07 INFO util.GSet: capacity = 2^15 = 32768 entries
16/02/25 14:05:08 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1182930464-172.16.101.55-1456380308394
16/02/25 14:05:08 INFO common.Storage: Storage directory /hadoop/hadoop-2.7.2/data/dfs/name has been successfully formatted.
16/02/25 14:05:08 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
16/02/25 14:05:08 INFO util.ExitUtil: Exiting with status 0
16/02/25 14:05:08 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at sht-sgmhadoopnn-01.telenav.cn/172.16.101.55
************************************************************/

c.同步NameNode元数据


同步sht-sgmhadoopnn-01 元数据到sht-sgmhadoopnn-02
主要是：dfs.namenode.name.dir，dfs.namenode.edits.dir还应该确保共享存储目录下(dfs.namenode.shared.edits.dir ) 包含NameNode 所有的元数据。
[root@sht-sgmhadoopnn-01 hadoop-2.7.2]# pwd
/hadoop/hadoop-2.7.2
[root@sht-sgmhadoopnn-01 hadoop-2.7.2]# scp -r data/ root@sht-sgmhadoopnn-02:/hadoop/hadoop-2.7.2
seen_txid 100% 2 0.0KB/s 00:00
fsimage_0000000000000000000 100% 351 0.3KB/s 00:00
fsimage_0000000000000000000.md5 100% 62 0.1KB/s 00:00
VERSION 100% 205 0.2KB/s 00:00

d.初始化ZFCK


[root@sht-sgmhadoopnn-01 bin]# hdfs zkfc -formatZK
……………..
……………..
16/02/25 14:14:41 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
16/02/25 14:14:41 INFO zookeeper.ZooKeeper: Client environment:user.dir=/hadoop/hadoop-2.7.2/bin
16/02/25 14:14:41 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=sht-sgmhadoopdn-01:2181,sht-sgmhadoopdn-02:2181,sht-sgmhadoopdn-03:2181 sessionTimeout=2000 watcher=org.apache.hadoop.ha.ActiveStandbyElector$WatcherWithClientRef@5f4298a5
16/02/25 14:14:41 INFO zookeeper.ClientCnxn: Opening socket connection to server sht-sgmhadoopdn-01.telenav.cn/172.16.101.58:2181. Will not attempt to authenticate using SASL (unknown error)
16/02/25 14:14:41 INFO zookeeper.ClientCnxn: Socket connection established to sht-sgmhadoopdn-01.telenav.cn/172.16.101.58:2181, initiating session
16/02/25 14:14:42 INFO zookeeper.ClientCnxn: Session establishment complete on server sht-sgmhadoopdn-01.telenav.cn/172.16.101.58:2181, sessionid = 0x15316c965750000, negotiated timeout = 4000
16/02/25 14:14:42 INFO ha.ActiveStandbyElector: Session connected.
16/02/25 14:14:42 INFO ha.ActiveStandbyElector: Successfully created /hadoop-ha/mycluster in ZK.
16/02/25 14:14:42 INFO zookeeper.ClientCnxn: EventThread shut down
16/02/25 14:14:42 INFO zookeeper.ZooKeeper: Session: 0x15316c965750000 closed

e.启动HDFS 系统

集群启动,在sht-sgmhadoopnn-01执行start-dfs.sh

集群关闭,在sht-sgmhadoopnn-01执行stop-dfs.sh

#####集群启动############


[root@sht-sgmhadoopnn-01 sbin]# start-dfs.sh
16/02/25 14:21:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [sht-sgmhadoopnn-01 sht-sgmhadoopnn-02]
sht-sgmhadoopnn-01: starting namenode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-namenode-sht-sgmhadoopnn-01.telenav.cn.out
sht-sgmhadoopnn-02: starting namenode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-namenode-sht-sgmhadoopnn-02.telenav.cn.out
sht-sgmhadoopdn-01: starting datanode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-datanode-sht-sgmhadoopdn-01.telenav.cn.out
sht-sgmhadoopdn-02: starting datanode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-datanode-sht-sgmhadoopdn-02.telenav.cn.out
sht-sgmhadoopdn-03: starting datanode, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-datanode-sht-sgmhadoopdn-03.telenav.cn.out
Starting journal nodes [sht-sgmhadoopdn-01 sht-sgmhadoopdn-02 sht-sgmhadoopdn-03]
sht-sgmhadoopdn-01: journalnode running as process 6348. Stop it first.
sht-sgmhadoopdn-03: journalnode running as process 16722. Stop it first.
sht-sgmhadoopdn-02: journalnode running as process 7197. Stop it first.
16/02/25 14:21:56 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting ZK Failover Controllers on NN hosts [sht-sgmhadoopnn-01 sht-sgmhadoopnn-02]
sht-sgmhadoopnn-01: starting zkfc, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-zkfc-sht-sgmhadoopnn-01.telenav.cn.out
sht-sgmhadoopnn-02: starting zkfc, logging to /hadoop/hadoop-2.7.2/logs/hadoop-root-zkfc-sht-sgmhadoopnn-02.telenav.cn.out
You have mail in /var/spool/mail/root

####单进程启动###########

NameNode(sht-sgmhadoopnn-01, sht-sgmhadoopnn-02):

hadoop-daemon.sh start namenode

DataNode(sht-sgmhadoopdn-01, sht-sgmhadoopdn-02, sht-sgmhadoopdn-03):

hadoop-daemon.sh start datanode

JournamNode(sht-sgmhadoopdn-01, sht-sgmhadoopdn-02, sht-sgmhadoopdn-03):

hadoop-daemon.sh start journalnode

ZKFC(sht-sgmhadoopnn-01, sht-sgmhadoopnn-02):

hadoop-daemon.sh start zkfc

f.验证namenode,datanode,zkfc

  1. 进程

[root@sht-sgmhadoopnn-01 sbin]# jps
12712 Jps
12593 DFSZKFailoverController
12278 NameNode
[root@sht-sgmhadoopnn-02 ~]# jps
29714 NameNode
29849 DFSZKFailoverController
30229 Jps
[root@sht-sgmhadoopdn-01 ~]# jps
6348 JournalNode
8775 Jps
559 QuorumPeerMain
8509 DataNode
[root@sht-sgmhadoopdn-02 ~]# jps
9430 Jps
9160 DataNode
7197 JournalNode
2073 QuorumPeerMain
[root@sht-sgmhadoopdn-03 ~]# jps
16722 JournalNode
17369 Jps
15519 QuorumPeerMain
17214 DataNode
  1. 页面

sht-sgmhadoopnn-01:

http://172.16.101.55:50070/

sht-sgmhadoopnn-02:

http://172.16.101.56:50070/

g.启动YARN运算框架

#####集群启动############

  1. sht-sgmhadoopnn-01启动Yarn，命令所在目录：$HADOOP_HOME/sbin

[root@sht-sgmhadoopnn-01 sbin]# start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /hadoop/hadoop-2.7.2/logs/yarn-root-resourcemanager-sht-sgmhadoopnn-01.telenav.cn.out
sht-sgmhadoopdn-03: starting nodemanager, logging to /hadoop/hadoop-2.7.2/logs/yarn-root-nodemanager-sht-sgmhadoopdn-03.telenav.cn.out
sht-sgmhadoopdn-02: starting nodemanager, logging to /hadoop/hadoop-2.7.2/logs/yarn-root-nodemanager-sht-sgmhadoopdn-02.telenav.cn.out
sht-sgmhadoopdn-01: starting nodemanager, logging to /hadoop/hadoop-2.7.2/logs/yarn-root-nodemanager-sht-sgmhadoopdn-01.telenav.cn.out
  1. sht-sgmhadoopnn-02备机启动RM

[root@sht-sgmhadoopnn-02 sbin]# yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /hadoop/hadoop-2.7.2/logs/yarn-root-resourcemanager-sht-sgmhadoopnn-02.telenav.cn.out

####单进程启动###########

1) ResourceManager(sht-sgmhadoopnn-01, sht-sgmhadoopnn-02)

yarn-daemon.sh start resourcemanager

2) NodeManager(sht-sgmhadoopdn-01, sht-sgmhadoopdn-02, sht-sgmhadoopdn-03)

yarn-daemon.sh start nodemanager

######关闭#############

[root@sht-sgmhadoopnn-01 sbin]# stop-yarn.sh

#包含namenode的resourcemanager进程，datanode的nodemanager进程

[root@sht-sgmhadoopnn-02 sbin]# yarn-daemon.sh stop resourcemanager

h.验证resourcemanager,nodemanager

  1. 进程

[root@sht-sgmhadoopnn-01 sbin]# jps
13611 Jps
12593 DFSZKFailoverController
12278 NameNode
13384 ResourceManager
[root@sht-sgmhadoopnn-02 sbin]# jps
32265 ResourceManager
32304 Jps
29714 NameNode
29849 DFSZKFailoverController
[root@sht-sgmhadoopdn-01 ~]# jps
6348 JournalNode
559 QuorumPeerMain
8509 DataNode
10286 NodeManager
10423 Jps
[root@sht-sgmhadoopdn-02 ~]# jps
9160 DataNode
10909 NodeManager
11937 Jps
7197 JournalNode
2073 QuorumPeerMain
[root@sht-sgmhadoopdn-03 ~]# jps
18031 Jps
16722 JournalNode
17710 NodeManager
15519 QuorumPeerMain
17214 DataNode
  1. 页面

ResourceManger（Active）：http://172.16.101.55:8088

ResourceManger（Standby）：http://172.16.101.56:8088/cluster/cluster

九.监控集群

[root@sht-sgmhadoopnn-01 ~]# hdfs dfsadmin -report

十.附件及参考

#http://archive-primary.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.5.2.tar.gz

#http://archive-primary.cloudera.com/cdh5/cdh/5/zookeeper-3.4.5-cdh5.5.2.tar.gz

hadoop : http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.7.2/hadoop-2.7.2.tar.gz

zookeeper :http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz

参考:

Hadoop-2.3.0-cdh5.0.1完全分布式环境搭建(NameNode,ResourceManager HA):

http://blog.itpub.net/30089851/viewspace-1987620/

如何解决这类问题：The string “–” is not permitted within comments:

http://blog.csdn.net/free4294/article/details/38681095

SecureCRT连接linux终端中文显示乱码解决办法:

http://www.cnblogs.com/qi09/archive/2013/02/05/2892922.html

5xh
关注
  • 1
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Hadoop-2.8.1+Zookeeper-3.4.6(HDFS,YARN HA)部署指南
12-26
Hadoop-2.8.1+Zookeeper-3.4.6(HDFS,YARN HA)部署指南
ZooKeeper 避坑指南： ZooKeeper 3.4.6 版本 BUG 导致的数据不一致问题
阿里云云栖号
04-27 760
ZooKeeper 作为分布式系统的元数据中心，对外服务的数据一致性需要得到很好的保证，但是一些老版本的 ZooKeeper 在一些情况下可能无法保证数据的一致性，导致依赖 ZooKeeper 的系统出现异常。
Zookeeper3.4.6版本升级到3.6.2版本安装与配置
最新发布
weixin_51485976的博客
05-16 6951
由于clickhouse集群可视化ckman需求，需要将Zookeeper3.4.6版本升级到3.6.2提示：以下是本篇文章正文内容，下面案例可供参考1.升级过程一定要保持myid与zookeeper_server.pid一致2.升级过程一定要保持dataDir，dataLogDir与原版本一致3.保证数据质量和集群可用性。
zookeeper安装部署 zookeeper都需要修改
Maynor996的博客
10-19 3178
安装前需要安装好jdk 检测集群时间是否同步 检测防火墙是否关闭 检测主机 ip映射有没有配置 ##下载安装包、解压 tar -zxvf zookeeper-3.4.5.tar.gz mv zookeeper-3.4.5 zookeeper ##修改环境变量（注意：3台zookeeper都需要修改） vi /etc/profile export ZOOKEEPER_HOME=/export/servers/zookeeper-3.4.5-cdh5.14.0 export PATH=$PATH:$ZOO
ZooKeeper3.4.6分布式环境搭建
Java朱老师博客
12-02 1383
本次使用的zookeeper为zookeeper3.4.6，Linux发行版为CentOS7。 主机名 IP zk1 192.168.150.21 zk2 192.168.150.22 zk3 192.168.150.23 前置准备： 一、搭建hp301 静态IP、关闭防火墙，关闭selinux，命名主机名为zk1，修改hosts做一个映射，修改ip地址。 参见：Hadoop3.3.1详细教程（二）样机配置 二、安装JDK 参见：Hadoop3.3.1详细教程（三）克隆样机+JD
zookeeper下载安装、zookeeper-3.4.6下载安装、Windows启动zookeeper、zookeeper启动闪退解决、\..\conf\zoo.cfg file is missin
郝开的博客
10-28 889
官网下载ZooKeeper安装包：https://zookeeper.apache.org/releases.html官网历史版本下载链接：https://archive.apache.org/dist/zookeeper/如果想要下载之前一点的版本 选择对应tar包下载即可下载完成后进行解压，解压目录结构如下图zookeeper启动寻找配置文件的目录对应zkEnv前缀文件的相对路径：…\conf\zoo.cfg，需要先将conf文件夹中的zoo_sample.cfg文件名为zoo.cfg
( hadoop-2.7.3+zookeeper-3.4.8+hadoop-2.7.3分布式环境搭建整理
04-25
Step by step Hadoop-2.6.4 + Zookeeper-3.4.9 + Hbase-1.2.4完全分布式开发环境配置
04-17
此文以命令行+截图的形式详细的记录了Hadoop-2.6.4+Zookeeper-3.4.9+Hbase-1.2.4分布式开发平台的环境配置过程，希望能对大家有所帮助。
Hadoop2.7.3+HBase1.2.5+ZooKeeper3.4.6搭建分布式集群环境详解
11-10
本文档详细介绍了如何用ZooKeeper和Hadoop、HBase搭建分布式大数据分析平台。
hadoop-2.7.3+zookeeper-3.4.8+hadoop-2.7.3分布式环境搭建整理(王三旗亲试成功安装)
09-07
hadoop-2.7.3+zookeeper-3.4.8+hadoop-2.7.3分布式环境搭建整理(王三旗亲试成功安装)
zookeeper-3.4.6.zip
04-29
zookeeper-3.4.6 解压后可直接运行 bin/zkServer.cmd 来启动
zookeeper3.4.6超稳定版
11-09
zookeeper-3.4.6超稳定版本，有需要的朋友可直接下载搭建
zookeeper下载-3.3.6安装文件及教程
09-19
zookeeper-3.3.6.tar.gz，ZooKeeper的安装与部署　ZooKeeper是一个分布式的，开放源码的分布式应用程序协调服务，是Google的Chubby一个开源的实现，是Hadoop和Hbase的重要组件。它是一个为分布式应用提供一致性服务的软件，提供的功能包括：配置维护、名字服务、分布式同步、组服务等。
zookeeper-3.4.6.rar
12-14
zookeeper-3.4.6.rar
zookeeper-3.4.6_zookeeper_
10-04
注册中心 zookeeper-3.4.6
zookeeper 入门到精通
一只菜鸟de博客
09-08 346
如果骄傲没被现实大海冷冷拍下，又怎会懂得要多努力才走得到远方！ spring cloud 中文文档 一、引言 在分布式环境下,如果舍弃SpringCloud,使用其他的分布式框架,那么注册心中,配置集中管理,集群管理,分布式锁,分布式任务,队列的管理想单独实现怎...
ZooKeeper的部署以及简单使用
strawbingo的专栏
03-24 1685
http://sling2007.blog.163.com/blog/static/847327132013283163528/ ZooKeeper的部署以及简单使用   2013-03-08 15:52:14|  分类： 分布式/hadoop |  标签： |举报 |字号大中小 订阅     要想使用ZooKeeper，首先就要把它部署在服务器上跑起来，就
大数据技术基础实验五：Zookeeper实验——部署ZooKeeper
北天的博客
09-30 2710
大数据技术基础实验五，学习如何在三台虚拟机上部署并启动ZooKeeper。
/opt/module/hadoop-2.7.2/bin/yarn jar
04-27
/opt/module/hadoop-2.7.2/bin/yarn jar是一个在Hadoop中常用的命令。其中，/opt/module/hadoop-2.7.2/bin是Hadoop安装目录下的可执行文件路径，yarn是一个用于管理Hadoop集群资源的框架，jar是指在Hadoop集群中运行...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值