HBase完全分布式集群搭建

完全分布式集群搭建

一. 搭建前准备

（1）Zookeeper 正常部署

bin/zkServer.sh start

（2）Hadoop 正常部署

start-all.sh

二.开始搭建

（1）安装

上传并解压HBase安装包

tar -xvzf hbase-2.2.4.tar.gz

（2）修改HBase配置文件

进入hbase的文件配置目录

cd hbase-2.2.4/conf

配置文件

1. hbase-env.sh

vi hbase-env.sh export JAVA_HOME=/home/hadoop/software/jdk1.8 export HBASE_MANAGES_ZK=false

2. hbase-site.xml

vim hbase-site.xml #在<configuration></configuration>中添加以下内容 ------------------------------ <configuration> <property> <name>hbase.rootdir</name> <value>hdfs://HadoopMaster:9000/HBase</value> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <!-- 0.98 后的新变动，之前版本没有.port,默认端口为 60000 --> <property> <name>hbase.master.port</name> <value>16000</value> </property> <!-- 在分布式的情况下一定要设置，不然容易出现Hmaster起不来的情况 --> <property> <name>hbase.unsafe.stream.capability.enforce</name> <value>false</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>HadoopMaster,HadoopSlave01,HadoopSlave02</value> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/home/hadoop/software/zookeeper-3.4.5/tmp</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>HadoopMaster,HadoopSlave01,HadoopSlave02</value> </property> <property> <name>hbase.wal.provider</name> <value>filesystem</value> </property> </configuration>

注意：

1）HadoopMaster:9000 此处的HadoopMaster是对应的主机名，9000是安装部署hadoop是的端口，到hadoop安装路径下的/etc/hadoop/的core-site.xml 文件中查看

进入core-site.xml文件即可看到

2）HadoopMaster,HadoopSlave01,HadoopSlave02要对于改为自己的三台主机的主机名3）/home/hadoop/software/zookeeper-3.4.5/tmp要改为安装zookeeper是配置的数据缓存路径，如果忘记的可以到 zookeepe的conf目录下，查看zoo.cfg即可看到。

（3）修改regionservers文件

vi regionservers （进入regionservers文件，然后添加以下内容） HadoopMaster HadoopSlave01 HadoopSlave02

（4）软连接hadoop配置文件到Hbase

ln -s /home/hadoop/software/hadoop-3.3.0/etc/hadoop/core-site.xml /home/hadoop/software/hbase-2.2.4/conf/core-site.xml ln -s /home/hadoop/software/hadoop-3.3.0/etc/hadoop/hdfs-site.xml /home/hadoop/software/hbase-2.2.4/conf/hdfs-site.xml

（5）HBase 远程发送到其他集群

scp -r /home/hadoop/software/hbase-2.2.4/ HadoopSlave01:~/software/ scp -r /home/hadoop/software/hbase-2.2.4/ HadoopSlave02:~/software/

（6）启动HBase

cd hbase-2.2.4/bin/ start-hbase.sh

（7）验证Hbase是否启动成功

# 启动hbase shell客户端 hbase shell # 输入status [root@hadoop102 onekey]# hbase shell SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/export/server/hadoop-2.7.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/export/server/hbase-2.1.0/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] HBase Shell Use "help" to get list of supported commands. Use "exit" to quit this interactive shell. Version 2.1.0, re1673bb0bbfea21d6e5dba73e013b09b8b49b89b, Tue Jul 10 17:26:48 CST 2018 Took 0.0034 seconds Ignoring executable-hooks-1.6.0 because its extensions are not built. Try: gem pristine executable-hooks --version 1.6.0 Ignoring gem-wrappers-1.4.0 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.4.0 2.4.1 :001 > status 1 active master, 0 backup masters, 3 servers, 0 dead, 0.6667 average load Took 0.4562 seconds 2.4.1 :002 >