完全分布式HBase简易搭建

最新推荐文章于 2024-08-07 17:57:47 发布

蒋含竹

最新推荐文章于 2024-08-07 17:57:47 发布

阅读量278

点赞数

分类专栏： BigData 文章标签： HBase 大数据数据库 NoSQL

本文链接：https://blog.csdn.net/alionsss/article/details/80201674

版权

BigData 专栏收录该内容

52 篇文章 7 订阅

订阅专栏

前要示例

本集群hosts文件示例

[jerry@skey-3 ~]$ cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.112.101 skey-1
192.168.112.102 skey-2
192.168.112.103 skey-3
192.168.112.104 skey-4
192.168.112.105 skey-5

本集群SSH示例

[jerry@skey-1 hbase-1.3.1]$ ssh jerry@skey-2
[jerry@skey-1 hbase-1.3.1]$ ssh jerry@skey-3
[jerry@skey-1 hbase-1.3.1]$ ssh jerry@skey-4
[jerry@skey-1 hbase-1.3.1]$ ssh jerry@skey-5

本集群HDFS、ZooKeeper示例

节点/组件	skey-1	skey-2	skey-3	skey-4	skey-5
HDFS	NameNode	SecondaryNameNode	DataNode	DataNode	DataNode
ZooKeeper	Null	Null	QuorumPeer	QuorumPeer	QuorumPeer

开始配置安装

[jerry@skey-1 conf]$ pwd
/home/jerry/app/hbase-1.3.1/conf

配置hbase-env.sh

[jerry@skey-1 conf]$ pwd
/home/jerry/app/hbase-1.3.1/conf
[jerry@skey-1 conf]$ vim hbase-env.sh
# The java implementation to use.  Java 1.7+ required.
export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
# Extra Java CLASSPATH elements.  Optional.
export HBASE_CLASSPATH=/home/jerry/app/hadoop-2.6.5/etc/hadoop
# Tell HBase whether it should manage it's own instance of Zookeeper or not.
export HBASE_MANAGES_ZK=false

配置hbase-site.xml

[jerry@skey-1 conf]$ vim hbase-site.xml 
<configuration>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://skey-1:9000/hbase</value>
    </property>
    <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
    </property>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>skey-3:2181,skey-4:2181,skey-5:2181</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.dataDir</name>
        <value>/home/jerry/app/hbase-1.3.1/zookeeper</value>
    </property>
</configuration>

配置regionservers、backup-masters

[jerry@skey-1 conf]$ vim regionservers
skey-3
skey-4
skey-5
[jerry@skey-1 conf]$ vim backup-masters
skey-2

分发HBase包到其他节点

[jerry@skey-1 app]$ scp -r ./hbase-1.3.1/ jerry@skey-2:/home/jerry/app
[jerry@skey-1 app]$ scp -r ./hbase-1.3.1/ jerry@skey-3:/home/jerry/app
[jerry@skey-1 app]$ scp -r ./hbase-1.3.1/ jerry@skey-4:/home/jerry/app
[jerry@skey-1 app]$ scp -r ./hbase-1.3.1/ jerry@skey-5:/home/jerry/app

启动

启动HDFS（如果是高可用的HDFS，需要先启动ZooKeeper）
启动ZooKeeper
启动HBase

[jerry@skey-1 hbase-1.3.1]$ ./bin/start-hbase.sh 
starting master, logging to /home/jerry/app/hbase-1.3.1/bin/../logs/hbase-jerry-master-skey-1.out
skey-5: starting regionserver, logging to /home/jerry/app/hbase-1.3.1/bin/../logs/hbase-jerry-regionserver-skey-5.out
skey-3: starting regionserver, logging to /home/jerry/app/hbase-1.3.1/bin/../logs/hbase-jerry-regionserver-skey-3.out
skey-4: starting regionserver, logging to /home/jerry/app/hbase-1.3.1/bin/../logs/hbase-jerry-regionserver-skey-4.out
skey-2: starting master, logging to /home/jerry/app/hbase-1.3.1/bin/../logs/hbase-jerry-master-skey-2.out

目前集群结构分布

节点/组件	skey-1	skey-2	skey-3	skey-4	skey-5
HDFS	NameNode	SecondaryNameNode	DataNode	DataNode	DataNode
ZooKeeper	Null	Null	QuorumPeer	QuorumPeer	QuorumPeer
HBase	HMaster(Active)	HMaster(Bakup)	HRegionServer	HRegionServer	HRegionServer