安装部署（七） HBase集群安装部署与测试

HBase集群安装部署与测试


Hadoop 2.7.2 
Spark 2.0.0
Kafka 0.10.0.0
HBase 1.2.2
Zookeeper 3.4.8


参考：
http://www.tuicool.com/articles/VV7bam
http://blog.csdn.net/yinedent/article/details/48275407


1 下载：
http://mirrors.hust.edu.cn/apache/hbase/stable/
http://mirrors.hust.edu.cn/apache/hbase/stable/hbase-1.2.2-bin.tar.gz


2 解压：
root@py-server:/server# tar xvzf hbase-1.2.2-bin.tar.gz
root@py-server:/server# mv hbase-1.2.2/ hbase


3 环境变量：
vi ~/.bashrc
export HBASE_HOME=/server/hbase
export PATH=$HBASE_HOME/bin
source ~/.bashrc


4 配置：
依赖zookeeper环境，zookeeper集群参考spark安装部署里边的相应内容。主备Master。
5台机配置如下：


4.1 配置hbase-site.xml
vi $HBASE_HOME/conf/hbase-site.xml
内容如下：
<property>
    <name>hbase.rootdir</name>
    <value>hdfs://py-server:9000/hbase</value>
  </property>
  <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>
    <property>
<name>hbase.zookeeper.quorum</name>
<value>py-server:2181,py-11:2181,py-12:2181,py-13:2181,py-14:2181</value>
</property>
注：hdfs端口号在root@py-server:/server/hadoop/etc/hadoop# vi core-site.xml里查看，之前配的是9000


4.2 配置主备Master
配置备用Master,把备用的Master主机名写入，backup-masters配置文件默认不存在，新建一个
vi $HBASE_HOME/conf/backup-masters
py-12


4.3 配置regionservers
py-server
py-11
py-12
py-13
py-14


4.4配置hbase-env.sh
修改堆内存，不用HBase管理zookeeper集群。
vi $HBASE_HOME/conf/hbase-env.sh
export HBASE_HEAPSIZE=4G
export HBASE_MANAGES_ZK=false


5 分发
root@py-server:/server# scp -r hbase/ [email protected]:/server/
root@py-server:/server# scp -r hbase/ [email protected]:/server/
root@py-server:/server# scp -r hbase/ [email protected]:/server/
root@py-server:/server# scp -r hbase/ [email protected]:/server/
修改各自的环境变量11-14节点 ~/.bashrc


6 启动集群


6.1
在主节点py-server执行：
root@py-server:/server# $HBASE_HOME/bin/start-hbase.sh
结果：
starting master, logging to /server/hbase/logs/hbase-root-master-py-server.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
py-11: starting regionserver, logging to /server/hbase/bin/../logs/hbase-root-regionserver-py-11.out
py-14: starting regionserver, logging to /server/hbase/bin/../logs/hbase-root-regionserver-py-14.out
py-13: starting regionserver, logging to /server/hbase/bin/../logs/hbase-root-regionserver-py-13.out
py-12: starting regionserver, logging to /server/hbase/bin/../logs/hbase-root-regionserver-py-12.out
py-11: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
py-11: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
py-13: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
py-13: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
py-12: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
py-12: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
py-12: SLF4J: Class path contains multiple SLF4J bindings.
py-12: SLF4J: Found binding in [jar:file:/server/hbase/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
py-12: SLF4J: Found binding in [jar:file:/server/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
py-12: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
py-12: SLF4J: