Hadoop2.7.4上搭建Hbase全分布式集群

一 Hadoop集群规划

主机名            IP                                安装的软件                          

master           192.168.0.110           jdk1.8、hadoop2.7.4        

slave1            192.168.0.111           jdk1.8、hadoop2.7.4        

slave2            192.168.0.112           jdk1.8、hadoop2.7.4        

二 搭建环境前的准备

1 已搭建完成Hadoop集群

2 已搭建完成zookeeper集群

master

[root@master zookeeper-3.4.6]# jps
2560 NameNode
2789 Jps
2381 QuorumPeerMain

slave1

[root@slave1 bin]# jps
2465 DataNode
2609 Jps
2390 QuorumPeerMain
2524 SecondaryNameNode

svale2

[root@slave2 ~]# jps
2531 Jps
2454 DataNode
2365 QuorumPeerMain

三 在master上下载Hbase

[root@master opt]# wget http://archive.apache.org/dist/hbase/1.2.6/hbase-1.2.6-bin.tar.gz

四 在master节点解压hbase

[root@master opt]# tar xzvf hbase-1.2.6-bin.tar.gz

五 修改hbase-env.sh

export JAVA_HOME=/opt/jdk1.8
export HBASE_MANAGES_ZK=false

六 修改hbase-site.xml

<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>hdfs://master:8020/hbase</value>
    <description>The directory shared byregion servers.</description>
  </property>
  
  <property>
    <name>hbase.cluster.distributed</name>
   <value>true</value>
  </property>
  
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>master:2181,slave1:2181,slave2:2181</value>   
  </property>
  
</configuration>

七 修改regionservers

master
slave1
slave2

八 修改3个机器的环境变量/etc/profile

export HBASE_HOME=/opt/hbase-1.2.6
export PATH=$PATH:$HBASE_HOME/bin

九 指定备用主节点

[root@master conf]# cat backup-masters
slave2

十 把hadoop的core-site.xml和hdfs-site.xml放到hbase/conf目录下

[root@master conf]# cp /opt/hadoop-2.7.4/etc/hadoop/core-site.xml /opt/hbase-1.2.6/conf/
[root@master conf]# cp /opt/hadoop-2.7.4/etc/hadoop/hdfs-site.xml /opt/hbase-1.2.6/conf/

十一 把master节点数据分发到其他两个节点

[root@master conf]# scp -r /opt/hbase-1.2.6 root@slave1:/opt
[root@master conf]# scp -r /opt/hbase-1.2.6 root@slave2:/opt

十二 启动和测试

启动前先保证zookeeper和hdfs启动

[root@master hbase-1.2.6]# start-hbase.sh
starting master, logging to /opt/hbase-1.2.6/logs/hbase-root-master-master.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
slave2: \S
slave2: Kernel \r on an \m
slave2: starting regionserver, logging to /opt/hbase-1.2.6/bin/../logs/hbase-root-regionserver-slave2.out
slave3: ssh: Could not resolve hostname slave3: Name or service not known
master: \S
master: Kernel \r on an \m
master: starting regionserver, logging to /opt/hbase-1.2.6/bin/../logs/hbase-root-regionserver-master.out
slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
master: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
slave2: \S
slave2: Kernel \r on an \m
slave2: starting master, logging to /opt/hbase-1.2.6/bin/../logs/hbase-root-master-slave2.out
slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
slave2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

十三 启动后测试

master

[root@master hadoop-2.7.4]# jps
2560 NameNode
2945 HMaster
3077 HRegionServer
3207 Jps
2381 QuorumPeerMain

slave1

[root@slave1 ~]# jps
2465 DataNode
2689 HRegionServer
2390 QuorumPeerMain
2524 SecondaryNameNode
2863 Jps

slave2

[root@slave2 ~]# jps
2672 HMaster
2913 Jps
2454 DataNode
2602 HRegionServer
2365 QuorumPeerMain

十四 网页测试

十五 参考

https://chuanke.baidu.com/v7662331-230665-1633772.html

http://blog.csdn.net/bingoxubin/article/details/78548875