HBase0.90.5安装

最新推荐文章于 2024-09-15 01:19:00 发布

weixin_34329187

最新推荐文章于 2024-09-15 01:19:00 发布

阅读量102

点赞数

文章标签：大数据 shell java

原文链接：https://my.oschina.net/siiiso/blog/846683

版权

为什么80%的码农都做不了架构师？>>>

安装环境介绍

Linux：CentOS6.5_x64
JDK：jdk1.7.0_76
Hadoop: hadoop-0.20.2
Hbase: hbase-0.90.5

安装前准备

JDK版本

[hadoop@Hmaster ~]$ java -version
java version "1.7.0_76"
Java(TM) SE Runtime Environment (build 1.7.0_76-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.76-b04, mixed mode)

Hadoop0.20.2完全分布式环境

前期已经部署完成

[hadoop@Hmaster ~]$ hadoop version
Hadoop 0.20.2
Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010

HBase版本

hbase-0.90.5

安装步骤

配置hosts

# vim /etc/hosts
192.168.103.237  Hmaster
192.168.103.238  Hslave1
192.168.103.239  Hslave2

解压安装包

Hadoop用户登录

$ tar -zxvf hbase-0.90.5.tar.gz

替换Hadoop核心jar包

[hadoop@Hmaster lib]$ pwd
/home/hadoop/hbase-0.90.5/lib
[hadoop@Hmaster lib]$ mv hadoop-core-0.20-append-r1056497.jar hadoop-core-0.20-append-r1056497.jar.bak
[hadoop@Hmaster lib]$ cp /home/hadoop/hadoop/hadoop-0.20.2-core.jar /home/hadoop/hbase-0.90.5/lib/
[hadoop@Hmaster lib]$ ls -l hadoop-0.20.2-core.jar
-rw-rw-r--. 1 hadoop hadoop 2689741 Dec  3 14:59 hadoop-0.20.2-core.jar
[hadoop@Hmaster lib]$ chmod 775 hadoop-0.20.2-core.jar
[hadoop@Hmaster lib]$ ls -l hadoop-0.20.2-core.jar
-rwxrwxr-x. 1 hadoop hadoop 2689741 Dec  3 14:59 hadoop-0.20.2-core.jar

编辑hbase-env.sh文件

$ cd /home/hadoop/hbase-0.90.5/conf
$ vim hbase-env.sh
# 添加如下内容
export JAVA_HOME=/usr/java/jdk1.7.0_76
export HBASE_CLASSPATH=/home/hadoop/hbase-0.90.5/conf
export HBASE_HOME=/home/hadoop/hbase-0.90.5
export HBASE_LOG_DIR=${HBASE_HOME}/logs
export HBASE_MANAGES_ZK=true

说明：使用独立的ZooKeeper时需要修改HBASE_MANAGES_ZK值为false，为不使用默认ZooKeeper实例(默认为true)。

编辑hbase-site.xml文件

$ vim hbase-site.xml
#添加如下内容
<configuration>
<property>
<name>hbase.rootdir</name> #设置hbase数据库存放数据的目录
<value>hdfs://Hmaster:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>  #打开hbase分布模式
<value>true</value>
</property>
<property>
<name>hbase.master</name> #指定hbase集群主控节点
<value>Hmaster:60000</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>Hmaster,Hslave1,Hslave2</value> #指定zookeeper集群节点名,因为是由zookeeper表决算法决定的
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name> #指zookeeper集群data目录
<value>/home/hadoop/hbase-0.90.5/zookeeper</value>
</property>
</configuration>

编辑regionservers文件

$ vim regionservers
将localhost改为Hslave1和Hslave2

[hadoop@Hmaster conf]$ cat regionservers 
Hslave1
Hslave2

将配置好的hbase-0.90.5目录同步到从节点

$ scp -r /home/hadoop/hbase-0.90.5 hadoop@Hslave1:/home/hadoop/
$ scp -r /home/hadoop/hbase-0.90.5 hadoop@Hslave2:/home/hadoop/

注意：如果主节点上Hbase目录中配置文件修改，那么要同步到其他的从节点。

启动/关闭HBase集群

启动顺序为：先启动Hadoop，后启动Hbase；

关闭顺序为：先关闭Hbase，后关闭Hadoop；

查看Hadoop启动状态

启动HBase前先检查Hadoop是否已启动

$ hadoop dfsadmin -report
（或 $ /home/hadoop/hadoop/bin/hadoop dfsadmin -report）
Configured Capacity: 307703062528 (286.57 GB)
Present Capacity: 291104432128 (271.11 GB)
DFS Remaining: 154077036544 (143.5 GB)
DFS Used: 137027395584 (127.62 GB)
DFS Used%: 47.07%
Under replicated blocks: 959
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Datanodes available: 2 (2 total, 0 dead)

Name: 192.168.103.239:50010
Decommission Status : Normal
Configured Capacity: 153851531264 (143.29 GB)
DFS Used: 68887625728 (64.16 GB)
Non DFS Used: 8209874944 (7.65 GB)
DFS Remaining: 76754030592(71.48 GB)
DFS Used%: 44.78%
DFS Remaining%: 49.89%
Last contact: Thu Dec 03 16:47:48 CST 2015


Name: 192.168.103.238:50010
Decommission Status : Normal
Configured Capacity: 153851531264 (143.29 GB)
DFS Used: 68139769856 (63.46 GB)
Non DFS Used: 8388755456 (7.81 GB)
DFS Remaining: 77323005952(72.01 GB)
DFS Used%: 44.29%
DFS Remaining%: 50.26%
Last contact: Thu Dec 03 16:47:49 CST 2015

启动HBase集群

$ /home/hadoop/hbase-0.90.5/bin/start-hbase.sh
Hslave1: starting zookeeper, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-zookeeper-Hslave1.out
Hmaster: starting zookeeper, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-zookeeper-Hmaster.out
Hslave2: starting zookeeper, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-zookeeper-Hslave2.out
starting master, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-master-Hmaster.out
Hslave1: starting regionserver, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-regionserver-Hslave1.out
Hslave2: starting regionserver, logging to /home/hadoop/hbase-0.90.5/logs/hbase-hadoop-regionserver-Hslave2.out

查看主/从节点上的进程

主节点

[hadoop@Hmaster ~]$ jps
11579 HQuorumPeer
11631 HMaster
18024 Jps
4392 NameNode
4545 SecondaryNameNode
4618 JobTracker

从节点

[hadoop@Hslave1 ~]$ jps
17709 HRegionServer
3522 DataNode
544 Jps
17636 HQuorumPeer
3617 TaskTracker

[hadoop@Hslave2 ~]$ jps
17634 HQuorumPeer
3038 DataNode
3133 TaskTracker
17713 HRegionServer
536 Jps

浏览器访问HBase

http://192.168.100.xxx:60010/master.jsp

关闭HBase集群

$ /home/hadoop/hbase-0.90.5/bin/stop-hbase.sh
stopping hbase.......
Hslave1: stopping zookeeper.
Hmaster: stopping zookeeper.
Hslave2: stopping zookeeper.

HBase命令行操作

进入hbase

[hadoop@Hmaster ~]$ /home/hadoop/hbase-0.90.5/bin/hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.5, r1212209, Fri Dec  9 05:40:36 UTC 2011

查看hbase状态

hbase(main):004:0> status
2 servers, 0 dead, 1.0000 average load

查看hbase版本

hbase(main):005:0> version
0.90.5, r1212209, Fri Dec  9 05:40:36 UTC 2011

help命令

hbase(main):006:0> help
HBase Shell, version 0.90.5, r1212209, Fri Dec  9 05:40:36 UTC 2011
Type 'help "COMMAND"', (e.g. 'help "get"' -- the quotes are necessary) for help on a specific command.
Commands are grouped. Type 'help "COMMAND_GROUP"', (e.g. 'help "general"') for help on a command group.

COMMAND GROUPS:
  Group name: general
  Commands: status, version

  Group name: ddl
  Commands: alter, create, describe, disable, drop, enable, exists, is_disabled, is_enabled, list

  Group name: dml
  Commands: count, delete, deleteall, get, get_counter, incr, put, scan, truncate

  Group name: tools
  Commands: assign, balance_switch, balancer, close_region, compact, flush, major_compact, move, split, unassign, zk_dump

  Group name: replication
  Commands: add_peer, disable_peer, enable_peer, remove_peer, start_replication, stop_replication

SHELL USAGE:
Quote all names in HBase Shell such as table and column names.  Commas delimit
command parameters.  Type <RETURN> after entering a command to run it.
Dictionaries of configuration used in the creation and alteration of tables are
Ruby Hashes. They look like this:

  {'key1' => 'value1', 'key2' => 'value2', ...}

and are opened and closed with curley-braces.  Key/values are delimited by the
'=>' character combination.  Usually keys are predefined constants such as
NAME, VERSIONS, COMPRESSION, etc.  Constants do not need to be quoted.  Type
'Object.constants' to see a (messy) list of all constants in the environment.

If you are using binary keys or values and need to enter them in the shell, use
double-quote'd hexadecimal representation. For example:

  hbase> get 't1', "key\x03\x3f\xcd"
  hbase> get 't1', "key\003\023\011"
  hbase> put 't1', "test\xef\xff", 'f1:', "\x01\x33\x40"

The HBase shell is the (J)Ruby IRB with the above HBase-specific commands added.
For more on the HBase Shell, see http://hbase.apache.org/docs/current/book.html

转载于:https://my.oschina.net/siiiso/blog/846683