1、安装hadoop-0.20.2+zookeeper-3.4.6+hbase-0.90.6完成之候,在http://10.10.10.70:60010页面的时候出现如下信息:
2、这是因为hadoop版本和hbase版本不兼容,会出现数据丢失
3、需要安装hadoop branch,步骤
安装git
安装hadoop-common
切换并验证
创建build.properties
安装ant
编译
测试编译的文件,时间太长,中途停止了
替换hadoop的jar包,需重命名
替换hbase的jar包,无需重命名
4、重启所有服务
参考文档:
http://www.michael-noll.com/blog/2011/04/14/building-an-hadoop-0-20-x-version-for-hbase-0-90-2/
- You are currently running the HMaster without HDFS append support enabled. This may result in data loss. Please see the HBase wiki for details.
3、需要安装hadoop branch,步骤
安装git
- grid@master1:/usr/local/hadoop$ sudo apt-get install -y git
- grid@master1:/usr/local/hadoop$ git clone http://git.apache.org/hadoop-common.git
- Cloning into 'hadoop-common'...
- Checking connectivity... done.
- grid@master1:/usr/local/hadoop$ cd hadoop-common/
- grid@master1:/usr/local/hadoop/hadoop-common$ git checkout -t origin/branch-0.20-append
- Branch branch-0.20-append set up to track remote branch branch-0.20-append from origin.
- Switched to a new branch 'branch-0.20-append'
-
- grid@master1:/usr/local/hadoop/hadoop-common$ git show-branch release-0.20.2 branch-0.20-append
- ! [release-0.20.2] Hadoop 0.20.2 release
- * [branch-0.20-append] HDFS-1779. After NameNode restart , Clients can not read partial files even after client invokes Sync. Contributed by Uma Maheswara Rao G.
- --
- * [branch-0.20-append] HDFS-1779. After NameNode restart , Clients can not read partial files even after client invokes Sync. Contributed by Uma Maheswara Rao G.
- ....................
- ...................
- grid@master1:/usr/local/hadoop/hadoop-common$ vi ../build.properties
-
- resolvers=internal
- version=0.20-append-for-hbase
- project.version=${version}
- hadoop.version=${version}
- hadoop-core.version=${version}
- hadoop-hdfs.version=${version}
- hadoop-mapred.version=${version}
grid@master1:/usr/local/hadoop/hadoop-common$ ln -s ../build.properties build.properties
- grid@master1:/usr/local/hadoop/hadoop-common$ sudo apt-get install -y ant
- grid@master1:/usr/local/hadoop/hadoop-common$ ant mvn-install
- .....................................
BUILD SUCCESSFUL
Total time: 2 minutes 18 seconds
- ant test
- ant test-core
- grid@master1:/usr/local/hadoop$ mv hadoop-0.20.2-core.jar hadoop-0.20.2-core.jar.bak
-
- grid@master1:/usr/local/hadoop$ cp hadoop-common/build/hadoop-core-0.20-append-for-hbase.jar hadoop-0.20-append-for-hbase-core.jar
- grid@master1:/usr/local/hbase/lib$ mv hadoop-0.20.2-core.jar hadoop-0.20.2-core.jar.bak
-
- grid@master1:/usr/local/hadoop/hadoop-common/build$ cp hadoop-core-0.20-append-for-hbase.jar /usr/local/hbase/lib/
参考文档:
http://www.michael-noll.com/blog/2011/04/14/building-an-hadoop-0-20-x-version-for-hbase-0-90-2/
来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/12219480/viewspace-1778955/,如需转载,请注明出处,否则将追究法律责任。
转载于:http://blog.itpub.net/12219480/viewspace-1778955/