Hbase数据备份

创建表:

hbase(main):001:0>create 'member','member_id','address','info'

插入数据:

put 'member','xueba','info:age','25'
put 'member','xueba','info:birthday','1989-06-19'
put 'member','xueba','info:company','tecent'
put 'member','xueba','address:contry','china'
put 'member','xueba','address:province','guangdong'
put 'member','xueba','address:city','shenzhen'
put 'member','xiaoming','info:age','24'
put 'member','xiaoming','info:birthday','1990-03-22'
put 'member','xiaoming','info:company','tecent'
put 'member','xiaoming','info:favorite','movie'
put 'member','xiaoming','address:contry','china'
put 'member','xiaoming','address:province','guangdong'
put 'member','xiaoming','address:city','guangzhou'

查询表
在这里插入图片描述
扫描表:
在这里插入图片描述
hdfs上创建demo目录:
在这里插入图片描述
将hbase表member的数据导出到hdfs的路径/demo上面:

hbase org.apache.hadoop.hbase.mapreduce.Export member /demo

在这里插入图片描述
在这里插入图片描述

查看生成的目录: 在这里插入图片描述
将hbase数据备份到本地文件:
在这里插入图片描述
创建备份到的目标hbase表
在这里插入图片描述
注: Column family address must exist in region memberdemo
将备份的数据导入到备份目标表中
在这里插入图片描述
在这里插入图片描述
全表扫描新表:
在这里插入图片描述
**

注:

**

  1. 执行hbase org.apache.hadoop.hbase.mapreduce.Export member /demo命令发现报错:
    在这里插入图片描述
    删除demo文件夹:
    在这里插入图片描述
 2019-01-21 23:36:21,199 INFO  [main] mapreduce.Job: Job job_1548140399871_0002 running in uber mode : false
2019-01-21 23:36:21,225 INFO  [main] mapreduce.Job:  map 0% reduce 0%
2019-01-21 23:36:21,266 INFO  [main] mapreduce.Job: Job job_1548140399871_0002 failed with state FAILED due to: Application application_1548140399871_0002 failed 2 times due to Error launching appattempt_1548140399871_0002_000002. Got exception: org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container.
This token is expired. current time is 1548159795772 found 1548143180339
Note: System times on machines may be out of sync. Check system time and time zones.
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:122)
        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:250)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
. Failing the application.
2019-01-21 23:36:21,328 INFO  [main] mapreduce.Job: Counters: 0

可用date查看时间,发现不同步,so需时间同步,

例:ntpdate 1.cn.pool.ntp.org

 2019-01-22 00:21:24,851 INFO  [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_00092019-01-22 00:21:24,851 INFO  [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_0009
Exception in thread "main" java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:61)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input Pattern file:/home/hadoop/member/* matches 0 files
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:321)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:264)

解决:

hbase org.apache.hadoop.hbase.mapreduce.Driver import tablename **hdfspath**
hbase org.apache.hadoop.hbase.mapreduce.Import tablename **hdfspath**
  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值