创建表:
hbase(main):001:0>create 'member','member_id','address','info'
插入数据:
put 'member','xueba','info:age','25'
put 'member','xueba','info:birthday','1989-06-19'
put 'member','xueba','info:company','tecent'
put 'member','xueba','address:contry','china'
put 'member','xueba','address:province','guangdong'
put 'member','xueba','address:city','shenzhen'
put 'member','xiaoming','info:age','24'
put 'member','xiaoming','info:birthday','1990-03-22'
put 'member','xiaoming','info:company','tecent'
put 'member','xiaoming','info:favorite','movie'
put 'member','xiaoming','address:contry','china'
put 'member','xiaoming','address:province','guangdong'
put 'member','xiaoming','address:city','guangzhou'
查询表
扫描表:
hdfs上创建demo目录:
将hbase表member的数据导出到hdfs的路径/demo上面:
hbase org.apache.hadoop.hbase.mapreduce.Export member /demo
查看生成的目录:
将hbase数据备份到本地文件:
创建备份到的目标hbase表
注: Column family address must exist in region memberdemo
将备份的数据导入到备份目标表中
全表扫描新表:
**
注:
**
- 执行hbase org.apache.hadoop.hbase.mapreduce.Export member /demo命令发现报错:
删除demo文件夹:
2019-01-21 23:36:21,199 INFO [main] mapreduce.Job: Job job_1548140399871_0002 running in uber mode : false
2019-01-21 23:36:21,225 INFO [main] mapreduce.Job: map 0% reduce 0%
2019-01-21 23:36:21,266 INFO [main] mapreduce.Job: Job job_1548140399871_0002 failed with state FAILED due to: Application application_1548140399871_0002 failed 2 times due to Error launching appattempt_1548140399871_0002_000002. Got exception: org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container.
This token is expired. current time is 1548159795772 found 1548143180339
Note: System times on machines may be out of sync. Check system time and time zones.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:122)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:250)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
. Failing the application.
2019-01-21 23:36:21,328 INFO [main] mapreduce.Job: Counters: 0
可用date查看时间,发现不同步,so需时间同步,
例:ntpdate 1.cn.pool.ntp.org
2019-01-22 00:21:24,851 INFO [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_00092019-01-22 00:21:24,851 INFO [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_0009
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:61)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input Pattern file:/home/hadoop/member/* matches 0 files
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:321)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:264)
解决:
hbase org.apache.hadoop.hbase.mapreduce.Driver import tablename **hdfspath**
hbase org.apache.hadoop.hbase.mapreduce.Import tablename **hdfspath**