hive 跨集群迁移
hive跨集群迁移数据工作中相对比较常见的事情, 其中涉及到数据迁移, metastore迁移, hive版本升级等.1. 迁移hdfs数据至新集群hadoop distcp -skipcrcchec...
导出表结构
#/bin/bash
#hive -e"
#show databases;
#">databases.txt
#sed -i '1d' databases.txt
for database in `cat databases.txt`
do
echo database-------------- ${database}
# hive -e "use ${database};"
# hive -e"
# use ${database};
# show tables;
# ">tables.txt
# sed -i '1d' tables.txt
for table in `cat tables.txt`
do
echo table--${table}
mkdir -p hive_table_0413/${database}
hive -e"
use ${database};
show create table ${table};">hive_table_0413/${database}/${table}.txt
done
donesed -i "s/hdfs:\/\/getui-bi-calc//g" *.txt
sed -i "/2018-04-17/d" *.txt
sed -i '$r 1' *.txt
