使用sqoop1将hive导入mysql

#!/bin/sh
#数据连接 
srcConnect="connect jdbc:mysql://10.2.1.1:3306/test"
#临时表存放的目录
tempTabPath=/user/test

sql="select  NVL(rowkey,'') as rowkey, 
             NVL(projid,'') as projid,
NVL(devid,'')  as devid,
NVL(barcode,'') as barcode,
NVL(devaddr,'') as devaddr,
NVL(runmode_mb,'') as runmode_mb,
    NVL(starttime,TIMESTAMP('1971-01-01 00:30:00')) as starttime,
    NVL(endttime,TIMESTAMP('1971-01-01 00:30:00')) as endttime,
    NVL(receivetime,TIMESTAMP('1971-01-01 00:30:00')) as receivetime
from test"


echo "++++++++++++++++++++开始导入数据:++++++++++++++++++++++++++++++++"


#将hive表的数据,导入到hdfs上  
hive -e "
        use default;

insert overwrite  directory  '${tempTabPath}' row format delimited fields terminated by '\t' ${sql};
       "
#利用sqoop,将hive得数据导入到mysql集群   
  sqoop export \
  --${srcConnect} \
  --username root \
  --password 1234qwer \
  --table speed_test \
  --export-dir ${tempTabPath} \
  --input-fields-terminated-by '\t' \
       -- m 5
echo "++++++++++++++++++++结束导入数据:++++++++++++++++++++++++++++++++"  
  
     hadoop fs -rm -r ${tempTabPath} 

 

执行脚本前,在mysql创建一个跟hive表结构相同的表,否则,导入数据报错。

 
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值