sqoop 导出mysql，oracle

最新推荐文章于 2024-08-16 21:15:52 发布

Schnappix

最新推荐文章于 2024-08-16 21:15:52 发布

阅读量804

点赞数 1

文章标签： Hadoop Linux sqoop mysql oracle

本文链接：https://blog.csdn.net/wxf912519176/article/details/72821997

版权

本文介绍了如何配置和使用sqoop在Hadoop与MySQL及Oracle数据库间进行数据导入导出。内容包括sqoop的安装、配置、MySQL授权、测试连接、数据迁移以及增量抽取。此外，还涉及到sqoop与Hive的集成以及对Oracle数据库的连接和数据导出。

摘要由CSDN通过智能技术生成

sqoop mysql 导入，导出
1.
安装（前提hadoop启动）

[hadoop@h91 ~]$ tar -zxvf sqoop-1.3.0-cdh3u5.tar.gz
[hadoop@h91 hadoop-0.20.2-cdh3u5]$ cp hadoop-core-0.20.2-cdh3u5.jar /home/hadoop/sqoop-1.3.0-cdh3u5/lib/

[hadoop@h91 ~]$ cp ojdbc6.jar sqoop-1.3.0-cdh3u5/lib/

[hadoop@h91 ~]$ vi .bash_profile
添加
export SQOOP_HOME=/home/hadoop/sqoop-1.3.0-cdh3u5

[hadoop@h91 ~]$ source .bash_profile

2.

[hadoop@h91 ~]$ cd sqoop-1.3.0-cdh3u5/bin/

[hadoop@h91 bin]$ vi configure-sqoop
注释掉hbase和zookeeper检查
## Moved to be a runtime check in sqoop.
#if [ ! -d "${HBASE_HOME}" ]; then
# echo "Warning: $HBASE_HOME does not exist! HBase imports will fail."
# echo 'Please set $HBASE_HOME to the root of your HBase installation.'
#fi

3.mysql 授权

mysql> insert into mysql.user(Host,User,Password) values("hadoop1","hive",password("mysql"));
mysql> flush privileges;
mysql> grant all privileges on *.* to 'hive'@'%' identified by 'mysql' with grant option;
mysql> flush privileges;

mysql> use test;
mysql> create table sss (id int,name varchar(10));

mysql&