sqoop2简单使用

本文介绍了如何使用Sqoop2版本1.99.7从HDFS到MySQL进行数据迁移。首先启动服务和客户端,然后创建HDFS和MySQL的link对象,接着创建job,并在MySQL中准备目标表,最后启动job完成数据导入。
摘要由CSDN通过智能技术生成
Sqoop1.99.7
1.    HDFSà MYSQL

1.       启动服务:                sqoop2-serverstart

 

[root@slave2 bin]# sqoop2-server start

Setting conf dir:/opt/hadoop/packages/sqoop-1.99.7/bin/../conf

Sqoop home directory:/opt/hadoop/packages/sqoop-1.99.7

Starting the Sqoop2 server...

Sqoop2 server started.

 

2.       启动客户端:             sqoop2-shell

[root@slave2 bin]# sqoop2-shell

Setting conf dir:/opt/hadoop/packages/sqoop-1.99.7/bin/../conf

Sqoop home directory:/opt/hadoop/packages/sqoop-1.99.7

Loading resource file .sqoop2rc

sqoop:000> set server --host slave2.server--port 12000 --webapp sqoop 

Server is set successfully

===> OK

sqoop:000> set option --name verbose--value true

Verbose option was changed to true

===> OK

Resource file loaded.

Sqoop Shell: Type 'help' or '\h' for help.

 

之前直接写了配置文件./.sqoop2rc  启动时会读取该文件

 

3.       测试连接,显示版本说明连接成功

sqoop:000> show version --all

client version:

Sqoop 1.99.7 source revision435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb

Compiled by abefine on Tue Jul 19 16:08:27PDT 2016

0   [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... usingbuiltin-java classes where applicable

server version:

Sqoop 1.99.7 source revision435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb

Compiled by abefine on Tue Jul 19 16:08:27PDT 2016

API versions:

[v1]

sqoop:000>

 

4.       创建HDFS的link对象

 

sqoop:000>

评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值