Sqoop

最新推荐文章于 2023-12-20 10:38:01 发布
最新推荐文章于 2023-12-20 10:38:01 发布
阅读量723 收藏 1
点赞数 1
分类专栏： Hadoop
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/chen45682kang/article/details/81479220
版权

Sqoop

  • 安装

    • 下载，解压，配置环境变量
    • conf里的配置不需要动，如果没有安装ZooKeeper和Hbase，就把configure-sqoop里有关zk和hbase的脚本全部注释掉；如果安装了zk和hbase，就不需要改。

  • 导入，一个mysql的坑

我们导入hive表的DBS表

➜  sqoop git:(master) ✗ sqoop import --connect jdbc:mysql://localhost:3306/hive --table DBS --username root -password root

java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@3901d134 is still active.

Warning: /Users/chenxiaokang/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /Users/chenxiaokang/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
18/08/07 10:52:24 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
18/08/07 10:52:24 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/08/07 10:52:24 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
18/08/07 10:52:24 INFO tool.CodeGenTool: Beginning code generation
18/08/07 10:52:25 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `DBS` AS t LIMIT 1
18/08/07 10:52:25 ERROR manager.SqlManager: Error reading from database: java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@3901d134 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@3901d134 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.

这是MySQL的一个bug，把（lib目录下）mysql的连接jar包mysql-connector-java-5.1.13-bin.jar换成mysql-connector-java-5.1.32.jar就好了。

➜  lib git:(master) ✗ sqoop import --connect jdbc:mysql://localhost:3306/hive --table DBS --username root -password root 
Warning: /Users/chenxiaokang/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /Users/chenxiaokang/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
18/08/07 11:01:47 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
18/08/07 11:01:47 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/08/07 11:01:47 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
18/08/07 11:01:47 INFO tool.CodeGenTool: Beginning code generation
18/08/07 11:01:48 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `DBS` AS t LIMIT 1
18/08/07 11:01:48 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `DBS` AS t LIMIT 1
18/08/07 11:01:48 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /Users/chenxiaokang/hadoop-2.7.6
Note: /tmp/sqoop-chenxiaokang/compile/3ecfbbea71dfb1dd1314eba358b9a7d7/DBS.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/08/07 11:01:52 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-chenxiaokang/compile/3ecfbbea71dfb1dd1314eba358b9a7d7/DBS.jar
18/08/07 11:01:52 WARN manager.MySQLManager: It looks like you are importing from mysql.
18/08/07 11:01:52 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
18/08/07 11:01:52 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
18/08/07 11:01:52 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
18/08/07 11:01:52 INFO mapreduce.ImportJobBase: Beginning import of DBS
18/08/07 11:01:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/08/07 11:01:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
18/08/07 11:01:56 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
18/08/07 11:01:56 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
18/08/07 11:02:02 INFO db.DBInputFormat: Using read commited transaction isolation
18/08/07 11:02:02 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`DB_ID`), MAX(`DB_ID`) FROM `DBS`
18/08/07 11:02:02 INFO mapreduce.JobSubmitter: number of splits:4
18/08/07 11:02:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1533537460397_0001
18/08/07 11:02:04 INFO impl.YarnClientImpl: Submitted application application_1533537460397_0001
18/08/07 11:02:05 INFO mapreduce.Job: The url to track the job: http://172.20.10.3:8088/proxy/application_1533537460397_0001/
18/08/07 11:02:05 INFO mapreduce.Job: Running job: job_1533537460397_0001
18/08/07 11:02:23 INFO mapreduce.Job: Job job_1533537460397_0001 running in uber mode : false
18/08/07 11:02:23 INFO mapreduce.Job:  map 0% reduce 0%
18/08/07 11:02:38 INFO mapreduce.Job:  map 50% reduce 0%
18/08/07 11:02:39 INFO mapreduce.Job:  map 100% reduce 0%
18/08/07 11:02:40 INFO mapreduce.Job: Job job_1533537460397_0001 completed successfully
18/08/07 11:02:40 INFO mapreduce.Job: Counters: 31
    File System Counters
        FILE: Number of bytes read=0
        FILE: Number of bytes written=565736
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=417
        HDFS: Number of bytes written=158
        HDFS: Number of read operations=16
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=8
    Job Counters 
        Killed map tasks=1
        Launched map tasks=4
        Other local map tasks=4
        Total time spent by all maps in occupied slots (ms)=50716
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=50716
        Total vcore-milliseconds taken by all map tasks=50716
        Total megabyte-milliseconds taken by all map tasks=51933184
    Map-Reduce Framework
        Map input records=2
        Map output records=2
        Input split bytes=417
        Spilled Records=0
        Failed Shuffles=0
        Merged Map outputs=0
        GC time elapsed (ms)=454
        CPU time spent (ms)=0
        Physical memory (bytes) snapshot=0
        Virtual memory (bytes) snapshot=0
        Total committed heap usage (bytes)=440926208
    File Input Format Counters 
        Bytes Read=0
    File Output Format Counters 
        Bytes Written=158
18/08/07 11:02:40 INFO mapreduce.ImportJobBase: Transferred 158 bytes in 44.4693 seconds (3.553 bytes/sec)
18/08/07 11:02:40 INFO mapreduce.ImportJobBase: Retrieved 2 records.

可以看到hdfs中就有了我们导入的mysql的数据

0: jdbc:hive2://localhost:10000> dfs -ls /user/hdfs;
+----------------------------------------------------------------------------+--+
|                                 DFS Output                                 |
+----------------------------------------------------------------------------+--+
| Found 1 items                                                              |
| drwxr-xr-x   - hdfs supergroup          0 2018-08-07 11:02 /user/hdfs/DBS  |
+----------------------------------------------------------------------------+--+
2 rows selected (0.01 seconds)
0: jdbc:hive2://localhost:10000> dfs -cat /user/hdfs/DBS/part-m-00000;
+----------------------------------------------------------------------------------------+--+
|                                       DFS Output                                       |
+----------------------------------------------------------------------------------------+--+
| 1,Default Hive database,hdfs://localhost:9000/user/hive/warehouse,default,public,ROLE  |
+----------------------------------------------------------------------------------------+--+
1 row selected (0.024 seconds)

  • 导入过程

    • Sqoop也是通过MapReduce作业进行导入工作，在作业中，会从表中读取一行行记录，然后将其写入HDFS中：
      • 开始导入之前，Sqoop会通过JDBC来获得所需要的数据库元数据，例如导入表的列名、数据类型等；
      • 接着数据库的数据类型（varchar、number等）会被映射成Java的基本数据类型（String、int等），根据这些信息，Sqoop会生成一个与表名同名的类用来完成反序列化工作，保存表中每一行的记录；
      • Sqoop启动MapReduce作业；
      • 启动的作业在input的过程中，会通过JDBC读取数据库表中的内容,这时使用Sqoop生成的类进行反序列化；
      • 最后再将这些记录写到HDFS中，在写入HDFS的过程中，同时会使用Sqoop生成的类进行序列化。
    • Sqoop的导入作业通常不只是由一个Map任务完成，也就是每个任务会获取表的一部分数据。如果只由一个Map任务完成导入的话，那么在第四步会执行“`SELECT col1,col2,… FROM table;
    • 如果多个Map任务，就必须对表进行水平切分，水平切分的依据通常是表的主键。Sqoop在启动MapReduce作业时，会首先通过JDBC查询切分列的最大值和最小值，再根据启动的任务数（-m指定）划分出每个任务所负责的数据：SELECT col1,col2,... FROM table WHERE id >= 0 AND id < 50000;,SELECT col1,col2,... FROM table WHERE id >= 50000 AND id < 100000;
    • 并行导入切分列的数据分布会很大地影响性能，如果均匀分布，性能最好。数据严重倾斜，性能很差。所以在导入之前，有必要对切分列的数据进行抽样检测，了解数据的分布。
    • Sqoop可以对导入过程进行精细地控制，不用每次都导入一张表的所有字段。Sqoop允许我们指定表的列，在查询中加入WHERE子句，也可以自定义查询SQL语句，在SQL中可以使用目标数据库所支持的函数。
    • 我们在导入到HDFS的时候可以在Hive创建好该表：sqoop create-hive-table --connect jdbc://master:3306/hive --table DBS --fields-terminated-by ',' --username [username] --password [password]，然后LOAD数据即可。
    • Sqoop默认导出格式为逗号分隔，所以在Sqoop建表命令中，我们用--fields-terminated-by ','指明Hive中的DBS表的列分隔符。
    • 也可将导入HDFS、创建表、加载数据合并为一个步骤：sqoop import --connect jdbc:mysql://master:3306/hive --table DBS --username [usernmae] --password [password] -m [num] --hive-import

  • 导出过程

    • 在将Hive中的表导出到数据库时，必须在数据库中新建一张用来接收数据的表。
    • 同样的，Sqoop根据目标表的结构会生成一个Java类（第一二步），作用是序列化和反序列化。接着启动一个MapReduce作业（第三步），在作业中会用生成的Java类从HDFS中读取数据（第四步），并生成一批INSERT语句，每条语句都会向MySQL的目标表中插入多条记录（第五步），这样读写都是并行，写入性能受限于目标数据库的写入性能。

例子：导出sc表到MySQL

0: jdbc:hive2://localhost:10000> DESC sc;
+-----------+------------+----------+--+
| col_name  | data_type  | comment  |
+-----------+------------+----------+--+
| id        | bigint     |          |
| courseid  | bigint     |          |
| account   | string     |          |
+-----------+------------+----------+--+
3 rows selected (0.185 seconds)
0: jdbc:hive2://localhost:10000> 
mysql> use test;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
mysql> create table sc(id bigint, courseid bigint, account varchar(32));
Query OK, 0 rows affected (0.03 sec)
➜  bin git:(master) ✗ sqoop export --connect jdbc:mysql://localhost:3306/test --table sc --export-dir /user/hive/warehouse/sc --username root --password root -m 1 --fields-terminated-by ',';
Warning: /Users/chenxiaokang/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /Users/chenxiaokang/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
18/08/07 12:23:32 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
18/08/07 12:23:32 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/08/07 12:23:32 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
18/08/07 12:23:32 INFO tool.CodeGenTool: Beginning code generation
18/08/07 12:23:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `sc` AS t LIMIT 1
18/08/07 12:23:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `sc` AS t LIMIT 1
18/08/07 12:23:33 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /Users/chenxiaokang/hadoop-2.7.6
Note: /tmp/sqoop-chenxiaokang/compile/fb350fa941a369d077323a7b646b5380/sc.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/08/07 12:23:35 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-chenxiaokang/compile/fb350fa941a369d077323a7b646b5380/sc.jar
18/08/07 12:23:35 INFO mapreduce.ExportJobBase: Beginning export of sc
18/08/07 12:23:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/08/07 12:23:35 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
18/08/07 12:23:37 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
18/08/07 12:23:37 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
18/08/07 12:23:37 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
18/08/07 12:23:37 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
18/08/07 12:23:42 INFO input.FileInputFormat: Total input paths to process : 1
18/08/07 12:23:42 INFO input.FileInputFormat: Total input paths to process : 1
18/08/07 12:23:43 INFO mapreduce.JobSubmitter: number of splits:1
18/08/07 12:23:43 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
18/08/07 12:23:43 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1533537460397_0002
18/08/07 12:23:44 INFO impl.YarnClientImpl: Submitted application application_1533537460397_0002
18/08/07 12:23:44 INFO mapreduce.Job: The url to track the job: http://172.20.10.3:8088/proxy/application_1533537460397_0002/
18/08/07 12:23:44 INFO mapreduce.Job: Running job: job_1533537460397_0002
18/08/07 12:23:57 INFO mapreduce.Job: Job job_1533537460397_0002 running in uber mode : false
18/08/07 12:23:57 INFO mapreduce.Job:  map 0% reduce 0%
18/08/07 12:24:04 INFO mapreduce.Job:  map 100% reduce 0%
18/08/07 12:24:05 INFO mapreduce.Job: Job job_1533537460397_0002 completed successfully
18/08/07 12:24:05 INFO mapreduce.Job: Counters: 30
    File System Counters
        FILE: Number of bytes read=0
        FILE: Number of bytes written=141082
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=1044
        HDFS: Number of bytes written=0
        HDFS: Number of read operations=4
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=0
    Job Counters 
        Launched map tasks=1
        Data-local map tasks=1
        Total time spent by all maps in occupied slots (ms)=4797
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=4797
        Total vcore-milliseconds taken by all map tasks=4797
        Total megabyte-milliseconds taken by all map tasks=4912128
    Map-Reduce Framework
        Map input records=82
        Map output records=82
        Input split bytes=132
        Spilled Records=0
        Failed Shuffles=0
        Merged Map outputs=0
        GC time elapsed (ms)=74
        CPU time spent (ms)=0
        Physical memory (bytes) snapshot=0
        Virtual memory (bytes) snapshot=0
        Total committed heap usage (bytes)=121110528
    File Input Format Counters 
        Bytes Read=0
    File Output Format Counters 
        Bytes Written=0
18/08/07 12:24:05 INFO mapreduce.ExportJobBase: Transferred 1.0195 KB in 28.176 seconds (37.0528 bytes/sec)
18/08/07 12:24:05 INFO mapreduce.ExportJobBase: Exported 82 records.
chenxiaokang97
关注
  • 1
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
Sqoop 安装包
10-26
Sqoop 是一款开源的工具，主要用于在 Hadoop(Hive)与传统的数据库(mysql、 postgresql...) 间 进 行 数 据 的 传 递 ， 可 以 将 一 个 关 系 型 数 据 库 （ 例 如 ：MySQL ,Oracle ,Postgres 等）中的数据导进到 ...
sqoop安装和需要注意的步骤
qq_46183404的博客
10-01 540
sqoop安装和需要注意的步骤
linux如何下载安装sqoop
tanxinji的博客
06-30 1301
sqoop可以采集关系型数据库中的数据到hdfs 等 官网链接 https://sqoop.apache.org/ 官网使用链接 https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html下载链接 http://archive.apache.org/dist/sqoop/  放在任意位置，解压到 目录下  在压缩包的目录下输入  重命名  sqoop的安装目录 二、配置环境变量 三、其他配置  记住hadoop的安装目录  向sqoop配置文件中
Sqoop的下载与安装
qq_44814265的博客
07-11 3697
下载地址：https://mirrors.tuna.tsinghua.edu.cn/apache/sqoop/1.4.7/ 1.把sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz上传到linux的/opt/software目录下 注意：文件目录根据自身情况更改 2.解压sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz到/opt/module/目录下 [root@hadoop01 software]# tar -zxvf sqoop-1.4.7.bin
Sqoop入门：如何下载、配置和使用
kilig_CSM的博客
12-20 1298
Sqoop是Apache的一个开源工具，主要用于在Hadoop和关系数据库之间传输数据。：你可以从Apache的官方网站下载Sqoop。大多数企业使用的Sqoop版本是Sqoop1，例如sqoop-1.4.6或sqoop-1.4.7。需注意的是要确定下载的版本和你的Hadoop版本兼容。：将下载的Sqoop tar.gz文件解压到指定目录。：将MySQL的JDBC驱动包（例如mysql-connector-java-5.1.40-bin.jar）添加到Sqoop的lib目录下。可以从。
Windows下安装Sqoop
tttzzzqqq2018的博客
08-07 1533
1.1、Sqoop是什么Sqoop是一个用于Hadoop和结构化数据存储（如关系型数据库）之间进行高效传输大批量数据的工具。它包括以下两个方面：1.1.1、​可以使用Sqoop将数据从关系型数据库管理系统(如MySql)导入到Hadoop系统(如HDFS、Hive、HBase)中。1.1.2、将数据从Hadoop系统中抽取并导出到关系型数据库(如MySql)。1.2、底层实现原理​ Sqoop的核心设计思想是利用MapReduce加快数据传输速度。
sqoop常用命令.xlsx
01-15
sqoop的常用指令操作
sqoop-1.4.7.zip
04-24
运行Sqoop报错：找不到或无法加载主类 org.apache.sqoop.sqoop 将sqoop-1.4.7.jar包放到Sqoop的lib目录下，问题解决。
sqoop1.4.7
07-05
Sqoop是专门用来迁移数据的，它可以把数据库中的数据迁移到HDFS文件系统，当然也可以从HDFS文件系统导回到数据库
sqoop-1.4.6.jar.zip
04-20
sqoop框架开发工具使用的jar sqoop-1.4.6.jar 手动安装到maven <groupId>org.apache.sqoop <artifactId>sqoop <version>1.4.6 </dependency>
sqoop-1.4.5-cdh5.3.6.tar.gz
03-14
cdh版本sqoop，目前在使用的版本，需要其他版本可以去其他地方下载
09_sqoop常用参数
weixin_56765170的博客
05-11 284
sqoop 导入常用参数: bin/sqoop import ------------------------------公有参数----------------------------------- --connect 指定mysql url连接 --username 指定mysql账号 --password 指定mysql的密码 -------------------------------导入HDFS的时候使用-------------------------...
如何从Sqoop官网下载适用于集群的版本
u012453843的专栏
10-27 1694
第一步，从百度上搜索Sqoop，我们点击第二条链接，如下图所示。 第二步：点击上图的链接之后，我们会进入到如下图所示的界面，我们点击Latest stable release is 1.4.6后面的"Download"，如下图所示。 第三步：点击上图的"Download"链接之后，我们会进入到如下图所示的界面，这个页面有很多下载地址，我们点击第一个下载地址就行，如下图所示。 第四
sqoop to hive GC overhead limit exceeded 大表抽取到hive中发生异常
为了更好的未来_加油
04-08 1694
如果你已经试过了别的博客提供的修改内存的方法，但是美效果的话，不妨看看我的解决办法。 为什么Sqoop Import抛出这个异常? 22/04/08 16:22:35 INFO mapreduce.Job: Task Id : attempt_1649398255409_0017_m_000000_0, Status : FAILED Exception from container-launch. Container id: container_1649398255409_0017_01_000002 E
Sqoop安装教程
Andy86666的博客
12-18 716
Sqoop主要使用来将Hadoop的数据与传统关系数据库数据的导出和导出，将关系型数据库的数据导入到HDFS中，也可以将HDFS的数据导出到关系型数据库中。Sqoop 底层原理：主要是通过将导入、导出的命令转成成MapReduce，通过map来导入导出。中添加以下内容,Hadoop、Hbase、Hive、zookeeper的安装路径。测试Sqoop是否能够成功连接数据库,并展示MySQL中数据库。将sqoop文件上传到Linux中，将文件上传到。,只需要里面的jar包。
数据转换工具sqoop安装和使用
FLY的博客
06-14 1260
Sqoop sqoop1.4.7 sqoop安装 sqoop使用 sqoop导入导出数据
sqoop map并行度以及split-by数量详解
welcome to zdsg's csdn
07-10 3886
Sqoop 同步记录 文章目录Sqoop 同步记录1. sqoop -m2. sqoop --split-by3.sqoop --split-by 分割机制3.1 分割int类型3.2 分割date类型3.3 分割varchar类型4. sqoop --split-limit5. map的数量由什么决定6.为什么要设定--split-limit 1. sqoop -m 有一种情况可以不需要指定 sqoop -m 就是你要同步的表有主键,这样的话sqoop默认会按照主键进行split然后分成4个map并行执行
sqoop的安装（sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz）
qq_55906442的博客
03-11 4029
一.下载sqoop 官网如下： http://archive.apache.org/dist/sqoop/ 可以选择想要的版本！但后面一定要是.tar.gz
sqoop详细安装
qq_34999090的博客
07-01 3256
sqoop详细安装
sqoop export
最新发布
03-02
Sqoop Export是一个用于将数据从Hadoop生态系统中的关系型数据库导出到Hadoop集群的工具。它可以将数据从关系型数据库（如MySQL、Oracle等）导出到Hadoop的HDFS或Hive中。 Sqoop Export的主要特点和功能包括： 1. ...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值