Sqoop安装教程及使用

最新推荐文章于 2024-05-28 21:28:23 发布

月苍.

最新推荐文章于 2024-05-28 21:28:23 发布

阅读量224

点赞数

分类专栏： Hadoop 文章标签： sqoop

本文链接：https://blog.csdn.net/Lyb_13393230912/article/details/110425518

版权

Hadoop 专栏收录该内容

3 篇文章 0 订阅

订阅专栏

文章目录

Sqoop安装
- 下载&安装
Sqoop从MySql导入HDFS中
限制数据范围数据导入
Sqoop从MySql导入HBase中
- Sqoop从MySql导入HBase中相关问题
- - 出现这个问题的原因是因为Sqoop不支持Hbase的版本

Sqoop安装

下载&安装

下载地址：http://sqoop.apache.org/
稳定版1.4.7
解压

tar -xvf   sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /home/software/

添加环境变量，并更新环境变量

export SQOOP_HOME=/home/software/sqoop-1.4.7.bin__hadoop-2.6.0
export PATH=$PATH:$SQOOP_HOME/bin

编辑 vim /home/software/sqoop-1.4.7.bin__hadoop-2.6.0/bin/configure-sqoop，将文件中的HCAT_HOME,ACCUMULO_HOME验证注释掉（如果不使用的话）
sqoop所在文件路径，配置环境

cd /home/software/sqoop-1.4.7.bin__hadoop-2.6.0/conf

cp sqoop_env_template.sh sqoop_env.sh

编辑 vim sqoop_env.sh
查看版本sqoop version
在使用之前需要将相关数据库驱动放入到 ${SQOOP_HOME}/lib下

Sqoop从MySql导入HDFS中

命令语法：sqoop import （控制参数） (导入参数)
命令元素：导入操作，数据源，访问控制，导入控制，目标地址

导入数据之前需要将驱动jar放入Sqoop安装文件夹下的lib中
进行导入

sqoop import \
--connect jdbc:mysql://ip:3306/test_database \
--driver com.mysql.jdbc.Driver \
--username root \
--password 123456 \
--table test_user \
--target-dir /sqoop \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "\t"

connect：表示连接的数据库地址（sqoop_test为数据库名）
driver：数据库驱动
username和password：表示要连接的数据库的用户名和密码
table：表示想要导出数据的表
target-dir：表示要导入到hdfs中的目录（如果不指定，默认存储在“/user/用户名/导入的表名” 目录下）
delete-target-dir：表示如果在hdfs中有该目录，则先删除，然后再导入数据到该目录下
num-mappers：表示设置的maptask个数，默认为4个，决定最终在hdfs中生成的文件个数（将table中的数据分成几个文件分别存储）

导入时出现的问题
在导入数据时，使用Hdfs文件系统上的jar，而不是使用本地jar，导致找不到类，在mapred-site.xml 中添加相关配置即可

# 异常信息
ERROR tool.ImportTool: Encountered IOException running import job: java.io.FileNotFoundException: File does not exist: hdfs://Hadoop:9000/usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/lib/snappy-java-1.0.5.jar

<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>

限制数据范围数据导入

columns的使用

指定需要导入的列
注：columns和where需要指明表名
语法：在导入命令后，任意位置加上 --columns <列名>

where条件的使用

规定数据选择的标准，类似sql语句中的where条件
注：columns和where需要指明表名
语法：在导入命令后，任意位置加上 --where <条件>

sqoop import \
--connect jdbc:mysql://ip:3306/test_database \
--driver com.mysql.jdbc.Driver \
--username root \
--password 123456 \
--table test_user \
--columns "id,name" \
--where "char_length(name) > 2" \
--target-dir /sqoop/test_user \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "\t"

自由SQL导入

可以使用sql语句将数据进行导入
注：必须在sql语句中加入where \$CONDITIONS，可以看作单独的筛选条件必须添加。
语法：在导入命令后，任意位置加上 --query <sql>

sqoop import \
--connect jdbc:mysql://ip:3306/test_database \
--driver com.mysql.jdbc.Driver \
--username root \
--password 123456 \
--query "select * from test_user where \$CONDITIONS" \
--target-dir /sqoop/test_user \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "\t"

Sqoop从MySql导入HBase中

相关命令

sqoop import \
--connect jdbc:mysql://ip:3306/test_database \
--driver com.mysql.jdbc.Driver \
--username root \
--password 123456 \
--table test_user \
--hbase-table test_user \
--column-family info  \
--hbase-create-table \
--hbase-row-key id

Sqoop从MySql导入HBase中相关问题

出现这个问题的原因是因为Sqoop不支持Hbase的版本

最开始使用的版本： hadoop-2.6.0、sqoop-1.4.7、hbase-2.2.4
在使用Sqoop将数据导入到HDFS中可以使用，但是导入到Hbase中，出现此问题

18/08/08 18:41:28 INFO mapreduce.ImportJobBase: Beginning import of mytable
18/08/08 18:41:28 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
18/08/08 18:41:28 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.HBaseAdmin.<init>(Lorg/apache/hadoop/conf/Configuration;)V
    at org.apache.sqoop.mapreduce.HBaseImportJob.jobSetup(HBaseImportJob.java:163)
    at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:268)
    at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
    at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

修改Hbase使用的版本： hadoop-2.6.0、sqoop-1.4.7、hbase-1.6.0此问题不再出现，数据导入成功

20/12/02 15:51:32 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
20/12/02 15:51:32 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
20/12/02 15:51:32 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
20/12/02 15:51:33 INFO manager.SqlManager: Using default fetchSize of 1000
20/12/02 15:51:33 INFO tool.CodeGenTool: Beginning code generation
20/12/02 15:51:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM test_user AS t WHERE 1=0
20/12/02 15:51:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM test_user AS t WHERE 1=0
20/12/02 15:51:33 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/software/hadoop-2.6.0
注: /tmp/sqoop-root/compile/af579de58c7596178eda1406b5a67d8d/test_user.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
20/12/02 15:51:36 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/af579de58c7596178eda1406b5a67d8d/test_user.jar
20/12/02 15:51:36 INFO mapreduce.ImportJobBase: Beginning import of test_user
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/software/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/software/hbase-1.6.0/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/12/02 15:51:36 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/12/02 15:51:36 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM test_user AS t WHERE 1=0
20/12/02 15:51:36 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/12/02 15:51:37 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5a4bef8 connecting to ZooKeeper ensemble=Hadoop:2181
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:host.name=Hadoop
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_171
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.home=/home/software/jdk1.8.0_171/jre
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/software/hadoop-2.6.0/etc/hadoop:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hadoop-annotations-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/htrace-core-3.0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hadoop-auth-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/activation-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/junit-4.11.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-framework-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-client-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-json-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-recipes-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jettison-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-nfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/activation-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jettison-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jline-2.12.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/conf:/home/software/apache-zookeeper-3.6.0-bin/conf::/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/ant-contrib-1.0b3.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/ant-eclipse-1.0-jvm1.2.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/avro-1.8.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/avro-mapred-1.8.1-hadoop2.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-codec-1.4.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-compress-1.8.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-io-1.4.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-jexl-2.1.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-lang3-3.4.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/commons-logging-1.1.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/hsqldb-1.8.0.10.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/jackson-annotations-2.3.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/jackson-core-2.3.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/jackson-core-asl-1.9.13.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/jackson-databind-2.3.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/jackson-mapper-asl-1.9.13.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/kite-data-core-1.1.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/kite-data-hive-1.1.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/kite-data-mapreduce-1.1.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/kite-hadoop-compatibility-1.1.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/mysql-connector-java-5.1.6.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/opencsv-2.3.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/paranamer-2.7.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-avro-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-column-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-common-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-encoding-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-format-2.2.0-rc1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-generator-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-hadoop-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/parquet-jackson-1.6.0.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/slf4j-api-1.6.1.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/snappy-java-1.1.1.6.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/lib/xz-1.5.jar:/home/software/hbase-1.6.0/conf:/home/software/jdk1.8.0_171/lib/tools.jar:/home/software/hbase-1.6.0:/home/software/hbase-1.6.0/lib/activation-1.1.jar:/home/software/hbase-1.6.0/lib/aopalliance-1.0.jar:/home/software/hbase-1.6.0/lib/apacheds-i18n-2.0.0-M15.jar:/home/software/hbase-1.6.0/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/software/hbase-1.6.0/lib/api-asn1-api-1.0.0-M20.jar:/home/software/hbase-1.6.0/lib/api-i18n-1.0.0-M20.jar:/home/software/hbase-1.6.0/lib/api-util-1.0.0-M20.jar:/home/software/hbase-1.6.0/lib/asm-3.1.jar:/home/software/hbase-1.6.0/lib/avro-1.7.7.jar:/home/software/hbase-1.6.0/lib/commons-beanutils-1.7.0.jar:/home/software/hbase-1.6.0/lib/commons-beanutils-core-1.8.0.jar:/home/software/hbase-1.6.0/lib/commons-cli-1.2.jar:/home/software/hbase-1.6.0/lib/commons-codec-1.9.jar:/home/software/hbase-1.6.0/lib/commons-collections-3.2.2.jar:/home/software/hbase-1.6.0/lib/commons-compress-1.4.1.jar:/home/software/hbase-1.6.0/lib/commons-configuration-1.6.jar:/home/software/hbase-1.6.0/lib/commons-daemon-1.0.13.jar:/home/software/hbase-1.6.0/lib/commons-digester-1.8.jar:/home/software/hbase-1.6.0/lib/commons-el-1.0.jar:/home/software/hbase-1.6.0/lib/commons-httpclient-3.1.jar:/home/software/hbase-1.6.0/lib/commons-io-2.4.jar:/home/software/hbase-1.6.0/lib/commons-lang-2.6.jar:/home/software/hbase-1.6.0/lib/commons-lang3-3.8.1.jar:/home/software/hbase-1.6.0/lib/commons-logging-1.2.jar:/home/software/hbase-1.6.0/lib/commons-math-2.2.jar:/home/software/hbase-1.6.0/lib/commons-math3-3.1.1.jar:/home/software/hbase-1.6.0/lib/commons-net-3.1.jar:/home/software/hbase-1.6.0/lib/curator-client-2.7.1.jar:/home/software/hbase-1.6.0/lib/curator-framework-2.7.1.jar:/home/software/hbase-1.6.0/lib/curator-recipes-2.7.1.jar:/home/software/hbase-1.6.0/lib/disruptor-3.3.0.jar:/home/software/hbase-1.6.0/lib/findbugs-annotations-1.3.9-1.jar:/home/software/hbase-1.6.0/lib/gson-2.2.4.jar:/home/software/hbase-1.6.0/lib/guava-12.0.1.jar:/home/software/hbase-1.6.0/lib/guice-3.0.jar:/home/software/hbase-1.6.0/lib/guice-servlet-3.0.jar:/home/software/hbase-1.6.0/lib/hadoop-annotations-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-auth-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-client-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-common-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-hdfs-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-hdfs-client-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-mapreduce-client-app-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-mapreduce-client-common-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-mapreduce-client-core-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-mapreduce-client-jobclient-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-mapreduce-client-shuffle-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-yarn-api-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-yarn-client-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-yarn-common-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-yarn-server-common-2.8.5.jar:/home/software/hbase-1.6.0/lib/hadoop-yarn-server-nodemanager-2.8.5.jar:/home/software/hbase-1.6.0/lib/hbase-annotations-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-annotations-1.6.0-tests.jar:/home/software/hbase-1.6.0/lib/hbase-client-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-common-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-common-1.6.0-tests.jar:/home/software/hbase-1.6.0/lib/hbase-examples-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-external-blockcache-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-hadoop2-compat-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-hadoop-compat-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-hbtop-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-it-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-it-1.6.0-tests.jar:/home/software/hbase-1.6.0/lib/hbase-metrics-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-metrics-api-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-prefix-tree-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-procedure-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-protocol-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-resource-bundle-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-rest-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-rsgroup-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-server-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-server-1.6.0-tests.jar:/home/software/hbase-1.6.0/lib/hbase-shaded-gson-3.0.0.jar:/home/software/hbase-1.6.0/lib/hbase-shell-1.6.0.jar:/home/software/hbase-1.6.0/lib/hbase-thrift-1.6.0.jar:/home/software/hbase-1.6.0/lib/htrace-core-3.1.0-incubating.jar:/home/software/hbase-1.6.0/lib/htrace-core4-4.0.1-incubating.jar:/home/software/hbase-1.6.0/lib/httpclient-4.5.2.jar:/home/software/hbase-1.6.0/lib/httpcore-4.4.4.jar:/home/software/hbase-1.6.0/lib/jackson-annotations-2.9.10.jar:/home/software/hbase-1.6.0/lib/jackson-core-2.9.10.jar:/home/software/hbase-1.6.0/lib/jackson-core-asl-1.9.13.jar:/home/software/hbase-1.6.0/lib/jackson-databind-2.9.10.1.jar:/home/software/hbase-1.6.0/lib/jackson-jaxrs-base-2.9.10.jar:/home/software/hbase-1.6.0/lib/jackson-jaxrs-json-provider-2.9.10.jar:/home/software/hbase-1.6.0/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hbase-1.6.0/lib/jackson-module-jaxb-annotations-2.9.10.jar:/home/software/hbase-1.6.0/lib/jamon-runtime-2.4.1.jar:/home/software/hbase-1.6.0/lib/jasper-compiler-5.5.23.jar:/home/software/hbase-1.6.0/lib/jasper-runtime-5.5.23.jar:/home/software/hbase-1.6.0/lib/javax.inject-1.jar:/home/software/hbase-1.6.0/lib/java-xmlbuilder-0.4.jar:/home/software/hbase-1.6.0/lib/jaxb-api-2.2.2.jar:/home/software/hbase-1.6.0/lib/jaxb-impl-2.2.3-1.jar:/home/software/hbase-1.6.0/lib/jcodings-1.0.8.jar:/home/software/hbase-1.6.0/lib/jersey-client-1.9.jar:/home/software/hbase-1.6.0/lib/jersey-core-1.9.jar:/home/software/hbase-1.6.0/lib/jersey-guice-1.9.jar:/home/software/hbase-1.6.0/lib/jersey-json-1.9.jar:/home/software/hbase-1.6.0/lib/jersey-server-1.9.jar:/home/software/hbase-1.6.0/lib/jets3t-0.9.0.jar:/home/software/hbase-1.6.0/lib/jettison-1.3.3.jar:/home/software/hbase-1.6.0/lib/jetty-6.1.26.jar:/home/software/hbase-1.6.0/lib/jetty-sslengine-6.1.26.jar:/home/software/hbase-1.6.0/lib/jetty-util-6.1.26.jar:/home/software/hbase-1.6.0/lib/joni-2.1.2.jar:/home/software/hbase-1.6.0/lib/jruby-complete-1.6.8.jar:/home/software/hbase-1.6.0/lib/jsch-0.1.54.jar:/home/software/hbase-1.6.0/lib/jsp-2.1-6.1.14.jar:/home/software/hbase-1.6.0/lib/jsp-api-2.1-6.1.14.jar:/home/software/hbase-1.6.0/lib/junit-4.12.jar:/home/software/hbase-1.6.0/lib/leveldbjni-all-1.8.jar:/home/software/hbase-1.6.0/lib/libthrift-0.12.0.jar:/home/software/hbase-1.6.0/lib/log4j-1.2.17.jar:/home/software/hbase-1.6.0/lib/metrics-core-2.2.0.jar:/home/software/hbase-1.6.0/lib/metrics-core-3.1.2.jar:/home/software/hbase-1.6.0/lib/netty-all-4.1.8.Final.jar:/home/software/hbase-1.6.0/lib/paranamer-2.3.jar:/home/software/hbase-1.6.0/lib/protobuf-java-2.5.0.jar:/home/software/hbase-1.6.0/lib/servlet-api-2.5-6.1.14.jar:/home/software/hbase-1.6.0/lib/servlet-api-2.5.jar:/home/software/hbase-1.6.0/lib/slf4j-api-1.7.25.jar:/home/software/hbase-1.6.0/lib/slf4j-log4j12-1.7.25.jar:/home/software/hbase-1.6.0/lib/snappy-java-1.0.5.jar:/home/software/hbase-1.6.0/lib/spymemcached-2.11.6.jar:/home/software/hbase-1.6.0/lib/xmlenc-0.52.jar:/home/software/hbase-1.6.0/lib/xz-1.0.jar:/home/software/hbase-1.6.0/lib/zookeeper-3.4.10.jar:/home/software/hadoop-2.6.0/etc/hadoop:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hadoop-annotations-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/htrace-core-3.0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/hadoop-auth-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/activation-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/junit-4.11.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-framework-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-client-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-json-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/curator-recipes-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/common/lib/jettison-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-nfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/activation-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jettison-1.1.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/lib/jline-2.12.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-api-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-client-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-registry-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-tests.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0.jar:/home/software/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0.jar:/home/software/hadoop-2.6.0/contrib/capacity-scheduler/*.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/sqoop-1.4.7.jar:/home/software/sqoop-1.4.7.bin__hadoop-2.6.0/sqoop-test-1.4.7.jar::/home/software/hadoop-2.6.0/contrib/capacity-scheduler/*.jar
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/software/hadoop-2.6.0/lib/native
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-1062.18.1.el7.x86_64
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:user.name=root
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/software
20/12/02 15:51:37 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=Hadoop:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@6c451c9c
20/12/02 15:51:37 INFO zookeeper.ClientCnxn: Opening socket connection to server Hadoop/192.168.24.12:2181. Will not attempt to authenticate using SASL (unknown error)
20/12/02 15:51:37 INFO zookeeper.ClientCnxn: Socket connection established to Hadoop/192.168.24.12:2181, initiating session
20/12/02 15:51:37 INFO zookeeper.ClientCnxn: Session establishment complete on server Hadoop/192.168.24.12:2181, sessionid = 0x100000c2daa001b, negotiated timeout = 40000
20/12/02 15:51:40 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
20/12/02 15:51:40 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x100000c2daa001b
20/12/02 15:51:40 INFO zookeeper.ZooKeeper: Session: 0x100000c2daa001b closed
20/12/02 15:51:40 INFO zookeeper.ClientCnxn: EventThread shut down
20/12/02 15:51:40 WARN mapreduce.TableMapReduceUtil: The addDependencyJars(Configuration, Class<?>...) method has been deprecated since it is easy to use incorrectly. Most users should rely on addDependencyJars(Job) instead. See HBASE-8386 for more details.
20/12/02 15:51:40 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
20/12/02 15:51:45 INFO db.DBInputFormat: Using read commited transaction isolation
20/12/02 15:51:45 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(id), MAX(id) FROM test_user
20/12/02 15:51:45 INFO db.IntegerSplitter: Split size: 2500; Num splits: 4 from: 4 to: 10004
20/12/02 15:51:45 INFO mapreduce.JobSubmitter: number of splits:4
20/12/02 15:51:46 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1606894716093_0002
20/12/02 15:51:46 INFO impl.YarnClientImpl: Submitted application application_1606894716093_0002
20/12/02 15:51:46 INFO mapreduce.Job: The url to track the job: http://Hadoop:8088/proxy/application_1606894716093_0002/
20/12/02 15:51:46 INFO mapreduce.Job: Running job: job_1606894716093_0002
20/12/02 15:51:58 INFO mapreduce.Job: Job job_1606894716093_0002 running in uber mode : false
20/12/02 15:51:58 INFO mapreduce.Job:  map 0% reduce 0%
20/12/02 15:52:30 INFO mapreduce.Job:  map 50% reduce 0%
20/12/02 15:52:35 INFO mapreduce.Job:  map 100% reduce 0%
20/12/02 15:52:40 INFO mapreduce.Job: Job job_1606894716093_0002 completed successfully
20/12/02 15:52:41 INFO mapreduce.Job: Counters: 30
        File System Counters
                FILE: Number of bytes read=0
                FILE: Number of bytes written=636168
                FILE: Number of read operations=0
                FILE: Number of large read operations=0
                FILE: Number of write operations=0
                HDFS: Number of bytes read=399
                HDFS: Number of bytes written=0
                HDFS: Number of read operations=4
                HDFS: Number of large read operations=0
                HDFS: Number of write operations=0
        Job Counters
                Launched map tasks=4
                Other local map tasks=4
                Total time spent by all maps in occupied slots (ms)=144051
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=144051
                Total vcore-seconds taken by all map tasks=144051
                Total megabyte-seconds taken by all map tasks=147508224
        Map-Reduce Framework
                Map input records=10001
                Map output records=10001
                Input split bytes=399
                Spilled Records=0
                Failed Shuffles=0
                Merged Map outputs=0
                GC time elapsed (ms)=1701
                CPU time spent (ms)=11630
                Physical memory (bytes) snapshot=438964224
                Virtual memory (bytes) snapshot=8373112832
                Total committed heap usage (bytes)=94478336
        File Input Format Counters
                Bytes Read=0
        File Output Format Counters
                Bytes Written=0
20/12/02 15:52:41 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 60.8616 seconds (0 bytes/sec)
20/12/02 15:52:41 INFO mapreduce.ImportJobBase: Retrieved 10001 records.

月苍.

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
Sqoop安装教程及使用

Sqoop安装Sqoop从MySql导入HDFS中命令语法：sqoop import （控制参数） (导入参数)命令元素：导入操作，数据源，访问控制，导入控制，目标地址导入数据之前需要将驱动jar放入Sqoop安装文件夹下的lib中进行导入sqoop import \--connect jdbc:mysql://ip:3306/test_database \--driver com.mysql.jdbc.Driver \--username root \--password 12
复制链接

扫一扫