一、概述
Sqoop是一款开源工具，主要是用于在Hadoop或Hive与传统数据库（如：MySQL、Oracle等）进行数据传递，它可以将一个关系型数据库中的数据导入到Hadoop的HDFS中，也可以将HDFS的数据导出到关系型数据库中。甚至可以使用Sqoop将数据从数据库中转移到Hbase中。
二、Sqoop安装
1、下载与解压
首先下载你需要的sqoop版本（http://archive.apache.org/dist中一般可以下载到你需要的关于大数据方面的组件）我这里使用的是 sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz。
将下载好的压缩包上传到Centos7中所想放置的目录下，并解压、重命名
tar -zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz sqoop
2、配置环境
- 配置环境变量
打开/etc/profile文件，在其中添加如下内容
export SQOOP_HOME=/home/hadoop/sqoop
export PATH=$PATH:$SQOOP_HOME/bin
使配置文件立即生效
source /etc/profile
- 进入到 conf 文件夹，找到 sqoop-env-template.sh，修改其名称为 sqoop-env.sh 并打开
cd $SQOOP_HOME/conf
mv sqoop-env-template.sh sqoop-env.sh
vim sqoop-env.sh
修改内容如下：
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/home/hadoop/hadoop-2.8.5
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/home/hadoop/hadoop-2.8.5
#set the path to where bin/hbase is available
export HBASE_HOME=/home/hadoop/hbase
#Set the path to where bin/hive is available
export HIVE_HOME=/home/hadoop/hive
#Set the path for where zookeper config dir is
export ZOOCFGDIR=/home/hadoop/zookeeper/zookeeper-3.4.14/conf
- 将MySQL的驱动包复制到sqoop的lib目录下
我在配置hive的时候将MySQL的驱动包复制到hive的lib下，所以直接从hive的lib下复制过去
cp /home/hadoop/hive/lib/mysql-connector-java-5.1.49-bin.jar /home/hadoop/sqoop/lib
- 验证安装是否成功
sqoop version
三、Sqoop的使用
Sqoop主要是用来导入和导出数据，所以这里主要讲解sqoop的import和export命令的使用。
- 基本操作
1.查看MySQL中的数据库
[hadoop@hadoop0~]$ sqoop list-databases \
> --connect jdbc:mysql://hadoop0：3306/ \
> --username root \
> --password root
结果如下：
2.查询数据库中的表
[hadoop@hadoop0~]$ sqoop list-tables \
> --connect jdbc:mysql://hadoop0：3306/mysql \
> --username root \
> --password root
查询结果如下：
Warning: /home/hadoop/apps/sqoop-1.4.6/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/apps/sqoop-1.4.6/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
18/04/12 13:46:21 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
18/04/12 13:46:21 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/04/12 13:46:21 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
columns_priv
db
event
func
general_log
help_category
help_keyword
help_relation
help_topic
innodb_index_stats
innodb_table_stats
ndb_binlog_index
plugin
proc
procs_priv
proxies_priv
servers
slave_master_info
slave_relay_log_info
slave_worker_info
slow_log
tables_priv
time_zone
time_zone_leap_second
time_zone_name
time_zone_transition
time_zone_transition_type
user
- 数据导入
1.从MySQL中导入到HDFS中
shell模版
sqoop import \
--connect jdbc:mysql://服务器地址[:端口号]/数据库名 \
--username 数据库用户名
--password 数据库密码
--table 表名
-m Map任务数量
实例
将mysql中的help_keyword表导入到HDFS中
sqoop import \
--connect jdbc:mysql://hadoop0:3306/mysql \
--username root \
--password 123456 \
--table help_keyword \
-m 1
运行结果
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
20/11/13 13:08:39 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/11/13 13:08:40 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
20/11/13 13:08:41 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
20/11/13 13:08:41 INFO tool.CodeGenTool: Beginning code generation
Fri Nov 13 13:08:43 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
20/11/13 13:08:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `help_keyword` AS t LIMIT 1
20/11/13 13:08:51 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `help_keyword` AS t LIMIT 1
20/11/13 13:08:51 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/hadoop-2.8.5
注: /tmp/sqoop-root/compile/3294c79adf2e4c91cc3bb00459e61026/help_keyword.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
20/11/13 13:09:22 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/3294c79adf2e4c91cc3bb00459e61026/help_keyword.jar
20/11/13 13:09:25 WARN manager.MySQLManager: It looks like you are importing from mysql.
20/11/13 13:09:25 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
20/11/13 13:09:25 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
20/11/13 13:09:25 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
20/11/13 13:09:26 INFO mapreduce.ImportJobBase: Beginning import of help_keyword
20/11/13 13:09:30 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/11/13 13:09:34 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/11/13 13:09:35 INFO client.RMProxy: Connecting to ResourceManager at hadoop0/192.168.140.132:8032
Fri Nov 13 13:09:58 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
20/11/13 13:09:59 INFO db.DBInputFormat: Using read commited transaction isolation
20/11/13 13:10:00 INFO mapreduce.JobSubmitter: number of splits:1
20/11/13 13:10:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1605238170560_0001
20/11/13 13:10:23 INFO impl.YarnClientImpl: Submitted application application_1605238170560_0001
20/11/13 13:10:24 INFO mapreduce.Job: The url to track the job: http://hadoop0:8088/proxy/application_1605238170560_0001/
20/11/13 13:10:24 INFO mapreduce.Job: Running job: job_1605238170560_0001
20/11/13 13:13:19 INFO mapreduce.Job: Job job_1605238170560_0001 running in uber mode : false
20/11/13 13:13:19 INFO mapreduce.Job: map 0% reduce 0%
20/11/13 13:14:20 INFO mapreduce.Job: map 100% reduce 0%
20/11/13 13:14:21 INFO mapreduce.Job: Job job_1605238170560_0001 completed successfully
20/11/13 13:14:22 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=176366
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=12455
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=50082
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=50082
Total vcore-milliseconds taken by all map tasks=50082
Total megabyte-milliseconds taken by all map tasks=51283968
Map-Reduce Framework
Map input records=908
Map output records=908
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=77
CPU time spent (ms)=1410
Physical memory (bytes) snapshot=109002752
Virtual memory (bytes) snapshot=2093428736
Total committed heap usage (bytes)=30474240
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=12455
20/11/13 13:14:22 INFO mapreduce.ImportJobBase: Transferred 12.1631 KB in 288.0207 seconds (43.2434 bytes/sec)
20/11/13 13:14:22 INFO mapreduce.ImportJobBase: Retrieved 908 records.
生成的文件默认放在*/user/root/help_keyword* 中，使用命令hdfs dfs -ls /user/root查看如下
打开文件help_keyword 查看内部有两个文件
内容保存在part-m-00000中，查看使用hdfs dfs -cat /user/root/help_keyword/part-m-00000命令查看内容
2.从MySQL中导入到Hive中
只需要在1中的命令行中加入*- -hive-import*，具体如下
sqoop import /
--connect jdbc:mysql://hadoop0:3306/mysql \
--username root \
--password 123456 \
--table help_keyword \
--hive-import \
-m 1
运行后再hive中可以查看到表help_keyword，使用命令show tables
当然你也可以在命令中添加信息，指定自动创建hive表，指定表名等，如下：
sqoop import \
--connect jdbc:mysql://hadoop1:3306/mysql \
--username root \
--password root \
--table help_keyword \
--fields-terminated-by "\t" \
--lines-terminated-by "\n" \
--hive-import \
--hive-overwrite \
--create-hive-table \
--delete-target-dir \
--hive-database mydb_test \
--hive-table new_help_keyword
注意一点， sqoop会自动给创建hive的表。 但是不会自动创建不存在的库
3.从MySQL中导入到Hbase中
首先需要在Hbase中创建表，不然会报错
create ‘new_help_keyword','info'
然后执行命令：
sqoop import \
--connect jdbc:mysql://hadoop0:3306/mysql \
--username root \
--password 123456 \
--table help_keyword \
--hbase-table new_help_keyword \
--column-family info \
--hbase-row-key help_keyword_id
执行结果如下：
[root@hadoop0 /]# sqoop import \
--connect jdbc:mysql://hadoop0:3306/mysql \
--username root \
--password 123456 \
--table help_keyword \
--hbase-table new_help_keyword \
--column-family info \
--hbase-row-key help_keyword_id
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
20/11/14 10:17:18 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/11/14 10:17:18 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
20/11/14 10:17:18 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
20/11/14 10:17:18 INFO tool.CodeGenTool: Beginning code generation
Sat Nov 14 10:17:19 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
20/11/14 10:17:20 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `help_keyword` AS t LIMIT 1
20/11/14 10:17:20 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `help_keyword` AS t LIMIT 1
20/11/14 10:17:21 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/hadoop-2.8.5
注: /tmp/sqoop-root/compile/842d09947d8a17b8e45ede973d0fc613/help_keyword.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
20/11/14 10:17:29 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/842d09947d8a17b8e45ede973d0fc613/help_keyword.jar
20/11/14 10:17:29 WARN manager.MySQLManager: It looks like you are importing from mysql.
20/11/14 10:17:29 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
20/11/14 10:17:29 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
20/11/14 10:17:29 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
20/11/14 10:17:30 INFO mapreduce.ImportJobBase: Beginning import of help_keyword
20/11/14 10:17:30 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/11/14 10:17:30 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/11/14 10:17:31 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7fae4d4a connecting to ZooKeeper ensemble=192.168.140.132:2181
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop0
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_262
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.262.b10-0.el7_8.x86_64/jre
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/hadoop/hadoop-2.8.5/etc/hadoop:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hadoop-auth-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hadoop-annotations-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-framework-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-digester-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/json-smart-1.3.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-common-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-nfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-nfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-client-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/fst-2.50.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/curator-test-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-tests-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-registry-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-api-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/hadoop-annotations-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.5.jar:/home/hadoop/sqoop/conf:/home/hadoop/zookeeper/zookeeper-3.4.14/conf::/home/hadoop/sqoop/lib/ant-contrib-1.0b3.jar:/home/hadoop/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/home/hadoop/sqoop/lib/avro-1.7.5.jar:/home/hadoop/sqoop/lib/avro-mapred-1.7.5-hadoop2.jar:/home/hadoop/sqoop/lib/commons-codec-1.4.jar:/home/hadoop/sqoop/lib/commons-compress-1.4.1.jar:/home/hadoop/sqoop/lib/commons-io-1.4.jar:/home/hadoop/sqoop/lib/commons-jexl-2.1.1.jar:/home/hadoop/sqoop/lib/commons-logging-1.1.1.jar:/home/hadoop/sqoop/lib/hsqldb-1.8.0.10.jar:/home/hadoop/sqoop/lib/jackson-annotations-2.3.0.jar:/home/hadoop/sqoop/lib/jackson-core-2.3.1.jar:/home/hadoop/sqoop/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/sqoop/lib/jackson-databind-2.3.1.jar:/home/hadoop/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/sqoop/lib/kite-data-core-1.0.0.jar:/home/hadoop/sqoop/lib/kite-data-hive-1.0.0.jar:/home/hadoop/sqoop/lib/kite-data-mapreduce-1.0.0.jar:/home/hadoop/sqoop/lib/kite-hadoop-compatibility-1.0.0.jar:/home/hadoop/sqoop/lib/mysql-connector-java-5.1.49-bin.jar:/home/hadoop/sqoop/lib/opencsv-2.3.jar:/home/hadoop/sqoop/lib/paranamer-2.3.jar:/home/hadoop/sqoop/lib/parquet-avro-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-column-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-common-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-encoding-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-format-2.0.0.jar:/home/hadoop/sqoop/lib/parquet-generator-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-hadoop-1.4.1.jar:/home/hadoop/sqoop/lib/parquet-jackson-1.4.1.jar:/home/hadoop/sqoop/lib/slf4j-api-1.6.1.jar:/home/hadoop/sqoop/lib/snappy-java-1.0.5.jar:/home/hadoop/sqoop/lib/xz-1.0.jar:/home/hadoop/hbase/conf:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.262.b10-0.el7_8.x86_64//lib/tools.jar:/home/hadoop/hbase:/home/hadoop/hbase/lib/activation-1.1.jar:/home/hadoop/hbase/lib/aopalliance-1.0.jar:/home/hadoop/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hbase/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hbase/lib/api-i18n-1.0.0-M20.jar:/home/hadoop/hbase/lib/api-util-1.0.0-M20.jar:/home/hadoop/hbase/lib/asm-3.1.jar:/home/hadoop/hbase/lib/avro-1.7.7.jar:/home/hadoop/hbase/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase/lib/commons-cli-1.2.jar:/home/hadoop/hbase/lib/commons-codec-1.9.jar:/home/hadoop/hbase/lib/commons-collections-3.2.2.jar:/home/hadoop/hbase/lib/commons-compress-1.4.1.jar:/home/hadoop/hbase/lib/commons-configuration-1.6.jar:/home/hadoop/hbase/lib/commons-daemon-1.0.13.jar:/home/hadoop/hbase/lib/commons-digester-1.8.jar:/home/hadoop/hbase/lib/commons-el-1.0.jar:/home/hadoop/hbase/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase/lib/commons-io-2.4.jar:/home/hadoop/hbase/lib/commons-lang-2.6.jar:/home/hadoop/hbase/lib/commons-lang3-3.8.1.jar:/home/hadoop/hbase/lib/commons-logging-1.2.jar:/home/hadoop/hbase/lib/commons-math-2.2.jar:/home/hadoop/hbase/lib/commons-math3-3.1.1.jar:/home/hadoop/hbase/lib/commons-net-3.1.jar:/home/hadoop/hbase/lib/curator-client-2.7.1.jar:/home/hadoop/hbase/lib/curator-framework-2.7.1.jar:/home/hadoop/hbase/lib/curator-recipes-2.7.1.jar:/home/hadoop/hbase/lib/disruptor-3.3.0.jar:/home/hadoop/hbase/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/hbase/lib/gson-2.2.4.jar:/home/hadoop/hbase/lib/guava-12.0.1.jar:/home/hadoop/hbase/lib/guice-3.0.jar:/home/hadoop/hbase/lib/guice-servlet-3.0.jar:/home/hadoop/hbase/lib/hadoop-annotations-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-auth-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-hdfs-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-app-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-core-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-api-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-nodemanager-2.7.4.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-client-1.4.13.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-examples-1.4.13.jar:/home/hadoop/hbase/lib/hbase-external-blockcache-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop2-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hbtop-1.4.13.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-metrics-1.4.13.jar:/home/hadoop/hbase/lib/hbase-metrics-api-1.4.13.jar:/home/hadoop/hbase/lib/hbase-prefix-tree-1.4.13.jar:/home/hadoop/hbase/lib/hbase-procedure-1.4.13.jar:/home/hadoop/hbase/lib/hbase-protocol-1.4.13.jar:/home/hadoop/hbase/lib/hbase-resource-bundle-1.4.13.jar:/home/hadoop/hbase/lib/hbase-rest-1.4.13.jar:/home/hadoop/hbase/lib/hbase-rsgroup-1.4.13.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-shaded-gson-3.0.0.jar:/home/hadoop/hbase/lib/hbase-shell-1.4.13.jar:/home/hadoop/hbase/lib/hbase-thrift-1.4.13.jar:/home/hadoop/hbase/lib/hive-hbase-handler-2.3.6.jar:/home/hadoop/hbase/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/hbase/lib/httpclient-4.5.2.jar:/home/hadoop/hbase/lib/httpcore-4.4.4.jar:/home/hadoop/hbase/lib/jackson-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jackson-core-2.9.10.jar:/home/hadoop/hbase/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hbase/lib/jackson-databind-2.9.10.1.jar:/home/hadoop/hbase/lib/jackson-jaxrs-base-2.9.10.jar:/home/hadoop/hbase/lib/jackson-jaxrs-json-provider-2.9.10.jar:/home/hadoop/hbase/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hbase/lib/jackson-module-jaxb-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jamon-runtime-2.4.1.jar:/home/hadoop/hbase/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase/lib/javax.inject-1.jar:/home/hadoop/hbase/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hbase/lib/jaxb-api-2.2.2.jar:/home/hadoop/hbase/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase/lib/jcodings-1.0.8.jar:/home/hadoop/hbase/lib/jersey-client-1.9.jar:/home/hadoop/hbase/lib/jersey-core-1.9.jar:/home/hadoop/hbase/lib/jersey-guice-1.9.jar:/home/hadoop/hbase/lib/jersey-json-1.9.jar:/home/hadoop/hbase/lib/jersey-server-1.9.jar:/home/hadoop/hbase/lib/jets3t-0.9.0.jar:/home/hadoop/hbase/lib/jettison-1.3.3.jar:/home/hadoop/hbase/lib/jetty-6.1.26.jar:/home/hadoop/hbase/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hbase/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase/lib/joni-2.1.2.jar:/home/hadoop/hbase/lib/jruby-complete-1.6.8.jar:/home/hadoop/hbase/lib/jsch-0.1.54.jar:/home/hadoop/hbase/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase/lib/junit-4.12.jar:/home/hadoop/hbase/lib/leveldbjni-all-1.8.jar:/home/hadoop/hbase/lib/libthrift-0.9.3-1.jar:/home/hadoop/hbase/lib/log4j-1.2.17.jar:/home/hadoop/hbase/lib/metrics-core-2.2.0.jar:/home/hadoop/hbase/lib/metrics-core-3.1.2.jar:/home/hadoop/hbase/lib/netty-all-4.1.8.Final.jar:/home/hadoop/hbase/lib/paranamer-2.3.jar:/home/hadoop/hbase/lib/protobuf-java-2.5.0.jar:/home/hadoop/hbase/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase/lib/servlet-api-2.5.jar:/home/hadoop/hbase/lib/slf4j-api-1.7.25.jar:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/hbase/lib/snappy-java-1.0.5.jar:/home/hadoop/hbase/lib/spymemcached-2.11.6.jar:/home/hadoop/hbase/lib/xmlenc-0.52.jar:/home/hadoop/hbase/lib/xz-1.0.jar:/home/hadoop/hbase/lib/zookeeper-3.4.10.jar:/home/hadoop/hadoop-2.8.5/etc/hadoop:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hadoop-auth-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hadoop-annotations-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-framework-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-digester-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/json-smart-1.3.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-common-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/common/hadoop-nfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-nfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/hdfs/hadoop-hdfs-client-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/fst-2.50.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/curator-test-2.7.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-tests-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-registry-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-client-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-api-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/hadoop-annotations-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.8.5.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-tests.jar:/home/hadoop/hadoop-2.8.5/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.5.jar:/home/hadoop/hadoop-2.8.5/contrib/capacity-scheduler/*.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13.jar:/home/hadoop/hbase/lib/hbase-protocol-1.4.13.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13.jar:/home/hadoop/hbase/lib/hbase-procedure-1.4.13.jar:/home/hadoop/hbase/lib/hbase-client-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop2-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-prefix-tree-1.4.13.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13.jar:/home/hadoop/hbase/lib/hbase-thrift-1.4.13.jar:/home/hadoop/hbase/lib/hbase-rest-1.4.13.jar:/home/hadoop/hbase/lib/hbase-shell-1.4.13.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13.jar:/home/hadoop/hbase/lib/hbase-examples-1.4.13.jar:/home/hadoop/hbase/lib/hbase-external-blockcache-1.4.13.jar:/home/hadoop/hbase/lib/jcodings-1.0.8.jar:/home/hadoop/hbase/lib/joni-2.1.2.jar:/home/hadoop/hbase/lib/guava-12.0.1.jar:/home/hadoop/hbase/lib/jersey-client-1.9.jar:/home/hadoop/hbase/lib/metrics-core-2.2.0.jar:/home/hadoop/hbase/lib/commons-logging-1.2.jar:/home/hadoop/hbase/lib/commons-cli-1.2.jar:/home/hadoop/hbase/lib/commons-math-2.2.jar:/home/hadoop/hbase/lib/commons-lang-2.6.jar:/home/hadoop/hbase/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/hbase/lib/hbase-rsgroup-1.4.13.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-core-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-common-2.7.4.jar:/home/hadoop/hbase/lib/servlet-api-2.5.jar:/home/hadoop/hbase/lib/guice-3.0.jar:/home/hadoop/hbase/lib/javax.inject-1.jar:/home/hadoop/hbase/lib/aopalliance-1.0.jar:/home/hadoop/hbase/lib/jersey-guice-1.9.jar:/home/hadoop/hbase/lib/avro-1.7.7.jar:/home/hadoop/hbase/lib/paranamer-2.3.jar:/home/hadoop/hbase/lib/snappy-java-1.0.5.jar:/home/hadoop/hbase/lib/hadoop-annotations-2.7.4.jar:/home/hadoop/hbase/lib/guice-servlet-3.0.jar:/home/hadoop/hbase/lib/hadoop-common-2.7.4.jar:/home/hadoop/hbase/lib/commons-math3-3.1.1.jar:/home/hadoop/hbase/lib/xmlenc-0.52.jar:/home/hadoop/hbase/lib/jets3t-0.9.0.jar:/home/hadoop/hbase/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hbase/lib/commons-configuration-1.6.jar:/home/hadoop/hbase/lib/commons-digester-1.8.jar:/home/hadoop/hbase/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase/lib/gson-2.2.4.jar:/home/hadoop/hbase/lib/jsch-0.1.54.jar:/home/hadoop/hbase/lib/curator-client-2.7.1.jar:/home/hadoop/hbase/lib/curator-recipes-2.7.1.jar:/home/hadoop/hbase/lib/commons-compress-1.4.1.jar:/home/hadoop/hbase/lib/xz-1.0.jar:/home/hadoop/hbase/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase/lib/commons-codec-1.9.jar:/home/hadoop/hbase/lib/commons-collections-3.2.2.jar:/home/hadoop/hbase/lib/protobuf-java-2.5.0.jar:/home/hadoop/hbase/lib/jersey-core-1.9.jar:/home/hadoop/hbase/lib/jersey-server-1.9.jar:/home/hadoop/hbase/lib/asm-3.1.jar:/home/hadoop/hbase/lib/commons-io-2.4.jar:/home/hadoop/hbase/lib/hbase-shaded-gson-3.0.0.jar:/home/hadoop/hbase/lib/zookeeper-3.4.10.jar:/home/hadoop/hbase/lib/jetty-6.1.26.jar:/home/hadoop/hbase/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hbase/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase/lib/jamon-runtime-2.4.1.jar:/home/hadoop/hbase/lib/netty-all-4.1.8.Final.jar:/home/hadoop/hbase/lib/disruptor-3.3.0.jar:/home/hadoop/hbase/lib/httpclient-4.5.2.jar:/home/hadoop/hbase/lib/httpcore-4.4.4.jar:/home/hadoop/hbase/lib/hadoop-auth-2.7.4.jar:/home/hadoop/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hbase/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hbase/lib/api-util-1.0.0-M20.jar:/home/hadoop/hbase/lib/curator-framework-2.7.1.jar:/home/hadoop/hbase/lib/hadoop-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-app-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-api-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-hdfs-2.7.4.jar:/home/hadoop/hbase/lib/commons-daemon-1.0.13.jar:/home/hadoop/hbase/lib/leveldbjni-all-1.8.jar:/home/hadoop/hbase/lib/jersey-json-1.9.jar:/home/hadoop/hbase/lib/jettison-1.3.3.jar:/home/hadoop/hbase/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase/lib/jaxb-api-2.2.2.jar:/home/hadoop/hbase/lib/activation-1.1.jar:/home/hadoop/hbase/lib/jackson-jaxrs-json-provider-2.9.10.jar:/home/hadoop/hbase/lib/jackson-jaxrs-base-2.9.10.jar:/home/hadoop/hbase/lib/jackson-module-jaxb-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jackson-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jackson-core-2.9.10.jar:/home/hadoop/hbase/lib/jackson-databind-2.9.10.1.jar:/home/hadoop/hbase/lib/commons-net-3.1.jar:/home/hadoop/hbase/lib/libthrift-0.9.3-1.jar:/home/hadoop/hbase/lib/slf4j-api-1.7.25.jar:/home/hadoop/hbase/lib/jruby-complete-1.6.8.jar:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-nodemanager-2.7.4.jar:/home/hadoop/hbase/lib/hbase-metrics-api-1.4.13.jar:/home/hadoop/hbase/lib/hbase-metrics-1.4.13.jar:/home/hadoop/hbase/lib/metrics-core-3.1.2.jar:/home/hadoop/hbase/lib/hbase-resource-bundle-1.4.13.jar:/home/hadoop/hbase/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hbase/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hbase/lib/hbase-hbtop-1.4.13.jar:/home/hadoop/hbase/lib/commons-lang3-3.8.1.jar:/home/hadoop/hbase/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/hbase/lib/log4j-1.2.17.jar:/home/hadoop/hbase/lib/junit-4.12.jar:/home/hadoop/hbase/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase/lib/commons-el-1.0.jar:/home/hadoop/hbase/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase/lib/api-i18n-1.0.0-M20.jar:/home/hadoop/hbase/lib/spymemcached-2.11.6.jar:/home/hadoop/hbase/lib/hive-hbase-handler-2.3.6.jar:/home/hadoop/sqoop/sqoop-1.4.6.jar:/home/hadoop/sqoop/sqoop-test-1.4.6.jar::/home/hadoop/hadoop-2.8.5/contrib/capacity-scheduler/*.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13-tests.jar:/home/hadoop/hbase/lib/hbase-annotations-1.4.13.jar:/home/hadoop/hbase/lib/hbase-protocol-1.4.13.jar:/home/hadoop/hbase/lib/hbase-common-1.4.13.jar:/home/hadoop/hbase/lib/hbase-procedure-1.4.13.jar:/home/hadoop/hbase/lib/hbase-client-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-hadoop2-compat-1.4.13.jar:/home/hadoop/hbase/lib/hbase-prefix-tree-1.4.13.jar:/home/hadoop/hbase/lib/hbase-server-1.4.13.jar:/home/hadoop/hbase/lib/hbase-thrift-1.4.13.jar:/home/hadoop/hbase/lib/hbase-rest-1.4.13.jar:/home/hadoop/hbase/lib/hbase-shell-1.4.13.jar:/home/hadoop/hbase/lib/hbase-it-1.4.13.jar:/home/hadoop/hbase/lib/hbase-examples-1.4.13.jar:/home/hadoop/hbase/lib/hbase-external-blockcache-1.4.13.jar:/home/hadoop/hbase/lib/jcodings-1.0.8.jar:/home/hadoop/hbase/lib/joni-2.1.2.jar:/home/hadoop/hbase/lib/guava-12.0.1.jar:/home/hadoop/hbase/lib/jersey-client-1.9.jar:/home/hadoop/hbase/lib/metrics-core-2.2.0.jar:/home/hadoop/hbase/lib/commons-logging-1.2.jar:/home/hadoop/hbase/lib/commons-cli-1.2.jar:/home/hadoop/hbase/lib/commons-math-2.2.jar:/home/hadoop/hbase/lib/commons-lang-2.6.jar:/home/hadoop/hbase/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/hbase/lib/hbase-rsgroup-1.4.13.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-core-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-common-2.7.4.jar:/home/hadoop/hbase/lib/servlet-api-2.5.jar:/home/hadoop/hbase/lib/guice-3.0.jar:/home/hadoop/hbase/lib/javax.inject-1.jar:/home/hadoop/hbase/lib/aopalliance-1.0.jar:/home/hadoop/hbase/lib/jersey-guice-1.9.jar:/home/hadoop/hbase/lib/avro-1.7.7.jar:/home/hadoop/hbase/lib/paranamer-2.3.jar:/home/hadoop/hbase/lib/snappy-java-1.0.5.jar:/home/hadoop/hbase/lib/hadoop-annotations-2.7.4.jar:/home/hadoop/hbase/lib/guice-servlet-3.0.jar:/home/hadoop/hbase/lib/hadoop-common-2.7.4.jar:/home/hadoop/hbase/lib/commons-math3-3.1.1.jar:/home/hadoop/hbase/lib/xmlenc-0.52.jar:/home/hadoop/hbase/lib/jets3t-0.9.0.jar:/home/hadoop/hbase/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hbase/lib/commons-configuration-1.6.jar:/home/hadoop/hbase/lib/commons-digester-1.8.jar:/home/hadoop/hbase/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase/lib/gson-2.2.4.jar:/home/hadoop/hbase/lib/jsch-0.1.54.jar:/home/hadoop/hbase/lib/curator-client-2.7.1.jar:/home/hadoop/hbase/lib/curator-recipes-2.7.1.jar:/home/hadoop/hbase/lib/commons-compress-1.4.1.jar:/home/hadoop/hbase/lib/xz-1.0.jar:/home/hadoop/hbase/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase/lib/commons-codec-1.9.jar:/home/hadoop/hbase/lib/commons-collections-3.2.2.jar:/home/hadoop/hbase/lib/protobuf-java-2.5.0.jar:/home/hadoop/hbase/lib/jersey-core-1.9.jar:/home/hadoop/hbase/lib/jersey-server-1.9.jar:/home/hadoop/hbase/lib/asm-3.1.jar:/home/hadoop/hbase/lib/commons-io-2.4.jar:/home/hadoop/hbase/lib/hbase-shaded-gson-3.0.0.jar:/home/hadoop/hbase/lib/zookeeper-3.4.10.jar:/home/hadoop/hbase/lib/jetty-6.1.26.jar:/home/hadoop/hbase/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hbase/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase/lib/jamon-runtime-2.4.1.jar:/home/hadoop/hbase/lib/netty-all-4.1.8.Final.jar:/home/hadoop/hbase/lib/disruptor-3.3.0.jar:/home/hadoop/hbase/lib/httpclient-4.5.2.jar:/home/hadoop/hbase/lib/httpcore-4.4.4.jar:/home/hadoop/hbase/lib/hadoop-auth-2.7.4.jar:/home/hadoop/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hbase/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hbase/lib/api-util-1.0.0-M20.jar:/home/hadoop/hbase/lib/curator-framework-2.7.1.jar:/home/hadoop/hbase/lib/hadoop-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-app-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-api-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-hdfs-2.7.4.jar:/home/hadoop/hbase/lib/commons-daemon-1.0.13.jar:/home/hadoop/hbase/lib/leveldbjni-all-1.8.jar:/home/hadoop/hbase/lib/jersey-json-1.9.jar:/home/hadoop/hbase/lib/jettison-1.3.3.jar:/home/hadoop/hbase/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase/lib/jaxb-api-2.2.2.jar:/home/hadoop/hbase/lib/activation-1.1.jar:/home/hadoop/hbase/lib/jackson-jaxrs-json-provider-2.9.10.jar:/home/hadoop/hbase/lib/jackson-jaxrs-base-2.9.10.jar:/home/hadoop/hbase/lib/jackson-module-jaxb-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jackson-annotations-2.9.10.jar:/home/hadoop/hbase/lib/jackson-core-2.9.10.jar:/home/hadoop/hbase/lib/jackson-databind-2.9.10.1.jar:/home/hadoop/hbase/lib/commons-net-3.1.jar:/home/hadoop/hbase/lib/libthrift-0.9.3-1.jar:/home/hadoop/hbase/lib/slf4j-api-1.7.25.jar:/home/hadoop/hbase/lib/jruby-complete-1.6.8.jar:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-client-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-common-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/hadoop/hbase/lib/hadoop-yarn-server-nodemanager-2.7.4.jar:/home/hadoop/hbase/lib/hbase-metrics-api-1.4.13.jar:/home/hadoop/hbase/lib/hbase-metrics-1.4.13.jar:/home/hadoop/hbase/lib/metrics-core-3.1.2.jar:/home/hadoop/hbase/lib/hbase-resource-bundle-1.4.13.jar:/home/hadoop/hbase/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hbase/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hbase/lib/hbase-hbtop-1.4.13.jar:/home/hadoop/hbase/lib/commons-lang3-3.8.1.jar:/home/hadoop/hbase/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/hbase/lib/log4j-1.2.17.jar:/home/hadoop/hbase/lib/junit-4.12.jar:/home/hadoop/hbase/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase/lib/commons-el-1.0.jar:/home/hadoop/hbase/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase/lib/api-i18n-1.0.0-M20.jar:/home/hadoop/hbase/lib/spymemcached-2.11.6.jar:/home/hadoop/hbase/lib/hive-hbase-handler-2.3.6.jar
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hadoop/hadoop-2.8.5/lib/native
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-1127.el7.x86_64
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:user.name=root
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Client environment:user.dir=/
20/11/14 10:17:31 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.140.132:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@51745f40
20/11/14 10:17:31 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.140.132/192.168.140.132:2181. Will not attempt to authenticate using SASL (unknown error)
20/11/14 10:17:32 INFO zookeeper.ClientCnxn: Socket connection established to 192.168.140.132/192.168.140.132:2181, initiating session
20/11/14 10:17:32 INFO zookeeper.ClientCnxn: Session establishment complete on server 192.168.140.132/192.168.140.132:2181, sessionid = 0x100000a0d0a0018, negotiated timeout = 40000
20/11/14 10:17:34 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
20/11/14 10:17:34 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x100000a0d0a0018
20/11/14 10:17:34 INFO zookeeper.ZooKeeper: Session: 0x100000a0d0a0018 closed
20/11/14 10:17:34 INFO zookeeper.ClientCnxn: EventThread shut down
20/11/14 10:17:34 WARN mapreduce.TableMapReduceUtil: The addDependencyJars(Configuration, Class<?>...) method has been deprecated since it is easy to use incorrectly. Most users should rely on addDependencyJars(Job) instead. See HBASE-8386 for more details.
20/11/14 10:17:35 INFO client.RMProxy: Connecting to ResourceManager at hadoop0/192.168.140.132:8032
Sat Nov 14 10:17:42 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
20/11/14 10:17:42 INFO db.DBInputFormat: Using read commited transaction isolation
20/11/14 10:17:42 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`help_keyword_id`), MAX(`help_keyword_id`) FROM `help_keyword`
20/11/14 10:17:42 INFO mapreduce.JobSubmitter: number of splits:4
20/11/14 10:17:42 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1605318874968_0002
20/11/14 10:17:44 INFO impl.YarnClientImpl: Submitted application application_1605318874968_0002
20/11/14 10:17:44 INFO mapreduce.Job: The url to track the job: http://hadoop0:8088/proxy/application_1605318874968_0002/
20/11/14 10:17:44 INFO mapreduce.Job: Running job: job_1605318874968_0002
20/11/14 10:17:59 INFO mapreduce.Job: Job job_1605318874968_0002 running in uber mode : false
20/11/14 10:17:59 INFO mapreduce.Job: map 0% reduce 0%
20/11/14 10:18:41 INFO mapreduce.Job: map 100% reduce 0%
20/11/14 10:18:44 INFO mapreduce.Job: Job job_1605318874968_0002 completed successfully
20/11/14 10:18:45 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=849212
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=511
HDFS: Number of bytes written=0
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=0
Job Counters
Launched map tasks=4
Other local map tasks=4
Total time spent by all maps in occupied slots (ms)=154070
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=154070
Total vcore-milliseconds taken by all map tasks=154070
Total megabyte-milliseconds taken by all map tasks=157767680
Map-Reduce Framework
Map input records=908
Map output records=908
Input split bytes=511
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=1328
CPU time spent (ms)=13830
Physical memory (bytes) snapshot=584810496
Virtual memory (bytes) snapshot=8428462080
Total committed heap usage (bytes)=186908672
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
20/11/14 10:18:45 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 70.4042 seconds (0 bytes/sec)
20/11/14 10:18:45 INFO mapreduce.ImportJobBase: Retrieved 908 records.
- 数据导出
与导入数据相反，导出（export）数据是将HDFS或Hive作为数据源，而将一个远程的数据库作为目标。
1.首先需要在MySQL中新建一张表来用于接收数据的目标表。
将之前导入的help_keyword表重新导入到一个新的MySQL表中，首先创建新的兼容的Mysql表。
create database sqooptest;
use database sqooptest;
create table sqoopexport(help_keyword_id int(10),name char(64));
2.执行导出的操作shell模版如下
sqoop export \
--connect jdbc:mysql://服务器地址[:端口号]/数据库名 \
--table 表名
--export-dir 要导出的数据文件路径
--input-fields-terminates-by ',' //这里设置的是文件中字段之间的分隔符
--username 数据库用户名
--password 数据库密码
实例命令
sqoop export \
--connect jdbc:mysql://hadoop0:3306/sqooptest \
--table sqoopexport \
--export-dir '/user/root/help_keyword/part-m-00000' \
--input-fields-terminates-by ',' \
--username root \
--password 123456
注意一点，每一个命令结束后要有空格，不然不被识别，会报错
结果如下：
[root@hadoop0 ~]# sqoop export --connect jdbc:mysql://hadoop0:3306/sqooptest --username root --password 123456 --table sqoopexport --export-dir '/user/root/help_keyword/part-m-00000' --input-fields-terminated-by ','
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
20/11/13 16:10:00 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/11/13 16:10:00 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
20/11/13 16:10:01 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
20/11/13 16:10:01 INFO tool.CodeGenTool: Beginning code generation
Fri Nov 13 16:10:01 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
20/11/13 16:10:03 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `sqoopexport` AS t LIMIT 1
20/11/13 16:10:03 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `sqoopexport` AS t LIMIT 1
20/11/13 16:10:03 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/hadoop-2.8.5
注: /tmp/sqoop-root/compile/9a531acf1769aac60053db8a78cdcd7f/sqoopexport.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
20/11/13 16:10:17 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/9a531acf1769aac60053db8a78cdcd7f/sqoopexport.jar
20/11/13 16:10:17 INFO mapreduce.ExportJobBase: Beginning export of sqoopexport
20/11/13 16:10:18 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/11/13 16:10:20 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
20/11/13 16:10:20 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
20/11/13 16:10:20 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/11/13 16:10:20 INFO client.RMProxy: Connecting to ResourceManager at hadoop0/192.168.140.132:8032
20/11/13 16:10:28 INFO input.FileInputFormat: Total input files to process : 1
20/11/13 16:10:28 INFO input.FileInputFormat: Total input files to process : 1
20/11/13 16:10:29 INFO mapreduce.JobSubmitter: number of splits:4
20/11/13 16:10:29 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
20/11/13 16:10:29 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1605252643608_0003
20/11/13 16:10:30 INFO impl.YarnClientImpl: Submitted application application_1605252643608_0003
20/11/13 16:10:30 INFO mapreduce.Job: The url to track the job: http://hadoop0:8088/proxy/application_1605252643608_0003/
20/11/13 16:10:30 INFO mapreduce.Job: Running job: job_1605252643608_0003
20/11/13 16:10:45 INFO mapreduce.Job: Job job_1605252643608_0003 running in uber mode : false
20/11/13 16:10:45 INFO mapreduce.Job: map 0% reduce 0%
20/11/13 16:11:00 INFO mapreduce.Job: map 50% reduce 0%
20/11/13 16:11:16 INFO mapreduce.Job: map 100% reduce 0%
20/11/13 16:11:16 INFO mapreduce.Job: Job job_1605252643608_0003 completed successfully
20/11/13 16:11:16 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=704072
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=25952
HDFS: Number of bytes written=0
HDFS: Number of read operations=19
HDFS: Number of large read operations=0
HDFS: Number of write operations=0
Job Counters
Launched map tasks=4
Data-local map tasks=4
Total time spent by all maps in occupied slots (ms)=79935
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=79935
Total vcore-milliseconds taken by all map tasks=79935
Total megabyte-milliseconds taken by all map tasks=81853440
Map-Reduce Framework
Map input records=908
Map output records=908
Input split bytes=616
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=340
CPU time spent (ms)=5070
Physical memory (bytes) snapshot=468115456
Virtual memory (bytes) snapshot=8369905664
Total committed heap usage (bytes)=121896960
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
20/11/13 16:11:16 INFO mapreduce.ExportJobBase: Transferred 25.3438 KB in 56.2046 seconds (461.7415 bytes/sec)
20/11/13 16:11:16 INFO mapreduce.ExportJobBase: Exported 908 records.
结果中显示一共导出908条数据。
导出成功后在mysql中可以查看到
use database sqooptest;
select count(*) from sqoopexport;
导出的表中也是908条数据。导出成功。
Sqoop 基本用法结束~~~
参考了博主“扎心了，老铁”的博文，感谢博主大大，附上链接https://www.cnblogs.com/qingyunzong/p/8807252.html#_label4_2
1万+
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
