sqoop同步时间戳到mysql_Sqoop将MySQL的表数据同步到HDFS（三）设置压缩

[root@centos02 bin]#sqoop import --connect jdbc:mysql://centos02:3306/OfficialCashMid --driver com.mysql.cj.jdbc.Driver --username root --password sa123_ADMIN. --table tadminoperationlog --m 2 --target-dir /jdbcHDFS/TAdminLog_txt_snappy --compress --compression-codec org.apache.hadoop.io.compress.SnappyCodec --fields-terminated-by '\t'

Warning: /opt/bigdata/sqoop/sqoop-1.4.7/../hbase does not exist!HBase imports will fail.

Please set$HBASE_HOMEto the root of your HBase installation.

Warning:/opt/bigdata/sqoop/sqoop-1.4.7/../hcatalog does not exist!HCatalog jobs will fail.

Please set$HCAT_HOMEto the root of your HCatalog installation.

Warning:/opt/bigdata/sqoop/sqoop-1.4.7/../accumulo does not exist!Accumulo imports will fail.

Please set$ACCUMULO_HOMEto the root of your Accumulo installation.

Warning:/opt/bigdata/sqoop/sqoop-1.4.7/../zookeeper does not exist!Accumulo imports will fail.

Please set$ZOOKEEPER_HOMEto the root of your Zookeeper installation.19/09/04 01:32:14 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7

19/09/04 01:32:14 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.19/09/04 01:32:14 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.19/09/04 01:32:14 INFO manager.SqlManager: Using default fetchSize of 1000

19/09/04 01:32:14INFO tool.CodeGenTool: Beginning code generation19/09/04 01:32:16 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tadminoperationlog AS t WHERE 1=0

19/09/04 01:32:16 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tadminoperationlog AS t WHERE 1=0

19/09/04 01:32:16 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/bigdata/hadoop/hadoop-2.8.5注:/tmp/sqoop-root/compile/af712eaf4c137b07c33ec387e44fbbd0/tadminoperationlog.java使用或覆盖了已过时的 API。

注: 有关详细信息, 请使用-Xlint:deprecation 重新编译。19/09/04 01:32:18 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/af712eaf4c137b07c33ec387e44fbbd0/tadminoperationlog.jar19/09/04 01:32:18INFO mapreduce.ImportJobBase: Beginning import of tadminoperationlog19/09/04 01:32:18INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar19/09/04 01:32:18 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tadminoperationlog AS t WHERE 1=0

19/09/04 01:32:20INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps19/09/04 01:32:20 INFO client.RMProxy: Connecting to ResourceManager at centos02/192.168.122.1:8032

19/09/04 01:32:27INFO db.DBInputFormat: Using read commited transaction isolation19/09/04 01:32:27INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(FID), MAX(FID) FROM tadminoperationlog19/09/04 01:32:27 INFO db.IntegerSplitter: Split size: 16058; Num splits: 2 from: 21 to: 32138

19/09/04 01:32:28 INFO mapreduce.JobSubmitter: number of splits:2

19/09/04 01:32:28 INFO mapreduce.JobSubmitter: Submitting tokens forjob: job_1567503661837_000819/09/04 01:32:29INFO impl.YarnClientImpl: Submitted application application_1567503661837_000819/09/04 01:32:29 INFO mapreduce.Job: The url to track the job: http://centos02:8088/proxy/application_1567503661837_0008/

19/09/04 01:32:29INFO mapreduce.Job: Running job: job_1567503661837_000819/09/04 01:32:40 INFO mapreduce.Job: Job job_1567503661837_0008 running in uber mode : false

19/09/04 01:32:40 INFO mapreduce.Job: map 0% reduce 0%

19/09/04 01:33:18 INFO mapreduce.Job: map 100% reduce 0%

19/09/04 01:33:20INFO mapreduce.Job: Job job_1567503661837_0008 completed successfully19/09/04 01:33:20 INFO mapreduce.Job: Counters: 30File System Counters

FILE: Number of bytes read=0FILE: Number of bytes written=357726FILE: Number of read operations=0FILE: Number of large read operations=0FILE: Number of write operations=0HDFS: Number of bytes read=206HDFS: Number of bytes written=353086HDFS: Number of read operations=8HDFS: Number of large read operations=0HDFS: Number of write operations=4Job Counters

Launched map tasks=2Other local map tasks=2Total time spent by all mapsin occupied slots (ms)=70808Total time spent by all reducesin occupied slots (ms)=0Total time spent by all map tasks (ms)=70808Total vcore-milliseconds taken by all map tasks=70808Total megabyte-milliseconds taken by all map tasks=72507392Map-Reduce Framework

Map input records=12122Map output records=12122Input split bytes=206Spilled Records=0Failed Shuffles=0Merged Map outputs=0GC time elapsed (ms)=382CPU time spent (ms)=14060Physical memory (bytes) snapshot=374837248Virtual memory (bytes) snapshot=4287746048Total committed heap usage (bytes)=192937984File Input Format Counters

Bytes Read=0File Output Format Counters

Bytes Written=353086

19/09/04 01:33:20 INFO mapreduce.ImportJobBase: Transferred 344.8105 KB in 60.7307 seconds (5.6777 KB/sec)19/09/04 01:33:20 INFO mapreduce.ImportJobBase: Retrieved 12122records.

[root@centos02 bin]#