问题:java.lang.Exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found
准备插入一张表staff,在Linux中输入以下命令
bin/sqoop import \
--connect jdbc:mysql://hadoop102:3306/company?useSSL=false \
--username root \
--password 123456 \
--table staff \
--target-dir /user/company \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "/t"
但是却发现以下报错
2021-08-02 19:22:17,688 WARN mapred.LocalJobRunner: job_local429534774_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:492)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:552)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2638)
at org.apache.sqoop.mapreduce.db.DBConfiguration.getInputClass(DBConfiguration.java:403)
at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.createDBRecordReader(DataDrivenDBInputFormat.java:237)
at org.apache.sqoop.mapreduce.db.DBInputFormat.createRecordReader(DBInputFormat.java:263)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:527)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: Class staff not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2542)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2636)
... 12 more
2021-08-02 19:22:18,572 INFO mapreduce.Job: Job job_local429534774_0001 running in uber mode : false
2021-08-02 19:22:18,573 INFO mapreduce.Job: map 0% reduce 0%
2021-08-02 19:22:18,574 INFO mapreduce.Job: Job job_local429534774_0001 failed with state FAILED due to: NA
2021-08-02 19:22:18,578 INFO mapreduce.Job: Counters: 0
2021-08-02 19:22:18,581 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2021-08-02 19:22:18,582 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 1.731 seconds (0 bytes/sec)
2021-08-02 19:22:18,582 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2021-08-02 19:22:18,582 INFO mapreduce.ImportJobBase: Retrieved 0 records.
2021-08-02 19:22:18,582 ERROR tool.ImportTool: Error during import: Import job failed!
报错原因:sqoop import命令时,java文件会默认产生在当前目录下,.jar文件和.class文件会默认存放在/tmp/sqoop-(你的用户名)/compile下,因此找不到jar包。
解决办法1:
文件夹内.jar包、.java和.class文件拷贝至sqoop/lib目录下即可,如果临时文件夹太多可以删除所有,然后再跑一遍命令,再找到新生成的临时文件夹。
解决办法2:
–bindir 指定生成的Java文件编译成的class文件及将生成文件打包为jar的文件输出路径,这样省去未来手动导入jar包问题。
示例代码:
bin/sqoop import \
--connect jdbc:mysql://hadoop102:3306/company?useSSL=false \
--username root \
--password 123456 \
--table staff \
--target-dir /user/company \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "/t" \
--bindir /opt/module/sqoop/lib
ps:路径放在sqoop目录或者sqoop/lib目录都可以
修改完路径后跑第一遍依然出现找不到类的报错,此时还没有生成相关文件,将命令重复再跑一次就行了。
数据已成功上传。