使用sqoop将mysql数据上传至hdfs出现找不到类的问题

问题：java.lang.Exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found

准备插入一张表staff，在Linux中输入以下命令

bin/sqoop import \
--connect jdbc:mysql://hadoop102:3306/company?useSSL=false \
--username root \
--password 123456 \
--table staff \
--target-dir /user/company \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "/t"

但是却发现以下报错

2021-08-02 19:22:17,688 WARN mapred.LocalJobRunner: job_local429534774_0001
java.lang.Exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:492)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:552)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class staff not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2638)
	at org.apache.sqoop.mapreduce.db.DBConfiguration.getInputClass(DBConfiguration.java:403)
	at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.createDBRecordReader(DataDrivenDBInputFormat.java:237)
	at org.apache.sqoop.mapreduce.db.DBInputFormat.createRecordReader(DBInputFormat.java:263)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:527)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: Class staff not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2542)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2636)
	... 12 more
2021-08-02 19:22:18,572 INFO mapreduce.Job: Job job_local429534774_0001 running in uber mode : false
2021-08-02 19:22:18,573 INFO mapreduce.Job:  map 0% reduce 0%
2021-08-02 19:22:18,574 INFO mapreduce.Job: Job job_local429534774_0001 failed with state FAILED due to: NA
2021-08-02 19:22:18,578 INFO mapreduce.Job: Counters: 0
2021-08-02 19:22:18,581 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2021-08-02 19:22:18,582 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 1.731 seconds (0 bytes/sec)
2021-08-02 19:22:18,582 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2021-08-02 19:22:18,582 INFO mapreduce.ImportJobBase: Retrieved 0 records.
2021-08-02 19:22:18,582 ERROR tool.ImportTool: Error during import: Import job failed!

报错原因：sqoop import命令时，java文件会默认产生在当前目录下，.jar文件和.class文件会默认存放在/tmp/sqoop-（你的用户名）/compile下，因此找不到jar包。

解决办法1：

文件夹内.jar包、.java和.class文件拷贝至sqoop/lib目录下即可，如果临时文件夹太多可以删除所有，然后再跑一遍命令，再找到新生成的临时文件夹。

解决办法2：

–bindir    指定生成的Java文件编译成的class文件及将生成文件打包为jar的文件输出路径，这样省去未来手动导入jar包问题。

 示例代码：

bin/sqoop import \
--connect jdbc:mysql://hadoop102:3306/company?useSSL=false \
--username root \
--password 123456 \
--table staff \
--target-dir /user/company \
--delete-target-dir \
--num-mappers 1 \
--fields-terminated-by "/t" \
--bindir /opt/module/sqoop/lib

ps：路径放在sqoop目录或者sqoop/lib目录都可以

修改完路径后跑第一遍依然出现找不到类的报错，此时还没有生成相关文件，将命令重复再跑一次就行了。

数据已成功上传。