sqoop版本:Sqoop 1.4.6-cdh5.7.6
sqoop往mysql导出数据报错:
21/06/09 17:31:19 ERROR tool.ExportTool: Error during export:
Export job failed!
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:442)
at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
查看日志为:
排查为hive表为orc格式, 查阅资料后修改命令如下:
sqoop export \
--hcatalog-database di_qc_test \
--hcatalog-table dsw_profile_psi \
--hcatalog-partition-keys day \
--hcatalog-partition-values ronghui_lys_score \
--connect jdbc:mysql://10.21.33.28:3306/test_dushw \
--username root \
--password techp1234java \
--table dsw_profile_psi \
-m 1
注意:mysql表和hive表结构应一致,mysql表结构需提前存在
测试成功