用sqoop把hdfs传到mysql报错:ERROR mapreduce.ExportJobBase: Export job failed! 2020-07-21 20:38:06,879 ERROR

用sqoop把hdfs传到mysql报错

2020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1595291661620_0009
2020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Executing with tokens: []
2020-07-21 20:37:37,301 INFO conf.Configuration: resource-types.xml not found
2020-07-21 20:37:37,302 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2020-07-21 20:37:37,509 INFO impl.YarnClientImpl: Submitted application application_1595291661620_0009
2020-07-21 20:37:37,582 INFO mapreduce.Job: The url to track the job: http://node7-1:8088/proxy/application_1595291661620_0009/
2020-07-21 20:37:37,583 INFO mapreduce.Job: Running job: job_1595291661620_0009
2020-07-21 20:37:49,086 INFO mapreduce.Job: Job job_1595291661620_0009 running in uber mode : false
2020-07-21 20:37:49,090 INFO mapreduce.Job:  map 0% reduce 0%
2020-07-21 20:38:04,405 INFO mapreduce.Job:  map 25% reduce 0%
2020-07-21 20:38:05,542 INFO mapreduce.Job:  map 100% reduce 0%
2020-07-21 20:38:06,581 INFO mapreduce.Job: Job job_1595291661620_0009 failed with state FAILED due to: Task failed task_1595291661620_0009_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0

2020-07-21 20:38:06,836 INFO mapreduce.Job: Counters: 13
	Job Counters 
		Failed map tasks=1
		Killed map tasks=3
		Launched map tasks=4
		Other local map tasks=1
		Data-local map tasks=3
		Total time spent by all maps in occupied slots (ms)=50529
		Total time spent by all reduces in occupied slots (ms)=0
		Total time spent by all map tasks (ms)=50529
		Total vcore-milliseconds taken by all map tasks=50529
		Total megabyte-milliseconds taken by all map tasks=51741696
	Map-Reduce Framework
		CPU time spent (ms)=0
		Physical memory (bytes) snapshot=0
		Virtual memory (bytes) snapshot=0
2020-07-21 20:38:06,857 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2020-07-21 20:38:06,863 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 38.3936 seconds (0 bytes/sec)
2020-07-21 20:38:06,871 INFO mapreduce.ExportJobBase: Exported 0 records.
2020-07-21 20:38:06,872 ERROR mapreduce.ExportJobBase: Export job failed!
2020-07-21 20:38:06,879 ERROR tool.ExportTool: Error during export: 
Export job failed!
	at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445)
	at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
	at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
	at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
	at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

解决方法

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 7
    评论
2023-06-10 06:10:14,356 INFO mapreduce.Job: Job job_1686300831839_0056 failed with state FAILED due to: Task failed task_1686300831839_0056_m_000001 Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0 2023-06-10 06:10:14,536 INFO mapreduce.Job: Counters: 9 Job Counters Failed map tasks=1 Killed map tasks=3 Launched map tasks=4 Data-local map tasks=4 Total time spent by all maps in occupied slots (ms)=20374 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=20374 Total vcore-milliseconds taken by all map tasks=20374 Total megabyte-milliseconds taken by all map tasks=20862976 2023-06-10 06:10:14,561 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead 2023-06-10 06:10:14,566 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 19.7479 seconds (0 bytes/sec) 2023-06-10 06:10:14,582 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead 2023-06-10 06:10:14,582 INFO mapreduce.ExportJobBase: Exported 0 records. 2023-06-10 06:10:14,582 ERROR mapreduce.ExportJobBase: Export job failed! 2023-06-10 06:10:14,585 ERROR tool.ExportTool: Error during export: Export job failed! at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445) at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931) at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80) at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
06-11

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 7
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值