hive数据写入ES报错

最新推荐文章于 2023-06-06 17:07:34 发布

badbeat

最新推荐文章于 2023-06-06 17:07:34 发布

阅读量2.7k

点赞数 1

分类专栏：数据仓库 hive 文章标签： hive es

本文链接：https://blog.csdn.net/caojian107/article/details/94469609

版权

在尝试通过插件将Hive数据存入ES时遇到执行错误，报错信息包括MapReduce任务失败、无法解析字段[teacher_name]。经过分析，发现错误可能与字段[teacher_name]有关，通过固定该字段的值或者去除其中的中文和英文空格解决了问题。此案例强调了读取并理解错误日志对于解决问题的重要性。

摘要由CSDN通过智能技术生成

使用插件，将hive中的数据存入ES，在向映射表中更新数据的时候报错：

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-3: Map: 1 Reduce: 1 Cumulative CPU: 4.75 sec HDFS Read: 1214122 HDFS Write: 1093402 SUCCESS Stage-Stage-6: Map: 1 Reduce: 1 Cumulative CPU: 8.87 sec HDFS Read: 34826 HDFS Write: 77342 SUCCESS Stage-Stage-7: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 13 seconds 620 msec 2019-06-26 16:16:51.502 [main] ERROR c.a.e.f.a.j.l.impl.CommonShellJobLauncherImpl - [FJI-F5EAACDAFBBBA154_0] Failed to execute command, exit code=2 2019-06-26 16:16:51.503 [main] INFO c.a.e.f.a.j.l.impl.CommonShellJobLauncherImpl - [FJI-F5EAACDAFBBBA154_0.0] Finished command line, exit code=2. Wed Jun 26 16:16:51 CST 2019 [JobLauncherRunner] INFO Closing job launcher ... 2019-06-26 16:16:51.505 [main] INFO c.a.emr.flow.agent.jobs.launcher.JobLauncherBase - [FJI-F5EAACDAFBBBA154_0] Closing ... 2019-06-26 16:16:51.505 [main] INFO c.a.e.f.a.j.l.impl.CommonShellJobLauncherImpl - [FJI-F5EAACDAFBBBA154_0] Stopping command executor ... Wed Jun 26 16:16:51 CST 2019 [YarnJobLauncherAM] INFO Closing launcher am ... Wed Jun 26 16:16:51 CST 2019 [YarnJobLauncherAM] INFO Emr flow launcher is quit. Exception in thread "main" java.lang.reflect.Unde