问题:
向桶表中插入数据出现异常,错误日志如下:
Exception in thread "Thread-25" java.lang.RuntimeException: Error while reading from task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:240)
at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:227)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:92)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://liaozhongmin:50060/tasklog?taskid=attempt_201501231449_0050_m_000000_0&start=-8193
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
at java.net.URL.openStream(URL.java:1010)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:192)
... 3 more
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 1 Reduce: 4 HDFS Read: 0 HDFS Write: 0 FAIL关键看Caused by:
http://liaozhongmin:50060/tasklog?taskid=attempt_201501231449_0050_m_000000_0&start=-8193
我们可以通过这个URL快速定位到具体错误,方法是将taskid改为appemptid,如下:
http://liaozhongmin:50060/tasklog?attemptid=attempt_201501231449_0050_m_000000_0&start=-8193
然后再把修改后的URL贴到浏览器中,比如我这里:
然后再根据具体的错误去解决问题!
在向Hive桶表插入数据时遇到异常,日志中的URL(http://liaozhongmin:50060/tasklog?taskid=attempt_201501231449_0050_m_000000_0&start=-8193)可用于定位错误。将taskid替换为attemptid,如http://liaozhongmin:50060/tasklog?attemptid=attempt_201501231449_0050_m_000000_0&start=-8193,然后在浏览器中打开,以便进一步分析和解决错误。
83

被折叠的 条评论
为什么被折叠?



