java子进程错误码_错误：java.lang.RuntimeException: PipeMapRed.waitOutputThreads（）：子进程失败，代码为1，工作正常...

我在每一个论坛上都搜索过这个错误，但没有运气。我得到以下错误：18/08/29 00:24:53 INFO mapreduce.Job: map 0% reduce 0%

18/08/29 00:24:59 INFO mapreduce.Job: Task Id : attempt_1535105716146_0226_m_000000_0, Status : FAILED

Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1

at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)

at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)

at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)

at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)

at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)

at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)

at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)

at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

18/08/29 00:25:45 INFO mapreduce.Job: Task Id : attempt_1535105716146_0226_r_000000_2, Status : FAILED

Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1

at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)

at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:538)

at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:134)

at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:454)

at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:393)

at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)

at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

18/08/29 00:25:52 INFO mapreduce.Job: map 100% reduce 100%

18/08/29 00:25:53 INFO mapreduce.Job: Job job_1535105716146_0226 failed with state FAILED due to: Task failed task_1535105716146_0226_r_000000

Job failed as tasks failed. failedMaps:0 failedReduces:1 killedMaps:0 killedReduces: 0

18/08/29 00:25:53 ERROR streaming.StreamJob: Job not successful!

Streaming Command Failed!

在python独立命令的帮助下，我也尝试了map reduce代码

^{pr2}$

代码运行得非常好。但是当我尝试通过Hadoop流媒体时，它反复抛出上述错误。我的输入文件大小是3KB。我也尝试过运行Hadoop流式处理命令，但是没有成功！我还在脚本的顶部添加了#!/usr/bin/python命令。目录里什么也没有。我也尝试过不同版本的命令：

版本1：hadoop jar /usr/hdp/3.0.0.0-1634/hadoop-mapreduce/hadoop-streaming-3.1.0.3.0.0.0-1634.jar -Dmapred.reduce.tasks=1 -file /home/mapper.py -mapper mapper.py -file /home/reducer.py -reducer reducer.py -input /data/studentMapReduce/student1.txt -output outputMapReduceFile.txt

版本2：带有单引号和双引号的python命令hadoop jar /usr/hdp/3.0.0.0-1634/hadoop-mapreduce/hadoop-streaming-3.1.0.3.0.0.0-1634.jar -Dmapred.reduce.tasks=1 -file /home/mapper.py -mapper "python mapper.py" -file /home/reducer.py -reducer "python reducer.py" -input /data/studentMapReduce/student1.txt -output outputMapReduceFile.txt

简单的字数统计程序在环境上成功运行，也生成正确的输出，但当我添加mysql.connector然后Hadoop流式处理报告这个错误。我也研究了工作日志，但没有找到这样的信息。在