1.oozie调动任务时,出现10020 failed on connection exception
解决:当oozie调度任务时要连接hadoop的jobhistory服务,10020是jobhistory服务的端口。检查hadoop的jobhistory服务是否
已经启动。如果没启动到目录/data/app/hadoop-2.7.7/sbin下使用mr-jobhistory-daemon.sh start historyserver启动。启动后使用jps命令可以看到JobHistoryServer的服务
2.oozie调度shell任务时,报错:java.io.IOException: Cannot run program "catch.sh" (in directory "/home/yarn/nm/usercache/root/appcache/application_1534405855130_0022/container_1534405855130_0022_01_000002"): error=2, 没有那个文件或目录
解决:在hue添加shell任务时,指定要运行脚本的路径就可以了
3.oozie任务运行后,查看日志显示:Aggregation is not enabled. Try the nodemanager at hadoop-slave03:36405
默认如果不配置yarn.log-aggregation-enable。yarn的job结束后日志就被删除了
解决:在yarn-site.xml中添加如下配置:
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
<property>
<name>yarn.log-aggregation.retain-seconds</name>
<value>604800</value>
</property>
配置后,重启yarn,命令:stop-yarn.sh start-yarn.sh 重启日志历史服务:mr-jobhistory-daemon.sh start historyserver