1.1) 有问题程序的YARN服务 container 日志
yarn logs -applicationId <application_xxxxxxxxxxxxx_yyyy> -appOwner <user_name> > application_xxxxxxxxxxxxx_yyyy.log
1.2)有问题程序的MR JOB的 jhist 和 conf.xml文件
需要去HDFS下面找一下
sudo hdfs hdfs dfs -ls /user/history/done/
举个例子,运行一个MR小程序
hadoop jar /opt/cloudera/parcels/CDH/jars/hadoop-examples.jar pi 5 5
会有下面的文件
/user/history/done/2017/12/05/000000/job_1512490574798_0004-1512529857185-systest-QuasiMonteCarlo-1512529879420-5-1-SUCCEEDED-root.systest-1512529862064.jhist
/user/history/done/2017/12/05/000000/job_1512490574798_0004_conf.xm