大数据开发遇到的问题

1. mapreduce卡在mapreduce.Job: Running job

查看日志
cat logs/yarn-resourcemanager.local.log

WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start

解决：

vi etc/hadoop/yarn-site.xml

 <property>
  <!--用于磁盘空间检查，低于某一值时，会导致mapreduce无法正常运行-->
  <name>yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage</name>
  <value>99</value>
 </property>