集群崩溃处理

在 mapred-site.xml 中添加如下内容

<!-- 是否对容器强制执行虚拟内存限制 -->
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
<description>Whether virtual memory limits will be enforced for
containers</description>
</property>
<!-- 为容器设置内存限制时虚拟内存与物理内存之间的比率 -->
<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>5</value>
<description>Ratio between virtual memory to physical memory when
setting memory limits for containers</description>
</property>

在 yarn-site.xml 中添加如下内容

<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2048</value>
<description>default value is 1024</description>
</property>

scp传给其他虚拟机

scp mapred-site.xml root@bigdata005:/opt/softs/hadoop3.1.3/etc/hadoop/
                                   
scp mapred-site.xml root@bigdata006:/opt/softs/hadoop3.1.3/etc/hadoop/
                                    
scp yarn-site.xml root@bigdata006:/opt/softs/hadoop3.1.3/etc/hadoop/   
                                             
scp yarn-site.xml root@bigdata005:/opt/softs/hadoop3.1.3/etc/hadoop/

重启集群