Hadoop beyond the ‘VIRTUAL‘ memory limit.问题解决

错误：

Container [pid=95788,containerID=container_1645494729047_0005_01_000002] is running 249903616B beyond the 'VIRTUAL' memory limit. Current usage: 65.4 MB of 1 GB physical memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.

解决：
1、在/opt/module/hadoop-3.1.4/etc/hadoop/下的mapred-site.xml中添加如下配置

[root@hadoop102 hadoop-3.1.3]# vim etc/hadoop/yarn-site.xml 
[root@hadoop102 hadoop-3.1.3]# xsync etc/hadoop/yarn-site.xml 

    <property>
    <!-- 是否对容器强制执行虚拟内存限制 -->
        <name>yarn.nodemanager.vmem-check-enabled</name>
        <value>false</value>
        <description>Whether virtual memory limits will be enforced for containers</description>
    </property>
    <property>
    <!-- 为容器设置内存限制时虚拟内存与物理内存之间的比率 -->
        <name>yarn.nodemanager.vmem-pmem-ratio</name>
        <value>4</value>
        <description>Ratio between virtual memory to physical memory when setting memory limits for containers</description>
    </property>

重启yarn

[root@hadoop103 sbin]# stop-yarn.sh
[root@hadoop103 sbin]# start-yarn.sh