container is running 9441280B beyond the ‘PHYSICAL‘ memory limit问题处理

报错：

[2021-08-09 16:10:02.211]Container [pid=92799,containerID=container_e01_1625131199794_0236_01_000005] is running 9441280B beyond the ‘PHYSICAL’ memory limit. Current usage: 1.0 GB of 1 GB physical memory used; 2.5 GB of 2.1 GB virtual memory used. Killing container. Dump of the process-tree for container_e01_1625131199794_0236_01_000005 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 92799 92797 92799 92799 (bash) 0 0 9797632 288 /bin/bash -c /usr/java/jdk1.8.0_291/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Djava.net.preferIPv4Stack=true -Xmx820m -Djava.io.tmpdir=/data/yarn/nm/usercache/hive/appcache/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/data/yarn/container-logs/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 172.16.51.6 7902 attempt_1625131199794_0236_m_000000_0 1099511627781 1>/data/yarn/container-logs/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005/stdout 2>/data/yarn/container-logs/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005/stderr |- 92828 92799 92799 92799 (java) 1967 53 2712313856 264161 /usr/java/jdk1.8.0_291/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Djava.net.preferIPv4Stack=true -Xmx820m -Djava.io.tmpdir=/data/yarn/nm/usercache/hive/appcache/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/data/yarn/container-logs/application_1625131199794_0236/container_e01_1625131199794_0236_01_000005 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 172.16.51.6 7902 attempt_1625131199794_0236_m_000000_0 1099511627781 [2021-08-09 16:10:02.244]Container killed on request. Exit code is 143 [2021-08-09 16:10:02.249]Container exited with a non-zero exit code 143.

调整以下两个参数

两个默认1024M，通常不够用，可以改成4G：

mapreduce.map.memory.mb
mapreduce.reduce.memory.mb