MapTask虚拟内存不足

运行时报错信息：

Backend error message
---------------------
AttemptID:attempt_1431928337591_3554_m_000000_0 Info:Container killed by the ApplicationMaster.




Backend error message
---------------------
AttemptID:attempt_1431928337591_3554_r_000000_0 Info:Container [pid=27045,containerID=container_1431928337591_3554_01_000003]is running beyond virtual memory limits. Current usage: 279.4 Mb of 1 Gb physical memory used; 2.1 Gb of 2.1 Gb virtual memory used. Killing container.
Dump of the process-tree for container_1431928337591_3554_01_000003 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
|- 27161 27045 27045 27045 (python) 8 4 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller4116299268763144752.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27092 27045 27045 27045 (python) 9 4 89120768 1352 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller933383721664018631.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27171 27045 27045 27045 (python) 10 4 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller1555483680648943237.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27045 7565 27045 27045 (java) 782 60 673775616 47721 /opt/tools/jdk1.7.0_55/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Djava.io.tmpdir=/opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.mapreduce.container.log.dir=/opt/hadoop-2.0.3/logs/userlogs/application_1431928337591_3554/container_1431928337591_3554_01_000003 -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 10.21.3.123 36319 attempt_1431928337591_3554_r_000000_0 3 
|- 27156 27045 27045 27045 (python) 10 6 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller4456590137329453990.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27096 27045 27045 27045 (python) 8 3 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller3137945478526729844.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27146 27045 27045 27045 (python) 9 5 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller7909695520288780235.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27176 27045 27045 27045 (python) 9 3 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller6260584468054939558.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27116 27045 27045 27045 (python) 8 3 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller4444572104258260691.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27106 27045 27045 27045 (python) 10 4 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller441485797742554560.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27151 27045 27045 27045 (python) 9 4 89120768 1322 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller4599895247010829264.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27126 27045 27045 27045 (python) 10 5 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller5466846372554765475.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27141 27045 27045 27045 (python) 9 3 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller3724334134307788323.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27166 27045 27045 27045 (python) 9 4 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller8669644849879965761.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27136 27045 27045 27045 (python) 8 5 89120768 1320 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller3632538291767121925.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27131 27045 27045 27045 (python) 9 3 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller2774910788234131744.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27101 27045 27045 27045 (python) 8 4 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller7969523543243898959.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27111 27045 27045 27045 (python) 8 4 89120768 1322 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller8429460955928455854.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
|- 27121 27045 27045 27045 (python) 8 3 89120768 1321 python /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/controller8576683611955451276.py extract_action1_num /opt/tools/pig-udfs get_number_by_action /opt/hadoop-2.0.3/tmp/hadoop-root/nm-local-dir/usercache/root/appcache/application_1431928337591_3554/container_1431928337591_3554_01_000003/tmp/opt/tools/pig-udfs /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.out /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action.err /opt/hadoop-2.0.3/logs/userlogs/get_number_by_action_python.log false 
蓝色部分指出了报错的原因，主要是因为单个MapTask超出了最大内存2.1G，这时可以调整yarn-site.xml的yarn.nodemanager.vmem-pmem-ratio，我修改为3.1，即为默认map(1G)的3.1倍

yarn-site.xml配置

<property>
        <name>yarn.nodemanager.vmem-pmem-ratio</name>
        <value>3.1</value>
    </property>

    更多了解：Yarn简单介绍及内存配置