Container [pid=7204,containerID=container_1607355221856_0001_01_000002] is running beyond virtual me

最新推荐文章于 2023-11-29 23:08:32 发布
最新推荐文章于 2023-11-29 23:08:32 发布
阅读量2.2k 收藏 8
点赞数 9
分类专栏： Hadoop 文章标签： hadoop
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_43999048/article/details/110821175
版权

问题描述：

0/12/07 23:36:07 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.21.132:8032
20/12/07 23:36:12 INFO input.FileInputFormat: Total input paths to process : 1
20/12/07 23:36:13 INFO mapreduce.JobSubmitter: number of splits:1
20/12/07 23:36:14 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1607355221856_0001
20/12/07 23:36:16 INFO impl.YarnClientImpl: Submitted application application_1607355221856_0001
20/12/07 23:36:16 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1607355221856_0001/
20/12/07 23:36:16 INFO mapreduce.Job: Running job: job_1607355221856_0001



20/12/07 23:37:03 INFO mapreduce.Job: Job job_1607355221856_0001 running in uber mode : false
20/12/07 23:37:03 INFO mapreduce.Job:  map 0% reduce 0%
20/12/07 23:37:21 INFO mapreduce.Job:  map 100% reduce 0%
20/12/07 23:37:21 INFO mapreduce.Job: Task Id : attempt_1607355221856_0001_m_000000_0, Status : FAILED
Container [pid=7204,containerID=container_1607355221856_0001_01_000002] is running beyond virtual memory limits. Current usage: 53.3 MB of 1 GB physical memory used; 2.1 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1607355221856_0001_01_000002 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 7204 7202 7204 7204 (bash) 3 13 227827712 768 /bin/bash -c /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_0 2 1>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000002/stdout 2>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000002/stderr  
	|- 7208 7204 7204 7204 (java) 365 396 2067255296 12880 /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_0 2 

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

20/12/07 23:37:22 INFO mapreduce.Job:  map 0% reduce 0%
20/12/07 23:37:30 INFO mapreduce.Job: Task Id : attempt_1607355221856_0001_m_000000_1, Status : FAILED
Container [pid=7237,containerID=container_1607355221856_0001_01_000003] is running beyond virtual memory limits. Current usage: 77.4 MB of 1 GB physical memory used; 2.1 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1607355221856_0001_01_000003 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 7241 7237 7237 7237 (java) 585 279 2067902464 19041 /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000003/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000003 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_1 3 
	|- 7237 7235 7237 7237 (bash) 0 1 227827712 772 /bin/bash -c /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000003/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000003 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_1 3 1>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000003/stdout 2>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000003/stderr  

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

20/12/07 23:37:37 INFO mapreduce.Job: Task Id : attempt_1607355221856_0001_m_000000_2, Status : FAILED
Container [pid=6822,containerID=container_1607355221856_0001_01_000004] is running beyond virtual memory limits. Current usage: 61.0 MB of 1 GB physical memory used; 2.1 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1607355221856_0001_01_000004 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 6822 6819 6822 6822 (bash) 1 5 227827712 765 /bin/bash -c /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000004/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000004 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_2 4 1>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000004/stdout 2>/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000004/stderr  
	|- 6826 6822 6822 6822 (java) 239 388 2067853312 14846 /opt/java/jdk1.8/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx200m -Djava.io.tmpdir=/opt/tmp/nm-local-dir/usercache/master/appcache/application_1607355221856_0001/container_1607355221856_0001_01_000004/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/hadoop/hadoop2/logs/userlogs/application_1607355221856_0001/container_1607355221856_0001_01_000004 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.21.134 42851 attempt_1607355221856_0001_m_000000_2 4 

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

20/12/07 23:37:45 INFO mapreduce.Job:  map 100% reduce 100%
20/12/07 23:37:46 INFO mapreduce.Job: Job job_1607355221856_0001 failed with state FAILED due to: Task failed task_1607355221856_0001_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

20/12/07 23:37:46 INFO mapreduce.Job: Counters: 16
	Job Counters 
		Failed map tasks=4
		Killed reduce tasks=1
		Launched map tasks=4
		Other local map tasks=3
		Data-local map tasks=1
		Total time spent by all maps in occupied slots (ms)=30090
		Total time spent by all reduces in occupied slots (ms)=0
		Total time spent by all map tasks (ms)=30090
		Total time spent by all reduce tasks (ms)=0
		Total vcore-milliseconds taken by all map tasks=30090
		Total vcore-milliseconds taken by all reduce tasks=0
		Total megabyte-milliseconds taken by all map tasks=30812160
		Total megabyte-milliseconds taken by all reduce tasks=0
	Map-Reduce Framework
		CPU time spent (ms)=0
		Physical memory (bytes) snapshot=0
		Virtual memory (bytes) snapshot=0

解决：

Container [pid=7237,containerID=container_1607355221856_0001_01_000003] is running beyond virtual memory limits.：Yarn容器虚拟内存率不足：
修改Hadoop_HOME/etc/hadoop/yarn-site.xml文件

<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>3.0</value>
</property>
Flink 异常 - 11.单台 Container 内存异常增加导致 Container 被 kill 排查
BITDDD小栈
10-24 1897
Flink running beyond physical memory limits Container 被 kill 问题分析与排查。
Container killed on request. Exit code is 143_Permission denied: user=dr.who, a---Hadoop3.x启动报错记录001
添柴程序猿的专栏
02-24 425
Permission denied: user=dr.who, access=WRITE, inode="/":root:supergroup:drwxr-xr-x 这个错误。Permission denied: user=dr.who, access=WRITE, inode="/":root:supergroup:drwxr-xr-x 这个错误。这里的关键就是配置这个静态用户为自己的用户,这个配置好了,就可以删除了.在hdfs网页端删除某个文件,文件夹的时候,报错,说当前使用66.9MB。
Hadoop运行程序的时候在日志里发现的错误
qq_38147044的博客
10-27 804
在日志里发现下面这个错误 [2021-10-26 19:47:45.029]Container [pid=8097,containerID=container_1635247229913_0031_01_000003] is running 274078208B beyond the 'VIRTUAL' memory limit. Current usage: 153.1 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory us
Container被kill beyond the ‘VIRTUAL‘ memory limit. Current usage: 308.2 MB of 1 GB physical memory us
最新发布
weixin_53359823的博客
11-29 483
【代码】Container被kill beyond the ‘VIRTUAL‘ memory limit. Current usage: 308.2 MB of 1 GB physical memory us。
记一次MR报错：Container is running beyond physical memory limits,Current usage...
热门推荐
Abysscarry的博客
05-16 1万+
背景： 使用sqoop将公司数仓（mysql-myisam架构）中的mysql表导出为Hive表，遇到如下错误（之前也遇到过，但没有记录，本次着重记录下）（集群为CDH5.13.0） 1、详细错误记录 注：从上往下慢慢看下去会有收获的！ Warning: /home/cdh/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../l...
Hadoop运行过程中错误解决
Xlucas的博客
10-08 581
错误信息：Container [pid=64555,containerID=container_1563447435119_3196879_01_000107] is running beyond physical memory limits. Current usage: 3.4 GB of 3 GB physical memory used; 5.2 GB of 12.6 GB virtual...
Container [pid=7082,containerID=container_1686138374771_0002_01_000003] is running 294541824B beyond the 'VIRTUAL' memory limit. Current usage: 57.9 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory used. Killing container
06-08
这个错误提示是由于一个容器（Container）运行时超出了其虚拟内存（virtual memory）的限制。在这个例子中，容器使用了2.4 GB的虚拟内存，超过了2.1 GB的限制，因此被系统强制终止。虚拟内存是操作系统中的一种机制...
怎么解决Container [pid=7082,containerID=container_1686138374771_0002_01_000003] is running 294541824B beyond the 'VIRTUAL' memory limit. Current usage: 57.9 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory used. Killing container
06-08
要解决这个问题，可以考虑以下几个方法： 1. 调整容器的内存限制：可以通过增加容器的内存限制来解决这个问题，让容器能够使用更多的内存。可以通过Docker等容器管理工具来进行设置。 2. 优化程序的内存使用：可以...
遇到问题---hive---数据仓库---Container ... is running beyond physical memory limits
直到世界的尽头
03-02 3814
情况 我们跑一个hive的动态分区insert overwrite时最后报错如下: Container [pid=39398,containerID=container_1511338430452_0073_01_009567] is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical me...
Container [pid=108284,containerID=container_e19_1533108188813_12125_01_000002] is running beyond vir
qq_41622603的博客
10-01 831
Yarn容器虚拟内存率不足： 修改Hadoop_HOME/etc/hadoop/yarn-site.xml文件，加入下面代码，如果还是提示不足的话可以把value改大点 <property> <name>yarn.nodemanager.vmem-pmem-ratio</name> <value>3.0</value> </property> ...
Diagnostics: Exception from container-launch
lming_08技术博客
05-09 1万+
16/05/09 11:02:14 INFO mapreduce.Job: Job job_1459494184870_43303 failed with state FAILED due to: Application application_1459494184870_43303 failed 1 times due to AM Container for appattempt_14594941
hadoop 启动 报running beyond virtual memory错误的解决
健康平安的活着的专栏
01-04 866
报错日志： [2019-01-04 11:05:50.749]Container [pid=7247,containerID=container_1546564651505_0001_01_000002] is running 219036160B beyond the 'VIRTUAL' memory limit. Current usage: 37.6 MB of 1 GB physical...
hadoop报错Container is running beyond memory limits
civil的专栏
04-11 3102
写在前面 在我们运行hive时，有时会报内存使用超过了限制的异常，内容如下： Container [pid=18578,containerID=container_e29_1554258701746_2799_01_000007] is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical me...
大数据-异常解决记录
itman_cx的博客
12-28 1680
资源问题 yarn资源被占用 报内存不足 Container [pid=8468,containerID=container_1594198338753_0001_01_000002] is running 318740992B beyond the 'VIRTUAL' memory limit. Current usage: 111.5 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory used. Killing cont
虚拟内存限制问题
weixin_44854027的博客
07-02 465
虚拟内存限制问题: 错误: [2020-07-18 16:35:28.310]Container [pid=2711,containerID=container_1595061096107_0001_01_000002] is running 332302848B beyond the ‘VIRTUAL’ memory limit. Current usage: 167.8 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory us
Hadoop运行因为container的内存大小而抛错
LibsKnowledge的博客
11-09 6696
本文转载自：http://blog.chinaunix.net/uid-25691489-id-5587957.html Hadoop运行中抛出如下异常： Container [pid=41355,containerID=container_1451456053773_0001_01_000002] is running beyond physical memory limits. Curr
spark报错集锦
farbeyonds的博客
05-29 1571
1.spark报错信息： org.apache.spark.SparkException: Job aborted due to stage failure: Task 5 in stage 2.0 failed 4 times, most recent failure: Lost task 5.3 in stage 2.0 (TID 227, dhpnm236-192-064, executor 25): ExecutorLostFailure (executor 25 exited caused b
pyspark报错寻找解决方案
Neon Light 的博客
12-21 4810
pyspark玄学问题spark报错问题怎么找？spark报错问题原因怎么找？spark报错问题解决方案怎么找？ 报错后就调spark conf 的参数，感觉太玄学了 一般都吧问题原因归结到oom，解决就调大内存，调大partitions spark报错问题怎么找？ 看 spark UI 提供的报错 log 日志 # type1 ExecutorLostFailure (executor 3 exited caused by one of the running tasks) Reason: Contain
Linux内核宏container_of详解：实现原理与应用深度解析
本文将深入剖析Linux内核中的container_of宏，一个在驱动开发中广泛应用的重要工具。container_of宏的主要作用是在只提供一个指向结构体成员的指针时，通过这个成员找到整个结构体的地址。这对于理解Linux内核源码和...
评论 8
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值