错误
Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1602825966780_0008 failed 2 times due to AM Container for appattempt_1602825966780_0008_000002 exited with exitCode: -103
For more detailed output, check application tracking page:http://zjj102:8088/cluster/app/application_1602825966780_0008Then, click on link s to logs of each attempt.
Diagnostics: Container [pid=9668,containerID=container_1602825966780_0008_02_000001] is running beyond virtual memory limits. Current usag e: 83.5 MB of 1 GB physical memory used; 2.6 GB of 2.1 GB virtual memory used. Killing container.
大概意思是内存不足了…
解决办法就是修改 yarn的
hadoop-2.7.2/etc/hadoop/yarn-site.xml
<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>3.0</value>
</property>
指定一下内存,上面指定三个G,
然后重启ResourceManager 和NodeManager 即可解决问题.