今天搭建hive on tez 报错误
Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdow
n. Application application_1565763986535_0001 failed 2 times due to AM Container for appattempt_1565763986535_0001_000002 exited with exitCode: -103
经查找资料知道这种问题是从机上运行的Container试图使用过多的内存,而被NodeManager kill掉了。找到解决办法有两种:
方案一:或者是关掉虚拟内存检查。我们选这个,修改yarn-site.xml
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
方案二:mapred-site.xml中设置Map和Reduce任务的内存配置如下:(value中实际配置的内存需要根据自己机器内存大小及应用情况进行修改)
<property>
<name>mapreduce.map.memory.mb</name>
<value>1536</value>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx2048M</value>
</property>
<property>
<name>mapreduce.reduce.memory.mb</name>
<value>3072</value>
</property>
<property>
<name>mapreduce.reduce.java.opts</name>
<value>-Xmx2560M</value>
</property>