hive on tez 调优

• etc/hadoop下的tez-site.xml调优

• <?xml version="1.0" encoding="UTF-8"?>
  <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
  <configuration>
  <property>
  <name>tez.lib.uris</name>
   <value>hdfs://mycluster/tez-0.10.1-SNAPSHOT.tar.gz</value>
  </property>
  <property>
   <name>tez.use.cluster.hadoop-libs</name>
   <value>true</value>
  </property>
  <property>
   <name>tez.am.resource.memory.mb</name>
   <value>1024</value>
  </property>
  <property>
   <name>tez.am.resource.cpu.vcores</name>
   <value>1</value>
  </property>
  <property>
   <name>tez.container.max.java.heap.fraction</name>
   <value>0.8</value>
  </property>
  <property>
   <name>tez.task.resource.memory.mb</name>
   <value>2048</value>
  </property>
  <property>
   <name>tez.task.resource.cpu.vcores</name>
   <value>2</value>
  </property>
  </configuration>

• tez.am.resource.memory.mb  设置am container大小
• 默认：1024
• 建议：小于等于yarn.scheduler.minimum-allocation-mb