hive安装Tez计算引擎

环境

CentOS 7

hive 1.2.1

apache-tez-0.9.1

安装步骤

1. 上传taz到hdfs中

   hadoop fs -mkdir /tez
   hadoop fs -put apache-tez-0.9.1-bin.tar.gz /tez
   

2. 解压缩

   tar -zxvf apache-tez-0.9.1-bin.tar.gz -C /opt
   

3. 修改名称

   mv /opt/apache-tez-0.9.1-bin /opt/tez-0.9.1
   

4. 在hive/conf目录下创建tez-site.xml

   <?xml version="1.0" encoding="UTF-8"?>
   <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
   <configuration>
   <property>
   	<name>tez.lib.uris</name>
       <value>${fs.defaultFS}/tez/apache-tez-0.9.1-bin.tar.gz</value>
   </property>
   <property>
        <name>tez.use.cluster.hadoop-libs</name>
        <value>true</value>
   </property>
   <property>
        <name>tez.history.logging.service.class</name>        <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value>
   </property>
   </configuration>
   
   

5. 在hive/conf/hive-env.sh文件中添加tez环境变量配置和依赖包环境变量配置 添加如下配置

   # Set HADOOP_HOME to point to a specific hadoop install directory
   export HADOOP_HOME=/opt/hadoop-2.7.2
   
   # Hive Configuration Directory can be controlled by:
   export HIVE_CONF_DIR=/opt/hive-1.2.1/conf
   
   # Folder containing extra libraries required for hive compilation/execution can be controlled by:
   export TEZ_HOME=/opt/tez-0.9.1    #是你的tez的解压目录
   export TEZ_JARS=""
   for jar in `ls $TEZ_HOME |grep jar`; do
       export TEZ_JARS=$TEZ_JARS:$TEZ_HOME/$jar
   done
   for jar in `ls $TEZ_HOME/lib`; do
       export TEZ_JARS=$TEZ_JARS:$TEZ_HOME/lib/$jar
   done
   
   export HIVE_AUX_JARS_PATH=/opt/hadoop-2.7.2/share/hadoop/common/hadoop-lzo-0.4.20.jar$TEZ_JARS
   
   

6. 修改hive计算引擎 编辑hive/conf/hive-site.xml 添加如下配置

   <property>
       <name>hive.execution.engine</name>
       <value>tez</value>
   </property>