hive-2.1.0 on tez-0.9.0

tez安装

1、把apache-tez-0.9.0-bin.tar.gz上传/usr/local/下

cd /usr/local/

tar -zxvf apache-tez-0.9.0-bin.tar.gz

2、在hdfs上创建文件并上传tez.tar.gz

hdfs dfs -mkdir -p /usr/tez

hdfs dfs -put tez.tar.gz /user/tez/

3、配置tez-site.xml

在hadoop_home/etc/hadoop/下创建tez-site.xml配置文件

vim tez-site.xml
<configuration>
  <property>
    <name>tez.lib.uris</name>
    <value>${fs.defaultFS}/user/tez/tez.tar.gz</value>
  </property>
<!--因为内存不足添加，可以不加-->
  <property>
    <name>tez.container.max.java.heap.fraction</name>
    <value>0.2</value>
  </property>
</configuration>

4、环境变量配置/etc/profile

export TEZ_CONF_DIR=$HADOOP_CONF_DIR

export TEZ_JARS=/usr/local/tez-0.9.0-bin/*:/usr/local/tez-0.9.0=bin/lib/*

export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$HADOOP_CLASSPATH

source /etc/profile 环境变量生效

5、解决Hadoop版本兼容性问题

cd  tez-0.9.0-bin/lib

rm -rf hadoop-mapreduce-client-core-2.7.0.jar hadoop-mapreduce-client-common-2.7.0.jar
cp  /opt/hadoop-2.7.6/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.6.jar  /usr/local/tez-0.9.0-bin/lib/
cp /opt/hadoop-2.7.6/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.6.jar  /usr/local/tez-0.9.0-bin/lib/

启动Hive

hive
hive>set hive.execution.engine=tez;