Hive本文主要介绍在之前搭建的集群基础上安装的详细过程。
实验环境
hive版本:apache-hive-2.3.0-bin.tar.gz
hadoop: hadoop-2.7.3(请提前安装)
安装hive
上传hive文件到/hasoft
解压命令:tar -zxvf apache-hive-2.3.0-bin.tar.gz
配置环境变量
命令: vi /etc/profile
export HIVE_HOME=/hasoft/apache-hive-2.3.0-bin
export PATH=${HIVE_HOME}/bin:$PATH
配置生效
命令:source /etc/profile
安装mysql
详情参考 MYSQL安装文档
设置开机启动
命令: chkconfig mysql on
安装mysql客户端
命令: yum install -y mysql-connector-java
将mysql connector拷贝到hive的lib包中
命令: cp /usr/share/java/mysql-connector-java.jar /hasoft/apache-hive-2.3.0-bin/lib
数据库在mysql上创建hive元,创建hive账号,并进行授权
命令: mysql -u root -p
进入mysql后依次执行以下命令:
create database if not exists hive_metadata;
grant all privileges on hive_metadata.* to 'hive'@'%' identified by 'hive';
grant all privileges on hive_metadata.* to 'hive'@'localhost' identified by 'hive';
grant all privileges on hive_metadata.* to 'hive'@'sparkproject1' identified by 'hive';
flush privileges;
use hive_metadata;
配置文件
配置hive-site.xml
cd /hasoft/apache-hive-2.3.0-bin/conf
mkdir ../tmp
cp hive-default.xml.template hive-site.xml
vi hive-site.xml
执行以下VI命令(替换临时文件地址):
:%s#${system:java.io.tmpdir}#/hasoft/apache-hive-2.3.0-bin/tmp
修改以下属性内容:
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://ha1.ry600.com:3306/hive_metadata?createDatabaseIfNotExist=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive</value>
</property>
配置hive-env.sh
cp hive-env.sh.template hive-env.sh
配置hive-env.sh
vi hive-env.sh
export JAVA_HOME=/hasoft/jdk1.8.0_131
export HIVE_HOME=/hasoft/apache-hive-2.3.0-bin
export HADOOP_HOME=/hasoft/hadoop-2.7.3
修复jar包版本冲突:
cd /hasoft/hadoop-2.7.3/share/hadoop/yarn/lib
mv jline-0.9.94.jar jline-0.9.94.jar.bak
cd /hasoft/apache-hive-1.2.2-bin/lib
cp jline-2.12.jar /hasoft/hadoop-2.6.4/share/hadoop/yarn/lib
测试hive是否安装成功
首先上传users.txt文件到/hasoft/tmpfile
users.txt内容格式如下:
1 adas
2 ladkda
3 hahah
4 kissyou
5 wan
6 nnds
然后启动hive
命令: hive
*如果报2784行有错,就在此添加
create table users(id int, name string) row format delimited fields terminated by ' ';
load data local inpath '/hasoft/tmpfile/users.txt' into table users;
select * from users;
select name from users;
如果中间不提示有误并且得到如下查询,这说明hive安装成功。
退出命令:exit