一、环境介绍
- 集群环境
IP | 主机名 |
---|---|
192.168.205.60 | master |
192.168.205.65 | slave1 |
192.168.205.66 | slave2 |
二、安装Hive
- 下载软件包
#Master
cd /usr/local/src
wget http://mirror.bit.edu.cn/apache/hive/hive-1.2.2/apache-hive-1.2.2-bin.tar.gz
tar zxvf apache-hive-1.2.2-bin.tar.gz
mv apache-hive-1.2.2-bin /usr/local/
- 修改Hive配置文件
#Master
cd /usr/local/apache-hive-1.2.2-bin/conf
vim hive.xml
<configuration>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://master:3306/hive?createDatabaseIfNotExist=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hadoop</value>
</property>
</configuration>
- 增加环境变量
#Master、Slave1、Slave2三台机器要一致,建议使用rsync推送保持一致。
vim /etc/profile
export HIVE_HOME=/usr/local/apache-hive-1.2.2-bin
export PATH=$HIVE_HOME/bin:$PATH
#刷新环境变量
source /etc/profile
- 安装MySQL(如果不是安装在Master机器,那么要修改hive.xml中的数据库IP和密码)
(1)Docker安装(推荐)
docker run -p 3306:3306 --name docker_mysql5.7 -v /opt/mysql/conf/my.cnf:/etc/my.cnf -v /opt/mysql/data:/var/lib/mysql/ -e MYSQL_ROOT_PASSWORD=123456 -d mysql:5.7
(2)编译安装(新手推荐)
#Master
yum -y install mysql-server
chkconfig --add mysql
service mysqld start
#配置MySQL Root用户密码
mysqladmin -uroot password hadoop
- 安装MySQL连接工具
(1)yum安装
yum install -y mysql-connector-java.noarch
#复制连接库文件
cp /usr/share/java/mysql-connector-java.jar /usr/local/apache-hive-1.2.2-bin/lib
(2)编译安装
#Master
1)下载安装包
wget https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.44.tar.gz
tar zxvf mysql-connector-java-5.1.44.tar.gz
2)复制连接库文件
cp mysql-connector-java-5.1.44/mysql-connector-java-5.1.44-bin.jar /usr/local/apache-hive-1.2.2-bin/lib
- 拷贝安装包和环境变量
(1)Ansible
#Hive包同步
ansible Vmware -m synchronize -a 'src=/usr/local/apache-hive-1.2.2-bin dest=/usr/local'
#变量配置文件同步
ansible Vmware -m synchronize -a 'src=/etc/profile dest=/etc/'
(2)Rsync
#Hive包同步
rsync -avuz /usr/local/apache-hive-1.2.2-bin slave1:/usr/local/
rsync -avuz /usr/local/apache-hive-1.2.2-bin slave2:/usr/local/
#变量配置文件同步
rsync -avuz /etc/profile slave1:/etc/
rsync -avuz /etc/profile slave2:/etc/
- 启动Hive服务
#Master
[root@master conf]# hive
Logging initialized using configuration in jar:file:/usr/local/apache-hive-1.2.2-bin/lib/hive-common-1.2.2.jar!/hive-log4j.properties
hive>