基于Hadoop-2.7.7、MySQL5.7的Hive安装文档

OS	Hadoop集群版本	MySQL
CentOS 7	Hadoop-2.7.7	MySQL 5.7

1 上传安装包

[yao@master ~]$ rz
  
[yao@master ~]$ ls
apache-hive-1.2.1-bin.tar.gz  hadoop-2.7.7         mysql-connector-java-5.1.40-bin.jar  t2.jar
Desktop                       hadoop-2.7.7.tar.gz  Pictures                             t3.jar
Documents                     hadoopdata           Public                               t4.jar
dou.jar                       hw.txt               README.txt                           Templates
dou.txt                       kong.jar             sort.txt                             Videos
Downloads                     Music                t1.jar                               word.txt

2 安装MySql

切换到root用户

2.1 净化MySQL环境

2.1.1 检查是否安装过mysql

[root@master yao]# rpm -qa | grep -i mysql

如果以前安装过，那么需要卸载MySQL相关文件。

2.1.2 分别卸载

2.1.3 删除MySQL相应文件

2.2 安装MySQL

2.2.1 下载MySQL的yum源

[root@master yao]# wget http://dev.mysql.com/get/mysql57-community-release-el7-7.noarch.rpm

2.2.2 查看下载源中包含的rpm包

[root@master yao]# rpm -qpl mysql57-community-release-el7-7.noarch.rpm

2.2.3 安装rpm包

[root@master yao]# rpm -ivh mysql57-community-release-el7-7.noarch.rpm

2.2.4 安装MySQL

[root@master yao]# yum install -y mysql-community-server

2.2.5 获取临时密码

• 启动mysqld服务

[root@master log]# /bin/systemctl start mysqld.service

• 查找初始密码

[root@master log]# grep "password" /var/log/mysqld.log
2019-03-20T08:37:33.612845Z 1 [Note] A temporary password is generated for root@localhost: ;okvftI*h9Jl 

2.2.6 设置密码

1. 登录

[root@master log]# mysql -uroot -p
Enter password:

2. 设置安全级别

mysql> set global validate_password_policy=0;

3. 设置密码长度

mysql> set global validate_password_length=4;

4. 设置密码

mysql> set password=password('1234');

2.3 配置MySQL

2.3.1 创建数据库

mysql> create database hive;

2.3.2 创建hadoop用户

mysql> grant all on *.* to hadoop@'%' identified by "hadoop";
mysql> grant all on *.* to hadoop@'localhost' identified by 'hadoop';
mysql> grant all on *.* to hadoop@'master' identified by 'hadoop';
mysql> flush privileges;

3 安装Hive

切换到普通用户下

3.1 解压Hive安装包

[yao@master ~]$ tar -zxvf apache-hive-1.2.1-bin.tar.gz

3.2 配置参数文件

在conf目录下创建新文件hive-site.xml

[yao@master ~]$ cd apache-hive-1.2.1-bin/conf/
[yao@master conf]$ vi hive-site.xml

添加内容：

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hive.metastore.local</name>      //刚刚创建的数据库名称
        <value>true</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
         <value>jdbc:mysql://master:3306/hive?characterEncoding=UTF-8</value>      //要连接的节点的locolhost
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.jdbc.Driver</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>hadoop</value>			//用户名
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>hadoop</value>			//密码
    </property>
</configuration>

3.3 添加依赖包

将驱动driver的jar包添加到hive里

[yao@master conf]$ cd ../lib/
[yao@master lib]$ pwd
/home/yao/apache-hive-1.2.1-bin/lib
[yao@master lib]$ cp /home/yao/mysql-connector-java-5.1.40-bin.jar ./

3.4 配置环境变量

[yao@master lib]$ cd
[yao@master ~]$ vi .bash_profile

[yao@master ~]$ source .bash_profile

4 启动并验证Hive

4.1 启动Hive

[yao@master ~]$ hive