电商数仓3.0 业务数据模块之Hive安装

资料

参考博客：https://blog.csdn.net/qq_40180229/article/details/104858967
链接：https://pan.baidu.com/s/1V554UcEuawYl9J7VQmEqMA
提取码：506m

添加环境变量

[scorpion@warehouse102 module]$ sudo vim /etc/profile.d/env.sh
#HIVE_HOME
export HIVE_HOME=/opt/module/hive-3.1.2
export PATH=$PATH:$HIVE_HOME/bin

// source一下
[scorpion@warehouse102 module]$ source /etc/profile.d/env.sh

解决日志Jar包冲突

[scorpion@warehouse102 module]$ cd /opt/module/hive-3.1.2/lib/
[scorpion@warehouse102 lib]$ mv log4j-slf4j-impl-2.10.0.jar log4j-slf4j-impl-2.10.0.jar.bak

Hive元数据配置MySQL

// 拷贝驱动
[scorpion@warehouse102 07_mysql]$ cp ./mysql-connector-java-5.1.48.jar /opt/module/hive-3.1.2/lib/

// 配置Metastore到MySQL，在Hive-3.1.2/conf目录下新建hive-site.xml文件
[scorpion@warehouse102 conf]$ vim hive-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://warehouse102:3306/metastore?useSSL=false</value>
    </property>

    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.jdbc.Driver</value>
    </property>

    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>root</value>
    </property>

    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>000000</value>
    </property>

    <property>
        <name>hive.metastore.warehouse.dir</name>
        <value>/user/hive/warehouse</value>
    </property>

    <property>
        <name>hive.metastore.schema.verification</name>
        <value>false</value>
    </property>

    <property>
    <name>hive.server2.thrift.port</name>
    <value>10000</value>
    </property>

    <property>
        <name>hive.server2.thrift.bind.host</name>
        <value>warehouse102</value>
    </property>

    <property>
        <name>hive.metastore.event.db.notification.api.auth</name>
        <value>false</value>
    </property>
    
    <property>
        <name>hive.cli.print.header</name>
        <value>true</value>
    </property>

    <property>
        <name>hive.cli.print.current.db</name>
        <value>true</value>
    </property>
</configuration>

初始化元数据库

// 登录mysql
[scorpion@warehouse102 conf]$ mysql -uroot -p000000

// 新建hive元数据库
mysql> create database metastore;
mysql> quit;

// 初始化Hive源数据库
[scorpion@warehouse102 conf]$ schematool -initSchema -dbType mysql -verbose

启动Hive客户端

[scorpion@warehouse102 hive-3.1.2]$ bin/hive

// 查看已有数据库 
hive (default)> show databases;