hadoop3.1.1 完全分布式安装 hive-3.1.1

1、环境介绍

涉及到软件下载地址：https://pan.baidu.com/s/1hpcXUSJe85EsU9ara48MsQ

服务器：CentOS 6.8

JDK：jdk-8u191-linux-x64.tar.gz

hadoop：hadoop-3.1.1  

hadoop3.1.1 HA高可用分布式集群安装部署：https://www.cnblogs.com/lufan2008/p/10312085.html

hbase：hbase-2.0.4

hbase-2.0.4 完全分布式安装：https://www.cnblogs.com/lufan2008/p/10317322.html

hive：apache-hive-3.1.1-bin.tar.gz   其中：使用 mysql 作为 metastore

2、安装hive

#解压缩
tar -zxvf /usr/local/soft/apache-hive-3.1.1-bin.tar.gz -C /usr/local/

#修改目录名称
mv /usr/local/apache-hive-3.1.1-bin/ /usr/local/apache-hive-3.1.1

vim /etc/profile

#增加HIVE环境变量内容
export HIVE_HOME=/usr/local/apache-hive-3.1.1
export PATH=$PATH:$HIVE_HOME/bin
export CLASSPATH=$CLASSPATH:$HIVE_HOME/bin

使环境变量生效：source /etc/profile

vim /usr/local/apache-hive-3.1.1/conf/hive-env.sh

#增加内容
export HADOOP_HOME=/usr/local/hadoop-3.1.1
export HIVE_CONF_DIR=/usr/local/apache-hive-3.1.1/conf

vim /usr/local/apache-hive-3.1.1/conf/hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://192.168.67.1:3306/hadoop_hive_meta?allowMultiQueries=true&amp;useSSL=false&amp;verifyServerCertificate=false</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.cj.jdbc.Driver</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>数据库用户名</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>数据库密码</value>
    </property>
    <property>
        <name>datanucleus.readOnlyDatastore</name>
        <value>false</value>
    </property>
    <property>
        <name>datanucleus.fixedDatastore</name>
        <value>false</value>
    </property>
    <property>
        <name>datanucleus.autoCreateSchema</name>
        <value>true</value>
    </property>
    <property>
        <name>datanucleus.autoCreateTables</name>
        <value>true</value>
    </property>
    <property>
        <name>datanucleus.autoCreateColumns</name>
        <value>true</value>
    </property>
</configuration>

#将下载好的 mysql 驱动拷贝到hive的lib目录中
cp /usr/local/soft/mysql-connector-java-8.0.12.jar /usr/local/apache-hive-3.1.1/lib/

#在 mysql 服务器中新建空数据库 hadoop_hive_meta，跟 hive-site.xml 中配置的数据库名称一致
#首次启动初始化schema
schematool -dbType mysql -initSchema

3、验证

 

转载于:https://www.cnblogs.com/lufan2008/p/10314884.html