Hive安装笔记

最新推荐文章于 2021-09-18 00:03:21 发布

Tao_J

最新推荐文章于 2021-09-18 00:03:21 发布

阅读量620

点赞数

分类专栏： hadoop

本文链接：https://blog.csdn.net/xssjtt/article/details/40224993

版权

hadoop 专栏收录该内容

4 篇文章 0 订阅

订阅专栏

1. 安装mysql

准备好MySQL安装包：

执行如下命令：

sudo rpm -e--nodeps mysql

yum list | grep mysql

sudo yum install -y mysql-server mysqlmysql-deve

为root用户设置密码：

mysqladmin -u root password 'root'

然后可以使用root账号登录MySQL数据库，进行管理：

mysql -u root -p

输入密码登录成功。

MySQL数据库中创建数据库，名称为hive，并进行访问授权：

CREATE DATABASE hive;

GRANT ALL ON hive.* TO 'hive'@'%' IDENTIFIEDBY 'hive';

FLUSH PRIVILEGES;

2. 下载hvie

下载地址：http://archive.cloudera.com/cdh5/cdh/5/

取得版本为：hive-0.12.0-cdh5.0.0.tar.gz

3. 创建hive用户（已有hadoop组）

执行如下命令：

useradd -ghadoop -m hive

4. 把Hive移动到/home/hive目录下并解压，重命名

执行如下命令：

   tar -zxvf  hive-0.12.0-cdh5.0.0.tar.gz

    mv hive-0.12.0-cdh5.0.0 hive5

5. 用root用户给hive5授权

执行如下命令：

   chown -R hive:hadoop hive5

6. 在hive用户下添加环境变量

  执行如下命令：

  su - hive

   vim .profile

   在.profile文件中添加如下内容：

   export HADOOP_HOME=/home/hdfs/bch

   export HIVE_HOME=/home/hive/hive5

   export PATH=$PATH:$HIVE_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

7. 配置 Hive 配置文件

a、配置hive-env.sh

在/home/hive/hive5/conf目录下，如果没有hive-env.sh文件，则cp hive-env.sh.template hive-env.sh

如果有hive-env.sh文件，则在该文件修改如下内容：

HADOOP_HOME=/home/hdfs/bch

export HIVE_CONF_DIR=/home/hive/hive5/conf

b、配置hive-default.xml 和 hive-site.xml

        在“/home/hive/hive5/conf”目录下,没有这两个文件,只有一个“hive-default.xml.template”,

   所以我们要复制两个“hive-default.xml.template”,并分别命名为“hive-default.xml”和“hive-site.xml”

   因为我们当前是 root 用户,所以还要把两个的文件的授权给 hadoop 用户。

       执行如下命令：

       cp hive-default.xml.template hive-default.xml

        chown -R hive:hadoop hive-default.xml

        cp hive-default.xml.template hive-site.xml

        chown -R hive:hadoop hive-site.xml

   备注: “hive-default.xml”用于保留默认配置,“hive-site.xml”用于个性化配置,可覆盖默认配置。

       hive-site.xml内容如下（将hive-site.xml配置文件拆为如下两部分 ）：

（1）、服务端配置文件

<?xml version="1.0"?>
<?xml-stylesheettype="text/xsl" href="configuration.xsl"?>
 
<configuration>
 <property>
   <name>hive.metastore.warehouse.dir</name>
   <value>/hive/warehouse</value>
 </property>
 
 <property>
   <name>hive.querylog.location</name>
   <value>/home/hive/hive5/logs</value>
 </property>
 
<!-- temparary sql data  -->  
 <property>
   <name>hive.exec.scratchdir</name>
   <value>/home/hive/hive5/data</value>
 </property>
<!--
DEPRECATED: Configuration propertyhive.metastore.local no longer has any effect.
Make sure to provide a valid value forhive.metastore.uris if you are connecting to a remote metastore.
 <property>
   <name>hive.metastore.local</name>
   <value>true</value>
 </property>
 --> 
<!--
 <property> 
  <name>hive.metastore.uris</name> 
  <value>thrift://master1.hadoop:9083</value> 
 </property>
-->
 <property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://master1.hadoop:3306/hive?createDatabaseIfNotExist=true&characterEncoding=UTF-8</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionDriverName</name>
   <value>com.mysql.jdbc.Driver</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionUserName</name>
   <value>hive</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionPassword</name>
   <value>hive</value>
 </property>
 
  <!--
 <property>
   <name>hive.hwi.listen.host</name>
   <value>0.0.0.0</value>
   <description>This is the host address the Hive Web Interface willlisten on</description>
 </property>
 
 
 <property>
   <name>hive.hwi.listen.port</name>
   <value>9999</value>
   <description>This is the port the Hive Web Interface will listenon</description>
  </property>
 
 
 <property>
   <name>hive.hwi.war.file</name>
   <value>lib/hive-hwi-0.12.0-cdh5.0.0.jar</value>
   <description>This sets the path to the HWI war file, relative to${HIVE_HOME}. </description>
 </property>
 --> 
 
 <property>
   <name>hive.metastore.client.socket.timeout</name>
   <value>60</value>
   <description>MetaStore Client socket timeout inseconds</description>
 </property>
 
 <!-- integrate hbase  -->
 
 <property>
   <name>hive.support.concurrency</name>
   <value>true</value>
   <description>Whether hive supports concurrency or not. A zookeeperinstance must be up and running for the default hive lock manager to supportread-write locks.</description>
 </property>
 
 <property>
   <name>hive.zookeeper.quorum</name>
   <value>slave1.hadoop,slave2.hadoop,slave3.hadoop</value>
   <description>The list of zookeeper servers to talk to. This isonly needed for read/write locks.</description>
 </property>
</configuration>

（2）、客户端配置文件

<?xml version="1.0"?>
<?xml-stylesheettype="text/xsl" href="configuration.xsl"?>
 
<configuration>
 <property>
   <name>hive.metastore.warehouse.dir</name>
   <value>/hive/warehouse</value>
 </property>
 
 <property>
   <name>hive.querylog.location</name>
   <value>/home/hive/hive5/logs</value>
 </property>
 
<!-- temparary sql data  -->  
 <property>
   <name>hive.exec.scratchdir</name>
   <value>/home/hive/hive5/data</value>
 </property>
<!--
DEPRECATED: Configuration propertyhive.metastore.local no longer has any effect.
Make sure to provide a valid value forhive.metastore.uris if you are connecting to a remote metastore.-->
 <property>
   <name>hive.metastore.local</name>
   <value>false</value>
 </property>
 
 <property> 
  <name>hive.metastore.uris</name> 
  <value>thrift://master1.hadoop:9083</value> 
 </property>
<!--
 <property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://master1.hadoop/hive?createDatabaseIfNotExist=true&characterEncoding=UTF-8</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionDriverName</name>
   <value>com.mysql.jdbc.Driver</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionUserName</name>
   <value>hive</value>
 </property>
    
 <property>
   <name>javax.jdo.option.ConnectionPassword</name>
   <value>hive</value>
 </property>
-->
  <!--
 <property>
   <name>hive.hwi.listen.host</name>
   <value>0.0.0.0</value>
   <description>This is the host address the Hive Web Interface willlisten on</description>
 </property>
 
 <property>
   <name>hive.hwi.listen.port</name>
   <value>9999</value>
   <description>This is the port the Hive Web Interface will listenon</description>
  </property>
 
 <property>
   <name>hive.hwi.war.file</name>
   <value>lib/hive-hwi-0.12.0-cdh5.0.0.jar</value>
   <description>This sets the path to the HWI war file, relative to${HIVE_HOME}. </description>
 </property>
 --> 
 
 <property>
   <name>hive.metastore.client.socket.timeout</name>
   <value>60</value>
   <description>MetaStore Client socket timeout inseconds</description>
 </property>
 
 <!-- integrate hbase  -->
 
 <property>
   <name>hive.support.concurrency</name>
   <value>true</value>
   <description>Whether hive supports concurrency or not. A zookeeperinstance must be up and running for the default hive lock manager to supportread-write locks.</description>
 </property>
 
 <property>
   <name>hive.zookeeper.quorum</name>
   <value>slave1.hadoop,slave2.hadoop,slave3.hadoop</value>
   <description>The list of zookeeper servers to talk to. This isonly needed for read/write locks.</description>
 </property>
</configuration>