Hive手动环境搭建

一，搭建环境前的准备：Centos6.9，VMware，jdk1.7，hadoop-cdh5.3.6，hive-cdh5.3.6

二，首先我们需要知道hive的默认metastore的存放数据库是:Derby数据库(这个数据库只允许一个用户连接)，因此我们选择mysql数据库

 1.安装mysql数据库

    1.1选择yum安装mysql的步骤     

      yum list | grep mysql 或 yum -y list mysql*

      sudo yum install mysql-server

      mysqldadmin -u root password 'root'

      sudo service mysqld start

      sudo chkconfig mysqld on

      mysql -u root -p root

 2.修改hive/conf下的配置文件hive-env.sh(改名),在文件中添加如下内容

 

# Set HADOOP_HOME to point to a specific hadoop install directory

HADOOP_HOME=/opt/modules/hadoop-2.5.0



# Hive Configuration Directory can be controlled by:

export HIVE_CONF_DIR=/opt/modules/hive-2.0.0-bin/conf

 

 3.拷贝配置文件，然后将默认数据库改为mysql数据库

<configuration>

<!-- WARNING!!! This file is provided for documentation purposes ONLY!     -->

<!-- WARNING!!! Any changes you make to this file will be ignored by Hive. -->

<!-- WARNING!!! You must make your changes in hive-site.xml instead.       -->

<!-- Hive Execution Parameters -->

    <property>

        <name>javax.jdo.option.ConnectionURL</name>

        <value>jdbc:mysql://bigdata-master.kevin.com:3306/hive?createDatabaseIfNotExist=true</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionDriverName</name>

        <value>com.mysql.jdbc.Driver</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionUserName</name>

        <value>root</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionPassword</name>

        <value>root</value>

    </property>

</configuration>

 4.启动hive

    先进行元数据验证 ./schematool -initSchema -dbType mysql

    再启动hive，启动命令使用bin/hive

 5.测试

    在hive中创建数据库，创建表

create database if not exists student;

CREATE TABLE USER_INFO (

ID BIGINT,

ACCOUNT STRING,

NAME  STRING,

AGE INT)

ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t';

 

 6.使用hive加载本地文件到表中

load data local inpath '/opt/modules/hive-2.0.0-bin/testdata/student.txt' into table user_info;