hive安装、配置 mysql存储元数据

 

1.下载hive安装包

 

2.安装hive

将hive解压到指定路径

#mv hive-0.9.0.tar.gz ~hadoop

#chown hadoop.hadoop ~hadoop/hive-0.9.0.tar.gz

#su - hadoop

$tar zxf hive-0.9.0.tar.gz

$mv hive-0.9.0.tar.gz hive

 

3.配置hive

$pwd

/home/hadoop/hive

$cd conf

$vi hadoop-env.sh

修改以下内容：

export  HADOOP_HOME=/home/hadoop/hadoop

export  HIVE_HOME=/home/hadoop/hive

保存退出

 

此时可以运行hive进行安装测试：

$./bin/hive

hive>

 

4.使用mysql存储数据元（默认使用derby）

(1) 修改配置文件

$pwd

/home/hadoop/hive/conf

$vi hive-site.xml

修改如下内容：

<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://masterIP:3306/hivedb?useUnicode=true&amp;characterEncoding=UTF-8&amp;createDatabaseIfNotExist=true</value>
  <description>JDBC connect string for a JDBC metastore</description>
</property>

<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
  <description>Driver class name for a JDBC metastore</description>
</property>

<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>hive</value>
  <description>username to use against metastore database</description>
</property>

<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>hive</value>
  <description>password to use against metastore database</description>
</property>

 

(2)获取mysql-connector-java-X.jar

将mysql-connector-java-X.jar拷贝到 hive/lib下

 

(3)登录mysql数据库，创建hivedb数据库，创建hive用户并赋予相应权限

mysql -p

mysql>create database hivedb;

mysql>grant all priviledeges to hive.* on hivedb@'localhost' idetified by 'hive';

mysql>grant all priviledeges to hive.* on hivedb@'master' idetified by 'hive';

 

5.运行hive，检测安装配置情况

$./bin/hive

hive>show databases;

OK

default;

 

6.查看mysql数据库中的hive数据元

mysql -p

mysql>use hivedb;

mysql>show tables;

+-----------------+
| Tables_in_hive |
+-----------------+
| BUCKETING_COLS |
| CDS |
| COLUMNS_V2 |
| DATABASE_PARAMS |
| DBS |
| PARTITION_KEYS |
| SDS |
| SD_PARAMS |
| SEQUENCE_TABLE |
| SERDES |
| SERDE_PARAMS |
| SORT_COLS |
| TABLE_PARAMS |
| TBLS |
+-----------------+
14 rows in set (0.00 sec)

 

 注意hive日志的位置，有问题先查看日志信息