Hive 安装配置

最新推荐文章于 2023-09-01 21:09:22 发布

开发老张

最新推荐文章于 2023-09-01 21:09:22 发布

阅读量466

点赞数 1

分类专栏： Hive HADOOP Linux 文章标签： hive hadoop 大数据搭建配置

本文链接：https://blog.csdn.net/zhy0414/article/details/126777784

版权

HADOOP 同时被 3 个专栏收录

21 篇文章 0 订阅

订阅专栏

Linux

17 篇文章 0 订阅

订阅专栏

Hive

9 篇文章 0 订阅

订阅专栏

记录个 hive 的安装配置流程

下载解压

安装版本：apache-hive-3.1.2-bin.tar.gz

$ tar xzvf apache-hive-3.1.2-bin.tar.gz -C /home/hadoop/local/

$ cd /home/hadoop/local/

$ ln -s apache-hive-3.1.2-bin hive

添加环境变量

$ vim /etc/profile.d/my_env.sh

HIVE_HOME=/home/hadoop/local/hive                                                                                                                                    
PATH=$PATH:$HIVE_HOME/bin       
export HIVE_HOME PATH

$ source /etc/profile

解决日志 Jar 包冲突

$ cd /home/hadoop/local/hive/lib

$ rm -rf log4j-slf4j-impl-2.10.0.jar

拷贝 MySQL 驱动包

$ cp mysql-connector-java-8.0.11.jar /home/hadoop/local/hive/lib/

配置

$ vim conf/hive-site.xml

<?xml version="1.0"?>
<?xml-style sheettype="text/xsl" href="configuration.xsl"?>
<configuration>
   <property>
       <name>javax.jdo.option.ConnectionURL</name>
       <value>jdbc:mysql://ns1:3306/metastore?useSSL=false</value>
   </property>

   <property>
       <name>javax.jdo.option.ConnectionDriverName</name>
       <value>com.mysql.cj.jdbc.Driver</value>
   </property>

   <property>
       <name>javax.jdo.option.ConnectionUserName</name>
       <value>root</value>
   </property>

   <property>
       <name>javax.jdo.option.ConnectionPassword</name>
       <value>123456</value>
   </property>

   <property>
       <name>hive.metastore.warehouse.dir</name>
       <value>/user/hive/warehouse</value>
   </property>

   <property>
       <name>hive.metastore.schema.verification</name>
       <value>false</value>
   </property>

   <property>
   <name>hive.server2.thrift.port</name>
   <value>10000</value>
   </property>

   <property>
       <name>hive.server2.thrift.bind.host</name>
       <value>ns1</value>
   </property>

   <property>
       <name>hive.metastore.event.db.notification.api.auth</name>
       <value>false</value>
   </property>
   
   <property>
       <name>hive.cli.print.header</name>
       <value>true</value>
   </property>

   <property>
       <name>hive.cli.print.current.db</name>
       <value>true</value>
   </property>
</configuration>

修改日志存放路径

$ cd /home/hadoop/local/hive/conf/

$ mv hive-log4j2.properties.template hive-log4j2.properties

$ vim hive-log4j2.properties

修改日志存放路径配置：

property.hive.log.dir = /home/hadoop/local/hive/logs

初始化元数据库

创建数据库：

mysql> create database metastore;

初始化：

$ cd /home/hadoop/local/hive/bin/

$ schematool -initSchema -dbType mysql -verbose

初始化后会自动在数据库中创建表：

MySQL [metastore]> show tables;                                                                                                                                      
+-------------------------------+                                                                                                                                    
| Tables_in_metastore           |                                                                                                                                    
+-------------------------------+                                                                                                                                    
| AUX_TABLE                     |                                                                                                                                    
| BUCKETING_COLS                |                                                                                                                                    
| CDS                           |                                                                                                                                    
| COLUMNS_V2                    |                                                                                                                                    
| COMPACTION_QUEUE              |                                                                                                                                    
| COMPLETED_COMPACTIONS         |                                                                                                                                    
| COMPLETED_TXN_COMPONENTS      |                                                                                                                                    
| CTLGS                         |                                                                                                                                    
| DATABASE_PARAMS               |                                                                                                                                    
| DBS                           |                                                                                                                                    
| DB_PRIVS                      |                                                                                                                                    
| DELEGATION_TOKENS             |                                                                                                                                    
| FUNCS                         |                                                                                                                                    
| FUNC_RU                       |                                                                                                                                    
| GLOBAL_PRIVS                  |                                                                                                                                    
| HIVE_LOCKS                    |                                                                                                                                    
| IDXS                          |                                                                                                                                    
| INDEX_PARAMS                  |                                                                                                                                    
| I_SCHEMA                      |                                                                                                                                    
| KEY_CONSTRAINTS               |                                                                                                                                    
| MASTER_KEYS                   |                                                                                                                                    
| MATERIALIZATION_REBUILD_LOCKS |                                                                                                                                    
| METASTORE_DB_PROPERTIES       |                                                                                                                                    
| MIN_HISTORY_LEVEL             |                                                                                                                                    
| MV_CREATION_METADATA          |                                                                                                                                    
| MV_TABLES_USED                |                                                                                                                                    
| NEXT_COMPACTION_QUEUE_ID      |                                                                                                                                    
| NEXT_LOCK_ID                  |                                                                                                                                    
| NEXT_TXN_ID                   |                                                                                                                                    
| NEXT_WRITE_ID                 |                                                                                                                                    
| NOTIFICATION_LOG              |                                                                                                                                    
| NOTIFICATION_SEQUENCE         |                                                                                                                                    
| NUCLEUS_TABLES                |                                                                                                                                    
| PARTITIONS                    |                                                                                                                                    
| PARTITION_EVENTS              |                                                                                                                                    
| PARTITION_KEYS                |                                                                                                                                    
| PARTITION_KEY_VALS            |                                                                                                                                    
| PARTITION_PARAMS              |                                                                                                                                    
| PART_COL_PRIVS                |                                                                                                                                    
| PART_COL_STATS                |                                                                                                                                    
| PART_PRIVS                    |                                                                                                                                    
| REPL_TXN_MAP                  |                                                                                                                                    
| ROLES                         |                                                                                                                                    
| ROLE_MAP                      |                                                                                                                                    
| RUNTIME_STATS                 |                                                                                                                                    
| SCHEMA_VERSION                |                                                                                                                                    
| SDS                           |                                                                                                                                    
| SD_PARAMS                     |                                                                                                                                    
| SEQUENCE_TABLE                |                                                                                                                                    
| SERDES                        |                                                                                                                                    
| SERDE_PARAMS                  |                                                                                                                                    
| SKEWED_COL_NAMES              |                                                                                                                                    
| SKEWED_COL_VALUE_LOC_MAP      |                                                                                                                                    
| SKEWED_STRING_LIST            |                                                                                                                                    
| SKEWED_STRING_LIST_VALUES     |                                                                                                                                    
| SKEWED_VALUES                 |                                                                                                                                    
| SORT_COLS                     |                                                                                                                                    
| TABLE_PARAMS                  |                                                                                                                                    
| TAB_COL_STATS                 |                                                                                                                                    
| TBLS                          |                                                                                                                                    
| TBL_COL_PRIVS                 |                                                                                                                                    
| TBL_PRIVS                     |                                                                                                                                    
| TXNS                          |                                                                                                                                    
| TXN_COMPONENTS                |                                                                                                                                    
| TXN_TO_WRITE_ID               |                                                                                                                                    
| TYPES                         |                                                                                                                                    
| TYPE_FIELDS                   |                                                                                                                                    
| VERSION                       |                                                                                                                                    
| WM_MAPPING                    |                                                                                                                                    
| WM_POOL                       |                                                                                                                                    
| WM_POOL_TO_TRIGGER            |                                                                                                                                    
| WM_RESOURCEPLAN               |                                                                                                                                    
| WM_TRIGGER                    |                                                                                                                                    
| WRITE_SET                     |                                                                                                                                    
+-------------------------------+                                                                                                                                    
74 rows in set (0.00 sec)

启动 hive 客户端

$ hive

hive(default)> show databases;

OK                                                                                                                                                                   
database_name                                                                                                                                                        
default                                                                                                                                                              
Time taken: 0.712 seconds, Fetched: 1 row(s)