数据仓库 & Apache Hive

目录

一、数据分析

1、数据仓库

1.1、数仓专注分析

1.2、数仓主要特征

1.3、数据仓库主流开发语言--SQL

2、Apache Hive

2.1、为什么使用Hive?

2.2、Hive和Hadoop关系

2.3、Hive架构图、各组件功能

2.4、Hive安装部署

2.4.1、Hive概念介绍

2.4.2、安装前准备

Hadoop与Hive整合

Step1:MySQL安装

Step2:上传解压Hive安装包(node1安装即可)

Step3:修改配置文件

Step4:上传mysql jdbc驱动到hive安装包lib下

2.4.3、初始化元数据

初始化元数据遇到的问题

2.4.4、在hdfs创建hive存储目录

2.5、启动Hive

1、启动metastore服务

2.6、Hive自带客户端

第1代客户端连接:bin/hive

第2代客户端连接:bin/beeline客户端连接

2.7、Hive可视化客户端

DataGrip


一、数据分析

1、数据仓库

    数据仓库(英语:Data Warehouse,简称数仓、DW),是一个用于存储、分析、报告的数据系统。

    数据仓库的目的是构建面向分析的集成化数据环境,分析结果为企业提供决策支持(Decision Support)。

思考:

1、假如你现在手里有200w,当下的时间点去投资口罩生成,你做不做?能不能赚钱?

2、假如你是公司营销总监,是否愿意招聘女主播进行短视频带货直播销售?

1.1、数仓专注分析

    数据仓库本身并不“生产”任何数据,其数据来源于不同外部系统。

    同时数据仓库自身也不需要“消费”任何的数据,其结果开放给各个外部应用使用。

    这也是为什么叫“仓库”,而不叫“工厂”的原因。

数据仓库为何而来,解决什么问题的?

结论:为了分析数据而来,分析结果给企业决策提供支撑。

数据驱动决策的制定。

    联机事务处理系统(OLTP):其主要任务是执行联机事务处理。关系型数据库(RDBMS)是OLTP典型应用,比如:Oracle、MySQL、SQL、SQL Server等

OLTP环境开展分析可行吗?可以,但是没必要

    OLTP系统的核心是面向业务,支持业务,支持事务。所有的业务操作可以分为读、写两种操作,一般来说读的压力明显大于写的压力。如果在OLTP环境直接开展各种分析,有以下问题需要考虑:

    1、数据分析也是对数据进行读取操作,会让读取压力倍增

    2、OLTP仅存储数周或数月的数据

    3、数据分散在不同系统不同表中,字段类型属性不统一。

数据仓库面世

    1、当分析所涉及数据规模较小的时候,在业务低峰期时可以在OLTP系统上开展直接分析。

    2、但为了更好的进行各种规模的数据分析,同时也不影响OLTP系统运行,此时需要构建一个集成统一的数据分析平台。该平台的目的很简单:面向分析,支持分析,并且和OLTP系统解耦合。

    3、基于这种需求,数据仓库的雏形开始在企业中出现了。

数据仓库的构建

    数仓是一个用于存储、分析、报告的数据系统,目的是构建面向分析的集成化数据环境。我们把这种面向分析、支持分析的系统称之为OLAP(联机分析处理)系统。当然数据仓库是OLAP系统的一种实现。

1.2、数仓主要特征

    1、面向主题(Subject-Oriented):主题是一个抽象的概念,是较高层次上数据综合、归类并进行分析利用的抽象。

    2、集成性(Integrated):主题相关的数据通常会分布在多个操作型系统中,彼此分散、独立、异构。需要集成到数仓主题下要统一源数据中所有矛盾之处(如字段的同名异义、异名同义、单位不统一、字长不一致等等) 

    业务系统(ETL:抽取、转换、加载)===>数仓。

    3、非易失性(Non-Volatile):也叫非易变性。数据仓库是分析数据的平台,而不是创造数据的平台。我们是通过数仓去分析数据中的规律,而不是去创造修改其中的规律。因此数据进入数据仓库后,它便稳定且不会改变。数据仓库中一般有大量的查询操作,但修改和删除操作很少。

    4、时变性(Time-Variant):数据仓库包含各种粒度的历史数据,数据可能与某个特定日期、星期、月份、季度或者年份有关。当业务变化后会失去时效性。因此数据仓库的数据需要随着时间更新,以适应决策的需要。从这个角度讲,数据仓库建设是一个项目,更是一个过程。

1.3、数据仓库主流开发语言--SQL

    数据分析领域,SQL编程语言,应该称之为分析领域主流开发语言。

    结构化查询语言(Structured Query Language)简称SQL,是一种数据库查询和程序设计语言,用于存取数据以及查询、更新管理数据。

    SQL是一种ANSI(美国国家标准化组织)的标准计算机语言,各大数据库厂商在生产数据库软件的时候,几乎都会去支持SQL语法,以使得用户在使用软件时更加容易上手,以及在不同厂商软件之间进行切换时更加适应,因为大家的SQL语法都差不多。

    SQL语言功能很强,十分简洁,核心功能只用了9个动词。语法接近英语口语,所以,用户很容易学习和使用。

    用户学习SQL成本低,SQL语言对于数据分析真的十分友好。

结构化数据

    结构化数据也称作行数据,是由二维表结构来逻辑表达和实现的数据,严格地遵循数据格式与长度规范,主要通过关系型数据库进行存储和管理。

    与结构化数据相对的是不适于由二维表来表现的非结构化数据,包括所有格式的办公文档、XML、HTML、各类报表、图片和音频、视频信息等。

    通俗来说,结构化数据会有严格的行列对齐,便于解读与理解。

2、Apache Hive

    Apache Hive是一款建立在Hadoop之上的开源数据仓库系统,可以将存储在Hadoop文件中的结构化、半结构化数据文件映射为一张数据库表,基于表提供了一种类似SQL的查询模型,称为Hive查询语言(HQL),用于访问和分析存储在Hadoop文件中的大型数据集。

    Hive核心是将HQL转换为MapReduce程序,然后将程序提交到Hadoop群集执行。

    Hive由Facebook实现并开源。

Hive官网

2.1、为什么使用Hive?

    1、使用Hadoop MapReduce直接处理数据所面临的问题

        1、人员学习成本太高,需要掌握java语言

        2、MapReduce实现复杂查询逻辑开发难度太大

    2、使用Hive处理数据的好处

        1、操作接口采用类SQL语法,提供快速开发的能力(简单、容易上手

        2、避免直接写MapReduce,减少开发人员的学习成本

        3、支持自定义函数,功能扩展很方便

        4、背靠Hadoop,擅长存储分析海量数据集

2.2、Hive和Hadoop关系

    从功能来说,数据仓库软件,至少需要具备下述两种能力。

        1、存储数据的能力  2、分析数据的能力

    Apache Hive作为一款大数据时代的数据仓库软件,当然也具备上述两种能力。只不过Hive并不是自己实现了上述两种能力,而是借助Hadoop。

    Hive利用HDFS存储数据,利用MapReduce查询分析数据。

    这样突然发现Hive没啥用,不过是套壳Hadoop罢了。其实不然,Hive的最大的魅力在于用户专注于编写SQL,Hive帮您转换成为MapReduce程序完成对数据分析。

1、Hive能将数据文件映射成为一张表,这个映射是指什么?

    文件和表之间的对应关系

2、Hive软件本身到底承担了什么功能职责

    SQL语法解析编译成为MapReduce

实现Hive的功能如下图

2.3、Hive架构图、各组件功能

Hive架构图

Hive组件

1、用户接口

    包括CLI、JDBC/ODBC、WebGUI。其中,CLI(command line interface)为shell命令行;Hive中的Thrift服务器允许外部客户端通过网络与Hive进行交互,类似于JDBC或ODBC协议。WebGUI是通过浏览器访问Hive。

2、元数据存储

    通常是存储在关系数据库如mysql/derby中。Hive中的元数据包括表的名字,表的列和分区及其属性,表的属性(是否为外部表等),表的数据所在目录等。

3、Driver驱动程序、包括语法解析器、计划编译器、优化器、执行器

    完成HQL查询语句从词法分析、语法分析、编译、优化以及查询计划的生成。生成的查询计划存储在HDFS中,并在随后由执行引擎执行。

4、执行引擎

    Hive本身并不直接处理数据文件。而是通过执行引擎处理。当下Hive支持MapReduce、Tez、Spark  3种执行引擎。

2.4、Hive安装部署

2.4.1、Hive概念介绍

什么是元数据?

    元数据(Metadata),又称中介数据、中继数据,为描述数据的数据(data about data),主要是描述数据属性(property)的信息,用来支持如指示存储位置、历史数据、资源查找、文件记录等功能。

Hive Metadata

    Hive Metadata即Hive的元数据。包含用Hive创建的database、table、表的位置、类型、属性,字段顺序类型等信息。

    元数据存储在关系型数据库中。如hive内置的Derby、或者第三方如MySQL等。

Hive Metastore

    Metastore即元数据服务。Metastore服务的作用是管理metadata元数据,对外暴露服务地址,让各种客户端通过连接Metastore服务,由Metastore再去连接MySQL数据库来存取元数据。

    有了Metastore服务,就可以有多个客户端同时连接,而且这些客户端不需要知道MySQL数据库的用户名和密码,只需要连接Metastore服务即可。某种程度上也保证了hive元数据的安全。

Metastore配置方式

    Metastore服务配置有3种模式:内嵌模式、本地模式、远程模式

    区分3种配置方式的关键是弄清楚两个问题:

Metastore服务是否需要单独配置、单独启动?

Metadata是存储在内置的derby中,还是第三方RDBMS,比如MySQL。

推荐模式:远程模式部署

内嵌模式本地模式远程模式
Metastore单独配置、启动
Metadata存储介质DerbyMySQLMySQL

Metastore远程模式

    在生产环境中,建议用远程模式来配置Hive Metastore。在这种情况下,其他依赖hive的软件都可以通过Metastore访问hive。由于还可以完全屏蔽数据库层,因此这也带来了更好的可管理性/安全性。

2.4.2、安装前准备

    由于Apache Hive是一款基于Hadoop的数据仓库软件,通常部署运行在Linux系统之上。因此不管使用何种方式配置Hive Metastore,必须先保证服务器的基础环境正常,Hadoop集群健康可用。

    1、服务器基础环境:集群时间同步、防火墙关闭、主机Host映射、免密登录、JDK安装

    2、Hadoop集群健康可用:启动Hive之前必须先启动Hadoop集群。特别要注意,需等待HDFS安全模式关闭之后再启动运行Hive。Hive不是分布式安装运行的软件,其分布式的特性主要借由Hadoop完成。包括分布式存储、分布式计算。

Hadoop与Hive整合

    因为Hive需要把数据存储在HDFS上,并且通过MapReduce作为执行引擎处理数据。因此需要在Hadoop中添加相关配置属性,以满足Hive在Hadoop上运行。

    修改Hadoop中core-site.xml,并且Hadoop集群同步配置文件,重启生效。

<!-- 整合hive -->
<property>
   <name>hadoop.proxyuser.root.hosts</name>
   <value>*</value>
</property>
 
<property>
   <name>hadoop.proxyuser.root.groups</name>
   <value>*</value>
</property>
Step1:MySQL安装

注意:MySQL只需要在一台机器安装并且需要授权远程访问。

Linux 软件安装

Step2:上传解压Hive安装包(node1安装即可)

Hive的安装

Hive官网下载地址

Hive官网下载地址hive

    上传安装包 解压

[root@node1 ~]# cd /export/server/
[root@node1 server]# tar -zxvf apache-hive-3.1.3-bin.tar.gz
...
# 修改文件名为hive-3.1.3
[root@node1 server]# mv apache-hive-3.1.3-bin hive-3.1.3

解决Hive与Hadoop之间guava版本差异(使用Hadoop中的guava)

[root@node1 server]# cd hive-3.1.3/
[root@node1 hive-3.1.3]# rm -rf lib/guava-19.0.jar
[root@node1 hive-3.1.3]# cp /export/server/hadoop-3.3.6/share/hadoop/common/lib/guava-27.0-jre.jar ./lib/
Step3:修改配置文件

hive.env.sh

[root@node1 hive-3.1.3]# cd /export/server/hive-3.1.3/conf/
[root@node1 conf]# ls
beeline-log4j2.properties.template  hive-env.sh.template                  hive-l
hive-default.xml.template           hive-exec-log4j2.properties.template  ivyset
# 把hive-env.sh.template模版改名
[root@node1 conf]# mv hive-env.sh.template hive-env.sh
[root@node1 conf]# vi hive-env.sh

# 修改内容如下
export HADOOP_HOME=/export/server/hadoop-3.3.6
export HIVE_CONF_DIR=/export/server/hive-3.1.3/conf
export HIVE_AUX_JARS_PATH=/export/server/hive-3.1.3/lib

hive-site.xml  需要新建此文件内容如下

[root@node1 ~]# cd /export/server/hive-3.1.3/conf/
[root@node1 conf]# ls
beeline-log4j2.properties.template    ivysettings.xml
hive-default.xml.template             llap-cli-log4j2.properties.template
hive-env.sh                           llap-daemon-log4j2.properties.template
hive-exec-log4j2.properties.template  parquet-logging.properties
hive-log4j2.properties.template
[root@node1 conf]# vi hive-site.xml
[root@node1 conf]# ls
beeline-log4j2.properties.template    hive-site.xml
hive-default.xml.template             ivysettings.xml
hive-env.sh                           llap-cli-log4j2.properties.template
hive-exec-log4j2.properties.template  llap-daemon-log4j2.properties.template
hive-log4j2.properties.template       parquet-logging.properties
[root@node1 conf]#

下面内容粘贴到hive-site.xml中--如下指定mysql连接信息需要修改

<configuration>
<!-- 存储元数据mysql相关配置 -->
<property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true&amp;useSSL=false&amp;useUnicode=true&amp;characterEncoding=utf-8&amp;serverTimezone=UTC</value>
</property>

<property>
   <name>javax.jdo.option.ConnectionDriverName</name>
   <value>com.mysql.cj.jdbc.Driver</value>
</property>

<property>
   <name>javax.jdo.option.ConnectionUserName</name>
   <value>root</value>
</property>

<property>
   <name>javax.jdo.option.ConnectionPassword</name>
   <value>root</value>
</property>

<!-- H2S运行绑定host -->
<property>
   <name>hive.server2.thrift.bind.host</name>
   <value>node1</value>
</property>

<!-- 远程模式部署metastore metastore地址 -->
<property>
   <name>hive.metastore.uris</name>
   <value>thrift://node1:9083</value>
</property>

<!-- 关闭元数据存储授权 -->
<property>
   <name>hive.metastore.event.db.notification.api.auth</name>
   <value>false</value>
</property>

</configuration>
Step4:上传mysql jdbc驱动到hive安装包lib下

使用maven依赖下载mysql驱动包

<dependency>
   <groupId>mysql</groupId>
   <artifactId>mysql-connector-java</artifactId>
   <version>8.0.17</version>
</dependency>

mysql-connector-java-8.0.17.jar 上传mysql jdbc驱动到hive安装包lib下

2.4.3、初始化元数据
[root@node1 hive-3.1.3]# cd /export/server/hive-3.1.3/
[root@node1 hive-3.1.3]# bin/schematool -dbType mysql -initSchema -verbose
初始化元数据遇到的问题

经历了错误,最终问题得以解决

[root@node1 hive-3.1.3]# bin/schematool -dbType mysql -initSchema
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:        jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true
Metastore Connection Driver :    com.mysql.jdbc.Driver
Metastore connection User:       root
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: java.sql.SQLException : The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.
SQL Error code: 0
Use --verbose for detailed stacktrace.
*** schemaTool failed ***
[root@node1 hive-3.1.3]# cd /export/server/hive-3.1.3/
[root@node1 hive-3.1.3]# bin/schematool -dbType mysql -initSchema -verbose
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:        jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true
Metastore Connection Driver :    com.mysql.cj.jdbc.Driver
Metastore connection User:       root
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: java.sql.SQLException : The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.
SQL Error code: 0
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
        at org.apache.hadoop.hive.metastore.tools.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:94)
        at org.apache.hive.beeline.HiveSchemaTool.getConnectionToMetastore(HiveSchemaTool.java:169)
        at org.apache.hive.beeline.HiveSchemaTool.testConnectionToMetastore(HiveSchemaTool.java:475)
        at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:581)
        at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:567)
        at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1517)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:328)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:241)
Caused by: java.sql.SQLException: The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
        at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
        at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:76)
        at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:827)
        at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:447)
        at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:237)
        at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:199)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at org.apache.hadoop.hive.metastore.tools.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:88)
        ... 11 more
Caused by: com.mysql.cj.exceptions.InvalidConnectionAttributeException: The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
        at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:85)
        at com.mysql.cj.util.TimeUtil.getCanonicalTimezone(TimeUtil.java:132)
        at com.mysql.cj.protocol.a.NativeProtocol.configureTimezone(NativeProtocol.java:2139)
        at com.mysql.cj.protocol.a.NativeProtocol.initServerSession(NativeProtocol.java:2163)
        at com.mysql.cj.jdbc.ConnectionImpl.initializePropsFromServer(ConnectionImpl.java:1301)
        at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:958)
        at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:817)
        ... 17 more
*** schemaTool failed ***
[root@node1 hive-3.1.3]# cd conf
[root@node1 conf]# vi hive-site.xml
[root@node1 conf]# cd ..
[root@node1 hive-3.1.3]# bin/schematool -dbType mysql -initSchema -verbose
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: com.ctc.wstx.exc.WstxUnexpectedCharException: Unexpected character '=' (code 61); expected a semi-colon after the reference for entity 'useUnicode'
 at [row,col,system-id]: [5,88,"file:/export/server/hive-3.1.3/conf/hive-site.xml"]
        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3101)
        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:3050)
        at org.apache.hadoop.conf.Configuration.loadProps(Configuration.java:2923)
        at org.apache.hadoop.conf.Configuration.addResourceObject(Configuration.java:1035)
        at org.apache.hadoop.conf.Configuration.addResource(Configuration.java:940)
        at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5154)
        at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5107)
        at org.apache.hive.beeline.HiveSchemaTool.<init>(HiveSchemaTool.java:96)
        at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1473)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:328)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:241)
Caused by: com.ctc.wstx.exc.WstxUnexpectedCharException: Unexpected character '=' (code 61); expected a semi-colon after the reference for entity 'useUnicode'
 at [row,col,system-id]: [5,88,"file:/export/server/hive-3.1.3/conf/hive-site.xml"]
        at com.ctc.wstx.sr.StreamScanner.throwUnexpectedChar(StreamScanner.java:666)
        at com.ctc.wstx.sr.StreamScanner.parseEntityName(StreamScanner.java:2080)
        at com.ctc.wstx.sr.StreamScanner.fullyResolveEntity(StreamScanner.java:1538)
        at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2818)
        at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1121)
        at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3405)
        at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3191)
        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3084)
        ... 14 more

问题1:Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.

解决方式:需要将 com.mysql.jdbc.Driver  改为  com.mysql.cj.jdbc.Driver

问题2:Underlying cause: java.sql.SQLException : The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the serverTimezone configuration property) to use a more specifc time zone value if you want to utilize time zone support.

解决方式:修改hive-site.xml

<property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true&amp;useSSL=false&amp;useUnicode=true&amp;characterEncoding=utf-8&amp;serverTimezone=UTC</value>
</property>

mysql设置:修改mysql支持远程连接,关闭防火墙

C:\Users\Administrator>mysql -uroot -proot -h127.0.0.1 -P3306
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 15
Server version: 8.0.17 MySQL Community Server - GPL

Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> use mysql;
Database changed
mysql> select host,user,plugin from user;
+-----------+------------------+-----------------------+
| host      | user             | plugin                |
+-----------+------------------+-----------------------+
| localhost | root             | mysql_native_password |
| localhost | mysql.infoschema | caching_sha2_password |
| localhost | mysql.session    | caching_sha2_password |
| localhost | mysql.sys        | caching_sha2_password |
+-----------+------------------+-----------------------+
4 rows in set (0.00 sec)

# host 显示 localhost(默认),说明只支持本地访问,不允许远程访问
# 更改 root 用户的 host 默认配置

mysql> update user set host = '%' where user = 'root';
Query OK, 0 rows affected (0.00 sec)
Rows matched: 1  Changed: 1  Warnings: 0
mysql> select host,user,plugin from user;
+-----------+------------------+-----------------------+
| host      | user             | plugin                |
+-----------+------------------+-----------------------+
| %         | root             | mysql_native_password |
| localhost | mysql.infoschema | caching_sha2_password |
| localhost | mysql.session    | caching_sha2_password |
| localhost | mysql.sys        | caching_sha2_password |
+-----------+------------------+-----------------------+
4 rows in set (0.00 sec)

#  刷新权限,链接成功
mysql> flush privileges;
Query OK, 0 rows affected (0.01 sec)
# 修改密码
mysql> alter user 'root'@'%' identified with mysql_native_password by 'root';
Query OK, 0 rows affected (0.01 sec)
# 设置密码永不过期
mysql> alter user 'root'@'%' password expire never;
Query OK, 0 rows affected (0.01 sec)
#  刷新权限
mysql> flush privileges;
Query OK, 0 rows affected (0.01 sec)

最终成功,可以在DB中看到74张表

# 初始化元数据成功log信息
[root@node1 hive-3.1.3]# bin/schematool -dbType mysql -initSchema -verbose
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:        jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true&useSSL=false&useUnicode=true&characterEncoding=utf-8&serverTimezone=UTC
Metastore Connection Driver :    com.mysql.cj.jdbc.Driver
Metastore connection User:       root
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.mysql.sql
Connecting to jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true&useSSL=false&useUnicode=true&characterEncoding=utf-8&serverTimezone=UTC
Connected to: MySQL (version 8.0.17)
Driver: MySQL Connector/J (version mysql-connector-java-8.0.17 (Revision: 16a712ddb3f826a1933ab42b0039f7fb9eebc6ec))
Transaction isolation: TRANSACTION_READ_COMMITTED
0: jdbc:mysql://192.168.18.69:3306/hive> !autocommit on
Autocommit status: true
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */
No rows affected (0.004 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET NAMES utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40103 SET TIME_ZONE='+00:00' */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.004 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `BUCKETING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAINT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.104 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `CDS` ( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.07 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `COLUMNS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` MEDIUMTEXT DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.096 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `DATABASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.108 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE `CTLGS` ( `CTLG_ID` BIGINT PRIMARY KEY, `NAME` VARCHAR(256), `DESC` VARCHAR(4000), `LOCATION_URI` VARCHAR(4000) NOT NULL, UNIQUE KEY `UNIQUE_CATALOG` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.101 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO `CTLGS` VALUES (1, 'hive', 'Default catalog for Hive', 'TBD')
1 row affected (0.019 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `DBS` ( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CTLG_NAME` varchar(256) NOT NULL DEFAULT 'hive', PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`, `CTLG_NAME`), CONSTRAINT `CTLG_FK1` FOREIGN KEY (`CTLG_NAME`) REFERENCES `CTLGS` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.118 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `DB_PRIVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`AUTHORIZER`,`DB_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CONSTRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.125 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `GLOBAL_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE KEY `GLOBALPRIVILEGEINDEX` (`AUTHORIZER`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRANTOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.098 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `IDXS` ( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REBUILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`), KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.146 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `INDEX_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KEY `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`INDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.108 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `NUCLEUS_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER` varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.106 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CONSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.13 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.004 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONEVENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.089 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITION_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.122 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.111 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PARTITION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`), KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.119 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PART_COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PART_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `PART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.127 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PART_PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`PART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.178 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `ROLES` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.101 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `ROLE_MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.124 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SDS` ( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSED` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` int(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), KEY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.143 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SD_PARAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PARAMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.101 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SEQUENCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.073 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO `SEQUENCE_TABLE` (`SEQUENCE_NAME`, `NEXT_VAL`) VALUES ('org.apache.hadoop.hive.metastore.model.MNotificationLog', 1)
1 row affected (0.011 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SERDES` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESCRIPTION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_TYPE` integer, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.111 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.008 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SERDE_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KEY `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.167 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONSTRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.133 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.143 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.104 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_STRING_LIST_VALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.083 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.005 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SKEWED_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`), KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FOREIGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.132 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `SORT_COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_ID`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.099 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TABLE_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `TABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.205 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `MV_CREATION_METADATA` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TXN_LIST` TEXT DEFAULT NULL, `MATERIALIZATION_TIME` bigint(20) NOT NULL, PRIMARY KEY (`MV_CREATION_METADATA_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.073 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX MV_UNIQUE_TABLE ON MV_CREATION_METADATA (TBL_NAME, DB_NAME) USING BTREE
No rows affected (0.081 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TBLS` ( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEXT` mediumtext, `IS_REWRITE_ENABLED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.162 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `MV_TABLES_USED` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `TBL_ID` bigint(20) NOT NULL, CONSTRAINT `MV_TABLES_USED_FK1` FOREIGN KEY (`MV_CREATION_METADATA_ID`) REFERENCES `MV_CREATION_METADATA` (`MV_CREATION_METADATA_ID`), CONSTRAINT `MV_TABLES_USED_FK2` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.135 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TBL_COL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.124 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TBL_PRIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.24 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TAB_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.131 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX TAB_COL_STATS_IDX ON TAB_COL_STATS (CAT_NAME, DB_NAME, TABLE_NAME, COLUMN_NAME) USING BTREE
No rows affected (0.075 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `PART_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.106 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (CAT_NAME, DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE
No rows affected (0.053 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TYPES` ( `TYPES_ID` bigint(20) NOT NULL, `TYPE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE1` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE2` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TYPES_ID`), UNIQUE KEY `UNIQUE_TYPE` (`TYPE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.099 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `TYPE_FIELDS` ( `TYPE_NAME` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `FIELD_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `FIELD_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TYPE_NAME`,`FIELD_NAME`), KEY `TYPE_FIELDS_N49` (`TYPE_NAME`), CONSTRAINT `TYPE_FIELDS_FK1` FOREIGN KEY (`TYPE_NAME`) REFERENCES `TYPES` (`TYPES_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.106 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `MASTER_KEYS` ( `KEY_ID` INTEGER NOT NULL AUTO_INCREMENT, `MASTER_KEY` VARCHAR(767) BINARY NULL, PRIMARY KEY (`KEY_ID`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.074 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `DELEGATION_TOKENS` ( `TOKEN_IDENT` VARCHAR(767) BINARY NOT NULL, `TOKEN` VARCHAR(767) BINARY NULL, PRIMARY KEY (`TOKEN_IDENT`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.082 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `VERSION` ( `VER_ID` BIGINT NOT NULL, `SCHEMA_VERSION` VARCHAR(127) NOT NULL, `VERSION_COMMENT` VARCHAR(255), PRIMARY KEY (`VER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.178 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `FUNCS` ( `FUNC_ID` BIGINT(20) NOT NULL, `CLASS_NAME` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `CREATE_TIME` INT(11) NOT NULL, `DB_ID` BIGINT(20), `FUNC_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `FUNC_TYPE` INT(11) NOT NULL, `OWNER_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `OWNER_TYPE` VARCHAR(10) CHARACTER SET latin1 COLLATE latin1_bin, PRIMARY KEY (`FUNC_ID`), UNIQUE KEY `UNIQUEFUNCTION` (`FUNC_NAME`, `DB_ID`), KEY `FUNCS_N49` (`DB_ID`), CONSTRAINT `FUNCS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.154 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `FUNC_RU` ( `FUNC_ID` BIGINT(20) NOT NULL, `RESOURCE_TYPE` INT(11) NOT NULL, `RESOURCE_URI` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `INTEGER_IDX` INT(11) NOT NULL, PRIMARY KEY (`FUNC_ID`, `INTEGER_IDX`), CONSTRAINT `FUNC_RU_FK1` FOREIGN KEY (`FUNC_ID`) REFERENCES `FUNCS` (`FUNC_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.078 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `NOTIFICATION_LOG` ( `NL_ID` BIGINT(20) NOT NULL, `EVENT_ID` BIGINT(20) NOT NULL, `EVENT_TIME` INT(11) NOT NULL, `EVENT_TYPE` varchar(32) NOT NULL, `CAT_NAME` varchar(256), `DB_NAME` varchar(128), `TBL_NAME` varchar(256), `MESSAGE` longtext, `MESSAGE_FORMAT` varchar(16), PRIMARY KEY (`NL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.067 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `NOTIFICATION_SEQUENCE` ( `NNI_ID` BIGINT(20) NOT NULL, `NEXT_EVENT_ID` BIGINT(20) NOT NULL, PRIMARY KEY (`NNI_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.073 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO `NOTIFICATION_SEQUENCE` (`NNI_ID`, `NEXT_EVENT_ID`) SELECT * from (select 1 as `NNI_ID`, 1 as `NOTIFICATION_SEQUENCE`) a WHERE (SELECT COUNT(*) FROM `NOTIFICATION_SEQUENCE`) = 0
1 row affected (0.012 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `KEY_CONSTRAINTS` ( `CHILD_CD_ID` BIGINT, `CHILD_INTEGER_IDX` INT(11), `CHILD_TBL_ID` BIGINT, `PARENT_CD_ID` BIGINT, `PARENT_INTEGER_IDX` INT(11) NOT NULL, `PARENT_TBL_ID` BIGINT NOT NULL, `POSITION` BIGINT NOT NULL, `CONSTRAINT_NAME` VARCHAR(400) NOT NULL, `CONSTRAINT_TYPE` SMALLINT(6)  NOT NULL, `UPDATE_RULE` SMALLINT(6), `DELETE_RULE` SMALLINT(6), `ENABLE_VALIDATE_RELY` SMALLINT(6) NOT NULL, `DEFAULT_VALUE` VARCHAR(400), PRIMARY KEY (`CONSTRAINT_NAME`, `POSITION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.072 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE
No rows affected (0.054 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX `CONSTRAINTS_CONSTRAINT_TYPE_INDEX` ON KEY_CONSTRAINTS (`CONSTRAINT_TYPE`) USING BTREE
No rows affected (0.051 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS `METASTORE_DB_PROPERTIES` ( `PROPERTY_KEY` varchar(255) NOT NULL, `PROPERTY_VALUE` varchar(1000) NOT NULL, `DESCRIPTION` varchar(1000), PRIMARY KEY(`PROPERTY_KEY`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.092 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS WM_RESOURCEPLAN ( `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `QUERY_PARALLELISM` int(11), `STATUS` varchar(20) NOT NULL, `DEFAULT_POOL_ID` bigint(20), PRIMARY KEY (`RP_ID`), UNIQUE KEY `UNIQUE_WM_RESOURCEPLAN` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.137 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS WM_POOL ( `POOL_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `PATH` varchar(767) NOT NULL, `ALLOC_FRACTION` DOUBLE, `QUERY_PARALLELISM` int(11), `SCHEDULING_POLICY` varchar(767), PRIMARY KEY (`POOL_ID`), UNIQUE KEY `UNIQUE_WM_POOL` (`RP_ID`, `PATH`), CONSTRAINT `WM_POOL_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.445 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> ALTER TABLE `WM_RESOURCEPLAN` ADD CONSTRAINT `WM_RESOURCEPLAN_FK1` FOREIGN KEY (`DEFAULT_POOL_ID`) REFERENCES `WM_POOL`(`POOL_ID`)
No rows affected (0.084 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS WM_TRIGGER ( `TRIGGER_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `TRIGGER_EXPRESSION` varchar(1024), `ACTION_EXPRESSION` varchar(1024), `IS_IN_UNMANAGED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TRIGGER_ID`), UNIQUE KEY `UNIQUE_WM_TRIGGER` (`RP_ID`, `NAME`), CONSTRAINT `WM_TRIGGER_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.117 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS WM_POOL_TO_TRIGGER ( `POOL_ID` bigint(20) NOT NULL, `TRIGGER_ID` bigint(20) NOT NULL, PRIMARY KEY (`POOL_ID`, `TRIGGER_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK1` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK2` FOREIGN KEY (`TRIGGER_ID`) REFERENCES `WM_TRIGGER` (`TRIGGER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.131 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE IF NOT EXISTS WM_MAPPING ( `MAPPING_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `ENTITY_TYPE` varchar(128) NOT NULL, `ENTITY_NAME` varchar(128) NOT NULL, `POOL_ID` bigint(20), `ORDERING` int, PRIMARY KEY (`MAPPING_ID`), UNIQUE KEY `UNIQUE_WM_MAPPING` (`RP_ID`, `ENTITY_TYPE`, `ENTITY_NAME`), CONSTRAINT `WM_MAPPING_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`), CONSTRAINT `WM_MAPPING_FK2` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.134 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE TXNS ( TXN_ID bigint PRIMARY KEY, TXN_STATE char(1) NOT NULL, TXN_STARTED bigint NOT NULL, TXN_LAST_HEARTBEAT bigint NOT NULL, TXN_USER varchar(128) NOT NULL, TXN_HOST varchar(128) NOT NULL, TXN_AGENT_INFO varchar(128), TXN_META_INFO varchar(128), TXN_HEARTBEAT_COUNT int, TXN_TYPE int ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.106 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE TXN_COMPONENTS ( TC_TXNID bigint NOT NULL, TC_DATABASE varchar(128) NOT NULL, TC_TABLE varchar(128), TC_PARTITION varchar(767), TC_OPERATION_TYPE char(1) NOT NULL, TC_WRITEID bigint, FOREIGN KEY (TC_TXNID) REFERENCES TXNS (TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.122 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX TC_TXNID_INDEX ON TXN_COMPONENTS (TC_TXNID)
No rows affected (0.08 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE COMPLETED_TXN_COMPONENTS ( CTC_TXNID bigint NOT NULL, CTC_DATABASE varchar(128) NOT NULL, CTC_TABLE varchar(256), CTC_PARTITION varchar(767), CTC_TIMESTAMP timestamp DEFAULT CURRENT_TIMESTAMP NOT NULL, CTC_WRITEID bigint, CTC_UPDATE_DELETE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.078 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX COMPLETED_TXN_COMPONENTS_IDX ON COMPLETED_TXN_COMPONENTS (CTC_DATABASE, CTC_TABLE, CTC_PARTITION) USING BTREE
No rows affected (0.055 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE NEXT_TXN_ID ( NTXN_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.156 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO NEXT_TXN_ID VALUES(1)
1 row affected (0.011 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE HIVE_LOCKS ( HL_LOCK_EXT_ID bigint NOT NULL, HL_LOCK_INT_ID bigint NOT NULL, HL_TXNID bigint NOT NULL, HL_DB varchar(128) NOT NULL, HL_TABLE varchar(128), HL_PARTITION varchar(767), HL_LOCK_STATE char(1) not null, HL_LOCK_TYPE char(1) not null, HL_LAST_HEARTBEAT bigint NOT NULL, HL_ACQUIRED_AT bigint, HL_USER varchar(128) NOT NULL, HL_HOST varchar(128) NOT NULL, HL_HEARTBEAT_COUNT int, HL_AGENT_INFO varchar(128), HL_BLOCKEDBY_EXT_ID bigint, HL_BLOCKEDBY_INT_ID bigint, PRIMARY KEY(HL_LOCK_EXT_ID, HL_LOCK_INT_ID), KEY HIVE_LOCK_TXNID_INDEX (HL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.105 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID)
No rows affected (0.052 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE NEXT_LOCK_ID ( NL_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.067 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO NEXT_LOCK_ID VALUES(1)
1 row affected (0.012 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE COMPACTION_QUEUE ( CQ_ID bigint PRIMARY KEY, CQ_DATABASE varchar(128) NOT NULL, CQ_TABLE varchar(128) NOT NULL, CQ_PARTITION varchar(767), CQ_STATE char(1) NOT NULL, CQ_TYPE char(1) NOT NULL, CQ_TBLPROPERTIES varchar(2048), CQ_WORKER_ID varchar(128), CQ_START bigint, CQ_RUN_AS varchar(128), CQ_HIGHEST_WRITE_ID bigint, CQ_META_INFO varbinary(2048), CQ_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.087 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE COMPLETED_COMPACTIONS ( CC_ID bigint PRIMARY KEY, CC_DATABASE varchar(128) NOT NULL, CC_TABLE varchar(128) NOT NULL, CC_PARTITION varchar(767), CC_STATE char(1) NOT NULL, CC_TYPE char(1) NOT NULL, CC_TBLPROPERTIES varchar(2048), CC_WORKER_ID varchar(128), CC_START bigint, CC_END bigint, CC_RUN_AS varchar(128), CC_HIGHEST_WRITE_ID bigint, CC_META_INFO varbinary(2048), CC_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.077 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( NCQ_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.183 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO NEXT_COMPACTION_QUEUE_ID VALUES(1)
1 row affected (0.011 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE AUX_TABLE ( MT_KEY1 varchar(128) NOT NULL, MT_KEY2 bigint NOT NULL, MT_COMMENT varchar(255), PRIMARY KEY(MT_KEY1, MT_KEY2) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.086 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE WRITE_SET ( WS_DATABASE varchar(128) NOT NULL, WS_TABLE varchar(128) NOT NULL, WS_PARTITION varchar(767), WS_TXNID bigint NOT NULL, WS_COMMIT_ID bigint NOT NULL, WS_OPERATION_TYPE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.073 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE TXN_TO_WRITE_ID ( T2W_TXNID bigint NOT NULL, T2W_DATABASE varchar(128) NOT NULL, T2W_TABLE varchar(256) NOT NULL, T2W_WRITEID bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.073 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE UNIQUE INDEX TBL_TO_TXN_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_TXNID)
No rows affected (0.135 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE UNIQUE INDEX TBL_TO_WRITE_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_WRITEID)
No rows affected (0.049 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE NEXT_WRITE_ID ( NWI_DATABASE varchar(128) NOT NULL, NWI_TABLE varchar(256) NOT NULL, NWI_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.071 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE UNIQUE INDEX NEXT_WRITE_ID_IDX ON NEXT_WRITE_ID (NWI_DATABASE, NWI_TABLE)
No rows affected (0.138 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE MIN_HISTORY_LEVEL ( MHL_TXNID bigint NOT NULL, MHL_MIN_OPEN_TXNID bigint NOT NULL, PRIMARY KEY(MHL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.074 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX MIN_HISTORY_LEVEL_IDX ON MIN_HISTORY_LEVEL (MHL_MIN_OPEN_TXNID)
No rows affected (0.055 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE MATERIALIZATION_REBUILD_LOCKS ( MRL_TXN_ID bigint NOT NULL, MRL_DB_NAME VARCHAR(128) NOT NULL, MRL_TBL_NAME VARCHAR(256) NOT NULL, MRL_LAST_HEARTBEAT bigint NOT NULL, PRIMARY KEY(MRL_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.453 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE `I_SCHEMA` ( `SCHEMA_ID` BIGINT PRIMARY KEY, `SCHEMA_TYPE` INTEGER NOT NULL, `NAME` VARCHAR(256), `DB_ID` BIGINT, `COMPATIBILITY` INTEGER NOT NULL, `VALIDATION_LEVEL` INTEGER NOT NULL, `CAN_EVOLVE` bit(1) NOT NULL, `SCHEMA_GROUP` VARCHAR(256), `DESCRIPTION` VARCHAR(4000), FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`), KEY `UNIQUE_NAME` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.15 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE `SCHEMA_VERSION` ( `SCHEMA_VERSION_ID` bigint primary key, `SCHEMA_ID` BIGINT, `VERSION` INTEGER NOT NULL, `CREATED_AT` BIGINT NOT NULL, `CD_ID` BIGINT, `STATE` INTEGER NOT NULL, `DESCRIPTION` VARCHAR(4000), `SCHEMA_TEXT` mediumtext, `FINGERPRINT` VARCHAR(256), `SCHEMA_VERSION_NAME` VARCHAR(256), `SERDE_ID` bigint, FOREIGN KEY (`SCHEMA_ID`) REFERENCES `I_SCHEMA` (`SCHEMA_ID`), FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`), FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), KEY `UNIQUE_VERSION` (`SCHEMA_ID`, `VERSION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.148 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE REPL_TXN_MAP ( RTM_REPL_POLICY varchar(256) NOT NULL, RTM_SRC_TXN_ID bigint NOT NULL, RTM_TARGET_TXN_ID bigint NOT NULL, PRIMARY KEY (RTM_REPL_POLICY, RTM_SRC_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.068 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE TABLE RUNTIME_STATS ( RS_ID bigint primary key, CREATE_TIME bigint NOT NULL, WEIGHT bigint NOT NULL, PAYLOAD blob ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.066 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> CREATE INDEX IDX_RUNTIME_STATS_CREATE_TIME ON RUNTIME_STATS(CREATE_TIME)
No rows affected (0.046 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> INSERT INTO VERSION (VER_ID, SCHEMA_VERSION, VERSION_COMMENT) VALUES (1, '3.1.0', 'Hive release version 3.1.0')
1 row affected (0.015 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40103 SET TIME_ZONE=@OLD_TIME_ZONE */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET SQL_MODE=@OLD_SQL_MODE */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40014 SET FOREIGN_KEY_CHECKS=@OLD_FOREIGN_KEY_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40014 SET UNIQUE_CHECKS=@OLD_UNIQUE_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET CHARACTER_SET_CLIENT=@OLD_CHARACTER_SET_CLIENT */
No rows affected (0.002 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET CHARACTER_SET_RESULTS=@OLD_CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40101 SET COLLATION_CONNECTION=@OLD_COLLATION_CONNECTION */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> /*!40111 SET SQL_NOTES=@OLD_SQL_NOTES */
No rows affected (0.001 seconds)
0: jdbc:mysql://192.168.18.69:3306/hive> !closeall
Closing: 0: jdbc:mysql://192.168.18.69:3306/hive?createDatabaseIfNotExist=true&useSSL=false&useUnicode=true&characterEncoding=utf-8&serverTimezone=UTC
beeline>
beeline> Initialization script completed
schemaTool completed
[root@node1 hive-3.1.3]#
2.4.4、在hdfs创建hive存储目录

先启动hadoop集群

如存在则不用操作

hadoop fs -mkdir /tmp
hadoop fs -mkdir -p /user/hive/warehouse
hadoop fs -chmod g+w /tmp
hadoop fs -chmod g+w /user/hive/warehouse

2.5、启动Hive

1、启动metastore服务

1、前台启动,进程会一直占据终端,ctrl+c结束进程,服务关闭。

可以根据需求添加参数开启debug日志,获取详细日志信息,便于排错。

# 前台启动
/export/server/hive-3.1.3/bin/hive --service metastore

#前台启动开启debug日志
/export/server/hive-3.1.3/bin/hive --service metastore --hiveconf hive.root.logger=DEBUG,console

#前台启动关闭方式 ctrl+c结束进程

[root@node1 ~]# /export/server/hive-3.1.3/bin/hive --service metastore
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl                                         -2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/commo                                         n/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2024-01-31 23:06:29: Starting Hive Metastore Server
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

2、后台启动,输出日志信息在/root目录下nohup.out

nohup /export/server/hive-3.1.3/bin/hive --service metastore &

# 后台挂起启动 结束进程
使用jps查看进程 使用kill -9 杀死进程

# nohup命令,在默认情况下(非重定向时),会输出一个名叫nohup.out的文件到当前目录下

[root@node1 ~]# nohup /export/server/hive-3.1.3/bin/hive --service metastore &
[1] 2815
[root@node1 ~]# nohup: ignoring input and appending output to ‘nohup.out’

[root@node1 ~]# jps
1555 NameNode
2947 Jps
1686 DataNode
2263 NodeManager
2077 ResourceManager
2815 RunJar
[root@node1 ~]# ll
total 28
-rw-r--r--. 1 root root   10 Jan  2 23:51 1.txt
-rw-------. 1 root root 1260 Dec 24 23:40 anaconda-ks.cfg
-rw-r--r--. 1 root root    2 Jan  7 00:31 a.txt
-rw-r--r--. 1 root root 1197 Dec 25 22:59 authorized_keys
-rw-r--r--. 1 root root    2 Jan  7 00:31 b.txt
-rw-r--r--. 1 root root    2 Jan  7 00:31 c.txt
-rw-------. 1 root root 1052 Jan 31 23:08 nohup.out
drwxr-xr-x. 2 root root   33 Jan  7 00:19 test
[root@node1 ~]# cat nohup.out
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2024-01-31 23:08:30: Starting Hive Metastore Server
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
[root@node1 ~]#

2.6、Hive自带客户端

/bin/hive、/bin/beeline

(1)Hive自带客户端

    Hive发展至今,总共历经了两代客户端工具。

    第一代客户端(deprecated不推荐使用):$HIVE_HOME/bin/hive,是一个shellUtil。主要功能:一是可用于以交互或批处理模式运行Hive查询;二是用于Hive相关服务的启动,比如metastore服务。

    第二代客户端(recommended推荐使用):$HIVE_HOME/bin/beeline,是一个JDBC客户端,是官方强烈推荐使用的Hive命令行工具,和第一代客户端相比,性能加强安全性提高。

[root@node1 ~]# cd /export/server/hive-3.1.3/bin/
[root@node1 bin]# ll
total 44
-rwxr-xr-x. 1 root root   881 Oct 24  2019 beeline
drwxr-xr-x. 3 root root  4096 Jan 29 23:53 ext
-rwxr-xr-x. 1 root root 10158 Mar 29  2022 hive
-rwxr-xr-x. 1 root root  2085 Feb 28  2022 hive-config.sh
-rwxr-xr-x. 1 root root   885 Oct 24  2019 hiveserver2
-rwxr-xr-x. 1 root root   880 Oct 24  2019 hplsql
-rwxr-xr-x. 1 root root  3064 Oct 24  2019 init-hive-dfs.sh
-rwxr-xr-x. 1 root root   832 Oct 24  2019 metatool
-rwxr-xr-x. 1 root root   884 Oct 24  2019 schematool
[root@node1 bin]#

(2)HiveServer2服务介绍

    远程模式下beeline通过Thrift连接到单独的HiveServer2服务上,这也是官方推荐在生产环境中使用的模式。

    HiveServer2支持多客户端的并发和身份认证,旨在为开放API客户端如JDBC、ODBC提供更好的支持。

关系梳理

    HiveServer2通过Metastore服务读写元数据。所以在远程模式下,启动HiveServer2之前必须首先启动metastore服务。

    特别注意:远程模式下,beeline客户端只能通过HiveServer2服务访问hive。而bin/hive是通过Metastore服务访问的。具体关系如下:

bin/beeline客户端使用

    在hive安装的服务器上,首先启动metastore服务,然后启动hiveserver2服务。启动先后间隔个30秒左右。因为一个服务启动后提供服务需要时间。

# 先启动metastore服务 然后启动hiveserver2服务
nohup /export/server/hive-3.1.3/bin/hive --service metastore &
nohup /export/server/hive-3.1.3/bin/hive --service hiveserver2 &

[root@node1 bin]# nohup /export/server/hive-3.1.3/bin/hive --service hiveserver2 &
[2] 3028
[root@node1 bin]# nohup: ignoring input and appending output to ‘nohup.out’

[root@node1 bin]# jps
1555 NameNode
3028 RunJar
1686 DataNode
2263 NodeManager
3159 Jps
2077 ResourceManager
2815 RunJar
[root@node1 bin]#

前提:node1上hadoop集群+hive启动完成

把node1上的hive安装包拷贝到node3上使用客户端来连接测试

[root@node1 ~]# scp -r /export/server/hive-3.1.3 root@node3:/export/server/
LICENSE                                       100%   20KB   1.4MB/s   00:00
RELEASE_NOTES.txt                             100%  540   366.0KB/s   00:00
NOTICE                                        100%  230   178.8KB/s   00:00
com.thoughtworks.paranamer-LICENSE            100% 1537   405.9KB/s   00:00
...
hive-webhcat-java-client-3.1.3.jar            100%  113KB  29.8MB/s   00:00
hive-jdbc-3.1.3-standalone.jar                100%   69MB  34.7MB/s   00:02
[root@node1 ~]#

    以下操作在node3上操作,实际连接的是node1上的hive服务,为什么?因为hive安装包下的配置文件hive-site.xml有指向node1的地址

<!-- 远程模式部署metastore metastore地址 -->
<property>
   <name>hive.metastore.uris</name>
   <value>thrift://node1:9083</value>
</property>
第1代客户端连接:bin/hive
[root@node3 ~]# /export/server/hive-3.1.3/bin/hive
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl                                                                                                                                                             -2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/commo                                                                                                                                                             n/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
which: no hbase in (/export/server/jdk1.8.0_202/bin:/usr/local/sbin:/usr/local/b                                                                                                                                                             in:/usr/sbin:/usr/bin:/export/server/hadoop-3.3.6/bin:/export/server/hadoop-3.3.                                                                                                                                                             6/sbin:/root/bin)
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl                                                                                                                                                             -2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/commo                                                                                                                                                             n/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Hive Session ID = c611ec90-b1d9-4f8b-ab01-7f2f0670fbc1

Logging initialized using configuration in jar:file:/export/server/hive-3.1.3/li                                                                                                                                                             b/hive-common-3.1.3.jar!/hive-log4j2.properties Async: true
Hive-on-MR is deprecated in Hive 2 and may not be available in the future versio                                                                                                                                                             ns. Consider using a different execution engine (i.e. spark, tez) or using Hive                                                                                                                                                              1.X releases.
Hive Session ID = 2f97c4e0-db42-4611-b7ba-5b720846fa84
hive> show databases;
OK
default
Time taken: 0.722 seconds, Fetched: 1 row(s)
hive> show tables;
OK
Time taken: 0.086 seconds
hive>

第2代客户端连接:bin/beeline客户端连接
# 连接访问
[root@node3 ~]# /export/server/hive-3.1.3/bin/beeline
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl                                                      -2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/commo                                                      n/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/export/server/hive-3.1.3/lib/log4j-slf4j-impl                                                      -2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/export/server/hadoop-3.3.6/share/hadoop/commo                                                      n/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Beeline version 3.1.3 by Apache Hive
# 需要连接地址
beeline> ! connect jdbc:hive2://node1:10000
Connecting to jdbc:hive2://node1:10000
# 输入用户root
Enter username for jdbc:hive2://node1:10000: root
# 没有密码直接回车
Enter password for jdbc:hive2://node1:10000:
Connected to: Apache Hive (version 3.1.3)
Driver: Hive JDBC (version 3.1.3)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://node1:10000> show databases;
INFO  : Compiling command(queryId=root_20240201221914_d96f999b-8872-487f-bc68-c90191e050a5): show databases
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null)
INFO  : Completed compiling command(queryId=root_20240201221914_d96f999b-8872-487f-bc68-c90191e050a5); Time taken: 0.947 seconds
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Executing command(queryId=root_20240201221914_d96f999b-8872-487f-bc68-c90191e050a5): show databases
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=root_20240201221914_d96f999b-8872-487f-bc68-c90191e050a5); Time taken: 0.112 seconds
INFO  : OK
INFO  : Concurrency mode is disabled, not creating a lock manager
+----------------+
| database_name  |
+----------------+
| default        |
+----------------+
1 row selected (1.562 seconds)
0: jdbc:hive2://node1:10000> show tables;
INFO  : Compiling command(queryId=root_20240201221928_a22fa273-1c0e-4fc2-8a6e-8a5f6966e3e5): show tables
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null)
INFO  : Completed compiling command(queryId=root_20240201221928_a22fa273-1c0e-4fc2-8a6e-8a5f6966e3e5); Time taken: 0.059 seconds
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Executing command(queryId=root_20240201221928_a22fa273-1c0e-4fc2-8a6e-8a5f6966e3e5): show tables
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=root_20240201221928_a22fa273-1c0e-4fc2-8a6e-8a5f6966e3e5); Time taken: 0.038 seconds
INFO  : OK
INFO  : Concurrency mode is disabled, not creating a lock manager
+-----------+
| tab_name  |
+-----------+
+-----------+
No rows selected (0.128 seconds)
0: jdbc:hive2://node1:10000>

2.7、Hive可视化客户端

    DataGrip、Dbeaver、SQuirrel SQL Client等

    可以在Windows、MAC平台中通过JDBC连接HiveServer2的图形界面工具。

    这类工具往往专门针对SQL类软件进行开发优化、页面美观大方,操作简洁,更重要的是SQL编辑环境优雅;SQL语法智能提示补全、关键字高亮、查询结果智能显示、按钮操作大于命令操作。

DataGrip

    DataGrip是由JetBrains公司推出的数据库管理软件,DataGrip支持几乎所有主流的关系数据库产品,如DB2、Derby、MySQL、Oracle、SQL Server等,也支持几乎所有主流的大数据生态圈SQL软件,并且提供了简单易用的界面,开发者上手几乎不会遇到任何困难。

DataGrip安装简单,注意安装路径不能有中文无空格即可。

开发工具--Tools

以上Hive环境+客户端连接成功。接下来的重点Hive建库与切换库操作。

Hadoop分布式文件系统(一)

Apache Hive(二)

请记住,你当下的结果,由过去决定;你现在的努力,在未来见效;
不断学习才能不断提高!磨炼,不断磨炼自己的技能!学习伴随我们终生!
生如蝼蚁,当立鸿鹄之志,命比纸薄,应有不屈之心。
乾坤未定,你我皆是黑马,若乾坤已定,谁敢说我不能逆转乾坤?
努力吧,机会永远是留给那些有准备的人,否则,机会来了,没有实力,只能眼睁睁地看着机会溜走。

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

杀神lwz

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值