记录搭建分布式项目环境-MySQL集群

下了好多版本,都没有默认的my.cnf文件,发现5.7.17有,但其实my.cnf可以直接复制一份到etc下面就可以了,然后将basedir和datadir记得改好

[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-common-5.7.28-1.el7.x86_64.rpm [sudo] hadoop 的密码:
Verifying...                          ################################# [100%]
准备中...                          ################################# [100%]
正在升级/安装...
   1:mysql-community-common-5.7.28-1.e################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-5.7.28-1.el7.x86_64.rpm 
Verifying...                          ################################# [100%]
准备中...                          ################################# [100%]
正在升级/安装...
   1:mysql-community-libs-5.7.28-1.el7################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm 
错误:依赖检测失败:
	libcrypto.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libcrypto.so.10(libcrypto.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libssl.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libssl.so.10(libssl.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
[hadoop@localhost mysqlBundle]$ yum install -y libaio
错误:运行此命令需要管理员特权(多数系统下是root用户)。
[hadoop@localhost mysqlBundle]$ sudo yum install -y libaio
上次元数据过期检查:2:58:31 前,执行于 2021年10月19日 星期二 13时49分15秒。
软件包 libaio-0.3.112-1.el8.x86_64 已安装。
依赖关系解决。
无需任何处理。
完毕!
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm 
错误:依赖检测失败:
	libcrypto.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libcrypto.so.10(libcrypto.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libssl.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
	libssl.so.10(libssl.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
[hadoop@localhost mysqlBundle]$ yum install -y libssl
错误:运行此命令需要管理员特权(多数系统下是root用户)。
[hadoop@localhost mysqlBundle]$ sudo yum install -y libssl
上次元数据过期检查:2:59:20 前,执行于 2021年10月19日 星期二 13时49分15秒。
未找到匹配的参数: libssl
错误:没有任何匹配: libssl
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm --nodeps --force
Verifying...                          ################################# [100%]
准备中...                          ################################# [100%]
正在升级/安装...
   1:mysql-community-libs-compat-5.7.2################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-client-5.7.28-1.el7.x86_64.rpm Verifying...                          ################################# [100%]
准备中...                          ################################# [100%]
正在升级/安装...
   1:mysql-community-client-5.7.28-1.e################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-server-5.7.28-1.el7.x86_64.rpm Verifying...                          ################################# [100%]
准备中...                          ################################# [100%]
正在升级/安装...
   1:mysql-community-server-5.7.28-1.e################################# [100%]
[/usr/lib/tmpfiles.d/mysql.conf:23] Line references path below legacy directory /var/run/, updating /var/run/mysqld → /run/mysqld; please update the tmpfiles.d/ drop-in file accordingly.
[/usr/lib/tmpfiles.d/pesign.conf:1] Line references path below legacy directory /var/run/, updating /var/run/pesign → /run/pesign; please update the tmpfiles.d/ drop-in file accordingly.
[hadoop@localhost mysqlBundle]$ vim /usr/lib/
alsa/           firmware/       kdump/          ostree/         tmpfiles.d/
binfmt.d/       fontconfig/     kernel/         polkit-1/       tuned/
.build-id/      games/          locale/         python3.6/      udev/
cpp             gcc/            mdadm/          realmd/         vmware-caf/
cups/           grub/           modprobe.d/     rpm/            vmware-tools/
debug/          java/           modules/        sse2/           vmware-vgauth/
dracut/         jvm/            modules-load.d/ sysctl.d/       
eclipse/        jvm-commmon/    mozilla/        sysimage/       
environment.d/  jvm-private/    NetworkManager/ systemd/        
firewalld/      kbd/            os-release      sysusers.d/     
[hadoop@localhost mysqlBundle]$ vim /usr/lib/tmpfiles.d/mysql.conf 
[hadoop@localhost mysqlBundle]$ sudo vim /usr/lib/tmpfiles.d/mysql.conf 
[sudo] hadoop 的密码:
[hadoop@localhost mysqlBundle]$ cd  /usr/lib/tmpfiles.d/
[hadoop@localhost tmpfiles.d]$ ls
cockpit-tempfiles.conf    home.conf            mdadm.conf            rpcbind.conf               systemd-nspawn.conf
colord.conf               httpd.conf           mod_fcgid.conf        rpm.conf                   tmp.conf
criu.conf                 iscsi.conf           mysql.conf            samba.conf                 tuned.conf
cryptsetup.conf           journal-nocow.conf   openssh.conf          selinux-policy.conf        udisks2.conf
cups.conf                 legacy.conf          ostree-tmpfiles.conf  setroubleshoot.conf        var.conf
cups-lp.conf              libselinux.conf      pam.conf              spice-vdagentd.conf        x11.conf
dbus.conf                 libstoragemgmt.conf  pesign.conf           subscription-manager.conf
dnf.conf                  lockdev.conf         podman.conf           sudo.conf
etc.conf                  lvm2.conf            portables.conf        systemd.conf
gvfsd-fuse-tmpfiles.conf  man-db.conf          radvd.conf            systemd-nologin.conf
[hadoop@localhost tmpfiles.d]$ vim pesign.conf 
[hadoop@localhost tmpfiles.d]$ sudo vim pesign.conf 

rpm安装的时候出现的问题
[/usr/lib/tmpfiles.d/mysql.conf:23] Line references path below legacy directory /var/run/, updating /var/run/mysqld → /run/mysqld; please update the tmpfiles.d/ drop-in file accordingly.
[/usr/lib/tmpfiles.d/pesign.conf:1] Line references path below legacy directory /var/run/, updating /var/run/pesign → /run/pesign; please update the tmpfiles.d/ drop-in file accordingly.

[hadoop@localhost mysql]$  mysql -uroot -p
Enter password: 
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)

Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (2)
这个错误如果你当前使用的不是root用户应当尝试一下
sudo chmod -R 777 /var/lib/mysql/

这个stackoverflow里面很多办法

hive

[hadoop@localhost conf]$ schematool -initSchema -dbType mysql -verbose
Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
	at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:536)
	at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:554)
	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:448)
	at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141)
	at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5104)
	at org.apache.hive.beeline.HiveSchemaTool.<init>(HiveSchemaTool.java:96)
	at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1473)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:236)

hive里面的guava和hadoop里面的版本不一样,hadoop版本的更高
在这里插入图片描述
在这里插入图片描述
删掉
rm -rf guava-19.0.jar
将Hadoop更高版本的复制过来
cp guava-27.0-jre.jar /opt/hive3/lib/

然后初始化

[hadoop@localhost lib]$ schematool -initSchema -dbType mysql -verbose
Metastore connection URL:	 jdbc:mysql://hadoop102:3306/metastore?useSSL=false
Metastore Connection Driver :	 com.mysql.jdbc.Driver
Metastore connection User:	 root
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.mysql.sql
Connecting to jdbc:mysql://hadoop102:3306/metastore?useSSL=false
Connected to: MySQL (version 5.7.28)
Driver: MySQL Connector Java (version mysql-connector-java-5.1.27 ( Revision: alexander.soklakov@oracle.com-20131021093118-gtm1bh1vb450xipt ))
Transaction isolation: TRANSACTION_READ_COMMITTED
0: jdbc:mysql://hadoop102:3306/metastore> !autocommit on
Autocommit status: true
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET NAMES utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET TIME_ZONE='+00:00' */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `BUCKETING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAINT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.017 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `CDS` ( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.018 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `COLUMNS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` MEDIUMTEXT DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DATABASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `CTLGS` ( `CTLG_ID` BIGINT PRIMARY KEY, `NAME` VARCHAR(256), `DESC` VARCHAR(4000), `LOCATION_URI` VARCHAR(4000) NOT NULL, UNIQUE KEY `UNIQUE_CATALOG` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `CTLGS` VALUES (1, 'hive', 'Default catalog for Hive', 'TBD')
1 row affected (0.02 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DBS` ( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CTLG_NAME` varchar(256) NOT NULL DEFAULT 'hive', PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`, `CTLG_NAME`), CONSTRAINT `CTLG_FK1` FOREIGN KEY (`CTLG_NAME`) REFERENCES `CTLGS` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.014 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DB_PRIVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`AUTHORIZER`,`DB_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CONSTRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `GLOBAL_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE KEY `GLOBALPRIVILEGEINDEX` (`AUTHORIZER`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRANTOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `IDXS` ( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REBUILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`), KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.016 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `INDEX_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KEY `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`INDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.014 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NUCLEUS_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER` varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CONSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.02 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONEVENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITION_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`), KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PART_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `PART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`PART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `ROLES` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `ROLE_MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SDS` ( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSED` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` int(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), KEY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SD_PARAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PARAMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SEQUENCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `SEQUENCE_TABLE` (`SEQUENCE_NAME`, `NEXT_VAL`) VALUES ('org.apache.hadoop.hive.metastore.model.MNotificationLog', 1)
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SERDES` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESCRIPTION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_TYPE` integer, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SERDE_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KEY `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONSTRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_STRING_LIST_V决绝ALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`), KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FOREIGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.015 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SORT_COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_ID`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TABLE_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `TABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MV_CREATION_METADATA` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TXN_LIST` TEXT DEFAULT NULL, `MATERIALIZATION_TIME` bigint(20) NOT NULL, PRIMARY KEY (`MV_CREATION_METADATA_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX MV_UNIQUE_TABLE ON MV_CREATION_METADATA (TBL_NAME, DB_NAME) USING BTREE
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBLS` ( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEXT` mediumtext, `IS_REWRITE_ENABLED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MV_TABLES_USED` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `TBL_ID` bigint(20) NOT NULL, CONSTRAINT `MV_TABLES_USED_FK1` FOREIGN KEY (`MV_CREATION_METADATA_ID`) REFERENCES `MV_CREATION_METADATA` (`MV_CREATION_METADATA_ID`), CONSTRAINT `MV_TABLES_USED_FK2` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBL_COL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBL_PRIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TAB_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.141 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX TAB_COL_STATS_IDX ON TAB_COL_STATS (CAT_NAME, DB_NAME, TABLE_NAME, COLUMN_NAME) USING BTREE
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (CAT_NAME, DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TYPES` ( `TYPES_ID` bigint(20) NOT NULL, `TYPE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE1` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE2` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TYPES_ID`), UNIQUE KEY `UNIQUE_TYPE` (`TYPE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client     = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TYPE_FIELDS` ( `TYPE_NAME` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `FIELD_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `FIELD_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TYPE_NAME`,`FIELD_NAME`), KEY `TYPE_FIELDS_N49` (`TYPE_NAME`), CONSTRAINT `TYPE_FIELDS_FK1` FOREIGN KEY (`TYPE_NAME`) REFERENCES `TYPES` (`TYPES_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MASTER_KEYS` ( `KEY_ID` INTEGER NOT NULL AUTO_INCREMENT, `MASTER_KEY` VARCHAR(767) BINARY NULL, PRIMARY KEY (`KEY_ID`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DELEGATION_TOKENS` ( `TOKEN_IDENT` VARCHAR(767) BINARY NOT NULL, `TOKEN` VARCHAR(767) BINARY NULL, PRIMARY KEY (`TOKEN_IDENT`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `VERSION` ( `VER_ID` BIGINT NOT NULL, `SCHEMA_VERSION` VARCHAR(127) NOT NULL, `VERSION_COMMENT` VARCHAR(255), PRIMARY KEY (`VER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `FUNCS` ( `FUNC_ID` BIGINT(20) NOT NULL, `CLASS_NAME` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `CREATE_TIME` INT(11) NOT NULL, `DB_ID` BIGINT(20), `FUNC_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `FUNC_TYPE` INT(11) NOT NULL, `OWNER_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `OWNER_TYPE` VARCHAR(10) CHARACTER SET latin1 COLLATE latin1_bin, PRIMARY KEY (`FUNC_ID`), UNIQUE KEY `UNIQUEFUNCTION` (`FUNC_NAME`, `DB_ID`), KEY `FUNCS_N49` (`DB_ID`), CONSTRAINT `FUNCS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `FUNC_RU` ( `FUNC_ID` BIGINT(20) NOT NULL, `RESOURCE_TYPE` INT(11) NOT NULL, `RESOURCE_URI` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `INTEGER_IDX` INT(11) NOT NULL, PRIMARY KEY (`FUNC_ID`, `INTEGER_IDX`), CONSTRAINT `FUNC_RU_FK1` FOREIGN KEY (`FUNC_ID`) REFERENCES `FUNCS` (`FUNC_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NOTIFICATION_LOG` ( `NL_ID` BIGINT(20) NOT NULL, `EVENT_ID` BIGINT(20) NOT NULL, `EVENT_TIME` INT(11) NOT NULL, `EVENT_TYPE` varchar(32) NOT NULL, `CAT_NAME` varchar(256), `DB_NAME` varchar(128), `TBL_NAME` varchar(256), `MESSAGE` longtext, `MESSAGE_FORMAT` varchar(16), PRIMARY KEY (`NL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NOTIFICATION_SEQUENCE` ( `NNI_ID` BIGINT(20) NOT NULL, `NEXT_EVENT_ID` BIGINT(20) NOT NULL, PRIMARY KEY (`NNI_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `NOTIFICATION_SEQUENCE` (`NNI_ID`, `NEXT_EVENT_ID`) SELECT * from (select 1 as `NNI_ID`, 1 as `NOTIFICATION_SEQUENCE`) a WHERE (SELECT COUNT(*) FROM `NOTIFICATION_SEQUENCE`) = 0
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `KEY_CONSTRAINTS` ( `CHILD_CD_ID` BIGINT, `CHILD_INTEGER_IDX` INT(11), `CHILD_TBL_ID` BIGINT, `PARENT_CD_ID` BIGINT, `PARENT_INTEGER_IDX` INT(11) NOT NULL, `PARENT_TBL_ID` BIGINT NOT NULL, `POSITION` BIGINT NOT NULL, `CONSTRAINT_NAME` VARCHAR(400) NOT NULL, `CONSTRAINT_TYPE` SMALLINT(6)  NOT NULL, `UPDATE_RULE` SMALLINT(6), `DELETE_RULE` SMALLINT(6), `ENABLE_VALIDATE_RELY` SMALLINT(6) NOT NULL, `DEFAULT_VALUE` VARCHAR(400), PRIMARY KEY (`CONSTRAINT_NAME`, `POSITION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX `CONSTRAINTS_CONSTRAINT_TYPE_INDEX` ON KEY_CONSTRAINTS (`CONSTRAINT_TYPE`) USING BTREE
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `METASTORE_DB_PROPERTIES` ( `PROPERTY_KEY` varchar(255) NOT NULL, `PROPERTY_VALUE` varchar(1000) NOT NULL, `DESCRIPTION` varchar(1000), PRIMARY KEY(`PROPERTY_KEY`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_RESOURCEPLAN ( `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `QUERY_PARALLELISM` int(11), `STATUS` varchar(20) NOT NULL, `DEFAULT_POOL_ID` bigint(20), PRIMARY KEY (`RP_ID`), UNIQUE KEY `UNIQUE_WM_RESOURCEPLAN` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_POOL ( `POOL_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `PATH` varchar(767) NOT NULL, `ALLOC_FRACTION` DOUBLE, `QUERY_PARALLELISM` int(11), `SCHEDULING_POLICY` varchar(767), PRIMARY KEY (`POOL_ID`), UNIQUE KEY `UNIQUE_WM_POOL` (`RP_ID`, `PATH`), CONSTRAINT `WM_POOL_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> ALTER TABLE `WM_RESOURCEPLAN` ADD CONSTRAINT `WM_RESOURCEPLAN_FK1` FOREIGN KEY (`DEFAULT_POOL_ID`) REFERENCES `WM_POOL`(`POOL_ID`)
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_TRIGGER ( `TRIGGER_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `TRIGGER_EXPRESSION` varchar(1024), `ACTION_EXPRESSION` varchar(1024), `IS_IN_UNMANAGED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TRIGGER_ID`), UNIQUE KEY `UNIQUE_WM_TRIGGER` (`RP_ID`, `NAME`), CONSTRAINT `WM_TRIGGER_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_POOL_TO_TRIGGER ( `POOL_ID` bigint(20) NOT NULL, `TRIGGER_ID` bigint(20) NOT NULL, PRIMARY KEY (`POOL_ID`, `TRIGGER_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK1` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK2` FOREIGN KEY (`TRIGGER_ID`) REFERENCES `WM_TRIGGER` (`TRIGGER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_MAPPING ( `MAPPING_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `ENTITY_TYPE` varchar(128) NOT NULL, `ENTITY_NAME` varchar(128) NOT NULL, `POOL_ID` bigint(20), `ORDERING` int, PRIMARY KEY (`MAPPING_ID`), UNIQUE KEY `UNIQUE_WM_MAPPING` (`RP_ID`, `ENTITY_TYPE`, `ENTITY_NAME`), CONSTRAINT `WM_MAPPING_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`), CONSTRAINT `WM_MAPPING_FK2` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXNS ( TXN_ID bigint PRIMARY KEY, TXN_STATE char(1) NOT NULL, TXN_STARTED bigint NOT NULL, TXN_LAST_HEARTBEAT bigint NOT NULL, TXN_USER varchar(128) NOT NULL, TXN_HOST varchar(128) NOT NULL, TXN_AGENT_INFO varchar(128), TXN_META_INFO varchar(128), TXN_HEARTBEAT_COUNT int, TXN_TYPE int ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXN_COMPONENTS ( TC_TXNID bigint NOT NULL, TC_DATABASE varchar(128) NOT NULL, TC_TABLE varchar(128), TC_PARTITION varchar(767), TC_OPERATION_TYPE char(1) NOT NULL, TC_WRITEID bigint, FOREIGN KEY (TC_TXNID) REFERENCES TXNS (TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX TC_TXNID_INDEX ON TXN_COMPONENTS (TC_TXNID)
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPLETED_TXN_COMPONENTS ( CTC_TXNID bigint NOT NULL, CTC_DATABASE varchar(128) NOT NULL, CTC_TABLE varchar(256), CTC_PARTITION varchar(767), CTC_TIMESTAMP timestamp DEFAULT CURRENT_TIMESTAMP NOT NULL, CTC_WRITEID bigint, CTC_UPDATE_DELETE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX COMPLETED_TXN_COMPONENTS_IDX ON COMPLETED_TXN_COMPONENTS (CTC_DATABASE, CTC_TABLE, CTC_PARTITION) USING BTREE
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_TXN_ID ( NTXN_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_TXN_ID VALUES(1)
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE HIVE_LOCKS ( HL_LOCK_EXT_ID bigint NOT NULL, HL_LOCK_INT_ID bigint NOT NULL, HL_TXNID bigint NOT NULL, HL_DB varchar(128) NOT NULL, HL_TABLE varchar(128), HL_PARTITION varchar(767), HL_LOCK_STATE char(1) not null, HL_LOCK_TYPE char(1) not null, HL_LAST_HEARTBEAT bigint NOT NULL, HL_ACQUIRED_AT bigint, HL_USER varchar(128) NOT NULL, HL_HOST varchar(128) NOT NULL, HL_HEARTBEAT_COUNT int, HL_AGENT_INFO varchar(128), HL_BLOCKEDBY_EXT_ID bigint, HL_BLOCKEDBY_INT_ID bigint, PRIMARY KEY(HL_LOCK_EXT_ID, HL_LOCK_INT_ID), KEY HIVE_LOCK_TXNID_INDEX (HL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_LOCK_ID ( NL_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_LOCK_ID VALUES(1)
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPACTION_QUEUE ( CQ_ID bigint PRIMARY KEY, CQ_DATABASE varchar(128) NOT NULL, CQ_TABLE varchar(128) NOT NULL, CQ_PARTITION varchar(767), CQ_STATE char(1) NOT NULL, CQ_TYPE char(1) NOT NULL, CQ_TBLPROPERTIES varchar(2048), CQ_WORKER_ID varchar(128), CQ_START bigint, CQ_RUN_AS varchar(128), CQ_HIGHEST_WRITE_ID bigint, CQ_META_INFO varbinary(2048), CQ_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPLETED_COMPACTIONS ( CC_ID bigint PRIMARY KEY, CC_DATABASE varchar(128) NOT NULL, CC_TABLE varchar(128) NOT NULL, CC_PARTITION varchar(767), CC_STATE char(1) NOT NULL, CC_TYPE char(1) NOT NULL, CC_TBLPROPERTIES varchar(2048), CC_WORKER_ID varchar(128), CC_START bigint, CC_END bigint, CC_RUN_AS varchar(128), CC_HIGHEST_WRITE_ID bigint, CC_META_INFO varbinary(2048), CC_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( NCQ_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_COMPACTION_QUEUE_ID VALUES(1)
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE AUX_TABLE ( MT_KEY1 varchar(128) NOT NULL, MT_KEY2 bigint NOT NULL, MT_COMMENT varchar(255), PRIMARY KEY(MT_KEY1, MT_KEY2) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE WRITE_SET ( WS_DATABASE varchar(128) NOT NULL, WS_TABLE varchar(128) NOT NULL, WS_PARTITION varchar(767), WS_TXNID bigint NOT NULL, WS_COMMIT_ID bigint NOT NULL, WS_OPERATION_TYPE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXN_TO_WRITE_ID ( T2W_TXNID bigint NOT NULL, T2W_DATABASE varchar(128) NOT NULL, T2W_TABLE varchar(256) NOT NULL, T2W_WRITEID bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX TBL_TO_TXN_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_TXNID)
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX TBL_TO_WRITE_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_WRITEID)
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_WRITE_ID ( NWI_DATABASE varchar(128) NOT NULL, NWI_TABLE varchar(256) NOT NULL, NWI_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX NEXT_WRITE_ID_IDX ON NEXT_WRITE_ID (NWI_DATABASE, NWI_TABLE)
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE MIN_HISTORY_LEVEL ( MHL_TXNID bigint NOT NULL, MHL_MIN_OPEN_TXNID bigint NOT NULL, PRIMARY KEY(MHL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX MIN_HISTORY_LEVEL_IDX ON MIN_HISTORY_LEVEL (MHL_MIN_OPEN_TXNID)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE MATERIALIZATION_REBUILD_LOCKS ( MRL_TXN_ID bigint NOT NULL, MRL_DB_NAME VARCHAR(128) NOT NULL, MRL_TBL_NAME VARCHAR(256) NOT NULL, MRL_LAST_HEARTBEAT bigint NOT NULL, PRIMARY KEY(MRL_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `I_SCHEMA` ( `SCHEMA_ID` BIGINT PRIMARY KEY, `SCHEMA_TYPE` INTEGER NOT NULL, `NAME` VARCHAR(256), `DB_ID` BIGINT, `COMPATIBILITY` INTEGER NOT NULL, `VALIDATION_LEVEL` INTEGER NOT NULL, `CAN_EVOLVE` bit(1) NOT NULL, `SCHEMA_GROUP` VARCHAR(256), `DESCRIPTION` VARCHAR(4000), FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`), KEY `UNIQUE_NAME` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `SCHEMA_VERSION` ( `SCHEMA_VERSION_ID` bigint primary key, `SCHEMA_ID` BIGINT, `VERSION` INTEGER NOT NULL, `CREATED_AT` BIGINT NOT NULL, `CD_ID` BIGINT, `STATE` INTEGER NOT NULL, `DESCRIPTION` VARCHAR(4000), `SCHEMA_TEXT` mediumtext, `FINGERPRINT` VARCHAR(256), `SCHEMA_VERSION_NAME` VARCHAR(256), `SERDE_ID` bigint, FOREIGN KEY (`SCHEMA_ID`) REFERENCES `I_SCHEMA` (`SCHEMA_ID`), FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`), FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), KEY `UNIQUE_VERSION` (`SCHEMA_ID`, `VERSION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE REPL_TXN_MAP ( RTM_REPL_POLICY varchar(256) NOT NULL, RTM_SRC_TXN_ID bigint NOT NULL, RTM_TARGET_TXN_ID bigint NOT NULL, PRIMARY KEY (RTM_REPL_POLICY, RTM_SRC_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE RUNTIME_STATS ( RS_ID bigint primary key, CREATE_TIME bigint NOT NULL, WEIGHT bigint NOT NULL, PAYLOAD blob ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX IDX_RUNTIME_STATS_CREATE_TIME ON RUNTIME_STATS(CREATE_TIME)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO VERSION (VER_ID, SCHEMA_VERSION, VERSION_COMMENT) VALUES (1, '3.1.0', 'Hive release version 3.1.0')
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET TIME_ZONE=@OLD_TIME_ZONE */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET SQL_MODE=@OLD_SQL_MODE */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET FOREIGN_KEY_CHECKS=@OLD_FOREIGN_KEY_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET UNIQUE_CHECKS=@OLD_UNIQUE_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET CHARACTER_SET_CLIENT=@OLD_CHARACTER_SET_CLIENT */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET CHARACTER_SET_RESULTS=@OLD_CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET COLLATION_CONNECTION=@OLD_COLLATION_CONNECTION */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40111 SET SQL_NOTES=@OLD_SQL_NOTES */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> !closeall
Closing: 0: jdbc:mysql://hadoop102:3306/metastore?useSSL=false
beeline> 
beeline> Initialization script completed
schemaTool completed

解决报错:

[hadoop@localhost lib]$ hive
2021-10-19 17:40:29,235 INFO  [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 09fe8720-09f8-4bcc-a722-e33fbefa073b
2021-10-19 17:40:31,367 INFO  [main] SessionState: Hive Session ID = 09fe8720-09f8-4bcc-a722-e33fbefa073b

Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:40:31,432 INFO  [main] SessionState: 
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
Exception in thread "main" java.lang.RuntimeException: java.net.ConnectException: Call From hadoop102/192.168.206.128 to hadoop102:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

这个是因为没启动hadoop

[hadoop@localhost lib]$ hive
2021-10-19 17:42:27,409 INFO  [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 36761330-b5c1-44fb-ba2d-80ca8383f370
2021-10-19 17:42:29,805 INFO  [main] SessionState: Hive Session ID = 36761330-b5c1-44fb-ba2d-80ca8383f370

Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:42:29,886 INFO  [main] SessionState: 
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /tmp/hive. Name node is in safe mode.
The reported blocks 48 has reached the threshold 0.9990 of total blocks 48. The minimum number of live datanodes is not required. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:hadoop102
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1508)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1495)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3251)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1158)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:723)
	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1086)

SafeModeException:hadoop刚启动,所以还在安全模式,需要等一会再启动hive

启动成功

[hadoop@localhost lib]$ hive
2021-10-19 17:43:25,417 INFO  [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:27,614 INFO  [main] SessionState: Hive Session ID = 82ce7380-4aec-45ef-9e24-9822c2cfbe1f

Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:43:27,693 INFO  [main] SessionState: 
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:43:29,131 INFO  [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop
2021-10-19 17:43:29,143 INFO  [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,180 INFO  [main] session.SessionState: Created local directory: /tmp/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,189 INFO  [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f/_tmp_space.db
2021-10-19 17:43:29,207 INFO  [main] conf.HiveConf: Using the default value passed in for log id: 82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,208 INFO  [main] session.SessionState: Updating thread name to 82ce7380-4aec-45ef-9e24-9822c2cfbe1f main
2021-10-19 17:43:30,287 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-19 17:43:30,349 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-19 17:43:30,360 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-19 17:43:30,362 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
2021-10-19 17:43:30,364 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Unable to find config file hivemetastore-site.xml
2021-10-19 17:43:30,364 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file null
2021-10-19 17:43:30,366 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Unable to find config file metastore-site.xml
2021-10-19 17:43:30,366 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file null
2021-10-19 17:43:30,675 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
2021-10-19 17:43:30,971 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-1 - Starting...
2021-10-19 17:43:31,338 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-1 - Start completed.
2021-10-19 17:43:31,505 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-2 - Starting...
2021-10-19 17:43:31,545 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-2 - Start completed.
2021-10-19 17:43:31,626 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
2021-10-19 17:43:31,802 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-19 17:43:31,805 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Initialized ObjectStore
2021-10-19 17:43:32,095 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,095 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,096 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,097 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,097 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,098 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:35,532 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Setting location of default catalog, as it hasn't been done after upgrade
2021-10-19 17:43:35,568 WARN  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Failed to get database hive.default, returning NoSuchObjectException
2021-10-19 17:43:35,651 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Added admin role in metastore
2021-10-19 17:43:35,660 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Added public role in metastore
2021-10-19 17:43:35,709 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: No user is added in admin role, since config is empty
2021-10-19 17:43:35,922 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-19 17:43:35,958 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: 0: get_all_functions
2021-10-19 17:43:35,961 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_all_functions	
Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
2021-10-19 17:43:35,991 INFO  [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] CliDriver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Hive Session ID = 4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:35,992 INFO  [pool-10-thread-1] SessionState: Hive Session ID = 4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,018 INFO  [pool-10-thread-1] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,024 INFO  [pool-10-thread-1] session.SessionState: Created local directory: /tmp/hadoop/4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,036 INFO  [pool-10-thread-1] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/4a304c40-5ff9-4489-b42c-943f78629388/_tmp_space.db
2021-10-19 17:43:36,041 INFO  [pool-10-thread-1] metastore.HiveMetaStore: 1: get_databases: @hive#
2021-10-19 17:43:36,042 INFO  [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_databases: @hive#	
2021-10-19 17:43:36,047 INFO  [pool-10-thread-1] metastore.HiveMetaStore: 1: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-19 17:43:36,049 INFO  [pool-10-thread-1] metastore.ObjectStore: ObjectStore, initialize called
2021-10-19 17:43:36,095 INFO  [pool-10-thread-1] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-19 17:43:36,097 INFO  [pool-10-thread-1] metastore.ObjectStore: Initialized ObjectStore
2021-10-19 17:43:36,119 INFO  [pool-10-thread-1] metastore.HiveMetaStore: 1: get_tables_by_type: db=@hive#default pat=.*,type=MATERIALIZED_VIEW
2021-10-19 17:43:36,119 INFO  [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_tables_by_type: db=@hive#default pat=.*,type=MATERIALIZED_VIEW	
2021-10-19 17:43:36,141 INFO  [pool-10-thread-1] metastore.HiveMetaStore: 1: get_multi_table : db=default tbls=
2021-10-19 17:43:36,141 INFO  [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_multi_table : db=default tbls=	
2021-10-19 17:43:36,182 INFO  [pool-10-thread-1] metadata.HiveMaterializedViewsRegistry: Materialized views registry has been initialized
hive> 

下面开始shell编写hql语句
CREATE TABLE pokes (foo INT, bar STRING);

create table pokes(foo int,bar string);
2021-10-21 20:20:52,248 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] conf.HiveConf: Using the default value passed in for log id: 011bf2aa-1ba6-4dc6-a523-c2c937456640
2021-10-21 20:20:52,337 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Compiling command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb): create table pokes(foo int,bar string)
2021-10-21 20:20:52,808 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 20:20:52,811 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-21 20:20:52,831 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=011bf2aa-1ba6-4dc6-a523-c2c937456640, clientType=HIVECLI]
2021-10-21 20:20:52,832 WARN  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-21 20:20:52,833 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-21 20:20:52,834 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 20:20:52,835 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-21 20:20:52,835 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 20:20:52,835 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore
2021-10-21 20:20:52,838 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 20:20:52,838 WARN  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:52,838 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:52,853 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:52,853 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:52,854 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:52,863 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] parse.CalcitePlanner: Creating table default.pokes position=13
2021-10-21 20:20:52,884 WARN  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:52,884 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:52,894 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:52,894 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:52,894 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:52,895 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-21 20:20:52,895 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-21 20:20:52,925 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-21 20:20:52,939 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-21 20:20:52,944 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Completed compiling command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb); Time taken: 0.641 seconds
2021-10-21 20:20:52,945 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] reexec.ReExecDriver: Execution #1 of query
2021-10-21 20:20:52,945 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 20:20:52,946 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Executing command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb): create table pokes(foo int,bar string)
2021-10-21 20:20:52,961 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Starting task [Stage-0:DDL] in serial mode
2021-10-21 20:20:52,961 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook to org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl
2021-10-21 20:20:52,962 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 20:20:52,962 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-21 20:20:52,962 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 20:20:52,962 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore
2021-10-21 20:20:53,262 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 20:20:53,262 WARN  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:53,262 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:53,273 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:53,273 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:53,273 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:53,274 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore:  bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{totalSize=0, numRows=0, rawDataSize=0, COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"bar":"true","foo":"true"}}, numFiles=0, bucketing_version=2}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, privileges:PrincipalPrivilegeSet(userPrivileges:{hadoop=[PrivilegeGrantInfo(privilege:INSERT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true)]}, groupPrivileges:null, rolePrivileges:null), temporary:false, catName:hive, ownerType:USER)
2021-10-21 20:20:53,274 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{totalSize=0, numRows=0, rawDataSize=0, COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"bar":"true","foo":"true"}}, numFiles=0, bucketing_version=2}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, privileges:PrincipalPrivilegeSet(userPrivileges:{hadoop=[PrivilegeGrantInfo(privilege:INSERT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true)]}, groupPrivileges:null, rolePrivileges:null), temporary:false, catName:hive, ownerType:USER)	
2021-10-21 20:20:53,327 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] utils.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-21 20:20:53,476 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Completed executing command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb); Time taken: 0.531 seconds
OK
2021-10-21 20:20:53,476 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: OK
2021-10-21 20:20:53,476 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.174 seconds
2021-10-21 20:20:53,477 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] CliDriver: Time taken: 1.174 seconds
2021-10-21 20:20:53,477 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] conf.HiveConf: Using the default value passed in for log id: 011bf2aa-1ba6-4dc6-a523-c2c937456640
2021-10-21 20:20:53,477 INFO  [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] session.SessionState: Resetting thread name to  main

可以看出创建成功,但是日志太多了,我们来更改下日志级别

CREATE TABLE invites (foo INT, bar STRING) PARTITIONED BY (ds STRING);
在这里插入图片描述

在这里插入图片描述

hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes;
2021-10-21 22:45:33,338 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] conf.HiveConf: Using the default value passed in for log id: c8421de0-5d74-4add-948b-61ff8d1a68cb
2021-10-21 22:45:33,408 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Compiling command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-21 22:45:33,820 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 22:45:33,826 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:33,826 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-21 22:45:34,131 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-21 22:45:34,133 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-21 22:45:34,139 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Completed compiling command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba); Time taken: 0.758 seconds
2021-10-21 22:45:34,139 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] reexec.ReExecDriver: Execution #1 of query
2021-10-21 22:45:34,140 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 22:45:34,140 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Executing command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-21 22:45:34,158 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-21 22:45:34,160 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 22:45:34,161 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-21 22:45:34,161 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 22:45:34,161 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Loading data to table default.pokes
2021-10-21 22:45:34,161 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] exec.Task: Loading data to table default.pokes from file:/opt/hive3/examples/files/kv1.txt
2021-10-21 22:45:34,163 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 22:45:34,163 WARN  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 22:45:34,164 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 22:45:34,178 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 22:45:34,178 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 22:45:34,178 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 22:45:34,178 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,178 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-21 22:45:34,209 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,209 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-21 22:45:34,238 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-21 22:45:34,238 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-21 22:45:34,269 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-21 22:45:34,712 INFO  [Thread-10] hdfs.DataStreamer: Exception in createBlockOutputStream blk_1073741962_1138
java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as 192.168.206.130:9866
	at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:134)
	at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:110)
	at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1779)
	at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1680)
	at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:715)
2021-10-21 22:45:34,714 WARN  [Thread-10] hdfs.DataStreamer: Abandoning BP-483593717-192.168.206.128-1634263371490:blk_1073741962_1138
2021-10-21 22:45:34,723 WARN  [Thread-10] hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[192.168.206.130:9866,DS-8d36418c-fefe-4d2f-ae05-86485c844169,DISK]
2021-10-21 22:45:35,186 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,187 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_table: hive.default.pokes newtbl=pokes	
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-21 22:45:35,295 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] stats.BasicStatsTask: Executing stats task
2021-10-21 22:45:35,297 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 22:45:35,297 WARN  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 22:45:35,297 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 22:45:35,308 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 22:45:35,308 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 22:45:35,308 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 22:45:35,309 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:35,309 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-21 22:45:35,596 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,596 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_table: hive.default.pokes newtbl=pokes	
2021-10-21 22:45:35,644 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] stats.BasicStatsTask: Table default.pokes stats: [numFiles=1, numRows=0, totalSize=5812, rawDataSize=0]
2021-10-21 22:45:35,645 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Completed executing command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba); Time taken: 1.504 seconds
OK
2021-10-21 22:45:35,645 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: OK
2021-10-21 22:45:35,645 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 2.266 seconds
2021-10-21 22:45:35,646 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] CliDriver: Time taken: 2.266 seconds
2021-10-21 22:45:35,646 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] conf.HiveConf: Using the default value passed in for log id: c8421de0-5d74-4add-948b-61ff8d1a68cb
2021-10-21 22:45:35,646 INFO  [c8421de0-5d74-4add-948b-61ff8d1a68cb main] session.SessionState: Resetting thread name to  main

很明显就是9866端口未开放,开放下端口就可以了
sudo firewall-cmd --zone=public --add-port=9866/tcp --permanent

sudo firewall-cmd --reload

hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes;
2021-10-22 08:37:05,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:37:05,736 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-22 08:37:06,150 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:37:06,156 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,156 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 08:37:06,409 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:37:06,411 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:37:06,418 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff); Time taken: 0.702 seconds
2021-10-22 08:37:06,419 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:37:06,419 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:37:06,419 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-22 08:37:06,437 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:37:06,438 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:37:06,438 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:37:06,439 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:37:06,439 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Loading data to table default.pokes
2021-10-22 08:37:06,440 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.pokes from file:/opt/hive3/examples/files/kv1.txt
2021-10-22 08:37:06,442 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:37:06,442 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:37:06,442 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:37:06,454 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:37:06,454 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:37:06,455 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:37:06,455 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,455 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 08:37:06,488 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,488 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 08:37:06,517 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:37:06,517 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 08:37:06,582 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 08:37:06,925 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:06,925 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_table: hive.default.pokes newtbl=pokes	
2021-10-22 08:37:07,024 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:37:07,024 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:37:07,024 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:37:07,025 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:37:07,025 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:37:07,025 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:37:07,026 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:37:07,026 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:37:07,027 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:37:07,039 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:37:07,039 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:37:07,039 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:37:07,040 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:07,040 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 08:37:07,301 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:07,301 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_table: hive.default.pokes newtbl=pokes	
2021-10-22 08:37:07,350 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Table default.pokes stats: [numFiles=1, numRows=0, totalSize=5812, rawDataSize=0]
2021-10-22 08:37:07,350 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff); Time taken: 0.931 seconds
OK
2021-10-22 08:37:07,350 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:37:07,351 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.637 seconds
2021-10-22 08:37:07,352 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 1.637 seconds
2021-10-22 08:37:07,352 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:37:07,352 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to  main

hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15');
2021-10-22 08:39:48,122 INFO  [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:39:48,123 INFO  [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:39:48,124 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15')
2021-10-22 08:39:48,147 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:39:48,147 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,147 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:39:48,198 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=ce39fa7f-65fa-46a8-8069-3af52af74324, clientType=HIVECLI]
2021-10-22 08:39:48,199 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-22 08:39:48,199 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,200 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,201 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,202 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,202 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,202 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,213 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,213 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,214 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,220 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,220 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,275 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,275 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76); Time taken: 0.182 seconds
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:39:48,306 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15')
2021-10-22 08:39:48,324 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:39:48,324 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,324 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:39:48,324 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,324 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,325 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,325 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Loading data to table default.invites partition (ds=2008-08-15)
2021-10-22 08:39:48,325 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.invites partition (ds=2008-08-15) from file:/opt/hive3/examples/files/kv2.txt
2021-10-22 08:39:48,327 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,327 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,327 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,338 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,338 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,339 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,339 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,339 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:39:48,364 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,364 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,396 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.MoveTask: Partition is: {ds=2008-08-15}
2021-10-22 08:39:48,397 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: partition_name_has_valid_characters
2021-10-22 08:39:48,397 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=partition_name_has_valid_characters	
2021-10-22 08:39:48,397 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,397 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:39:48,420 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,421 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,453 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:39:48,453 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 08:39:48,459 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:39:48,525 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: add_partition : tbl=hive.default.invites
2021-10-22 08:39:48,525 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=add_partition : tbl=hive.default.invites	
2021-10-22 08:39:48,619 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,619 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,665 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,666 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:39:48,666 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:39:48,668 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,668 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,668 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,679 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,679 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,680 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,680 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,680 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:39:48,704 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,704 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]	
2021-10-22 08:39:48,753 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Partition {ds=2008-08-15} stats: [numFiles=1, numRows=0, totalSize=5791, rawDataSize=0]
2021-10-22 08:39:48,754 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_partitions : tbl=hive.default.invites
2021-10-22 08:39:48,754 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_partitions : tbl=hive.default.invites	
2021-10-22 08:39:48,754 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: New partition values:[2008-08-15]
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76); Time taken: 0.515 seconds
OK
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 0.697 seconds
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 0.697 seconds
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:39:48,821 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to  main

hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08');
2021-10-22 08:41:01,811 INFO  [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:01,811 INFO  [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:41:01,813 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08')
2021-10-22 08:41:01,835 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 08:41:01,835 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:01,837 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:01,838 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:01,838 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:01,838 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:01,849 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:01,849 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:01,849 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:01,849 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:01,849 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:01,869 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,869 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:01,897 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,897 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:01,922 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:41:01,922 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:41:01,923 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca); Time taken: 0.109 seconds
2021-10-22 08:41:01,923 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:41:01,923 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:01,923 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08')
2021-10-22 08:41:01,930 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:41:01,931 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:01,931 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:41:01,931 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,931 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:01,932 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,932 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:01,933 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,933 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Loading data to table default.invites partition (ds=2008-08-08)
2021-10-22 08:41:01,933 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.invites partition (ds=2008-08-08) from file:/opt/hive3/examples/files/kv3.txt
2021-10-22 08:41:01,936 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:01,937 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:01,937 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:01,950 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:01,950 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:01,950 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:01,951 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:01,951 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:01,970 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,970 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:01,999 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.MoveTask: Partition is: {ds=2008-08-08}
2021-10-22 08:41:01,999 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: partition_name_has_valid_characters
2021-10-22 08:41:01,999 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=partition_name_has_valid_characters	
2021-10-22 08:41:02,000 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:02,000 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:02,020 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,020 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:02,046 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:41:02,047 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 08:41:02,052 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-08
2021-10-22 08:41:02,120 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: add_partition : tbl=hive.default.invites
2021-10-22 08:41:02,120 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=add_partition : tbl=hive.default.invites	
2021-10-22 08:41:02,162 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,162 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:02,208 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:41:02,208 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:02,208 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 08:41:02,209 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:41:02,211 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:02,211 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:02,211 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:02,220 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:02,220 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:02,220 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:02,221 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:02,221 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:02,241 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,241 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]	
2021-10-22 08:41:02,286 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Partition {ds=2008-08-08} stats: [numFiles=1, numRows=0, totalSize=216, rawDataSize=0]
2021-10-22 08:41:02,287 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_partitions : tbl=hive.default.invites
2021-10-22 08:41:02,287 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=alter_partitions : tbl=hive.default.invites	
2021-10-22 08:41:02,287 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: New partition values:[2008-08-08]
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca); Time taken: 0.419 seconds
OK
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 0.529 seconds
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 0.529 seconds
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:02,342 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to  main

查询

hive> SELECT a.foo FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 08:41:38,476 INFO  [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:38,476 INFO  [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:41:38,478 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153): SELECT a.foo FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:41:38,502 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:38,506 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 08:41:38,510 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 08:41:38,510 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:41:38,510 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:38,510 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:38,531 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:41:38,542 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:41:38,590 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:38,592 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 08:41:38,605 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
2021-10-22 08:41:38,617 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] results.QueryResultsCache: Query results cache: cacheDirectory /tmp/hive/_resultscache_/results-68bf50f9-4555-423a-9026-4bef405d0d8a, maxCacheSize 2147483648, maxEntrySize 10485760, maxEntryLifetime 3600000
2021-10-22 08:41:39,292 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,292 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_not_null_constraints : tbl=hive.default.invites	
2021-10-22 08:41:39,301 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,301 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 08:41:39,310 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,310 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 08:41:39,315 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,316 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_unique_constraints : tbl=hive.default.invites	
2021-10-22 08:41:39,323 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:41:39,323 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites	
2021-10-22 08:41:40,088 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:41:40,088 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partitions_by_expr : tbl=hive.default.invites	
2021-10-22 08:41:40,166 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 08:41:40,167 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_databases: @hive#	
2021-10-22 08:41:40,174 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:41:40,174 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_materialized_views_for_rewriting: db=@hive#default	
2021-10-22 08:41:40,219 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:41:40,219 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:40,219 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:41:40,245 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:41:40,245 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:41:40,250 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:40,291 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1/-mr-10001/.hive-staging_hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:40,302 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 08:41:40,331 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 08:41:40,331 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 08:41:40,331 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 08:41:40,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 08:41:40,408 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 08:41:40,408 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Not eligible for results caching - no mr/tez/spark jobs
2021-10-22 08:41:40,408 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:41:40,408 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null)], properties:null)
2021-10-22 08:41:40,424 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 08:41:40,424 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: Initializing operator SEL[2]
2021-10-22 08:41:40,425 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: SELECT struct<foo:int,bar:string,ds:string>
2021-10-22 08:41:40,425 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.ListSinkOperator: Initializing operator LIST_SINK[5]
2021-10-22 08:41:40,433 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153); Time taken: 1.955 seconds
2021-10-22 08:41:40,433 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:41:40,433 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:40,433 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153): SELECT a.foo FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:41:40,440 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153); Time taken: 0.007 seconds
OK
2021-10-22 08:41:40,440 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:41:40,440 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:40,449 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2021-10-22 08:41:40,478 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapred.FileInputFormat: Total input files to process : 1
474
281
179
291
62
271
217
135
167
468
423
413
245
455
425
241
177
272
231
448
287
246
440
31
373
447
443
175
278
296
147
428
126
249
21
273
441
106
371
153
356
217
490
33
35
421
243
402
128
10
226
133
333
15
110
391
343
275
0
485
293
240
241
286
85
408
477
455
99
335
476
482
367
59
48
424
226
494
488
94
485
393
349
11
161
123
409
50
265
402
128
468
314
497
224
63
344
4
277
135
3
206
101
331
114
209
281
56
239
389
114
254
235
390
165
304
264
196
238
20
11
492
129
257
71
289
453
421
82
58
5
86
249
438
360
323
222
42
467
411
175
429
338
281
68
185
16
147
119
492
473
376
347
120
213
306
393
427
291
426
132
446
386
65
121
388
184
375
284
191
129
246
197
491
369
262
122
438
351
390
352
23
226
328
382
342
349
480
102
497
487
480
331
409
475
463
183
177
399
15
318
149
392
77
275
476
258
174
252
114
87
161
75
264
48
336
340
390
443
484
407
189
305
367
6
260
2
349
170
51
355
363
164
118
310
104
19
80
117
326
47
121
241
450
140
212
308
30
405
239
119
358
11
49
143
153
341
21
105
157
416
199
375
42
89
363
395
347
386
77
454
293
364
20
89
461
52
40
8
168
384
313
324
310
206
381
404
206
385
259
226
262
69
303
245
260
328
322
122
241
469
404
384
76
116
42
104
481
303
93
277
406
451
53
32
132
192
58
351
70
443
356
399
205
352
52
21
317
330
209
138
429
160
267
454
257
76
174
412
16
375
489
295
105
204
126
274
439
374
494
216
457
93
470
196
302
119
375
391
287
450
375
437
12
398
35
334
384
435
60
29
442
151
52
404
446
300
0
268
491
392
21
295
93
104
436
61
407
439
156
341
118
335
172
244
6
284
164
136
349
371
462
123
432
496
355
144
87
408
152
382
348
122
427
292
182
474
353
310
52
486
152
378
414
261
65
371
256
292
412
97
495
385
40
49
389
259
97
478
125
243
151
178
100
415
401
156
228
363
117
22
248
459
402
62
137
162
244
276
46
341
78
379
215
134
196
410
157
431
82
440
100
407
371
308
430
309
135
161
468
152
138
76
161
300
337
91
478
118
1
89
178
457
29
242
285
35
227
395
244
2021-10-22 08:41:40,566 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500, 
2021-10-22 08:41:40,566 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_2:500, RECORDS_OUT_INTERMEDIATE:0, 
2021-10-22 08:41:40,566 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.ListSinkOperator: RECORDS_OUT_OPERATOR_LIST_SINK_5:500, RECORDS_OUT_INTERMEDIATE:0, 
Time taken: 1.962 seconds, Fetched: 500 row(s)
2021-10-22 08:41:40,574 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 1.962 seconds, Fetched: 500 row(s)
2021-10-22 08:41:40,574 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:40,574 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to  main
hive> INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 08:44:30,993 INFO  [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:44:30,993 INFO  [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:44:30,994 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:44:31,008 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:31,008 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 08:44:31,009 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 08:44:31,009 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:44:31,009 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:44:31,009 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:44:31,030 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:44:31,030 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:44:31,030 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 08:44:31,036 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,036 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_not_null_constraints : tbl=hive.default.invites	
2021-10-22 08:44:31,041 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,041 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 08:44:31,046 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,047 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 08:44:31,050 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,050 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_unique_constraints : tbl=hive.default.invites	
2021-10-22 08:44:31,055 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:44:31,055 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites	
2021-10-22 08:44:31,089 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:44:31,089 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partitions_by_expr : tbl=hive.default.invites	
2021-10-22 08:44:31,135 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 08:44:31,135 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_databases: @hive#	
2021-10-22 08:44:31,140 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:44:31,140 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_materialized_views_for_rewriting: db=@hive#default	
2021-10-22 08:44:31,150 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:44:31,151 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:44:31,151 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 08:44:31,170 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:44:31,170 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:44:31,172 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,186 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,191 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 08:44:31,191 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 08:44:31,191 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 08:44:31,191 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 08:44:31,192 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 08:44:31,232 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] optimizer.GenMRFileSink1: using CombineHiveInputformat for the merge job
2021-10-22 08:44:31,300 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 08:44:31,305 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 08:44:31,305 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 08:44:31,333 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 08:44:31,333 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorized: true
2021-10-22 08:44:31,333 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 08:44:31,333 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 08:44:31,333 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 08:44:31,334 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 08:44:31,334 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 08:44:31,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:44:31,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:a.ds, type:string, comment:null)], properties:null)
2021-10-22 08:44:31,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a); Time taken: 0.341 seconds
2021-10-22 08:44:31,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:44:31,335 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:31,336 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:44:31,377 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a
2021-10-22 08:44:31,377 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Query ID = hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a
Total jobs = 3
2021-10-22 08:44:31,377 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Total jobs = 3
Launching Job 1 out of 3
2021-10-22 08:44:31,390 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Launching Job 1 out of 3
2021-10-22 08:44:31,403 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 08:44:31,403 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 08:44:31,410 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,422 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 08:44:31,426 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Processing alias a
2021-10-22 08:44:31,426 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:44:31,430 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,440 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 08:44:31,494 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2021-10-22 08:44:31,508 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 08:44:31,604 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.206.129:8032
2021-10-22 08:44:31,883 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.206.129:8032
2021-10-22 08:44:31,890 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: PLAN PATH = hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1/-mr-10004/5fe16d2f-6fa8-4156-a701-440522c7bc21/map.xml
2021-10-22 08:44:32,108 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 08:44:32,128 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1634862971391_0001
2021-10-22 08:44:32,860 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: PLAN PATH = hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1/-mr-10004/5fe16d2f-6fa8-4156-a701-440522c7bc21/map.xml
2021-10-22 08:44:32,860 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 08:44:32,872 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15; using filter path hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:44:32,879 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 08:44:32,885 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 08:44:32,886 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 08:44:32,968 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 08:44:32,981 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
2021-10-22 08:44:33,027 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: Submitting tokens for job: job_1634862971391_0001
2021-10-22 08:44:33,027 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 08:44:33,213 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.Configuration: resource-types.xml not found
2021-10-22 08:44:33,214 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-10-22 08:44:33,454 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] impl.YarnClientImpl: Submitted application application_1634862971391_0001
2021-10-22 08:44:33,499 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Job: The url to track the job: http://hadoop103:8088/proxy/application_1634862971391_0001/
Starting Job = job_1634862971391_0001, Tracking URL = http://hadoop103:8088/proxy/application_1634862971391_0001/
2021-10-22 08:44:33,501 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Starting Job = job_1634862971391_0001, Tracking URL = http://hadoop103:8088/proxy/application_1634862971391_0001/
Kill Command = /usr/local/hadoop3/bin/mapred job  -kill job_1634862971391_0001
2021-10-22 08:44:33,501 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Kill Command = /usr/local/hadoop3/bin/mapred job  -kill job_1634862971391_0001
Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2021-10-22 08:44:38,579 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2021-10-22 08:44:38,642 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2021-10-22 08:44:38,635 Stage-1 map = 0%,  reduce = 0%
2021-10-22 08:44:38,644 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: 2021-10-22 08:44:38,635 Stage-1 map = 0%,  reduce = 0%
2021-10-22 08:44:38,651 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
Ended Job = job_1634862971391_0001 with errors
2021-10-22 08:44:38,670 ERROR [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Ended Job = job_1634862971391_0001 with errors
Error during job, obtaining debugging information...
2021-10-22 08:44:38,672 ERROR [Thread-42] exec.Task: Error during job, obtaining debugging information...
2021-10-22 08:44:38,672 INFO  [Thread-42] Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2021-10-22 08:44:38,704 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] impl.YarnClientImpl: Killed application application_1634862971391_0001
2021-10-22 08:44:38,725 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
2021-10-22 08:44:38,725 ERROR [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 
2021-10-22 08:44:38,746 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: MapReduce Jobs Launched: 
2021-10-22 08:44:38,757 WARN  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
Stage-Stage-1:  HDFS Read: 0 HDFS Write: 0 FAIL
2021-10-22 08:44:38,760 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Stage-Stage-1:  HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 08:44:38,761 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 08:44:38,761 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a); Time taken: 7.411 seconds
2021-10-22 08:44:38,761 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:38,779 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:44:38,779 INFO  [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to  main

设置一下这个

set hive.exec.mode.local.auto=true;(默认为false)

就可以了

hive> INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 09:13:30,273 INFO  [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:13:30,273 INFO  [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:13:30,320 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 09:13:30,746 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:13:30,749 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:13:30,775 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=51408bd7-50c8-4a43-954e-a1517b55ac60, clientType=HIVECLI]
2021-10-22 09:13:30,778 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-22 09:13:30,778 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 09:13:30,781 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:13:30,781 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 09:13:30,781 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:13:30,782 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 09:13:30,783 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:13:30,784 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:13:30,784 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:13:30,795 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:13:30,795 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:13:30,796 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:13:30,805 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:13:30,805 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:13:30,806 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:13:30,807 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:13:30,817 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:13:30,817 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:13:30,818 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:13:30,821 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:13:30,821 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 09:13:30,934 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:13:30,940 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:13:30,942 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:13:30,951 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
2021-10-22 09:13:30,975 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] results.QueryResultsCache: Query results cache: cacheDirectory /tmp/hive/_resultscache_/results-80ac00fc-8385-47c1-9ee3-cbf30eed39bb, maxCacheSize 2147483648, maxEntrySize 10485760, maxEntryLifetime 3600000
2021-10-22 09:13:31,542 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,542 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_not_null_constraints : tbl=hive.default.invites	
2021-10-22 09:13:31,550 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,550 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 09:13:31,562 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,562 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 09:13:31,570 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,570 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_unique_constraints : tbl=hive.default.invites	
2021-10-22 09:13:31,578 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:13:31,578 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites	
2021-10-22 09:13:32,374 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 09:13:32,374 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partitions_by_expr : tbl=hive.default.invites	
2021-10-22 09:13:32,476 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 09:13:32,477 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_databases: @hive#	
2021-10-22 09:13:32,483 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:13:32,483 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_materialized_views_for_rewriting: db=@hive#default	
2021-10-22 09:13:32,526 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:13:32,526 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:13:32,526 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 09:13:32,560 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:13:32,560 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:13:32,598 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1
2021-10-22 09:13:32,612 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1
2021-10-22 09:13:32,617 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:13:32,648 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 09:13:32,648 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 09:13:32,648 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 09:13:32,652 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:13:32,744 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.GenMRFileSink1: using CombineHiveInputformat for the merge job
2021-10-22 09:13:32,814 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:13:32,817 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:13:32,817 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:13:32,844 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:13:32,845 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:13:32,845 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:13:32,845 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:13:32,845 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:13:32,883 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15 length: 5791 file count: 1  directory count: 1
2021-10-22 09:13:32,893 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cannot get size of hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002. Safely ignored.
2021-10-22 09:13:32,896 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cannot get size of hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002. Safely ignored.
Automatically selecting local only mode for query
2021-10-22 09:13:32,897 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:13:32,901 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:13:32,901 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 09:13:32,902 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:13:32,905 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:a.ds, type:string, comment:null)], properties:null)
2021-10-22 09:13:32,911 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b); Time taken: 2.615 seconds
2021-10-22 09:13:32,911 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:13:32,912 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:13:32,912 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Executing command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 09:13:32,920 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b
2021-10-22 09:13:32,920 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Query ID = hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b
Total jobs = 3
2021-10-22 09:13:32,920 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total jobs = 3
Launching Job 1 out of 3
2021-10-22 09:13:32,941 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Launching Job 1 out of 3
2021-10-22 09:13:32,956 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:13:32,956 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:13:32,971 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 09:13:32,975 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Processing alias a
2021-10-22 09:13:32,976 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 09:13:32,989 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 09:13:33,002 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 09:13:33,132 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:13:33,141 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,279 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 09:13:33,422 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,422 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 09:13:33,433 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15; using filter path hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 09:13:33,525 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 09:13:33,533 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 09:13:33,534 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 09:13:33,548 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 09:13:33,607 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1064075207_0001
2021-10-22 09:13:33,607 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 09:13:33,734 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.Job: The url to track the job: http://localhost:8080/
2021-10-22 09:13:33,737 INFO  [Thread-11] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
Job running in-process (local Hadoop)
2021-10-22 09:13:33,737 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Job running in-process (local Hadoop)
2021-10-22 09:13:33,739 INFO  [Thread-11] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:13:33,755 INFO  [Thread-11] mapred.LocalJobRunner: Waiting for map tasks
2021-10-22 09:13:33,760 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1064075207_0001_m_000000_0
2021-10-22 09:13:33,814 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2021-10-22 09:13:33,823 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: Paths:/user/hive/warehouse/invites/ds=2008-08-15/kv2.txt:0+5791InputFormatClass: org.apache.hadoop.mapred.TextInputFormat

2021-10-22 09:13:33,834 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,835 INFO  [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo
2021-10-22 09:13:33,874 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 09:13:33,879 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,903 INFO  [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.file is deprecated. Instead, use mapreduce.map.input.file
2021-10-22 09:13:33,903 INFO  [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.start is deprecated. Instead, use mapreduce.map.input.start
2021-10-22 09:13:33,903 INFO  [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.length is deprecated. Instead, use mapreduce.map.input.length
2021-10-22 09:13:33,903 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0
2021-10-22 09:13:33,926 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:13:33,927 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/sha
2021-10-22 09:13:33,927 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,931 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: Initializing operator MAP[0]
2021-10-22 09:13:33,958 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 
<MAP>Id =0
  <Children>null
  <\Children>
  <Parent><\Parent>
<\MAP>
2021-10-22 09:13:33,960 INFO  [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 09:13:33,960 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: Initializing operator SEL[7]
2021-10-22 09:13:33,964 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: Initializing operator FS[8]
2021-10-22 09:13:33,965 INFO  [LocalJobRunner Map Task Executor #0] Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2021-10-22 09:13:33,966 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe[[[B@6b876068]:[_col0, _col1, _col2]:[int, string, string]] and formatter : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat@2159a3c2
2021-10-22 09:13:33,966 INFO  [LocalJobRunner Map Task Executor #0] Configuration.deprecation: mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2021-10-22 09:13:33,974 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:34,091 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_tmp.-ext-10002/000000_0
2021-10-22 09:13:34,091 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_task_tmp.-ext-10002/_tmp.000000_0
2021-10-22 09:13:34,091 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_tmp.-ext-10002/000000_0
2021-10-22 09:13:34,135 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 1
2021-10-22 09:13:34,136 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 10
2021-10-22 09:13:34,137 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 100
2021-10-22 09:13:34,146 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:500, RECORDS_OUT_OPERATOR_MAP_0:0, 
2021-10-22 09:13:34,146 INFO  [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500, 
2021-10-22 09:13:34,146 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: RECORDS_OUT_OPERATOR_SEL_7:500, RECORDS_OUT_INTERMEDIATE:0, 
2021-10-22 09:13:34,146 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 500
2021-10-22 09:13:34,230 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_1:500, RECORDS_OUT_OPERATOR_FS_8:500, 
2021-10-22 09:13:34,233 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 
2021-10-22 09:13:34,247 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1064075207_0001_m_000000_0 is done. And is in the process of committing
2021-10-22 09:13:34,250 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15/kv2.txt:0+5791
2021-10-22 09:13:34,250 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1064075207_0001_m_000000_0' done.
2021-10-22 09:13:34,255 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: m Counters
		FILE: Number of bytes read=40629062
		FILE: Number of bytes written=41865245
		FILE: Number of read operations=0
		FILE: Number of large read operations=0
		FILE: Number of write operations=0
		HDFS: Number of bytes read=5791
		HDFS: Number of bytes written=11291
		HDFS: Number of read operations=26
		HDFS: Number of large read operations=0
		HDFS: Number of write operations=10
		HDFS: Number of bytes read erasure-coded=0
	Map-Reduce Framework
		Map input records=500
		Map output records=0
		Input split bytes=225
		Spilled Records=0
		Failed Shuffles=0
		Merged Map outputs=0
		GC time elapsed (ms)=10
		Total committed heap usage (bytes)=163270656
	HIVE
		CREATED_FILES=1
		DESERIALIZE_ERRORS=0
		RECORDS_IN=500
		RECORDS_OUT_1=500
		RECORDS_OUT_INTERMEDIATE=0
		RECORDS_OUT_OPERATOR_FS_8=500
		RECORDS_OUT_OPERATOR_MAP_0=0
		RECORDS_OUT_OPERATOR_SEL_7=500
		RECORDS_OUT_OPERATOR_TS_0=500
	File Input Format Counters 
		Bytes Read=0
	File Output Format Counters 
		Bytes Written=0
2021-10-22 09:13:34,255 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1064075207_0001_m_000000_0
2021-10-22 09:13:34,257 INFO  [Thread-11] mapred.LocalJobRunner: map task executor complete.
2021-10-22 09:13:34,753 Stage-1 map = 100%,  reduce = 0%
2021-10-22 09:13:34,753 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: 2021-10-22 09:13:34,753 Stage-1 map = 100%,  reduce = 0%
Ended Job = job_local1064075207_0001
2021-10-22 09:13:34,762 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Ended Job = job_local1064075207_0001
2021-10-22 09:13:34,794 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-6:CONDITIONAL] in serial mode
Stage-3 is selected by condition resolver.
2021-10-22 09:13:34,799 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-3 is selected by condition resolver.
Stage-2 is filtered out by condition resolver.
2021-10-22 09:13:34,799 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-2 is filtered out by condition resolver.
Stage-4 is filtered out by condition resolver.
2021-10-22 09:13:34,800 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-4 is filtered out by condition resolver.
2021-10-22 09:13:34,800 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-3:MOVE] in serial mode
2021-10-22 09:13:34,801 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:13:34,801 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 09:13:34,801 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:13:34,801 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Moving data to directory hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000
2021-10-22 09:13:34,801 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to directory hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000 from hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002
2021-10-22 09:13:34,829 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
Moving data to directory /tmp/hdfs_out
2021-10-22 09:13:34,829 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to directory /tmp/hdfs_out from hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000
MapReduce Jobs Launched: 
2021-10-22 09:13:34,852 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: MapReduce Jobs Launched: 
Stage-Stage-1:  HDFS Read: 5791 HDFS Write: 11291 SUCCESS
2021-10-22 09:13:34,852 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Stage-Stage-1:  HDFS Read: 5791 HDFS Write: 11291 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:13:34,852 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:13:34,852 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed executing command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b); Time taken: 1.94 seconds
OK
2021-10-22 09:13:34,852 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: OK
2021-10-22 09:13:34,853 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 4.558 seconds
2021-10-22 09:13:34,858 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] CliDriver: Time taken: 4.558 seconds
2021-10-22 09:13:34,858 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:13:34,858 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: Resetting thread name to  main

hive> INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a;
2021-10-22 09:20:36,949 INFO  [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:20:36,949 INFO  [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:20:36,951 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797): INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a
2021-10-22 09:20:36,966 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:20:36,966 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:20:36,966 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:20:36,977 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:20:36,977 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:20:36,978 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:20:36,978 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 09:20:36,978 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:20:36,979 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:20:36,981 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:20:36,981 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:20:36,981 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:20:36,992 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:20:36,992 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:20:36,992 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:20:36,992 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 09:20:36,992 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 09:20:37,022 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:20:37,022 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:20:37,022 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:20:37,027 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,027 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_not_null_constraints : tbl=hive.default.pokes	
2021-10-22 09:20:37,031 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,031 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.pokes	
2021-10-22 09:20:37,036 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,036 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.pokes	
2021-10-22 09:20:37,040 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,040 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_unique_constraints : tbl=hive.default.pokes	
2021-10-22 09:20:37,043 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=pokes
2021-10-22 09:20:37,043 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=pokes	
2021-10-22 09:20:37,081 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 09:20:37,081 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_databases: @hive#	
2021-10-22 09:20:37,085 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:20:37,085 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_materialized_views_for_rewriting: db=@hive#default	
2021-10-22 09:20:37,093 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:20:37,093 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 09:20:37,093 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.pokes	
2021-10-22 09:20:37,120 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:20:37,120 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:20:37,129 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1
2021-10-22 09:20:37,130 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/local_out/.hive-staging_hive_2021-10-22_09-20-36_964_3191088301170901390-1
2021-10-22 09:20:37,137 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:20:37,137 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(2)
2021-10-22 09:20:37,137 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(1)
2021-10-22 09:20:37,137 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:20:37,158 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:20:37,159 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:20:37,159 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:20:37,159 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:20:37,159 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:20:37,160 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:20:37,160 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:20:37,160 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:20:37,163 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/pokes length: 5812 file count: 1  directory count: 1
Automatically selecting local only mode for query
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null)], properties:null)
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797); Time taken: 0.213 seconds
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:20:37,164 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Executing command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797): INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a
2021-10-22 09:20:37,171 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797
2021-10-22 09:20:37,171 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Query ID = hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797
Total jobs = 1
2021-10-22 09:20:37,171 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total jobs = 1
Launching Job 1 out of 1
2021-10-22 09:20:37,172 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Launching Job 1 out of 1
2021-10-22 09:20:37,176 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:20:37,177 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:20:37,178 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 09:20:37,178 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Processing alias a
2021-10-22 09:20:37,178 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 09:20:37,181 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 09:20:37,193 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.35KB
2021-10-22 09:20:37,194 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:20:37,206 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:20:37,208 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,216 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 09:20:37,299 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,299 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 09:20:37,300 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/pokes; using filter path hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 09:20:37,305 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 09:20:37,306 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 09:20:37,306 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 09:20:37,308 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 09:20:37,338 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1497044033_0002
2021-10-22 09:20:37,339 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 09:20:37,435 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.Job: The url to track the job: http://localhost:8080/
Job running in-process (local Hadoop)
2021-10-22 09:20:37,435 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Job running in-process (local Hadoop)
2021-10-22 09:20:37,435 INFO  [Thread-23] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:20:37,436 INFO  [Thread-23] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:20:37,438 INFO  [Thread-23] mapred.LocalJobRunner: Waiting for map tasks
2021-10-22 09:20:37,438 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1497044033_0002_m_000000_0
2021-10-22 09:20:37,440 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2021-10-22 09:20:37,442 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: Paths:/user/hive/warehouse/pokes/kv1.txt:0+5812InputFormatClass: org.apache.hadoop.mapred.TextInputFormat

2021-10-22 09:20:37,442 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,443 INFO  [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo
2021-10-22 09:20:37,457 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 4.35KB
2021-10-22 09:20:37,458 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,464 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0
2021-10-22 09:20:37,465 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:20:37,467 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:20:37,467 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,467 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: Initializing operator MAP[0]
2021-10-22 09:20:37,468 INFO  [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 
<MAP>Id =0
  <Children>null
  <\Children>
  <Parent><\Parent>
<\MAP>
2021-10-22 09:20:37,469 INFO  [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 09:20:37,469 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: Initializing operator SEL[3]
2021-10-22 09:20:37,469 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: Initializing operator FS[4]
2021-10-22 09:20:37,470 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe[[[B@39f46052]:[_col0, _col1]:[int, string]] and formatter : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat@555ce525
2021-10-22 09:20:37,472 INFO  [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,480 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_tmp.-mr-10000/000000_0
2021-10-22 09:20:37,480 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_task_tmp.-mr-10000/_tmp.000000_0
2021-10-22 09:20:37,480 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_tmp.-mr-10000/000000_0
2021-10-22 09:20:37,489 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1
2021-10-22 09:20:37,490 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 10
2021-10-22 09:20:37,490 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 100
2021-10-22 09:20:37,492 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:500, RECORDS_OUT_OPERATOR_MAP_0:0, 
2021-10-22 09:20:37,492 INFO  [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500, 
2021-10-22 09:20:37,492 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: RECORDS_OUT_OPERATOR_SEL_3:500, RECORDS_OUT_INTERMEDIATE:0, 
2021-10-22 09:20:37,492 INFO  [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 500
2021-10-22 09:20:37,531 INFO  [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: RECORDS_OUT_OPERATOR_FS_4:500, RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_1:500, 
2021-10-22 09:20:37,532 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 
2021-10-22 09:20:37,535 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1497044033_0002_m_000000_0 is done. And is in the process of committing
2021-10-22 09:20:37,536 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: hdfs://hadoop102:8020/user/hive/warehouse/pokes/kv1.txt:0+5812
2021-10-22 09:20:37,536 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1497044033_0002_m_000000_0' done.
2021-10-22 09:20:37,536 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task: m Counters
		FILE: Number of bytes read=81257687
		FILE: Number of bytes written=83729159
		FILE: Number of read operations=0
		FILE: Number of large read operations=0
		FILE: Number of write operations=0
		HDFS: Number of bytes read=11603
		HDFS: Number of bytes written=17103
		HDFS: Number of read operations=54
		HDFS: Number of large read operations=0
		HDFS: Number of write operations=22
		HDFS: Number of bytes read erasure-coded=0
	Map-Reduce Framework
		Map input records=500
		Map output records=0
		Input split bytes=209
		Spilled Records=0
		Failed Shuffles=0
		Merged Map outputs=0
		GC time elapsed (ms)=0
		Total committed heap usage (bytes)=163270656
	HIVE
		CREATED_FILES=1
		DESERIALIZE_ERRORS=0
		RECORDS_IN=500
		RECORDS_OUT_1=500
		RECORDS_OUT_INTERMEDIATE=0
		RECORDS_OUT_OPERATOR_FS_4=500
		RECORDS_OUT_OPERATOR_MAP_0=0
		RECORDS_OUT_OPERATOR_SEL_3=500
		RECORDS_OUT_OPERATOR_TS_0=500
	File Input Format Counters 
		Bytes Read=0
	File Output Format Counters 
		Bytes Written=0
2021-10-22 09:20:37,536 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1497044033_0002_m_000000_0
2021-10-22 09:20:37,536 INFO  [Thread-23] mapred.LocalJobRunner: map task executor complete.
2021-10-22 09:20:38,439 Stage-1 map = 100%,  reduce = 0%
2021-10-22 09:20:38,439 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: 2021-10-22 09:20:38,439 Stage-1 map = 100%,  reduce = 0%
Ended Job = job_local1497044033_0002
2021-10-22 09:20:38,441 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Ended Job = job_local1497044033_0002
2021-10-22 09:20:38,459 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 09:20:38,459 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:20:38,459 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Cleaning up thread local RawStore...	
2021-10-22 09:20:38,460 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:20:38,460 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=Done cleaning up thread local RawStore	
Moving data to local directory /tmp/local_out
2021-10-22 09:20:38,460 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to local directory /tmp/local_out from hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10000
2021-10-22 09:20:38,460 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: /tmp/local_out
MapReduce Jobs Launched: 
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: MapReduce Jobs Launched: 
Stage-Stage-1:  HDFS Read: 11603 HDFS Write: 17103 SUCCESS
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Stage-Stage-1:  HDFS Read: 11603 HDFS Write: 17103 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed executing command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797); Time taken: 1.308 seconds
OK
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: OK
2021-10-22 09:20:38,472 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.521 seconds
2021-10-22 09:20:38,477 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] CliDriver: Time taken: 1.521 seconds
2021-10-22 09:20:38,477 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:20:38,477 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: Resetting thread name to  main

hive> create table events as SELECT a.bar, count(*) FROM invites a WHERE a.foo > 0 GROUP BY a.bar;
2021-10-22 09:25:40,003 INFO  [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:25:40,003 INFO  [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:25:40,004 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022092540_2175849b-d1d7-41de-beb8-59afdc172bc6): create table events as SELECT a.bar, count(*) FROM invites a WHERE a.foo > 0 GROUP BY a.bar
2021-10-22 09:25:40,020 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:25:40,020 WARN  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:25:40,020 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:25:40,031 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:25:40,032 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:25:40,032 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:25:40,032 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:25:40,032 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:25:40,033 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Creating table default.events position=13
2021-10-22 09:25:40,034 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.events
2021-10-22 09:25:40,034 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.events	
2021-10-22 09:25:40,041 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,041 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,047 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:25:40,047 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:25:40,048 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:25:40,048 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 09:25:40,072 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:25:40,072 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:25:40,072 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,073 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,079 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/.hive-staging_hive_2021-10-22_09-25-40_016_3824792441440869218-1
2021-10-22 09:25:40,090 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:25:40,094 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,094 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_not_null_constraints : tbl=hive.default.invites	
2021-10-22 09:25:40,099 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,099 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 09:25:40,104 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,104 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_primary_keys : tbl=hive.default.invites	
2021-10-22 09:25:40,108 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,109 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_unique_constraints : tbl=hive.default.invites	
2021-10-22 09:25:40,113 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:25:40,113 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites	
2021-10-22 09:25:40,185 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_partitions : tbl=hive.default.invites
2021-10-22 09:25:40,185 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_partitions : tbl=hive.default.invites	
2021-10-22 09:25:40,232 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Creating table default.events position=13
2021-10-22 09:25:40,232 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.events
2021-10-22 09:25:40,232 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.events	
2021-10-22 09:25:40,236 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,237 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,242 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:25:40,242 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:25:40,242 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_table : tbl=hive.default.invites	
2021-10-22 09:25:40,268 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:25:40,268 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:25:40,269 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,269 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,283 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,283 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,289 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(7)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(6)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for GBY(5)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for RS(4)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for GBY(3)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 09:25:40,290 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:25:40,293 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.ColumnPrunerProcFactory: RS 4 oldColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]}
2021-10-22 09:25:40,293 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.ColumnPrunerProcFactory: RS 4 newColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]}
2021-10-22 09:25:40,295 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,295 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,301 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,302 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop	ip=unknown-ip-addr	cmd=get_database: @hive#default	
2021-10-22 09:25:40,329 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:25:40,329 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:25:40,329 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:25:40,337 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vector GROUP BY operator will use processing mode HASH
2021-10-22 09:25:40,347 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:25:40,347 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:25:40,347 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:25:40,347 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:25:40,347 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:25:40,348 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorization enabled: false
2021-10-22 09:25:40,348 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorized: false
2021-10-22 09:25:40,348 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorizedVertexNum: 1
2021-10-22 09:25:40,348 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reducer hive.vectorized.execution.reduce.enabled: true
2021-10-22 09:25:40,348 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reducer engine: mr
2021-10-22 09:25:40,353 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15 length: 5791 file count: 1  directory count: 1
2021-10-22 09:25:40,353 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-08 length: 216 file count: 1  directory count: 1
Automatically selecting local only mode for query
2021-10-22 09:25:40,353 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:25:40,355 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:25:40,355 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:25:40,355 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:_c1, type:bigint, comment:null)], properties:null)
2021-10-22 09:25:40,355 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022092540_2175849b-d1d7-41de-beb8-59afdc172bc6); Time taken: 0.351 seconds
2021-10-22 09:25:40,356 INFO  [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:25:40,356 INFO  [51408bd7-50c8-


在这里插入图片描述
在这里插入图片描述
在这里插入图片描述

![在这里插入图片描述](https://img-blog.csdnimg.cn/8b2b59e306cb4480ad422e7410e08938.png?x-oss-process=image/watermark,type_ZHJvaWRzYW5zZmFsbGJhY2s,shadow_50,text_Q1NETiBAPz9vPz8_,size_20,color_FFFFFF,t_70,g_se

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
搭建流程如下: 1. 创建虚拟机模板机:先安装虚拟化软件,如VMware Workstation,然后安装一个操作系统,如CentOS,配置好环境和软件,最后将其保存为虚拟机模板机。 2. 创建分布式集群:使用虚拟机模板机创建多个虚拟机,每个虚拟机都要安装相同的操作系统和软件,配置好网络和主机名等信息。然后使用分布式集群软件,如Apache Hadoop,将这些虚拟机组成一个分布式集群。 3. 安装OpenResty:在分布式集群中选择一台虚拟机,安装OpenResty,配置好Nginx和Lua环境,实现高性能的Web应用开发。 4. 安装Hadoop:在分布式集群中选择一台虚拟机,安装Hadoop,配置好HDFS和MapReduce等组件,实现大规模数据的分布式存储和处理。 5. 安装Zookeeper:在分布式集群中选择一台虚拟机,安装Zookeeper,配置好ZAB协议,实现分布式应用程序协调服务。 6. 安装Flume:在分布式集群中选择一台虚拟机,安装Flume,配置好数据采集和传输管道,实现数据的收集和传输。 7. 安装Hive和MySQL:在分布式集群中选择一台虚拟机,安装Hive和MySQL,配置好元数据和数据存储,实现数据的查询和分析。 8. 安装Zeppelin:在分布式集群中选择一台虚拟机,安装Zeppelin,配置好可视化工具和数据源,实现数据的可视化和探索。 9. 安装DolphinScheduler:在分布式集群中选择一台虚拟机,安装DolphinScheduler,配置好任务调度和执行,实现自动化任务的执行和管理。 10. 安装SuperSet:在分布式集群中选择一台虚拟机,安装SuperSet,配置好可视化工具和数据源,实现数据的可视化和探索。 以上是搭建流程的大致步骤,具体实现过程需要根据实际情况进行配置和调整。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值