一、hive创建表失败,报错:

CREATE TABLE pokes (foo INT, bar STRING);
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: An exception was thrown while adding/validating class(es) : Specified key was too long; max key length is 767 bytes
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes


解决方法:
mysql> SET @@global.innodb_large_prefix = 1;

mysql> ALTER DATABASE hivedb character set latin1;




二、drop表报错卡主,日志看不到信息,


解决方法:

方法一:最后找到问题是mysql5.6.30,换了一个mysql5.1数据库版本,解决问题

方法二:针对mysql5.6.30的bug,需要手动初始化hive metastore,否则用户在drop table时候会卡主。在dmp-gateway数据库(配置文件中指定的mysql)


[root@DMP-GATEWAY ~]# cd /opt/amos/hive/bin/

[root@DMP-GATEWAY bin]# ./schematool -dbType mysql –initSchema

结果:

Starting metastore schema initialization to 1.2.0

Initialization script hive-schema-1.2.0.mysql.sql

Initialization script completed

查看数据库:

[root@DMP-GATEWAY ~]# mysql -uroot –p

mysql> show databases;

--------------------

Database

--------------------

information_schema

exp

hive

hivedb 可以看到hivedb数据库被创建



wKioL1ebPAzwqlOHAAB9XdgCCQM728.png-wh_50



wKioL1ebO1vzAuGoAABUOMTGjVc713.png-wh_50

wKiom1ebO1vS72r7AAAnCu1DEcQ170.png-wh_50



三、在mestatore初始化后,会自动创建hivedb数据库,清空所有表,或者

drop database hivedb

create database hivedb


source hive-txn-schema-0.14.0.mysql.sql

source hive-schema-1.2.0.mysql.sql


git地址:

https://github.com/apache/hive/tree/release-1.2.1/metastore/scripts/upgrade/mysql



四、报错

no library native-lzo


需要 yum install -y lzo