flume 1.9.0 把kafka数据sink 到 hive

创建hive表

CREATE TABLE IF NOT EXISTS  user (userid string,sex string) PARTITIONED BY (dt string) clustered by (sex) into 2 buckets  row format delimited fields terminated by ',' stored as orc tblproperties  ('transactional'='true');

hive建表要求

1.必须要分桶
2. 存储格式必须orc
3. 必须开启事务

hive 配置要求

hive> set hive.support.concurrency=true;
hive> set hive.txn.manager=org.apache