日志导入 Impala parquet表 步骤

1、在hue 中的file brower 上新建目录 /user/flume/flume_raw.db/o_onecloud_xxxx

2、选中目录 action -》change permission 修改目录权限  赋予写权限（x 打钩）。

3、建表加分区：

CREATE TABLE flume_raw.o_onecloud_xxxx (   
    stime TIMESTAMP COMMENT '日期' ) 
PARTITIONED BY (   ptime BIGINT ) 
COMMENT 'xxxxxxxx' 
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\u0001' 
WITH SERDEPROPERTIES ('serialization.format'='\u0001', 'field.delim'='\u0001') 
STORED AS TEXTFILE LOCATION 'hdfs://dc-hdfs/user/flume/flume_raw.db/o_onecloud_xxxx';

ALTER table flume_raw.o_onecloud_xxxxx ADD PARTITION(ptime=20180723000000);

refresh flume_raw.o_onecloud_blockchain_transaction_successtmp;
 

4、将数据导入parquet格式表中

insert overwrite onecloud_orig.o_onecloud_xxxx partition(ptime=20180723000000)
select

stime

from flume_raw.o_onecloud_xxxxx;