[Hive]使用HDFS目录数据创建Hive表分区

最新推荐文章于 2021-10-31 16:54:19 发布

yeweiouyang

最新推荐文章于 2021-10-31 16:54:19 发布

阅读量8.8k

点赞数 1

分类专栏： [大数据]Hive Apache Hive

本文链接：https://blog.csdn.net/yeweiouyang/article/details/42082663

版权

描述：

Hive表pms.cross_sale_path建立以日期作为分区，将hdfs目录/user/pms/workspace/ouyangyewei/testUsertrack/job1Output/crossSale上的数据，写入该表的$yesterday分区上

表结构：

hive -e "
set mapred.job.queue.name=pms;

drop table if exists pms.cross_sale_path;
create external table pms.cross_sale_path
(
track_id string,
track_time string,
session_id string,
gu_id string,
end_user_id string,
page_category_id bigint,
algorithm_id int,
is_add_cart int,
rcmd_product_id bigint,
product_id bigint,
category_id bigint,
path_id string,
path_type int,
path_length int,
path_list string,
order_code string
)
PARTITIONED BY (ds string)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' 
LINES TERMINATED BY &