spark-sql --executor-memory 10G --driver-memory 10G --num-executors 10 --executor-cores 10 --master yarn -e "
create table bdm_gemini.tmp_dp_feature6_pc_concat_year
as
select a.gid1, collect_set(concat_ws(':',cast(b.idx as string), cast(\`_c2\` as string)))
from
bdm_gemini.tmp_dp_feature6_pc_year a
join
(
select * from bdm_gemini.tmp_dp_feature_class6_cid_num
where l_date='2016-07-31'
) b
on a.cid=b.cid
group by a.gid1;"
spark-sql执行
最新推荐文章于 2023-11-21 05:27:29 发布