shell 脚本导出hive查询结果为csv文件

今天遇到需求，导出hive维表查询结果到csv文件。

cat_id1="off_cat_id1,off_cat_name1,c1id"
cat_id2="off_cat_id2,off_cat_name2,c2id"
cat_id3="off_cat_id3,off_cat_name3,c3id"
cat_id4="off_cat_id4,off_cat_name4,c4id"
off_brand_id="off_brand_id,off_brand_name,brand_id"


array=($cat_id1 $cat_id2 $cat_id3 $cat_id4 $off_brand_id)

for ((i=0;i<${#array[@]};i++))
do
    echo ${array[i]};
    title=`echo ${array[i]} | cut -d "," -f1`
    col2=`echo ${array[i]} | cut -d "," -f2`
    name=`echo ${array[i]} | cut -d "," -f3`
    echo ${title};
    hive -e "
        select  '$name' as dic_code, ${title}, ${col2},  row_number() over() rank  from eds2.eds_sku_v2_online_offline_sku where dt='20211025' and ${title}!='-999' group by ${title}, ${col2}
        " | sed 's/[\t]/,/g'  > ${title}.csv
done

| sed 是利用sed将查询结果中的制表符转换成csv中需要的逗号