hive解析jsonb

get_json_object(string json_string, string path)

说明:
第一个参数填写json对象变量,第二个参数使用$表示json变量标识,然后用 . 或 [] 读取对象或数组;如果输入的json字符串无效,那么返回NULL。
每次只能返回一个数据项。

举例:
data 为 test表中的字段,数据结构如下:

data =
{
 "store":
        {
         "fruit":[{"weight":8,"type":"apple"}, {"weight":9,"type":"pear"}],  
         "bicycle":{"price":19.95,"color":"red"}
         }, 
 "email":"amy@only_for_json_udf_test.net", 
 "owner":"amy" 
}

1.get单层值

hive> select  get_json_object(data, '$.owner') from test;
结果:amy

2.get多层值.

hive> select  get_json_object(data, '$.store.bicycle.price') from test;
结果:19.95

3.get数组值[]

hive> select  get_json_object(data, '$.store.fruit[0]') from test;
结果:{"weight":8,"type":"apple"}

数组+json解析

例子

{"personal_solvency":
{"outside_pengyuan_personal_solvency":
{"result":"{\"receiveTime\":\"20190712 11:45:11\",\"cisReport\":
[{\"reportID\":\"2019071211063117\",\"queryReasonID\":\"101\",\"subReportTypes\":\"16000\",\"personAnnualIncome\":{\"income\":\"5.9-6.5\",\"subReportTypeCost\":\"16000\",\"subReportType\":\"16000\",\"errorMessage\":\"\",\"treatResult\":\"1\"},\"hasSystemError\":\"false\",\"treatResult\":\"2\",\"buildEndTime\":\"2019-07-12 11:45:11\",\"isFrozen\":\"false\",\"subReportTypesShortCaption\":\"1、个人偿债能力分析(16000)\"}],\"batNo\":\"2019071211063109\",\"unitName\":\"杭州义牛网络技术有限公司\",\"queryUserID\":\"ynwlwsqueryn01\",\"subOrgan\":\"金融技术部/数据支持组\",\"queryCount\":\"1\"}"}},"pengyuan":{"outside_pengyuan_score":{"unit_name":"杭州义牛网络技术有限公司","query_user_id":"ynwlwsqueryn01","bat_no":"2019071211063126","outside_cis_report":[{"person_apply_score_info_sub_report_type":"15105","outside_query_conditions":[{"name":"name","caption":"被查询者姓名","value":"2$1$AAADtpnSP1DHSruSuKfXIfWHKlU="},{"name":"documentNo","caption":"被查询者证件号码","value":"2$1$AAADl2i9tr8mB67jlKSQPhqC08XlL3PVDtpYpsWzaGhSlp+Q"},{"name":"phone","caption":"手机号码","value":"2$1$AAADvPBaKyLR/wl/XFHkrXW9H4o="}],"sub_report_types":"15105","is_frozen":"false","treat_result":"2","query_reason_id":"101","person_apply_score_info_score":"164","person_apply_score_info_treat_result":"1","build_end_time":"2019-07-12 11:45:12","has_system_error":"false","report_id":"2019071211063134","person_apply_score_info_advice":"建议人工审批","person_apply_score_info_sub_report_type_cost":"15105","sub_report_types_short_caption":"1、DR模型(15105)","person_apply_score_info_grade":"中风险","person_apply_score_info_error_message":""}],"query_count":"1","receive_time":"20190712 11:45:12","sub_organ":"金融技术部/数据支持组","version":1}}}

解析出income

select *,get_json_object(aa, '$.personAnnualIncome.income') as income
from(
select output,a,get_json_object(a, '$.cisReport[0]') as aa
from (
select *,get_json_object(output, '$.personal_solvency.outside_pengyuan_personal_solvency.result') as a
from userdb.py_test_200_not_loan_result
where output is not null
)t0)t0

参考:https://blog.csdn.net/qq_34105362/article/details/80454697

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Hive中,我们可以使用一些内置的函数来解析JSON数据。其中最常用的函数是get_json_object和json_tuple。get_json_object函数用于提取JSON对象中的特定字段值,而json_tuple函数则可以一次解析多个JSON字段。但是这两个函数都无法处理JSON数组的情况。对于处理JSON数组,我们可以使用自定义的serde(序列化/反序列化)来解析。一个常用的serde是json-serde,它可以帮助Hive解析和处理JSON数据。你需要将json-serde.jar添加到Hive的classpath中,并创建一个外部表来指定使用该serde。然后可以使用Hive的查询语句来解析JSON数组中的数据。例如,你可以使用add jar命令将json-serde.jar添加到Hive中,并创建一个表来解析JSON数组数据。具体的使用方法可以参考相关文档或指南。<span class="em">1</span><span class="em">2</span><span class="em">3</span> #### 引用[.reference_title] - *1* *2* [学会Hive解析Json数组](https://blog.csdn.net/ytp552200ytp/article/details/125277965)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 50%"] - *3* [hive解析json格式数据所需jar包](https://download.csdn.net/download/ls386239766/8662797)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 50%"] [ .reference_list ]

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值