读json文件

最新推荐文章于 2024-03-14 09:31:52 发布
最新推荐文章于 2024-03-14 09:31:52 发布
阅读量155 收藏
点赞数
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/Taoxiaoku/article/details/109993884
版权

scala> val fileRDD=sc.textFile(“hdfs://192.168.5.51:9000/kb09file/op.log”)

scala> val jsonStrRDD=fileRDD.map(x=>x.split(’|’)).map(x=>(x(0),x(1)))

scala> val jsonRDD=jsonStrRDD.map(x=>{var jsonStr=x._2;jsonStr
= jsonStr.substring(0,jsonStr.length-1);jsonStr+",“id”:""+x._1+""}"}) //加双引号才是json字符串 很重要

scala> val jsonDF=jsonRDD.toDF

scala> jsonDF.printSchema
root
|-- value: string (nullable = true)

scala> import spark.implicits._
scala> import org.apache.spark.sql.functions._
scala> import org.apache.spark.sql._
scala> import org.apache.spark.sql.types._

scala> jsonDF.select(get_json_object( " v a l u e " , " "value"," "value",".cm").alias(“cm”)).printSchema
root
|-- cm: string (nullable = true)

scala> jsonDF.select(get_json_object( " v a l u e " , " "value"," "value",".cm").alias(“cm”)).show
±-------------------+
| cm|
±-------------------+
|{“ln”:"-55.0",“sv…|
|{“ln”:”-114.9","s…|
±-------------------+

scala> jsonDF.select(get_json_object( " v a l u e " , " "value"," "value",".cm").alias(“cm”),get_json_object( " v a l u e " , " "value"," "value",".ap").alias(“ap”),
get_json_object( " v a l u e " , " "value"," "value",".et").alias(“et”),get_json_object( " v a l u e " , " "value"," "value",".id").alias(“id”)).show()
±-------------------±–±-------------------±------------+
| cm| ap| et| id|
±-------------------±–±-------------------±------------+
|{“ln”:"-55.0",“sv…|app|[{“ett”:“15930500…|1593136280858|
|{“ln”:”-114.9”,"s…|app|[{“ett”:"15930632…|1593136280858|
±-------------------±–±-------------------±------------+

//将json字符串结构化
//表头 cm ap et id
//列 a1 b1 c1 d1
scala> val jsonDF2 = jsonDF.select(get_json_object( " v a l u e " , " "value"," "value",".cm").alias(“cm”),get_json_object( " v a l u e " , " "value"," "value",".ap").alias(“ap”)
,get_json_object( " v a l u e " , " "value"," "value",".et").alias(“et”),get_json_object( " v a l u e " , " "value"," "value",".id").alias(“id”))

scala> jsonDF2.printSchema
root
|-- cm: string (nullable = true)
|-- ap: string (nullable = true)
|-- et: string (nullable = true)
|-- id: string (nullable = true)

scala> jsonDF2.select( " i d " , "id", "id",“ap”, " c m " , "cm", "cm",“et”).show
±------------±–±-------------------±-------------------+
| id| ap| cm| et|
±------------±–±-------------------±-------------------+
|1593136280858|app|{“ln”:"-55.0",“sv…|[{“ett”:“15930500…|
|1593136280858|app|{“ln”:”-114.9”,"s…|[{“ett”:"15930632…|
±------------±–±-------------------±-------------------+

scala> val jsonDF3 = jsonDF2.select( " i d " , "id", "id",“ap”,get_json_object( " c m " , " "cm"," "cm",".ln") alias(“ln”),
get_json_object( " c m " , " "cm"," "cm",".sv") alias(“sv”),get_json_object( " c m " , " "cm"," "cm",".os") alias(“os”),
get_json_object( " c m " , " "cm"," "cm",".g") alias(“g”),get_json_object( " c m " , " "cm"," "cm",".mid") alias(“mid”),
get_json_object( " c m " , " "cm"," "cm",".nw") alias(“nw”),get_json_object( " c m " , " "cm"," "cm",".l") alias(“l”),
get_json_object( " c m " , " "cm"," "cm",".vc") alias(“vc”),get_json_object( " c m " , " "cm"," "cm",".hw") alias(“hw”),
get_json_object( " c m " , " "cm"," "cm",".ar") alias(“ar”),get_json_object( " c m " , " "cm"," "cm",".uid") alias(“uid”),
get_json_object( " c m " , " "cm"," "cm",".t") alias(“t”),get_json_object( " c m " , " "cm"," "cm",".la") alias(“la”),
get_json_object( " c m " , " "cm"," "cm",".md") alias(“md”),get_json_object( " c m " , " "cm"," "cm",".vn") alias(“vn”),
get_json_object( " c m " , " "cm"," "cm",".ba") alias(“ba”),get_json_object( " c m " , " "cm"," "cm",".sr") alias(“sr”),$“et”)

scala> jsonDF3.printSchema
root
|-- id: string (nullable = true)
|-- ap: string (nullable = true)
|-- ln: string (nullable = true)
|-- sv: string (nullable = true)
|-- os: string (nullable = true)
|-- g: string (nullable = true)
|-- mid: string (nullable = true)
|-- nw: string (nullable = true)
|-- l: string (nullable = true)
|-- vc: string (nullable = true)
|-- hw: string (nullable = true)
|-- ar: string (nullable = true)
|-- uid: string (nullable = true)
|-- t: string (nullable = true)
|-- la: string (nullable = true)
|-- md: string (nullable = true)
|-- vn: string (nullable = true)
|-- ba: string (nullable = true)
|-- sr: string (nullable = true)
|-- et: string (nullable = true)

scala> jsonDF3.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±-------------------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| et|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±-------------------+
|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|[{“ett”:"15930500…|
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|[{“ett”:"15930632…|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±-------------------+

//from_json把字符串
[
{“ett”:“a1”,“en”:“a2”,“kv”:“a3”},
{“ett”:“b1”,“en”:“b2”,“kv”:“b3”},
{“ett”:“c1”,“en”:“c2”,“kv”:“c3”}
] 结构化
ett en kv
a1 a2 a3
b1 b2 b3
c1 c2 c3

val jsonDF4 = jsonDF3.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , f r o m j s o n ( "sr", from_json( "sr",fromj​son(“et”,ArrayType(StructType(StructField(“ett”,StringType)::StructField(“en”,StringType)::StructField(“kv”,StringType)::Nil))).alias(“event”))

jsonDF4大脑想到的结构是这样：
id ap mid nw *** event
1593136280858 app 12345 dsdwe **** [[ett en ev],[b1 b2 b3 ],[c1 c2 c3]]

---------------------思考结束---------------------------
开干。。。。。。。。
第二步

scala> val jsonDF5 = jsonDF4.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , e x p l o d e ( "sr", explode( "sr",explode(“event”).alias(“event”))

scala> val jsonDF6 = jsonDF5.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , ( "sr", ( "sr",(“event.kv”).alias(“kv”),( " e v e n t . e t t " ) . a l i a s ( " e t t " ) , ( "event.ett").alias("ett"),( "event.ett").alias("ett"),(“event.en”).alias(“en”))

scala> jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en" , "en",“kv”).filter($“en”===“loading”).show(false)

scala> val loadingDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr" , "sr",“ett”, " e n " , "en", "en",“kv”).filter($“en”===“loading”)

scala> loadingDF.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , g e t j s o n o b j e c t ( "en",get_json_object( "en",getj​sono​bject(“kv”," . e x t e n d 2 " ) a l i a s ( " e x t e n d 2 " ) , g e t j s o n o b j e c t ( .extend2") alias("extend2"),get_json_object( .extend2")alias("extend2"),getj​sono​bject(“kv”," . l o a d i n g t i m e " ) a l i a s ( " l o a d i n g t i m e " ) , g e t j s o n o b j e c t ( .loading_time") alias("loading_time"),get_json_object( .loadingt​ime")alias("loadingt​ime"),getj​sono​bject(“kv”," . a c t i o n " ) a l i a s ( " a c t i o n " ) , g e t j s o n o b j e c t ( .action") alias("action"),get_json_object( .action")alias("action"),getj​sono​bject(“kv”," . e x t e n d 1 " ) a l i a s ( " e x t e n d 1 " ) , g e t j s o n o b j e c t ( .extend1") alias("extend1"),get_json_object( .extend1")alias("extend1"),getj​sono​bject(“kv”," . t y p e " ) a l i a s ( " t y p e " ) , g e t j s o n o b j e c t ( .type") alias("type"),get_json_object( .type")alias("type"),getj​sono​bject(“kv”," . t y p e 1 " ) a l i a s ( " t y p e 1 " ) , g e t j s o n o b j e c t ( .type1") alias("type1"),get_json_object( .type1")alias("type1"),getj​sono​bject(“kv”,"$.loading_way") alias(“loading_way”)).printSchema
root
|-- id: string (nullable = true)
|-- ap: string (nullable = true)
|-- ln: string (nullable = true)
|-- sv: string (nullable = true)
|-- os: string (nullable = true)
|-- g: string (nullable = true)
|-- mid: string (nullable = true)
|-- nw: string (nullable = true)
|-- l: string (nullable = true)
|-- vc: string (nullable = true)
|-- hw: string (nullable = true)
|-- ar: string (nullable = true)
|-- uid: string (nullable = true)
|-- t: string (nullable = true)
|-- la: string (nullable = true)
|-- md: string (nullable = true)
|-- vn: string (nullable = true)
|-- ba: string (nullable = true)
|-- sr: string (nullable = true)
|-- ett: string (nullable = true)
|-- en: string (nullable = true)
|-- extend2: string (nullable = true)
|-- loading_time: string (nullable = true)
|-- action: string (nullable = true)
|-- extend1: string (nullable = true)
|-- type: string (nullable = true)
|-- type1: string (nullable = true)
|-- loading_way: string (nullable = true)

scala> val loadingDF1 = loadingDF.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”,
" s r " , "sr", "sr",“ett”, " e n " , g e t j s o n o b j e c t ( "en",get_json_object( "en",getj​sono​bject(“kv”," . e x t e n d 2 " ) a l i a s ( " e x t e n d 2 " ) , g e t j s o n o b j e c t ( .extend2") alias("extend2"),get_json_object( .extend2")alias("extend2"),getj​sono​bject(“kv”," . l o a d i n g t i m e " ) a l i a s ( " l o a d i n g t i m e " ) , g e t j s o n o b j e c t ( .loading_time") alias("loading_time"),get_json_object( .loadingt​ime")alias("loadingt​ime"),getj​sono​bject(“kv”," . a c t i o n " ) a l i a s ( " a c t i o n " ) , g e t j s o n o b j e c t ( .action") alias("action"),get_json_object( .action")alias("action"),getj​sono​bject(“kv”," . e x t e n d 1 " ) a l i a s ( " e x t e n d 1 " ) , g e t j s o n o b j e c t ( .extend1") alias("extend1"),get_json_object( .extend1")alias("extend1"),getj​sono​bject(“kv”," . t y p e " ) a l i a s ( " t y p e " ) , g e t j s o n o b j e c t ( .type") alias("type"),get_json_object( .type")alias("type"),getj​sono​bject(“kv”," . t y p e 1 " ) a l i a s ( " t y p e 1 " ) , g e t j s o n o b j e c t ( .type1") alias("type1"),get_json_object( .type1")alias("type1"),getj​sono​bject(“kv”,"$.loading_way") alias(“loading_way”))
scala> loadingDF1.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|extend2|loading_time|action|extend1|type|type1|loading_way|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------+
|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------+

scala> val adDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en", "en",“kv”).filter( " e n " = = = " a d " ) s c a l a > v a l a d D F 1 = a d D F . s e l e c t ( "en"==="ad") scala> val adDF1 = adDF.select( "en"==="ad")scala>valadDF1=adDF.select(“id”, " a p " , "ap", "ap",“ln”, " s v " , "sv", "sv",“os”, " g " , "g", "g",“mid”, " n w " , "nw", "nw",“l”, " v c " , "vc", "vc",“hw”, " a r " , "ar", "ar",“uid”, " t " , "t", "t",“la”, " m d " , "md", "md",“vn”, " b a " , "ba", "ba",“sr”, " e t t " , "ett", "ett",“en”,get_json_object( " k v " , " "kv"," "kv",".activityId") alias(“activityId”),get_json_object( " k v " , " "kv"," "kv",".displayMills") alias(“displayMills”),get_json_object( " k v " , " "kv"," "kv",".entry") alias(“entry”),get_json_object( " k v " , " "kv"," "kv",".action") alias(“action”),get_json_object( " k v " , " "kv"," "kv",".contentType") alias(“contentType”))
scala> adDF1.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|activityId|displayMills|entry|action|contentType|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------+
|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------+

scala> val notificationDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en", "en",“kv”).filter( " e n " = = = " n o t i f i c a t i o n " ) s c a l a > v a l n o t i f i c a t i o n D F 1 = n o t i f i c a t i o n D F . s e l e c t ( "en"==="notification") scala> val notificationDF1 = notificationDF.select( "en"==="notification")scala>valnotificationDF1=notificationDF.select(“id”, " a p " , "ap", "ap",“ln”, " s v " , "sv", "sv",“os”, " g " , "g", "g",“mid”, " n w " , "nw", "nw",“l”, " v c " , "vc", "vc",“hw”, " a r " , "ar", "ar",“uid”, " t " , "t", "t",“la”, " m d " , "md", "md",“vn”, " b a " , "ba", "ba",“sr”, " e t t " , "ett", "ett",“en”,get_json_object( " k v " , " "kv"," "kv",".ap_time") alias(“ap_time”),get_json_object( " k v " , " "kv"," "kv",".action") alias(“action”),get_json_object( " k v " , " "kv"," "kv",".type") alias(“type”),get_json_object( " k v " , " "kv"," "kv",".content") alias(“content”))
scala> notificationDF1.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en| ap_time|action|type|content|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------+
|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------+

scala> val active_backgroundDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en", "en",“kv”).filter( " e n " = = = " a c t i v e b a c k g r o u n d " ) s c a l a > v a l a c t i v e b a c k g r o u n d D F 1 = a c t i v e b a c k g r o u n d D F . s e l e c t ( "en"==="active_background") scala> val active_backgroundDF1 = active_backgroundDF.select( "en"==="activeb​ackground")scala>valactiveb​ackgroundDF1=activeb​ackgroundDF.select(“id”, " a p " , "ap", "ap",“ln”, " s v " , "sv", "sv",“os”, " g " , "g", "g",“mid”, " n w " , "nw", "nw",“l”, " v c " , "vc", "vc",“hw”, " a r " , "ar", "ar",“uid”, " t " , "t", "t",“la”, " m d " , "md", "md",“vn”, " b a " , "ba", "ba",“sr”, " e t t " , "ett", "ett",“en”,get_json_object( " k v " , " "kv"," "kv",".active_source") alias(“active_source”))
scala> active_backgroundDF1.show
±------------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|active_source|
±------------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------+
|1593136280858|app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640*960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|
±------------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------+

scala> val commentDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en", "en",“kv”).filter( " e n " = = = " c o m m e n t " ) s c a l a > v a l c o m m e n t D F 1 = c o m m e n t D F . s e l e c t ( "en"==="comment") scala> val commentDF1 = commentDF.select( "en"==="comment")scala>valcommentDF1=commentDF.select(“id”, " a p " , "ap", "ap",“ln”, " s v " , "sv", "sv",“os”, " g " , "g", "g",“mid”, " n w " , "nw", "nw",“l”, " v c " , "vc", "vc",“hw”, " a r " , "ar", "ar",“uid”, " t " , "t", "t",“la”, " m d " , "md", "md",“vn”, " b a " , "ba", "ba",“sr”, " e t t " , "ett", "ett",“en”,get_json_object( " k v " , " "kv"," "kv",".p_comment_id") alias(“p_comment_id”),get_json_object( " k v " , " "kv"," "kv",".addtime") alias(“addtime”),get_json_object( " k v " , " "kv"," "kv",".praise_count") alias(“praise_count”),get_json_object( " k v " , " "kv"," "kv",".other_id") alias(“other_id”),get_json_object( " k v " , " "kv"," "kv",".comment_id") alias(“comment_id”),get_json_object( " k v " , " "kv"," "kv",".reply_count") alias(“reply_count”),get_json_object( " k v " , " "kv"," "kv",".userid") alias(“userid”),get_json_object( " k v " , " "kv"," "kv",".content") alias(“content”))
scala> commentDF1.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|p_comment_id| addtime|praise_count|other_id|comment_id|reply_count|userid| content|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+
|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+

scala> val praiseDF = jsonDF6.select( " i d " , "id", "id",“ap”, " l n " , "ln", "ln",“sv”, " o s " , "os", "os",“g”, " m i d " , "mid", "mid",“nw”, " l " , "l", "l",“vc”, " h w " , "hw", "hw",“ar”, " u i d " , "uid", "uid",“t”, " l a " , "la", "la",“md”, " v n " , "vn", "vn",“ba”, " s r " , "sr", "sr",“ett”, " e n " , "en", "en",“kv”).filter( " e n " = = = " p r a i s e " ) s c a l a > v a l p r a i s e D F 1 = p r a i s e D F . s e l e c t ( "en"==="praise") scala> val praiseDF1 = praiseDF.select( "en"==="praise")scala>valpraiseDF1=praiseDF.select(“id”, " a p " , "ap", "ap",“ln”, " s v " , "sv", "sv",“os”, " g " , "g", "g",“mid”, " n w " , "nw", "nw",“l”, " v c " , "vc", "vc",“hw”, " a r " , "ar", "ar",“uid”, " t " , "t", "t",“la”, " m d " , "md", "md",“vn”, " b a " , "ba" , "ba",“sr”, " e t t " , "ett", "ett",“en”,get_json_object( " k v " , " "kv"," "kv",".target_id") alias(“target_id”),get_json_object( " k v " , " "kv"," "kv",".id") alias(“id1”),
get_json_object( " k v " , " "kv"," "kv",".type") alias(“type”),get_json_object( " k v " , " "kv"," "kv",".add_time") alias(“add_time”),get_json_object( " k v " , " "kv"," "kv",".userid") alias(“userid”))

scala> praiseDF1.show
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±-------±----±-----±–±------------±-----±--------±–±—±------------±-----+
| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|target_id|id1|type| add_time|userid|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±-------±----±-----±–±------------±-----±--------±–±—±------------±-----+
|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|640*1136| MX|490|1593121224789|-44.4|Huawei-8|1.0.1|Huawei| O|1593105344120|praise| 9| 7| 1|1593098545976| 8|
±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±-------±----±-----±–±------------±-----±--------±–±—±------------±-----+

scala> loadingDF1.join(adDF1,Seq(“id”,“id”),“inner”).join(notificationDF1,Seq(“id”,“id”),“inner”).join(active_backgroundDF1,Seq(“id”,“id”),“inner”).join(commentDF1,Seq(“id”,“id”),“inner”).show
±------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+
| id| id| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|extend2|loading_time|action|extend1|type|type1|loading_way| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|activityId|displayMills|entry|action|contentType| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en| ap_time|action|type|content| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|active_source| ap| ln| sv| os| g|mid| nw| l| vc| hw| ar|uid| t| la| md| vn| ba| sr| ett| en|p_comment_id| addtime|praise_count|other_id|comment_id|reply_count|userid| content|
±------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593050051366|loading| | 14| 3| | 2| 201| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593108791764| ad| 1| 78522| 1| 1| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593111271266|notification|1593097087883| 1| 1| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app| -55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4| 640960| MX|489|1593123253541| 5.2|sumsung-18|1.3.4|Sumsung| I|1593135644347|comment| 1|1593097573725| 973| 5| 9| 40| 7| 辑赤蹲慰鸽抿肘捎|
|1593136280858|1593136280858|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593063223807|loading| | 0| 3| | 1| 102| 1|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593095105466| ad| 1| 1966| 3| 2| 0|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593051718208|notification|1593095336265| 2| 3| |app|-55.0|V2.9.6|8.0.4|C6816QZ0@gmail.com|489| 3G| es| 4|640960| MX|489|1593123253541|5.2|sumsung-18|1.3.4|Sumsung| I|1593066033562|active_background| 3|app|-114.9|V2.7.8|8.0.4|NW0S962J@gmail.com|490| 3G| pt| 8|6401136| MX|490|1593121224789|-44.4| Huawei-8|1.0.1| Huawei| O|1593100021275|comment| 4|1593098946009| 220| 4| 9| 151| 4|抄应螟皮釉倔掉汉蛋蕾街羡晶|
±------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±------±-----------±-----±------±—±----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±–±---------±-----------±----±-----±----------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±-----------±------------±-----±—±------±–±----±-----±----±-----------------±–±--±–±--±------±–±--±------------±–±---------±----±------±–±------------±----------------±------------±–±-----±-----±----±-----------------±–±--±–±--±-------±–±--±------------±----±---------±----±------±–±------------±------±-----------±------------±-----------±-------±---------±----------±-----±-------------------------+

桃小酷
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
读json文件自动生成jsonpath
07-22
总之，要实现“读json文件自动生成jsonpath”，你需要理解JSON和JSONPath的基本概念，然后使用合适的库（如JsonPath）或自定义实现来处理JSON数据，生成对应的查询路径。`JsonPathLib.java`可能就是这样一个工具，...
pytorch模型转换，将.t7转为.pt
u013925378的博客
11-27 6563
将deep_sort跟踪模型ckpt.t7转为pt格式，用于pc端的推断。 def cvt_model(): print("===> Loading model") model = Net() modelname = 'ckpt.t7' checkpoint = torch.load(savedataroot + modelname) model....
Python中4种读取JSON文件和提取JSON文件内容的方法大盘点
最新发布
weixin_68789096的博客
03-14 9986
本文介绍了Python中四种读取和提取JSON文件内容的方法，分别是使用。
【Json文件的读取与写入】
qq_45142349的博客
04-02 4901
不同的语言中，它被理解为对象（object），纪录（record），结构（struct），字典（dictionary），哈希表（hash table），有键列表（keyed list），或者关联数组 （associative array）。一个对象以“{”（左括号）开始，“}”（右括号）结束。“‘名称/值’ 对”之间使用“,”（逗号）分隔。值（value）可以是双引号括起来的字符串（string）、数值(number)、true、false、 null、对象（object）或者数组（array）。
Json的不同读取方式
qq_39908137的博客
07-22 361
一、json格式 1、对象是一个无序的“‘名称/值’对”集合。 　　例子：表示人的一个对象： 　　{“姓名” : “大憨”,“年龄” : 24} 2、数组是值（value）的有序集合。 　　例子：一组学生 　　{“学生” :[{“姓名” : “小明” , “年龄” : 23},{“姓名” : “大憨” , “年龄” : 24}]} 　　json 对象数组：[{“姓名” : “小明” , “年龄” ...
json文件两种读取方式
q_xiami123的博客
05-07 6263
json文件两种读取方式 这是一段两个人的对话标注抄本 [ { "start_time": { "original": "0:00:00.611000" }, "end_time": { "original": "0:00:05.760000" }, "words": "+", "speaker": "", "location": "",
C#winform中读写json文件
01-02
这个示例中，我们创建了一个`Person`类，然后在按钮事件中分别实现了读取JSON文件和写入JSON文件的功能。 总结，C# WinForm应用中读写JSON文件主要依赖于Newtonsoft.Json库。通过简单的序列化和反序列化操作，我们...
JSON文件及Python对JSON文件的读写操作
09-20
因此，通过Python的内置库`json`，可以轻松地将JSON文件读取为字典，或将字典保存为JSON文件。 在Python中读取JSON文件时，可以使用`json.load()`方法。这个方法接受一个文件对象，然后读取该文件中的JSON数据，将...
C# 读取数组Json文件
03-22
本篇文章将深入探讨如何在C#中读取包含数组的JSON文件。 首先，我们需要了解JSON的基本结构。一个JSON文件通常包含键值对，可以表示对象或者数组。数组在JSON中用方括号`[]`表示，对象用大括号`{}`表示。例如，一个...
Java读取json文件，并转化为map取值
05-12
本教程将深入讲解如何使用Java读取JSON文件，并将其内容转化为Map以便进行取值操作。 首先，我们需要引入处理JSON的库。Java标准库并不直接支持JSON操作，所以我们通常会使用第三方库，如`org.json`或`...
mnist数据集.t7格式
01-23
torch框架中load函数加载的图片数据格式。
读取json文件
NottDevil的博客
12-20 2689
1.json介绍 json与xml相比, 对数据的描述性比XML较差,但是数据体积小,传递速度更快. json数据的书写格式是"名称:值对",比如: "Name" : "John" //name为名称,值对为"john"字符串 值对类型共分为: 数字（整数或浮点数） 字符串（在双引号中） 逻辑值（true 或 false） 数组（在方括号[]中） 对象（在花括号{}中） null 当然数组也可以包含多对象: { "emplo
读写JSON文件
qq_55858843的博客
11-12 1836
JSON(JavaScript Object Notation) 是一种轻量级的数据交换格式。它基于 ECMAScript 的一个子集。 JSON 采用完全独立于语言的文本格式，但是也使用了类似于 C 语言家族的习惯（包括 C、C++、Java、JavaScript、Perl、Python等）。这些特性使 JSON 成为理想的数据交换语言。易于人阅读和编写，同时也易于机器解析和生成（一般用于提升网络传输速率）。
java — 读取JSON文件的多种方式
csdn_halon的博客
09-14 4万+
在开发过程中有时会遇到需要读取本地.json文件的需求，通常会自己写Reader代码去读，但是这么做写出来的代码有些繁琐（需要关流、创建StringBuilder对象等操作）。最近发现几个小工具可以让需求代码变得更加简洁。 准备： json文件：F:\halon.json { "ID": 10001, "detail": "detail", "json_format_version": 1.0, "other_info": { "array_one": [ [855, 410], [
HTML5实现本地JSON文件的读写
weixin_30535565的博客
11-04 1万+
参考： 使用HTML5来实现本地文件读取和写入 （FileReader读取json文件，FileSaver.js保存json文件） w3school <input>标签 FileReader WebAPI接口 FileSaver.js下载地址 FileSaver.js介绍 JS创建、写入、读取本地文件（txt） （ActiveXObject 这玩意根本不能用，IE...
JavaScript读取JSON文件
Bruce_wjh的博客
03-13 5万+
JSON 是 JS 对象的字符串表示法，它使用文本表示一个 JS 对象的信息，本质是一个字符串。有关于json的相关信息，可参考：json百度百科。 1、HTML文档 &lt;!DOCTYPE html&gt; &lt;html lang="en"&gt; &lt;head&gt; &lt;meta charset="UTF-8"&gt; &lt;title&gt;R
java——读取JSON文件
热门推荐
ALemon_Y的博客
05-08 9万+
前几天胡思乱想一下： 我们拿到 JSON 文件，若想通过 java 读取其中的数据，该怎么做呢？ 就搜索些视频、博客看了一下，这里整理一番。读前需要了解 java-IO 基础知识 java-File了解 推荐一篇博文：使用FileUtils简化你的文件操作 首先我用到Apache Common IO 2.5包和java-JSON包注意： java-JSON包可以先在 github 下载下来，然
C++ 读取json文件内容
lgy101024的博客
06-01 6973
int main(int argc, const char* argv[]){ //Options opts; //try { // int exitCode = parseCommandLine(argc, argv, &amp;opts); // if (exitCode != 0) { // printf("Failed to parse command-line."); // retu...
with读json文件
07-28
要使用Python中的`with`语句来读取JSON文件，可以按照以下步骤进行操作： 1. 首先，确保已经导入了`json`模块。可以使用以下代码导入它： ```python import json ``` 2. 使用`with`语句打开JSON文件，并将其分配给...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值