spark scala dataset、dataframe、RDD 、SQL使用
Dataset[String] to Data[case class] dataset[String] to Dataset[ThrDynamicRowV001]
`val ds: Dataset[ThrDynamicRowV001] = spark.read.textFile(inputThrFile).map(row => {
val split_str = row.split(",")
for (i <- 0 to 13) {
if (split_str(i).isEmpt
原创
2020-12-27 16:15:35 ·
648 阅读 ·
0 评论