var offlineData: DataFrame = ......
val offlineDataFieldName: Array[String] = offlineData.schema.names
(0 until offlineDataFieldName.length).foreach(idx => {
offlineData = offlineData.withColumn(
offlineDataFieldName.apply(idx)
, when(col(offlineDataFieldName.apply(idx)) === "" or col(offlineDataFieldName.apply(idx)) === "其它值", lit(null)).otherwise(col(offlineDataFieldName.apply(idx)))
)
})
spark dataframe 将每一列中的空字符(或其它值)替换成null
最新推荐文章于 2023-04-23 10:55:04 发布