本文详细介绍了在Spark中使用Scala操作DataFrame时如何重命名列名的多种方法，包括`withColumnRenamed`函数、StructType结构体、Select表达式、withColumn、col()函数以及toDF()方法。通过实例展示了如何进行单列、多列重命名以及处理嵌套列名。
本文介绍常见的几种对spark dataframe 进行列名的修改方法
生成测试数据
val data = Seq(Row(Row("James ","","Smith"),"36636","M",3000),
Row(Row("Michael ","Rose",""),"40288","M",4000),
Row(Row("Robert ","","Williams"),"42114","M",4000),
Row(Row("Maria ","Anne","Jones"),"39192","F",4000),
Row(Row("Jen","Mary","Brown"),"","F",-1)
)
定义schema
val schema = new StructType()
.add("name",new StructType()
.add("firstname",StringType)
.add("middlename",StringType)
.add("lastname",StringType))
.add("dob",StringType)
.add("gender",StringType)
.add("salary",IntegerType)
创建 DataFrame</
最低0.47元/天 解锁文章
3889
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
