pyspark.sql 的dataframe 添加多列 / df.withColumns()用法

静静_jingjing

已于 2022-12-05 17:26:02 修改

阅读量1.3k

点赞数

分类专栏： python编程文章标签： python 开发语言

于 2022-12-05 16:44:31 首次发布

本文链接：https://blog.csdn.net/qq_39321513/article/details/128189330

版权

python编程专栏收录该内容

36 篇文章 1 订阅

订阅专栏

Signature: df_ft.withColumns(*colsMap: Dict[str, pyspark.sql.column.Column]) -> 'DataFrame'
Docstring:
Returns a new :class:`DataFrame` by adding multiple columns or replacing the
existing columns that has the same names.

The colsMap is a map of column name and column, the column must only refer to attributes
supplied by this Dataset. It is an error to add columns that refer to some other Dataset.

.. versionadded:: 3.3.0
   Added support for multiple columns adding

Parameters
----------
colsMap : dict
    a dict of column name and :class:`Column`. Currently, only single map is supported.

Examples
--------
>>> df.withColumns({'age2': df.age + 2, 'age3': df.age + 3}).collect()
[Row(age=2, name='Alice', age2=4, age3=5), Row(age=5, name='Bob', age2=7, age3=8)]
File:      ~/opt/anaconda3/lib/python3.9/site-packages/pyspark/sql/dataframe.py
Type:      method

这个方法是新出的方法

3.3.1有这个方法