spark 把一列数据合并_scala spark，如何将一组列合并到一个dataframe上?(scala spark, how do I merge a set of columns to a s...

I’m looking for a way to do this without a UDF, I am wondering if its possible. Lets say I have a DF as follows:

Buyer_name  Buyer_state  CoBuyer_name  CoBuyers_state  Price  Date

Bob         CA           Joe           CA              20     010119

Stacy       IL           Jamie         IL              50     020419

... about 3 millions more rows...

And I want to turn it to:

Buyer_name Buyer_state Price Date

Bob        CA          20    010119

Joe        CA          20    010119

Stacy      IL          50    020419

Jamie      IL          50    020419

...

Edit: I could also,

Create two dataframes, removing “Buyer” columns from one, and “Cobuyer” columns from the other.

Rename dataframe with “Cobuyer” columns as “Buyer” columns.

Concatenate both dataframes.