python dataframe join条件筛选_python 3.x-如何在PySpark中按条件 join这两个 DataFrame ？...

df_1 = pd.DataFrame({'P_ID' : [100, 200, 300], 'P_Name': ['Moto', 'Apple', 'Oppo'], 'P_Size' : [16, 15, 18]})

sdf_1 = sc.createDataFrame(df_1)

df_2 = pd.DataFrame({'P_ID' : [100, 100, 300], 'List_Code': ['ALPHA', 'BETA', 'GAMMA'], 'P_Amount' : [20000, 60000, 10000]})

sdf_2 = sc.createDataFrame(df_2)

sdf_pivoted = sdf_2.groupby('P_ID').pivot('List_Code').agg(f.sum('P_Amount')).fillna(0)

sdf_joined = sdf_1.join(sdf_pivoted, on='P_ID', how='left').fillna(0)

sdf_joined.show()

+----+------+------+-----+-----+-----+

|P_ID|P_Name|P_Size|ALPHA| BETA|GAMMA|

+----+------+------+-----+-----+-----+

| 300| Oppo| 18| 0| 0|10000|

| 200| Apple| 15| 0| 0| 0|

| 100| Moto| 16|20000|60000| 0|

+----+------+------+-----+-----+-----+