pyspark 错误 IndexError: pop from an empty deque

问题

在调试wide and deep 网络，对数据做预处理时，对pages_views进行sql查询时出现“IndexError: pop from an empty deque”错误。

代码

train_set_df = spark.sql('''
SELECT * FROM clicks_train_joined t
WHERE NOT EXISTS (SELECT display_id FROM validation_display_ids
WHERE display_id = t.display_id)''').cache()
print("train_set_df.count() =", train_set_df.count