pyspark.sql.utils.IllegalArgumentException: u'requirement failed'

19/01/10 17:18:35 WARN KMeans: The input data is not directly cached, which may hurt performance if its parent RDDs are also uncached.
Traceback (most recent call last):
File “/home/work/XXX/XXX/XXX/XXX/clu/lib/k_means_stratification_v3_23_01_bei.py”, line 356, in
run()
File “/home/work/XXX/XXX/XXX/XXX/clu/lib/k_means_stratification_v3_23_01_bei.py”, line 351, in run
clustering(sc_context=spark_context, df_filtered=df_nonDirectBusiness, temp_path=temp_path + ‘nonDirectBusiness/’, columns=cols,options=options,property_dict=property_dict)
File “/home/work/XXX/XXX/XXX/XXX/clu/lib/k_means_stratification_v3_23_01_bei.py”, line 240, in clustering
temp_k = get_elbow(temp_vc2, temp_min_k, temp_max_k, 3)
File “/home/work/XXX/XXX/XXX/XXX/clu/lib/k_means_stratification_v3_23_01_bei.py”, line 40, in get_elbow
model = kmeans_def.fit(rdd_data)
File “/home/work/local/spark-2.1.1/python/lib/pyspark.zip/