‘KMeansModel‘ object has no attribute ‘computeCost‘ 的解决方法

问题

当使用pyspark的KMeansModel，用computeCost计算cost(WSSSE),会报以下错误

原因

因为在pyspark3.0中已经deprecate了这个方法

解决方案

pyspark官方文档
使用ClusterEvaluator代替computeCost方法来进行模型评价

# Make predictions
predictions = model.transform(dataset)

# Evaluate clustering by computing Silhouette score
evaluator = ClusteringEvaluator()

silhouette = evaluator.evaluate(predictions)
print("Silhouette with squared euclidean distance = " + str(silhouette))

完整示例代码

from pyspark.ml.clustering import KMeans
from pyspark.ml.evaluation import ClusteringEvaluator

# Loads data.
dataset = spark.read.format("libsvm").load("data/mllib/sample_kmeans_data.txt")

# Trains a k-means model.
kmeans = KMeans().setK(2).setSeed(1)
model = kmeans.fit(dataset)

# Make predictions
predictions = model.transform(dataset)

# Evaluate clustering by computing Silhouette score
evaluator = ClusteringEvaluator()

silhouette = evaluator.evaluate(predictions)
print("Silhouette with squared euclidean distance = " + str(silhouette))

# Shows the result.
centers = model.clusterCenters()
print("Cluster Centers: ")
for center in centers:
    print(center)

如果有帮助到您还请给个赞哦~
有问题欢迎讨论~