spark ML中的vector类型错误

最新推荐文章于 2024-08-05 12:12:53 发布

mbshqqb

最新推荐文章于 2024-08-05 12:12:53 发布

阅读量3.7k

点赞数

分类专栏：机器学习文章标签： spark 机器学习

本文链接：https://blog.csdn.net/mbshqqb/article/details/76152029

版权

机器学习专栏收录该内容

14 篇文章 0 订阅

订阅专栏

Exception in thread "main" java.lang.IllegalArgumentException: requirement failed: Column termWeights must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually ArrayType(DoubleType,false).
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.ml.util.SchemaUtils$.checkColumnType(SchemaUtils.scala:42)
at org.apache.spark.ml.clustering.KMeansParams$class.validateAndTransformSchema(KMeans.scala:92)
at org.apache.spark.ml.clustering.KMeans.validateAndTransformSchema(KMeans.scala:253)
at org.apache.spark.ml.clustering.KMeans.transformSchema(KMeans.scala:330)
at org.apache.spark.ml.PipelineStage.transformSchema(Pipeline.scala:74)
at org.apache.spark.ml.clustering.KMeans.fit(KMeans.scala:304)
at Scala.com.zj.hot_weibo.TF_IDF_LDAExample$.main(TF_IDF_LDAExample.scala:95)

at Scala.com.zj.hot_weibo.TF_IDF_LDAExample.main(TF_IDF_LDAExample.scala)

https://stackoverflow.com/questions/38664972/why-is-unable-to-find-encoder-for-type-stored-in-a-dataset-when-creating-a-dat