org.apache.spark.sql.AnalysisException: Try to map struct<>to Tuple1 异常

最新推荐文章于 2022-03-31 17:49:52 发布

玉羽凌风

最新推荐文章于 2022-03-31 17:49:52 发布

阅读量3.2k

点赞数

分类专栏： SPARK 文章标签： spark

本文链接：https://blog.csdn.net/zhouyan8603/article/details/78148978

版权

SPARK 专栏收录该内容

51 篇文章 1 订阅

订阅专栏

spark.read.parquet(mypath).as[MyEntity]会遇到下面异常



org.apache.spark.sql.AnalysisException: Try to map struct<uid:string> to Tuple1, but failed as the number of fields does not line up.;
	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$fail(Analyzer.scala:2044)
	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$validateTopLevelTupleFields(Analyzer.scala:2061)
	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2035)
	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2027)



在read之前需要：
import spark.implicits._