spark 自定义函数报错如下:
Exception in thread "main" java.lang.UnsupportedOperationException: Schema for type Any is not supported
at org.apache.spark.sql.catalyst.ScalaReflection$.$anonfun$schemaFor$1(ScalaReflection.scala:743)
at scala.reflect.internal.tpe.TypeConstraints$UndoLog.undo(TypeConstraints.scala:69)
at org.apache.spark.sql.catalyst.ScalaReflection.cleanUpReflectionObjects(ScalaReflection.scala:882)
原因:
spark自定义函数是有返回值的,返回值必须有,而且类型也要一样
我的代码分支没有返回值,加了下面图片红色的代码,分支给返回值,就可以了