Error:(31, 126) Unable to find encoder for type stored in a Dataset. Primitive types (Int, String,

sparkStruce消费kafak里的数据输出到mysql 出现的异常

Error:(31, 126) Unable to find encoder for type stored in a Dataset.  Primitive types (Int, String, etc) and Product types (case classes) are supported by importing spark.implicits._  Support for serializing other types will be added in future releases.
    val kafkaDatasString: Dataset[(String, String)] = kafkaDatas.selectExpr("CAST(key AS STRING)","CAST(value AS STRING)").as[(String,String)]
————————————————

解决措施
尽量把隐式转换往前些,因为下面的代码需要用到这个没有的方法

import spark.implicits._

报错


Error:(35, 10) Unable to find encoder for type stored in a Dataset.  Primitive types (Int, String, etc) and Product types (case classes) are supported by importing spark.implicits._  Support for serializing other types will be added in future releases.
      .as[(String,String)]
Error:(35, 10) not enough arguments for method as: (implicit evidence$2: org.apache.spark.sql.Encoder[(String, String)])org.apache.spark.sql.Dataset[(String, String)].
Unspecified value parameter evidence$2.
      .as[(String,String)]

在这里插入图片描述

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值