Spark中用DataFrame从本地电脑mysql8.0为数据源加载数据时,报错如下:

Exception in thread "main" java.lang.ClassNotFoundException: org.mysql.cj.jdbc.Driver

       at java.net.URLClassLoader.findClass(URLClassLoader.java:381)

       at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

       at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)

       at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

       at org.apache.spark.sql.execution.datasources.jdbc.DriverRegistry$.register(DriverRegistry.scala:46)

       at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.$anonfun$driverClass$1(JDBCOptions.scala:101)

       at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.$anonfun$driverClass$1$adapted(JDBCOptions.scala:101)

       at scala.Option.foreach(Option.scala:407)

       at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.<init>(JDBCOptions.scala:101)

       at org.apache.spark.sql.execution.datasources.jdbc.JDBCOptions.<init>(JDBCOptions.scala:39)

       at org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:33)

       at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:350)

       at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:274)

       at org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:245)

       at scala.Option.getOrElse(Option.scala:189)

       at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:245)

       at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:174)

       at com.mm.sql.Demo02$.createFromJdbc(Demo02.scala:221)

       at com.mm.sql.Demo02$.main(Demo02.scala:29)

       at com.mm.sql.Demo02.main(Demo02.scala)

23/05/24 16:25:33 INFO SparkContext: Invoking stop() from shutdown hook

23/05/24 16:25:33 INFO SparkUI: Stopped Spark web UI at http://LG:4107

23/05/24 16:25:33 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!

23/05/24 16:25:33 INFO MemoryStore: MemoryStore cleared

23/05/24 16:25:33 INFO BlockManager: BlockManager stopped

解决办法:到Maven Repository: mysql » mysql-connector-java » 8.0.25 (mvnrepository.com)找到如下内容,复制到Idea的pom.xml中

<!-- https://mvnrepository.com/artifact/mysql/mysql-connector-java -->
<dependency>
    <groupId>mysql</groupId>
    <artifactId>mysql-connector-java</artifactId>
    <version>8.0.25</version>
</dependency>

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

三峡大爸

你的鼓励将是我创作的最大动力

¥2 ¥4 ¥6 ¥10 ¥20
输入1-500的整数
余额支付 (余额:-- )
扫码支付
扫码支付:¥2
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、C币套餐、付费专栏及课程。

余额充值