idea使用spark时报错

idea使用spark时报错

Exception in thread “main” java.lang.ExceptionInInitializerError
at org.apache.spark.unsafe.array.ByteArrayMethods.(ByteArrayMethods.java:54)
at org.apache.spark.internal.config.package$.<init>(package.scala:1006)atorg.apache.spark.internal.config.package$.(package.scala)
at org.apache.spark.SparkConf$.<init>(SparkConf.scala:639)atorg.apache.spark.SparkConf$.(SparkConf.scala)
at org.apache.spark.SparkConf.set(SparkConf.scala:94)
at org.apache.spark.SparkConf.set(SparkConf.scala:83)
at org.apache.spark.SparkConf.setAppName(SparkConf.scala:120)
at com.atuigu.doris.spark.JDBCDemo$.main(JDBCDemo.scala:10)
at com.atuigu.doris.spark.JDBCDemo.main(JDBCDemo.scala)
Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make private java.nio.DirectByteBuffer(long,int) accessible: module java.base does not “opens java.nio” to unnamed module @3590fc5b
at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:354)
at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:297)
at java.base/java.lang.reflect.Constructor.checkCanSetAccessible(Constructor.java:188)
at java.base/java.lang.reflect.Constructor.setAccessible(Constructor.java:181)
at org.apache.spark.unsafe.Platform.(Platform.java:56)
… 10 more

1、注意基本的java、scala环境配置
2、注意spark与scala的版本兼容

3、最新的java不支持spark，推荐使用jdk8

4、将依赖中的scope范围注释，provided不会将对应的依赖打入包里
可以参考：https://blog.csdn.net/smileyan9/article/details/126661885