将Hive的配置文件拷贝到Spark中后,启动spark-shell
scala> spark.sql("show databases").show
报错如下
org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
要将mysql的驱动拷贝到spark的jars下面
[hadoop@hadoop002 lib]$ cp mysql-connector-java-5.1.27-bin.jar /home/hadoop/app/spark-2.4.4-bin-2.6.0-cdh5.15.1/jars/
停止之前的spark-shell服务,并重新启动
scala> spark.sql("show databases").show()
19/10/14 18:51:09 ERROR ObjectStore: Version information found in metastore differs 1.1.0-cdh5.15.1 from expected schema version 1.2.0. Schema verififcation is disabled hive.metastore.schema.verification so setting version.
+------------+
|databaseName|
+------------+
| default|
| test|