spark-shell报错
Caused by: org.apache.derby.iapi.error.StandardException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@15fd903, see the next exception for details.
at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 153 more
Caused by: org.apache.derby.iapi.error.StandardException: Another instance of Derby may have already booted the database /home/hadoop/metastore_db.
原因:错误XSDB6:Derby的另一个实例可能已经启动了数据库/ metastore_db。因为已经有多个其他Spark-Shell实例已经运行并且已经拥有了derby DB,所以当我启动另一个Spark Shell并使用RDD.toDF()创建数据框时,它抛出错误
解决方式:运行ps命令来查找Spark-Shell的其他实例:ps -ef | grep spark-shell
我使用kill命令杀死它们:
kill -9 Spark-Shell-processID(例如:kill -9 4848),并重新启动spark-shell