学习 sparksql 遇到的异常问题

问题描述：启动spark和zookeeper，在客户端以spark-shell --master local[2] 方式启动

1. val lineRDD= sc.textFile("/person.txt").map(_.split(" ")) 读取hdfs上的文件

将RDD转换成DataFrame 执行rdd.toDF方法报错

执行 lineRDD.collect方法仍然报错才发现hadoop集群没启动，然后启动hadoop集群，但是仍然报下面的错

解决方法：在hadoop启动的情况下，重新启动spark-shell 问题解决，不知道为什么要先启动Hadoop才可以

Caused by: org.apache.derby.iapi.error.StandardException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@597aab09, see the next exception for details.
  at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
  at org.apache.derby.impl.jdbc.SQLExceptionFactory.wrapArgsForTransportAcrossDRDA(Unknown Source)
  ... 153 more
Caused by: org.apache.derby.iapi.error.StandardException: Another instance of Derby may have already booted the database /export/servers/spark2.3.3/bin/metastore_db.
  at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
  at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
  at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source)
  at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source)
  at java.security.AccessController.doPrivileged(Native Method)
  at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source)
  at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source)
  at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source)
  at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source)
  at org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown Source)
  at org.apache.derby.impl.services.monitor.FileMonitor.startModule(Unknown Source)
  at org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown Source)
  at org.apache.derby.impl.store.raw.RawStore$6.run(Unknown Source)
  at java.security.AccessController.doPrivileged(Native Method)
  at org.apache.derby.impl.store.raw.RawStore.bootServiceModule(Unknown Source)
  at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source)
  at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source)
  at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source)
  at org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown Source)
  at org.apache.derby.impl.services.monitor.FileMonitor.startModule(Unknown Source)

spark