启动spark thrif server

cp /hive-3.1.2/conf/hive-site.xml /spark-3.0.0/conf
cp /hadoop-3.2.1/etc/hadoop/hdfs-site.xml /spark-3.0.0/conf
cp /hadoop-3.2.1/etc/hadoop/core-site.xml /spark-3.0.0/conf

-- 复制hadoop-yarn-server-resourcemanager-3.2.1.jar到/spark-3.0.0/jars
cp /hadoop-3.2.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.2.1.jar  /spark-3.0.0/jars

cd /spark-3.0.0/sbin

#启动thriftserver，默认queue为default
./start-thriftserver.sh --hiveconf spark.yarn.queue=default

启动报如下错误

Caused by: org.datanucleus.exceptions.NucleusException: Attempt to invoke the "BONECP" plugin to create a ConnectionPool gave an error : The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:232)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.initialiseDataSources(ConnectionFactoryImpl.java:117)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.<init>(ConnectionFactoryImpl.java:82)
	... 97 more
Caused by: org.datanucleus.store.rdbms.connectionpool.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.
	at org.datanucleus.store.rdbms.connectionpool.AbstractConnectionPoolFactory.loadDriver(AbstractConnectionPoolFactory.java:58)
	at org.datanucleus.store.rdbms.connectionpool.BoneCPConnectionPoolFactory.createConnectionPool(BoneCPConnectionPoolFactory.java:54)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl.generateDataSources(ConnectionFactoryImpl.java:213)
	... 99 more
Nested Throwables StackTrace:

解决:

有些说是spark-env.sh未配置com.mysql.jdbc.Driver，其实是缺少mysql-connector-java包

cp /hive-3.1.2/lib/mysql-connector-java-5.1.48.jar  /Users/zheng/spark/spark-3.0.0/jars

 

启动完后在http://localhost:8088/cluster/apps/RUNNING页面能看到running中的application