spark代码连接hive_如何在SparkSQL中以编程方式连接到Hive Metastore？

我也面临同样的问题，但已经解决了 . 只需按照Spark 2.0版本中的步骤操作即可

Step1: 将Hive conf文件夹中的hive-site.xml文件复制到spark conf .

Step 2: 编辑spark-env.sh文件并配置你的mysql驱动程序 . (如果您使用Mysql作为hive Metastore . )

或者将MySQL驱动程序添加到Maven / SBT(如果使用那些)

Step3: 创建spark会话时添加enableHiveSupport()

val spark = SparkSession.builder.master(“local”) . appName(“testing”) . enableHiveSupport() . getOrCreate()

Sample code:

package sparkSQL

/**

* Created by venuk on 7/12/16.

*/

import org.apache.spark.sql.SparkSession

object hivetable {

def main(args: Array[String]): Unit = {

val spark = SparkSession.builder.master("local[*]").appName("hivetable").enableHiveSupport().getOrCreate()

spark.sql("create table hivetab (name string, age int, location string) row format delimited fields terminated by ',' stored as textfile")

spark.sql("load data local inpath '/home/hadoop/Desktop/asl' into table hivetab").show()

val x = spark.sql("select * from hivetab")

x.write.saveAsTable("hivetab")

}

}

Output: