IDEA实现Spark连接Hive

 1.拷贝hive-site.xml文件到classpath下


2.pom.xml增加对应的依赖关系（包含MYSQL的驱动）

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-hive_2.12</artifactId>
    <version>3.0.0</version>
</dependency>
<dependency>
    <groupId>org.apache.hive</groupId>
    <artifactId>hive-exec</artifactId>
    <version>1.2.1</version>
</dependency>
<dependency>
    <groupId>mysql</groupId>
    <artifactId>mysql-connector-java</artifactId>
    <version>5.1.27</version>
</dependency>

3. 测试连接

spark环境要添加enableHiveSupport()

//TODO 创建SparkSQL的运行环境
val spark_Conf = new SparkConf().setMaster("local[*]").setAppName("SparkSQL")
val spark = SparkSession.builder().enableHiveSupport().config(spark_Conf).getOrCreate()

//TODO 测试连接
spark.sql("show tables").show

//TODO 关闭环境
spark.close()