一.POM依赖
作者的hadoop集群环境为:
HDFS,YARN,MapReduce2 : 2.7.3Hive : 1.2.1000
HBase : 1.1.2
注:phoenix版本依赖性较强,请注意不同发行版之间的差异(直接从集群服务器上获取jar包最为可靠)
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<spring-data-hadoop.version>2.4.0.RELEASE</spring-data-hadoop.version>
<hive.version>1.2.1</hive.version>
<phoenix-client.version>4.7</phoenix-client.version>
<druid.version>1.0.27</druid.version>
</properties>
<dependencies>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-jdbc</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.data</groupId>
<artifactId>spring-data-hadoop</artifactId>
<version>${spring-data-hadoop.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-jdbc</artifactId>
<version>${hive.version}</version>
</dependency>
<dependency>
<groupId>org.apache.phoenix</groupId>
<artifactId>phoenix-client</artifactId>
<version>${phoenix-client.version}</version>
</dependency>
<dependency>
<groupId>com.alibaba</groupId>
<artifactId>druid</artifactId>
<version>${druid.version}</version>
</dependency>
</dependencies>
二.spring boot 配置文件
因为spring boot 是默认且推荐采用yaml和properties配置文件的方式。因此,作者在这里采用yaml方式为例:
application.yml: