spark读取postgresql中的数据:
代码实现
val pgUrl = "jdbc:postgresql://ip:5433/databaseName"
// 读取pg中的数据
val df1 = hiveContext.read.format("jdbc")
.option("url", pgUrl)
.option("user", "user")
.option("password", "password")
.option("dbtable", "tablename")
.load()
df1.show()
依赖的jar包:
<!-- https://mvnrepository.com/artifact/org.postgresql/postgresql -->
<dependency>
<groupId>org.postgresql</groupId>
<artifactId>postgresql</artifactId>
<version>42.2.2</version>
</dependency>