pyspark读取mysql和oracle

读取语法

mysql和oracle写法的格式一样

数据库配置

user,password,driver='xxx','yyy','zzz'
url = 'jdbc:mysql://host:port/database'
prop = {'user': user, 'password': password,'driver': driver}

方式1

最短的写法，我比较喜欢，尤其是读数据库次数较多的时候

data = spark.read.jdbc(url=url, table='tb_newCity', properties=prop)# data是个dataframe
data.write.jdbc(url=url, table='new', mode='append', properties=prop)

方式2

	df.write.format('jdbc')\
			.options(url=url,driver=driver,dbtable='user_activity',user='123',password='456')\
			.mode('append').save()

方式3

jdbcDF = spark.read.format("jdbc")\
    .option("driver",driver)\
    .option("url",url)\
    .option("dbtable","student")\
    .option("user",user)\
    .option("password",password)\
		.load()