pyspark An error occurred while calling o30.jdbc. java.lang.ClassNotFoundException: com.mysql.jdbc.

1.pyspark读取mysql错误

from pyspark.sql import SparkSession

if __name__ == '__main__':

    spark = SparkSession.Builder() \
        .appName('t') \
        .master('local') \
        .getOrCreate()

    url = 'jdbc:mysql://localhost:3306/db'
    property = {
        'user': '***', 'password': '***', 'driver': 'com.mysql.jdbc.Driver'
    }
    spark.read.jdbc(url=url, table='a', properties=property).show()
    spark.stop()

    1.1 File "lib\site-packages\py4j\protocol.py", line 319, in get_return_value
    format(target_id, ".", name), value)
py4j.protocol.Py4JJavaError: An error occurred while calling o30.jdbc.

: java.lang.ClassNotFoundException: com.mysql.jdbc.Driver

这种问题直接在%SPARK_HOME%/jars 添加mysql-connector-java-5.1.39.jar 包直接解决

注意：当然也可以不用写driver