spark删除mysql记录,删除MySQL表与SparkSQL

I know that we can query or create a Mysql table from SparkSQL through the below commands.

val data = sqlContext.read.jdbc(urlstring, tablename, properties)

data.write.format("com.databricks.spark.csv").save(result_location)

val dataframe = sqlContext.read.json("users.json")

dataframe.write.jdbc(urlstring, table, properties)

Like that is there any way to drop a table ?

解决方案

You can try a basic DROP operation with the JDBC driver :

val DB_URL: String = ???

val USER: String = ???

val PASS: String = ???

def dropTable(tableName: String) = {

import java.sql._;

var conn: Connection = null;

var stmt: Statement = null;

try {

Class.forName("com.mysql.jdbc.Driver");

println("Connecting to a selected database...");

conn = DriverManager.getConnection(DB_URL, USER, PASS);

println("Connected database successfully...");

println("Deleting table in given database...");

stmt = conn.createStatement();

val sql: String = s"DROP TABLE ${tableName} ";

stmt.executeUpdate(sql);

println(s"Table ${tableName} deleted in given database...");

} catch {

case e: Exception => println("exception caught: " + e);

} finally {

???

}

}

dropTable("test")

You can do that with Spark using JDBCUtils but this is more straightforward.