测试代码如下:
object ReadFileTest {
def main(args: Array[String]): Unit = {
//创建spark环境
val spark: SparkSession = SparkSession.builder()
.appName(ReadFileTest.getClass.getName)
.master("local[6]")
.getOrCreate()
//读取数据,得到DataFrame
val sourceDF: DataFrame = spark.read
.option("header", true)
.csv("/Users/tal/Documents/company/data/test.csv")
//Df注册为临时表
sourceDF.createOrReplaceTempView("test")
//从临时表中查询数据
spark.sql("select bid from test").show(100)
spark.close()
} |
数据源如下:
bid,name,iphone
1,a,118
2,b,111
3,c,125
报错如下:
20/01/09 17:42:52 INFO SparkSqlParser: Pars