1、启动spark-shell
bin/spark-shell --master spark://search01:7077 yarn-client
2、使用
val nowWeekPathList=List("hdfs://cluster1/data/preHandle/ioc/20200327","hdfs://cluster1/data/preHandle/ioc/20200325")
val newIoc=spark.read.option("header","true").csv("/data/preHandle/ioc/20200319",