1.取列名
val columnName = ss.sql(desc $tableName).first.get(0)
where $columnName != ‘$columnName’
lower($columnName) NOT LIKE %$columnName%
2.sql中进行大小写忽略比较
lower(字段) NOT LIKE %‘xxx’%
3.local模式读取本地文件,亲测,直接写路径即可。不用加file:///
4. 获取2个时间间隔内的所有日期
val dtf =
var startDate = LocalDate.parse(startPart,dtf)
var endDate = LocalDate.parse(endPart,dtf)
while(startDate.isBefor(endDate) || startDate.isEqual(endDate)) {
dateRangeArr.append(startDate)
startDate = startDate.plus(1,ChronUnit.DAYS)
}
5. 在匿名函数中使用break
import util.control.Breaks._
dateRangeArr.foreach(
col => breakable {
if(df.count == 0) break
}
)