u010865811的博客

1.去掉本地代码中setMaster("local[5]")2.用maven在本地编译代码：     maven clean package -DskipTests3.服务端运行  spark-submit --master local[5]\       //本地模式启动spark--jars $(echo /home/hadoop/app/hbase-1.2.0-cdh5.7.0/lib/*....

1.idea  排除掉了此包2.自己定义的包名是否跟系统的冲突

需要引入的包： import org.apache.spark.sql.expressions.Window import org.apache.spark.sql.functions._ //scala实现row_number() over(partition by , order by ) val w = Window.partitionBy($"prediction").o...

解决： 1.利用流的方式读取文件 ImputStream inputStream2 = this.getClass.getClassLoader.getResourceAsStream(“dict/xxx.txt”) BufferedReader reader2 = new BufferedReader(new InputStreamReader(inputStream2,"UTF-8")) ...