java+dataset+foreach_spark使用java代码实现foreachPartition

System.setProperty("hadoop.home.dir","h:\\hadoop2.3.7");

string mastor="local"

string name="wordcount"+system.currentTimeMillis()

sparkSeesion spark=sparkSeesion.builder().appName(neme).master(mastor).getOrCreate();

Data dataset=spark.read().json("src/j.json")

Dataset jsons=dataset.toJSON();

JavaRDD rdd=json.javaRDD();

rdd.foreachPartition(new VoidFunction>() {

@Override

public void call(Iterator iter) throws Exception {

while(iter.hasNext()) {

String next=iter.next();

System.out.println("获取"+next);

}

}

});

标签：java,mastor,System,iter,next,json,foreachPartition,spark

来源： https://blog.csdn.net/weixin_40672098/article/details/88218370