java中void的作业_java.lang.NullPointerException：writeSupportClass在火花流作业中写入实地标文件时不应该为空...

readyToSave.foreachRDD((VoidFunction>) rdd -> {

Configuration configuration = rdd.context().hadoopConfiguration();

Job job = Job.getInstance(configuration);

ParquetOutputFormat.setWriteSupportClass(job, ProtoWriteSupport.class);

ProtoParquetOutputFormat.setProtobufClass(job, MyProtoRecord.class);

rdd.saveAsNewAPIHadoopFile("path-to-hdfs", Void.class, MyProtoRecord.class, ParquetOutputFormat.class, configuration);

});

，我得到以下异常：

java.lang.NullPointerException: writeSupportClass should not be null

at parquet.Preconditions.checkNotNull(Preconditions.java:38)

at parquet.hadoop.ParquetOutputFormat.getWriteSupport(ParquetOutputFormat.java:326)

at parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:272)

at parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:262)

at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1112)

at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1095)

at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)

at org.apache.spark.scheduler.Task.run(Task.scala:86)

at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

我怎么能解决问题呢？

2017-06-14

Mohammad