spark 读取alluxio: Caused by: java.io.IOException: Block 38416150429696 is not available in Alluxio

使用Alluxio， 读取文件报错：

30-09-2017 10:41:14 CST gpsWarning INFO - Driver stacktrace:
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1435)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1423)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1422)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1422)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.Option.foreach(Option.scala:257)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:802)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1650)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1605)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1594)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:628)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext.runJob(SparkContext.scala:1918)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext.runJob(SparkContext.scala:1931)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext.runJob(SparkContext.scala:1944)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext.runJob(SparkContext.scala:1958)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.rdd.RDD.count(RDD.scala:1157)
30-09-2017 10:41:14 CST gpsWarning INFO - at com.weidai.gps.warning2.rules.calculate.GPSWarnRunner$.getProcessData(GPSWarnRunner.scala:706)
30-09-2017 10:41:14 CST gpsWarning INFO - at com.weidai.gps.warning2.rules.calculate.GPSWarnRunner$.drive(GPSWarnRunner.scala:85)
30-09-2017 10:41:14 CST gpsWarning INFO - at com.weidai.gps.warning2.rules.calculate.GPSWarnRunner$.main(GPSWarnRunner.scala:72)
30-09-2017 10:41:14 CST gpsWarning INFO - at com.weidai.gps.warning2.rules.calculate.GPSWarnRunner.main(GPSWarnRunner.scala)
30-09-2017 10:41:14 CST gpsWarning INFO - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
30-09-2017 10:41:14 CST gpsWarning INFO - at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
30-09-2017 10:41:14 CST gpsWarning INFO - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
30-09-2017 10:41:14 CST gpsWarning INFO - at java.lang.reflect.Method.invoke(Method.java:498)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
30-09-2017 10:41:14 CST gpsWarning INFO - Caused by: java.io.IOException: Block 38416150429696 is not available in Alluxio
30-09-2017 10:41:14 CST gpsWarning INFO - at alluxio.client.block.AlluxioBlockStore.getInStream(AlluxioBlockStore.java:134)
30-09-2017 10:41:14 CST gpsWarning INFO - at alluxio.client.file.FileInStream.updateBlockInStream(FileInStream.java:519)
30-09-2017 10:41:14 CST gpsWarning INFO - at alluxio.client.file.FileInStream.updateStreams(FileInStream.java:426)
30-09-2017 10:41:14 CST gpsWarning INFO - at alluxio.client.file.FileInStream.close(FileInStream.java:145)
30-09-2017 10:41:14 CST gpsWarning INFO - at alluxio.hadoop.HdfsFileInputStream.read(HdfsFileInputStream.java:194)
30-09-2017 10:41:14 CST gpsWarning INFO - at java.io.DataInputStream.read(DataInputStream.java:149)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.mapreduce.lib.input.UncompressedSplitLineReader.fillBuffer(UncompressedSplitLineReader.java:59)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.util.LineReader.readDefaultLine(LineReader.java:216)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.util.LineReader.readLine(LineReader.java:174)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.mapreduce.lib.input.UncompressedSplitLineReader.readLine(UncompressedSplitLineReader.java:91)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.mapred.LineRecordReader.skipUtfByteOrderMark(LineRecordReader.java:208)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:246)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:48)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.rdd.HadoopRDD$$anon$1.getNext(HadoopRDD.scala:266)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.rdd.HadoopRDD$$anon$1.getNext(HadoopRDD.scala:211)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:73)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:439)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:461)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
30-09-2017 10:41:14 CST gpsWarning INFO - at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1760)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1157)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1157)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1944)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1944)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.scheduler.Task.run(Task.scala:99)
30-09-2017 10:41:14 CST gpsWarning INFO - at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282)
30-09-2017 10:41:14 CST gpsWarning INFO - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
30-09-2017 10:41:14 CST gpsWarning INFO - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
30-09-2017 10:41:14 CST gpsWarning INFO - at java.lang.Thread.run(Thread.java:745)

原因：block丢失，主要是因为alluxio内存使用问题，每个work会将数据缓存，而不是分布式缓存，导致后面的不经常用的数据丢失

reference: http://blog.csdn.net/xubo245/article/details/53190921