异常 spark 运行 未解决

原创 2015年03月30日 14:34:14
3/user/BlockManagerActor1#-1503002418]] after [30000 ms]}
15/03/30 14:32:31 ERROR spark.ContextCleaner: Error cleaning broadcast 3
akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka.tcp://sparkExecutor@ip:60963/user/BlockManagerActor1#-1503002418]] after [30000 ms]
        at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:333)
        at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:117)
        at akka.actor.LightArrayRevolverScheduler$TaskHolder.run(Scheduler.scala:476)
        at akka.actor.LightArrayRevolverScheduler$$anonfun$close$1.apply(Scheduler.scala:282)
        at akka.actor.LightArrayRevolverScheduler$$anonfun$close$1.apply(Scheduler.scala:281)
        at scala.collection.Iterator$class.foreach(Iterator.scala:727)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at akka.actor.LightArrayRevolverScheduler.close(Scheduler.scala:280)
        at akka.actor.ActorSystemImpl.stopScheduler(ActorSystem.scala:687)
        at akka.actor.ActorSystemImpl$$anonfun$liftedTree2$1$1.apply$mcV$sp(ActorSystem.scala:616)
        at akka.actor.ActorSystemImpl$$anonfun$liftedTree2$1$1.apply(ActorSystem.scala:616)
        at akka.actor.ActorSystemImpl$$anonfun$liftedTree2$1$1.apply(ActorSystem.scala:616)
        at akka.actor.ActorSystemImpl$$anon$3.run(ActorSystem.scala:640)
        at akka.actor.ActorSystemImpl$TerminationCallbacks$$anonfun$run$1.runNext$1(ActorSystem.scala:807)
        at akka.actor.ActorSystemImpl$TerminationCallbacks$$anonfun$run$1.apply$mcV$sp(ActorSystem.scala:810)
        at akka.actor.ActorSystemImpl$TerminationCallbacks$$anonfun$run$1.apply(ActorSystem.scala:803)
        at akka.actor.ActorSystemImpl$TerminationCallbacks$$anonfun$run$1.apply(ActorSystem.scala:803)
        at akka.util.ReentrantGuard.withGuard(LockUtil.scala:15)
        at akka.actor.ActorSystemImpl$TerminationCallbacks.run(ActorSystem.scala:803)
        at akka.actor.ActorSystemImpl$$anonfun$terminationCallbacks$1.apply(ActorSystem.scala:637)
        at akka.actor.ActorSystemImpl$$anonfun$terminationCallbacks$1.apply(ActorSystem.scala:637)
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
        at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)
        at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)
        at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)
        at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)
        at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)
        at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:393)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Spark排错与优化

此文章新地址一.报错常见错误1.shuffle.FetchFailedException错误提示(1) missing output locationorg.apache.spark.shuffle....
  • lsshlsw
  • lsshlsw
  • 2015年10月15日 17:08
  • 34318

Akka 学习笔记

容错 容错:不是抓住系统所有的错误并恢复,而是将错误(崩溃)孤立出来,不会导致整个系统崩溃(隔离故障组件),备份组件可以替换崩溃组件(冗余)(可恢复性)  容错方式:Restart, Resu...

Akka2使用探索4(Actors)

Actor模型为编写并发和分布式系统提供了一种更高的抽象级别。它将开发人员从显式地处理锁和线程管理的工作中解脱出来,使编写并发和并行式系统更加容易。 Akka Actor的API与Scala Act...

Spark问题3之SparkException:Error notifying standalone scheduler's driver endpoint

更多代码请见:https://github.com/xubo245/SparkLearningSpark生态之Alluxio学习 版本:alluxio(tachyon) 0.7.1,spark-1.5...

Spark问题11之广播失败

更多代码请见:https://github.com/xubo245/SparkLearningSpark生态之Alluxio学习 版本:alluxio(tachyon) 0.7.1,spark-1.5...

[解决]Spark运行中java.net.UnknownHostException: nameservice1的异常

[Author]: kwu_和讯大数据 解决Spark运行中java.net.UnknownHostException: nameservice1的异常,nameservice1是配置hdfs中用到...
  • BDCHome
  • BDCHome
  • 2015年09月08日 16:16
  • 5016

Android UncaughtExceptionHandler 解决未捕获异常,防止软件报”停止运行“

UncaughtExceptionHandler接口这个接口就是处理程序中没有处理的异常,而且是在系统抛出异常导致程序异常终止之前!无论是空值针,参数异常等各种异常出现后,若代码中未进行处理,均会调用...

Spark运行程序异常信息: org.apache.spark.SparkException: Task not serializable 解决办法

Spark 运行程序异常信息: org.apache.spark.SparkException: Task not serializable 解决办法...

spark点点滴滴 —— 运行scala任务异常处理

spark版本:2.0.1 最近在用spark提交scala语言写的任务时,提交任务总是失败,异常如下:17/05/05 18:39:23 ERROR yarn.ApplicationMaster:...

Android-捕获运行时未捕获的异常

package com.onetoo.www.onetoo.utils; import android.content.Context;/** * Created by longShun on 20...
内容举报
返回顶部
收藏助手
不良信息举报
您举报文章:异常 spark 运行 未解决
举报原因:
原因补充:

(最多只允许输入30个字)