spark-storage模块
文章平均质量分 72
heruilong1988
喜欢动漫 排球
展开
-
BlockManagerSlaveActor类
private[storage] class BlockManagerSlaveActor(blockManager: BlockManager) extends Actor { override def receive = { case RemoveBlock(blockId) => blockManager.removeBlock(blockId)原创 2014-05-20 16:00:15 · 891 阅读 · 0 评论 -
BlockManager
每次rdd调用iterator方法时,都先会从 final def iterator(split: Partition, context: TaskContext): Iterator[T] = { if (storageLevel != StorageLevel.NONE) { SparkEnv.get.cacheManager.getOrCom原创 2014-05-20 16:25:30 · 707 阅读 · 0 评论 -
BlockManagerMasterActor类
override def preStart() { if (!BlockManager.getDisableHeartBeatsForTesting(conf)) { import context.dispatcher timeoutCheckingTask = context.system.scheduler.schedule(0.seconds, chec原创 2014-05-20 15:56:08 · 631 阅读 · 0 评论