![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark-storage模块
文章平均质量分 72
heruilong1988
喜欢动漫 排球
展开
-
BlockManagerSlaveActor类
private[storage]class BlockManagerSlaveActor(blockManager: BlockManager) extends Actor { override def receive = { case RemoveBlock(blockId) => blockManager.removeBlock(blockId)原创 2014-05-20 16:00:15 · 885 阅读 · 0 评论 -
BlockManager
每次rdd调用iterator方法时,都先会从final def iterator(split: Partition, context: TaskContext): Iterator[T] = { if (storageLevel != StorageLevel.NONE) { SparkEnv.get.cacheManager.getOrCom原创 2014-05-20 16:25:30 · 697 阅读 · 0 评论 -
BlockManagerMasterActor类
override def preStart() { if (!BlockManager.getDisableHeartBeatsForTesting(conf)) { import context.dispatcher timeoutCheckingTask = context.system.scheduler.schedule(0.seconds, chec原创 2014-05-20 15:56:08 · 622 阅读 · 0 评论