Spark深入分析（目录）

Spark-Core

• Spark-Init

1. SparkContext
2. SparkEnv
3. SparkConf
4. RpcEnv
5. SparkStatusTracker
6. SecurityManager
7. SparkUI
8. MetricsSystem

• Spark-Memory

1. ........

• Spark-Storage

1. SerializerManager
2. BroadcastManager
3. ShuffleManager
4. MemoryManager
5. NettyBlockTransferService
6. BlockManagerMaster
7. BlockManager

• Spark-Compute

1. LiveListenerBus
2. MapOutputTracker
3. DAGScheduler
4. TaskScheduler
5. ExecutorAllocationManager
6. OutputCommitCoordinator
7. ContextClearner

• Spark-RunOn

1. on Yarn
2. on Standlone
3. on Mesos
4. on Local

Spark-Subassembly(Spark组件)

• Spark-SQL

1. Spark-Session
2. Sql-Context
3. BaseRelation
4. SparkPlan
5. SparkOptimizer
6. SparkSqlParser
7. QueryExecution

• Spark-Streaming

• Spark-MLib

• Spark-Graphx

Spark-Public

• Spark-Tags

 

 

 

 

 

 

 

 

 

 

(不定时更新，未完待续)