在spark-on-yarn下cluster模式中显示
ResourceManager:负责集群中所有资源的统一管理和分配,它接收来自各个节点(NodeManager)的资源汇报信息,并把这些信息按照一定的策略分配给各个应用程序(实际上是ApplicationManager)。
NameNode:
SecondaryNameNode:
DataNode:
NodeManager:
CoarseGrainedExecutorBackend:
SparkSubmit
ApplicationMaster:
在spark-on-yarn下client模式中显示
ResourceManager:
NameNode:
SecondaryNameNode:
DataNode:
NodeManager:
CoarseGrainedExecutorBackend:
SparkSubmit: