Clinet、ResourceManager、NodeManager、ApplicationMaster
master/slave:RM/NM
Clinet:向RM提交任务,杀死任务
ApplicationMaster:每个应用程序对应一个AM,AM向RM申请资源用于在NM上启动对应的Task,数据切分,为每个Task向RM申请资源(container),NodeManager通信,任务的监控
NodeManager(多个):干活、向RM发送心跳信息、任务的执行情况、启动任务,接受来自RM的请求来启动任务,处理来自AM的命令
ResourceManager:集群中同一时刻对外提供服务的只有一个,负责资源相关,处理来自客户端的请求:提交、杀死
启动/监控AM
监控NM
资源相关
container:任务的运行的抽象
memory、cpu…
task是运行在container里面的
可以运行am、也可以运行map/reduce task
The ResourceManager has two main components: Scheduler and ApplicationsManager.
The Scheduler is responsible for allocating resources to the various running applications subject to familiar constraints of capacities, queues etc. The Scheduler is pure scheduler in the sense that it performs no monitoring or tracking of status for the application. Also, it