- 注: 堆java size > 分配内存
1, ResourceManager 内存
----内存(MB)--- | |
---|---|
yarn.scheduler.minimum-allocation-mb | 默认 1024MB |
yarn.scheduler.maximum-allocation-mb | 默认 8192MB |
----java堆内存大小--- | |
Java Heap Size of ResourceManager in Bytes | 默认 1G |
----cpu个数--- | |
yarn.scheduler.minimum-allocation-vcores | 默认 1 |
yarn.scheduler.maximum-allocation-vcores | 默认 4 |
2 :ApplicationMaster 内存
----ApplicationMaster Memory内存--- | |
---|---|
yarn.app.mapreduce.am.resource.mb | |
----java堆内存大小--- | |
ApplicationMaster Java Maximum Heap Size | |
---ApplicationMaster Virtual CPU Cores--- | |
yarn.app.mapreduce.am.resource.cpu-vcores | 默认 1 |
3, NodeManager内存
yarn.nodemanager.resource.memory-mb | 默认 -1 (80%物理内存) |
---|---|
yarn.nodemanager.resource.cpu-vcores | 默认 -1 |
yarn.nodemanager.resource.cpu-vcores | 默认 -1 |
----java堆内存大小--- | |
Java Heap Size of NodeManager in Bytes | 默认 1G |
4, map-reduce内存
mapreduce.map.memory.mb | [minimum-allocation-mb , maximum-allocation-mb) |
---|---|
mapreduce.reduce.memory.mb | [minimum-allocation-mb , maximum-allocation-mb) : 约等2x的map内存 |
----java堆内存大小--- | |
Map Task Maximum Heap Size | Reduce Task Maximum Heap Size |