conf:
key | value |
---|---|
spark.ui.port | 4040 |
spark.shuffle.service.port | 7337 |
spark.blockManager.port | 随机,blockmanager监听的端口 |
spark.driver.blockManager.port | 等于spark.blockManager.port |
spark.driver.port | 随机,driver监听的端口,用来和executor以及standalone master通信 |
spark.history.ui.port | 18080,History Server |
standalone 模式:
key | value |
---|---|
SPARK_MASTER_PORT | master是7077, |
SPARK_MASTER_WEBUI_PORT | 8080 for master, |
SPARK_WORKER_PORT | 随机 |
SPARK_WORKER_WEBUI_PORT | 8081 for worker |
spark.master.rest.port | 6066,通过rest方式提交job |