Spark Yarn Client模式spark.driver.host导致 Cannot assign requested address: Service ‘sparkDriver‘ failed

最新推荐文章于 2022-03-30 21:25:14 发布

九师兄

最新推荐文章于 2022-03-30 21:25:14 发布

阅读量2.6k

点赞数

分类专栏：大数据-spark

本文为博主九师兄（QQ:541711153 欢迎来探讨技术）原创文章，未经允许博主不允许转载。

本文链接：https://blog.csdn.net/qq_21383435/article/details/100147850

版权

大数据-spark 专栏收录该内容

201 篇文章 476 订阅 ¥49.90 ¥99.00

订阅专栏

1.背景

在这里插入图片描述

[deploy@fideploy cheetah-node]$  /opt/cloudera/parcels/SPARK2/bin/spark2-submit  --keytab /etc/security/keytabs/cluster_user.keytab --principal [email protected] --class com.dtwave.cheetah.node.spark.structured.streaming.StructureStreamingExecutor --name test --master yarn --deploy-mode client --queue root.default /opt/workspace/cheetah-node/libs/spark-structured-streaming.jar  deploy-mode=client  task-protocol=/data/cheetah-node/codes/T_6167372758075432_20190829211641_2_1/stream_info   yarn-address=xxx:8032


WARNING: User-defined SPARK_HOME (/opt/cloudera/parcels/SPARK2-2.2.0.cloudera4-1.cdh5.13.3.p0.603055/lib/spark2) overrides detected (/opt/cloudera/parcels/SPARK2/lib/spark2).
WARNING:

了解本专栏

订阅专栏解锁全文

优惠劵

九师兄

关注关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
打赏
0
评论
Spark Yarn Client模式spark.driver.host导致 Cannot assign requested address: Service ‘sparkDriver‘ failed

1.背景[deploy@fideploy cheetah-node]$ /opt/cloudera/parcels/SPARK2/bin/spark2-submit --keytab /etc/security/keytabs/cluster_user.keytab --principal [email protected] --class com.dtwave.cheetah....
复制链接

扫一扫