Spark应用程序无法写入在docker中运行的elasticsearch解决办法

最新推荐文章于 2024-01-20 22:18:50 发布

zhangjunli

最新推荐文章于 2024-01-20 22:18:50 发布

阅读量240

点赞数 1

分类专栏： Spark ElasticSearch Docker 文章标签： Spark Elasticsearch 连接超时配置解决方法

本文链接：https://blog.csdn.net/zhangjunli/article/details/111224227

版权

Docker 同时被 3 个专栏收录

76 篇文章 1 订阅

订阅专栏

Spark

17 篇文章 0 订阅

订阅专栏

ElasticSearch

7 篇文章 0 订阅

订阅专栏

报错如下：

20/12/15 16:23:44 INFO EsRDDWriter: Writing to [spark/docs]
20/12/15 16:24:05 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection timed out: connect
20/12/15 16:24:05 INFO HttpMethodDirector: Retrying request
20/12/15 16:24:05 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection timed out: connect
20/12/15 16:24:05 INFO HttpMethodDirector: Retrying request
20/12/15 16:24:26 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection timed out: connect
20/12/15 16:24:26 INFO HttpMethodDirector: Retrying request
20/12/15 16:24:26 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection timed out: connect
20/12/15 16:24:26 INFO HttpMethodDirector: Retrying request

解决办法：

conf.set("es.nodes.wan.only", "true")

添加如上配置项即可

zhangjunli

关注

1
点赞
踩
0

收藏

觉得还不错? 一键收藏
2
评论
Spark应用程序无法写入在docker中运行的elasticsearch解决办法

报错如下：20/12/15 16:23:44 INFO EsRDDWriter: Writing to [spark/docs]20/12/15 16:24:05 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection timed out: connect20/12/15 16:24:05 INFO HttpMethodDirect.
复制链接

扫一扫