项目中java连接cdh中的kafka报错java.io.IOException: Can‘t resolve address: node0X:9092的解决方案

14 篇文章 1 订阅
8 篇文章 0 订阅

问题

docker 容器日志报java.io.IOException: Can't resolve address: node04:9092

 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 19 common frames omitted
 
 2021-02-07 14:54:07.591  WARN 6 --- [ntainer#3-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-4, groupId=databank-broker2] Error connecting to node node04:9092 (id: 189 rack: null)
 
 java.io.IOException: Can't resolve address: node04:9092
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:235) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.common.network.Selector.connect(Selector.java:214) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:864) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:265) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.trySend(ConsumerNetworkClient.java:485) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:261) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:242) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:230) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:314) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentbroker2IfNeeded(KafkaConsumer.java:1218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1175) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1154) [kafka-clients-2.0.1.jar!/:na]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java:742) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:699) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_272]
 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_272]
 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 17 common frames omitted
 
 2021-02-07 14:54:07.592  WARN 6 --- [ntainer#1-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-8, groupId=databank-broker2] Error connecting to node node05:9092 (id: 187 rack: null)
 
 java.io.IOException: Can't resolve address: node05:9092
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:235) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.common.network.Selector.connect(Selector.java:214) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:864) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:265) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.trySend(ConsumerNetworkClient.java:485) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:261) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:242) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:230) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:314) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentbroker2IfNeeded(KafkaConsumer.java:1218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1175) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1154) [kafka-clients-2.0.1.jar!/:na]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java:742) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:699) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_272]
 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_272]
 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 17 common frames omitted

本模块,连接的是cdh集群的kafka集群

解决方案

在cdh中搜索http://$(host_ip):7180/cmf/services/44/config#filterfreeText=kafka.p

 

在“kafka.properties 的 Kafka Broker 高级配置代码段(安全阀)”的列表中,每个broker节点,加入如下配置

listeners=PLAINTEXT://0.0.0.0:9092
advertised.listeners=PLAINTEXT://196.168.6.18:9092

有几个对应的broker,添加几个,这样项目就可以正常连接cdh中的kafka集群了。

  • 1
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 2
    评论
这个错误的原因是文件系统无法删除当前目录。根据提供的引用内容,我们可以看到在HDFSClient类的main方法,使用了`FileSystem.copyFromLocalFile`方法将一个文件从本地复制到HDFS的根目录下。而在这个方法之前,没有删除HDFS当前目录的操作。 要解决这个问题,可以在复制文件之前,先删除HDFS当前目录。根据引用的解决方法,可以通过删除Hadoop的temp和logs文件夹来解决。具体步骤如下: 1. 打开文件`hadoop-env.sh`,位于`/usr/local/hadoop-2.6.0-cdh5.9.3/etc/hadoop`目录下。可以使用`vim`命令来编辑该文件。 2. 在文件找到`export HADOOP_HOME=/usr/local/hadoop-2.6.0-cdh5.9.3`这一行,下面添加一行`export HADOOP_SSH_OPTS="-p 22"`。 3. 保存文件并退出编辑模式。 4. 在命令行执行`rm -rf temp/ logs/`命令,删除Hadoop的temp和logs文件夹。 这样,再次运行程序时,就可以成功删除当前目录了。<span class="em">1</span><span class="em">2</span><span class="em">3</span> #### 引用[.reference_title] - *1* *2* *3* [Java后台日常学习环境搭建](https://blog.csdn.net/xyxc202/article/details/108752078)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_1"}}] [.reference_item style="max-width: 100%"] [ .reference_list ]
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

阿啄debugIT

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值