kafka2,金九银十正确打开方式

先自我介绍一下,小编浙江大学毕业,去过华为、字节跳动等大厂,目前阿里P7

深知大多数程序员,想要提升技能,往往是自己摸索成长,但自己不成体系的自学效果低效又漫长,而且极易碰到天花板技术停滞不前!

因此收集整理了一份《2024年最新大数据全套学习资料》,初衷也很简单,就是希望能够帮助到想自学提升又不知道该从何学起的朋友。
img
img
img
img
img

既有适合小白学习的零基础资料,也有适合3年以上经验的小伙伴深入学习提升的进阶课程,涵盖了95%以上大数据知识点,真正体系化!

由于文件比较多,这里只是将部分目录截图出来,全套包含大厂面经、学习笔记、源码讲义、实战项目、大纲路线、讲解视频,并且后续会持续更新

如果你需要这些资料,可以添加V获取:vip204888 (备注大数据)
img

正文

ssl.key.password=test1234

ssl.truststore.location=/home/lighthouse/server.truststore.jks

ssl.truststore.password=测试1234


注意:ssl.truststore.password 在技术上是可选的,但强烈建议使用。如果未设置密码,则对信任库的访问仍然可用,但完整性检查将被禁用。值得考虑的可选设置:


1. ssl.client.auth=none(“required” => 需要客户端身份验证,“requested” =>请求客户端身份验证,没有证书的客户端仍然可以连接。不建议使用“requested”,因为它提供了错误的安全感,并且配置错误的客户端仍将成功连接。
2. ssl.cipher.suites(可选)。密码套件是身份验证、加密、MAC 和密钥交换算法的命名组合,用于协商使用 TLS 或 SSL 网络协议的网络连接的安全设置。(默认值为空列表)
3. ssl.enabled.protocols=TLSv1.2,TLSv1.1,TLSv1 (列出要从客户端接受的 SSL 协议。请注意,SSL 已被弃用,取而代之的是 TLS,不建议在生产中使用 SSL)
4. ssl.keystore.type=JKS
5. ssl.truststore.type=JKS
6. ssl.secure.random.implementation=SHA1PRNG


如果要为代理之间的通信启用 SSL,请将以下内容添加到 server.properties 文件(默认为 PLAINTEXT)



security.inter.broker.protocol=SSL



1. 5[配置 Kafka 客户端]( )


SSL 仅支持新的 Kafka 生产者和使用者,不支持较旧的 API。对于生产者和使用者,SSL 的配置是相同的。  
 如果代理中不需要客户机认证,那么下面是一个最小配置示例:



security.protocol=SSL协议

ssl.truststore.location=/var/private/ssl/client.truststore.jks

ssl.truststore.password=测试1234


注意:ssl.truststore.password 在技术上是可选的,但强烈建议使用。如果未设置密码,则对信任库的访问仍然可用,但完整性检查将被禁用。如果需要客户机认证,那么必须像步骤 1 中一样创建密钥库,并且还必须配置以下内容:



ssl.keystore.location=/var/private/ssl/client.keystore.jks

ssl.keystore.password=test1234

ssl.key.password=test1234


根据我们的要求和代理配置,可能还需要其他配置设置:


1. ssl.provider(可选)。用于 SSL 连接的安全提供程序的名称。缺省值是 JVM 的缺省安全提供程序。
2. ssl.cipher.suites(可选)。密码套件是身份验证、加密、MAC 和密钥交换算法的命名组合,用于协商使用 TLS 或 SSL 网络协议的网络连接的安全设置。
3. ssl.enabled.protocols=TLSv1.2,TLSv1.1,TLSv1。它应该列出至少一个在代理端配置的协议
4. ssl.truststore.type=JKS
5. ssl.keystore.type=JKS


生产者和消费者共同使用到的client-ssl.properties文件内容如下:


![](https://img-blog.csdnimg.cn/direct/bd2be38c9d9f478391fc064cde91996a.png)


使用 console-producer 和 console-consumer 的示例:



./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test --producer.config ./config/client-ssl.properties
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --consumer.config ./config/client-ssl.properties


报错了:


![](https://img-blog.csdnimg.cn/direct/4835b7255e294b33bd90b2e2c200bf91.png)


还要在用户目录下执行如下命令,信任客户端:



keytool -keystore client.truststore.jks -alias CARoot -import -file ca-cert
keytool -keystore client.keystore.jks -alias CARoot -import -file ca-cert


如果密码错了,还会报如下错误:



lighthouse@VM-8-10-ubuntu:~/kafkaWithZk/kafka_2.12-2.2.1$ ./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test --producer.config ./config/client-ssl.properties
org.apache.kafka.common.KafkaException: Failed to construct kafka producer
at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:431)
at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:299)
at kafka.tools.ConsoleProducer . m a i n ( C o n s o l e P r o d u c e r . s c a l a : 44 ) a t k a f k a . t o o l s . C o n s o l e P r o d u c e r . m a i n ( C o n s o l e P r o d u c e r . s c a l a ) C a u s e d b y : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : F a i l e d t o l o a d S S L k e y s t o r e / h o m e / l i g h t h o u s e / c l i e n t . t r u s t s t o r e . j k s o f t y p e J K S a t o r g . a p a c h e . k a f k a . c o m m o n . n e t w o r k . S s l C h a n n e l B u i l d e r . c o n f i g u r e ( S s l C h a n n e l B u i l d e r . j a v a : 73 ) a t o r g . a p a c h e . k a f k a . c o m m o n . n e t w o r k . C h a n n e l B u i l d e r s . c r e a t e ( C h a n n e l B u i l d e r s . j a v a : 146 ) a t o r g . a p a c h e . k a f k a . c o m m o n . n e t w o r k . C h a n n e l B u i l d e r s . c l i e n t C h a n n e l B u i l d e r ( C h a n n e l B u i l d e r s . j a v a : 67 ) a t o r g . a p a c h e . k a f k a . c l i e n t s . C l i e n t U t i l s . c r e a t e C h a n n e l B u i l d e r ( C l i e n t U t i l s . j a v a : 99 ) a t o r g . a p a c h e . k a f k a . c l i e n t s . p r o d u c e r . K a f k a P r o d u c e r . n e w S e n d e r ( K a f k a P r o d u c e r . j a v a : 439 ) a t o r g . a p a c h e . k a f k a . c l i e n t s . p r o d u c e r . K a f k a P r o d u c e r . < i n i t > ( K a f k a P r o d u c e r . j a v a : 420 ) . . . 3 m o r e C a u s e d b y : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : F a i l e d t o l o a d S S L k e y s t o r e / h o m e / l i g h t h o u s e / c l i e n t . t r u s t s t o r e . j k s o f t y p e J K S a t o r g . a p a c h e . k a f k a . c o m m o n . s e c u r i t y . s s l . S s l F a c t o r y . c o n f i g u r e ( S s l F a c t o r y . j a v a : 144 ) a t o r g . a p a c h e . k a f k a . c o m m o n . n e t w o r k . S s l C h a n n e l B u i l d e r . c o n f i g u r e ( S s l C h a n n e l B u i l d e r . j a v a : 71 ) . . . 8 m o r e C a u s e d b y : o r g . a p a c h e . k a f k a . c o m m o n . K a f k a E x c e p t i o n : F a i l e d t o l o a d S S L k e y s t o r e / h o m e / l i g h t h o u s e / c l i e n t . t r u s t s t o r e . j k s o f t y p e J K S a t o r g . a p a c h e . k a f k a . c o m m o n . s e c u r i t y . s s l . S s l F a c t o r y .main(ConsoleProducer.scala:44) at kafka.tools.ConsoleProducer.main(ConsoleProducer.scala) Caused by: org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: Failed to load SSL keystore /home/lighthouse/client.truststore.jks of type JKS at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:73) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146) at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99) at org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:439) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:420) ... 3 more Caused by: org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: Failed to load SSL keystore /home/lighthouse/client.truststore.jks of type JKS at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:144) at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:71) ... 8 more Caused by: org.apache.kafka.common.KafkaException: Failed to load SSL keystore /home/lighthouse/client.truststore.jks of type JKS at org.apache.kafka.common.security.ssl.SslFactory .main(ConsoleProducer.scala:44)atkafka.tools.ConsoleProducer.main(ConsoleProducer.scala)Causedby:org.apache.kafka.common.KafkaException:org.apache.kafka.common.KafkaException:org.apache.kafka.common.KafkaException:FailedtoloadSSLkeystore/home/lighthouse/client.truststore.jksoftypeJKSatorg.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:73)atorg.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)atorg.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)atorg.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99)atorg.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:439)atorg.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:420)...3moreCausedby:org.apache.kafka.common.KafkaException:org.apache.kafka.common.KafkaException:FailedtoloadSSLkeystore/home/lighthouse/client.truststore.jksoftypeJKSatorg.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:144)atorg.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:71)...8moreCausedby:org.apache.kafka.common.KafkaException:FailedtoloadSSLkeystore/home/lighthouse/client.truststore.jksoftypeJKSatorg.apache.kafka.common.security.ssl.SslFactorySecurityStore.load(SslFactory.java:357)
at org.apache.kafka.common.security.ssl.SslFactory.createSSLContext(SslFactory.java:248)
at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:141)
… 9 more
Caused by: java.io.IOException: keystore password was incorrect
at java.base/sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2092)
at java.base/sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:243)
at java.base/java.security.KeyStore.load(KeyStore.java:1479)
at org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.load(SslFactory.java:354)
… 11 more
Caused by: java.security.UnrecoverableKeyException: failed to decrypt safe contents entry: javax.crypto.BadPaddingException: Given final block not properly padded. Such issues can arise if a bad key is used during decryption.
… 15 more


然后我核对了client-ssl.properties文件中的配置(包含密码),再次启动producer,会报如下错:



lighthouse@VM-8-10-ubuntu:~/kafkaWithZk/kafka_2.12-2.2.1$ ./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test --producer.config ./config/client-ssl.properties

[2024-03-19 13:42:49,783] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:49,835] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:49,937] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:50,140] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:50,543] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:51,298] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:52,203] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:53,158] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:54,264] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:55,220] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 13:42:56,376] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
CClighthouse@VM-8-10-ubuntu:~/kafkaWithZk/kafka_2.12-2.2.1$


核对了server.properties文件的密码后,启动kafka还是报错,报的错关键信息如下:



[2024-03-19 14:34:31,955] INFO [SocketServer brokerId=0] Failed authentication with /127.0.0.1 (SSL handshake failed) (org.apache.kafka.common.network.Selector)
[2024-03-19 14:34:31,957] WARN SSL handshake failed (kafka.utils.CoreUtils ) o r g . a p a c h e . k a f k a . c o m m o n . e r r o r s . S s l A u t h e n t i c a t i o n E x c e p t i o n : S S L h a n d s h a k e f a i l e d C a u s e d b y : j a v a x . n e t . s s l . S S L H a n d s h a k e E x c e p t i o n : N o n a m e m a t c h i n g l o c a l h o s t f o u n d a t j a v a . b a s e / s u n . s e c u r i t y . s s l . A l e r t . c r e a t e S S L E x c e p t i o n ( A l e r t . j a v a : 131 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . T r a n s p o r t C o n t e x t . f a t a l ( T r a n s p o r t C o n t e x t . j a v a : 360 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . T r a n s p o r t C o n t e x t . f a t a l ( T r a n s p o r t C o n t e x t . j a v a : 303 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . T r a n s p o r t C o n t e x t . f a t a l ( T r a n s p o r t C o n t e x t . j a v a : 298 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . C e r t i f i c a t e M e s s a g e ) org.apache.kafka.common.errors.SslAuthenticationException: SSL handshake failed Caused by: javax.net.ssl.SSLHandshakeException: No name matching localhost found at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:131) at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:360) at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:303) at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:298) at java.base/sun.security.ssl.CertificateMessage )org.apache.kafka.common.errors.SslAuthenticationException:SSLhandshakefailedCausedby:javax.net.ssl.SSLHandshakeException:Nonamematchinglocalhostfoundatjava.base/sun.security.ssl.Alert.createSSLException(Alert.java:131)atjava.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:360)atjava.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:303)atjava.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:298)atjava.base/sun.security.ssl.CertificateMessageT12CertificateConsumer.checkServerCerts(CertificateMessage.java:654)
at java.base/sun.security.ssl.CertificateMessage T 12 C e r t i f i c a t e C o n s u m e r . o n C e r t i f i c a t e ( C e r t i f i c a t e M e s s a g e . j a v a : 473 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . C e r t i f i c a t e M e s s a g e T12CertificateConsumer.onCertificate(CertificateMessage.java:473) at java.base/sun.security.ssl.CertificateMessage T12CertificateConsumer.onCertificate(CertificateMessage.java:473)atjava.base/sun.security.ssl.CertificateMessageT12CertificateConsumer.consume(CertificateMessage.java:369)
at java.base/sun.security.ssl.SSLHandshake.consume(SSLHandshake.java:392)
at java.base/sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:443)
at java.base/sun.security.ssl.SSLEngineImpl D e l e g a t e d T a s k DelegatedTask DelegatedTaskDelegatedAction.run(SSLEngineImpl.java:1076)
at java.base/sun.security.ssl.SSLEngineImpl D e l e g a t e d T a s k DelegatedTask DelegatedTaskDelegatedAction.run(SSLEngineImpl.java:1063)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/sun.security.ssl.SSLEngineImpl$DelegatedTask.run(SSLEngineImpl.java:1010)
at org.apache.kafka.common.network.SslTransportLayer.runDelegatedTasks(SslTransportLayer.java:402)
at org.apache.kafka.common.network.SslTransportLayer.handshakeUnwrap(SslTransportLayer.java:484)
at org.apache.kafka.common.network.SslTransportLayer.doHandshake(SslTransportLayer.java:340)
at org.apache.kafka.common.network.SslTransportLayer.handshake(SslTransportLayer.java:265)
at org.apache.kafka.common.network.KafkaChannel.prepare(KafkaChannel.java:170)
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:547)
at org.apache.kafka.common.network.Selector.poll(Selector.java:483)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:535)
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:74)
at kafka.server.KafkaServer.doControlledShutdown 1 ( K a f k a S e r v e r . s c a l a : 510 ) a t k a f k a . s e r v e r . K a f k a S e r v e r . c o n t r o l l e d S h u t d o w n ( K a f k a S e r v e r . s c a l a : 563 ) a t k a f k a . s e r v e r . K a f k a S e r v e r . 1(KafkaServer.scala:510) at kafka.server.KafkaServer.controlledShutdown(KafkaServer.scala:563) at kafka.server.KafkaServer. 1(KafkaServer.scala:510)atkafka.server.KafkaServer.controlledShutdown(KafkaServer.scala:563)atkafka.server.KafkaServer.anonfun$shutdown 2 ( K a f k a S e r v e r . s c a l a : 585 ) a t k a f k a . u t i l s . C o r e U t i l s 2(KafkaServer.scala:585) at kafka.utils.CoreUtils 2(KafkaServer.scala:585)atkafka.utils.CoreUtils.swallow(CoreUtils.scala:86)
at kafka.server.KafkaServer.shutdown(KafkaServer.scala:585)
at kafka.server.KafkaServerStartable.shutdown(KafkaServerStartable.scala:48)
at kafka.Kafka$$anon 1. r u n ( K a f k a . s c a l a : 72 ) C a u s e d b y : j a v a . s e c u r i t y . c e r t . C e r t i f i c a t e E x c e p t i o n : N o n a m e m a t c h i n g l o c a l h o s t f o u n d a t j a v a . b a s e / s u n . s e c u r i t y . u t i l . H o s t n a m e C h e c k e r . m a t c h D N S ( H o s t n a m e C h e c k e r . j a v a : 234 ) a t j a v a . b a s e / s u n . s e c u r i t y . u t i l . H o s t n a m e C h e c k e r . m a t c h ( H o s t n a m e C h e c k e r . j a v a : 103 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . X 509 T r u s t M a n a g e r I m p l . c h e c k I d e n t i t y ( X 509 T r u s t M a n a g e r I m p l . j a v a : 461 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . X 509 T r u s t M a n a g e r I m p l . c h e c k I d e n t i t y ( X 509 T r u s t M a n a g e r I m p l . j a v a : 435 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . X 509 T r u s t M a n a g e r I m p l . c h e c k T r u s t e d ( X 509 T r u s t M a n a g e r I m p l . j a v a : 283 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . X 509 T r u s t M a n a g e r I m p l . c h e c k S e r v e r T r u s t e d ( X 509 T r u s t M a n a g e r I m p l . j a v a : 141 ) a t j a v a . b a s e / s u n . s e c u r i t y . s s l . C e r t i f i c a t e M e s s a g e 1.run(Kafka.scala:72) Caused by: java.security.cert.CertificateException: No name matching localhost found at java.base/sun.security.util.HostnameChecker.matchDNS(HostnameChecker.java:234) at java.base/sun.security.util.HostnameChecker.match(HostnameChecker.java:103) at java.base/sun.security.ssl.X509TrustManagerImpl.checkIdentity(X509TrustManagerImpl.java:461) at java.base/sun.security.ssl.X509TrustManagerImpl.checkIdentity(X509TrustManagerImpl.java:435) at java.base/sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:283) at java.base/sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:141) at java.base/sun.security.ssl.CertificateMessage 1.run(Kafka.scala:72)Causedby:java.security.cert.CertificateException:Nonamematchinglocalhostfoundatjava.base/sun.security.util.HostnameChecker.matchDNS(HostnameChecker.java:234)atjava.base/sun.security.util.HostnameChecker.match(HostnameChecker.java:103)atjava.base/sun.security.ssl.X509TrustManagerImpl.checkIdentity(X509TrustManagerImpl.java:461)atjava.base/sun.security.ssl.X509TrustManagerImpl.checkIdentity(X509TrustManagerImpl.java:435)atjava.base/sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:283)atjava.base/sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:141)atjava.base/sun.security.ssl.CertificateMessageT12CertificateConsumer.checkServerCerts(CertificateMessage.java:632)
… 24 more
[2024-03-19 14:34:31,957] ERROR [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) failed authentication due to: SSL handshake failed (org.apache.kafka.clients.NetworkClient)
[2024-03-19 14:34:31,960] INFO [/config/changes-event-process-thread]: Shutting down (kafka.common.ZkNodeChangeNotificationListener C h a n g e E v e n t P r o c e s s T h r e a d ) [ 2024 − 03 − 1914 : 34 : 31 , 961 ] I N F O [ / c o n f i g / c h a n g e s − e v e n t − p r o c e s s − t h r e a d ] : S h u t d o w n c o m p l e t e d ( k a f k a . c o m m o n . Z k N o d e C h a n g e N o t i f i c a t i o n L i s t e n e r ChangeEventProcessThread) [2024-03-19 14:34:31,961] INFO [/config/changes-event-process-thread]: Shutdown completed (kafka.common.ZkNodeChangeNotificationListener ChangeEventProcessThread)[2024031914:34:31,961]INFO[/config/changeseventprocessthread]:Shutdowncompleted(kafka.common.ZkNodeChangeNotificationListenerChangeEventProcessThread)
[2024-03-19 14:34:31,961] INFO [/config/changes-event-process-thread]: Stopped (kafka.common.ZkNodeChangeNotificationListener C h a n g e E v e n t P r o c e s s T h r e a d ) [ 2024 − 03 − 1914 : 34 : 31 , 962 ] I N F O [ S o c k e t S e r v e r b r o k e r I d = 0 ] S t o p p i n g s o c k e t s e r v e r r e q u e s t p r o c e s s o r s ( k a f k a . n e t w o r k . S o c k e t S e r v e r ) [ 2024 − 03 − 1914 : 34 : 31 , 979 ] I N F O [ S o c k e t S e r v e r b r o k e r I d = 0 ] S t o p p e d s o c k e t s e r v e r r e q u e s t p r o c e s s o r s ( k a f k a . n e t w o r k . S o c k e t S e r v e r ) [ 2024 − 03 − 1914 : 34 : 31 , 980 ] I N F O [ d a t a − p l a n e K a f k a R e q u e s t H a n d l e r o n B r o k e r 0 ] , s h u t t i n g d o w n ( k a f k a . s e r v e r . K a f k a R e q u e s t H a n d l e r P o o l ) [ 2024 − 03 − 1914 : 34 : 31 , 988 ] I N F O [ d a t a − p l a n e K a f k a R e q u e s t H a n d l e r o n B r o k e r 0 ] , s h u t d o w n c o m p l e t e l y ( k a f k a . s e r v e r . K a f k a R e q u e s t H a n d l e r P o o l ) [ 2024 − 03 − 1914 : 34 : 31 , 995 ] I N F O [ K a f k a A p i − 0 ] S h u t d o w n c o m p l e t e . ( k a f k a . s e r v e r . K a f k a A p i s ) [ 2024 − 03 − 1914 : 34 : 31 , 997 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − t o p i c ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ChangeEventProcessThread) [2024-03-19 14:34:31,962] INFO [SocketServer brokerId=0] Stopping socket server request processors (kafka.network.SocketServer) [2024-03-19 14:34:31,979] INFO [SocketServer brokerId=0] Stopped socket server request processors (kafka.network.SocketServer) [2024-03-19 14:34:31,980] INFO [data-plane Kafka Request Handler on Broker 0], shutting down (kafka.server.KafkaRequestHandlerPool) [2024-03-19 14:34:31,988] INFO [data-plane Kafka Request Handler on Broker 0], shut down completely (kafka.server.KafkaRequestHandlerPool) [2024-03-19 14:34:31,995] INFO [KafkaApi-0] Shutdown complete. (kafka.server.KafkaApis) [2024-03-19 14:34:31,997] INFO [ExpirationReaper-0-topic]: Shutting down (kafka.server.DelayedOperationPurgatory ChangeEventProcessThread)[2024031914:34:31,962]INFO[SocketServerbrokerId=0]Stoppingsocketserverrequestprocessors(kafka.network.SocketServer)[2024031914:34:31,979]INFO[SocketServerbrokerId=0]Stoppedsocketserverrequestprocessors(kafka.network.SocketServer)[2024031914:34:31,980]INFO[dataplaneKafkaRequestHandleronBroker0],shuttingdown(kafka.server.KafkaRequestHandlerPool)[2024031914:34:31,988]INFO[dataplaneKafkaRequestHandleronBroker0],shutdowncompletely(kafka.server.KafkaRequestHandlerPool)[2024031914:34:31,995]INFO[KafkaApi0]Shutdowncomplete.(kafka.server.KafkaApis)[2024031914:34:31,997]INFO[ExpirationReaper0topic]:Shuttingdown(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,059] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
^C[2024-03-19 14:34:32,114] INFO Terminating process due to signal SIGINT (org.apache.kafka.common.utils.LoggingSignalHandler)
[2024-03-19 14:34:32,132] INFO [ExpirationReaper-0-topic]: Stopped (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 132 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − t o p i c ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,132] INFO [ExpirationReaper-0-topic]: Shutdown completed (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,132]INFO[ExpirationReaper0topic]:Shutdowncompleted(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,134] INFO [TransactionCoordinator id=0] Shutting down. (kafka.coordinator.transaction.TransactionCoordinator)
[2024-03-19 14:34:32,135] INFO [ProducerId Manager 0]: Shutdown complete: last producerId assigned 1000 (kafka.coordinator.transaction.ProducerIdManager)
[2024-03-19 14:34:32,136] INFO [Transaction State Manager 0]: Shutdown complete (kafka.coordinator.transaction.TransactionStateManager)
[2024-03-19 14:34:32,136] INFO [Transaction Marker Channel Manager 0]: Shutting down (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2024-03-19 14:34:32,139] INFO [Transaction Marker Channel Manager 0]: Stopped (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2024-03-19 14:34:32,140] INFO [Transaction Marker Channel Manager 0]: Shutdown completed (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2024-03-19 14:34:32,141] INFO [TransactionCoordinator id=0] Shutdown complete. (kafka.coordinator.transaction.TransactionCoordinator)
[2024-03-19 14:34:32,141] INFO [GroupCoordinator 0]: Shutting down. (kafka.coordinator.group.GroupCoordinator)
[2024-03-19 14:34:32,144] INFO [ExpirationReaper-0-Heartbeat]: Shutting down (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 160 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 261 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 344 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − H e a r t b e a t ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,160] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,261] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,344] INFO [ExpirationReaper-0-Heartbeat]: Shutdown completed (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,160]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,261]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,344]INFO[ExpirationReaper0Heartbeat]:Shutdowncompleted(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,344] INFO [ExpirationReaper-0-Heartbeat]: Stopped (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 344 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − R e b a l a n c e ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,344] INFO [ExpirationReaper-0-Rebalance]: Shutting down (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,344]INFO[ExpirationReaper0Rebalance]:Shuttingdown(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,362] INFO [ExpirationReaper-0-Rebalance]: Stopped (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 362 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 363 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − R e b a l a n c e ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,362] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,363] INFO [ExpirationReaper-0-Rebalance]: Shutdown completed (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,362]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,363]INFO[ExpirationReaper0Rebalance]:Shutdowncompleted(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,363] INFO [GroupCoordinator 0]: Shutdown complete. (kafka.coordinator.group.GroupCoordinator)
[2024-03-19 14:34:32,364] INFO [ReplicaManager broker=0] Shutting down (kafka.server.ReplicaManager)
[2024-03-19 14:34:32,364] INFO [LogDirFailureHandler]: Shutting down (kafka.server.ReplicaManager L o g D i r F a i l u r e H a n d l e r ) [ 2024 − 03 − 1914 : 34 : 32 , 366 ] I N F O [ L o g D i r F a i l u r e H a n d l e r ] : S t o p p e d ( k a f k a . s e r v e r . R e p l i c a M a n a g e r LogDirFailureHandler) [2024-03-19 14:34:32,366] INFO [LogDirFailureHandler]: Stopped (kafka.server.ReplicaManager LogDirFailureHandler)[2024031914:34:32,366]INFO[LogDirFailureHandler]:Stopped(kafka.server.ReplicaManagerLogDirFailureHandler)
[2024-03-19 14:34:32,366] INFO [LogDirFailureHandler]: Shutdown completed (kafka.server.ReplicaManager L o g D i r F a i l u r e H a n d l e r ) [ 2024 − 03 − 1914 : 34 : 32 , 368 ] I N F O [ R e p l i c a F e t c h e r M a n a g e r o n b r o k e r 0 ] s h u t t i n g d o w n ( k a f k a . s e r v e r . R e p l i c a F e t c h e r M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 369 ] I N F O [ R e p l i c a F e t c h e r M a n a g e r o n b r o k e r 0 ] s h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . R e p l i c a F e t c h e r M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 370 ] I N F O [ R e p l i c a A l t e r L o g D i r s M a n a g e r o n b r o k e r 0 ] s h u t t i n g d o w n ( k a f k a . s e r v e r . R e p l i c a A l t e r L o g D i r s M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 370 ] I N F O [ R e p l i c a A l t e r L o g D i r s M a n a g e r o n b r o k e r 0 ] s h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . R e p l i c a A l t e r L o g D i r s M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 370 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − F e t c h ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y LogDirFailureHandler) [2024-03-19 14:34:32,368] INFO [ReplicaFetcherManager on broker 0] shutting down (kafka.server.ReplicaFetcherManager) [2024-03-19 14:34:32,369] INFO [ReplicaFetcherManager on broker 0] shutdown completed (kafka.server.ReplicaFetcherManager) [2024-03-19 14:34:32,370] INFO [ReplicaAlterLogDirsManager on broker 0] shutting down (kafka.server.ReplicaAlterLogDirsManager) [2024-03-19 14:34:32,370] INFO [ReplicaAlterLogDirsManager on broker 0] shutdown completed (kafka.server.ReplicaAlterLogDirsManager) [2024-03-19 14:34:32,370] INFO [ExpirationReaper-0-Fetch]: Shutting down (kafka.server.DelayedOperationPurgatory LogDirFailureHandler)[2024031914:34:32,368]INFO[ReplicaFetcherManageronbroker0]shuttingdown(kafka.server.ReplicaFetcherManager)[2024031914:34:32,369]INFO[ReplicaFetcherManageronbroker0]shutdowncompleted(kafka.server.ReplicaFetcherManager)[2024031914:34:32,370]INFO[ReplicaAlterLogDirsManageronbroker0]shuttingdown(kafka.server.ReplicaAlterLogDirsManager)[2024031914:34:32,370]INFO[ReplicaAlterLogDirsManageronbroker0]shutdowncompleted(kafka.server.ReplicaAlterLogDirsManager)[2024031914:34:32,370]INFO[ExpirationReaper0Fetch]:Shuttingdown(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,463] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-03-19 14:34:32,492] INFO [ExpirationReaper-0-Fetch]: Shutdown completed (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 492 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − F e t c h ] : S t o p p e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,492] INFO [ExpirationReaper-0-Fetch]: Stopped (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,492]INFO[ExpirationReaper0Fetch]:Stopped(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,492] INFO [ExpirationReaper-0-Produce]: Shutting down (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 564 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 666 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 674 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − P r o d u c e ] : S t o p p e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,564] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,666] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,674] INFO [ExpirationReaper-0-Produce]: Stopped (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,564]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,666]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,674]INFO[ExpirationReaper0Produce]:Stopped(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,674] INFO [ExpirationReaper-0-Produce]: Shutdown completed (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 674 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − D e l e t e R e c o r d s ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,674] INFO [ExpirationReaper-0-DeleteRecords]: Shutting down (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,674]INFO[ExpirationReaper0DeleteRecords]:Shuttingdown(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,692] INFO [ExpirationReaper-0-DeleteRecords]: Stopped (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 692 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − D e l e t e R e c o r d s ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,692] INFO [ExpirationReaper-0-DeleteRecords]: Shutdown completed (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,692]INFO[ExpirationReaper0DeleteRecords]:Shutdowncompleted(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,693] INFO [ExpirationReaper-0-ElectPreferredLeader]: Shutting down (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 768 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 870 ] W A R N [ C o n t r o l l e r i d = 0 , t a r g e t B r o k e r I d = 0 ] C o n n e c t i o n t o n o d e 0 ( l o c a l h o s t / 127.0.0.1 : 9092 ) c o u l d n o t b e e s t a b l i s h e d . B r o k e r m a y n o t b e a v a i l a b l e . ( o r g . a p a c h e . k a f k a . c l i e n t s . N e t w o r k C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 893 ] I N F O [ E x p i r a t i o n R e a p e r − 0 − E l e c t P r e f e r r e d L e a d e r ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . D e l a y e d O p e r a t i o n P u r g a t o r y ExpiredOperationReaper) [2024-03-19 14:34:32,768] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,870] WARN [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2024-03-19 14:34:32,893] INFO [ExpirationReaper-0-ElectPreferredLeader]: Shutdown completed (kafka.server.DelayedOperationPurgatory ExpiredOperationReaper)[2024031914:34:32,768]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,870]WARN[Controllerid=0,targetBrokerId=0]Connectiontonode0(localhost/127.0.0.1:9092)couldnotbeestablished.Brokermaynotbeavailable.(org.apache.kafka.clients.NetworkClient)[2024031914:34:32,893]INFO[ExpirationReaper0ElectPreferredLeader]:Shutdowncompleted(kafka.server.DelayedOperationPurgatoryExpiredOperationReaper)
[2024-03-19 14:34:32,893] INFO [ExpirationReaper-0-ElectPreferredLeader]: Stopped (kafka.server.DelayedOperationPurgatory E x p i r e d O p e r a t i o n R e a p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 897 ] I N F O [ R e p l i c a M a n a g e r b r o k e r = 0 ] S h u t d o w n c o m p l e t e l y ( k a f k a . s e r v e r . R e p l i c a M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 898 ] I N F O S h u t t i n g d o w n . ( k a f k a . l o g . L o g M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 934 ] I N F O S h u t d o w n c o m p l e t e . ( k a f k a . l o g . L o g M a n a g e r ) [ 2024 − 03 − 1914 : 34 : 32 , 960 ] I N F O [ Z o o K e e p e r C l i e n t ] C l o s i n g . ( k a f k a . z o o k e e p e r . Z o o K e e p e r C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 964 ] I N F O S e s s i o n : 0 x 100 c d 6124170002 c l o s e d ( o r g . a p a c h e . z o o k e e p e r . Z o o K e e p e r ) [ 2024 − 03 − 1914 : 34 : 32 , 966 ] I N F O E v e n t T h r e a d s h u t d o w n f o r s e s s i o n : 0 x 100 c d 6124170002 ( o r g . a p a c h e . z o o k e e p e r . C l i e n t C n x n ) [ 2024 − 03 − 1914 : 34 : 32 , 966 ] I N F O [ Z o o K e e p e r C l i e n t ] C l o s e d . ( k a f k a . z o o k e e p e r . Z o o K e e p e r C l i e n t ) [ 2024 − 03 − 1914 : 34 : 32 , 968 ] I N F O [ T h r o t t l e d C h a n n e l R e a p e r − F e t c h ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . C l i e n t Q u o t a M a n a g e r ExpiredOperationReaper) [2024-03-19 14:34:32,897] INFO [ReplicaManager broker=0] Shut down completely (kafka.server.ReplicaManager) [2024-03-19 14:34:32,898] INFO Shutting down. (kafka.log.LogManager) [2024-03-19 14:34:32,934] INFO Shutdown complete. (kafka.log.LogManager) [2024-03-19 14:34:32,960] INFO [ZooKeeperClient] Closing. (kafka.zookeeper.ZooKeeperClient) [2024-03-19 14:34:32,964] INFO Session: 0x100cd6124170002 closed (org.apache.zookeeper.ZooKeeper) [2024-03-19 14:34:32,966] INFO EventThread shut down for session: 0x100cd6124170002 (org.apache.zookeeper.ClientCnxn) [2024-03-19 14:34:32,966] INFO [ZooKeeperClient] Closed. (kafka.zookeeper.ZooKeeperClient) [2024-03-19 14:34:32,968] INFO [ThrottledChannelReaper-Fetch]: Shutting down (kafka.server.ClientQuotaManager ExpiredOperationReaper)[2024031914:34:32,897]INFO[ReplicaManagerbroker=0]Shutdowncompletely(kafka.server.ReplicaManager)[2024031914:34:32,898]INFOShuttingdown.(kafka.log.LogManager)[2024031914:34:32,934]INFOShutdowncomplete.(kafka.log.LogManager)[2024031914:34:32,960]INFO[ZooKeeperClient]Closing.(kafka.zookeeper.ZooKeeperClient)[2024031914:34:32,964]INFOSession:0x100cd6124170002closed(org.apache.zookeeper.ZooKeeper)[2024031914:34:32,966]INFOEventThreadshutdownforsession:0x100cd6124170002(org.apache.zookeeper.ClientCnxn)[2024031914:34:32,966]INFO[ZooKeeperClient]Closed.(kafka.zookeeper.ZooKeeperClient)[2024031914:34:32,968]INFO[ThrottledChannelReaperFetch]:Shuttingdown(kafka.server.ClientQuotaManagerThrottledChannelReaper)
[2024-03-19 14:34:33,168] INFO [ThrottledChannelReaper-Fetch]: Stopped (kafka.server.ClientQuotaManager T h r o t t l e d C h a n n e l R e a p e r ) [ 2024 − 03 − 1914 : 34 : 33 , 168 ] I N F O [ T h r o t t l e d C h a n n e l R e a p e r − F e t c h ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . C l i e n t Q u o t a M a n a g e r ThrottledChannelReaper) [2024-03-19 14:34:33,168] INFO [ThrottledChannelReaper-Fetch]: Shutdown completed (kafka.server.ClientQuotaManager ThrottledChannelReaper)[2024031914:34:33,168]INFO[ThrottledChannelReaperFetch]:Shutdowncompleted(kafka.server.ClientQuotaManagerThrottledChannelReaper)
[2024-03-19 14:34:33,168] INFO [ThrottledChannelReaper-Produce]: Shutting down (kafka.server.ClientQuotaManager T h r o t t l e d C h a n n e l R e a p e r ) [ 2024 − 03 − 1914 : 34 : 33 , 170 ] I N F O [ T h r o t t l e d C h a n n e l R e a p e r − P r o d u c e ] : S t o p p e d ( k a f k a . s e r v e r . C l i e n t Q u o t a M a n a g e r ThrottledChannelReaper) [2024-03-19 14:34:33,170] INFO [ThrottledChannelReaper-Produce]: Stopped (kafka.server.ClientQuotaManager ThrottledChannelReaper)[2024031914:34:33,170]INFO[ThrottledChannelReaperProduce]:Stopped(kafka.server.ClientQuotaManagerThrottledChannelReaper)
[2024-03-19 14:34:33,170] INFO [ThrottledChannelReaper-Produce]: Shutdown completed (kafka.server.ClientQuotaManager T h r o t t l e d C h a n n e l R e a p e r ) [ 2024 − 03 − 1914 : 34 : 33 , 170 ] I N F O [ T h r o t t l e d C h a n n e l R e a p e r − R e q u e s t ] : S h u t t i n g d o w n ( k a f k a . s e r v e r . C l i e n t Q u o t a M a n a g e r ThrottledChannelReaper) [2024-03-19 14:34:33,170] INFO [ThrottledChannelReaper-Request]: Shutting down (kafka.server.ClientQuotaManager ThrottledChannelReaper)[2024031914:34:33,170]INFO[ThrottledChannelReaperRequest]:Shuttingdown(kafka.server.ClientQuotaManagerThrottledChannelReaper)
^C[2024-03-19 14:34:33,740] INFO Terminating process due to signal SIGINT (org.apache.kafka.common.utils.LoggingSignalHandler)
^C[2024-03-19 14:34:33,972] INFO Terminating process due to signal SIGINT (org.apache.kafka.common.utils.LoggingSignalHandler)
[2024-03-19 14:34:34,170] INFO [ThrottledChannelReaper-Request]: Stopped (kafka.server.ClientQuotaManager T h r o t t l e d C h a n n e l R e a p e r ) [ 2024 − 03 − 1914 : 34 : 34 , 170 ] I N F O [ T h r o t t l e d C h a n n e l R e a p e r − R e q u e s t ] : S h u t d o w n c o m p l e t e d ( k a f k a . s e r v e r . C l i e n t Q u o t a M a n a g e r ThrottledChannelReaper) [2024-03-19 14:34:34,170] INFO [ThrottledChannelReaper-Request]: Shutdown completed (kafka.server.ClientQuotaManager ThrottledChannelReaper)[2024031914:34:34,170]INFO[ThrottledChannelReaperRequest]:Shutdowncompleted(kafka.server.ClientQuotaManagerThrottledChannelReaper)
[2024-03-19 14:34:34,172] INFO [SocketServer brokerId=0] Shutting down socket server (kafka.network.SocketServer)
^C[2024-03-19 14:34:34,204] INFO [SocketServer brokerId=0] Shutdown completed (kafka.network.SocketServer)
[2024-03-19 14:34:34,204] INFO Terminating process due to signal SIGINT (org.apache.kafka.common.utils.LoggingSignalHandler)
[2024-03-19 14:34:34,206] INFO [KafkaServer id=0] shut down completed (kafka.server.KafkaServer)


经过一番清理ca-\*,cert-\*,client-\*,server-\*文件后,然后重新生成秘钥证书和CA、签名,步骤如下:



一、生成 SSL 密钥和证书
keytool -keystore server.keystore.jks -alias localhost -validity 700 -genkey -keyalg RSA
keytool -keystore server.truststore.jks -alias localhost -validity 700 -genkey -keyalg RSA
keytool -keystore client.keystore.jks -alias localhost -validity 700 -genkey -keyalg RSA
keytool -keystore client.truststore.jks -alias localhost -validity 700 -genkey -keyalg RSA

2、创建我自己的CA
openssl req -new -x509 -keyout ca-key -out ca-cert -days 700
keytool -keystore server.keystore.jks -alias localhost -certreq -file cert-file
openssl x509 -req -CA ca-cert -CAkey ca-key -in cert-file -out cert-signed -days 700 -CAcreateserial -passin pass:123456

3、对证书进行签名
keytool -keystore server.keystore.jks -alias CARoot -import -file ca-cert
keytool -keystore server.keystore.jks -alias localhost -import -file cert-signed

keytool -keystore server.truststore.jks -alias CARoot -import -file ca-cert

keytool -keystore client.keystore.jks -alias CARoot -import -file ca-cert

keytool -keystore client.truststore.jks -alias CARoot -import -file ca-cert


再次启动zookeeper和kafka,然后执行生产producer命令,发现还是报错:



[2024-03-19 17:52:38,773] INFO [SocketServer brokerId=0] Failed authentication with /127.0.0.1 (SSL handshake failed) (org.apache.kafka.common.network.Selector)
[2024-03-19 17:52:38,876] INFO [Controller id=0, targetBrokerId=0] Failed authentication with localhost/127.0.0.1 (SSL handshake failed) (org.apache.kafka.common.network.Selector)
[2024-03-19 17:52:38,876] ERROR [Controller id=0, targetBrokerId=0] Connection to node 0 (localhost/127.0.0.1:9092) failed authentication due to: SSL handshake failed (org.apache.kafka.clients.NetworkClient)

网上学习资料一大堆,但如果学到的知识不成体系,遇到问题时只是浅尝辄止,不再深入研究,那么很难做到真正的技术提升。

需要这份系统化的资料的朋友,可以添加V获取:vip204888 (备注大数据)
img

一个人可以走的很快,但一群人才能走的更远!不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人,都欢迎加入我们的的圈子(技术交流、学习资源、职场吐槽、大厂内推、面试辅导),让我们一起学习成长!

thentication due to: SSL handshake failed (org.apache.kafka.clients.NetworkClient)

网上学习资料一大堆,但如果学到的知识不成体系,遇到问题时只是浅尝辄止,不再深入研究,那么很难做到真正的技术提升。

需要这份系统化的资料的朋友,可以添加V获取:vip204888 (备注大数据)
[外链图片转存中…(img-C3zjPS1H-1713304788476)]

一个人可以走的很快,但一群人才能走的更远!不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人,都欢迎加入我们的的圈子(技术交流、学习资源、职场吐槽、大厂内推、面试辅导),让我们一起学习成长!

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值
>