大数据系列之：安装pulsar详细步骤

最新推荐文章于 2024-04-26 10:09:40 发布
最新推荐文章于 2024-04-26 10:09:40 发布
阅读量2k 收藏 4
点赞数 3
分类专栏： 日常分享专栏 文章标签： 大数据 安装pulsar详细步骤
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/zhengzaifeidelushang/article/details/128970796
版权

大数据系列之：安装pulsar详细步骤

一、Pulsar版本和jdk对应关系

点击下面的链接查看Pulsar版本和jdk对应关系：

在这里插入图片描述

二、安装JDK

点击链接下载JDK：

tar -zxvf OpenJDK17U-jdk_x64_linux_hotspot_17.0.6_10.tar.gz

三、设置和激活jdk环境变量

设置环境变量

vim /etc/profile
export JAVA_HOME="/data/src/jdk17"
PATH=$PATH:$JAVA_HOME/bin

激活环境变量

source /etc/profile

四、下载和解压Pulsar

下载Pulsar

wget https://archive.apache.org/dist/pulsar/pulsar-2.11.0/apache-pulsar-2.11.0-bin.tar.gz

解压Pulsar

tar -zxvf apache-pulsar-2.11.0-bin.tar.gz

五、查看Pulsar目录

cd apache-pulsar-2.11.0
ls 
bin  conf  data  examples  instances  lib  LICENSE  logs  NOTICE  packages-storage  README

六、启动Pulsar standalone cluster

bin/pulsar standalone

2023-02-10T15:19:17,880+0800 [main] INFO  org.apache.pulsar.functions.worker.FunctionRuntimeManager - Initializing secrets provider configurator org.apache.pulsar.functions.secretsproviderconfigurator.DefaultSecretsProviderConfigurator with configs: null
2023-02-10T15:19:17,885+0800 [pulsar-web-48-6] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:17 +0800] "GET /admin/v2/persistent/public/functions/coordinate/subscriptions HTTP/1.1" 200 16 "-" "Pulsar-Java-v2.11.0" 19
2023-02-10T15:19:17,888+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/__change_events][reader-6bed90fa36] Successfully getLastMessageId -1:-1
2023-02-10T15:19:17,890+0800 [main] INFO  org.apache.pulsar.functions.runtime.process.ProcessRuntimeFactory - Java instance jar location is not defined, using the location defined in system environment : /data/src/apache-pulsar-2.11.0/instances/java-instance.jar
2023-02-10T15:19:17,890+0800 [main] INFO  org.apache.pulsar.functions.runtime.process.ProcessRuntimeFactory - Python instance file location is not defined using the location defined in system environment : /data/src/apache-pulsar-2.11.0/instances/python-instance/python_instance_main.py
2023-02-10T15:19:17,891+0800 [main] INFO  org.apache.pulsar.functions.runtime.process.ProcessRuntimeFactory - Extra dependencies location is not defined using the location defined in system environment : /data/src/apache-pulsar-2.11.0/instances/deps
2023-02-10T15:19:17,894+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Start Leader Service **/
2023-02-10T15:19:17,898+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650]] Connected to server
2023-02-10T15:19:17,899+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - New connection from /127.0.0.1:10729
2023-02-10T15:19:17,915+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["persistent://public/functions/coordinate"],"topicsPattern":null,"subscriptionName":"participants","subscriptionType":"Failover","subscriptionProperties":null,"subscriptionMode":"Durable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":"c-standalone-fw-localhost-8080:localhost:8080","ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{"id":"c-standalone-fw-localhost-8080:localhost:8080"},"readCompacted":false,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:19:17,919+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:17,925+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/coordinate][participants] Subscribing to topic on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650], consumerId 0
2023-02-10T15:19:17,926+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Subscribing on topic persistent://public/functions/coordinate / participants
2023-02-10T15:19:17,928+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created subscription on topic persistent://public/functions/coordinate / participants
2023-02-10T15:19:17,928+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/coordinate][participants] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 0
2023-02-10T15:19:17,929+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Initializing Metadata Manager **/
2023-02-10T15:19:17,935+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["persistent://public/functions/metadata"],"topicsPattern":null,"subscriptionName":"c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"NonDurable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":"c-standalone-fw-localhost-8080-function-metadata-tailer","ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":false,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:19:17,939+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:17,941+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Subscribing to topic on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650], consumerId 1
2023-02-10T15:19:17,942+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Subscribing on topic persistent://public/functions/metadata / c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3
2023-02-10T15:19:17,942+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Creating non-durable subscription at msg id -1:-1:-1:-1 - {}
2023-02-10T15:19:17,942+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.NonDurableCursorImpl - [public/functions/persistent/metadata] Created non-durable cursor read-position=18:0 mark-delete-position=18:-1
2023-02-10T15:19:17,942+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/functions/persistent/metadata] Opened new cursor: NonDurableCursorImpl{ledger=public/functions/persistent/metadata, ackPos=18:-1, readPos=18:0}
2023-02-10T15:19:17,943+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedCursorImpl - [public/functions/persistent/metadata-c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Rewind from 18:0 to 18:0
2023-02-10T15:19:17,943+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created subscription on topic persistent://public/functions/metadata / c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3
2023-02-10T15:19:17,943+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 1
2023-02-10T15:19:17,944+0800 [main] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Get topic last message Id
2023-02-10T15:19:17,945+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Successfully getLastMessageId -1:-1
2023-02-10T15:19:17,949+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closing consumer: consumerId=1
2023-02-10T15:19:17,949+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.AbstractDispatcherSingleActiveConsumer - Removing consumer Consumer{subscription=PersistentSubscription{topic=persistent://public/functions/metadata, name=c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3}, consumerId=1, consumerName=c-standalone-fw-localhost-8080-function-metadata-tailer, address=/127.0.0.1:10729}
2023-02-10T15:19:17,950+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Successfully closed subscription [NonDurableCursorImpl{ledger=public/functions/persistent/metadata, ackPos=18:-1, readPos=18:0}]
2023-02-10T15:19:17,951+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Successfully closed dispatcher for reader
2023-02-10T15:19:17,952+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closed consumer, consumerId=1
2023-02-10T15:19:17,952+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata] [c-standalone-fw-localhost-8080-function-metadata-tailer-reader-c67f7ce6a3] Closed consumer
2023-02-10T15:19:17,954+0800 [main] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataManager - FunctionMetaData Manager initialization complete
2023-02-10T15:19:17,954+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Initializing Runtime Manager **/
2023-02-10T15:19:17,961+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["persistent://public/functions/assignments"],"topicsPattern":null,"subscriptionName":"c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"NonDurable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":"c-standalone-fw-localhost-8080-function-assignment-initialize","ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":true,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:19:17,964+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:17,965+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Subscribing to topic on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650], consumerId 2
2023-02-10T15:19:17,966+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Subscribing on topic persistent://public/functions/assignments / c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce
2023-02-10T15:19:17,967+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Creating non-durable subscription at msg id -1:-1:-1:-1 - {}
2023-02-10T15:19:17,967+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.NonDurableCursorImpl - [public/functions/persistent/assignments] Created non-durable cursor read-position=15:0 mark-delete-position=15:-1
2023-02-10T15:19:17,967+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/functions/persistent/assignments] Opened new cursor: NonDurableCursorImpl{ledger=public/functions/persistent/assignments, ackPos=15:-1, readPos=15:0}
2023-02-10T15:19:17,967+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created subscription on topic persistent://public/functions/assignments / c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce
2023-02-10T15:19:17,968+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 2
2023-02-10T15:19:17,969+0800 [main] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Get topic last message Id
2023-02-10T15:19:17,970+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Successfully getLastMessageId -1:-1
2023-02-10T15:19:17,970+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closing consumer: consumerId=2
2023-02-10T15:19:17,970+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.AbstractDispatcherSingleActiveConsumer - Removing consumer Consumer{subscription=PersistentSubscription{topic=persistent://public/functions/assignments, name=c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce}, consumerId=2, consumerName=c-standalone-fw-localhost-8080-function-assignment-initialize, address=/127.0.0.1:10729}
2023-02-10T15:19:17,970+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Successfully closed subscription [NonDurableCursorImpl{ledger=public/functions/persistent/assignments, ackPos=15:-1, readPos=15:0}]
2023-02-10T15:19:17,971+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Successfully closed dispatcher for reader
2023-02-10T15:19:17,971+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closed consumer, consumerId=2
2023-02-10T15:19:17,971+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments] [c-standalone-fw-localhost-8080-function-assignment-initialize-reader-a8bc01f6ce] Closed consumer
2023-02-10T15:19:17,972+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Starting Function Assignment Tailer **/
2023-02-10T15:19:17,972+0800 [main] INFO  org.apache.pulsar.functions.worker.FunctionAssignmentTailer - Assignment tailer will start reading from message id -1:-1:-1
2023-02-10T15:19:17,977+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["persistent://public/functions/assignments"],"topicsPattern":null,"subscriptionName":"c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"NonDurable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":"c-standalone-fw-localhost-8080-function-assignment-tailer","ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":true,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:19:17,980+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:17,981+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Subscribing to topic on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650], consumerId 3
2023-02-10T15:19:17,983+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Subscribing on topic persistent://public/functions/assignments / c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3
2023-02-10T15:19:17,983+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Creating non-durable subscription at msg id -1:-1:-1:-1 - {}
2023-02-10T15:19:17,983+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.NonDurableCursorImpl - [public/functions/persistent/assignments] Created non-durable cursor read-position=15:0 mark-delete-position=15:-1
2023-02-10T15:19:17,983+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/functions/persistent/assignments] Opened new cursor: NonDurableCursorImpl{ledger=public/functions/persistent/assignments, ackPos=15:-1, readPos=15:0}
2023-02-10T15:19:17,984+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created subscription on topic persistent://public/functions/assignments / c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3
2023-02-10T15:19:17,984+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 3
2023-02-10T15:19:17,987+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Starting Metadata Manager **/
2023-02-10T15:19:17,992+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["persistent://public/functions/metadata"],"topicsPattern":null,"subscriptionName":"c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"NonDurable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":"c-standalone-fw-localhost-8080-function-metadata-tailer","ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":false,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:19:17,994+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:17,996+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Subscribing to topic on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650], consumerId 4
2023-02-10T15:19:17,996+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Subscribing on topic persistent://public/functions/metadata / c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116
2023-02-10T15:19:17,997+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Creating non-durable subscription at msg id -1:-1:-1:-1 - {}
2023-02-10T15:19:17,997+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.NonDurableCursorImpl - [public/functions/persistent/metadata] Created non-durable cursor read-position=18:0 mark-delete-position=18:-1
2023-02-10T15:19:17,997+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/functions/persistent/metadata] Opened new cursor: NonDurableCursorImpl{ledger=public/functions/persistent/metadata, ackPos=18:-1, readPos=18:0}
2023-02-10T15:19:17,997+0800 [pulsar-io-19-3] INFO  org.apache.bookkeeper.mledger.impl.ManagedCursorImpl - [public/functions/persistent/metadata-c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Rewind from 18:0 to 18:0
2023-02-10T15:19:17,997+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created subscription on topic persistent://public/functions/metadata / c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116
2023-02-10T15:19:17,998+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 4
2023-02-10T15:19:18,003+0800 [main] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataManager - MetaData Manager Tailer started
2023-02-10T15:19:18,007+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Starting Cluster Service Coordinator **/
2023-02-10T15:19:18,007+0800 [main] INFO  org.apache.pulsar.functions.worker.ClusterServiceCoordinator - /** Starting cluster service coordinator **/
2023-02-10T15:19:18,011+0800 [main] INFO  org.apache.pulsar.functions.worker.PulsarWorkerService - /** Started worker id=c-standalone-fw-localhost-8080 **/
2023-02-10T15:19:18,011+0800 [main] INFO  org.apache.pulsar.broker.PulsarService - Function worker service started
2023-02-10T15:19:18,014+0800 [main] INFO  org.apache.pulsar.packages.management.storage.filesystem.FileSystemPackagesStorage - Packages management filesystem storage initialized on packages-storage
2023-02-10T15:19:18,036+0800 [main] INFO  org.apache.pulsar.broker.PulsarService - messaging service is ready, bootstrap_seconds=4
2023-02-10T15:19:18,036+0800 [main] INFO  org.apache.pulsar.broker.PulsarService - messaging service is ready, bootstrap service port = 8080, broker url= pulsar://localhost:6650, cluster=standalone, configs=org.apache.pulsar.broker.ServiceConfiguration@32c8d67
2023-02-10T15:19:18,042+0800 [main] INFO  org.apache.pulsar.broker.PulsarService - created admin with url http://localhost:8080 
2023-02-10T15:19:18,086+0800 [pulsar-web-48-7] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/clusters HTTP/1.1" 200 14 "-" "Pulsar-Java-v2.11.0" 7
2023-02-10T15:19:18,094+0800 [pulsar-web-48-8] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/tenants HTTP/1.1" 200 19 "-" "Pulsar-Java-v2.11.0" 4
2023-02-10T15:19:18,108+0800 [pulsar-web-48-5] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/namespaces/public HTTP/1.1" 200 37 "-" "Pulsar-Java-v2.11.0" 12
2023-02-10T15:19:18,112+0800 [pulsar-web-48-1] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/clusters HTTP/1.1" 200 14 "-" "Pulsar-Java-v2.11.0" 2
2023-02-10T15:19:18,119+0800 [pulsar-web-48-4] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/tenants HTTP/1.1" 200 19 "-" "Pulsar-Java-v2.11.0" 2
2023-02-10T15:19:18,126+0800 [pulsar-web-48-1] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:18 +0800] "GET /admin/v2/namespaces/pulsar HTTP/1.1" 200 17 "-" "Pulsar-Java-v2.11.0" 4
2023-02-10T15:19:18,928+0800 [pulsar-io-19-4] INFO  org.apache.bookkeeper.mledger.impl.ManagedCursorImpl - [public/functions/persistent/coordinate-participants] Rewind from 17:0 to 17:0
2023-02-10T15:19:18,930+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.LeaderService - Worker c-standalone-fw-localhost-8080:localhost:8080 became the leader.
2023-02-10T15:19:18,949+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {"topicName":"persistent://public/functions/assignments","producerName":"c-standalone-fw-localhost-8080-scheduler-manager","sendTimeoutMs":30000,"blockIfQueueFull":true,"maxPendingMessages":0,"maxPendingMessagesAcrossPartitions":0,"messageRoutingMode":"RoundRobinPartition","hashingScheme":"JavaStringHash","cryptoFailureAction":"FAIL","batchingMaxPublishDelayMicros":1000,"batchingPartitionSwitchFrequencyByPublishDelay":10,"batchingMaxMessages":1000,"batchingMaxBytes":131072,"batchingEnabled":false,"chunkingEnabled":false,"chunkMaxMessageSize":-1,"compressionType":"LZ4","initialSequenceId":null,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"multiSchema":true,"accessMode":"Exclusive","lazyStartPartitionedProducers":false,"properties":{},"initialSubscriptionName":null}
2023-02-10T15:19:18,951+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:18,953+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/assignments] [c-standalone-fw-localhost-8080-scheduler-manager] Creating producer on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650]
2023-02-10T15:19:18,970+0800 [bookkeeper-ml-scheduler-OrderedScheduler-0-0] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/assignments] Updated topic epoch to 1
2023-02-10T15:19:18,972+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/functions/assignments}, client=/127.0.0.1:10729, producerName=c-standalone-fw-localhost-8080-scheduler-manager, producerId=0}
2023-02-10T15:19:18,977+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/assignments] [c-standalone-fw-localhost-8080-scheduler-manager] Created producer on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650]
2023-02-10T15:19:18,977+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/assignments] [c-standalone-fw-localhost-8080-scheduler-manager] Producer epoch is Optional[1]
2023-02-10T15:19:18,981+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {"topicName":"persistent://public/functions/metadata","producerName":"c-standalone-fw-localhost-8080-leader","sendTimeoutMs":30000,"blockIfQueueFull":true,"maxPendingMessages":0,"maxPendingMessagesAcrossPartitions":0,"messageRoutingMode":"RoundRobinPartition","hashingScheme":"JavaStringHash","cryptoFailureAction":"FAIL","batchingMaxPublishDelayMicros":1000,"batchingPartitionSwitchFrequencyByPublishDelay":10,"batchingMaxMessages":1000,"batchingMaxBytes":131072,"batchingEnabled":false,"chunkingEnabled":false,"chunkMaxMessageSize":-1,"compressionType":"LZ4","initialSequenceId":null,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"multiSchema":true,"accessMode":"Exclusive","lazyStartPartitionedProducers":false,"properties":{},"initialSubscriptionName":null}
2023-02-10T15:19:18,983+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":null,"tlsCertificateFilePath":null,"tlsTrustCertsFilePath":null,"tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":null,"tlsKeyStorePassword":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:19:18,985+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/metadata] [c-standalone-fw-localhost-8080-leader] Creating producer on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650]
2023-02-10T15:19:18,990+0800 [bookkeeper-ml-scheduler-OrderedScheduler-2-0] INFO  org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/functions/metadata] Updated topic epoch to 1
2023-02-10T15:19:18,990+0800 [bookkeeper-ml-scheduler-OrderedScheduler-2-0] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/functions/metadata}, client=/127.0.0.1:10729, producerName=c-standalone-fw-localhost-8080-leader, producerId=1}
2023-02-10T15:19:18,990+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/metadata] [c-standalone-fw-localhost-8080-leader] Created producer on cnx [id: 0xa5a16e3a, L:/127.0.0.1:10729 - R:localhost/127.0.0.1:6650]
2023-02-10T15:19:18,990+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/metadata] [c-standalone-fw-localhost-8080-leader] Producer epoch is Optional[1]
2023-02-10T15:19:18,991+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.SchedulerManager - Initializing scheduler manager
2023-02-10T15:19:19,989+0800 [assignment-tailer-thread] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Get topic last message Id
2023-02-10T15:19:19,990+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Successfully getLastMessageId -1:-1
2023-02-10T15:19:19,991+0800 [assignment-tailer-thread] INFO  org.apache.pulsar.functions.worker.FunctionAssignmentTailer - assignment tailer thread exiting
2023-02-10T15:19:19,991+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.FunctionAssignmentTailer - Closing function assignment tailer
2023-02-10T15:19:19,991+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closing consumer: consumerId=3
2023-02-10T15:19:19,991+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.AbstractDispatcherSingleActiveConsumer - Removing consumer Consumer{subscription=PersistentSubscription{topic=persistent://public/functions/assignments, name=c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3}, consumerId=3, consumerName=c-standalone-fw-localhost-8080-function-assignment-tailer, address=/127.0.0.1:10729}
2023-02-10T15:19:19,992+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Successfully closed subscription [NonDurableCursorImpl{ledger=public/functions/persistent/assignments, ackPos=15:-1, readPos=15:0}]
2023-02-10T15:19:19,992+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/assignments][c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Successfully closed dispatcher for reader
2023-02-10T15:19:19,992+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closed consumer, consumerId=3
2023-02-10T15:19:19,992+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/assignments] [c-standalone-fw-localhost-8080-function-assignment-tailer-reader-f1cd2d43c3] Closed consumer
2023-02-10T15:19:19,992+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataManager - FunctionMetaDataManager becoming leader by creating exclusive producer
2023-02-10T15:19:20,004+0800 [function-metadata-tailer-thread] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Get topic last message Id
2023-02-10T15:19:20,005+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Successfully getLastMessageId -1:-1
2023-02-10T15:19:20,005+0800 [function-metadata-tailer-thread] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataTopicTailer - metadata tailer thread exiting
2023-02-10T15:19:20,005+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataTopicTailer - Stopping function metadata tailer
2023-02-10T15:19:20,005+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closing consumer: consumerId=4
2023-02-10T15:19:20,005+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.AbstractDispatcherSingleActiveConsumer - Removing consumer Consumer{subscription=PersistentSubscription{topic=persistent://public/functions/metadata, name=c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116}, consumerId=4, consumerName=c-standalone-fw-localhost-8080-function-metadata-tailer, address=/127.0.0.1:10729}
2023-02-10T15:19:20,006+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Successfully closed subscription [NonDurableCursorImpl{ledger=public/functions/persistent/metadata, ackPos=18:-1, readPos=18:0}]
2023-02-10T15:19:20,006+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://public/functions/metadata][c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Successfully closed dispatcher for reader
2023-02-10T15:19:20,006+0800 [pulsar-io-19-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:10729] Closed consumer, consumerId=4
2023-02-10T15:19:20,006+0800 [pulsar-client-io-58-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/functions/metadata] [c-standalone-fw-localhost-8080-function-metadata-tailer-reader-63c4334116] Closed consumer
2023-02-10T15:19:20,006+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataTopicTailer - Stopped function metadata tailer
2023-02-10T15:19:20,006+0800 [pulsar-external-listener-59-1] INFO  org.apache.pulsar.functions.worker.FunctionMetaDataManager - FunctionMetaDataManager done becoming leader
2023-02-10T15:19:20,043+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:20 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 28
2023-02-10T15:19:20,056+0800 [worker-scheduler-0] INFO  org.apache.pulsar.functions.worker.SchedulerManager - Schedule summary - execution time: 0.043905637 sec | total unassigned: 0 | stats: {"Added": 0, "Updated": 0, "removed": 0}
{
  "c-standalone-fw-localhost-8080" : {
    "originalNumAssignments" : 0,
    "finalNumAssignments" : 0,
    "instancesAdded" : 0,
    "instancesRemoved" : 0,
    "instancesUpdated" : 0,
    "alive" : true
  }
}
2023-02-10T15:19:48,014+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:48 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 4
2023-02-10T15:19:48,021+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:19:48 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 3
2023-02-10T15:20:18,013+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:20:18 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 3
2023-02-10T15:20:18,020+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:20:18 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 3
2023-02-10T15:20:18,025+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:20:18 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 2
2023-02-10T15:20:48,014+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:20:48 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 3
2023-02-10T15:20:48,019+0800 [ForkJoinPool.commonPool-worker-3] INFO  org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [10/Feb/2023:15:20:48 +0800] "GET /admin/v2/persistent/public/functions/coordinate/stats?getPreciseBacklog=false&subscriptionBacklogSize=false&getEarliestTimeInBacklog=false HTTP/1.1" 200 2410 "-" "Pulsar-Java-v2.11.0" 3

七、创建Kafka Topic

bin/pulsar-admin topics create persistent://public/default/my-topic
(root)[t-qcbj5-hadoop-database-002]{/data/src/apache-pulsar-2.11.0}<test>$ bin/pulsar-client produce my-topic --messages 'Hello Pulsar!'
2023-02-10T15:07:22,363+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConnectionPool - [[id: 0x0fe4db59, L:/127.0.0.1:9978 - R:localhost/127.0.0.1:6650]] Connected to server
2023-02-10T15:07:22,489+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {"topicName":"my-topic","producerName":null,"sendTimeoutMs":30000,"blockIfQueueFull":false,"maxPendingMessages":1000,"maxPendingMessagesAcrossPartitions":50000,"messageRoutingMode":"RoundRobinPartition","hashingScheme":"JavaStringHash","cryptoFailureAction":"FAIL","batchingMaxPublishDelayMicros":1000,"batchingPartitionSwitchFrequencyByPublishDelay":10,"batchingMaxMessages":1000,"batchingMaxBytes":131072,"batchingEnabled":true,"chunkingEnabled":false,"chunkMaxMessageSize":-1,"compressionType":"NONE","initialSequenceId":null,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"multiSchema":true,"accessMode":"Shared","lazyStartPartitionedProducers":false,"properties":{},"initialSubscriptionName":null}
2023-02-10T15:07:22,521+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650/","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":"","tlsCertificateFilePath":"","tlsTrustCertsFilePath":"","tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":"","tlsKeyStorePassword":"*****","tlsTrustStoreType":"JKS","tlsTrustStorePath":"","tlsTrustStorePassword":"*****","tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:07:22,536+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [my-topic] [null] Creating producer on cnx [id: 0x0fe4db59, L:/127.0.0.1:9978 - R:localhost/127.0.0.1:6650]
2023-02-10T15:07:22,547+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [my-topic] [standalone-0-1] Created producer on cnx [id: 0x0fe4db59, L:/127.0.0.1:9978 - R:localhost/127.0.0.1:6650]
2023-02-10T15:07:22,593+0800 [main] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - [my-topic] [standalone-0-1] Pending messages: 0 --- Publish throughput: 14.62 msg/s --- 0.00 Mbit/s --- Latency: med: 29.000 ms - 95pct: 29.000 ms - 99pct: 29.000 ms - 99.9pct: 29.000 ms - max: 29.000 ms --- BatchSize: med: 1.000 - 95pct: 1.000 - 99pct: 1.000 - 99.9pct: 1.000 - max: 1.000 --- MsgSize: med: 13.000 bytes - 95pct: 13.000 bytes - 99pct: 13.000 bytes - 99.9pct: 13.000 bytes - max: 13.000 bytes --- Ack received rate: 14.62 ack/s --- Failed messages: 0 --- Pending messages: 0
2023-02-10T15:07:22,598+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [my-topic] [standalone-0-1] Closed Producer
2023-02-10T15:07:22,599+0800 [main] INFO  org.apache.pulsar.client.impl.PulsarClientImpl - Client closing. URL: pulsar://localhost:6650/
2023-02-10T15:07:22,622+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ClientCnx - [id: 0x0fe4db59, L:/127.0.0.1:9978 ! R:localhost/127.0.0.1:6650] Disconnected
2023-02-10T15:07:24,636+0800 [main] INFO  org.apache.pulsar.client.cli.PulsarClientTool - 1 messages successfully produced

八、往Topic写入数据

bin/pulsar-client produce my-topic --messages 'Hello Pulsar!'

九、消费pulsar的Topic

bin/pulsar-client consume my-topic -s 'my-subscription' -p Earliest -n 0
2023-02-10T15:07:09,675+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xd3503738, L:/127.0.0.1:9960 - R:localhost/127.0.0.1:6650]] Connected to server
2023-02-10T15:07:09,787+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {"topicNames":["my-topic"],"topicsPattern":null,"subscriptionName":"my-subscription","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"Durable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":null,"ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":60000,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":false,"subscriptionInitialPosition":"Earliest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":true,"startPaused":false,"autoScaledReceiverQueueSizeEnabled":false,"topicConfigurations":[],"maxPendingChuckedMessage":10}
2023-02-10T15:07:09,820+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650/","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"connectionMaxIdleSeconds":180,"useTcpNoDelay":true,"useTls":false,"tlsKeyFilePath":"","tlsCertificateFilePath":"","tlsTrustCertsFilePath":"","tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsKeyStoreType":"JKS","tlsKeyStorePath":"","tlsKeyStorePassword":"*****","tlsTrustStoreType":"JKS","tlsTrustStorePath":"","tlsTrustStorePassword":"*****","tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
2023-02-10T15:07:09,839+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [my-topic][my-subscription] Subscribing to topic on cnx [id: 0xd3503738, L:/127.0.0.1:9960 - R:localhost/127.0.0.1:6650], consumerId 0
2023-02-10T15:07:09,873+0800 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [my-topic][my-subscription] Subscribed to topic on localhost/127.0.0.1:6650 -- consumer: 0
----- got message -----
key:[null], properties:[], content:Hello Pulsar!
2023-02-10T15:08:09,828+0800 [pulsar-timer-6-1] INFO  org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [my-topic] [my-subscription] [4410a] Prefetched messages: 0 --- Consume throughput received: 0.02 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 0.02 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0

至此完成pulsar安装部署

最笨的羊羊
关注
  • 3
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
pulsar-client-go：Apache Pulsar Go客户端库
02-09
Apache Pulsar Go客户端库 项目的Go客户端库。 目标 该项目正在开发不依赖于C ++ ... URL : "pulsar://localhost:6650" , }) defer client . Close () producer , err := client . CreateProducer (pulsar. Produce
Pulsar简介及其安装
HQ DevJ的专栏
10-10 295
Apache Pulsar 是 Apache 软件基金会顶级项目，是下一代云原生分布式消息流平台，集消息、存储、轻量化函数式计算为一体。该系统源于 Yahoo，最初在 Yahoo 内部开发和部署，支持 Yahoo 应用服务平台 140 万个主题，日处理超过 1000 亿条消息。Pulsar 于 2016 年由 Yahoo 开源并捐赠给Apache 软件基金会进行孵化，2018 年成为 Apache 软件基金会顶级项目。
【Pulsar】学习笔记-安装部署
weixin_41162023的博客
06-27 166
advertisedAddress 修改为服务器对应的ip,在另外两台服务器也做对应的修改advertisedAddress=10.91.1.90。# 修改zk地址和端口信息zkServers=10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181。订阅test主题(-n:消费的消息数量,-s:订阅的名字,-t:订阅的类型)发消息到test主题(-n:发送消息的次数,-m:消息内容)三台分别启动bookeeper。三台分别启动broker。以下结果为初始化成功。
Pulsar【部署 02】Pulsar可视化工具Manager安装使用
最新发布
Java与大数据相关实践内容分享！
04-26 967
Pulsar可视化工具Manager安装使用
Pulsar-学习-安装部署
CallousZD的博客
01-31 2451
pulsar 部署
Pulsar安装部署
qq_43226029的博客
01-28 5567
Pulsar安装部署（单节点） 参考：pulsar-4：单机部署pulsar单节点集群 - 云+社区 - 腾讯云 1、安装包下载 wgethttps://archive.apache.org/dist/pulsar/pulsar-2.8.0/apache-pulsar-2.8.0-bin.tar.gz 解压 $ tar -xzvf apache-pulsar-2.8.0-bin.tar.gz -C servers/ $ cd $ mv apache-pulsar-2.8.1 pulsar $.
Pulsar详解2—架构和组件 & 安装和配置（示例：Go语言）
风不归的乐园
12-20 1352
Pulsar：架构和组件：分层架构、BookKeeper和ZooKeeper、Broker服务、Pulsar IO（连接器）；安装和配置：安装步骤、配置文件
云原生时代消息中间件Pulsar(介绍、集群安装部署、管理页面安装部署)
四维大脑的博客
04-06 6302
是一个云原生企业级的发布订阅（pub-sub）消息系统，最初由Yahoo开发，并于2016年底开源，现在是Apache软件基金会顶级开源项目。Pulsar在Yahoo的生产环境运行了三年多，助力Yahoo的主要应用，如Yahoo Mail、Yahoo Finance、Yahoo Sports、Flickr、Gemini广告平台和Yahoo分布式键值存储系统Sherpa。
《Apache Pulsar从入门到实战》系列教程第1讲之pulsar基础篇
小米吃辣椒的博客
02-09 3571
《Apache Pulsar从入门到实战》系列教程之基础篇
apache-pulsar-grafana-dashboard:Apache Pulsar Grafana仪表板
05-06
Apache Pulsar Grafana仪表板 Grafana仪表板docker映像可从。 要使用此仪表板图像，请提供以下环境变量： PULSAR_PROMETHEUS_URL ：指向您的普罗米修斯服务的HTTP URL。 例如， http://<prometheus>:9090 。 PULSAR_...
脉冲星：Apache Pulsar-分布式发布订阅消息系统
02-07
Pulsar是具有非常灵活的消息传递模型和直观的客户端API的分布式pub-sub消息传递平台。 在了解有关Pulsar的更多信息 主要特点 水平可扩展（每秒数百万个独立主题和数百万条消息发布） 强大的订购和一致性保证 低...
大数据之路 Apache Pulsar 调研（全面）.docx
11-12
大数据之路 Apache Pulsar 调研（全面）.docx
DSPSR: Digital Pulsar Signal Processing-开源
04-28
DSPSR（Digital Pulsar Signal Processing）就是这样一个专为无线电脉冲星天文学设计的开源数字信号处理库，它为科研人员提供了强大的工具，以处理来自天文观测的数据。 DSPSR的设计理念是高性能和面向对象，这使得...
Apache Pulsar部署搭建
weixin_43114209的博客
05-24 4575
如果不指定 --url 参数并且没有在 conf/client.conf 文件中指定 pulsar 集群连接信息，则默认连接的是 pulsar://localhost:6650/。可以指定 --url pulsar://192.168.1.147:6650 或者 --url http://192.168.1.147:8080 与 broker 进行交互。访问 http://192.168.1.147:7750/bkvm 查看 bookie 信息，用户名：admin，密码：admin。
pulsar消息中间件：安装及入门示例
学亮编程手记
10-23 416
要安装 Pulsar Python 客户端库，您可以使用pip这将自动下载并安装最新版本的 Pulsar Python 客户端库。请确保您的系统已经安装了 Python 和 pip 工具，并且已经设置了正确的环境变量。如果您使用的是 Python 3，您可能需要使用pip3安装完成后，您就可以在 Python 代码中导入 Pulsar 客户端库并开始使用了。
Apache-Pulsar安装操作说明
u010479989的博客
04-07 1090
Pulsar 是一种用于服务器到服务器消息传递的多租户高性能解决方案。
《Apache Pulsar从入门到实战》系列教程第9讲之pulsar架构原理
小米吃辣椒的博客
02-16 1220
一、深入理解pulsar分层存储 单个pulsar集群由以下三部分组成： 多个broker负责处理和负载均衡producer发出的消息，并将这些消息分派给consumer；broker和pulsar配置存储交互来处理相应的任务，并将消息存储在bookkeeper实例中（又称bookies）；broker依赖zookeeper集群处理特定的任务，等等 多个bookie的bookkepper集群负责消息的持久化存储 一个zookeeper集群，用来处理多个pulsar集群之间的协调任务 在一些流数据
Mq之pulsar的入门使用（一）
u014642921的博客
03-21 1281
docker容器的部署效率会更高。若使用docker容器搭建效率应该会更高。后面会使用容器进行搭建发布出来。》》docker容器的官网使用docker compose插件方式部署，可以尝试一下》》错误问题继续排查。那个[错误](#err)虽然不影响使用, 但是挺纠结，在尝试使用docker部署时关注这一点，进行纠错, 并在这个文章里进行更新.pulsar集群安装的文章中提到了如何解决这个问题，但是不起作用pulsar的部署需要搭配的内容真不少。注：bookeeper，主要用于持久化存储等。
聊聊 Pulsar： 在 Linux 环境上搭建 Pulsar
riemann_的博客
02-19 2620
一、环境准备 jdk下载地址链接：jdk 1.8，提取码: dv5h pulsar下载地址链接：pulsar2.9.1，提取码: 8489 1.1 Java 环境为前提 1.1.1 上传jdk-8u261-linux-x64.rpm到服务器并安装 # 安装命令 rpm -ivh jdk-8u261-linux-x64.rpm 1.1.2 配置环境变量 # 编辑配置文件,jdk的bin目录到/etc/profile文件，对所有用户的shell有效 vim /etc/profile # 生效 source
如何在Presto服务器上安装Pulsar Connector
06-09
要在Presto服务器上安装Pulsar Connector，可以按照以下步骤进行操作： 1.首先，下载Presto的最新版本，并将其解压缩到安装目录中。 2.下载Pulsar Connector的最新版本，并将其解压缩到Presto的插件目录中。插件目录的位置在Presto安装文件夹下的插件文件夹中。 3.配置Pulsar Connector。在Presto的配置文件中，添加以下内容： ``` connector.name=pulsar pulsar.service-url=pulsar://localhost:6650 ``` 这里，`pulsar.service-url`是指Pulsar服务的地址和端口号。 4.启动Presto服务器。在命令行中输入以下命令： ``` ./presto-server-<version>/bin/launcher start ``` 5.测试Pulsar Connector。在Presto命令行中输入以下命令： ``` SELECT * FROM pulsar.<topic-name>; ``` 这里，`<topic-name>`是指要查询的Pulsar主题的名称。 如果一切顺利，你应该可以在Presto中看到来自Pulsar的数据。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

最笨的羊羊

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值