RocketMQ消费者配置消费场景

先看一句话:”rocketmq客户端初始化DefaultMQPushConsumer依据topic的数量进行初始化“

场景一:
一个producer, 一个consumer1,一个consumer2

1.producer发送消息 3条

DefaultMQProducer producer = new DefaultMQProducer("group");
        producer.setRetryTimesWhenSendAsyncFailed(3);
        producer.setNamesrvAddr("127.0.0.1:9876");
        producer.start();
        String[] tags = new String[] {"tag"};
        for (int i = 0; i < 3; i++) {
            Message msg = new Message("topic", tags[i % tags.length],
                ("Hello RocketMQ" + i).getBytes(RemotingHelper.DEFAULT_CHARSET));
            producer.send(msg, new SendCallback() {
                @Override
                public void onSuccess(SendResult sendResult) {
                    System.out.println(sendResult);
                }
                @Override
                public void onException(Throwable e) {
                    e.printStackTrace();
                }
            });

2.启动consumer1,consumer2 订阅关系完全一致(groupName+topic+tag)

 DefaultMQPushConsumer consumer = new DefaultMQPushConsumer("consumerGroup");
    consumer.setNamesrvAddr("localhost:9876");
    consumer.setMessageModel(MessageModel.CLUSTERING);
    try {
        consumer.subscribe("topic","tag");
        consumer.registerMessageListener(new MessageListenerConcurrently() {
            @Override
            public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> msgs,
                ConsumeConcurrentlyContext context) {
                for (MessageExt msg : msgs) {
                    System.out.println(new String(msg.getBody()) + " >> " + msg);
                }
                return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;
            }
        });
        consumer.start();
        System.out.println("Consumer Started.");
    }
    catch (MQClientException e) {
        e.printStackTrace();
    }

结果:
此种场景下,consumer1与consumer2能正常消费到producer发送的所有消息,并遵循broker端的lb策略,consumer1与consumer2消费到的消息之和等于producer发送的消息数目

场景二:consumer1和consumer2配置相同的单个consumerGroup,多个topic和tags

1.producer发送消息 6条消息(各topic发送3条)

public static void main(String[] args)
        throws MQClientException, UnsupportedEncodingException, RemotingException, InterruptedException {
        DefaultMQProducer producer = new DefaultMQProducer("group");
        producer.setRetryTimesWhenSendAsyncFailed(3);
        producer.setNamesrvAddr("127.0.0.1:9876");
        producer.start();
        String[] tags = new String[] {"tag"};
        for (int i = 0; i < 3; i++) {
            Message msg = new Message("topic", tags[i % tags.length],
                ("Hello RocketMQ" + i).getBytes(RemotingHelper.DEFAULT_CHARSET));
            producer.send(msg, new SendCallback() {
                @Override
                public void onSuccess(SendResult sendResult) {


                    System.out.println(sendResult);
                }

                @Override
                public void onException(Throwable e) {


                    e.printStackTrace();
                }
            });
        }

        String[] tags2 = new String[] {"tag1"};
        for (int i = 0; i < 3; i++) {
            Message msg = new Message("topic1", tags2[i % tags2.length],
                ("Hello RocketMQ" + i).getBytes(RemotingHelper.DEFAULT_CHARSET));
            producer.send(msg, new SendCallback() {
                @Override
                public void onSuccess(SendResult sendResult) {

                    System.out.println(sendResult);
                }

                @Override
                public void onException(Throwable e)
                {
                    e.printStackTrace();
                }
            });
        }

    }

2.启动consumer1,consumer2 订阅关系不一致
Consumer1. “group” “topic1” “tag1”(groupName+topic+tag)

public static void main(String[] args) {
        DefaultMQPushConsumer consumer = new DefaultMQPushConsumer("consumerGroup");
        consumer.setNamesrvAddr("localhost:9876");
        consumer.setMessageModel(MessageModel.CLUSTERING);
        try {
            consumer.subscribe("topic1","tag1");
            consumer.registerMessageListener(new MessageListenerConcurrently() {
                @Override
                public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> msgs,
                    ConsumeConcurrentlyContext context) {
                    for (MessageExt msg : msgs) {
                        System.out.println(new String(msg.getBody()) + " >> " + msg);
                    }
                    return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;
                }
            });
            consumer.start();
            System.out.println("Consumer Started.");
        }
        catch (MQClientException e) {
            e.printStackTrace();
        }
    }

Consumer2. “group” “topic” “tag”(groupName+topic+tag)

public static void main(String[] args) {
        DefaultMQPushConsumer consumer = new DefaultMQPushConsumer("consumerGroup");
        consumer.setNamesrvAddr("localhost:9876");
        consumer.setMessageModel(MessageModel.CLUSTERING);
        try {
            consumer.subscribe("topic","tag");
            consumer.registerMessageListener(new MessageListenerConcurrently() {
                @Override
                public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> msgs,
                    ConsumeConcurrentlyContext context) {
                    for (MessageExt msg : msgs) {
                        System.out.println(new String(msg.getBody()) + " >> " + msg);
                    }
                    return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;
                }
            });
            consumer.start();
            System.out.println("Consumer Started.");
        }
        catch (MQClientException e) {
            e.printStackTrace();
        }
    }

结果:
此种场景下,若客户端初始化DefaultMQPushConsumer依据topic的数量进行初始化,则consumer1与consumer2与broker建立心跳链接时会相互覆盖相同consumerGroup下的消费topic信息,这样会导致部分消息消费不了
换句话就是:“同组下,DefaultMQPushConsumer根据topic的数量进行初始化,则consumer1与consumer2与broker建立心跳链接时会相互覆盖相同consumerGroup下的消费topic信息,这样会导致部分消息消费不了"
再换句话说:“同组,不同topic,consumer1和consumer2与broker建立心跳时相互覆盖同组下的消费topic信息,会导致部分消息消费不了”

场景三:
consumer1和consumer2配置不同的多个consumerGroup,相同的单个topic和tags

1.producer

public static void main(String[] args)
        throws MQClientException, UnsupportedEncodingException, RemotingException, InterruptedException {
        DefaultMQProducer producer = new DefaultMQProducer("group");
        producer.setRetryTimesWhenSendAsyncFailed(3);
        producer.setNamesrvAddr("127.0.0.1:9876");
        producer.start();
        String[] tags = new String[] {"tag"};
        for (int i = 0; i < 3; i++) {
            Message msg = new Message("topic", tags[i % tags.length],
                ("Hello RocketMQ" + i).getBytes(RemotingHelper.DEFAULT_CHARSET));
            producer.send(msg, new SendCallback() {
                @Override
                public void onSuccess(SendResult sendResult) {
                    System.out.println(sendResult);
                }
                @Override
                public void onException(Throwable e) {
                    e.printStackTrace();
                }
            });
        }
    }

2.consumer1

public static void main(String[] args) {
        DefaultMQPushConsumer consumer = new DefaultMQPushConsumer("consumerGroup1");
        consumer.setNamesrvAddr("localhost:9876");
        consumer.setMessageModel(MessageModel.CLUSTERING);
        try {
            consumer.subscribe("topic","tag");
            consumer.registerMessageListener(new MessageListenerConcurrently() {
                @Override
                public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> msgs,
                    ConsumeConcurrentlyContext context) {
                    for (MessageExt msg : msgs) {
                        System.out.println(new String(msg.getBody()) + " >> " + msg);
                    }
                    return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;
                }
            });
            consumer.start();
            System.out.println("Consumer Started.");
        }
        catch (MQClientException e) {
            e.printStackTrace();
        }
    }

consumer2:

public static void main(String[] args) {
        DefaultMQPushConsumer consumer = new DefaultMQPushConsumer("consumerGroup2");
        consumer.setNamesrvAddr("localhost:9876");
        consumer.setMessageModel(MessageModel.CLUSTERING);
        try {
            consumer.subscribe("topic","tag");
            consumer.registerMessageListener(new MessageListenerConcurrently() {
                @Override
                public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> msgs,
                    ConsumeConcurrentlyContext context) {
                    for (MessageExt msg : msgs) {
                        System.out.println(new String(msg.getBody()) + " >> " + msg);
                    }
                    return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;
                }
            });
            consumer.start();
            System.out.println("Consumer Started.");
        }
        catch (MQClientException e) {
            e.printStackTrace();
        }
    }

结果:
此种情况用于consumer1和consumer2需要同时消费所有producer发出的消息。consumer1和consumer2消费的消息之和等于producer生产的消息的2倍,所有发出的消息都会同时出现在consumer1和consumer2的消费队列中

  • 0
    点赞
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
RocketMQ消费者配置主要包括以下几个方面: 1. 配置消费者组名(Group Name):在创建消费者时,需要指定一个唯一的消费者组名,用于标识一组共享相同主题(Topic)消息的消费者。 2. 配置消费模式(Consuming Mode):RocketMQ支持两种消费模式,分别是集群模式(Cluster)和广播模式(Broadcast)。集群模式下,同一消费者组内的每个消费者消费一部分消息;广播模式下,同一消费者组内的每个消费者都会接收到所有消息。 3. 配置消息模式(Message Model):RocketMQ支持两种消息模式,分别是集中式消费(Clustering)和广播消费(Broadcasting)。集中式消费模式下,同一消费者组内的每个消费者只会有一个消费线程消费消息;广播消费模式下,同一消费者组内的每个消费者都会有多个消费线程同时消费消息。 4. 配置消息拉取方式(Message Pulling):RocketMQ提供了两种消息拉取方式,分别是长轮询(Long Polling)和短轮询(Short Polling)。长轮询方式下,消费者向Broker发送拉取消息请求后,如果没有新消息,则Broker会阻塞一段时间再返回响应;短轮询方式下,消费者向Broker发送拉取消息请求后,无论是否有新消息,Broker都会立即返回响应。 5. 配置消息消费失败重试次数(Max Reconsume Times):RocketMQ允许配置消息消费失败后的最大重试次数。当消息消费失败时,可以选择将消息重新发送给消费者进行重试,直到达到最大重试次数或消息成功消费为止。 这些是RocketMQ消费者的一些常用配置项,根据具体的业务需求和场景,可以灵活配置以满足应用程序的需求。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值