RabbitMQ超详细笔记

2 篇文章 0 订阅
1 篇文章 0 订阅

RabbitMQ

一、RabbitMQ介绍

1.1 现存问题
  • 服务调用:两个服务调用时,我们可以通过传统的HTTP方式,让服务A直接去调用服务B的接口,但是这种方式是同步的方式,虽然可以采用SpringBoot提供的@Async注解实现异步调用,但是这种方式无法确保请求一定回访问到服务B的接口。那如何保证服务A的请求信息一定能送达到服务B去完成一些业务操作呢?| 如何实现异步调用1642517531404.png
  • 海量请求:在我们在做一些秒杀业务时,可能会在某个时间点突然出现大量的并发请求,这可能已经远远超过服务器的并发瓶颈,这时我们需要做一些削峰的操作,也就是将大量的请求缓冲到一个队列中,然后慢慢的消费掉。如何提供一个可以存储千万级别请求的队列呢?1642517747632.png
  • 在微服务架构下,可能一个业务会出现同时调用多个其他服务的场景,而且这些服务之间一般会用到Feign的方式进行轻量级的通讯,如果存在一个业务,用户创建订单成功后,还需要去给用户添加积分、通知商家、通知物流系统、扣减商品库存,而在执行这个操作时,如果任意一个服务出现了问题,都会导致整体的下单业务失败,并且会导致给用户反馈的时间延长。这时就造成了服务之间存在一个较高的耦合性的问题。如何可以降低服务之间的耦合性呢?1642517948196.png
1.2 处理问题

RabbitMQ就可以解决上述的全部问题

  • 服务之间如何想实现可靠的异步调用,可以通过RabbitMQ的方式实现,服务A只需要保证可以把消息发送到RabbitMQ的队列中,服务B就一定会消费到队列中的消息只不过会存在一定的延时。| 异步访问1642518013295.png
  • 忽然的海量请求可以存储在RabbitMQ的队列中,然后由消费者慢慢消费掉,RabbitMQ的队列本身就可以存储上千万条消息 1642518109219.png
  • 在调用其他服务时,如果允许延迟效果的出现,可以将消息发送到RabbitMQ中,再由消费者慢慢消费| 服务解耦
    1642518233825.png
1.3 RabbitMQ介绍

百度百科:

> RabbitMQ是实现了高级消息队列协议(AMQP)的开源消息代理软件(亦称面向消息的中间件)。RabbitMQ服务器是用Erlang语言编写的,而集群和故障转移是构建在开放电信平台框架上的。所有主要的编程语言均有与代理接口通讯的客户端库。

首先RabbitMQ基于AMQP协议开发,所以很多基于AMQP协议的功能RabbitMQ都是支持的,比如SpringCloud中的消息总线bus

其次RabbitMQ是基于Erlang编写,这是也是RabbitMQ天生的优势,Erlang被称为面向并发编程的语言,并发能力极强,在众多的MQ中,RabbitMQ的延迟特别低,在微秒级别,所以一般的业务处理RabbitMQ比Kafka和RocketMQ更有优势。

最后RabbitMQ提供自带了图形化界面,操作方便,还自带了多种集群模式,可以保证RabbitMQ的高可用,并且SpringBoot默认就整合RabbitMQ,使用简单方便。

二、RabbitMQ安装


2.1 安装RabbitMQ

这里推荐搭建采用Docker的方式在Linux中安装RabbitMQ,如果对Docker不了解,推荐去学习一下Docker的应用,不然学习其他的知识时,安装的成本都特别高,这里我们就采用Docker的方式安装RabbitMQ。

直接使用docker-compose.yml文件即可安装RabbitMQ服务

version: '3.1'
services:
  rabbitmq:
    restart: always
    image: daocloud.io/library/rabbitmq:3.8.8
    volumes:
      - ./data/:/var/lib/rabbitmq/
      - ./log/:/var/log/rabbitmq/log/
    ports:
      - 15672:15672
      - 5672:5672

执行 docker-compose up -d运行

测试效果:curl localhost:5672

查看效果
image20220121005749217.png
2.2 开启图形化界面

默认情况下,当前镜像的图形化界面默认没有开启,需要进入到容器内部开启图形化管理界面

启动图形化界面插件
image20220121005619975.png
image20220121005624253.png

通过浏览器访问15672,查看图形化界面

查看登录页面
image20220121005852818.png

默认用户和密码均为:guest,查看首页

查看首页
image20220121005930123.png

三、RabbitMQ构架

RabbitMQ的架构可以查看官方地址:https://rabbitmq.com/tutorials/amqp-concepts.html

官方简单架构
image20220121010054992.png

可以看出RabbitMQ中主要分为三个角色:

  • Publisher:消息的发布者,将消息发布到RabbitMQ中的Exchange
  • RabbitMQ服务:Exchange接收Publisher的消息,并且根据Routes策略将消息转发到Queue中
  • Consumer:消息的消费者,监听Queue中的消息并进行消费

官方提供的架构图相对简洁,我们可以自己画一份相对完整一些的架构图:

RabbitMQ架构图
image20220121011000157.png

可以看出Publisher和Consumer都是单独和RabbitMQ服务中某一个Virtual Host建立Connection的客户端

后续通过Connection可以构建Channel通道,用来发布、接收消息

一个Virtual Host中可以有多个Exchange和Queue,Exchange可以同时绑定多个Queue

在基于架构图查看图形化界面,会更加清晰

图形化界面信息
image20220121011418076.png

四、RabbitMQ通讯方式


RabbitMQ提供了很多中通讯方式,依然可以去官方查看:https://rabbitmq.com/getstarted.html

七种通讯方式
image20220121011637076.png
4.1 RabbitMQ提供的通讯方式
4.2 构建Connection工具类
  • 导入依赖:amqp-client,junit

    <dependencies>
        <dependency>
            <groupId>com.rabbitmq</groupId>
            <artifactId>amqp-client</artifactId>
            <version>5.9.0</version>
        </dependency>
        <dependency>
            <groupId>junit</groupId>
            <artifactId>junit</artifactId>
            <version>4.12</version>
        </dependency>
    </dependencies>
    
  • 构建工具类:

    package com.ajie.util;
    
    
    import com.rabbitmq.client.Connection;
    import com.rabbitmq.client.ConnectionFactory;
    
    import java.io.IOException;
    import java.util.concurrent.TimeoutException;
    
    public class RabbitMQConnectionUtil {
        public static final String HOST = "ajie103";
        public static final int PORT = 5672;
        public static final String USER = "ajie";
        public static final String PASSWORD = "**********";
        public static final String V_HOST = "/";
    
        public static Connection getConnection() throws IOException, TimeoutException {
            // 1.创建连接工厂
            ConnectionFactory factory = new ConnectionFactory();
            factory.setHost(HOST);
            factory.setPort(PORT);
            factory.setUsername(USER);
            factory.setPassword(PASSWORD);
            factory.setVirtualHost(V_HOST);
    
            // 2.获取连接
            return factory.newConnection();
        }
    }
    
    
4.3 Hello World
通讯方式
image.png

生产者:

package com.ajie.helloworld;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import org.junit.Test;

import java.io.IOException;
import java.nio.charset.StandardCharsets;
import java.util.concurrent.TimeoutException;

public class Publisher {
    public static final String QUEUE = "hello";

    @Test
    public void test() throws IOException, TimeoutException {
        // 1.获取连接
        try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
            //2.获取通道
            try (Channel channel = connection.createChannel()) {
                // 3.声明队列
                channel.queueDeclare(QUEUE, false, false, false, null);
                // 4. 发送消息
                String message = "hello world";
                channel.basicPublish("", QUEUE, null, message.getBytes(StandardCharsets.UTF_8));
                System.out.println("发送消息成功");
                System.in.read();
            }
        }
    }
}

消费者:

package com.ajie.helloworld;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.*;
import org.junit.Test;

import java.io.IOException;
import java.util.concurrent.TimeoutException;

public class Consumer {
    @Test
    public void test() throws IOException, TimeoutException {
        //1.创建连接
        try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
            // 2. 创建通道
            try (Channel channel = connection.createChannel()) {
                // 3. 声明队列
                channel.queueDeclare(Publisher.QUEUE, false, false, false, null);
                // 4. 消费消息
                DefaultConsumer callback = new DefaultConsumer(channel) {
                    @Override
                    public void handleDelivery(String consumerTag, Envelope envelope, AMQP.BasicProperties properties, byte[] body) throws IOException {
                        System.out.println("消费者获取到消息:" + new String(body));
                    }
                };
                channel.basicConsume(Publisher.QUEUE, true, callback);
                System.out.println("开始监听队列");
                System.in.read();
            }
        }
    }
}
4.4 Work Queues
WorkQueues需要学习的内容
image.png
  • 生产者:生产者和Hello World的形式是一样的,都是将消息推送到默认交换机。

  • 消费者:让消费者关闭自动ack,并且设置消息的流控,最终实现消费者可以尽可能去多消费消息

    package com.ajie.work;
    
    import com.ajie.util.RabbitMQConnectionUtil;
    import com.rabbitmq.client.*;
    import org.junit.Test;
    
    import java.io.IOException;
    import java.util.concurrent.TimeUnit;
    import java.util.concurrent.TimeoutException;
    
    public class Consumer {
        @Test
        public void consumer1() throws IOException, TimeoutException {
            //1.创建连接
            try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
                // 2. 创建通道
                try (Channel channel = connection.createChannel()) {
                    // 3. 声明队列
                    channel.queueDeclare(Publisher.QUEUE, false, false, false, null);
                    // 3.5 设置拉取消息的频率
                    channel.basicQos(1);
                    // 4. 消费消息
                    DefaultConsumer callback = new DefaultConsumer(channel) {
                        @Override
                        public void handleDelivery(String consumerTag, Envelope envelope, AMQP.BasicProperties properties, byte[] body) throws IOException {
                            try {
                                TimeUnit.MILLISECONDS.sleep(100);
                            } catch (InterruptedException e) {
                                throw new RuntimeException(e);
                            }
                            System.out.println("消费者1号获取到消息:" + new String(body));
                            channel.basicAck(envelope.getDeliveryTag(), false);
                        }
                    };
                    channel.basicConsume(Publisher.QUEUE, false, callback);
                    System.out.println("开始监听队列");
                    System.in.read();
                }
            }
        }
    
        @Test
        public void consumer2() throws IOException, TimeoutException {
            //1.创建连接
            try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
                // 2. 创建通道
                try (Channel channel = connection.createChannel()) {
                    // 3. 声明队列
                    channel.queueDeclare(Publisher.QUEUE, false, false, false, null);
                    // 3.5 设置拉取消息的频率
                    channel.basicQos(1);
                    // 4. 消费消息
                    DefaultConsumer callback = new DefaultConsumer(channel) {
                        @Override
                        public void handleDelivery(String consumerTag, Envelope envelope, AMQP.BasicProperties properties, byte[] body) throws IOException {
                            try {
                                TimeUnit.MILLISECONDS.sleep(1000);
                            } catch (InterruptedException e) {
                                throw new RuntimeException(e);
                            }
                            System.out.println("消费者2号获取到消息:" + new String(body));
                            channel.basicAck(envelope.getDeliveryTag(), false);
                        }
                    };
                    channel.basicConsume(Publisher.QUEUE, false, callback);
                    System.out.println("开始监听队列");
                    System.in.read();
                }
            }
        }
    }
    
    
4.5 Publish/Subscribe
自定义一个交换机
image.png

生产者:自行构建Exchange并绑定指定队列(FANOUT类型)

package com.ajie.pubsub;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.BuiltinExchangeType;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import org.junit.Test;

import java.io.IOException;
import java.nio.charset.StandardCharsets;
import java.util.concurrent.TimeoutException;

public class Publisher {
    public static final String EXCHANGE_NAME = "pubsub";
    public static final String QUEUE_NAME1 = "pubsub-one";
    public static final String QUEUE_NAME2 = "pubsub-two";

    @Test
    public void pubsub() throws IOException, TimeoutException {
        // 1.获取连接
        try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
            // 2.获取通道
            try (Channel channel = connection.createChannel()) {
                // 3.声明交换机
                channel.exchangeDeclare(EXCHANGE_NAME, BuiltinExchangeType.FANOUT);
                // 4.声明队列
                channel.queueDeclare(QUEUE_NAME1, true, false, false, null);
                channel.queueDeclare(QUEUE_NAME2, true, false, false, null);
                // 5.绑定交换机和队列
                channel.queueBind(QUEUE_NAME1, EXCHANGE_NAME, "");
                channel.queueBind(QUEUE_NAME2, EXCHANGE_NAME, "");
                // 6.发送消息
                for (int i = 0; i < 10; i++) {
                    String message = "pubsub_" + i;
                    channel.basicPublish(EXCHANGE_NAME, "", null, message.getBytes(StandardCharsets.UTF_8));
                }
                System.out.println("发送消息成功");
                System.in.read();
            }
        }
    }

}

4.6 Routing
DIRECT类型Exchange
image.png

生产者:在绑定Exchange和Queue时,需要指定好routingKey,同时在发送消息时,也指定routingKey,只有routingKey一致时,才会把指定的消息路由到指定的Queue

package com.ajie.routing;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.BuiltinExchangeType;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import org.junit.Test;

import java.io.IOException;
import java.nio.charset.StandardCharsets;
import java.util.concurrent.TimeoutException;

public class Publisher {
    public static final String EXCHANGE_NAME = "routing";
    public static final String QUEUE_NAME1 = "routing-one";
    public static final String QUEUE_NAME2 = "routing-two";
    @Test
    public void publish() throws IOException, TimeoutException {
        // 1.获取连接
        try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
            // 2.获取通道
            try (Channel channel = connection.createChannel()) {
                // 3.声明交换机
                channel.exchangeDeclare(EXCHANGE_NAME, BuiltinExchangeType.DIRECT);
                // 4.声明队列
                channel.queueDeclare(QUEUE_NAME1, true, false, false, null);
                channel.queueDeclare(QUEUE_NAME2, true, false, false, null);
                // 5.绑定交换机和队列
                channel.queueBind(QUEUE_NAME1, EXCHANGE_NAME, "ORANGE");
                channel.queueBind(QUEUE_NAME2, EXCHANGE_NAME, "BLACK");
                channel.queueBind(QUEUE_NAME2, EXCHANGE_NAME, "GREEN");
                // 6.发送消息
                channel.basicPublish(EXCHANGE_NAME,"ORANGE",null,"大橙子".getBytes(StandardCharsets.UTF_8));
                channel.basicPublish(EXCHANGE_NAME,"BLACK",null,"黑布林".getBytes(StandardCharsets.UTF_8));
                channel.basicPublish(EXCHANGE_NAME,"GREEN",null,"小白兔".getBytes(StandardCharsets.UTF_8));
                System.out.println("发送消息成功");
                System.in.read();
            }
        }
    }
}

4.7 Topic
Topic模式
image.png

生产者:TOPIC类型可以编写带有特殊意义的routingKey的绑定方式

package com.ajie.topic;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.BuiltinExchangeType;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import org.junit.Test;

import java.io.IOException;
import java.nio.charset.StandardCharsets;
import java.util.concurrent.TimeoutException;

public class Publisher {
    public static final String EXCHANGE_NAME = "topic";
    public static final String QUEUE_NAME1 = "topic-one";
    public static final String QUEUE_NAME2 = "topic-two";
    @Test
    public void publish() throws IOException, TimeoutException {
        // 1.获取连接
        try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
            // 2.获取通道
            try (Channel channel = connection.createChannel()) {
                // 3.声明交换机
                channel.exchangeDeclare(EXCHANGE_NAME, BuiltinExchangeType.TOPIC);
                // 4.声明队列
                channel.queueDeclare(QUEUE_NAME1, true, false, false, null);
                channel.queueDeclare(QUEUE_NAME2, true, false, false, null);
                // 5.绑定交换机和队列
                channel.queueBind(QUEUE_NAME1, EXCHANGE_NAME, "*.orange.*");
                channel.queueBind(QUEUE_NAME2, EXCHANGE_NAME, "*.*.rabbit");
                channel.queueBind(QUEUE_NAME2, EXCHANGE_NAME, "lazy.#");
                // 6.发送消息
                channel.basicPublish(EXCHANGE_NAME,"big.orange.rabbit",null,"大橙兔子".getBytes(StandardCharsets.UTF_8));
                channel.basicPublish(EXCHANGE_NAME,"small.white.rabbit",null,"小白兔".getBytes(StandardCharsets.UTF_8));
                channel.basicPublish(EXCHANGE_NAME,"lazy.dog.dog.dog.dog.dog.dog",null,"懒狗狗狗狗狗狗".getBytes(StandardCharsets.UTF_8));
                System.out.println("发送消息成功");
                System.in.read();
            }
        }
    }
}

4.8 RPC(了解)

因为两个服务在交互时,可以尽量做到Client和Server的解耦,通过RabbitMQ进行解耦操作

需要让Client发送消息时,携带两个属性:

  • replyTo告知Server将相应信息放到哪个队列
  • correlationId告知Server发送相应消息时,需要携带位置标示来告知Client响应的信息
RPC方式
image.png

客户端:

package com.ajie.rpc;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.*;
import org.junit.Test;

import java.io.IOException;
import java.util.UUID;

public class Publisher {

    public static final String QUEUE_PUBLISHER = "rpc_publisher";
    public static final String QUEUE_CONSUMER = "rpc_consumer";

    @Test
    public void publish() throws Exception {
        //1. 获取连接对象
        Connection connection = RabbitMQConnectionUtil.getConnection();

        //2. 构建Channel
        Channel channel = connection.createChannel();

        //3. 构建队列
        channel.queueDeclare(QUEUE_PUBLISHER,false,false,false,null);
        channel.queueDeclare(QUEUE_CONSUMER,false,false,false,null);

        //4. 发布消息
        String message = "Hello RPC!";
        String uuid = UUID.randomUUID().toString();
        AMQP.BasicProperties props = new AMQP.BasicProperties()
                .builder()
                .replyTo(QUEUE_CONSUMER)
                .correlationId(uuid)
                .build();
        channel.basicPublish("",QUEUE_PUBLISHER,props,message.getBytes());

        channel.basicConsume(QUEUE_CONSUMER,false,new DefaultConsumer(channel){
            @Override
            public void handleDelivery(String consumerTag, Envelope envelope, AMQP.BasicProperties properties, byte[] body) throws IOException {
                String id = properties.getCorrelationId();
                if(id != null && id.equalsIgnoreCase(uuid)){
                    System.out.println("接收到服务端的响应:" + new String(body,"UTF-8"));
                }
                channel.basicAck(envelope.getDeliveryTag(),false);
            }
        });
        System.out.println("消息发送成功!");

        System.in.read();
    }


}

服务端:

package com.ajie.rpc;

import com.ajie.util.RabbitMQConnectionUtil;
import com.rabbitmq.client.*;
import org.junit.Test;

import java.io.IOException;

/**
 * @author zjw
 * @description
 * @date 2022/1/24 23:02
 */
public class Consumer {

    public static final String QUEUE_PUBLISHER = "rpc_publisher";
    public static final String QUEUE_CONSUMER = "rpc_consumer";

    @Test
    public void consume() throws Exception {
        //1. 获取连接对象
        Connection connection = RabbitMQConnectionUtil.getConnection();

        //2. 构建Channel
        Channel channel = connection.createChannel();

        //3. 构建队列
        channel.queueDeclare(QUEUE_PUBLISHER,false,false,false,null);
        channel.queueDeclare(QUEUE_CONSUMER,false,false,false,null);


        //4. 监听消息
        DefaultConsumer callback = new DefaultConsumer(channel){
            @Override
            public void handleDelivery(String consumerTag, Envelope envelope, AMQP.BasicProperties properties, byte[] body) throws IOException {
                System.out.println("消费者获取到消息:" + new String(body,"UTF-8"));
                String resp = "获取到了client发出的请求,这里是响应的信息";
                String respQueueName = properties.getReplyTo();
                String uuid = properties.getCorrelationId();
                AMQP.BasicProperties props = new AMQP.BasicProperties()
                        .builder()
                        .correlationId(uuid)
                        .build();
                channel.basicPublish("",respQueueName,props,resp.getBytes());
                channel.basicAck(envelope.getDeliveryTag(),false);
            }
        };
        channel.basicConsume(QUEUE_PUBLISHER,false,callback);
        System.out.println("开始监听队列");

        System.in.read();
    }
}

五、SpringBoot操作RabbitMQ


5.1 SpringBoot声明信息
  • 创建项目

  • 导入依赖

    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-amqp</artifactId>
    </dependency>
    
  • 配置RabbitMQ信息

    spring:
      rabbitmq:
        host: ajie103
        port: 5672
        username: ajie
        password: ***********
        virtual-host: /
    
    
  • 声明交换机&队列

    package com.ajie.config;
    
    import org.springframework.amqp.core.*;
    import org.springframework.amqp.rabbit.core.RabbitTemplate;
    import org.springframework.boot.SpringBootConfiguration;
    import org.springframework.context.annotation.Bean;
    
    @SpringBootConfiguration
    public class RabbitMQConfig {
        public static final String EXCHANGE = "boot-exchange";
        public static final String QUEUE = "boot-queue";
        public static final String ROUTING_KEY = "*.black.*";
    
        @Bean
        public Exchange bootExchange() {
            return ExchangeBuilder.topicExchange(EXCHANGE).build();
        }
    
        @Bean
        public Queue bootQueue() {
            return QueueBuilder.durable(QUEUE).build();
        }
    
        @Bean
        public Binding bootBinding(Exchange bootExchange, Queue bootQueue) {
            return BindingBuilder.bind(bootQueue).to(bootExchange).with(ROUTING_KEY).noargs();
        }
    }
    
    
    
5.2 生产者操作
package com.ajie;

import com.ajie.config.RabbitMQConfig;
import org.junit.jupiter.api.Test;
import org.springframework.amqp.AmqpException;
import org.springframework.amqp.core.Message;
import org.springframework.amqp.core.MessagePostProcessor;
import org.springframework.amqp.rabbit.core.RabbitTemplate;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.beans.factory.annotation.Qualifier;
import org.springframework.boot.test.context.SpringBootTest;

import java.io.IOException;
import java.util.Optional;

@SpringBootTest
public class PublisherTest {

    @Autowired
    private RabbitTemplate rabbitTemplate;

    @Test
    public void publish() throws IOException {
        rabbitTemplate.convertAndSend(RabbitMQConfig.EXCHANGE,"big.black.dog","message");
        System.out.println("消息发送成功");
    }

    @Test
    public void publishWithProperties(){
        rabbitTemplate.convertAndSend(RabbitMQConfig.EXCHANGE, "big.black.dog", "messageWithProps",
                new MessagePostProcessor() {
                    @Override
                    public Message postProcessMessage(Message message) throws AmqpException {
                        message.getMessageProperties()
                                .setCorrelationId("123");
                        return message;
                    }
                }
        );
        System.out.println("消息发送成功");
    }
}

5.3 消费者操作
package com.ajie.listener;

import com.ajie.config.RabbitMQConfig;
import com.rabbitmq.client.Channel;
import org.springframework.amqp.core.Message;
import org.springframework.amqp.rabbit.annotation.RabbitListener;
import org.springframework.stereotype.Component;

import java.io.IOException;

@Component
public class ConsumerListener {

    @RabbitListener(queues = RabbitMQConfig.QUEUE)
    public void consume(String msg, Channel channel, Message message) throws IOException {
        System.out.println("队列的消息为:" + msg);
        String correlationId = message.getMessageProperties().getCorrelationId();
        System.out.println("唯一标识:"+correlationId);
        long deliveryTag = message.getMessageProperties().getDeliveryTag();
        channel.basicAck(deliveryTag, false);
    }
}

六、RabbitMQ保证消息可靠性


6.1 保证消息一定送达到Exchange

Confirm机制

可以通过Confirm效果保证消息一定送达到Exchange,官方提供了三种方式,选择了对于效率影响最低的异步回调的效果

// 4.开启confirm
channel.confirmSelect();
// 5.设置confirms的异步回调
channel.addConfirmListener(new ConfirmListener() {
    @Override
    public void handleAck(long deliveryTag, boolean multiple) {
        System.out.println("消息成功的发送到Exchange!");
    }

    @Override
    public void handleNack(long deliveryTag, boolean multiple) {
        System.out.println("消息没有发送到Exchange,尝试重试,或者保存到数据库做其他补偿操作!");
    }
});
6.2 保证消息可以路由到Queue

Return机制

为了保证Exchange上的消息一定可以送达到Queue

// 6.设置Return回调,确认消息是否路由到Queue
channel.addReturnListener(new ReturnListener() {
    @Override
    public void handleReturn(int replyCode, String replyText, String exchange, String routingKey, AMQP.BasicProperties properties, byte[] body) throws IOException {
        System.out.println("消息没有路由到queue");
    }
});
//7. 在发送消息时,将basicPublish方法参数中的mandatory设置为true,即可开启Return机制,当消息没有路由到队列中时,就会执行return回调
6.3 保证Queue可以持久化消息

DeliveryMode设置消息持久化

DeliveryMode设置为2代表持久化,如果设置为1,就代表不会持久化。

//7. 设置消息持久化
AMQP.BasicProperties props = new AMQP.BasicProperties()
    .builder()
    .deliveryMode(2)
    .build();

//7. 发布消息
channel.basicPublish("","confirms",true,props,message.getBytes());
6.4 保证消费者可以正常消费消息

详情看WorkQueue模式

6.5 SpringBoot实现上述操作
6.5.1 Confirm
  • 编写配置文件开启Confirm机制

    spring:
      rabbitmq:
        publisher-confirm-type: correlated  # 新版本
        publisher-confirms: true  # 老版本 
    
  • 在发送消息时,配置RabbitTemplate

    @Test
    public void publishWithConfirms() throws IOException {
        rabbitTemplate.setConfirmCallback(new RabbitTemplate.ConfirmCallback() {
            @Override
            public void confirm(CorrelationData correlationData, boolean ack, String cause) {
                if (ack) {
                    System.out.println("消息已经送达到交换机!!");
                } else {
                    System.out.println("消息没有送达到Exchange,需要做一些补偿操作!!retry!!!");
                }
            }
        });
        rabbitTemplate.convertAndSend(RabbitMQConfig.EXCHANGE, "big.black.dog", "message");
        System.out.println("消息发送成功");
        System.in.read();
    }
    
6.5.2 Return
  • 编写配置文件开启Return机制

    spring:
      rabbitmq:
        publisher-returns: true # 开启Return机制
    
  • 在发送消息时,配置RabbitTemplate

    @Test
    public void publishWithReturn() throws IOException {
        rabbitTemplate.setReturnsCallback(new RabbitTemplate.ReturnsCallback() {
            @Override
            public void returnedMessage(ReturnedMessage returned) {
                String msg = new String(returned.getMessage().getBody());
                System.out.println("消息:" + msg + "路由队列失败!!做补救操作!!");
            }
        });
        rabbitTemplate.convertAndSend(RabbitMQConfig.EXCHANGE, "big.blacks.dog", "message");
        System.out.println("消息发送成功");
        System.in.read();
    }
    
6.5.3 消息持久化
@Test
public void publishWithBasicProperties() throws IOException {

    rabbitTemplate.convertAndSend(RabbitMQConfig.EXCHANGE, "big.black.dog", "message", new MessagePostProcessor() {
        @Override
        public Message postProcessMessage(Message message) throws AmqpException {
            message.getMessageProperties()
                .setDeliveryMode(MessageDeliveryMode.PERSISTENT);
            return message;
        }
    });
    System.out.println("消息发送成功");
    System.in.read();
}

七、RabbitMQ死信队列&延迟交换机

7.1 什么是死信
死信&死信队列
1644476424544.png

死信队列的应用:

  • 基于死信队列在队列消息已满的情况下,消息也不会丢失
  • 实现延迟消费的效果。比如:下订单时,有15分钟的付款时间
7.2 实现死信队列
7.2.1 准备Exchange&Queue
package com.ajie.config;

import org.springframework.amqp.core.*;
import org.springframework.boot.SpringBootConfiguration;
import org.springframework.context.annotation.Bean;

@SpringBootConfiguration
public class DeadLetterConfig {
    public static final String NORMAL_EXCHANGE = "normal-exchange";
    public static final String NORMAL_QUEUE = "normal-queue";
    public static final String NORMAL_ROUTING_KEY = "normal.#";

    public static final String DEAD_EXCHANGE = "dead-exchange";
    public static final String DEAD_QUEUE = "dead-queue";
    public static final String DEAD_ROUTING_KEY = "dead.#";

    @Bean
    public Exchange normalExchange() {
        return ExchangeBuilder.topicExchange(NORMAL_EXCHANGE)
                .build();
    }

    @Bean
    public Queue normalQueue() {
        return QueueBuilder.durable(NORMAL_QUEUE)
                .deadLetterExchange(DEAD_EXCHANGE)
                .deadLetterRoutingKey(DEAD_ROUTING_KEY)
                .build();
    }

    @Bean
    public Binding normalBinding(Exchange normalExchange, Queue normalQueue) {
        return BindingBuilder.bind(normalQueue)
                .to(normalExchange)
                .with(NORMAL_ROUTING_KEY)
                .noargs();
    }

    @Bean
    public Exchange deadExchange() {
        return ExchangeBuilder.topicExchange(DEAD_EXCHANGE).build();
    }

    @Bean
    public Queue deadQueue() {
        return QueueBuilder.durable(DEAD_QUEUE).build();
    }

    @Bean
    public Binding deadBinding(Exchange deadExchange, Queue deadQueue) {
        return BindingBuilder.bind(deadQueue)
                .to(deadExchange)
                .with(DEAD_ROUTING_KEY)
                .noargs();
    }
}
7.2.2 实现效果
  • 基于消费者进行reject或者nack实现死信效果

    package com.ajie.listener;
    
    import com.ajie.config.DeadLetterConfig;
    import com.rabbitmq.client.Channel;
    import org.springframework.amqp.core.Message;
    import org.springframework.amqp.rabbit.annotation.RabbitListener;
    import org.springframework.stereotype.Component;
    
    import java.io.IOException;
    
    @Component
    public class DeadListener {
    
        @RabbitListener(queues = DeadLetterConfig.NORMAL_QUEUE)
        public void consume(String msg, Channel channel, Message message) throws IOException {
            System.out.println("接收到normal队列的消息:" + msg);
            channel.basicReject(message.getMessageProperties().getDeliveryTag(),false);
            channel.basicNack(message.getMessageProperties().getDeliveryTag(), false, false);
        }
    }
    
  • 消息的生存时间

    • 给消息设置生存时间

      @Test
      public void publishWithExpire() {
          String message = "dead-latter-expire!!!";
          rabbitTemplate.convertAndSend(DeadLetterConfig.NORMAL_EXCHANGE, "normal.a.a.a", message.getBytes(StandardCharsets.UTF_8),
                                        new MessagePostProcessor() {
                                            @Override
                                            public Message postProcessMessage(Message message) throws AmqpException {
                                                message.getMessageProperties()
                                                    .setExpiration("5000");
                                                return message;
                                            }
                                        });
      
          System.out.println("消息发送成功!!!");
      }
      
    • 给队列设置消息的生存时间

      @Bean
      public Queue normalQueue() {
          return QueueBuilder.durable(NORMAL_QUEUE)
              .deadLetterExchange(DEAD_EXCHANGE)
              .deadLetterRoutingKey(DEAD_ROUTING_KEY)
              .ttl(10000)
              .build();
      }
      
  • 设置Queue中的消息最大长度

@Bean
public Queue normalQueue() {
    return QueueBuilder.durable(NORMAL_QUEUE)
        .deadLetterExchange(DEAD_EXCHANGE)
        .deadLetterRoutingKey("dead.abc")
        .maxLength(1)
        .build();
}

只要Queue中已经有一个消息,如果再次发送一个消息,这个消息会变为死信!

7.3 延迟交换机

下载地址:https://github.com/rabbitmq/rabbitmq-delayed-message-exchange/releases/tag/3.8.9

死信队列实现延迟消费时,如果延迟时间比较复杂,比较多,直接使用死信队列时,需要创建大量的队列还对应不同的时间,可以采用延迟交换机来解决这个问题。

  • 构建延迟交换机

    package com.ajie.config;
    
    import org.springframework.amqp.core.*;
    import org.springframework.boot.SpringBootConfiguration;
    import org.springframework.context.annotation.Bean;
    
    import java.util.HashMap;
    import java.util.Map;
    
    @SpringBootConfiguration
    public class DelayedConfig {
        public static final String DELAYED_EXCHANGE = "delayed-exchange";
        public static final String DELAYED_QUEUE = "delayed-queue";
        public static final String DELAYED_ROUTING_KEY = "delayed.#";
    
        @Bean
        public Exchange delayedExchange() {
            Map<String, Object> arguments = new HashMap<>();
            arguments.put("x-delayed-type", ExchangeTypes.TOPIC);
            return new CustomExchange(DELAYED_EXCHANGE, "x-delayed-message",
                                      true, false, arguments);
        }
    
        @Bean
        public Queue delayedQueue() {
            return QueueBuilder.durable(DELAYED_QUEUE).build();
        }
    
        @Bean
        public Binding delayedBinding(Exchange delayedExchange, Queue delayedQueue) {
            return BindingBuilder.bind(delayedQueue)
                .to(delayedExchange)
                .with(DELAYED_ROUTING_KEY)
                .noargs();
        }
    }
    
    
  • 发送消息

    package com.ajie;
    
    import com.ajie.config.DelayedConfig;
    import org.junit.jupiter.api.Test;
    import org.springframework.amqp.AmqpException;
    import org.springframework.amqp.core.Message;
    import org.springframework.amqp.core.MessagePostProcessor;
    import org.springframework.amqp.rabbit.core.RabbitTemplate;
    import org.springframework.beans.factory.annotation.Autowired;
    import org.springframework.boot.test.context.SpringBootTest;
    
    @SpringBootTest
    public class DelayedPublisherTest {
    
        @Autowired
        private RabbitTemplate rabbitTemplate;
    
        @Test
        public void publish() {
            String message = "delayed message";
            rabbitTemplate.convertAndSend(DelayedConfig.DELAYED_EXCHANGE, "delayed.abc", message, new MessagePostProcessor() {
                @Override
                public Message postProcessMessage(Message message) throws AmqpException {
                    message.getMessageProperties()
                        .setDelay(30000);
                    return message;
                }
            });
    
            System.out.println("发送消息成功");
        }
    }
    
    

八、RabbitMQ的集群

RabbitMQ的镜像模式

RabbitMQ的集群
1644926959251.png

高可用

提升RabbitMQ的效率

搭建RabbitMQ集群

  • 准备两台虚拟机(克隆)

  • 准备RabbitMQ的yml文件

    rabbitmq1:

    version: '3.5'
    services:
      rabbitmq1:
        image: rabbitmq:3.8.5-management-alpine
        container_name: rabbitmq1
        environment:
          - RABBITMQ_DEFAULT_USER=ajie
          - RABBITMQ_DEFAULT_PASS=***********
          - RABBITMQ_ERLANG_COOKIE=SAGEAGASEGFAG
        hostname: rabbitmq1
        extra_hosts:
          - "rabbitmq1:10.0.0.184"
          - "rabbitmq2:10.0.0.119"
        volumes:
          - ./data/:/var/lib/rabbitmq/
          - ./log/:/var/log/rabbitmq/log/
        ports:
          - 15672:15672
          - 5672:5672
          - 4369:4369
          - 25672:25672
    

    rabbitmq2:

    version: '3.5'
    services:
      rabbitmq2:
        image: rabbitmq:3.8.5-management-alpine
        container_name: rabbitmq2
        environment:
          - RABBITMQ_DEFAULT_USER=ajie
          - RABBITMQ_DEFAULT_PASS=*************
          - RABBITMQ_ERLANG_COOKIE=SAGEAGASEGFAG
        hostname: rabbitmq2
        extra_hosts:
          - "rabbitmq1:10.0.0.184"
          - "rabbitmq2:10.0.0.119"
        volumes:
          - ./data/:/var/lib/rabbitmq/
          - ./log/:/var/log/rabbitmq/log/
        ports:
          - 15672:15672
          - 5672:5672
          - 4369:4369
          - 25672:25672
    

    准备完毕之后,启动两台RabbitMQ

    启动效果
    image-20240511104818484
  • 让RabbitMQ服务实现join操作

    需要四个命令完成join操作

    让rabbitmq2 join rabbitmq1,需要进入到rabbitmq2的容器内部,去执行下述命令

    rabbitmqctl stop_app
    rabbitmqctl reset 
    rabbitmqctl join_cluster rabbit@rabbitmq1
    rabbitmqctl start_app
    

    执行成功后:

    执行后
    image-20240511111059817
  • 设置镜像模式

    在指定的RabbitMQ服务中设置好镜像策略即可

    镜像模式
    image-20240511112516265

九、RabbitMQ其他内容

9.1 Headers类型Exchange

headers就是一个基于key-value的方式,让Exchange和Queue绑定的到一起的一种规则

相比Topic形式,可以采用的类型更丰富。

headers绑定方式
1645705080465.png

具体实现方式

  • 传统api实现

    package com.ajie.headers;
    
    import com.ajie.util.RabbitMQConnectionUtil;
    import com.rabbitmq.client.AMQP;
    import com.rabbitmq.client.BuiltinExchangeType;
    import com.rabbitmq.client.Channel;
    import com.rabbitmq.client.Connection;
    import org.junit.Test;
    
    import java.io.IOException;
    import java.util.HashMap;
    import java.util.Map;
    import java.util.concurrent.TimeoutException;
    
    public class Publisher {
        public static final String header_exchange = "header-exchange";
        public static final String header_queue = "header-queue";
    
        @Test
        public void publish() throws IOException, TimeoutException {
            // 1.获取连接
            try (Connection connection = RabbitMQConnectionUtil.getConnection()) {
                // 2.获取连接通道
                try (Channel channel = connection.createChannel()) {
                    // 3.创建交换机
                    channel.exchangeDeclare(header_exchange, BuiltinExchangeType.HEADERS);
                    // 4.声明队列
                    channel.queueDeclare(header_queue, true, false, false, null);
                    Map<String, Object> args = new HashMap<>();
                    // 多个header的key-value只要可以匹配上一个就可以
                    // args.put("x-match","any");
                    // 多个header的key-value要求全部匹配上
                    args.put("x-match", "any");
                    args.put("name", "zhangsan");
                    args.put("age", "19");
                    // 5.绑定队列和交换机
                    channel.queueBind(header_queue, header_exchange, "", args);
    
                    // 5.发送消息
                    String message = "header 测试消息";
                    Map<String, Object> headers = new HashMap<>();
                    headers.put("name", "zhangsan");
                    headers.put("age", "20");
    
                    AMQP.BasicProperties properties = new AMQP.BasicProperties()
                        .builder()
                        .headers(headers)
                        .build();
                    channel.basicPublish(header_exchange, header_queue, properties, message.getBytes());
                    System.out.println("发送消息成功");
                }
            }
        }
    }
    
    
  • springboot实现

    • 创建交换机队列并进行绑定

      package com.ajie.config;
      
      import org.springframework.amqp.core.*;
      import org.springframework.boot.SpringBootConfiguration;
      import org.springframework.context.annotation.Bean;
      
      import java.util.HashMap;
      import java.util.Map;
      
      @SpringBootConfiguration
      public class HeadersConfig {
          public static final String header_exchange = "header-exchange";
          public static final String header_queue = "header-queue";
      
          @Bean
          public Exchange headerExchange() {
              return ExchangeBuilder.headersExchange(header_exchange).build();
          }
      
          @Bean
          public Queue headerQueue() {
              return QueueBuilder.durable(header_queue).build();
          }
      
          @Bean
          public Binding headerBinding(Exchange headerExchange, Queue headerQueue) {
              Map<String, Object> headers = new HashMap<>();
              headers.put("x-match", "all");
              headers.put("name", "zhangsan");
              headers.put("age", 20);
              return BindingBuilder.bind(headerQueue)
                  .to(headerExchange)
                  .with("")
                  .and(headers);
          }
      }
      
    • 发送消息

      package com.ajie;
      
      import com.ajie.config.HeadersConfig;
      import org.junit.jupiter.api.Test;
      import org.springframework.amqp.AmqpException;
      import org.springframework.amqp.core.Message;
      import org.springframework.amqp.core.MessagePostProcessor;
      import org.springframework.amqp.rabbit.core.RabbitTemplate;
      import org.springframework.beans.factory.annotation.Autowired;
      import org.springframework.boot.test.context.SpringBootTest;
      
      import java.util.HashMap;
      import java.util.Map;
      
      @SpringBootTest
      public class HeadersPublisherTest {
          @Autowired
          private RabbitTemplate rabbitTemplate;
      
          @Test
          public void publish() {
              String message = "headers springboot 测试";
              rabbitTemplate.convertAndSend(HeadersConfig.header_exchange, "", message, new MessagePostProcessor() {
                  @Override
                  public Message postProcessMessage(Message message) throws AmqpException {
                      Map<String, Object> headers = new HashMap<>();
                      headers.put("name", "zhangsan");
                      headers.put("age", 20);
                      message.getMessageProperties()
                          .setHeaders(headers);
                      return message;
                  }
              });
              System.out.println("发送消息成功");
          }
      }
      
      
  • 7
    点赞
  • 15
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值