借鉴:https://blog.csdn.net/canot/article/details/51938955
1.什么是pub/sub
Pub/Sub功能(means Publish, Subscribe)即发布及订阅功能。基于事件的系统中,Pub/Sub是目前广泛使用的通信模型,它采用事件作为基本的通信机制,提供大规模系统所要求的松散耦合的交互模式:订阅者(如客户端)以事件订阅的方式表达出它有兴趣接收的一个事件或一类事件;发布者(如服务器)可将订阅者感兴趣的事件随时通知相关订阅者。熟悉设计模式的朋友应该了解这与23种设计模式中的观察者模式极为相似。
同样,Redis的pub/sub是一种消息通信模式,主要的目的是解除消息发布者和消息订阅者之间的耦合,Redis作为一个pub/sub的server,在订阅者和发布者之间起到了消息路由的功能。
2.Redis pub/sub的实现
Redis通过publish和subscribe命令实现订阅和发布的功能。订阅者可以通过subscribe向redis server订阅自己感兴趣的消息类型。redis将信息类型称为通道(channel)。当发布者通过publish命令向redis server发送特定类型的信息时,订阅该消息类型的全部订阅者都会收到此消息。
客户端1订阅CCTV1:
127.0.0.1:6379> subscribe CCTV1
Reading messages... (press Ctrl-C to quit)
1) "subscribe"
2) "CCTV1"
3) (integer) 1
客户端2订阅CCTV1和CCTV2:
127.0.0.1:6379> subscribe CCTV1 CCTV2
Reading messages... (press Ctrl-C to quit)
1) "subscribe"
2) "CCTV1"
3) (integer) 1
1) "subscribe"
2) "CCTV2"
3) (integer) 2
此时这两个客户端分别监听这指定的频道。现在另一个客户端向服务器推送了关于这两个频道的信息。
127.0.0.1:6379> publish CCTV1 "cctv1 is good"
(integer) 2
//返回2表示两个客户端接收了次消息。被接收到消息的客户端如下所示。
1) "message"
2) "CCTV1"
3) "cctv1 is good"
----
1) "message"
2) "CCTV1"
3) "cctv1 is good"
如上的订阅/发布也称订阅发布到频道(使用publish与subscribe命令),此外还有订阅发布到模式(使用psubscribe来订阅一个模式)
订阅CCTV的全部频道
127.0.0.1:6379> psubscribe CCTV*
Reading messages... (press Ctrl-C to quit)
1) "psubscribe"
2) "CCTV*"
3) (integer) 1
当依然先如上推送一个CCTV1的消息时,该客户端正常接收。
3.Pub/Sub在java中的实现
导入Redis驱动:
redis.clients
jedis
2.9.0
Redis驱动包提供了一个抽象类:JedisPubSub…继承这个类就完成了对客户端对订阅的监听。示例代码:
/*** redis发布订阅消息监听器
* @ClassName: RedisMsgPubSubListener
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月22日 上午10:05:35
**/
public class RedisMsgPubSubListener extendsJedisPubSub {private Logger logger = LoggerFactory.getLogger(RedisMsgPubSubListener.class);
@Overridepublic voidunsubscribe() {super.unsubscribe();
}
@Overridepublic voidunsubscribe(String... channels) {super.unsubscribe(channels);
}
@Overridepublic voidsubscribe(String... channels) {super.subscribe(channels);
}
@Overridepublic voidpsubscribe(String... patterns) {super.psubscribe(patterns);
}
@Overridepublic voidpunsubscribe() {super.punsubscribe();
}
@Overridepublic voidpunsubscribe(String... patterns) {super.punsubscribe(patterns);
}
@Overridepublic voidonMessage(String channel, String message) {
logger.info("onMessage: channel[{}], message[{}]",channel, message);
}
@Overridepublic voidonPMessage(String pattern, String channel, String message) {
logger.info("onPMessage: pattern[{}], channel[{}], message[{}]", pattern, channel, message);
}
@Overridepublic void onSubscribe(String channel, intsubscribedChannels) {
logger.info("onSubscribe: channel[{}], subscribedChannels[{}]", channel, subscribedChannels);
}
@Overridepublic void onPUnsubscribe(String pattern, intsubscribedChannels) {
logger.info("onPUnsubscribe: pattern[{}], subscribedChannels[{}]", pattern, subscribedChannels);
}
@Overridepublic void onPSubscribe(String pattern, intsubscribedChannels) {
logger.info("onPSubscribe: pattern[{}], subscribedChannels[{}]", pattern, subscribedChannels);
}
@Overridepublic void onUnsubscribe(String channel, intsubscribedChannels) {
logger.info("channel:{} is been subscribed:{}", channel, subscribedChannels);
}
}
如上所示,抽象类中存在的方法。分别表示
监听到订阅模式接受到消息时的回调 (onPMessage)
监听到订阅频道接受到消息时的回调 (onMessage )
订阅频道时的回调( onSubscribe )
取消订阅频道时的回调( onUnsubscribe )
订阅频道模式时的回调 ( onPSubscribe )
取消订阅模式时的回调( onPUnsubscribe )
运行我们刚刚编写的类:
订阅者
/*** 订阅者
* @ClassName: RedisSubTest
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月23日 下午2:59:42
**/
public classRedisSubTest {
@Testpublic voidsubjava() {
System.out.println("订阅者 ");
Jedis jr= null;try{
jr= new Jedis("127.0.0.1", 6379, 0);//redis服务地址和端口号
RedisMsgPubSubListener sp = newRedisMsgPubSubListener();//jr客户端配置监听两个channel
jr.subscribe(sp, "news.share", "news.blog");
}catch(Exception e) {
e.printStackTrace();
}finally{if (jr != null) {
jr.disconnect();
}
}
}
}
发布者
/*** 发布者
* @ClassName: RedisPubTest
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月23日 下午2:59:25
**/
public classRedisPubTest {
@Testpublic voidpubjava() {
System.out.println("发布者 ");
Jedis jr= null;try{
jr= new Jedis("127.0.0.1", 6379, 0);//redis服务地址和端口号//jr客户端配置监听两个channel
jr.publish( "news.share", "新闻分享");
jr.publish("news.blog", "新闻博客");
}catch(Exception e) {
e.printStackTrace();
}finally{if (jr != null) {
jr.disconnect();
}
}
}
}
从代码中我们不难看出,我们声明的一个redis链接在设置监听后就可以执行一些操作,例如发布消息,订阅消息等。。。
当运行上述代码后会在控制台输出:
此时当在有客户端向new.share或者new.blog通道publish消息时,onMessage方法即可被相应。(jedis.publish(channel, message))。
4.Pub/Sub在Spring中的实践
导入依赖jar
redis.clients
jedis
2.9.0
org.springframework.data
spring-data-redis
2.0.8.RELEASE
核心消息监听器
/*** redis发布订阅消息监听器
* @ClassName: RedisMsgPubSubListener
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月22日 上午10:05:35
**/
public class RedisMsgPubSubListener implementsMessageListener {private Logger logger = LoggerFactory.getLogger(RedisMsgPubSubListener.class);
@Overridepublic void onMessage( final Message message, final byte[] pattern ) {
RedisSerializer> serializer =redisTemplate.getValueSerializer();//message.getBody()是Redis的值,需要用redis的valueSerializer反序列化
logger.info("Message receive-->pattern:{},message: {},{}", newString(pattern),
serializer.deserialize(message.getBody()),
redisTemplate.getStringSerializer().deserialize(message.getChannel()));
logger.info(message.toString());
JSONObject json=JSONObject.parseObject(serializer.deserialize(message.getBody()).toString());
String cutomerId= json.getString("cutomerId");//可以与WebSocket结合使用,解决分布式服务中,共享Session
if(StringUtils.isNotEmpty(cutomerId)) {
logger.info("cutomerId: {},消息:{}", cutomerId, message.toString());
}else{
logger.info("cutomerId 为空,无法推送给对应的客户端,消息:{}", message.toString());
}
}
}
现在我们在获取RedisTemplate,并给WEB_SOCKET:LOTTERY这个channel publish数据。
/*** 发布者
* @ClassName: RedisMsgPubClient
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月23日 下午3:59:33
**/@Controller
@RequestMapping(value="/redisMsgPubClientBySpring")public classRedisMsgPubClient {private Logger logger = LoggerFactory.getLogger(RedisMsgPubClient.class);
@Autowiredprivate RedisTemplateredisTemplate;
@RequestMapping
@ResponseBodypublicString pubMsg(HttpServletRequest request, HttpServletResponse response) {
String cutomerId= request.getParameter("cutomerId").toString();
String msg= request.getParameter("msg").toString();
logger.info("发布消息:{}", request.getParameter("msg").toString());
JSONObject json= newJSONObject();
json.put("cutomerId", cutomerId);
json.put("msg", msg);
redisTemplate.convertAndSend("WEB_SOCKET:LOTTERY", json);return "成功";
}
}
最后一步reids的配置
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/context
http://www.springframework.org/schema/context/spring-context.xsd
http://www.springframework.org/schema/aop
http://www.springframework.org/schema/aop/spring-aop.xsd
http://www.springframework.org/schema/tx
http://www.springframework.org/schema/tx/spring-tx.xsd
http://www.springframework.org/schema/mvc
http://www.springframework.org/schema/mvc/spring-mvc.xsd
http://www.springframework.org/schema/cache
http://www.springframework.org/schema/cache/spring-cache.xsd"default-autowire="byName">
redis 相关类 Spring 托管
如上的配置即配置了对Redis的链接。在配置类中的将ChannelTopic加入IOC容器。则在Spring启动时会在一个RedisTemplate(一个对Redis的链接)中设置的一个channel,即WEB_SOCKET:LOTTERY。
在上述配置中,RedisMsgPubSubListener是我们生成的,这个类即为核心监听类,RedisTemplate接受到数据如何处理就是在该类中处理的。
附加上Java配置
importjava.lang.reflect.Method;importjava.util.ArrayList;importjava.util.List;importorg.springframework.cache.CacheManager;importorg.springframework.cache.annotation.CachingConfigurerSupport;importorg.springframework.cache.annotation.EnableCaching;importorg.springframework.cache.interceptor.KeyGenerator;importorg.springframework.context.annotation.Bean;importorg.springframework.context.annotation.Configuration;importorg.springframework.data.redis.cache.RedisCacheManager;importorg.springframework.data.redis.connection.MessageListener;importorg.springframework.data.redis.connection.RedisConnectionFactory;importorg.springframework.data.redis.core.RedisTemplate;importorg.springframework.data.redis.core.StringRedisTemplate;importorg.springframework.data.redis.listener.ChannelTopic;importorg.springframework.data.redis.listener.RedisMessageListenerContainer;importorg.springframework.data.redis.listener.Topic;importorg.springframework.data.redis.listener.adapter.MessageListenerAdapter;importorg.springframework.data.redis.serializer.Jackson2JsonRedisSerializer;importorg.springframework.data.redis.serializer.StringRedisSerializer;importcom.fasterxml.jackson.annotation.JsonAutoDetect;importcom.fasterxml.jackson.annotation.PropertyAccessor;importcom.fasterxml.jackson.databind.ObjectMapper;importcom.gfss.common.listener.CustomRedisMsgPubSubListener;
@Configuration
@EnableCachingpublic class RedisConfiguration extendsCachingConfigurerSupport {
@Override
@BeanpublicKeyGenerator keyGenerator() {return newKeyGenerator() {
@OverridepublicObject generate(Object target, Method method, Object... params) {
StringBuilder sb= newStringBuilder();
sb.append(target.getClass().getName());
sb.append(method.getName());for(Object obj : params) {
sb.append(obj.toString());
}returnsb.toString();
}
};
}
@Beanpublic CacheManager cacheManager(RedisTemplate, ?>redisTemplate) {return newRedisCacheManager(redisTemplate);
}
@Beanpublic RedisTemplateredisTemplate(RedisConnectionFactory factory) {
StringRedisTemplate template= newStringRedisTemplate(factory);
Jackson2JsonRedisSerializer jackson2JsonRedisSerializer = new Jackson2JsonRedisSerializer(
Object.class);
ObjectMapper om= newObjectMapper();
om.setVisibility(PropertyAccessor.ALL, JsonAutoDetect.Visibility.ANY);
om.enableDefaultTyping(ObjectMapper.DefaultTyping.NON_FINAL);
jackson2JsonRedisSerializer.setObjectMapper(om);
template.setValueSerializer(jackson2JsonRedisSerializer);
template.afterPropertiesSet();returntemplate;
}
@Beanpublic RedisTemplateobjectRedisTemplate(RedisConnectionFactory factory) {
RedisTemplate template = new RedisTemplate();
template.setConnectionFactory(factory);
template.setKeySerializer(newStringRedisSerializer());returntemplate;
}/************** 配置redis发布订阅模式 *******************************/@BeanpublicCustomRedisMsgPubSubListener customRedisMsgPubSubListener() {return newCustomRedisMsgPubSubListener();
}
@BeanpublicMessageListenerAdapter messageListenerAdapter(MessageListener messageListener) {return newMessageListenerAdapter(messageListener);
}
@BeanpublicRedisMessageListenerContainer redisMessageListenerContainer(RedisConnectionFactory redisConnectionFactory,
MessageListenerAdapter messageListenerAdapter) {
List collection = new ArrayList();//普通订阅,订阅具体的频道
ChannelTopic channelTopic = new ChannelTopic("WEB_SOCKET:LOTTERY");
collection.add(channelTopic);/*// 模式订阅,支持模式匹配订阅,*为模糊匹配符
PatternTopic PatternTopic = new PatternTopic("WEB_SOCKET:*");
collection.add(PatternTopic);
// 匹配所有频道
PatternTopic PatternTopicAll = new PatternTopic("*");
collection.add(PatternTopicAll);*/RedisMessageListenerContainer redisMessageListenerContainer= newRedisMessageListenerContainer();
redisMessageListenerContainer.setConnectionFactory(redisConnectionFactory);
redisMessageListenerContainer.addMessageListener(messageListenerAdapter, collection);returnredisMessageListenerContainer;
}
}
访问页面去调用发布者
http://localhost:8088/redis/redisMsgPubClientBySpring?cutomerId=all&msg=你们好
订阅收到的消息
5.拓展开发
在分布式服务中,可以结合WebSocket与Redis的发布订阅模式相结合,解决session不能共享的问题。
当业务处理完成之后,通过Redis的发布订阅模式,发布消息到每个订阅该频道的服务节点,然后由每个服务节点通过key寻找自己内存缓存中的session,然后找到了就向客户端推消息,否则不处理。
Dubbo只能传输可序列化的对象,Redis只能缓存可序列化的对象,Dubbo基于网络流(TCP),Redis缓存的数据要存储在硬盘上,而WebSocketSession是没有实现序列化的,所以不能跨服务传递WebSocketSession,也不能使用Redis存储WebSocketSession,只能自定义一块缓存区。
6.动态订阅频道
importorg.slf4j.Logger;importorg.slf4j.LoggerFactory;importorg.springframework.beans.factory.annotation.Autowired;importorg.springframework.context.ApplicationContext;importorg.springframework.data.redis.connection.Message;importorg.springframework.data.redis.connection.MessageListener;importorg.springframework.data.redis.core.RedisTemplate;importorg.springframework.data.redis.listener.ChannelTopic;importorg.springframework.data.redis.listener.PatternTopic;importorg.springframework.data.redis.listener.RedisMessageListenerContainer;importorg.springframework.data.redis.listener.adapter.MessageListenerAdapter;importorg.springframework.data.redis.serializer.RedisSerializer;importcom.alibaba.fastjson.JSONObject;importcom.gfss.common.websocket.CustomWebSocketHandler;/*** redis发布订阅消息监听器
* @ClassName: RedisMsgPubSubListener
* @Description: TODO
*@authorOnlyMate
* @Date 2018年8月22日 上午10:05:35
**/
public class CustomRedisMsgPubSubListener implementsMessageListener {private Logger logger = LoggerFactory.getLogger(CustomRedisMsgPubSubListener.class);
@AutowiredprivateCustomWebSocketHandler customWebSocketHandler;
@AutowiredprivateApplicationContext applicationContext;
@Autowiredprivate RedisTemplateredisTemplate;/*** 实例:
* JSONObject json = new JSONObject();
* json.put("cutomerId", notifyResult.getResult());
* json.put("resultCode", map.get("resultCode"));
* //向redis发布消息
* redisTemplate.convertAndSend(channelName, json);
*@parammessage
*@parampattern
* @Throws
* @Author: chetao
* @Date: 2019年1月8日 下午10:40:21
*@seeorg.springframework.data.redis.connection.MessageListener#onMessage(org.springframework.data.redis.connection.Message, byte[])*/@Overridepublic void onMessage( final Message message, final byte[] pattern ) {
RedisSerializer> serializer =redisTemplate.getKeySerializer();
logger.info("Message receive-->pattern:{},message: {},{}", serializer.deserialize(pattern),
serializer.deserialize(message.getBody()), serializer.deserialize(message.getChannel()));if ("WEB_SOCKET:PAY_NOTIFY".equals(serializer.deserialize(message.getChannel()))) {
RedisMessageListenerContainer redisMessageListenerContainer=applicationContext
.getBean("redisMessageListenerContainer", RedisMessageListenerContainer.class);
MessageListenerAdapter messageListenerAdapter= applicationContext.getBean("messageListenerAdapter",
MessageListenerAdapter.class);/*List collection = new ArrayList();
// 动态添加订阅主题
ChannelTopic channelTopic = new ChannelTopic("WEB_SOCKET1:PAY_NOTIFY");
collection.add(channelTopic);
PatternTopic PatternTopic = new PatternTopic("WEB_SOCKET:*");
collection.add(PatternTopic);
redisMessageListenerContainer.addMessageListener(messageListenerAdapter, collection);*/
//动态添加订阅主题
ChannelTopic channelTopic = new ChannelTopic("WEB_SOCKET1:PAY_NOTIFY");
redisMessageListenerContainer.addMessageListener(messageListenerAdapter, channelTopic);
PatternTopic PatternTopic= new PatternTopic("WEB_SOCKET:*");
redisMessageListenerContainer.addMessageListener(messageListenerAdapter, PatternTopic);
}
JSONObject json=JSONObject.parseObject(message.toString());
customWebSocketHandler.sendMessage(json.toJSONString());
}
}
上面两种动态订阅频道的方式都可以,本人已测试是可行的,可以结合自己的业务去拓展,如:临时订阅频道后退订频道