<netty权威指南>笔记-分隔符解码器处理半包问题

原创 2017年09月05日 19:07:37

概述


以回车换行结尾的消息如何处理半包问题 一文中介绍了如何处理以回车换行的消息的半包问题,如果消息用分隔符来切割的,那么如何处理半包问题呢?可以组合使用

DelimiterBasedFrameDecoder
StringDecoder

来处理半包问题。


netty分隔符解码器


服务端代码

package nettyguide.encode.delimiter.server;

import io.netty.bootstrap.ServerBootstrap;
import io.netty.channel.ChannelFuture;
import io.netty.channel.EventLoopGroup;
import io.netty.channel.nio.NioEventLoopGroup;
import io.netty.channel.socket.nio.NioServerSocketChannel;
import io.netty.handler.logging.LogLevel;
import io.netty.handler.logging.LoggingHandler;

public class SocketServer {
    public static void main(String[] args) throws InterruptedException {
        EventLoopGroup parentGroup = new NioEventLoopGroup();
        EventLoopGroup childGroup = new NioEventLoopGroup();

        try {
            ServerBootstrap serverBootstrap = new ServerBootstrap();
            serverBootstrap.group(parentGroup, childGroup)
                    .channel(NioServerSocketChannel.class)
                    .handler(new LoggingHandler(LogLevel.INFO))
                    .childHandler(new SocketServerInitializer());

            ChannelFuture channelFuture = serverBootstrap.bind(8899).sync();
            channelFuture.channel().closeFuture().sync();
        }
        finally {
            parentGroup.shutdownGracefully();
            childGroup.shutdownGracefully();
        }
    }
}

package nettyguide.encode.delimiter.server;

import io.netty.buffer.ByteBuf;
import io.netty.buffer.Unpooled;
import io.netty.channel.ChannelInitializer;
import io.netty.channel.ChannelPipeline;
import io.netty.channel.socket.SocketChannel;
import io.netty.handler.codec.DelimiterBasedFrameDecoder;
import io.netty.handler.codec.string.StringDecoder;


public class SocketServerInitializer extends ChannelInitializer<SocketChannel> {
    @Override
    protected void initChannel(SocketChannel ch) throws Exception {
        // 告诉DelimiterBasedFrameDecoder以$_作为分隔符
        ByteBuf delimiter = Unpooled.copiedBuffer("$_".getBytes());
        ChannelPipeline pipeline = ch.pipeline();
        //这里的1024,表示单条消息的最大长度,当达到长度后,还没有找到分隔符,则抛出TooLongFrameException
        pipeline.addLast(new DelimiterBasedFrameDecoder(1024,delimiter));
        pipeline.addLast(new StringDecoder());
        pipeline.addLast(new SocketServerHandler());
    }
}

package nettyguide.encode.delimiter.server;

import io.netty.buffer.ByteBuf;
import io.netty.buffer.Unpooled;
import io.netty.channel.ChannelHandlerContext;
import io.netty.channel.ChannelInboundHandlerAdapter;

public class SocketServerHandler extends ChannelInboundHandlerAdapter {
    private int counter;

    @Override
    public void channelRead(ChannelHandlerContext ctx, Object msg) throws Exception {
        //打印客户端发送的数据
        String body = (String)msg;
        System.out.println("This is " + ++counter + " times receive from client:"+body+"");
        body = body + "$_";
        ByteBuf byteBuf = Unpooled.copiedBuffer(body.getBytes());
        ctx.writeAndFlush(byteBuf);
    }
}

客户端代码

package nettyguide.encode.delimiter.client;

import io.netty.bootstrap.Bootstrap;
import io.netty.channel.ChannelFuture;
import io.netty.channel.EventLoopGroup;
import io.netty.channel.nio.NioEventLoopGroup;
import io.netty.channel.socket.nio.NioSocketChannel;
import io.netty.handler.logging.LogLevel;
import io.netty.handler.logging.LoggingHandler;

public class SocketClient {
    public static void main(String[] args) throws InterruptedException {
        EventLoopGroup eventLoopGroup = new NioEventLoopGroup();

        try {
            Bootstrap bootstrap = new Bootstrap();
            bootstrap.group(eventLoopGroup)
                    .channel(NioSocketChannel.class)
                    .handler(new LoggingHandler(LogLevel.INFO))
                    .handler(new SocketClientInitializer());

            ChannelFuture channelFuture = bootstrap.connect("localhost", 8899).sync();
            channelFuture.channel().closeFuture().sync();
        }
        finally {
            eventLoopGroup.shutdownGracefully();
        }
    }
}

package nettyguide.encode.delimiter.client;

import io.netty.buffer.ByteBuf;
import io.netty.buffer.Unpooled;
import io.netty.channel.ChannelInitializer;
import io.netty.channel.ChannelPipeline;
import io.netty.channel.socket.SocketChannel;
import io.netty.handler.codec.DelimiterBasedFrameDecoder;
import io.netty.handler.codec.string.StringDecoder;

public class SocketClientInitializer extends ChannelInitializer<SocketChannel> {
    @Override
    protected void initChannel(SocketChannel ch) throws Exception {
        ByteBuf delimiter = Unpooled.copiedBuffer("$_".getBytes());
        ChannelPipeline pipeline = ch.pipeline();
        //这里的1024,表示单条消息的最大长度,当达到长度后,还没有找到分隔符,则抛出TooLongFrameException
        pipeline.addLast(new DelimiterBasedFrameDecoder(1024,delimiter));
        pipeline.addLast(new StringDecoder());
        pipeline.addLast(new SocketClientHandler());
    }
}

package nettyguide.encode.delimiter.client;

import io.netty.buffer.Unpooled;
import io.netty.channel.ChannelHandlerContext;
import io.netty.channel.ChannelInboundHandlerAdapter;

public class SocketClientHandler extends ChannelInboundHandlerAdapter {
    private int counter;
    private static String req = "Hi Sam.Welcome to Netty home.$_";
    @Override
    public void channelRead(ChannelHandlerContext ctx, Object msg) throws Exception {
        String body = (String)msg;
        System.out.println("This is " + ++counter + " times receive from server:"+body+"");
    }

    @Override
    public void channelActive(ChannelHandlerContext ctx) throws Exception {
        for (int i = 0; i < 10; i++) {
            ctx.writeAndFlush(Unpooled.copiedBuffer(req.getBytes()));
        }
    }
 }

运行服务端和客户端代码,服务端打印的信息如下

This is 1 times receive from client:Hi Sam.Welcome to Netty home.
This is 2 times receive from client:Hi Sam.Welcome to Netty home.
This is 3 times receive from client:Hi Sam.Welcome to Netty home.
This is 4 times receive from client:Hi Sam.Welcome to Netty home.
This is 5 times receive from client:Hi Sam.Welcome to Netty home.
This is 6 times receive from client:Hi Sam.Welcome to Netty home.
This is 7 times receive from client:Hi Sam.Welcome to Netty home.
This is 8 times receive from client:Hi Sam.Welcome to Netty home.
This is 9 times receive from client:Hi Sam.Welcome to Netty home.
This is 10 times receive from client:Hi Sam.Welcome to Netty home.

客户端打印的信息如下

This is 1 times receive from server:Hi Sam.Welcome to Netty home.
This is 2 times receive from server:Hi Sam.Welcome to Netty home.
This is 3 times receive from server:Hi Sam.Welcome to Netty home.
This is 4 times receive from server:Hi Sam.Welcome to Netty home.
This is 5 times receive from server:Hi Sam.Welcome to Netty home.
This is 6 times receive from server:Hi Sam.Welcome to Netty home.
This is 7 times receive from server:Hi Sam.Welcome to Netty home.
This is 8 times receive from server:Hi Sam.Welcome to Netty home.
This is 9 times receive from server:Hi Sam.Welcome to Netty home.
This is 10 times receive from server:Hi Sam.Welcome to Netty home.

结果很正常,客户端发送10次,服务端接收到信息后,也往客户端发送了10次请求。半包问题得到解决了。

现在来做个试验,如果把客户端代码中SocketClientInitializer类中的

pipeline.addLast(new DelimiterBasedFrameDecoder(1024,delimiter));

注释掉,会发生什么事情呢?

注释掉后运行服务端代码和客户端代码,服务端打印信息如下

This is 1 times receive from client:Hi Sam.Welcome to Netty home.
This is 2 times receive from client:Hi Sam.Welcome to Netty home.
This is 3 times receive from client:Hi Sam.Welcome to Netty home.
This is 4 times receive from client:Hi Sam.Welcome to Netty home.
This is 5 times receive from client:Hi Sam.Welcome to Netty home.
This is 6 times receive from client:Hi Sam.Welcome to Netty home.
This is 7 times receive from client:Hi Sam.Welcome to Netty home.
This is 8 times receive from client:Hi Sam.Welcome to Netty home.
This is 9 times receive from client:Hi Sam.Welcome to Netty home.
This is 10 times receive from client:Hi Sam.Welcome to Netty home.

也是10次,跟我们的预期一样,但是客户端却发生了粘包。客户端打印信息如下

This is 1 times receive from server:Hi Sam.Welcome to Netty home.$_
This is 2 times receive from server:Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_
This is 3 times receive from server:Hi Sam.Welcome to Netty home.$_
This is 4 times receive from server:Hi Sam.Welcome to Netty home.$_
This is 5 times receive from server:Hi Sam.Welcome to Netty home.$_
This is 6 times receive from server:Hi Sam.Welcome to Netty home.$_
This is 7 times receive from server:Hi Sam.Welcome to Netty home.$_

总共才发送了7次请求给服务端,部分数据在客户端发生了粘包。但是由于服务端仍然使用了

pipeline.addLast(new DelimiterBasedFrameDecoder(1024,delimiter));

所有服务端是能够正确解析的。仍然是打印10次。

如果是把服务端类中的SocketServerInitializer中的

pipeline.addLast(new DelimiterBasedFrameDecoder(1024,delimiter));

注释掉。但是客户端中的保留。又会是什么效果呢?继续运行代码看效果。

服务端打印如下

This is 1 times receive from client:Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_Hi Sam.Welcome to Netty home.$_

客户端打印如下

This is 1 times receive from server:Hi Sam.Welcome to Netty home.
This is 2 times receive from server:Hi Sam.Welcome to Netty home.
This is 3 times receive from server:Hi Sam.Welcome to Netty home.
This is 4 times receive from server:Hi Sam.Welcome to Netty home.
This is 5 times receive from server:Hi Sam.Welcome to Netty home.
This is 6 times receive from server:Hi Sam.Welcome to Netty home.
This is 7 times receive from server:Hi Sam.Welcome to Netty home.
This is 8 times receive from server:Hi Sam.Welcome to Netty home.
This is 9 times receive from server:Hi Sam.Welcome to Netty home.
This is 10 times receive from server:Hi Sam.Welcome to Netty home.

这次服务端解析出现问题了,把客户端的所有信息一次性解析出来,这是我们不希望发生的。而客户端这边在发送信息的时候,是正常的。

如果消息是有分隔符的,服务端开发的程序和客户端开发的程序,在处理这些消息时,记得使用

DelimiterBasedFrameDecoder

解码器。


csdn code 路径


这个项目的源代码放置在csdn code上,欢迎访问。
netty_study

版权声明:本文为博主原创文章,未经博主允许不得转载。

相关文章推荐

怎么在CSDN博客文章中添加公式

问题 最近在写博客的过程中需要在文章中编辑公式,很多文章直接贴图,很不专业也很不美观,同时影响阅读。试了一些方法,先分享一下。 方法一、借助Mathtype    首先打开Mathtype,然后点...

Apache Kafka:下一代分布式消息系统

作者 Abhishek Sharma ,译者 梅雪松 原文地址:http://www.infoq.com/cn/articles/apache-kafka 简介Apache Kafka是分布式发...

Netty权威指南 第2版学习笔记4——TCP粘包/拆包问题的解决之道

TCP粘包/拆包假设客户端分别发送了两个数据包D1 和D2给服务商厦 ,由于服务端一次读取到的字节数是不确定的,故可能存在4种情况: 服务端分两次读取到了两个独立的数据包,分别是D1 和 D2,没有粘...
  • xundh
  • xundh
  • 2017年01月02日 11:41
  • 386

netty分隔符和定长解码器的应用

  • 2016年07月21日 06:23
  • 13.8MB
  • 下载

Netty权威指南 第2版学习笔记9——Channel,Unsafe和 AttributeMap

Channel功能说明io.netty.channel.Channel是Netty网络操抽象类,它聚合了一组功能,包括但不限于网络的读、写,客户端发起连接,主动关闭连接,链路关闭,获取通信双方的网络地...
  • xundh
  • xundh
  • 2017年03月06日 10:54
  • 236

Netty权威指南 第2版学习笔记11——实现WebSocket

WebSocket 入门WebSocket是HTML5开始提供的一种浏览器与服务间进行全双工通信的网络技术,WebSocket通信协议于2011年被IETF定为标准RFC6455,WebSocket ...
  • xundh
  • xundh
  • 2017年03月12日 16:41
  • 349

Netty权威指南 第2版学习笔记2——NIO入门

传统的BIO编程网络编程的基本模型是Client/Server模型,通过三次扬建立连接,如果连接建立成功,双方就可以通过网络套接字进行通信。BIO通信模型图采用BIO通信模型的服务端,通常由一个独立的...
  • xundh
  • xundh
  • 2017年01月01日 00:34
  • 371

Netty权威指南 第2版学习笔记1——Java的I/O演进之路

I/O基础入门Java1.4之前对I/O的支持并不完善。开发人员在开发高性能I/O程序的时候,会面临一些巨大的挑战和困难,主要问题: 没有数据缓冲区,I/O性能存在问题 没有C/C++的Channel...
  • xundh
  • xundh
  • 2016年12月31日 23:36
  • 278

Netty (四) 分隔符和定长解码器的使用

TCP以流的形式进行数据传输,上层的应用协议为了对消息进行划分,往往采用如下的4种方式。 (1)消息长度固定,累计读到长度总和为定长len的报文后,就认为读取到了一个完整的消息;然后重新开始读取下一...

Netty的分隔符和定长解码器应用

TCP以流的方式进行数据传输,上层的应用协议为了对消息进行分区,往往采用下面4种方式:     (1)消息长度固定,累计读取到长度总和为定长LEN的报文后,就以为读取到了一个完整的消息;将计数器置位...
内容举报
返回顶部
收藏助手
不良信息举报
您举报文章:<netty权威指南>笔记-分隔符解码器处理半包问题
举报原因:
原因补充:

(最多只允许输入30个字)