java.net.SocketException: No buffer space available (maximum connections reached?): connect

需求:类似于消息推送,在一定时间段内将固定数据发送给用户(用户量很大,抛开技术实现方面问题,只分析异常)

1.异常

[2020-10-28 17:44:03] [INFO] [com.eebbk.onlinelesson.common.util.HttpUtil] [284] - No buffer space available (maximum connections reached?): connect
java.net.SocketException: No buffer space available (maximum connections reached?): connect
	at java.net.DualStackPlainSocketImpl.connect0(Native Method)
	at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:79)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:835)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at com.eebbk.onlinelesson.common.util.HttpUtil.doHttpGet(HttpUtil.java:264)
	at com.eebbk.onlinelesson.common.util.PushMsgUtil.pushMsgWithMachineId(PushMsgUtil.java:127)
	at com.eebbk.onlinelesson.Call.PushCall.call(PushCall.java:44)
	at com.eebbk.onlinelesson.Call.PushCall.call(PushCall.java:21)
	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
	at java.util.concurrent.FutureTask.run(FutureTask.java)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	

 

 

2.异常原因:是因为机器端口号用尽导致tcp无法申请新的端口去建立连接

代码

ExecutorService pool = new ThreadPoolExecutor(20, 20,0L, TimeUnit.MILLISECONDS,
                new LinkedBlockingQueue<Runnable>());
        try {
            List<String> list=  liveTelecastService.getStatisticsByActivityKey(coursePackageId+"");
          
            list=new ArrayList<>();
            for (int i = 0; i <50000 ; i++) {
                list.add("700S520072701");
            }
            int pushSuccess=0;
            Message message  = new Message();         

            //初始化计数器大小
            CountDownLatch latch=new CountDownLatch(list.size());
            List< Future<Boolean>> futureList=new ArrayList<>();
            for (String machineId:list) {
                PushCall pushCall = new PushCall(message,machineId,latch);
                Future<Boolean>  future=  pool.submit(pushCall);
                futureList.add(future);
            }
            //等待所有线程执行完成
            latch.await();
            for (Future<Boolean> future:futureList) {
                if(future.get()){
                    pushSuccess++;
                }
            }

 

五万条数据,创建20个线程去请求接口获取数据,根据异常情况,查看代码,频繁new httpclient,每次都要重新建立tcp连接,完成3次握手和4次挥手。

2.修改为http连接池


@Slf4j
public class HttpClientUtils {

    //  客户端从服务端读取数据的超时时间

    private static final int HTTP_TIMEOUT = 2000;
    //  客户端与服务器建立连接的超时时间

    private static final int HTTP_CON_TIMEOUT = 200;

    //  客户端从连接池中获取连接的超时时间

    private static final int HTTP_CON_REQ_TIMEOUT = 1000;

    //  路由的默认最大连接

    private static final int HTTP_MAX_PERROUTE = 500;

    //  整个连接池连接的最大值

    private static final int HTTP_MAX_TOTAL = 1000;
    private static RequestConfig defaultRequestConfig = null;
    private static CloseableHttpClient httpClient = null;



    public static CloseableHttpClient getHttpClient()
    {
        if(null == httpClient)
        {
            //  创建连接池管理器
            PoolingHttpClientConnectionManager connManager = new PoolingHttpClientConnectionManager();
            //  设置socket配置
            SocketConfig socketConfig = SocketConfig.custom()
                    .setTcpNoDelay(true)
                    .build();
            connManager.setDefaultSocketConfig(socketConfig);
            connManager.setMaxTotal(HTTP_MAX_TOTAL);
            connManager.setDefaultMaxPerRoute(HTTP_MAX_PERROUTE);
            //  设置获取连接超时时间、建立连接超时时间、从服务端读取数据的超时时间
            defaultRequestConfig = RequestConfig.custom()
                    .setSocketTimeout(HTTP_TIMEOUT)
                    .setConnectTimeout(HTTP_CON_TIMEOUT)
                    .setConnectionRequestTimeout(HTTP_CON_REQ_TIMEOUT)
                    .build();
            //  创建httpclient实例
            httpClient = HttpClients.custom()
                    .setConnectionManager(connManager)
                    .setDefaultRequestConfig(defaultRequestConfig)
                    .build();
        }
        return httpClient;
    }
}

代码

 

问题解决,不会出现上面的异常。

 

后记:上面问题解决了,但是由与并发高,又出现了响应超时问题,这个只要设置连接池的超时时间就好

- Read timed out
java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
	at com.eebbk.onlinelesson.common.util.HttpUtil.doHttpGet(HttpUtil.java:264)
	at com.eebbk.onlinelesson.common.util.PushMsgUtil.pushMsgWithMachineId(PushMsgUtil.java:127)
	at com.eebbk.onlinelesson.Call.PushCall.call(PushCall.java:44)
	at com.eebbk.onlinelesson.Call.PushCall.call(PushCall.java:21)
	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
	at java.util.concurrent.FutureTask.run(FutureTask.java)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

 

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值