问题背景:
最近项目中增加了些网络请求,使用JDK11自带的HttpClient进行请求
因为IO比较费时,于是尝试使用线程池来执行IO
问题描述
外部调用者是使用一个1核心线程,10最大线程的线程池执行的。每次执行方法就提交一次任务到线程池
public class CommandServiceImpl{
private ThreadPoolExecutor threadPoolExecutor = new ThreadPoolExecutor(1, 10, 30, TimeUnit.SECONDS
, new SynchronousQueue<Runnable>(true)
,Executors.defaultThreadFactory());
public void run(){
threadPoolExecutor.submit(()->{
String data = NetWork.getData(...);
...
});
}
}
具体的IO执行方法方法中,使用以下方法初始化各自的HttpClient并发送请求
public class NetWork{
public static String getData(...){
HttpClient httpClient = HttpClient.newBuilder().connectTimeout(Duration.ofSeconds(10)).build();
HttpRequest httpRequest = HttpRequest.newBuilder()
.uri(new URI("***"))
.POST(HttpRequest.BodyPublishers.ofString(json))
.header("content-type","application/json")
.build();
HttpResponse<String> response = httpClient.send(httpRequest, HttpResponse.BodyHandlers.ofString());
return response.body();
}
}
第一次可以正常执行并返回结果,后续多次尝试执行时,均会提示SSLHandshakeException
2022-10-08 15:49:56 I/stdout: java.io.IOException: Received fatal alert: handshake_failure
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.HttpClientImpl.send(HttpClientImpl.java:565) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.HttpClientFacade.send(HttpClientFacade.java:119) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at com.github.cuteluobo.util.AiImgUtils.getImg(AiImgUtils.java:75) ~[main/:?]
2022-10-08 15:49:56 I/stdout: at com.github.cuteluobo.command.AiDrawCommand.lambda$0_aroundBody6(AiDrawCommand.java:83) ~[main/:?]
2022-10-08 15:49:56 I/stdout: at com.github.cuteluobo.command.AiDrawCommand.lambda$0_aroundBody7$advice(AiDrawCommand.java:126) ~[main/:?]
2022-10-08 15:49:56 I/stdout: at com.github.cuteluobo.command.AiDrawCommand.lambda$0(AiDrawCommand.java:1) ~[main/:?]
2022-10-08 15:49:56 I/stdout: at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
2022-10-08 15:49:56 I/stdout: at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
2022-10-08 15:49:56 I/stdout: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
2022-10-08 15:49:56 I/stdout: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
2022-10-08 15:49:56 I/stdout: at java.lang.Thread.run(Thread.java:834) ~[?:?]
2022-10-08 15:49:56 I/stdout: Caused by: javax.net.ssl.SSLHandshakeException: Received fatal alert: handshake_failure
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.Alert.createSSLException(Alert.java:128) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.Alert.createSSLException(Alert.java:117) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.TransportContext.fatal(TransportContext.java:308) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.Alert$AlertConsumer.consume(Alert.java:279) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.TransportContext.dispatch(TransportContext.java:181) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.SSLTransport.decode(SSLTransport.java:164) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.SSLEngineImpl.decode(SSLEngineImpl.java:672) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.SSLEngineImpl.readRecord(SSLEngineImpl.java:627) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.SSLEngineImpl.unwrap(SSLEngineImpl.java:443) ~[?:?]
2022-10-08 15:49:56 I/stdout: at sun.security.ssl.SSLEngineImpl.unwrap(SSLEngineImpl.java:422) ~[?:?]
2022-10-08 15:49:56 I/stdout: at javax.net.ssl.SSLEngine.unwrap(SSLEngine.java:634) ~[?:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SSLFlowDelegate$Reader.unwrapBuffer(SSLFlowDelegate.java:480) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SSLFlowDelegate$Reader.processData(SSLFlowDelegate.java:389) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SSLFlowDelegate$Reader$ReaderDownstreamPusher.run(SSLFlowDelegate.java:263) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SequentialScheduler$SynchronizedRestartableTask.run(SequentialScheduler.java:175) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SequentialScheduler$CompleteRestartableTask.run(SequentialScheduler.java:147) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: at jdk.internal.net.http.common.SequentialScheduler$SchedulableTask.run(SequentialScheduler.java:198) ~[java.net.http:?]
2022-10-08 15:49:56 I/stdout: ... 3 more
2022-10-08 15:49:56 I/stdout:
2022-10-08 15:49:56 W/stderr: javax.net.ssl|DEBUG|03|Finalizer|2022-10-08 15:49:56.639 CST|SSLSocketImpl.java:473|duplex close of SSLSocket
2022-10-08 15:49:56 W/stderr: javax.net.ssl|WARNING|03|Finalizer|2022-10-08 15:49:56.640 CST|SSLSocketImpl.java:494|SSLSocket duplex close failed (
2022-10-08 15:49:56 W/stderr: "throwable" : {
2022-10-08 15:49:56 W/stderr: java.net.SocketException: Socket is not connected
2022-10-08 15:49:56 W/stderr: at java.base/java.net.Socket.shutdownOutput(Socket.java:1553)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.BaseSSLSocketImpl.shutdownOutput(BaseSSLSocketImpl.java:232)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.SSLSocketImpl.duplexCloseOutput(SSLSocketImpl.java:561)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.SSLSocketImpl.close(SSLSocketImpl.java:479)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.BaseSSLSocketImpl.finalize(BaseSSLSocketImpl.java:275)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.System$2.invokeFinalize(System.java:2117)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.ref.Finalizer.runFinalizer(Finalizer.java:87)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)}
2022-10-08 15:49:56 W/stderr:
2022-10-08 15:49:56 W/stderr: )
2022-10-08 15:49:56 W/stderr: javax.net.ssl|DEBUG|03|Finalizer|2022-10-08 15:49:56.640 CST|SSLSocketImpl.java:473|duplex close of SSLSocket
2022-10-08 15:49:56 W/stderr: javax.net.ssl|WARNING|03|Finalizer|2022-10-08 15:49:56.644 CST|SSLSocketImpl.java:494|SSLSocket duplex close failed (
2022-10-08 15:49:56 W/stderr: "throwable" : {
2022-10-08 15:49:56 W/stderr: java.net.SocketException: Socket is not connected
2022-10-08 15:49:56 W/stderr: at java.base/java.net.Socket.shutdownOutput(Socket.java:1553)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.BaseSSLSocketImpl.shutdownOutput(BaseSSLSocketImpl.java:232)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.SSLSocketImpl.duplexCloseOutput(SSLSocketImpl.java:561)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.SSLSocketImpl.close(SSLSocketImpl.java:479)
2022-10-08 15:49:56 W/stderr: at java.base/sun.security.ssl.BaseSSLSocketImpl.finalize(BaseSSLSocketImpl.java:275)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.System$2.invokeFinalize(System.java:2117)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.ref.Finalizer.runFinalizer(Finalizer.java:87)
2022-10-08 15:49:56 W/stderr: at java.base/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)}
2022-10-08 15:49:56 W/stderr:
2022-10-08 15:49:56 W/stderr: )
原因分析:
之前搜索的时候被结果误导了,大量问题都只讨论了JDK与支持的TLS版本,但与此次问题无关,毕竟第一次请求是可以正常执行的。
在stackoverflow(Java 11 HttpClient - What is Optimum Ratio of HttpClients to Concurrent HttpRequests)回答中找到了可能的问题所在,可能跟HttpClient的并发相关,因为单个请求时间都比较长,导致后续请求被阻塞。
解决方案:
后面按答案思路尝试了多种方法,调整任务执行线程池、关联任务等,无法解决问题。
后面尝试给IO执行类添加一个实例共用的带线程池的HttpClient就解决了
public class NetWork{
//new
private static ThreadPoolExecutor threadPoolExecutor = new ThreadPoolExecutor(1, 10, 30, TimeUnit.SECONDS
, new SynchronousQueue<Runnable>(true)
, Executors.defaultThreadFactory());
private static HttpClient httpClient = HttpClient.newBuilder().connectTimeout(Duration.ofSeconds(10)).executor(threadPoolExecutor).build();
public static String getData(...){
//remove
//HttpClient httpClient = HttpClient.newBuilder().connectTimeout(Duration.ofSeconds(10)).build();
HttpRequest httpRequest = HttpRequest.newBuilder()
.uri(new URI("***"))
.POST(HttpRequest.BodyPublishers.ofString(json))
.header("content-type","application/json")
.build();
HttpResponse<String> response = httpClient.send(httpRequest, HttpResponse.BodyHandlers.ofString());
return response.body();
}
}