原报错:
16:55:38.251 [http-nio-8081-exec-4] ERROR c.r.f.w.e.GlobalExceptionHandler - [handleRuntimeException,93] - 请求地址'/rcMessage/getAnswerNewStream',发生未知异常.
org.springframework.web.context.request.async.AsyncRequestTimeoutException: null
at org.springframework.web.context.request.async.TimeoutCallableProcessingInterceptor.handleTimeout(TimeoutCallableProcessingInterceptor.java:44)
at org.springframework.web.context.request.async.CallableInterceptorChain.triggerAfterTimeout(CallableInterceptorChain.java:94)
at org.springframework.web.context.request.async.WebAsyncManager.lambda$startCallableProcessing$1(WebAsyncManager.java:310)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at org.springframework.web.context.request.async.StandardServletAsyncWebRequest.onTimeout(StandardServletAsyncWebRequest.java:151)
at org.apache.catalina.core.AsyncListenerWrapper.fireOnTimeout(AsyncListenerWrapper.java:44)
at org.apache.catalina.core.AsyncContextImpl.timeout(AsyncContextImpl.java:133)
at org.apache.catalina.connector.CoyoteAdapter.asyncDispatch(CoyoteAdapter.java:137)
at org.apache.coyote.AbstractProcessor.dispatch(AbstractProcessor.java:241)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:57)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
16:55:38.253 [http-nio-8081-exec-4] WARN o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver - [logException,208] - Resolved [org.springframework.web.context.request.async.AsyncRequestTimeoutException]
org.apache.coyote.CloseNowException: Failed write
at org.apache.coyote.http11.Http11OutputBuffer$SocketOutputBuffer.doWrite(Http11OutputBuffer.java:542)
at org.apache.coyote.http11.filters.ChunkedOutputFilter.doWrite(ChunkedOutputFilter.java:110)
at org.apache.coyote.http11.Http11OutputBuffer.doWrite(Http11OutputBuffer.java:193)
at org.apache.coyote.Response.doWrite(Response.java:603)
at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:338)
at org.apache.catalina.connector.OutputBuffer.flushByteBuffer(OutputBuffer.java:784)
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:298)
at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:271)
at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:118)
at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java:523)
at com.ruoyi.service.service.impl.RcMessageServiceImpl.pushStreamFor(RcMessageServiceImpl.java:417)
at com.ruoyi.service.service.impl.RcMessageServiceImpl.sendRequest(RcMessageServiceImpl.java:389)
at com.ruoyi.service.service.impl.RcMessageServiceImpl.lambda$getAnswerNewStream$1(RcMessageServiceImpl.java:318)
at org.springframework.web.servlet.mvc.method.annotation.StreamingResponseBodyReturnValueHandler$StreamingResponseBodyTask.call(StreamingResponseBodyReturnValueHandler.java:111)
at org.springframework.web.servlet.mvc.method.annotation.StreamingResponseBodyReturnValueHandler$StreamingResponseBodyTask.call(StreamingResponseBodyReturnValueHandler.java:98)
at org.springframework.web.context.request.async.WebAsyncManager.lambda$startCallableProcessing$4(WebAsyncManager.java:337)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
16:55:38.280 [MyExecutor-1] INFO c.r.s.s.i.RcMessageServiceImpl - [lambda$getAnswerNewStream$1,325]
原因:异步线程操作默认时间是30s,你的异步操作超过30就会被终端
比如我的原因,使用okhttp发起流式请求(chatgpt大模型返回流式数据,时间超过30s),这里有另外一个问题,使用okhttp发起流式请求时,会提示
An Executor is required to handle java.util.concurrent.Callable return values.
Please, configure a TaskExecutor in the MVC config under "async support".
The SimpleAsyncTaskExecutor currently in use is not suitable under load.
解决办法:
@Configuration
public class ResourcesConfig implements WebMvcConfigurer
{
/** 选择合适的TaskExecutor: 鉴于SimpleAsyncTaskExecutor在负载较大时不适用,您可能需要选择一个更高级的TaskExecutor。例如,可以使用ThreadPoolTaskExecutor。
在Spring MVC配置中添加TaskExecutor: 打开您的Spring MVC配置文件,并确保已启用异步支持。然后,将新的TaskExecutor添加到配置中 */
@Bean
public AsyncTaskExecutor taskExecutor() {
ThreadPoolTaskExecutor executor = new ThreadPoolTaskExecutor();
executor.setCorePoolSize(20);
executor.setMaxPoolSize(40);
executor.setQueueCapacity(25);
executor.setThreadNamePrefix("MyExecutor-");
// 解决异步线程突然关闭,导致流flush失败
executor.setAwaitTerminationSeconds(600);
executor.initialize();
return executor;
}
@Override
public void configureAsyncSupport(AsyncSupportConfigurer configurer) {
configurer.setTaskExecutor(taskExecutor());
}
}
但是此时还是没有解决异步操作30s中断的问题
解决办法:在configureAsyncSupport方法里添加以下代码
@Override
public void configureAsyncSupport(AsyncSupportConfigurer configurer) {
// 解决异步线程突然关闭,导致流flush失败(默认是30s)
configurer.setDefaultTimeout(6000000); // 设置默认超时时间10分钟,单位为毫秒
configurer.setTaskExecutor(taskExecutor());
// 添加超时拦截器
configurer.registerCallableInterceptors(new TimeoutCallableProcessingInterceptor());
}