记一次使用redis stream创建的消息队列时,导致java服务的CPU、Memory过高的问题

首先通过jstack查看cpu过高的原因,进一步定位问题,由于本人对DefaultStreamMessageListenerContainer源码有操作,遂在服务中重写了该类的内容,由下方异常可以看出com.bot.base.biz.redis.rediesmq.stream.AIDefaultStreamMessageListenerContainer.lambda$getReadFunction$17(AIDefaultStreamMessageListenerContainer.java:255)出现的问题,那么我们定位到该段代码(图1),分析得知此处一直在不停的循环,不释放导致cpu过高;解决此问题需在创建消费者consumer的时候对pollTimeout设置是不能设置为Duration.ZERO,不阻塞便不释放cpu资源,可以设置为pollTimeout(Duration.ofMillis(5))即可。

at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1775)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
        at io.lettuce.core.protocol.AsyncCommand.await(AsyncCommand.java:83)
        at io.lettuce.core.internal.Futures.awaitOrCancel(Futures.java:244)
        at io.lettuce.core.LettuceFutures.awaitOrCancel(LettuceFutures.java:74)
        at org.springframework.data.redis.connection.lettuce.LettuceConnection.await(LettuceConnection.java:1060)
        at org.springframework.data.redis.connection.lettuce.LettuceConnection.lambda$doInvoke$4(LettuceConnection.java:919)
        at org.springframework.data.redis.connection.lettuce.LettuceConnection$$Lambda$1042/473666452.doInvoke(Unknown Source)
        at org.springframework.data.redis.connection.lettuce.LettuceInvoker$Synchronizer.invoke(LettuceInvoker.java:673)
        at org.springframework.data.redis.connection.lettuce.LettuceInvoker$DefaultManyInvocationSpec.toList(LettuceInvoker.java:618)
        at org.springframework.data.redis.connection.lettuce.LettuceStreamCommands.xReadGroup(LettuceStreamCommands.java:352)
        at com.bot.base.biz.redis.rediesmq.stream.AIDefaultStreamMessageListenerContainer.lambda$null$16(AIDefaultStreamMessageListenerContainer.java:256)
        at com.bot.base.biz.redis.rediesmq.stream.AIDefaultStreamMessageListenerContainer$$Lambda$1063/908139337.doInRedis(Unknown Source)
        at org.springframework.data.redis.core.RedisTemplate.execute(RedisTemplate.java:222)
        at org.springframework.data.redis.core.RedisTemplate.execute(RedisTemplate.java:189)
        at org.springframework.data.redis.core.RedisTemplate.execute(RedisTemplate.java:176)
        at com.bot.base.biz.redis.rediesmq.stream.AIDefaultStreamMessageListenerContainer.lambda$getReadFunction$17(AIDefaultStreamMessageListenerContainer.java:255)
        at com.bot.base.biz.redis.rediesmq.stream.AIDefaultStreamMessageListenerContainer$$Lambda$1054/832292933.apply(Unknown Source)
        at com.bot.base.biz.redis.rediesmq.stream.AIStreamPollTask.readRecords(AIStreamPollTask.java:161)
        at com.mxsf.bot.base.biz.redis.rediesmq.stream.AIStreamPollTask.doLoop(AIStreamPollTask.java:142)
        at com.mxsf.bot.base.biz.redis.rediesmq.stream.AIStreamPollTask.run(AIStreamPollTask.java:127)

"lettuce-nioEventLoop-4-1" #34 daemon prio=5 os_prio=0 tid=0x00007f0ab5353000 nid=0x75 runnable [0x00007f0a40e84000]
   java.lang.Thread.State: RUNNABLE
        at sun.misc.Unsafe.unpark(Native Method)
        at java.util.concurrent.locks.LockSupport.unpark(LockSupport.java:141)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.unparkSuccessor(AbstractQueuedSynchronizer.java:662)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1264)
        at java.util.concurrent.locks.ReentrantLock.unlock(ReentrantLock.java:457)
        at java.util.concurrent.LinkedBlockingQueue.signalNotEmpty(LinkedBlockingQueue.java:176)
        at java.util.concurrent.LinkedBlockingQueue.offer(LinkedBlockingQueue.java:430)
        at io.netty.util.concurrent.SingleThreadEventExecutor.offerTask(SingleThreadEventExecutor.java:352)
        at io.netty.util.concurrent.SingleThreadEventExecutor.addTask(SingleThreadEventExecutor.java:343)
        at io.netty.util.concurrent.SingleThreadEventExecutor.execute(SingleThreadEventExecutor.java:825)
        at io.netty.util.concurrent.SingleThreadEventExecutor.lazyExecute(SingleThreadEventExecutor.java:820)
        at io.netty.util.concurrent.AbstractScheduledEventExecutor.removeScheduled(AbstractScheduledEventExecutor.java:280)
        at io.netty.util.concurrent.ScheduledFutureTask.cancel(ScheduledFutureTask.java:207)
        at io.lettuce.core.protocol.CommandExpiryWriter.lambda$potentiallyExpire$1(CommandExpiryWriter.java:181)
        at io.lettuce.core.protocol.CommandExpiryWriter$$Lambda$1049/1431710377.accept(Unknown Source)
        at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
        at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
        at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962)

                                                                                图1

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值