mycat服务器CPU高问题

mycat服务器CPU高问题

版本：mycat1.6.6.1
问题描述：mycat运行一段时间后发现CPU持续升高，资源不释放，最终CPU占用率达到100%

–查询进程对应的线程占用CPU的情况
ps -mp pid -o THREAD,tid,time

排查链路：获取mycat进程号，ps -mp 进程号 -o THREAD,tid,time

root 62.2 19 - - - - 13943 6-02:40:25
root 70.7 19 - - - - 13944 6-22:29:12
root 52.4 19 - - - - 13945 5-03:26:54
root 70.5 19 - - - - 13949 6-22:08:25

以上四个线程cpu占用率和占用时间严重超高

线程号换算十六进制
printf “0x%x\n” 18584 --18584是线程号
用jstack 查看 线程对应堆栈
jstack 18571| vim +/0x4898 - – 1857是进程号

“BusinessExecutor11” #48 daemon prio=5 os_prio=0 tid=0x00007f9e1c300000 nid=0x3679 runnable [0x00007f9dabdfc000]
java.lang.Thread.State: RUNNABLE
at io.mycat.memory.unsafe.Platform.copyMemory(Platform.java:302)
at io.mycat.memory.unsafe.row.BufferHolder.grow(BufferHolder.java:64)
at io.mycat.memory.unsafe.row.UnsafeRowWriter.write(UnsafeRowWriter.java:182)
at io.mycat.memory.unsafe.row.UnsafeRowWriter.write(UnsafeRowWriter.java:175)
at io.mycat.sqlengine.mpp.DataNodeMergeManager.run(DataNodeMergeManager.java:434)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
其余三个相同

结论：mycat cpu异常原因，是后端db超时导致copyMemory方法和DataNodeMergeManager方法死循环

下面两种错误

"BusinessExecutor7" #52 daemon prio=5 os_prio=0 tid=0x00007f12602cd800 nid=0x4094 runnable [0x00007f120b8f7000]
   java.lang.Thread.State: RUNNABLE
        at io