升级runc后docker容器里mongosh登陆了失败“ctx“:“initandlisten“,“msg“:“\n\n***aborting after fassert() failure\n

docker容器里mongosh登陆了失败"ctx":“initandlisten”,“msg”:"\n\n***aborting after fassert() failure\n
【操作】安装的docker自带runc版本有漏洞，所以升级到runc-1.1.12版本，直接强制替换的二进制文件，没有重启docker，接着mongosh就进不去了，这个时候docker还活着，接着重启docker restart mongo重启mongo，docker start mongo启动失败,使用docker logs --tail 200 mongo查看日志，报错内容：

{"t":{"$date":"2024-06-05T19:50:52.323+08:00"},"s":"I",  "c":"NETWORK",  "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}

system_errori.cold.24","C":"std::__throw_system_error(int) [clone .cold.24]","s+":"2F"}}}
{"t":{"$date":"2024-06-05T19:50:52.360+08:00"},"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"main","msg":"Writing fatal message","attr":{"message":"std::exception::what(): Operation not permitted\nActual exception type: std::system_error\n\n"}}
{"t":{"$date":"2024-06-05T19:50:52.442+08:00"},"s":"I",  "c":"CONTROL",  "id":31380,   "ctx":"main","msg":"BACKTRACE","attr":{"bt":{"backtrace":[{"a":"564FACB046A4","b":"564FA7CF2000","o":"4E126A4","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.362","C":"mongo::stack_trace_detail::(anonymous namespace)::printStackTraceImpl(mongo::stack_trace_detail::(anonymous namespace)::Options const&, mongo::StackTraceSink*) [clone .constprop.362]","s+":"1F4"},{"a":"564FACB06BE9","b":"564FA7CF2000","o":"4E14BE9","s":"_ZN5mongo15printStackTraceEv","C":"mongo::printStackTrace()","s+":"29"},{"a":"564FACB00F37","b":"564FA7CF2000","o":"4E0EF37","s":"_ZN5mongo12_GLOBAL__N_111myTerminateEv","C":"mongo::(anonymous namespace)::myTerminate()","s+":"D7"},{"a":"564FACC8B9C6","b":"564FA7CF2000","o":"4F999C6","s":"_ZN10__cxxabiv111__terminateEPFvvE","C":"__cxxabiv1::__terminate(void (*)())","s+":"6"},{"a":"564FACC8BA01","b":"564FA7CF2000","o":"4F99A01","s":"_ZSt9terminatev","C":"std::terminate()","s+":"11"},{"a":"564FACC8BB3B","b":"564FA7CF2000","o":"4F99B3B","s":"__cxa_throw","s+":"4B"},{"a":"564FA9C07737","b":"564FA7CF2000","o":"1F15737","s":"_ZSt20__throw_system_errori.cold.24","C":"std::__throw_system_error(int) [clone .cold.24]","s+":"2F"},{"a":"564FACCA7D39","b":"564FA7CF2000","o":"4FB5D39","s":"_ZNSt6thread15_M_start_threadESt10unique_ptrINS_6_StateESt14default_deleteIS1_EEPFvvE","C":"std::thread::_M_start_thread(std::unique_ptr<std::thread::_State, std::default_delete<std::thread::_State> >, void (*)())","s+":"29"},{"a":"564FAABBAD8A","b":"564FA7CF2000","o":"2EC8D8A","s":"_ZN5mongo27startSignalProcessingThreadENS_13LogFileStatusE","C":"mongo::startSignalProcessingThread(mongo::LogFileStatus)","s+":"11A"},{"a":"564FA9E1963E","b":"564FA7CF2000","o":"212763E","s":"_ZN5mongo11mongod_mainEiPPc","C":"mongo::mongod_main(int, char**)","s+":"B4E"},{"a":"564FA9C0846E","b":"564FA7CF2000","o":"1F1646E","s":"main","s+":"E"},{"a":"7F5AAB0EFD90","b":"7F5AAB0C6000","o":"29D90","s":"__libc_init_first","s+":"90"},{"a":"7F5AAB0EFE40","b":"7F5AAB0C6000","o":"29E40","s":"__libc_start_main","s+":"80"},{"a":"564FA9E13F25","b":"564FA7CF2000","o":"2121F25","s":"_start","s+":"25"}],"processInfo":{"mongodbVersion":"6.0.5","gitVersion":"c9a99c120371d4d4c52cbb15dac34a36ce8d3b1d","compiledModules":[],"uname":{"sysname":"Linux","release":"3.10.0-957.el7.x86_64","version":"#1 SMP Thu Nov 8 23:39:32 UTC 2018","machine":"x86_64"},"somap":[{"b":"564FA7CF2000","elfType":3,"buildId":"3C976B679319B912CD7F7AC36B539DCD7F937343"},{"b":"7F5AAB0C6000","path":"/lib/x86_64-linux-gnu/libc.so.6","elfType":3,"buildId":"69389D485A9793DBE873F0EA2C93E02EFAA9AA3D"}]}}},"tags":[]}
{"t":{"$date":"2024-06-05T19:50:52.442+08:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"main","msg":"Frame","attr":{"frame":{"a":"564FA9C07737","b":"564FA7CF2000","o":"1F15737","s":"_ZSt20__throw_system_errori.cold.24","C":"std::__throw_system_error(int) [clone .cold.24]","s+":"2F"}}}

【docker容器里mongosh登录mongo报错内容截图】

【排查过程】
1.看到了一堆system报错，有点懵，怀疑是资源问题，查看/var/log/messages也没有发现可疑的日志，只看到了mongo启动失败之类的日志

2.再看看有没有能看得懂的日志，发现了一条：

针对： {“t”:{“$date”:“2024-06-05T19:50:52.323+08:00”},“s”:“I”, “c”:“NETWORK”, “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}

于是开启TCP FastOpen：
需要设置 /proc/sys/net/ipv4/tcp_fastopen 为3，这一步可能不是必须的，可以先不用设置

执行： echo 3 > /proc/sys/net/ipv4/tcp_fastopen

3.怀疑是不是runc版本问题，于是先停止所有容器，再停止docker服务，runc还原，再启动docker

docker stop  container1  container2 ....
systemctl stop docker
cp runc-1.1.2   /usr/bin/runc
systemctl  daemon-reload
systemctl start docker
docker start container1  container2 ....

发现docker能启动了

4.后面为了验证runc是否有影响，停止容器和docker服务后，又把docker的runc升级到runc-1.1.12，重载docke服务，拉起容器，发现mongo起不来，所以runc这次就不升级了。