现象:
环境中出现一台服务器间歇性自动重启
排查问题
- 查看操作记录是否有人为重启过?无人为重启操作
- 查看是否生产crash文件?/var/crash无crash文件生成
- 查看message日志是否有正常?message文件正常
- 查看sudo journalctl -k 结果
kernel: EDAC MC3: 1 CE memory scrubbing error on CPU_SrcID#1_MC#1_Chan#1_DIMM#0 (channel:1 slot:0 page:0x343acff offset:0xb40 grain:32 syndrome:0x0 - err_code:0x0008:0x00c1 socket:1 imc:1 rank:1 bg:1 ba:2 row:0x375f col:0x3e0)
kernel: core: [Hardware Error]: Machine check events logged
kernel: EDAC skx MC3: HANDLING MCE MEMORY ERROR
kernel: EDAC skx MC3: CPU 10: Machine Check Event: 0x0 Bank 16: 0x8c000040001020c1
kernel: EDAC skx MC3: TSC 0xe8d58c7dcea
kernel: EDAC skx MC3: ADDR 0x343acffbc0
kernel: EDAC skx MC3: MISC 0x908400000000086
kernel: EDAC skx MC3: PROCESSOR 0:0x50657 TIME 1644062224 SOCKET 1 APIC 0x10
确认是内存条的问题,造成机器重启
解决办法
1 业务下线
2. 重新插内存条或者更换内存条