分析:进程数满了导致系统系统崩溃才是主要原因 还有一个就是ssh的预留内存不够用,
措施:尝试修改最大进程数内核参数,避免进程数导致系统崩溃(下次修改ssh的预留内存)
操作命令:
sysctl kernel.pid_max
echo "kernel.pid_max=1000000 " >> /etc/sysctl.conf
sysctl -p
日志截图如下:
Aug 31 09:17:51 flexcc-app2 kernel: usb 2-13: new low-speed USB device number 5 using xhci_hcd
Aug 31 09:17:51 flexcc-app2 kernel: usb 2-13: New USB device found, idVendor=413c, idProduct=2003
Aug 31 09:17:51 flexcc-app2 kernel: usb 2-13: New USB device strings: Mfr=1, Product=2, SerialNumber=0
Aug 31 09:17:51 flexcc-app2 kernel: usb 2-13: Product: Dell USB Keyboard
Aug 31 09:17:51 flexcc-app2 kernel: usb 2-13: Manufacturer: Dell
Aug 31 09:17:51 flexcc-app2 kernel: input: Dell Dell USB Keyboard as /devices/pci0000:00/0000:00:14.0/usb2/2-13/2-13:1.0/input/input5
Aug 31 09:17:51 flexcc-app2 kernel: hid-generic 0003:413C:2003.0004: input,hidraw0: USB HID v1.10 Keyboard [Dell Dell USB Keyboard] on usb-0000:00:14.0-13/input0
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:54 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:17:57 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:00 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:03 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:06 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:09 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:12 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:15 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:18 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:21 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:24 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:27 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:28 flexcc-app2 kernel: ACPI Error: SMBus/IPMI/GenericSerialBus write requires Buffer of length 66, found length 32 (20130517/exfield-389)
Aug 31 09:18:28 flexcc-app2 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMM] (Node ffff88017a042c08), AE_AML_BUFFER_LIMIT (20130517/psparse-536)
Aug 31 09:18:28 flexcc-app2 kernel: ACPI Exception: AE_AML_BUFFER_LIMIT, Evaluating _PMM (20130517/power_meter-339)
Aug 31 09:18:30 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:33 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:36 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:39 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:42 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:45 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:48 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:51 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:54 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:18:57 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:19:01 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:19:04 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:19:07 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:19:10 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:19:13 flexcc-app2 systemd-udevd: fork of child failed: Cannot allocate memory
Aug 31 09:21:15 flexcc-app2 journal: Runtime journal is using 8.0M (max allowed 777.1M, trying to leave 1.1G free of 7.5G available → current limit 777.1M).
Aug 31 09:21:15 flexcc-app2 kernel: Initializing cgroup subsys cpuset
Aug 31 09:21:15 flexcc-app2 kernel: Initializing cgroup subsys cpu
Aug 31 09:21:15 flexcc-app2 kernel: Initializing cgroup subsys cpuacct
Aug 31 09:21:15 flexcc-app2 kernel: Linux version 3.10.0-693.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Tue Aug 22 21:09:27 UTC 2017
Aug 31 09:21:15 flexcc-app2 kernel: Command line: BOOT_IMAGE=/vmlinuz-3.10.0-693.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb quiet LANG=en_US.UTF-8
Aug 31 09:21:15 flexcc-app2 kernel: e820: BIOS-provided physical RAM map: