错误详情:
alert 告警日志中反复出现如下信息:
ORA-27300: OS system dependent operation:fork failed with status: 11
ORA-27301: OS failure message: Resource temporarily unavailable
ORA-27302: failure occurred at: skgpspawn5
同时用数据库 OS用户创建文件时报错:
touch test.txt
-bash: start_pipeline: pgrp pipe: Too many open files in system
-bash: /bin/touch: Too many open files in system
故而查看操作系统日志:
cd /var/log
tail -200f messages
部分错误信息:
Jul 25 10:55:46 handcmcc01 kernel: [676446.918864] httpd.worker[24874]: segfault at 50 ip 00007fb8620090af sp 00007fb846de9d10 error 4 in libapr-1.so.0[7fb861fe3000+35000]
Jul 25 10:55:46 handcmcc01 abrt[24856]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
Jul 25 10:55:46 handcmcc01 abrt[24875]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
Jul 25 10:55:46 handcmcc01 abrt[24876]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
Jul 25 10:55:46 handcmcc01 abrt[24904]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
Jul 25 10:55:49 handcmcc01 abrt[24989]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
Jul 25 10:56:09 handcmcc01 abrt[25297]: abrtd is not running. If it crashed, /proc/sys/kernel/core_pattern contains a stale value, consider resetting it to 'core'
根据错误信息可得,是系统参数设置太小:
/etc/security/limits.conf
@dba soft nofile 65536
@dba hard nofile 65536
@dba soft nproc 16384
@dba hard nproc 16384
@dba hard stack 16384
@dba soft stack 10240
因此做出调整:
@dba soft nofile 655360
@dba hard nofile 655360
@dba soft nproc 163840
@dba hard nproc 163840
@dba hard stack 163840
@dba soft stack 102400
参数扩大十倍,服务正常运行。
问题前景,服务使用人数100人。
(笔者原创文章,转载请注明出处:https://blog.csdn.net/LFCuiYs)谢谢!