WARNING: Subscription for node down event still pending

周末业务电话说数据库连接等待，连不进去

登录发现库正常但监听卡死

监听日志大量报错如下：

WARNING: Subscription for node down event still pending
12-MAR-2017 10:44:01 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=crfdb1)(USER=oracle))(COMMAND=status)(ARGUMENTS=64)(SERVICE=LISTENER)(VERSION=169869568)) * status * 0
12-MAR-2017 10:44:06 * (CONNECT_DATA=(SID=orcl)(CID=(PROGRAM=)(HOST=__jdbc__)(USER=))) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.195.33.55)(PORT=28762)) * establish * orcl * 0
12-MAR-2017 10:44:51 * (CONNECT_DATA=(SID=orcl)(CID=(PROGRAM=)(HOST=__jdbc__)(USER=))) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.198.20.11)(PORT=27225)) * establish * orcl * 0
12-MAR-2017 10:44:52 * (CONNECT_DATA=(SID=orcl)(CID=(PROGRAM=)(HOST=__jdbc__)(USER=))) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.198.20.23)(PORT=10164)) * establish * orcl * 0
WARNING: Subscription for node down event still pending

status及stop start，连接全是卡死状态

手工删除进程：

[oracle@crfdb1 ~]$ ps -ef |grep tns
oracle    4347     1  0  2016 ?        01:37:38 /opt/oracle/product/10.2/bin/tnslsnr LISTENER -inherit
oracle    8254  6842  0 16:00 pts/10   00:00:00 grep tns
oracle   29873  4347  0 13:13 ?        00:00:00 /opt/oracle/product/10.2/bin/tnslsnr LISTENER -inherit
[oracle@crfdb1 ~]$ 

[oracle@crfdb1 ~]$ kill -9 4347

[oracle@crfdb1 ~]$ kill -9 29873 
[oracle@crfdb1 ~]$ lsnrctl status

LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 12-MAR-2017 16:02:22

Copyright (c) 1991, 2005, Oracle.  All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC1)))
TNS-12541: TNS:no listener
 TNS-12560: TNS:protocol adapter error
  TNS-00511: No listener
   Linux Error: 111: Connection refused
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=crfdb1)(PORT=1521)))
TNS-12541: TNS:no listener
 TNS-12560: TNS:protocol adapter error
  TNS-00511: No listener
   Linux Error: 111: Connection refused
[oracle@crfdb1 ~]$ 

再启动监听：

[oracle@crfdb1 ~]$ lsnrctl start

LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 12-MAR-2017 16:02:29

Copyright (c) 1991, 2005, Oracle.  All rights reserved.

Starting /opt/oracle/product/10.2/bin/tnslsnr: please wait...
TNSLSNR for Linux: Version 10.2.0.1.0 - Production
System parameter file is /opt/oracle/product/10.2/network/admin/listener.ora
Log messages written to /opt/oracle/product/10.2/network/log/listener.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC1)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=crfdb1)(PORT=1521)))


Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC1)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date                12-MAR-2017 16:02:31
Uptime                    0 days 0 hr. 0 min. 0 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /opt/oracle/product/10.2/network/admin/listener.ora
Listener Log File         /opt/oracle/product/10.2/network/log/listener.log
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC1)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=crfdb1)(PORT=1521)))
Services Summary...
Service "PLSExtProc" has 1 instance(s).
  Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
[oracle@crfdb1 ~]$ 
[oracle@crfdb1 ~]$ 
[oracle@crfdb1 ~]$ 

如果监听问题未得到解决，参考如下：

'WARNING: Subscription for node down event still pending' in Listener Log (文档 ID 372959.1)

转到底部

---

In this Document Symptoms   Changes   Cause   Solution   References APPLIES TO: Oracle Net Services - Version 10.2.0.1 to 12.1.0.2 [Release 10.2 to 12.1] Information in this document applies to any platform. ***Checked for relevance on 29-JAN-2014*** This issue affects only 10g and newer listeners. SYMPTOMS You are receiving the following warning messages in the listener log file constantly: 'WARNING: Subscription for node down event still pending'  CHANGES This may be a new installation or a recent upgrade to 10g or newer. CAUSE These messages are related to the Oracle TNS Listener's default subscription to the Oracle Notification Service (ONS). In a non-RAC environment it is recommended to disable this subscription.   This feature was introduced in Oracle 10g. SOLUTION Set the following parameter in the listener.ora: SUBSCRIBE_FOR_NODE_DOWN_EVENT_<listener_name>=OFF Where <listener_name> should be replaced with the actual listener name configured in the LISTENER.ORA file. SUBSCRIBE_FOR_NODE_DOWN_EVENT_<listener_name> parameter is to be placed by itself on an empty line. It will be necessary to restart or reload the listener following the addition of this parameter. This will prevent the messages from being written to the log file and may also prevent the TNS Listener from hanging periodically.  See (10g only) NOTE 340091.1 Intermittent TNS Listener Hang, New Child Listener Process Forked Please Note: Setting SUBSCRIBE_FOR_NODE_DOWN_<listener_name> to OFF disables a necessary RAC functionality. The above workaround is recommended only for non-RAC environments.  The issue may be present in all 10g and newer installations. Note:  The use of this undocumented parameter may cause problems with the use of the Net Manager (NetMgr) configuration utility.  See Note 437598.1 NetMGR May Error When Listener.ora File Contains:SUBSCRIBE_FOR_NODE_DOWN_EVENT REFERENCES NOTE:340091.1 - 10g: Intermittent TNS Listener Hang, New Child Listener Process Forked NOTE:437598.1 - NetMGR May Error When Listener.ora File Contains:SUBSCRIBE_FOR_NODE_DOWN_EVENT