| Oracle_11g_rac节点1正常，节点2长时间没有启动再次启动时无法启动： 节点2的CSSD日志总是报： No asm libraries found in the system 以及 node 1, nezhdb01, has a disk HB, but no network HB 具体原因不明确，经重启节点1，再次启动就恢复正常了。 节点1和节点2公网地址和私网地址都可以互相通信。
[root@nezhdb01 bin]# ./crsctl stat res -t |
| [root@nezhdb02 bin]# ./crsctl start crs
2019-07-30 09:50:56.837: [ CSSD][2417317632]clssnmOpenGIPCEndp: listening on gipcha://nezhdb02:nm2_nezhdb-cluster 2019-07-30 09:50:56.839: [ SKGFD][2417317632]NOTE: No asm libraries found in the system
2019-07-30 09:50:56.839: [ CLSF][2417317632]Allocated CLSF context 2019-07-30 09:50:56.841: [ SKGFD][2417317632]Handle 0x16d6100 from lib :UFS:: for disk :/dev/asm_ocrvote1:
2019-07-30 09:50:56.842: [ SKGFD][2417317632]Handle 0x16d6520 from lib :UFS:: for disk :/dev/asm_ocrvote3:
2019-07-30 09:50:56.843: [ SKGFD][2417317632]Handle 0x16b0040 from lib :UFS:: for disk :/dev/asm_ocrvote2:
2019-07-30 09:50:56.843: [ CSSD][2417317632]clssnmlalloccx:phyname nezhdb02 2019-07-30 09:50:56.852: [ CSSD][2417317632]clssnmvDiskAvailabilityChange: voting file /dev/asm_ocrvote1 now online 2019-07-30 09:50:56.852: [ CSSD][2417317632]clssnmlgetfileslot: found expired slot 2 for host nezhdb02 leasename nezhdb02 2019-07-30 09:50:56.857: [ CSSD][2417317632]clssnmvDiskAvailabilityChange: voting file /dev/asm_ocrvote3 now online 2019-07-30 09:50:56.857: [ CSSD][2417317632]clssnmlgetfileslot: found expired slot 2 for host nezhdb02 leasename nezhdb02 2019-07-30 09:50:56.867: [ CSSD][2417317632]clssnmvDiskAvailabilityChange: voting file /dev/asm_ocrvote2 now online 2019-07-30 09:50:56.867: [ CSSD][2417317632]clssnmlgetfileslot: found expired slot 2 for host nezhdb02 leasename nezhdb02 2019-07-30 09:50:56.869: [ SKGFD][2392676096]NOTE: No asm libraries found in the system
2019-07-30 09:50:56.869: [ CLSF][2392676096]Allocated CLSF context 2019-07-30 09:50:56.872: [ SKGFD][2392676096]Handle 0x7f266808e6b0 from lib :UFS:: for disk :/dev/asm_ocrvote1:
2019-07-30 09:50:56.872: [ SKGFD][2392676096]Lib :UFS:: closing handle 0x7f266808e6b0 for disk :/dev/asm_ocrvote1:
2019-07-30 09:50:56.960: [ CSSD][2401556224]clssscSelect: cookie accept request 0x13ea190 2019-07-30 09:50:56.960: [ CSSD][2401556224]clssgmAllocProc: (0x7f26780593a0) allocated 2019-07-30 09:50:56.960: [ CSSD][2401556224]clssgmClientConnectMsg: properties of cmProc 0x7f26780593a0 - 1,2,3,4,5 2019-07-30 09:50:56.960: [ CSSD][2401556224]clssgmClientConnectMsg: Connect from con(0x37f) proc(0x7f26780593a0) pid(18679) version 11:2:1:4, properties: 1,2,3,4,5 2019-07-30 09:50:56.960: [ CSSD][2401556224]clssgmClientConnectMsg: The CSSD agent is process (0x7f26780593a0), number 2 2019-07-30 09:50:56.965: [ CSSD][2401556224]clssgmEvtInformation: reqtype (11) cmProc (0x7f26780593a0) client ((nil)) 2019-07-30 09:50:56.965: [ CSSD][2401556224]clssgmEvtInformation: reqtype (11) req (0x7f267804c250) 2019-07-30 09:50:56.965: [ CSSD][2401556224]clssnmQueueNotification: type (11) 0x7f267804c250 2019-07-30 09:50:57.770: [ CSSD][2401556224]clssscSelect: cookie accept request 0x13ea190 2019-07-30 09:50:57.770: [ CSSD][2401556224]clssgmAllocProc: (0x7f267806ecf0) allocated 2019-07-30 09:50:57.771: [ CSSD][2401556224]clssgmClientConnectMsg: properties of cmProc 0x7f267806ecf0 - 1,2,3,4,5 2019-07-30 09:50:57.771: [ CSSD][2401556224]clssgmClientConnectMsg: Connect from con(0x3ce) proc(0x7f267806ecf0) pid(6749) version 11:2:1:4, properties: 1,2,3,4,5 2019-07-30 09:50:57.823: [ CSSD][2401556224]clssgmClientConnectMsg: msg flags 0x0000 2019-07-30 09:50:57.825: [ CSSD][2401556224]clssscSelect: cookie accept request 0x7f2678084980 2019-07-30 09:50:57.825: [ CSSD][2401556224]clssscevtypSHRCON: getting client with cmproc 0x7f2678084980 2019-07-30 09:50:57.825: [ CSSD][2401556224]clssgmRegisterClient: proc(4/0x7f2678084980), client(1/0x7f2678061ca0) 2019-07-30 09:50:57.825: [ CSSD][2401556224]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x7f2678084980) client(0x7f2678061ca0) 2019-07-30 09:50:57.825: [ CSSD][2401556224]clssgmDiscEndpcl: gipcDestroy 0x44c 2019-07-30 09:50:57.875: [ SKGFD][2392676096]NOTE: No asm libraries found in the system 2019-07-30 09:51:10.924: [ CLSF][2392676096]Allocated CLSF context 2019-07-30 09:51:10.925: [ SKGFD][2392676096]Handle 0x7f266808e6b0 from lib :UFS:: for disk :/dev/asm_ocrvote2:
2019-07-30 09:51:10.925: [ SKGFD][2392676096]Lib :UFS:: closing handle 0x7f266808e6b0 for disk :/dev/asm_ocrvote2:
2019-07-30 09:51:11.802: [ CSSD][2401556224]clssscSelect: cookie accept request 0x7f267806ecf0 2019-07-30 09:51:11.802: [ CSSD][2401556224]clssscevtypSHRCON: getting client with cmproc 0x7f267806ecf0 2019-07-30 09:51:11.802: [ CSSD][2401556224]clssgmRegisterClient: proc(3/0x7f267806ecf0), client(15/0x7f2678056a10) 2019-07-30 09:51:11.802: [ CSSD][2401556224]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x7f267806ecf0) client(0x7f2678056a10) 2019-07-30 09:51:11.802: [ CSSD][2401556224]clssgmDiscEndpcl: gipcDestroy 0x792 2019-07-30 09:51:11.852: [ CSSD][2401556224]clssscSelect: cookie accept request 0x7f2678084980 2019-07-30 09:51:11.852: [ CSSD][2401556224]clssscevtypSHRCON: getting client with cmproc 0x7f2678084980 2019-07-30 09:51:11.852: [ CSSD][2401556224]clssgmRegisterClient: proc(4/0x7f2678084980), client(15/0x7f267805ee70) 2019-07-30 09:51:11.852: [ CSSD][2401556224]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x7f2678084980) client(0x7f267805ee70) 2019-07-30 09:51:11.852: [ CSSD][2401556224]clssgmDiscEndpcl: gipcDestroy 0x7aa 2019-07-30 09:51:11.855: [ CSSD][2401556224]clssscSelect: cookie accept request 0x13ea190 2019-07-30 09:51:11.855: [ CSSD][2401556224]clssgmAllocProc: (0x7f2678095800) allocated 2019-07-30 09:51:11.855: [ CSSD][2401556224]clssgmClientConnectMsg: properties of cmProc 0x7f2678095800 - 1,2,3,4,5 2019-07-30 09:51:11.855: [ CSSD][2401556224]clssgmClientConnectMsg: Connect from con(0x7dc) proc(0x7f2678095800) pid(5990) version 11:2:1:4, properties: 1,2,3,4,5 2019-07-30 09:51:11.855: [ CSSD][2401556224]clssgmClientConnectMsg: msg flags 0x0000 2019-07-30 09:51:11.926: [ CSSD][2417317632]clssnmlfmtlease: uniqueness 1564451454, gipc addr gipcha://nezhdb02:nm2_nezhdb-cluster 2019-07-30 09:51:11.927: [ CSSD][2417317632]clssnmvStatusBlkInit: myinfo nodename nezhdb02, uniqueness 1564451454 2019-07-30 09:51:11.928: [ CSSD][2417317632]clssnmvStatusBlkInit: myinfo nodename nezhdb02, uniqueness 1564451454 2019-07-30 09:51:11.928: [ CSSD][2417317632]clssnmvStatusBlkInit: myinfo nodename nezhdb02, uniqueness 1564451454 2019-07-30 09:51:11.969: [ CSSD][2417317632]clssnmlgetslot:lease acquisition for node nezhdb02/slot 2 completed in 15080 msecs 2019-07-30 09:51:11.980: [ CSSD][2417317632]clssnmvDHBValidateNcopy: node 1, nezhdb01, has a disk HB, but no network HB, DHB has rcfg 453393192, wrtcnt, 33409882, LATS 1012920164, lastSeqNo 0, uniqueness 1561040032, timestamp 1564451471/3410019084 2019-07-30 09:51:11.980: [ CSSD][2417317632]clssnmvDHBValidateNcopy: node 2, nezhdb02, has a disk HB, but no network HB, DHB has rcfg 453393191, wrtcnt, 31612341, LATS 1012920164, lastSeqNo 0, uniqueness 1564451454, timestamp 1563443572/5173494 2019-07-30 09:51:11.998: [ CSSD][2417317632]clssnmvDHBValidateNcopy: Saving DHB uniqueness for node nezhdb01, number 1 latestInfo(1561040032), readInfo(1561040032), nodeInfoDHB(0) 2019-07-30 09:51:11.998: [ CSSD][2417317632]clssnmvDHBValidateNcopy: node 1, nezhdb01, has a disk HB, but no network HB, DHB has rcfg 453393192, wrtcnt, 33409883, LATS 1012920184, lastSeqNo 0, uniqueness 1561040032, timestamp 1564451471/3410019274 2019-07-30 09:51:12.027: [ SKGFD][2417317632]Lib :UFS:: closing handle 0x16d6100 for disk :/dev/asm_ocrvote1:
2019-07-30 09:51:12.027: [ SKGFD][2417317632]Lib :UFS:: closing handle 0x16d6520 for disk :/dev/asm_ocrvote3:
2019-07-30 09:51:12.027: [ SKGFD][2417317632]Lib :UFS:: closing handle 0x16b0040 for disk :/dev/asm_ocrvote2:
2019-07-30 09:51:12.027: [ CSSD][2417317632]clssnmInitNodeDB: Initializing with OCR id 0 2019-07-30 09:51:12.804: [ CSSD][2401556224]clssscSelect: cookie accept request 0x7f267806ecf0 2019-07-30 09:51:12.804: [ CSSD][2401556224]clssscevtypSHRCON: getting client with cmproc 0x7f267806ecf0 2019-07-30 09:51:12.804: [ CSSD][2401556224]clssgmRegisterClient: proc(3/0x7f267806ecf0), client(16/0x7f267806f750) 2019-07-30 09:51:12.804: [ CSSD][2401556224]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x7f267806ecf0) client(0x7f267806f750) 2019-07-30 09:51:12.804: [ CSSD][2401556224]clssgmDiscEndpcl: gipcDestroy 0x816 2019-07-30 09:51:12.854: [ CSSD][2401556224]clssscSelect: cookie accept request 0x7f2678084980 2019-07-30 09:51:12.854: [ CSSD][2401556224]clssscevtypSHRCON: getting client with cmproc 0x7f2678084980 2019-07-30 09:51:12.854: [ CSSD][2401556224]clssgmRegisterClient: proc(4/0x7f2678084980), client(16/0x7f2678097f30) 2019-07-30 09:51:12.854: [ CSSD][2401556224]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x7f2678084980) client(0x7f2678097f30) 2019-07-30 09:51:12.854: [ CSSD][2401556224]clssgmDiscEndpcl: gipcDestroy 0x82c 2019-07-30 09:51:13.027: [ CSSD][2392676096]clssnm_skgxnmon: Compatible vendor clusterware not in use 2019-07-30 09:51:13.027: [ CSSD][2417317632]clssnmNotifyReq: type (20) 2019-07-30 09:51:13.027: [ CSSD][2417317632]clssnmReadNodeInfo: dynamic endp HA gipcha://nezhdb01:nm2_nezhdb-cluster len 36 ver 11.2.0.4.0 2019-07-30 09:51:13.027: [ CSSD][2417317632]clssnmReadNodeInfo: NM endp for node 1 (nezhdb01) - gipcha://nezhdb01:nm2_nezhdb-cluster 2019-07-30 09:51:13.027: [ CSSD][2417317632]clssnmReadNodeInfo: added node 1 (nezhdb01) to cluster, lease uniqueness 1561040032 2019-07-30 09:51:13.027: [ CSSD][2417317632]clssnmReadNodeInfo: dynamic endp HA gipcha://nezhdb02:nm2_nezhdb-cluster len 36 ver 11.2.0.4.0 2019-07-30 09:51:13.030: [ GPNP][2417317632] clsgpnp_Init: [at clsgpnp0.c:585] '/u01/11g/11.2.0/grid' in effect as GPnP home base. 2019-07-30 09:51:13.030: [ GPNP][2417317632] clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=18690, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=2003 2019-07-30 09:51:13.040: [ GPNP][2417317632] clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /u01/11g/11.2.0/grid/gpnp/nezhdb02/wallets/peer/ |
将节点1的crs服务关闭：
[root@nezhdb01 bin]# ./crsctl stop crs
查看ASM日志信息
[root@nezhdb01 diag]# vi /u01/11g/grid/diag/asm/+asm/+ASM1/trace/alert_+ASM1.log
| Tue Jul 30 11:47:21 2019 SQL> ALTER DISKGROUP OCR_VOTE DISMOUNT /* asm agent *//* {1:58087:22239} */ Tue Jul 30 11:47:21 2019 NOTE: ASM client cedb1:cedb disconnected unexpectedly. NOTE: check client alert log. Tue Jul 30 11:47:21 2019 SQL> ALTER DISKGROUP REDO DISMOUNT /* asm agent *//* {1:58087:22239} */ NOTE: Trace records dumped in trace file /u01/11g/grid/diag/asm/+asm/+ASM1/trace/+ASM1_ora_7363.trc NOTE: cache dismounting (clean) group 4/0xD1C91045 (REDO) NOTE: messaging CKPT to quiesce pins Unix process pid: 6585, image: oracle@nezhdb01 (TNS V1-V3) Tue Jul 30 11:47:21 2019 NOTE: LGWR doing clean dismount of group 4 (REDO) NOTE: LGWR closing thread 1 of diskgroup 4 (REDO) at ABA 12.22 NOTE: LGWR released thread recovery enqueue Tue Jul 30 11:47:22 2019 freeing rdom 4 Tue Jul 30 11:47:22 2019 NOTE: detached from domain 4 NOTE: cache dismounted group 4/0xD1C91045 (REDO) Tue Jul 30 11:47:22 2019 GMON dismounting group 4 at 13 for pid 29, osid 6585 NOTE: Disk REDO_0000 in mode 0x7f marked for de-assignment SUCCESS: diskgroup REDO was dismounted NOTE: cache deleting context for group REDO 4/0xd1c91045 SUCCESS: ALTER DISKGROUP REDO DISMOUNT /* asm agent *//* {1:58087:22239} */ SQL> ALTER DISKGROUP ARCH DISMOUNT /* asm agent *//* {1:58087:22239} */ Tue Jul 30 11:47:24 2019 SQL> ALTER DISKGROUP DATA DISMOUNT /* asm agent *//* {1:58087:22239} */ NOTE: cache dismounting (clean) group 1/0xD1B91042 (ARCH) NOTE: messaging CKPT to quiesce pins Unix process pid: 6585, image: oracle@nezhdb01 (TNS V1-V3) NOTE: cache dismounting (clean) group 2/0xD1B91043 (DATA) NOTE: LGWR doing clean dismount of group 1 (ARCH) NOTE: messaging CKPT to quiesce pins Unix process pid: 6588, image: oracle@nezhdb01 (TNS V1-V3) NOTE: LGWR closing thread 1 of diskgroup 1 (ARCH) at ABA 12.4096 NOTE: LGWR released thread recovery enqueue NOTE: LGWR doing clean dismount of group 2 (DATA) NOTE: LGWR closing thread 1 of diskgroup 2 (DATA) at ABA 12.1673 NOTE: LGWR released thread recovery enqueue freeing rdom 1 NOTE: detached from domain 1 NOTE: cache dismounted group 1/0xD1B91042 (ARCH) GMON dismounting group 1 at 14 for pid 29, osid 6585 NOTE: Disk ARCH_0000 in mode 0x7f marked for de-assignment SUCCESS: diskgroup ARCH was dismounted NOTE: cache deleting context for group ARCH 1/0xd1b91042 SUCCESS: ALTER DISKGROUP ARCH DISMOUNT /* asm agent *//* {1:58087:22239} */ freeing rdom 2 NOTE: detached from domain 2 NOTE: cache dismounted group 2/0xD1B91043 (DATA) GMON dismounting group 2 at 15 for pid 30, osid 6588 NOTE: Disk DATA_0000 in mode 0x7f marked for de-assignment SUCCESS: diskgroup DATA was dismounted NOTE: cache deleting context for group DATA 2/0xd1b91043 SUCCESS: ALTER DISKGROUP DATA DISMOUNT /* asm agent *//* {1:58087:22239} */ Tue Jul 30 11:47:31 2019 NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 3 Tue Jul 30 11:47:31 2019 ORA-15032: not all alterations performed ORA-15027: active use of diskgroup "OCR_VOTE" precludes its dismount ERROR: ALTER DISKGROUP OCR_VOTE DISMOUNT /* asm agent *//* {1:58087:22239} */ Tue Jul 30 11:47:32 2019 NOTE: client exited [6407] Tue Jul 30 11:47:33 2019 NOTE: ASMB process exiting due ASM instance shutdown (inactive for 1 seconds) Tue Jul 30 11:47:33 2019 Shutting down instance (immediate) Shutting down instance: further logons disabled Stopping background process MMNL Stopping background process MMON License high water mark = 21 SQL> ALTER DISKGROUP ALL DISMOUNT /* asm agent *//* {0:0:37339} */ NOTE: cache dismounting (clean) group 3/0xD1C91044 (OCR_VOTE) NOTE: messaging CKPT to quiesce pins Unix process pid: 6403, image: oracle@nezhdb01 (TNS V1-V3) Tue Jul 30 11:47:36 2019 NOTE: LGWR doing clean dismount of group 3 (OCR_VOTE) NOTE: LGWR closing thread 1 of diskgroup 3 (OCR_VOTE) at ABA 14.84 NOTE: LGWR released thread recovery enqueue Tue Jul 30 11:47:36 2019 freeing rdom 3 Tue Jul 30 11:47:37 2019 NOTE: detached from domain 3 NOTE: cache dismounted group 3/0xD1C91044 (OCR_VOTE) Tue Jul 30 11:47:37 2019 GMON dismounting group 3 at 17 for pid 23, osid 6403 NOTE: Disk OCR_VOTE_0000 in mode 0x7f marked for de-assignment NOTE: Disk OCR_VOTE_0001 in mode 0x7f marked for de-assignment NOTE: Disk OCR_VOTE_0002 in mode 0x7f marked for de-assignment SUCCESS: diskgroup OCR_VOTE was dismounted NOTE: cache deleting context for group OCR_VOTE 3/0xd1c91044 SUCCESS: ALTER DISKGROUP ALL DISMOUNT /* asm agent *//* {0:0:37339} */ Tue Jul 30 11:47:38 2019 Stopping background process VKTM Tue Jul 30 11:47:39 2019 freeing rdom 0 Tue Jul 30 11:47:42 2019 Instance shutdown complete |
节点2查看ASM日志信息：
| Tue Jul 30 11:48:03 2019 NOTE: No asm libraries found in the system NOTE: No asm libraries found in the system MEMORY_TARGET defaulting to 1128267776. * instance_number obtained from CSS = 2, checking for the existence of node 0... * node 0 does not exist. instance_number = 2 Starting ORACLE instance (normal) LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Initial number of CPU is 24 Number of processor cores in the system is 24 Number of processor sockets in the system is 4 Private Interface 'eth0:1' configured from GPnP for use as a private interconnect. [name='eth0:1', type=1, ip=169.254.219.245, mac=e4-1f-13-e3-61-9c, net=169.254.0.0/16, mask=255.255.0.0, use=haip:cluster_interconnect/62] Public Interface 'eth1' configured from GPnP for use as a public interface. [name='eth1', type=1, ip=10.163.24.34, mac=e4-1f-13-e3-61-9e, net=10.163.24.0/24, mask=255.255.255.0, use=public/1] Picked latch-free SCN scheme 3 Using LOG_ARCHIVE_DEST_1 parameter default value as /u01/11g/11.2.0/grid/dbs/arch Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is disabled NOTE: Volume support enabled NUMA system with 4 nodes detected Starting up: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options. ORACLE_HOME = /u01/11g/11.2.0/grid System name: Linux Node name: nezhdb02 Release: 2.6.32-642.el6.x86_64 Version: #1 SMP Wed Apr 13 00:51:26 EDT 2016 Machine: x86_64 Using parameter settings in server-side spfile +OCR_VOTE/nezhdb-cluster/asmparameterfile/registry.253.1003239933 System parameters with non-default values: large_pool_size = 12M instance_type = "asm" remote_login_passwordfile= "EXCLUSIVE" local_listener = "(ADDRESS=(PROTOCOL=TCP)(HOST=10.163.24.38)(PORT=11521))" asm_diskstring = "/dev/*" asm_diskgroups = "DATA" asm_diskgroups = "ARCH" asm_diskgroups = "REDO" asm_power_limit = 1 diagnostic_dest = "/u01/11g/grid" Cluster communication is configured to use the following interface(s) for this instance 169.254.219.245 cluster interconnect IPC version:Oracle UDP/IP (generic) IPC Vendor 1 proto 2 Tue Jul 30 11:48:05 2019 PMON started with pid=2, OS id=19300 Tue Jul 30 11:48:05 2019 PSP0 started with pid=3, OS id=19302 Tue Jul 30 11:48:06 2019 VKTM started with pid=4, OS id=19312 at elevated priority VKTM running at (1)millisec precision with DBRM quantum (100)ms Tue Jul 30 11:48:06 2019 GEN0 started with pid=5, OS id=19316 Tue Jul 30 11:48:06 2019 DIAG started with pid=6, OS id=19318 Tue Jul 30 11:48:06 2019 PING started with pid=7, OS id=19320 Tue Jul 30 11:48:06 2019 DIA0 started with pid=8, OS id=19322 Tue Jul 30 11:48:06 2019 LMON started with pid=9, OS id=19324 Tue Jul 30 11:48:06 2019 Reconfiguration started (old inc 0, new inc 2) ASM instance List of instances: 2 (myinst: 2) Global Resource Directory frozen * allocate domain 0, invalid = TRUE Communication channels reestablished Master broadcasted resource hash value bitmaps Non-local Process blocks cleaned out LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived Set master node info Submitted all remote-enqueue requests Dwn-cvts replayed, VALBLKs dubious All grantable enqueues granted Post SMON to start 1st pass IR Submitted all GCS remote-cache requests Post SMON to start 1st pass IR Fix write in gcs resources Reconfiguration complete Tue Jul 30 11:48:06 2019 LCK0 started with pid=22, OS id=19355 ORACLE_BASE not set in environment. It is recommended that ORACLE_BASE be set in the environment Tue Jul 30 11:48:09 2019 SQL> ALTER DISKGROUP ALL MOUNT /* asm agent call crs *//* {0:0:2} */ NOTE: Diskgroups listed in ASM_DISKGROUPS are DATA ARCH REDO NOTE: Diskgroup used for Voting files is: OCR_VOTE Diskgroup with spfile:OCR_VOTE Diskgroup used for OCR is:OCR_VOTE NOTE: cache registered group ARCH number=1 incarn=0x655de472 NOTE: cache began mount (first) of group ARCH number=1 incarn=0x655de472 NOTE: cache registered group DATA number=2 incarn=0x656de473 NOTE: cache began mount (first) of group DATA number=2 incarn=0x656de473 NOTE: cache registered group OCR_VOTE number=3 incarn=0x656de474 NOTE: cache began mount (first) of group OCR_VOTE number=3 incarn=0x656de474 NOTE: cache registered group REDO number=4 incarn=0x657de475 NOTE: cache began mount (first) of group REDO number=4 incarn=0x657de475 NOTE: Assigning number (1,0) to disk (/dev/asm-arch1) NOTE: Assigning number (2,0) to disk (/dev/asm-data1) NOTE: Assigning number (3,1) to disk (/dev/asm_ocrvote1) NOTE: Assigning number (3,2) to disk (/dev/asm_ocrvote3) NOTE: Assigning number (3,0) to disk (/dev/asm_ocrvote2) NOTE: Assigning number (4,0) to disk (/dev/asm-redo1) NOTE: GMON heartbeating for grp 1 GMON querying group 1 at 6 for pid 23, osid 19372 NOTE: cache opening disk 0 of grp 1: ARCH_0000 path:/dev/asm-arch1 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache mounting (first) external redundancy group 1/0x655DE472 (ARCH) * allocate domain 1, invalid = TRUE NOTE: attached to recovery domain 1 NOTE: cache recovered group 1 to fcn 0.45372 NOTE: redo buffer size is 256 blocks (1053184 bytes) NOTE: LGWR attempting to mount thread 1 for diskgroup 1 (ARCH) Process LGWR (pid 19338) is running at high priority QoS for Exadata I/O NOTE: LGWR found thread 1 closed at ABA 12.4096 NOTE: LGWR mounted thread 1 for diskgroup 1 (ARCH) NOTE: LGWR opening thread 1 at fcn 0.45372 ABA 13.4097 NOTE: cache mounting group 1/0x655DE472 (ARCH) succeeded NOTE: cache ending mount (success) of group ARCH number=1 incarn=0x655de472 NOTE: GMON heartbeating for grp 2 GMON querying group 2 at 8 for pid 23, osid 19372 NOTE: cache opening disk 0 of grp 2: DATA_0000 path:/dev/asm-data1 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache mounting (first) external redundancy group 2/0x656DE473 (DATA) Tue Jul 30 11:48:16 2019 * allocate domain 2, invalid = TRUE Tue Jul 30 11:48:16 2019 NOTE: attached to recovery domain 2 NOTE: cache recovered group 2 to fcn 0.7421 NOTE: redo buffer size is 256 blocks (1053184 bytes) Tue Jul 30 11:48:16 2019 NOTE: LGWR attempting to mount thread 1 for diskgroup 2 (DATA) NOTE: LGWR found thread 1 closed at ABA 12.1673 NOTE: LGWR mounted thread 1 for diskgroup 2 (DATA) NOTE: LGWR opening thread 1 at fcn 0.7421 ABA 13.1674 NOTE: cache mounting group 2/0x656DE473 (DATA) succeeded NOTE: cache ending mount (success) of group DATA number=2 incarn=0x656de473 Tue Jul 30 11:48:16 2019 NOTE: GMON heartbeating for grp 3 GMON querying group 3 at 10 for pid 23, osid 19372 NOTE: cache opening disk 0 of grp 3: OCR_VOTE_0000 path:/dev/asm_ocrvote2 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache opening disk 1 of grp 3: OCR_VOTE_0001 path:/dev/asm_ocrvote1 NOTE: F1X0 found on disk 1 au 2 fcn 0.0 NOTE: cache opening disk 2 of grp 3: OCR_VOTE_0002 path:/dev/asm_ocrvote3 NOTE: F1X0 found on disk 2 au 2 fcn 0.0 NOTE: cache mounting (first) normal redundancy group 3/0x656DE474 (OCR_VOTE) * allocate domain 3, invalid = TRUE NOTE: attached to recovery domain 3 NOTE: cache recovered group 3 to fcn 0.585 NOTE: redo buffer size is 256 blocks (1053184 bytes) NOTE: LGWR attempting to mount thread 1 for diskgroup 3 (OCR_VOTE) NOTE: LGWR found thread 1 closed at ABA 14.84 NOTE: LGWR mounted thread 1 for diskgroup 3 (OCR_VOTE) NOTE: LGWR opening thread 1 at fcn 0.585 ABA 15.85 NOTE: cache mounting group 3/0x656DE474 (OCR_VOTE) succeeded NOTE: cache ending mount (success) of group OCR_VOTE number=3 incarn=0x656de474 NOTE: GMON heartbeating for grp 4 GMON querying group 4 at 12 for pid 23, osid 19372 NOTE: cache opening disk 0 of grp 4: REDO_0000 path:/dev/asm-redo1 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache mounting (first) external redundancy group 4/0x657DE475 (REDO) * allocate domain 4, invalid = TRUE NOTE: attached to recovery domain 4 NOTE: cache recovered group 4 to fcn 0.77 NOTE: redo buffer size is 256 blocks (1053184 bytes) NOTE: LGWR attempting to mount thread 1 for diskgroup 4 (REDO) NOTE: LGWR found thread 1 closed at ABA 12.22 NOTE: LGWR mounted thread 1 for diskgroup 4 (REDO) NOTE: LGWR opening thread 1 at fcn 0.77 ABA 13.23 NOTE: cache mounting group 4/0x657DE475 (REDO) succeeded NOTE: cache ending mount (success) of group REDO number=4 incarn=0x657de475 Tue Jul 30 11:48:17 2019 NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 1 NOTE: redo buffer size is 256 blocks (1053184 bytes) NOTE: LGWR attempting to mount thread 1 for diskgroup 3 (OCR_VOTE) NOTE: LGWR found thread 1 closed at ABA 14.84 NOTE: LGWR mounted thread 1 for diskgroup 3 (OCR_VOTE) NOTE: LGWR opening thread 1 at fcn 0.585 ABA 15.85 NOTE: cache mounting group 3/0x656DE474 (OCR_VOTE) succeeded NOTE: cache ending mount (success) of group OCR_VOTE number=3 incarn=0x656de474 NOTE: GMON heartbeating for grp 4 GMON querying group 4 at 12 for pid 23, osid 19372 NOTE: cache opening disk 0 of grp 4: REDO_0000 path:/dev/asm-redo1 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache mounting (first) external redundancy group 4/0x657DE475 (REDO) * allocate domain 4, invalid = TRUE NOTE: attached to recovery domain 4 NOTE: cache recovered group 4 to fcn 0.77 NOTE: redo buffer size is 256 blocks (1053184 bytes) NOTE: LGWR attempting to mount thread 1 for diskgroup 4 (REDO) NOTE: LGWR found thread 1 closed at ABA 12.22 NOTE: LGWR mounted thread 1 for diskgroup 4 (REDO) NOTE: LGWR opening thread 1 at fcn 0.77 ABA 13.23 NOTE: cache mounting group 4/0x657DE475 (REDO) succeeded NOTE: cache ending mount (success) of group REDO number=4 incarn=0x657de475 Tue Jul 30 11:48:17 2019 NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 1 SUCCESS: diskgroup ARCH was mounted NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 2 SUCCESS: diskgroup DATA was mounted NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 3 SUCCESS: diskgroup OCR_VOTE was mounted NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 4 SUCCESS: diskgroup REDO was mounted SUCCESS: ALTER DISKGROUP ALL MOUNT /* asm agent call crs *//* {0:0:2} */ |
可以看到节点1关闭后，节点2立马就可以起来ASM实例了。
然后再将节点1起来，最后查看集群状态，都起来了：
| nezhdb02:/home/grid$crsctl stat res -t -------------------------------------------------------------------------------- NAME TARGET STATE SERVER STATE_DETAILS -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ARCH.dg ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.DATA.dg ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.LISTENER.lsnr ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.OCR_VOTE.dg ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.REDO.dg ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.asm ONLINE ONLINE nezhdb01 Started ONLINE ONLINE nezhdb02 Started ora.gsd ONLINE OFFLINE nezhdb01 ONLINE OFFLINE nezhdb02 ora.net1.network ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.ons ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 ora.registry.acfs ONLINE ONLINE nezhdb01 ONLINE ONLINE nezhdb02 -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE nezhdb02 ora.cedb.db 1 ONLINE ONLINE nezhdb01 Open 2 ONLINE ONLINE nezhdb02 Open ora.cvu 1 ONLINE ONLINE nezhdb02 ora.nezhdb01.vip 1 ONLINE ONLINE nezhdb01 ora.nezhdb02.vip 1 ONLINE ONLINE nezhdb02 ora.oc4j 1 ONLINE ONLINE nezhdb02 ora.scan1.vip 1 ONLINE ONLINE nezhdb02 |
669
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
