[    CSSD]2010-05-26 19:15:07.589 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab0008f78), asqhd (0x2aaab0008f50), flags 0x081
[    CSSD]2010-05-26 19:15:07.589 [1230670144] >TRACE:   clssnmCheckDskInfo: No wait for node 0, , defined 0, network state 0, disk state 0, disk status 0
[    CSSD]2010-05-26 19:15:07.589 [1230670144] >TRACE:   clssnmCheckDskInfo: No wait for node 1, racdb5, defined 1, network state 3, disk state 3, disk status 3
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmCheckDskInfo: node 1, clustersz 1, leader 1
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmCheckDskInfo: skipping active node 1.
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmEvict: Start
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmEvict: Evicting node 2, racdb6, birth 136, death 137, impendingrcfg 1, stateflags 0x40d
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmSendShutdown: req to node 2, kill time 379123574
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmAllocAsyncMsg: msg (0x2aaaac08d648), asqhd (0x2aaaac08d620), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmDiscHelper: racdb6, node(2) connection failed, con (0x99e6240), probe((nil))
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmDiscHelper: node 2 clean up, con (0x99e6240), init state 5, cur state 5
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 1
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock DG+ASM event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: sending message to client 0x2aaaac065f80 id 0x2aaaac062d30 size 144 seq 36
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab000c778), asqhd (0x2aaab000c750), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmFreeAsyncMsg: freeing msg (0x2aaaac08d648), asqhd (0x2aaaac08d620), sendct 0, flags 0x00000000
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmClusterListener: Entering select blocking
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 1
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock ORA_CLSRD_1_racweb event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: sending message to client 0x2aaaac07ac20 id 0x2aaaac07a920 size 144 seq 29
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab000bb28), asqhd (0x2aaab000bb00), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitOnEvictions: Start
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmClusterListener: Entering select blocking
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitOnEvictions: node 2, racdb6, undead 0
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitThread: thrd(3), timeout(0), wakeonpost(2)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock ORA_CLSRD_1_racweb event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock ORA_CLSRD_2_racweb event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock OSM_ALL event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: No event, groupName(OSM_ALL)  event(2) member 0, events 0x1, state 0x0
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmSetupAckWait: Ack message type (15)
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmDiscCheckin: disconnected connection(0x99e6240)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 1
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmSetupAckWait: node(1) is ACTIVE
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmClusterListener: Entering select blocking
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock DBRACWEB event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmSendUpdate: syncSeqNo(137)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: sending message to client 0x2aaaac0841f0 id 0x2aaaac083ef0 size 144 seq 36
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab0009c58), asqhd (0x2aaab0009c30), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmAllocAsyncMsg: msg (0x2aaaac0a1ee8), asqhd (0x2aaaac0a1ec0), flags 0x083
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmsendmsg: sending msg type 14 to node 1
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmsendmsg: msg queued type 14, qmsgh (0x2aaaac05eaa0) qmsg (0x2aaaac05eab0)
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmFreeAsyncMsg: freeing msg (0x2aaaac0a1ee8), asqhd (0x2aaaac0a1ec0), sendct 0, flags 0x00000002
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 1
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitForAcks: Ack message type(15), ackCount(1)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock DGRACWEB event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmHandleUpdate: src[1] dest[1] dom[0] seq[60] sync[137]
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitThread: thrd(3), timeout(1000), wakeonpost(2)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: sending message to client 0x2aaaac080de0 id 0x2aaaac080ae0 size 144 seq 36
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmUpdateNodeState: node 0, state (0/0) unique (0/0) prevConuni(0) birth (0/0) (old/new)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab000f878), asqhd (0x2aaab000f850), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmDeactivateNode: node 0, state 0

[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmUpdateNodeState: node 1, state (3/3) unique (1274492478/1274492478) prevConuni(0) birth (122/122) (old/new)
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmUpdateNodeState: node 1, racdb5, state set to 3
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmUpdateNodeState: node 2, state (5/0) unique (1274793098/1274793098) prevConuni(1274793098) birth (136/136) (old/new)
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmDeactivateNode: node 2, state 5

[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmDeactivateNode: node 2 (racdb6) left cluster

[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmSendAck: node(1) domain(0) syncSeqNo(137) type(15)
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmAllocAsyncMsg: msg (0x9beab18), asqhd (0x9beaaf0), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmsendmsg: sending msg type 15 to node 1
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmsendmsg: msg queued type 15, qmsgh (0x9be8940) qmsg (0x9be8950)
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmFreeAsyncMsg: freeing msg (0x9beab18), asqhd (0x9beaaf0), sendct 0, flags 0x00000000
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmQueueClientEvent:  Sending Event(1), type 1, incarn 137
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmQueueClientEvent: Node[1] state = 3, birth = 122, unique = 1274492478
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmQueueClientEvent: Node[2] state = 0, birth = 0, unique = 0
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >USER:    clssnmHandleUpdate: SYNC(137) from node(1) completed
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >USER:    clssnmHandleUpdate: NODE 1 (racdb5) IS ACTIVE MEMBER OF CLUSTER
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmHandleUpdate: diskTimeout set to (200000)ms
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: groupName(DGRACWEB) count(2) master(0) event(2), incarn 136, mbrc 2, to member 0, events 0x0, state 0x0
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 1
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmHandleAck: src[1] dest[1] dom[0] seq[60] sync[137] type[15] ackCount(0)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock DAALL_DB event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmClusterListener: Entering select blocking
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: No event, groupName(DAALL_DB)  event(2) member 0, events 0x1, state 0x0
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitForAcks: done, msg type(15)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: No event, groupName(DAALL_DB)  event(2) member 1, events 0x1, state 0x0
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmDoSyncUpdate: Sync 137 complete!
[    CSSD]2010-05-26 19:15:07.590 [1157241152] >TRACE:   clssnmClusterListener: Entering select blocking
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 2
[    CSSD]2010-05-26 19:15:07.590 [1230670144] >TRACE:   clssnmWaitThread: thrd(3), timeout(-1), wakeonpost(0)
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: skipping remote member 3
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmSuspendAllGrocks: Issue grock CRSDMAIN event SUSPEND
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: sending message to client 0x2aaaac05ad70 id 0x2aaaac05aa70 size 144 seq 44
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssscAllocAsyncMsg: msg (0x2aaab0007ba8), asqhd (0x2aaab0007b80), flags 0x081
[    CSSD]2010-05-26 19:15:07.590 [3153675504] >TRACE:   clssgmQueueGrockEvent: groupName(CRSDMAIN) count(2) master(1) event(2), incarn 136, mbrc 2, to member 1, events 0x8, state 0x0