oracle10g重新配置crs,不小心在oracle 10g rac的副节点下执行了localconfig add，然后副节点的crs启动不了了...

本帖最后由 snowolf128 于 2013-11-27 19:50 编辑

在安装另外一套rac的时候，运行dbca配置asm提示要运行#/oracle/product/10.2.0/db/bin/localconfig add，但是不小心在正常的rac的副节点上执行了，于是杯具发送了，副节点的rac当了

当时看到：

什么产生ocr key，什么要等待600s初始化，然后等了5分钟左右发现错了，就赶紧强制出来了。

现在查/etc/oracle/ocr.loc，已经把主节点的信息复制过来，然后在副节点运行ocrcheck正常，同主节点的信息是一样的。

但是执行crsctl start crs虽然信息报马上启动，但是死活启动不了，怎么办？

#crsctl check crs

Failure 1 contacting CSS daemon

Cannot communicate with CRS

Cannot communicate with EVM

----------------------------------

cat $CRS_HOME/log/hostanme/alertORCLE-b.log

[client(23104)]CRS-1006:The OCR location /oracle/product/10.2.0/db/cdata/localhost/local.ocr is inaccessible. Details in /oracle/product/10.2.0/crs/log/ORCLE-B/client/clscfg.log.

2013-11-27 15:39:28.853

[client(23104)]CRS-1006:The OCR location /oracle/product/10.2.0/db/cdata/localhost/local.ocr is inaccessible. Details in /oracle/product/10.2.0/crs/log/ORCLE-B/client/clscfg.log.

2013-11-27 15:39:29.392

[client(23104)]CRS-1001:The OCR was formatted using version 2.

--------------------------

crsd/crsd.log中看到：

2013-11-27 19:23:14.506: [ COMMCRS][1102047552]clsc_connect: (0xd1097d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ORCLE-B_crs))

2013-11-27 19:23:14.506: [ CSSCLNT][2454510320]clsssInitNative: connect failed, rc 9

2013-11-27 19:23:14.507: [  CRSRTI][2454510320]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2013-11-27 19:23:15.895: [ COMMCRS][1102047552]clsc_connect: (0xd1097d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ORCLE-B_crs))

2013-11-27 19:23:15.895: [ CSSCLNT][2454510320]clsssInitNative: connect failed, rc 9

2013-11-27 19:23:15.896: [  CRSRTI][2454510320]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..

----------------------------------

b节点的系统日志：

Wed Nov 27 15:39:31 2013

Errors in file /oracle/admin/ORCLE/bdump/ORCLE2_asmb_11450.trc:

ORA-15064: communication failure with ASM instance

ORA-03113: end-of-file on communication channel

Wed Nov 27 15:39:31 2013

ASMB: terminating instance due to error 15064

Wed Nov 27 15:39:31 2013

Errors in file /oracle/admin/ORCLE/bdump/ORCLE2_lmon_11388.trc:

ORA-15064: communication failure with ASM instance

Wed Nov 27 15:39:31 2013

Errors in file /oracle/admin/ORCLE/bdump/ORCLE2_lms1_11396.trc:

ORA-15064: communication failure with ASM instance

Wed Nov 27 15:39:31 2013

Errors in file /oracle/admin/ORCLE/bdump/ORCLE2_lms0_11392.trc:

ORA-15064: communication failure with ASM instance

Wed Nov 27 15:39:31 2013

System state dump is made for local instance

System State dumped to trace file /oracle/admin/ORCLE/bdump/ORCLE2_diag_11384.trc

Wed Nov 27 15:39:32 2013

Trace dumping is performing id=[cdmp_20131127153931]

Wed Nov 27 15:39:36 2013

Instance terminated by ASMB, pid = 11450

--------------------

[root@ORCLE-B bdump]# cat /oracle/admin/ORCLE/bdump/ORCLE2_asmb_11450.trc

/oracle/admin/ORCLE/bdump/ORCLE2_asmb_11450.trc

Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production

With the Partitioning, Real Application Clusters, OLAP, Data Mining

and Real Application Testing options

ORACLE_HOME = /oracle/product/10.2.0/db

System name:    Linux

Node name:      ORCLE-B

Release:        2.6.18-164.el5

Version:        #1 SMP Tue Aug 18 15:51:48 EDT 2009

Machine:        x86_64

Instance name: ORCLE2

Redo thread mounted by this instance: 2

Oracle process number: 23

Unix process pid: 11450, image: oracle@ORCLE-B (ASMB)

*** 2013-11-27 15:39:31.543

*** SERVICE NAME

SYS$BACKGROUND) 2013-11-27 15:39:31.522

*** SESSION ID

532.1) 2013-11-27 15:39:31.522

error 15064 detected in background process

ORA-15064: communication failure with ASM instance

ORA-03113: end-of-file on communication channel

ksuitm: waiting up to [5] seconds before killing DIAG