[grid@vastdata2 ~]$ crsctl stat res -t
NAME TARGET STATE SERVER STATE_DETAILS
Local Resources
ora.DATA.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.FRA.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.LISTENER.lsnr
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.OCR.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.asm
ONLINE ONLINE vastdata1 Started
ONLINE ONLINE vastdata2 Started
ora.gsd
OFFLINE OFFLINE vastdata1
OFFLINE OFFLINE vastdata2
ora.net1.network
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.ons
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE vastdata2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE vastdata1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE vastdata1
ora.cvu
1 ONLINE ONLINE vastdata2
ora.oc4j
1 ONLINE ONLINE vastdata2
ora.prod.db
1 ONLINE OFFLINE Instance Shutdown
2 ONLINE OFFLINE Instance Shutdown
ora.scan1.vip
1 ONLINE ONLINE vastdata2
ora.scan2.vip
1 ONLINE ONLINE vastdata1
ora.scan3.vip
1 ONLINE ONLINE vastdata1
ora.vastdata1.vip
1 ONLINE ONLINE vastdata1
ora.vastdata2.vip
1 ONLINE ONLINE vastdata2
[oracle@vastdata2 ~]$ srvctl start database -d prod
PRCR-1079 : Failed to start resource ora.prod.db
CRS-5017: The resource action "ora.prod.db start" encountered the following error:
ORA-00214: control file '+FRA/prod/controlfile/control02.ctl' version 1684 inconsistent with file '+DATA/prod/controlfile/control01.ctl' version 1678
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/vastdata1/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-5017: The resource action "ora.prod.db start" encountered the following error:
ORA-00214: control file '+FRA/prod/controlfile/control02.ctl' version 1684 inconsistent with file '+DATA/prod/controlfile/control01.ctl' version 1678
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/vastdata2/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.prod.db' on 'vastdata1' failed
CRS-2674: Start of 'ora.prod.db' on 'vastdata2' failed
CRS-2632: There are no more servers to try to place resource 'ora.prod.db' on that would satisfy its placement policy
[grid@vastdata2 ~]$ su - oracle
Password:
[oracle@vastdata2 ~]$ oerr ora 00214
00214, 00000, "control file '%s' version %s inconsistent with file '%s' version %s"
// *Cause: An inconsistent set of control files, datafiles/logfiles, and redo
// files was used.
// *Action: Use a consistant set of control files, datafiles/logfiles, and redo
// log files. That is, all the files must be for the same database
// and from the same time period.
[oracle@vastdata2 ~]$ su - grid
Password:
[grid@vastdata2 ~]$ asmcmd
ASMCMD> ls
DATA/
FRA/
OCR/
ASMCMD> cp +FRA/prod/controlfile/control02.ctl +DATA/prod/controlfile/control01.ctl
copying +FRA/prod/controlfile/control02.ctl -> +DATA/prod/controlfile/control01.ctl
[grid@vastdata2 ~]$ su - oracle
Password:
[oracle@vastdata2 ~]$ rman target /
Recovery Manager: Release 11.2.0.4.0 - Production on Thu May 4 00:35:03 2017
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
connected to target database (not started)
RMAN> startup
Oracle instance started
database mounted
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of startup command at 05/04/2017 00:35:27
ORA-01113: file 1 needs media recovery
ORA-01110: data file 1: '+DATA/prod/datafile/system01.dbf'
RMAN> recover database;
Starting recover at 2017-05-04 00:35:42
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=36 instance=PROD2 device type=DISK
starting media recovery
archived log for thread 2 with sequence 8 is already on disk as file +FRA/prod/archivelog/2_8_942617654.arc
archived log file name=+FRA/prod/archivelog/2_8_942617654.arc thread=2 sequence=8
media recovery complete, elapsed time: 00:00:04
Finished recover at 2017-05-04 00:35:51
RMAN> alter database open;
database opened
RMAN> shutdown immediate
using target database control file instead of recovery catalog
database closed
database dismounted
Oracle instance shut down
RMAN> exit
[oracle@vastdata2 ~]$ srvctl start database -d prod
[oracle@vastdata2 ~]$ su - grid
Password:
[grid@vastdata2 ~]$ crsctl stat res -t
NAME TARGET STATE SERVER STATE_DETAILS
Local Resources
ora.DATA.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.FRA.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.LISTENER.lsnr
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.OCR.dg
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.asm
ONLINE ONLINE vastdata1 Started
ONLINE ONLINE vastdata2 Started
ora.gsd
OFFLINE OFFLINE vastdata1
OFFLINE OFFLINE vastdata2
ora.net1.network
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
ora.ons
ONLINE ONLINE vastdata1
ONLINE ONLINE vastdata2
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE vastdata2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE vastdata1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE vastdata1
ora.cvu
1 ONLINE ONLINE vastdata2
ora.oc4j
1 ONLINE ONLINE vastdata2
ora.prod.db
1 ONLINE ONLINE vastdata1 Open
2 ONLINE ONLINE vastdata2 Open
ora.scan1.vip
1 ONLINE ONLINE vastdata2
ora.scan2.vip
1 ONLINE ONLINE vastdata1
ora.scan3.vip
1 ONLINE ONLINE vastdata1
ora.vastdata1.vip
1 ONLINE ONLINE vastdata1
ora.vastdata2.vip
1 ONLINE ONLINE vastdata2
ok~