该楼层疑似违规已被系统折叠 隐藏此楼查看此楼
Script 'root.sh' on Node Fails with: " 'ROOTCRS_STACK' with status:START.Error code is 256 " (Doc ID 1478917.1)
APPLIES TO:
Oracle Database - Enterprise Edition - Version 11.2.0.3 and later
Linux x86-64
Checked for relevance on 27-Aug-2014
SYMPTOMS
About the environment: 4 node RAC - 11.2.0.3 - Linux x86-64 (issue has been reported so far on Linux platform)
root.sh on node3, gives the following errors:
# /u01/app/grid/11.2.0/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/grid/11.2.0
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/grid/11.2.0/crs/install/crsconfig_params
User ignored Prerequisites during installation
Failed to write the checkpoint:'ROOTCRS_STACK' with status:START.Error code is 256
Failed to add (property/value):('VERSION/'11.2.0.3.0') for checkpoint:ROOTCRS_STACK.Error code is 256
Failed to write the checkpoint:'ROOTCRS_PARAM' with status:START.Error code is 256
Failed to write contents of pfile :/u01/app/grid/11.2.0/crs/install/crsconfig_params for checkpoint:ROOTCRS_PARAM. Error code is 256
Failed to write the checkpoint:'ROOTCRS_PARAM' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OSDSETUP' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OSDSETUP' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_ONETIME' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_ONETIME' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OLR' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OLR' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OLR' with status:SUCCESS.Error code is 256
OLR initialization - successful
Failed to write the checkpoint:'ROOTCRS_GPNPSETUP' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_GPNPSETUP' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OHASD' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_OHASD' with status:SUCCESS.Error code is 256
Adding Clusterware entries to inittab
Failed to write the checkpoint:'ROOTCRS_INITRES' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_INITRES' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_ACFSINST' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_ACFSINST' with status:SUCCESS.Error code is 256
Failed to write the checkpoint:'ROOTCRS_BOOTCFG' with status:START.Error code is 256
Failed to write the checkpoint:'ROOTCRS_BOOTCFG' with status:START.Error code is 256
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node lon6whspdorc001a, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
Failed to write the checkpoint:'ROOTCRS_BOOTCFG' with status:SUCCESS.Error code is 256
Errors continue to occur even after deconfiguring and reconfiguring Oracle Clusterware (Note:1377349.1)
CHANGES
root.sh log (under /install/root__.log) shows:
2012-06-25 10:56:44: Executing cmd: /u01/app/grid/11.2.0/bin/crsctl start resource ora.asm -init
2012-06-25 10:56:46: Command output:
> CRS-2672: Attempting to start 'ora.drivers.acfs' on 'NODE3'
> CRS-2676: Start of 'ora.drivers.acfs' on 'NODE3' succeeded
> CRS-2672: Attempting to start 'ora.asm' on 'NODE3'
> ORA-21561: OID generation failed
> CRS-5017: The resource action "ora.asm start" encountered the following error:
> ORA-21561: OID generation failed
> . For details refer to "(:CLSN00107:)" in "/u01/app/grid/11.2.0/log/NODE3/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
> CRS-2674: Start of 'ora.asm' on 'NODE3' failed
...
CRS-2672: Attempting to start 'ora.asm' on 'NODE3'
ORA-21561: OID generation failed
CRS-5017: The resource action "ora.asm start" encountered the following error:
ORA-21561: OID generation failed
. For details refer to "(:CLSN00107:)" in "/u01/app/grid/11.2.0/log/NODE3/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.asm' on 'NODE3' failed
CRS-2679: Attempting to clean 'ora.asm' on 'NODE3'
ORA-21561: OID generation failed
CRS-2681: Clean of 'ora.asm' on 'NODE3' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'NODE3'
CRS-2677: Stop of 'ora.drivers.acfs' on 'NODE3' succeeded
CRS-4000: Command Start failed, or completed with errors.
2012-06-25 10:57:38: Failed to start Oracle Grid Infrastructure stack
2012-06-25 10:57:38: ###### Begin DIE Stack Trace ######
2012-06-25 10:57:38: Package File Line Calling
2012-06-25 10:57:38: --------------- -------------------- ---- ----------
2012-06-25 10:57:38: 1: main rootcrs.pl 375 crsconfig_lib::dietrap
2012-06-25 10:57:38: 2: crsconfig_lib crsconfig_lib.pm 1272 main::__ANON__
2012-06-25 10:57:38: 3: crsconfig_lib crsconfig_lib.pm 1171 crsconfig_lib::start_cluster
2012-06-25 10:57:38: 4: main rootcrs.pl 803 crsconfig_lib::perform_start_cluster
2012-06-25 10:57:38: ####### End DIE Stack Trace #######
2012-06-25 10:57:38: 'ROOTCRS_STACK' checkpoint has failed
2012-06-25 10:57:38: Running as user oracle: /u01/app/grid/11.2.0/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -state FAIL
2012-06-25 10:57:38: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/11.2.0/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -state FAIL '
2012-06-25 10:57:39: Removing file /tmp/file7YDj0u
2012-06-25 10:57:39: Successfully removed file: /tmp/file7YDj0u
2012-06-25 10:57:39: /bin/su exited with rc=1
2012-06-25 10:57:39: Failed to write the checkpoint:'ROOTCRS_STACK' with status:FAIL.Error code is 256
CAUSE
Typo for the domain name stored in '/etc/sysconfig/network' file
SOLUTION
While attempting to diagnose the issue, found there was a typo for the domain name in '/etc/sysconfig/network' (missing a letter in the domain name).
After fixing this and then de-configuring and re-configuring the Oracle Clusterware, the issue got resolved.