oracle clusterware安装遇到的问题

安装clusterware最后出现问题，在最后一个节点执行root.sh时出现：
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
/u01/app/oracle/product/10.2.0/crs_1/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory

按照网上的方法修改两个节点上的vipca文件，在vipca的最后的加上
unset LD_ASSUME_KERNEL

如下

esac

unset LD_ASSUME_KERNEL

ARGUMENTS=""
NUMBER_OF_ARGUMENTS=$#
if [ $NUMBER_OF_ARGUMENTS -gt 0 ]; then
ARGUMENTS=$*
fi

然后运行./vipca
[root@rac2 bin]# ./vipca
PRKH-1010 : 无法与 CRS 服务通信。
[PRKH-1000 : 无法加载 SRVM HAS 共享库
[PRKN-1008 : 无法加载共享库 "srvmhas10"
或从属库, 从
LD_LIBRARY_PATH="/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386/client:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/../lib/i386:/u01/crs/oracle/product/10.2.0/crs/lib32:/u01/crs/oracle/product/10.2.0/crs/srvm/lib32:/u01/crs/oracle/product/10.2.0/crs/lib:/u01/crs/oracle/product/10.2.0/crs/srvm/lib:"
[java.lang.UnsatisfiedLinkError: /u01/crs/oracle/product/10.2.0/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
PRKH-1010 : 无法与 CRS 服务通信。
[PRKH-1000 : 无法加载 SRVM HAS 共享库
[PRKN-1008 : 无法加载共享库 "srvmhas10"
或从属库, 从
LD_LIBRARY_PATH="/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386/client:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/../lib/i386:/u01/crs/oracle/product/10.2.0/crs/lib32:/u01/crs/oracle/product/10.2.0/crs/srvm/lib32:/u01/crs/oracle/product/10.2.0/crs/lib:/u01/crs/oracle/product/10.2.0/crs/srvm/lib:"
[java.lang.UnsatisfiedLinkError: /u01/crs/oracle/product/10.2.0/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
PRKH-1010 : 无法与 CRS 服务通信。
[PRKH-1000 : 无法加载 SRVM HAS 共享库
[PRKN-1008 : 无法加载共享库 "srvmhas10"
或从属库, 从
LD_LIBRARY_PATH="/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386/client:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/lib/i386:/u01/crs/oracle/product/10.2.0/crs/jdk/jre/../lib/i386:/u01/crs/oracle/product/10.2.0/crs/lib32:/u01/crs/oracle/product/10.2.0/crs/srvm/lib32:/u01/crs/oracle/product/10.2.0/crs/lib:/u01/crs/oracle/product/10.2.0/crs/srvm/lib:"
[java.lang.UnsatisfiedLinkError: /u01/crs/oracle/product/10.2.0/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]


根据上面的错误，频繁出现32,i386的数字，怀疑是不是有些32位的包没有装，在最开始安装rpm包时，还为这事纠结来着，既有32位的，又有64位的，32位的我还装吗？后来就没有装32位的包。在网上查找这方面的信息也有说是因为如此。
安装相关32位rpm包，重新安装clusterware...

这一次出现问题了，不知为何在rac1无故一直重启，没能找到解决办法，只好重新创建rac1。

这时同样会出现
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
/u01/app/oracle/product/10.2.0/crs_1/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory
这次修改vipca，添加unset LD_ASSUME_KERNEL问题得到解决，最后确认clusterware安装成功：
[root@rac1 bin]# ./crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy
[root@rac1 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1
ora.rac2.gsd application 0/5 0/0 ONLINE ONLINE rac2
ora.rac2.ons application 0/3 0/0 ONLINE ONLINE rac2

ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2

启动两个节点，检查crs出现unknown问题
[root@rac1 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1
ora.rac2.gsd application 0/5 0/0 ONLINE UNKNOWN rac2
ora.rac2.ons application 0/3 0/0 ONLINE UNKNOWN rac2
ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2

[root@rac1 bin]# ./srvctl status nodeapps -n rac2
/u01/crs/oracle/product/10.2.0/crs/jdk/jre/bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory
[root@rac1 bin]# vi srvctl
[root@rac1 bin]# ./srvctl status nodeapps -n rac2
VIP 正在运行的节点: rac2
GSD 没有运行的节点: rac2
PRKO-2016 : 在节点上检查监听程序的条件时出错: rac2
ONS 守护程序未在节点上运行:rac2

在任一节点上，使用crs_stop命令停止unknown 的服务后重新启动：
[root@rac1 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1
ora.rac2.gsd application 0/5 0/0 ONLINE UNKNOWN rac2
ora.rac2.ons application 0/3 0/0 ONLINE UNKNOWN rac2
ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2
[root@rac1 bin]# ./crs_stop ora.rac2.gsd
Attempting to stop `ora.rac2.gsd` on member `rac2`
Stop of `ora.rac2.gsd` on member `rac2` succeeded.
[root@rac1 bin]# ./crs_start ora.rac2.gsd
Attempting to start `ora.rac2.gsd` on member `rac2`
Start of `ora.rac2.gsd` on member `rac2` succeeded.
[root@rac1 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1
ora.rac2.gsd application 0/5 0/0 ONLINE ONLINE rac2
ora.rac2.ons application 0/3 0/0 ONLINE UNKNOWN rac2
ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2
[root@rac1 bin]# ./crs_stop ora.rac2.ons
Attempting to stop `ora.rac2.ons` on member `rac2`
Stop of `ora.rac2.ons` on member `rac2` succeeded.
[root@rac1 bin]# ./crs_start ora.rac2.ons
Attempting to start `ora.rac2.ons` on member `rac2`
Start of `ora.rac2.ons` on member `rac2` succeeded.
[root@rac1 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1
ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1
ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1
ora.rac2.gsd application 0/5 0/0 ONLINE ONLINE rac2
ora.rac2.ons application 0/3 0/0 ONLINE ONLINE rac2
ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2

建库的时候出现错误，需要删除磁盘组中的文件，可以使用asmcmd来删除。

参考：

http://space.itpub.net/9390331/viewspace-631372

http://blog.csdn.net/tianlesoftware/article/details/5349003