利用vmware搭建11g rac环境

问题一、VM创建共享存储
1.添加硬盘
2.设备通道scsi 1:1,scsi 1:2
步骤
 一、关闭防火墙
 [root@rac01 ~]# service iptables stop
[root@rac01 ~]# chkconfig iptables off
[root@rac01 ~]# chkconfig iptables –list
 iptables             0:off   1:off   2:off   3:off   4:off   5:off   6:off
[root@rac01 ~]# vi /etc/selinux/config  
# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
# enforcing - SELinux security policy is enforced.
 # permissive - SELinux prints warnings instead of enforcing.
# disabled - No SELinux policy is loaded.
SELINUX=disabled
 # SELINUXTYPE= can take one of these two values:
# targeted - Targeted processes are protected,
# mls - Multi Level Security protection.
SELINUXTYPE=targeted
二、修改hosts文件（所有节点）
 [root@rac01 ~]# vi /etc/hosts
 # Do not remove the following line, or various programs
# that require network functionality will fail.  
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.0.137  rac1
192.168.0.136  rac2
192.168.0.187  rac1-vip
192.168.0.186  rac2-vip
192.168.120.137 rac1
192.168.120.136 rac2
192.168.0.130  rac-scan



三、添加组和用户  创建组：
 [root@rac01 ~]# groupadd -g 1000 oinstall
[root@rac01 ~]# groupadd -g 1001 asmadmin
[root@rac01 ~]# groupadd -g 1002 dba
[root@rac01 ~]# groupadd -g 1003 asmdba
[root@rac01 ~]# groupadd -g 1004 asmoper  
创建grid用户：  
[root@rac01 ~]# useradd -u 1000 -g oinstall -G asmadmin,asmdba,asmoper,dba -d /home/grid -m grid  
为grid用户设密码：
 [root@rac01 ~]#passwd grid  
创建oracle用户：  
如果oracle用户不存在，则：
 [root@rac01 ~]# useradd -u 1001 -g oinstall -G dba,asmdba -d /home/oracle -m oracle
如果oracle用户已经存在，则：
 [root@rac01 ~]# usermod -g oinstall -G dba,asmdba –u 1001 oracle
为oracle用户设密码：
 [root@rac01 ~]# passwd oracle  
检测nobody用户
 [root@rac01 ~]# id nobody
如果不存在，则：
 [root@rac01 ~]# useradd nobody

四、配SSH互信
 为ssh和scp创建连接
ls -l /usr/local/bin/ssh ls -l /usr/local/bin/scp
不存在则创建
 [root@rac01 ~]# /bin/ln -s /usr/bin/ssh /usr/local/bin/ssh
[root@rac01 ~]# /bin/ln -s /usr/bin/scp /usr/local/bin/scp  
为grid用户配置SSH：
在每个节点上：
[root@rac01 ~]# su – grid
[grid@rac01 ~]# mkdir ~/.ssh
[grid@rac01 ~]#cd .ssh
[grid@rac01 ~]# ssh-keygen -t rsa
[grid@rac01 ~]# ssh-keygen -t dsa
在节点1上：
[grid@rac01 ~]# cd .ssh
[grid@rac01 ~]# touch authorized_keys
[grid@rac01 ~]# ssh rac1 cat /home/grid/.ssh/id_rsa.pub >> authorized_keys
[grid@rac01 ~]# ssh rac2 cat /home/grid/.ssh/id_rsa.pub >> authorized_keys
[grid@rac01 ~]# ssh rac1 cat /home/grid/.ssh/id_dsa.pub >> authorized_keys
[grid@rac01 ~]# ssh rac2 cat /home/grid/.ssh/id_dsa.pub >> authorized_keys
[grid@rac01 ~]# scp authorized_keys rac02:/home/grid/.ssh/
分别在每个节点上:  
[grid@rac01 ~]# ssh rac1 date
[grid@rac01 ~]# ssh rac2 date
[grid@rac01 ~]# ssh-agent $SHELL
[grid@rac01 ~]# ssh-add

为oracle用户配置SSH：
在每个节点上：  
[root@rac01 ~]# su – oracle
[oracle@rac01 ~]# mkdir ~/.ssh
[oracle@rac01 ~]#cd .ssh
 [oracle@rac01 ~]# ssh-keygen -t rsa
[oracle@rac01 ~]# ssh-keygen -t dsa  
在节点1上：
 [oracle@rac01 ~]# touch authorized_keys
 [oracle@rac01 ~]# ssh rac01 cat /home/oracle/.ssh/id_rsa.pub >> authorized_keys
[oracle@rac01 ~]# ssh rac02 cat /home/oracle/.ssh/id_rsa.pub >> authorized_keys
[oracle@rac01 ~]# ssh rac01 cat /home/oracle/.ssh/id_dsa.pub >> authorized_keys
[oracle@rac01 ~]# ssh rac02 cat /home/oracle/.ssh/id_dsa.pub >> authorized_keys
[oracle@rac01 ~]# scp authorized_keys rac02:/home/oracle/.ssh/    
分别在每个节点上:
 [oracle@rac01 ~]# ssh rac01 date
[oracle@rac01 ~]# ssh rac02 date  
[oracle@rac01 ~]# ssh-agent $SHELL
[oracle@rac01 ~]# ssh-add

五、更改内核参数

[root@rac1 ~]# vim /etc/sysctl.conf

fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmall = 2097152
kernel.shmmax = 4294967295
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586

ps：上述参数中通常只有一项需要我们更改，即kernel.shmmax，该参数推荐设定为物理内存的一半，由于安装crs的时候要求内存至少512M，因此我们此处也按照512*1024*1024来设置。

六、对磁盘分区
以下操作在节点1完成：
[root@rac01 ~]# fdisk /dev/sdb
Command (m for help): p  
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders  
Units = cylinders of 16065 * 512 = 8225280 bytes    
Device Boot      Start         End      Blocks   Id  System  
Command (m for help): n
Command action  
 e   extended    
p   primary partition (1-4)
p  
Partition number (1-4): 1  
First cylinder (1-1044, default 1):  
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044):  
Using default value 1044  
Command (m for help): p  

Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders  
Units = cylinders of 16065 * 512 = 8225280 bytes      
Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        1044     8385898+  83  Linux  
Command (m for help): w  
The partition table has been altered!  
Calling ioctl() to re-read partition table.
Syncing disks.  
...
fdisk /dev/sdc
fdisk /dev/sdd 
七、安装asmlib并进行配置

[root@rac01 ~]#uname –r
在每个节点上都进行安装 
[root@rac01 ~]# rpm -ihv oracleasm-support-2.1.3-1.el5.x86_64.rpm  
[root@rac01 ~]# rpm -ihv oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm
[root@rac01 ~]# rpm -ihv oracleasmlib-2.0.4-1.el5.x86_64.rpm 

配置asmlib  
以下操作在每个节点上进行：  
[root@rac01 ~]# oracleasm configure -i
Configuring the Oracle ASM library driver.  
This will configure the on-boot properties of the Oracle ASM library driver.  
The following questions will determine whether the driver is
loaded on boot and what permissions it will have.  The current values
will be shown in brackets ('[]').  Hitting without typing an
answer will keep that current value.  Ctrl-C will abort. 

 Default user to own the driver interface []: grid  
Default group to own the driver interface []: asmadmin 
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]:  
Writing Oracle ASM library driver configuration: done  
[root@rac01 ~]# oracleasm init  
Creating /dev/oracleasm mount point: /dev/oracleasm
Loading module "oracleasm": oracleasm  
Mounting ASMlib driver filesystem: /dev/oracleasm 

初始化 ASM磁盘  
以下操作在节点1完成：  
[root@asm01 ~]# oracleasm createdisk disk01 /dev/sdb1
Writing disk header: done Instantiating disk: done  
[root@asm01 ~]# oracleasm createdisk disk02 /dev/sdc1
Writing disk header: done
Instantiating disk: done  

oracleasm createdisk disk03 /dev/sdd1
oracleasm createdisk disk04 /dev/sde1
oracleasm createdisk disk05 /dev/sdf1
oracleasm createdisk disk06 /dev/sdg1    
检查ASM硬盘配置 节点1：  
[root@rac01 asmlib]# oracleasm listdisks
DISK01
DISK02
DISK03  
其他节点：  
[root@rac02 asmlib]# oracleasm listdisks
----注意：此处命令输出为空是正常
[root@rac02 asmlib]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "DISK01"
Instantiating disk "DISK02"
Instantiating disk "DISK03" 
[root@rac02 asmlib]# oracleasm listdisks
DISK01
DISK02
DISK03

八、Grid安装过程

grid用户：  
[grid@rac01 ~]# vi .bash_profile  
export ORACLE_SID=+ASM1/+ASM2
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=/u01/app/grid/11.2
export PATH=$PATH:$ORACLE_HOME/bin  

oracle用户：  
[oracle@rac01 ~]# vi .bash_profile
export ORACLE_SID=racdb1/racdb2  
export ORACLE_UNQNAME=$ORACLE_SID
export ORACLE_BASE=/u01/app/oracle  
export ORACLE_HOME=$ORACLE_BASE/11.2/db_1
export PATH=$PATH:$ORACLE_HOME/bin

建立相关目录：  
[root@rac01 ~]# mkdir -p /u01/app/oracle  
[root@rac01 ~]# mkdir -p /u01/app/grid/11.2
[root@rac01 ~]# chown -R grid:oinstall /u01/app/oracle  
[root@rac01 ~]# chown -R grid:oinstall /u01/app/grid/11.2
[root@rac01 ~]# chmod 775 -R     /u01/app/oracle  
[root@rac01 ~]# chmod 775 -R    /u01/app/grid/11.2/

[root@rac01 ~]#mkdir -p /u01/app/oracle  
[root@rac01 ~]#mkdir -p /u01/app/oracle/11.2/db_1  
[root@rac01 ~]#chown -R oracle:oinstall /u01/app/oracle/11.2/db_1
[root@rac01 ~]#chmod 775 -R /u01/app/oracle/11.2/db_1

安装grid软件

解决方法：ping 下rac2-vip的IP地址，确定其地址是否已被占用



解决方法：检查host文件，能否正确解析域名，修改完host文件

问题三、11g 的rac 环境，vote和ocr 合二为一了

问题四、安装完grid软件后，监听没有启动
解决方法：
[grid@rac2 bin]$ ./srvctl status listener
PRCN-2044 : No listener exists
解决方法：
     手动增加listener信息，并启动listener。
[ grid@rac2 bin]$ ./srvctl add listener
[ grid@rac2 bin]$ ./srvctl status listener
Listener LISTENER is enabled
Listener LISTENER is not running
[ grid@rac2 bin]$ ./srvctl start listener
[ grid@rac2 bin]$ ./srvctl status listener
Listener LISTENER is enabled
Listener LISTENER is running on node(s): rac2
     至此问题解决！

问题五、

解决方法：暂时先忽略这些错误，强制安装

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/30158401/viewspace-1814995/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/30158401/viewspace-1814995/