规划
| RAC规划 | ||
| 主机名 | Cltrac1 | Cltrac2 |
| Private IP | 172.16.1.3 | 172.16.1.4 |
| Public IP | 10.205.0.35 | 10.205.0.36 |
| VIP IP | 10.205.0.37 | 10.205.0.38 |
| SCAN_IP | 10.205.0.39 | |
| Cluster ware | 11g R2 Grid Infrastructure (11.2.0.4) | 11g R2 Grid Infrastructure (11.2.0.4) |
| SID | Cltdb1 | Cltdb2 |
安装操作系统：
因为要挂磁盘阵列，装操作系统时注意选择自定义分区，并按下列方式进行分区：
Disk /dev/sdb: 943.7 GB, 943718400000 bytes
255 heads, 63 sectors/track, 114733 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sdb1 1 114734 921599999+ ee GPT
WARNING: GPT (GUID Partition Table) detected on '/dev/sdd'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/sdd: 943.7 GB, 943718400000 bytes
255 heads, 63 sectors/track, 114733 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sdd1 1 114734 921599999+ ee GPT
WARNING: GPT (GUID Partition Table) detected on '/dev/sde'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/sde: 943.7 GB, 943718400000 bytes
255 heads, 63 sectors/track, 114733 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sde1 1 114734 921599999+ ee GPT
WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/sda: 943.7 GB, 943718400000 bytes
255 heads, 63 sectors/track, 114733 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sda1 1 114734 921599999+ ee GPT
WARNING: GPT (GUID Partition Table) detected on '/dev/mapper/mpathb'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/mapper/mpathb: 943.7 GB, 943718400000 bytes
255 heads, 63 sectors/track, 114733 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
安装多路径驱动
[root@localhost ~]# df -h
文件系统 容量 已用 可用已用%% 挂载点
/dev/mapper/VolGroup-lv_root
50G 4.1G 43G 9% /
tmpfs 16G 224K 16G 1% /dev/shm
/dev/sdc2 485M 38M 422M 9% /boot
/dev/sdc1 200M 260K 200M 1% /boot/efi
/dev/mapper/VolGroup-lv_home
209G 188M 198G 1% /home
[root@localhost ~]# nullmkdir -p /mnt/cdrom
-bash: nullmkdir: command not found
[root@localhost ~]# mkdir -p /mnt/cdrom
[root@localhost ~]# mount /dev/cdrom /mnt/cdrom
mount: block device /dev/sr0 is write-protected, mounting read-only
[root@localhost ~]# df -h
文件系统 容量 已用 可用已用%% 挂载点
/dev/mapper/VolGroup-lv_root
50G 4.1G 43G 9% /
tmpfs 16G 224K 16G 1% /dev/shm
/dev/sdc2 485M 38M 422M 9% /boot
/dev/sdc1 200M 260K 200M 1% /boot/efi
/dev/mapper/VolGroup-lv_home
209G 188M 198G 1% /home
/dev/sr0 17M 17M 0 100% /media/MPDV2.0L24
/dev/sr0 17M 17M 0 100% /mnt/cdrom
[root@localhost ~]# cd /mnt/cdrom/
[root@localhost cdrom]# ls
gpl.txt mpdpkgadd P2U3-0031-13ENZ0.pdf P2U3-0031-13Z0.pdf readme.txt readme_utf8.txt RHEL4 RHEL5 RHEL6 src
[root@localhost cdrom]# ./mpdpkgadd
Preparing... ########################################### [100%]
1:kmod-FJSVmpd_rh ########################################### [ 33%]
2:FJSVmpd_rh-doc ########################################### [ 67%]
3:FJSVmpd_rh-kmod-common ########################################### [100%]
Progressing.....
If you have the latest applicable patch of ETERNUS Multipath Driver,
please apply it. After that, please reboot this system.
If not, please reboot this system now.
[root@localhost cdrom]# reboot
Broadcast message from root@localhost.localdomain
(/dev/pts/1) at 14:48 ...
改主机名修
[root@srvrac1 ~]# cd /etc/sysconfig/
[root@srvrac1 sysconfig]# cat network
NETWORKING=yes
HOSTNAME=cltrac1
GATEWAY=10.205.0.254
配置IP：
[root@localhost ~]# vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.205.0.35 cltrac1
10.205.0.36 cltrac2
#private-ip
172.16.1.3 cltrac1-private
172.16.1.3 cltrac2-private
#vip
10.205.0.37 cltrac1-vip
10.205.0.38 cltrac2-vip
#scan-ip
10.205.0.39 cltrac-cluster-scan
~
禁用selinux
Vi /etc/selinux/config
SELINUX=disabled
关掉防火墙
iptables -F
chkconfig cups off
chkconfig iptables off
chkconfig ip6tables off
chkconfig NetworkManager off
chkconfig ntpd off
配置操作系统sysctl参数：
[root@cltrac1 ~]# vi /etc/sysctl.conf
# Controls the maximum number of shared memory segments, in pages
kernel.shmall = 4294967296
fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmall = 2097152
kernel.shmmax = 4294967295
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
"/etc/sysctl.conf" 52L, 1460C written
[root@cltrac1 ~]# sysctl -p
net.ipv4.ip_forward = 0
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
kernel.sysrq = 0
kernel.core_uses_pid = 1
net.ipv4.tcp_syncookies = 1
error: "net.bridge.bridge-nf-call-ip6tables" is an unknown key
error: "net.bridge.bridge-nf-call-iptables" is an unknown key
error: "net.bridge.bridge-nf-call-arptables" is an unknown key
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.shmmax = 68719476736
kernel.shmall = 4294967296
fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmall = 2097152
kernel.shmmax = 4294967295
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
配置limit参数：
vi /etc/security/limits.conf
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
oracle soft stack 10240
grid soft nproc 2047
grid hard nproc 16384
grid soft nofile 1024
grid hard nofile 65536
grid soft stack 10240
添加用户和组
groupadd -g 501 oinstall
groupadd -g 502 dba
groupadd -g 503 oper
groupadd -g 504 asmadmin
groupadd -g 506 asmdba
groupadd -g 507 asmoper
useradd -u 501 -g oinstall -G asmadmin,asmdba,asmoper,dba grid
useradd -u 502 -g oinstall -G dba,asmdba,asmadmin,oper oracle
检查用户和组：
[root@cltrac1 ~]# id oracle
uid=502(oracle) gid=501(oinstall) 组=501(oinstall),502(dba),503(oper),504(asmadmin),506(asmdba)
[root@cltrac1 ~]# id grid
uid=501(grid) gid=501(oinstall) 组=501(oinstall),502(dba),504(asmadmin),506(asmdba),507(asmoper)
修改密码：
Passwd oracle bee2c.com@oracle
Passwd grid bee2c.com@grid
创建安装目录：
mkdir -p /bee/app/11.2.0/grid
mkdir -p /bee/app/oracle/product/11.2.0/db_1
mkdir -p /bee/app/grid
mkdir -p /bee/app/oraInventory
chown -R oracle.oinstall /bee
chown -R grid.oinstall /bee/app/11.2.0/grid/
chown -R grid.oinstall /bee/app/grid/
chown -R grid.oinstall /bee/app/oraInventory
修改环境变量：
vi /home/grid/.bash_profile
###################
export ORACLE_SID=+ASM1
export ORACLE_BASE=/bee/app/grid
export ORACLE_HOME=/bee/app/11.2.0/grid
export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"
export PATH=.:/usr/sbin:$ORACLE_HOME/bin:$PATH
export NLS_LANG="american_america.ZHS16GBK"
export EDITOR=vim
export LANG=en_us.UTF-8
export NLS_DATE_FORMAT=yyyy-mm-dd:hh24:mi:ss
umask 022
alias sqlplus='/usr/local/rlwrap/bin/rlwrap sqlplus'
alias rman='/usr/local/rlwrap/bin/rlwrap rman'
alias asmcmd='/usr/local/rlwrap/bin/rlwrap asmcmd'
alias adrci='/usr/local/rlwrap/bin/rlwrap adrci'
不要sourece 命令
vi /home/oracle/.bash_profile
###################11gr2 required，RAC ORACLE_UNQNAME is not orcl1,is orcl########
export ORACLE_HOSTNAME=cltrac1
export ORACLE_UNQNAME=cltdb
#####################
export ORACLE_SID=cltdb1
#export ORACLE_SID=cltdb2 第二台机器上配这个
export ORACLE_BASE=/bee/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"
export TNS_ADMIN=\$ORACLE_HOME/network/admin
export PATH=.:/usr/sbin:$ORACLE_HOME/bin:$PATH
export NLS_LANG="american_america.ZHS16GBK"
export EDITOR=vim
export LANG=en_us.UTF-8
export NLS_DATE_FORMAT=yyyy-mm-dd:hh24:mi:ss
umask 022
alias sqlplus='/usr/local/rlwrap/bin/rlwrap sqlplus'
alias rman='/usr/local/rlwrap/bin/rlwrap rman'
alias adrci='/usr/local/rlwrap/bin/rlwrap adrci'
配置存储
for i in b ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\"" >> /etc/udev/rules.d/99-oracle-asmdevices.rules
done;
接着执行：
/sbin/udevadm control --reload-rules
/sbin/start_udev
检查结果
[root@cltrac1 ~]# ls -l /dev/asm-diskb
brw-rw----. 1 grid asmadmin 8, 16 12月 5 14:02 /dev/asm-diskb
确定/etc/resolv.conf的内容两个节点一致。
[root@localhost ~]# cat /etc/resolv.conf
# Generated by NetworkManager
nameserver 211.155.27.88
确定两个节点时间已经同步
[root@cltrac2 ~]# ntpdate -u cn.pool.ntp.org
5 Dec 11:44:22 ntpdate[2527]: step time server 202.118.1.130 offset -1.048913 sec
[root@cltrac2 ~]# date
2014年 12月 05日星期五 11:44:25 CST
[root@cltrac2 ~]# hwclock --systohc
关闭ntp
[root@cltrac1 ~]# service ntpd stop
关闭 ntpd：[失败]
[root@cltrac1 ~]# chkconfig ntpd off
[root@cltrac1 ~]# mv /etc/ntp.conf /etc/ntp.conf.bak
[root@cltrac1 ~]# rm -rf /var/run/ntpd.pid
[root@cltrac1 ~]#
配置grid用户ssh对等性
在cltrac1上执行：
[root@cltrac1 ~]# su - grid
[grid@cltrac1 ~]$ mkdir ~/.ssh
[grid@cltrac1 ~]$ chmod 700 ~/.ssh
[grid@cltrac1 ~]$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/grid/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/grid/.ssh/id_rsa.
Your public key has been saved in /home/grid/.ssh/id_rsa.pub.
The key fingerprint is:
33:5f:68:9f:cc:33:35:14:74:7c:f8:d1:0b:f7:63:2d grid@cltrac1
The key's randomart image is:
[grid@cltrac1 ~]$ ssh-keygen -t dsa
[grid@cltrac1 ~]$ cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys
[grid@cltrac1 ~]$ cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys
在cltrac2重复上执行上面的过程
mkdir ~/.ssh
chmod 700 ~/.ssh
ssh-keygen -t rsa
ssh-keygen -t dsa
cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys
然后在cltrac1上
ssh cltrac2 cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys
ssh cltrac2 cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys
scp ~/.ssh/authorized_keys cltrac2:~/.ssh/authorized_keys
验证ssh对等性是否成功
在cltrac1上
ssh cltrac1 date
ssh cltrac2 date
第一次需要口令，以后不需要就表示成功了。
ssh cltrac1 date
ssh cltrac2 date
在cltvrac2同上步骤。
安装依赖包
用redhat6.4 64位的ISO来做yum源。
mount -o loop /dev/cdrom /mnt/cdrom
cp /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.bak
vi /etc/yum.repos.d/CentOS-Base.repo
[rhel-source]
name=Centos
baseurl=file:///mnt/cdrom/Server
gpgcheck=0
enable=1
yum clean all
yum -y install \
binutils \
compat-libstdc++-33 \
compat-libstdc++-33*i686* \
compat-libcap1 \
gcc \
gcc-c++ \
glibc \
glibc-*i686* \
glibc-devel \
glibc-devel-*i686* \
libgcc \
libgcc-*i686* \
libstdc++ \
libstdc++-*i686* \
libstdc++-devel \
libstdc++-devel-*i686* \
libaio \
libaio-*i686* \
libaio-devel \
libaio-devel-*i686* \
make \
sysstat \
unixODBC \
unixODBC-*i686* \
unixODBC-devel \
unixODBC-devel-*i686* \
pdksh
yum -y install elfutils-libelf-devel*
rpm -e ksh*
yum -y install pdksh*
yum -y install readline*
tar -zxvf rlwrap-0.37.tar.gz
cd ./rlwrap-0.37
./configure --prefix=/usr/local/rlwrap && make && make install
用以下命令检查下，没有的装上
rpm -q gcc make binutils openmotif setarch compat-db compat-gcc-34 compat-gcc-34-c++ compat-libstdc++- libXp ksh sysstat libaio glibc elfutils unixODBC
yum install gcc* glib* glibc* setarch-2* make-3* glibc-2* libaio-0* libaio-devel* compat-libstdc++-33-3* compat-libstdc++-33-3* compat-gcc-34-3* compat-gcc-34-c++-3* libXp* openmotif* compat-db-4*
rpm -q gcc make binutils openmotif setarch compat-db compat-gcc-34 compat-gcc-34-c++ compat-libstdc++- libXp ksh sysstat libaio glibc elfutils unixODBC
安装GRID前检查：
Cp /root/3of /home/grid
Unzip
./runcluvfy.sh stage -pre crsinst -n cltrac1,cltrac2 -fixup -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "cltrac1"
Destination Node Reachable?
------------------------------------ ------------------------
cltrac2 yes
cltrac1 yes
Result: Node reachability check passed from node "cltrac1"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Status
------------------------------------ ------------------------
cltrac2 passed
cltrac1 passed
Result: User equivalence check passed for user "grid"
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
cltrac2 passed
cltrac1 passed
Verification of the hosts config file successful
Interface information for node "cltrac2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth2 10.205.0.36 10.205.0.0 0.0.0.0 10.205.0.254 34:40:B5:CA:B8:2A 1500
eth3 172.16.1.4 172.16.0.0 0.0.0.0 10.205.0.254 34:40:B5:CA:B8:2E 1500
usb0 169.254.95.120 169.254.95.0 0.0.0.0 10.205.0.254 36:40:B5:D3:60:5B 1500
Interface information for node "cltrac1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth2 10.205.0.35 10.205.0.0 0.0.0.0 10.205.0.254 34:40:B5:CA:DF:F2 1500
eth3 172.16.1.3 172.16.0.0 0.0.0.0 10.205.0.254 34:40:B5:CA:DF:F6 1500
Check: Node connectivity of subnet "10.205.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
cltrac2[10.205.0.36] cltrac1[10.205.0.35] yes
Result: Node connectivity passed for subnet "10.205.0.0" with node(s) cltrac2,cltrac1
Check: TCP connectivity of subnet "10.205.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
cltrac1:10.205.0.35 cltrac2:10.205.0.36 passed
Result: TCP connectivity check passed for subnet "10.205.0.0"
Check: Node connectivity of subnet "172.16.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
cltrac2[172.16.1.4] cltrac1[172.16.1.3] yes
Result: Node connectivity passed for subnet "172.16.0.0" with node(s) cltrac2,cltrac1
Check: TCP connectivity of subnet "172.16.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
cltrac1:172.16.1.3 cltrac2:172.16.1.4 passed
Result: TCP connectivity check passed for subnet "172.16.0.0"
Check: Node connectivity of subnet "169.254.95.0"
Result: Node connectivity passed for subnet "169.254.95.0" with node(s) cltrac2
Check: TCP connectivity of subnet "169.254.95.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
cltrac1:10.205.0.35 cltrac2:169.254.95.120 failed
ERROR:
PRVF-7617 : Node connectivity between "cltrac1 : 10.205.0.35" and "cltrac2 : 169.254.95.120" failed
Result: TCP connectivity check failed for subnet "169.254.95.0"
Interfaces found on subnet "10.205.0.0" that are likely candidates for VIP are:
cltrac2 eth2:10.205.0.36
cltrac1 eth2:10.205.0.35
Interfaces found on subnet "172.16.0.0" that are likely candidates for a private interconnect are:
cltrac2 eth3:172.16.1.4
cltrac1 eth3:172.16.1.3
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "10.205.0.0".
Subnet mask consistency check passed for subnet "172.16.0.0".
Subnet mask consistency check passed for subnet "169.254.95.0".
Subnet mask consistency check passed.
Result: Node connectivity check failed
Checking multicast communication...
Checking subnet "10.205.0.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "10.205.0.0" for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "172.16.0.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "172.16.0.0" for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "169.254.95.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "169.254.95.0" for multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Checking ASMLib configuration.
Node Name Status
------------------------------------ ------------------------
cltrac2 passed
cltrac1 passed
Result: Check for ASMLib configuration passed.
Check: Total memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 31.3298GB (3.2851696E7KB) 1.5GB (1572864.0KB) passed
cltrac1 31.4577GB (3.298584E7KB) 1.5GB (1572864.0KB) passed
Result: Total memory check passed
Check: Available memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 30.9823GB (3.2487276E7KB) 50MB (51200.0KB) passed
cltrac1 30.7495GB (3.2243148E7KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 15.7344GB (1.649868E7KB) 16GB (1.6777216E7KB) failed
cltrac1 15.7344GB (1.649868E7KB) 16GB (1.6777216E7KB) failed
Result: Swap space check failed
Check: Free disk space for "cltrac2:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp cltrac2 / 45.8154GB 1GB passed
Result: Free disk space check passed for "cltrac2:/tmp"
Check: Free disk space for "cltrac1:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp cltrac1 / 44.3726GB 1GB passed
Result: Free disk space check passed for "cltrac1:/tmp"
Check: User existence for "grid"
Node Name Status Comment
------------ ------------------------ ------------------------
cltrac2 passed exists(501)
cltrac1 passed exists(501)
Checking for multiple users with UID value 501
Result: Check for multiple users with UID value 501 passed
Result: User existence check passed for "grid"
Check: Group existence for "oinstall"
Node Name Status Comment
------------ ------------------------ ------------------------
cltrac2 passed exists
cltrac1 passed exists
Result: Group existence check passed for "oinstall"
Check: Group existence for "dba"
Node Name Status Comment
------------ ------------------------ ------------------------
cltrac2 passed exists
cltrac1 passed exists
Result: Group existence check passed for "dba"
Check: Membership of user "grid" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Status
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 yes yes yes yes passed
cltrac1 yes yes yes yes passed
Result: Membership check for user "grid" in group "oinstall" [as Primary] passed
Check: Membership of user "grid" in group "dba"
Node Name User Exists Group Exists User in Group Status
---------------- ------------ ------------ ------------ ----------------
cltrac2 yes yes yes passed
cltrac1 yes yes yes passed
Result: Membership check for user "grid" in group "dba" passed
Check: Run level
Node Name run level Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 3 3,5 passed
cltrac1 5 3,5 passed
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
cltrac2 hard 65536 65536 passed
cltrac1 hard 65536 65536 passed
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
cltrac2 soft 1024 1024 passed
cltrac1 soft 1024 1024 passed
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
cltrac2 hard 16384 16384 passed
cltrac1 hard 16384 16384 passed
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
cltrac2 soft 2047 2047 passed
cltrac1 soft 2047 2047 passed
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 x86_64 x86_64 passed
cltrac1 x86_64 x86_64 passed
Result: System architecture check passed
Check: Kernel version
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 2.6.32-358.el6.x86_64 2.6.9 passed
cltrac1 2.6.32-358.el6.x86_64 2.6.9 passed
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 250 250 250 passed
cltrac1 250 250 250 passed
Result: Kernel parameter check passed for "semmsl"
Check: Kernel parameter for "semmns"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 32000 32000 32000 passed
cltrac1 32000 32000 32000 passed
Result: Kernel parameter check passed for "semmns"
Check: Kernel parameter for "semopm"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 100 100 100 passed
cltrac1 100 100 100 passed
Result: Kernel parameter check passed for "semopm"
Check: Kernel parameter for "semmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 128 128 128 passed
cltrac1 128 128 128 passed
Result: Kernel parameter check passed for "semmni"
Check: Kernel parameter for "shmmax"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 4294967295 4294967295 4294967295 passed
cltrac1 4294967295 4294967295 4294967295 passed
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 4096 4096 4096 passed
cltrac1 4096 4096 4096 passed
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmall"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 2097152 2097152 2097152 passed
cltrac1 2097152 2097152 2097152 passed
Result: Kernel parameter check passed for "shmall"
Check: Kernel parameter for "file-max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 6815744 6815744 6815744 passed
cltrac1 6815744 6815744 6815744 passed
Result: Kernel parameter check passed for "file-max"
Check: Kernel parameter for "ip_local_port_range"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
cltrac1 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
Result: Kernel parameter check passed for "ip_local_port_range"
Check: Kernel parameter for "rmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 262144 262144 262144 passed
cltrac1 262144 262144 262144 passed
Result: Kernel parameter check passed for "rmem_default"
Check: Kernel parameter for "rmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 4194304 4194304 4194304 passed
cltrac1 4194304 4194304 4194304 passed
Result: Kernel parameter check passed for "rmem_max"
Check: Kernel parameter for "wmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 262144 262144 262144 passed
cltrac1 262144 262144 262144 passed
Result: Kernel parameter check passed for "wmem_default"
Check: Kernel parameter for "wmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 1048576 1048576 1048576 passed
cltrac1 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "wmem_max"
Check: Kernel parameter for "aio-max-nr"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
cltrac2 1048576 1048576 1048576 passed
cltrac1 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "aio-max-nr"
Check: Package existence for "make"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 make-3.81-20.el6 make-3.80 passed
cltrac1 make-3.81-20.el6 make-3.80 passed
Result: Package existence check passed for "make"
Check: Package existence for "binutils"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 binutils-2.20.51.0.2-5.42.el6 binutils-2.15.92.0.2 passed
cltrac1 binutils-2.20.51.0.2-5.42.el6 binutils-2.15.92.0.2 passed
Result: Package existence check passed for "binutils"
Check: Package existence for "gcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 gcc(x86_64)-4.4.7-11.el6 gcc(x86_64)-3.4.6 passed
cltrac1 gcc(x86_64)-4.4.7-11.el6 gcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc(x86_64)"
Check: Package existence for "libaio(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
cltrac1 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio(x86_64)"
Check: Package existence for "glibc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 glibc(x86_64)-2.12-1.149.el6 glibc(x86_64)-2.3.4-2.41 passed
cltrac1 glibc(x86_64)-2.12-1.149.el6 glibc(x86_64)-2.3.4-2.41 passed
Result: Package existence check passed for "glibc(x86_64)"
Check: Package existence for "compat-libstdc++-33(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
cltrac1 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
Result: Package existence check passed for "compat-libstdc++-33(x86_64)"
Check: Package existence for "elfutils-libelf(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 elfutils-libelf(x86_64)-0.158-3.2.el6 elfutils-libelf(x86_64)-0.97 passed
cltrac1 elfutils-libelf(x86_64)-0.158-3.2.el6 elfutils-libelf(x86_64)-0.97 passed
Result: Package existence check passed for "elfutils-libelf(x86_64)"
Check: Package existence for "elfutils-libelf-devel"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 elfutils-libelf-devel-0.158-3.2.el6 elfutils-libelf-devel-0.97 passed
cltrac1 elfutils-libelf-devel-0.158-3.2.el6 elfutils-libelf-devel-0.97 passed
Result: Package existence check passed for "elfutils-libelf-devel"
Check: Package existence for "glibc-common"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 glibc-common-2.12-1.149.el6 glibc-common-2.3.4 passed
cltrac1 glibc-common-2.12-1.149.el6 glibc-common-2.3.4 passed
Result: Package existence check passed for "glibc-common"
Check: Package existence for "glibc-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 glibc-devel(x86_64)-2.12-1.149.el6 glibc-devel(x86_64)-2.3.4 passed
cltrac1 glibc-devel(x86_64)-2.12-1.149.el6 glibc-devel(x86_64)-2.3.4 passed
Result: Package existence check passed for "glibc-devel(x86_64)"
Check: Package existence for "glibc-headers"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 glibc-headers-2.12-1.149.el6 glibc-headers-2.3.4 passed
cltrac1 glibc-headers-2.12-1.149.el6 glibc-headers-2.3.4 passed
Result: Package existence check passed for "glibc-headers"
Check: Package existence for "gcc-c++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 gcc-c++(x86_64)-4.4.7-11.el6 gcc-c++(x86_64)-3.4.6 passed
cltrac1 gcc-c++(x86_64)-4.4.7-11.el6 gcc-c++(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc-c++(x86_64)"
Check: Package existence for "libaio-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
cltrac1 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio-devel(x86_64)"
Check: Package existence for "libgcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 libgcc(x86_64)-4.4.7-11.el6 libgcc(x86_64)-3.4.6 passed
cltrac1 libgcc(x86_64)-4.4.7-11.el6 libgcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "libgcc(x86_64)"
Check: Package existence for "libstdc++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 libstdc++(x86_64)-4.4.7-11.el6 libstdc++(x86_64)-3.4.6 passed
cltrac1 libstdc++(x86_64)-4.4.7-11.el6 libstdc++(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++(x86_64)"
Check: Package existence for "libstdc++-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 libstdc++-devel(x86_64)-4.4.7-11.el6 libstdc++-devel(x86_64)-3.4.6 passed
cltrac1 libstdc++-devel(x86_64)-4.4.7-11.el6 libstdc++-devel(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++-devel(x86_64)"
Check: Package existence for "sysstat"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 sysstat-9.0.4-27.el6 sysstat-5.0.5 passed
cltrac1 sysstat-9.0.4-27.el6 sysstat-5.0.5 passed
Result: Package existence check passed for "sysstat"
Check: Package existence for "pdksh"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 pdksh-5.2.14-37.el5_8.1 pdksh-5.2.14 passed
cltrac1 pdksh-5.2.14-37.el5_8.1 pdksh-5.2.14 passed
Result: Package existence check passed for "pdksh"
Check: Package existence for "expat(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
cltrac2 expat(x86_64)-2.0.1-11.el6_2 expat(x86_64)-1.95.7 passed
cltrac1 expat(x86_64)-2.0.1-11.el6_2 expat(x86_64)-1.95.7 passed
Result: Package existence check passed for "expat(x86_64)"
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed
Check: Current group ID
Result: Current group ID check passed
Starting check for consistency of primary group of root user
Node Name Status
------------------------------------ ------------------------
cltrac2 passed
cltrac1 passed
Check for consistency of root user's primary group passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
NTP Configuration file check started...
Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
No NTP Daemons or Services were found to be running
Result: Clock synchronization check using Network Time Protocol(NTP) passed
Checking Core file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "grid" is not in "root" group
Node Name Status Comment
------------ ------------------------ ------------------------
cltrac2 passed does not exist
cltrac1 passed does not exist
Result: User "grid" is not part of "root" group. Check passed
Check default user file creation mask
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
cltrac2 0022 0022 passed
cltrac1 0022 0022 passed
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes
Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both domain and search entries defined
Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking DNS response time for an unreachable node
Node Name Status
------------------------------------ ------------------------
cltrac2 passed
cltrac1 passed
The DNS response time for an unreachable node is within acceptable limit on all nodes
File "/etc/resolv.conf" is consistent across nodes
Check: Time zone consistency
Result: Time zone consistency check passed
Pre-check for cluster services setup was unsuccessful on all the nodes.
开始安装GRID
安装前先用root用户安装cvuqdisk-1.0.9-1.rpm
[root@cltrac1 rpm]# rpm -ivh cvuqdisk-1.0.9-1.rpm
./runInstaller
点ADD
点ADD
第二个警告可以忽略。使用UDEV来搭建ASM都会有这个报警。
如果忘记安装：cvuqdisk-1.0.9-1.rpm
/tmp/CVU_11.2.0.4.0_grid/runfixup.sh
执行完成后点击OK，继续安装。
Oracle强烈建议不要再 hosts文件中配置 SCAN VIP地址。如果使用 hosts文件来解析 SCAN主机名，则该 SCAN hostname只能解析成一个SCAN IP地址。
如果使用 hosts文件来解析SCAN主机名，则在 Grid Infrastructure安装结束时会遇到类似如下Cluster Verification Utility故障。
继续 yes
检查GI是否正常
[grid@cltrac1 grid]$ crsctl check cluster -all
**************************************************************
cltrac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
cltrac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[grid@cltrac1 grid]$ srvctl status nodeapps
VIP cltrac1-vip is enabled
VIP cltrac1-vip is running on node: cltrac1
VIP cltrac2-vip is enabled
VIP cltrac2-vip is running on node: cltrac2
Network is enabled
Network is running on node: cltrac1
Network is running on node: cltrac2
GSD is disabled
GSD is not running on node: cltrac1
GSD is not running on node: cltrac2
ONS is enabled
ONS daemon is running on node: cltrac1
ONS daemon is running on node: cltrac2
[grid@cltrac1 grid]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE cltrac1
ora....ER.lsnr ora....er.type ONLINE ONLINE cltrac1
ora....N1.lsnr ora....er.type ONLINE ONLINE cltrac1
ora.asm ora.asm.type ONLINE ONLINE cltrac1
ora....SM1.asm application ONLINE ONLINE cltrac1
ora....C1.lsnr application ONLINE ONLINE cltrac1
ora....ac1.gsd application OFFLINE OFFLINE
ora....ac1.ons application ONLINE ONLINE cltrac1
ora....ac1.vip ora....t1.type ONLINE ONLINE cltrac1
ora....SM2.asm application ONLINE ONLINE cltrac2
ora....C2.lsnr application ONLINE ONLINE cltrac2
ora....ac2.gsd application OFFLINE OFFLINE
ora....ac2.ons application ONLINE ONLINE cltrac2
ora....ac2.vip ora....t1.type ONLINE ONLINE cltrac2
ora.cvu ora.cvu.type ONLINE ONLINE cltrac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE cltrac1
ora.oc4j ora.oc4j.type ONLINE ONLINE cltrac1
ora.ons ora.ons.type ONLINE ONLINE cltrac1
ora.scan1.vip ora....ip.type ONLINE ONLINE cltrac1
如果安装失败，用以下命令卸载：
在oracle11gR2以前的版本中,卸载CRS和oracle database时需要手工去删除部分东西,从oracle 11gR2版本开始新增deinstall命令可以卸载grid和
database,new oui版本中不再支持卸载,可以删除的非常干净,需要手工删除的话,deinstall命令也会有提示出来。
grid@rac1 ~]$ cd /oracle/app/grid/product/11.2.0/deinstall/
开始安装ORACLE软件
点”yes”
这里要建立 oracle ssh 对等性连接
点击 ssh connectivity ，输入oracle的密码，点击setup
点”test”
此处要把$ORACLE_BASE变量手动改为：/bee/app/oracle否则会有警告提示
选择忽略，点”yes”：
在两台机器上都执行上面语句
用ＤＢＣＡ新建实例
[oracle@cltrac1 database]$ dbca
管理员管理的数据库(administrator-managed)是指，就像名字中提到的，全部需要由数据库管理员来管理。换句话说，就是Oracle 11.1以前的RAC数据库。
策略管理的数据库(Policy-manageddatabase)使用自动化特性来增删实例和服务。策略管理的数据库启动的节点的数量由服务器池的基数来配置；换句话说，如果你需要一个新的实例，你只要将一个新的节点分配到数据库的服务器池中，Oracle会执行剩下部分的工作。
要输入asmsnmp密码：
如果忘记，修改办法：
[grid@cltrac1 ~]$ sqlplus / as sysasm
SQL> alter user asmsnmp identified by bee2c_zteict;
检查：
[grid@cltrac1 admin]$ crsctl status resource -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE cltrac1
ONLINE ONLINE cltrac2
ora.LISTENER.lsnr
ONLINE ONLINE cltrac1
ONLINE ONLINE cltrac2
ora.asm
ONLINE ONLINE cltrac1 Started
ONLINE ONLINE cltrac2 Started
ora.gsd
OFFLINE OFFLINE cltrac1
OFFLINE OFFLINE cltrac2
ora.net1.network
ONLINE ONLINE cltrac1
ONLINE ONLINE cltrac2
ora.ons
ONLINE ONLINE cltrac1
ONLINE ONLINE cltrac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE cltrac1
ora.cltdb.db
1 ONLINE ONLINE cltrac1 Open
2 ONLINE ONLINE cltrac2 Open
ora.cltrac1.vip
1 ONLINE ONLINE cltrac1
ora.cltrac2.vip
1 ONLINE ONLINE cltrac2
ora.cvu
1 ONLINE ONLINE cltrac1
ora.oc4j
1 ONLINE ONLINE cltrac1
ora.orcl.db
1 ONLINE ONLINE cltrac1 Open
2 ONLINE ONLINE cltrac2 Open
ora.scan1.vip
1 ONLINE ONLINE cltrac1
1028
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
