Oracle 11G RAC命令行增删节点(非图形方式)

前台业务反应HIS数据库1节点无法连接,2节点正常,通过远程的方式接入数据库查看得知,数据库1节点操作系统已经无法登陆,在服务器厂商的协助处理下,数据库服务器1节点操作系统可正常登陆,但是数据库集群、ASM、数据库等组件均启动失败。
通过堡垒机审计以及数据库日志分析等多维度综合评估判断,1节点已经失效,需要重新安装(即重新安装操作系统、重新安装数据库集群软件、重新安装数据库软件、节点删除并重新添加至集群)。
服务器厂商对HIS数据库1节点服务器重新安装操作系。我方对1节点开始数据库层面操作,操作步骤大致如下:

  1. 安装前准备
     调整内核参数
     创建目录
     创建用户和用户组
     修改环境变量
     创建互信

  2. 节点剔除

  3. 安装数据库集群软件

  4. 安装数据库软件

  5. 添加节点至集群

  6. 处理步骤
    由于安装前准备等同于数据库的初始安装配置,因此相关命令不再赘述。
    3.1. 安装前准备
    3.1.1. 调整内核参数
    调整/etc/hosts、/etc/sysctl.conf等内核参数文件参数,保持与2节点一致。
    3.1.2. 创建目录
    创建ORACLE_BASE、ORACLE_HOME等目录,与2节点保持一致。
    3.1.3. 创建用户和用户组
    创建oracle、grid、oinstall、dba等用户和用户组,uid、gid等信息保持与2节点一致。
    3.1.4. 修改环境变量
    修改oracle、grid等用户的环境变量,与2节点保持一致。
    3.1.5. 创建互信
    由于远程环境无图形界面,因此需要手工建立互信,通过数据库集群件安装包下的sshUserset.sh脚本创建互信。
    3.2. 节点剔除
    3.2.1. 预检查

[root@oracle02 ~]# su - grid
[grid@oracle02 ~]$ /oracle/app/product/11.2.0/db_1/bin/cluvfy stage -pre crsinst -n oracle01,oracle02 -verbose

Performing pre-checks for cluster services setup 

Checking node reachability...

Check: Node reachability from node "oracle02"
  Destination Node                      Reachable?              
  ------------------------------------  ------------------------
  oracle01                              yes                     
  oracle02                              yes                     
Result: Node reachability check passed from node "oracle02"


Checking user equivalence...

Check: User equivalence for user "grid"
  Node Name                             Status                  
  ------------------------------------  ------------------------
  oracle02                              passed                  
  oracle01                              passed                  
Result: User equivalence check passed for user "grid"

Checking node connectivity...

Checking hosts config file...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  oracle02                              passed                  
  oracle01                              passed                  

Verification of the hosts config file successful


Interface information for node "oracle02"
 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
 ------ --------------- --------------- --------------- --------------- ----------------- ------
 ***  


Interface information for node "oracle01"
 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
 ------ --------------- --------------- --------------- --------------- ----------------- ------
***  


Check: Node connectivity for interface "bond0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
 ***             
Result: Node connectivity passed for interface "bond0"


Check: TCP connectivity of subnet "172.16.18.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  ***


Check: Node connectivity for interface "bond1"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  ***


Check: TCP connectivity of subnet "2.2.2.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  ***

Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "*".
Subnet mask consistency check passed for subnet "*".
Subnet mask consistency check passed.

Result: Node connectivity check passed

Checking multicast communication...

Checking subnet "172.16.18.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "172.16.18.0" for multicast communication with multicast group "230.0.1.0" passed.

Checking subnet "2.2.2.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "2.2.2.0" for multicast communication with multicast group "230.0.1.0" passed.

Check of multicast communication passed.

Checking ASMLib configuration.
  Node Name                             Status                  
  ------------------------------------  ------------------------
  oracle02                              passed                  
  oracle01                              passed                  
Result: Check for ASMLib configuration passed.

Check: Total memory 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      504.5993GB (5.29110668E8KB)  1.5GB (1572864.0KB)       passed    
  oracle01      504.5991GB (5.29110532E8KB)  1.5GB (1572864.0KB)       passed    
Result: Total memory check passed

Check: Available memory 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      264.0379GB (2.76863852E8KB)  50MB (51200.0KB)          passed    
  oracle01      270.6703GB (2.83818404E8KB)  50MB (51200.0KB)          passed    
Result: Available memory check passed

Check: Swap space 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      62.5GB (6.5535996E7KB)    16GB (1.6777216E7KB)      passed    
  oracle01      62.5GB (6.5535996E7KB)    16GB (1.6777216E7KB)      passed    
Result: Swap space check passed

Check: Free disk space for "oracle02:/oracle/grid/crs_1" 
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /oracle/grid/crs_1  oracle02      /oracle       47.3369GB     5.5GB         passed      
Result: Free disk space check passed for "oracle02:/oracle/grid/crs_1"

Check: Free disk space for "oracle01:/oracle/grid/crs_1" 
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /oracle/grid/crs_1  oracle01      /oracle       68.3945GB     5.5GB         passed      
Result: Free disk space check passed for "oracle01:/oracle/grid/crs_1"

Check: Free disk space for "oracle02:/tmp" 
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /tmp              oracle02      /             92.4619GB     1GB           passed      
Result: Free disk space check passed for "oracle02:/tmp"

Check: Free disk space for "oracle01:/tmp" 
  Path              Node Name     Mount point   Available     Required      Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  /tmp              oracle01      /             87.1504GB     1GB           passed      
Result: Free disk space check passed for "oracle01:/tmp"

Check: User existence for "grid" 
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  oracle02      passed                    exists(3001)            
  oracle01      passed                    exists(3001)            

Checking for multiple users with UID value 3001
Result: Check for multiple users with UID value 3001 passed 
Result: User existence check passed for "grid"

Check: Group existence for "oinstall" 
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  oracle02      passed                    exists                  
  oracle01      passed                    exists                  
Result: Group existence check passed for "oinstall"

Check: Group existence for "dba" 
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  oracle02      passed                    exists                  
  oracle01      passed                    exists                  
Result: Group existence check passed for "dba"

Check: Membership of user "grid" in group "oinstall" [as Primary]
  Node Name         User Exists   Group Exists  User in Group  Primary       Status      
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          yes           yes           yes           yes           passed      
  oracle01          yes           yes           yes           yes           passed      
Result: Membership check for user "grid" in group "oinstall" [as Primary] passed

Check: Membership of user "grid" in group "dba" 
  Node Name         User Exists   Group Exists  User in Group  Status          
  ----------------  ------------  ------------  ------------  ----------------
  oracle02          yes           yes           yes           passed          
  oracle01          yes           yes           yes           passed          
Result: Membership check for user "grid" in group "dba" passed

Check: Run level 
  Node Name     run level                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      5                         3,5                       passed    
  oracle01      3                         3,5                       passed    
Result: Run level check passed

Check: Hard limits for "maximum open file descriptors" 
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  oracle02          hard          65536         65536         passed          
  oracle01          hard          65536         65536         passed          
Result: Hard limits check passed for "maximum open file descriptors"

Check: Soft limits for "maximum open file descriptors" 
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  oracle02          soft          1024          1024          passed          
  oracle01          soft          1024          1024          passed          
Result: Soft limits check passed for "maximum open file descriptors"

Check: Hard limits for "maximum user processes" 
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  oracle02          hard          16384         16384         passed          
  oracle01          hard          16384         16384         passed          
Result: Hard limits check passed for "maximum user processes"

Check: Soft limits for "maximum user processes" 
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  oracle02          soft          2047          2047          passed          
  oracle01          soft          2047          2047          passed          
Result: Soft limits check passed for "maximum user processes"

Check: System architecture 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      x86_64                    x86_64                    passed    
  oracle01      x86_64                    x86_64                    passed    
Result: System architecture check passed

Check: Kernel version 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      2.6.32-642.el6.x86_64     2.6.9                     passed    
  oracle01      2.6.32-642.el6.x86_64     2.6.9                     passed    
Result: Kernel version check passed

Check: Kernel parameter for "semmsl" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          250           250           250           passed          
  oracle01          250           250           250           passed          
Result: Kernel parameter check passed for "semmsl"

Check: Kernel parameter for "semmns" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          32000         32000         32000         passed          
  oracle01          32000         32000         32000         passed          
Result: Kernel parameter check passed for "semmns"

Check: Kernel parameter for "semopm" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          100           100           100           passed          
  oracle01          100           100           100           passed          
Result: Kernel parameter check passed for "semopm"

Check: Kernel parameter for "semmni" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          128           128           128           passed          
  oracle01          128           128           128           passed          
Result: Kernel parameter check passed for "semmni"

Check: Kernel parameter for "shmmax" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          68719476736   68719476736   4294967295    passed          
  oracle01          68719476736   68719476736   4294967295    passed          
Result: Kernel parameter check passed for "shmmax"

Check: Kernel parameter for "shmmni" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          4096          4096          4096          passed          
  oracle01          4096          4096          4096          passed          
Result: Kernel parameter check passed for "shmmni"

Check: Kernel parameter for "shmall" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          4294967296    4294967296    2097152       passed          
  oracle01          4294967296    4294967296    2097152       passed          
Result: Kernel parameter check passed for "shmall"

Check: Kernel parameter for "file-max" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          6815744       6815744       6815744       passed          
  oracle01          6815744       6815744       6815744       passed          
Result: Kernel parameter check passed for "file-max"

Check: Kernel parameter for "ip_local_port_range" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          between 9000.0 & 65500.0  between 9000.0 & 65500.0  between 9000.0 & 65500.0  passed          
  oracle01          between 9000.0 & 65500.0  between 9000.0 & 65500.0  between 9000.0 & 65500.0  passed          
Result: Kernel parameter check passed for "ip_local_port_range"

Check: Kernel parameter for "rmem_default" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          262144        262144        262144        passed          
  oracle01          262144        262144        262144        passed          
Result: Kernel parameter check passed for "rmem_default"

Check: Kernel parameter for "rmem_max" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          4194304       4194304       4194304       passed          
  oracle01          4194304       4194304       4194304       passed          
Result: Kernel parameter check passed for "rmem_max"

Check: Kernel parameter for "wmem_default" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          262144        262144        262144        passed          
  oracle01          262144        262144        262144        passed          
Result: Kernel parameter check passed for "wmem_default"

Check: Kernel parameter for "wmem_max" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          1048576       1048576       1048576       passed          
  oracle01          1048576       1048576       1048576       passed          
Result: Kernel parameter check passed for "wmem_max"

Check: Kernel parameter for "aio-max-nr" 
  Node Name         Current       Configured    Required      Status        Comment     
  ----------------  ------------  ------------  ------------  ------------  ------------
  oracle02          1048576       1048576       1048576       passed          
  oracle01          1048576       1048576       1048576       passed          
Result: Kernel parameter check passed for "aio-max-nr"

Check: Package existence for "make" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      make-3.81-23.el6          make-3.80                 passed    
  oracle01      make-3.81-23.el6          make-3.80                 passed    
Result: Package existence check passed for "make"

Check: Package existence for "binutils" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      binutils-2.20.51.0.2-5.44.el6  binutils-2.15.92.0.2      passed    
  oracle01      binutils-2.20.51.0.2-5.44.el6  binutils-2.15.92.0.2      passed    
Result: Package existence check passed for "binutils"

Check: Package existence for "gcc(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      gcc(x86_64)-4.4.7-17.el6  gcc(x86_64)-3.4.6         passed    
  oracle01      gcc(x86_64)-4.4.7-17.el6  gcc(x86_64)-3.4.6         passed    
Result: Package existence check passed for "gcc(x86_64)"

Check: Package existence for "libaio(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      libaio(x86_64)-0.3.107-10.el6  libaio(x86_64)-0.3.105    passed    
  oracle01      libaio(x86_64)-0.3.107-10.el6  libaio(x86_64)-0.3.105    passed    
Result: Package existence check passed for "libaio(x86_64)"

Check: Package existence for "glibc(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      glibc(x86_64)-2.12-1.192.el6  glibc(x86_64)-2.3.4-2.41  passed    
  oracle01      glibc(x86_64)-2.12-1.192.el6  glibc(x86_64)-2.3.4-2.41  passed    
Result: Package existence check passed for "glibc(x86_64)"

Check: Package existence for "compat-libstdc++-33(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      compat-libstdc++-33(x86_64)-3.2.3-69.el6  compat-libstdc++-33(x86_64)-3.2.3  passed    
  oracle01      compat-libstdc++-33(x86_64)-3.2.3-69.el6  compat-libstdc++-33(x86_64)-3.2.3  passed    
Result: Package existence check passed for "compat-libstdc++-33(x86_64)"

Check: Package existence for "elfutils-libelf(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      elfutils-libelf(x86_64)-0.164-2.el6  elfutils-libelf(x86_64)-0.97  passed    
  oracle01      elfutils-libelf(x86_64)-0.164-2.el6  elfutils-libelf(x86_64)-0.97  passed    
Result: Package existence check passed for "elfutils-libelf(x86_64)"

Check: Package existence for "elfutils-libelf-devel" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      elfutils-libelf-devel-0.164-2.el6  elfutils-libelf-devel-0.97  passed    
  oracle01      elfutils-libelf-devel-0.164-2.el6  elfutils-libelf-devel-0.97  passed    
Result: Package existence check passed for "elfutils-libelf-devel"

Check: Package existence for "glibc-common" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      glibc-common-2.12-1.192.el6  glibc-common-2.3.4        passed    
  oracle01      glibc-common-2.12-1.192.el6  glibc-common-2.3.4        passed    
Result: Package existence check passed for "glibc-common"

Check: Package existence for "glibc-devel(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      glibc-devel(x86_64)-2.12-1.192.el6  glibc-devel(x86_64)-2.3.4  passed    
  oracle01      glibc-devel(x86_64)-2.12-1.192.el6  glibc-devel(x86_64)-2.3.4  passed    
Result: Package existence check passed for "glibc-devel(x86_64)"

Check: Package existence for "glibc-headers" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      glibc-headers-2.12-1.192.el6  glibc-headers-2.3.4       passed    
  oracle01      glibc-headers-2.12-1.192.el6  glibc-headers-2.3.4       passed    
Result: Package existence check passed for "glibc-headers"

Check: Package existence for "gcc-c++(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      gcc-c++(x86_64)-4.4.7-17.el6  gcc-c++(x86_64)-3.4.6     passed    
  oracle01      gcc-c++(x86_64)-4.4.7-17.el6  gcc-c++(x86_64)-3.4.6     passed    
Result: Package existence check passed for "gcc-c++(x86_64)"

Check: Package existence for "libaio-devel(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      libaio-devel(x86_64)-0.3.107-10.el6  libaio-devel(x86_64)-0.3.105  passed    
  oracle01      libaio-devel(x86_64)-0.3.107-10.el6  libaio-devel(x86_64)-0.3.105  passed    
Result: Package existence check passed for "libaio-devel(x86_64)"

Check: Package existence for "libgcc(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      libgcc(x86_64)-4.4.7-17.el6  libgcc(x86_64)-3.4.6      passed    
  oracle01      libgcc(x86_64)-4.4.7-17.el6  libgcc(x86_64)-3.4.6      passed    
Result: Package existence check passed for "libgcc(x86_64)"

Check: Package existence for "libstdc++(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      libstdc++(x86_64)-4.4.7-17.el6  libstdc++(x86_64)-3.4.6   passed    
  oracle01      libstdc++(x86_64)-4.4.7-17.el6  libstdc++(x86_64)-3.4.6   passed    
Result: Package existence check passed for "libstdc++(x86_64)"

Check: Package existence for "libstdc++-devel(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      libstdc++-devel(x86_64)-4.4.7-17.el6  libstdc++-devel(x86_64)-3.4.6  passed    
  oracle01      libstdc++-devel(x86_64)-4.4.7-17.el6  libstdc++-devel(x86_64)-3.4.6  passed    
Result: Package existence check passed for "libstdc++-devel(x86_64)"

Check: Package existence for "sysstat" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      sysstat-9.0.4-31.el6      sysstat-5.0.5             passed    
  oracle01      sysstat-9.0.4-31.el6      sysstat-5.0.5             passed    
Result: Package existence check passed for "sysstat"

Check: Package existence for "pdksh" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      missing                   pdksh-5.2.14              failed    
  oracle01      missing                   pdksh-5.2.14              failed    
Result: Package existence check failed for "pdksh"

Check: Package existence for "expat(x86_64)" 
  Node Name     Available                 Required                  Status    
  ------------  ------------------------  ------------------------  ----------
  oracle02      expat(x86_64)-2.0.1-11.el6_2  expat(x86_64)-1.95.7      passed    
  oracle01      expat(x86_64)-2.0.1-11.el6_2  expat(x86_64)-1.95.7      passed    
Result: Package existence check passed for "expat(x86_64)"

Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed 

Check: Current group ID 
Result: Current group ID check passed

Starting check for consistency of primary group of root user
  Node Name                             Status                  
  ------------------------------------  ------------------------
  oracle02                              passed                  
  oracle01                              passed                  

Check for consistency of root user's primary group passed

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...
The NTP configuration file "/etc/ntp.conf" is available on all nodes
NTP Configuration file check passed

Checking daemon liveness...

Check: Liveness for "ntpd"
  Node Name                             Running?                
  ------------------------------------  ------------------------
  oracle02                              yes                     
  oracle01                              yes                     
Result: Liveness check passed for "ntpd"
Check for NTP daemon or service alive passed on all nodes

Checking NTP daemon command line for slewing option "-x"
Check: NTP daemon command line
  Node Name                             Slewing Option Set?     
  ------------------------------------  ------------------------
  oracle02                              yes                     
  oracle01                              no                      
Result: 
NTP daemon slewing option check failed on some nodes
PRVF-5436 : The NTP daemon running on one or more nodes lacks the slewing option "-x"
Result: Clock synchronization check using Network Time Protocol(NTP) failed

Checking Core file name pattern consistency...
Core file name pattern consistency check passed.

Checking to make sure user "grid" is not in "root" group
  Node Name     Status                    Comment                 
  ------------  ------------------------  ------------------------
  oracle02      passed                    does not exist          
  oracle01      passed                    does not exist          
Result: User "grid" is not part of "root" group. Check passed

Check default user file creation mask
  Node Name     Available                 Required                  Comment   
  ------------  ------------------------  ------------------------  ----------
  oracle02      0022                      0022                      passed    
  oracle01      0022                      0022                      passed    
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes

Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both domain and search entries defined
Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking DNS response time for an unreachable node
  Node Name                             Status                  
  ------------------------------------  ------------------------
  oracle02                              failed                  
  oracle01                              failed                  
PRVF-5636 : The DNS response time for an unreachable node exceeded "15000" ms on following nodes: oracle02,oracle01

File "/etc/resolv.conf" is not consistent across nodes

Check: Time zone consistency 
Result: Time zone consistency check passed

Pre-check for cluster services setup was unsuccessful on all the nodes.

3.2.2. 查看当前集群状态

[grid@oracle02 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
               ONLINE  ONLINE       oracle02                                     
ora.DATA.dg
               ONLINE  ONLINE       oracle02                                     
ora.LISTENER.lsnr
               ONLINE  ONLINE       oracle02                                     
ora.OCR_VOTE.dg
               ONLINE  ONLINE       oracle02                                     
ora.asm
               ONLINE  ONLINE       oracle02                 Started             
ora.gsd
               OFFLINE OFFLINE      oracle02                                     
ora.net1.network
               ONLINE  ONLINE       oracle02                                     
ora.ons
               ONLINE  ONLINE       oracle02                                     
ora.registry.acfs
               ONLINE  ONLINE       oracle02                                     
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oracle02                                     
ora.cvu
      1        ONLINE  ONLINE       oracle02                                     
ora.oc4j
      1        ONLINE  ONLINE       oracle02                                     
ora.oracle01.vip
      1        ONLINE  INTERMEDIATE oracle02                 FAILED OVER         
ora.oracle02.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.scan1.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.wlsi.db
      1        ONLINE  OFFLINE                                                   
      2        ONLINE  ONLINE       oracle02                 Open

3.2.3. 更新集群信息

[oracle@oracle02 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=/oracle/app/product/11.2.0/db_1 "CLUSTER_NODES=oracle02"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.

3.2.4. 停止和删除1节点vip监听

[root@oracle02 bin]# ./srvctl stop vip -i oracle01-vip
[root@oracle02 bin]# ./srvctl remove vip -i oracle01-vip -f
[root@oracle02 bin]# ./crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
               ONLINE  ONLINE       oracle02                                     
ora.DATA.dg
               ONLINE  ONLINE       oracle02                                     
ora.LISTENER.lsnr
               ONLINE  ONLINE       oracle02                                     
ora.OCR_VOTE.dg
               ONLINE  ONLINE       oracle02                                     
ora.asm
               ONLINE  ONLINE       oracle02                 Started             
ora.gsd
               OFFLINE OFFLINE      oracle02                                     
ora.net1.network
               ONLINE  ONLINE       oracle02                                     
ora.ons
               ONLINE  ONLINE       oracle02                                     
ora.registry.acfs
               ONLINE  ONLINE       oracle02                                     
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oracle02                                     
ora.cvu
      1        ONLINE  ONLINE       oracle02                                     
ora.oc4j
      1        ONLINE  ONLINE       oracle02                                     
ora.oracle02.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.scan1.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.wlsi.db
      2        ONLINE  ONLINE       oracle02                 Open

3.2.5. 剔除节点1

[root@oracle02 ~]# cd /oracle/grid/crs_1/bin/
You have new mail in /var/spool/mail/root
[root@oracle02 bin]# ./olsnodes -s -t
oracle01        Inactive        Unpinned
oracle02        Active  Unpinned
[root@oracle02 bin]# ./crsctl delete node -n oracle01
CRS-4661: Node oracle01 successfully deleted.

3.3. 安装数据库集群软件
在2节点上向1节点安装数据库集群软件。

[root@oracle02 bin]# su - grid
[grid@oracle02 ~]$ cd $ORACLE_HOME
[grid@oracle02 crs_1]$ cd oui
[grid@oracle02 oui]$ cd bin
[grid@oracle02 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=/oracle/grid/crs_1 "CLUSTER_NODES=oracle02" CRS=TRUE -silent
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.

[root@oracle02 bin]# ./olsnodes
oracle02
[root@oracle02 bin]# pwd
/oracle/grid/crs_1/bin

[grid@oracle02 audit]$ cd $ORACLE_HOME
[grid@oracle02 crs_1]$ cd oui/bin/
[grid@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[grid@oracle02 bin]$ ./addNode.sh "CLUSTER_NEW_NODES=oracle01" "CLUSTER_NEW_VIRTUAL_HOSTNAMES=oracle01-vip"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.

SEVERE:Cannot perform add node procedure as the value of CLUSTER_NEW_VIRTUAL_HOSTNAMES or CLUSTER_NEW_NODES or both could not be obtained from the command line or response file(s). Silent install cannot continue.
[grid@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES={oracle01}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={oracle01-vip}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.


Performing tests to see whether nodes oracle01 are available
............................................................... 100% Done.

.
-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
   Source: /oracle/grid/crs_1
   New Nodes
Space Requirements
   New Nodes
      oracle01
         /oracle: Required 9.79GB : Available 63.69GB
Installed Products
   Product Names
      Oracle Grid Infrastructure 11g 11.2.0.4.0 
      Java Development Kit 1.5.0.51.10 
      Installer SDK Component 11.2.0.4.0 
      Oracle One-Off Patch Installer 11.2.0.3.4 
      Oracle Universal Installer 11.2.0.4.0 
      Oracle RAC Required Support Files-HAS 11.2.0.4.0 
      Oracle USM Deconfiguration 11.2.0.4.0 
      Oracle Configuration Manager Deconfiguration 10.3.1.0.0 
      Enterprise Manager Common Core Files 10.2.0.4.5 
      Oracle DBCA Deconfiguration 11.2.0.4.0 
      Oracle RAC Deconfiguration 11.2.0.4.0 
      Oracle Quality of Service Management (Server) 11.2.0.4.0 
      Installation Plugin Files 11.2.0.4.0 
      Universal Storage Manager Files 11.2.0.4.0 
      Oracle Text Required Support Files 11.2.0.4.0 
      Automatic Storage Management Assistant 11.2.0.4.0 
      Oracle Database 11g Multimedia Files 11.2.0.4.0 
      Oracle Multimedia Java Advanced Imaging 11.2.0.4.0 
      Oracle Globalization Support 11.2.0.4.0 
      Oracle Multimedia Locator RDBMS Files 11.2.0.4.0 
      Oracle Core Required Support Files 11.2.0.4.0 
      Bali Share 1.1.18.0.0 
      Oracle Database Deconfiguration 11.2.0.4.0 
      Oracle Quality of Service Management (Client) 11.2.0.4.0 
      Expat libraries 2.0.1.0.1 
      Oracle Containers for Java 11.2.0.4.0 
      Perl Modules 5.10.0.0.1 
      Secure Socket Layer 11.2.0.4.0 
      Oracle JDBC/OCI Instant Client 11.2.0.4.0 
      Oracle Multimedia Client Option 11.2.0.4.0 
      LDAP Required Support Files 11.2.0.4.0 
      Character Set Migration Utility 11.2.0.4.0 
      Perl Interpreter 5.10.0.0.2 
      PL/SQL Embedded Gateway 11.2.0.4.0 
      OLAP SQL Scripts 11.2.0.4.0 
      Database SQL Scripts 11.2.0.4.0 
      Oracle Extended Windowing Toolkit 3.4.47.0.0 
      SSL Required Support Files for InstantClient 11.2.0.4.0 
      SQL*Plus Files for Instant Client 11.2.0.4.0 
      Oracle Net Required Support Files 11.2.0.4.0 
      Oracle Database User Interface 2.2.13.0.0 
      RDBMS Required Support Files for Instant Client 11.2.0.4.0 
      RDBMS Required Support Files Runtime 11.2.0.4.0 
      XML Parser for Java 11.2.0.4.0 
      Oracle Security Developer Tools 11.2.0.4.0 
      Oracle Wallet Manager 11.2.0.4.0 
      Enterprise Manager plugin Common Files 11.2.0.4.0 
      Platform Required Support Files 11.2.0.4.0 
      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0 
      RDBMS Required Support Files 11.2.0.4.0 
      Oracle Ice Browser 5.2.3.6.0 
      Oracle Help For Java 4.2.9.0.0 
      Enterprise Manager Common Files 10.2.0.4.5 
      Deinstallation Tool 11.2.0.4.0 
      Oracle Java Client 11.2.0.4.0 
      Cluster Verification Utility Files 11.2.0.4.0 
      Oracle Notification Service (eONS) 11.2.0.4.0 
      Oracle LDAP administration 11.2.0.4.0 
      Cluster Verification Utility Common Files 11.2.0.4.0 
      Oracle Clusterware RDBMS Files 11.2.0.4.0 
      Oracle Locale Builder 11.2.0.4.0 
      Oracle Globalization Support 11.2.0.4.0 
      Buildtools Common Files 11.2.0.4.0 
      HAS Common Files 11.2.0.4.0 
      SQL*Plus Required Support Files 11.2.0.4.0 
      XDK Required Support Files 11.2.0.4.0 
      Agent Required Support Files 10.2.0.4.5 
      Parser Generator Required Support Files 11.2.0.4.0 
      Precompiler Required Support Files 11.2.0.4.0 
      Installation Common Files 11.2.0.4.0 
      Required Support Files 11.2.0.4.0 
      Oracle JDBC/THIN Interfaces 11.2.0.4.0 
      Oracle Multimedia Locator 11.2.0.4.0 
      Oracle Multimedia 11.2.0.4.0 
      Assistant Common Files 11.2.0.4.0 
      Oracle Net 11.2.0.4.0 
      PL/SQL 11.2.0.4.0 
      HAS Files for DB 11.2.0.4.0 
      Oracle Recovery Manager 11.2.0.4.0 
      Oracle Database Utilities 11.2.0.4.0 
      Oracle Notification Service 11.2.0.3.0 
      SQL*Plus 11.2.0.4.0 
      Oracle Netca Client 11.2.0.4.0 
      Oracle Advanced Security 11.2.0.4.0 
      Oracle JVM 11.2.0.4.0 
      Oracle Internet Directory Client 11.2.0.4.0 
      Oracle Net Listener 11.2.0.4.0 
      Cluster Ready Services Files 11.2.0.4.0 
      Oracle Database 11g 11.2.0.4.0 
-----------------------------------------------------------------------------


Instantiating scripts for add node (Wednesday, November 11, 2020 12:30:04 AM CST)
.                                                                 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Wednesday, November 11, 2020 12:30:06 AM CST)
...............................................................................................                                 96% Done.
Home copied to new nodes

Saving inventory on nodes (Wednesday, November 11, 2020 12:33:12 AM CST)
.                                                               100% Done.
Save inventory complete
WARNING:A new inventory has been created on one or more nodes in this session. However, it has not yet been registered as the central inventory of this system. 
To register the new inventory please run the script at '/oracle/oraInventory/orainstRoot.sh' with root privileges on nodes 'oracle01'.
If you do not register the inventory, you may not be able to update or patch the products you installed.
The following configuration scripts need to be executed as the "root" user in each new cluster node. Each script in the list below is followed by a list of nodes.
/oracle/oraInventory/orainstRoot.sh #On nodes oracle01
/oracle/grid/crs_1/root.sh #On nodes oracle01
To execute the configuration scripts:
    1. Open a terminal window
    2. Log in as "root"
    3. Run the scripts in each cluster node
    
The Cluster Node Addition of /oracle/grid/crs_1 was successful.
Please check '/tmp/silentInstall.log' for more details.

[root@oracle01 ~]# /oracle/oraInventory/orainstRoot.sh
Creating the Oracle inventory pointer file (/etc/oraInst.loc)
Changing permissions of /oracle/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /oracle/oraInventory to oinstall.
The execution of the script is complete.
[root@oracle01 ~]# /oracle/grid/crs_1/root.sh
Performing root user operation for Oracle 11g 

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /oracle/grid/crs_1

Enter the full pathname of the local bin directory: [/usr/local/bin]: 
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/grid/crs_1/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
Adding Clusterware entries to oracle-ohasd.conf
CRS-2672: Attempting to start 'ora.mdnsd' on 'oracle01'
CRS-2676: Start of 'ora.mdnsd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'oracle01'
CRS-2676: Start of 'ora.gpnpd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oracle01'
CRS-2672: Attempting to start 'ora.gipcd' on 'oracle01'
CRS-2676: Start of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-2676: Start of 'ora.gipcd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oracle01'
CRS-2672: Attempting to start 'ora.diskmon' on 'oracle01'
CRS-2676: Start of 'ora.diskmon' on 'oracle01' succeeded
CRS-2676: Start of 'ora.cssd' on 'oracle01' succeeded
Start of resource "ora.cssd" failed
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oracle01'
CRS-2672: Attempting to start 'ora.gipcd' on 'oracle01'
CRS-2676: Start of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-2676: Start of 'ora.gipcd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oracle01'
CRS-2672: Attempting to start 'ora.diskmon' on 'oracle01'
CRS-2676: Start of 'ora.diskmon' on 'oracle01' succeeded
CRS-2674: Start of 'ora.cssd' on 'oracle01' failed
CRS-2679: Attempting to clean 'ora.cssd' on 'oracle01'
CRS-2681: Clean of 'ora.cssd' on 'oracle01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'oracle01'
CRS-2677: Stop of 'ora.gipcd' on 'oracle01' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'oracle01'
CRS-2677: Stop of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-5804: Communication error with agent process
CRS-4000: Command Start failed, or completed with errors.
Failed to start Oracle Grid Infrastructure stack
Failed to start Cluster Synchorinisation Service in clustered mode at /oracle/grid/crs_1/crs/install/crsconfig_lib.pm line 1285.
/oracle/grid/crs_1/perl/bin/perl -I/oracle/grid/crs_1/perl/lib -I/oracle/grid/crs_1/crs/install /oracle/grid/crs_1/crs/install/rootcrs.pl execution failed

由于ASM磁盘组磁盘的多路径问题,导致root.sh脚本运行失败,后续通过停机重新配置磁盘多路径后,重新运行root.sh脚本完成。
3.4. 安装数据库软件

[oracle@oracle02 ~]$ cd /oracle/app/product/11.2.0/db_1/oui/bin/
[oracle@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[oracle@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES=oracle01"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.

SEVERE:Values for the following variables could not be obtained from the command line or response file(s): 
  CLUSTER_NEW_NODES(NewNodes) 
Silent install cannot continue.
[oracle@oracle02 bin]$ cd $ORACLE_HOME/oui/bin
[oracle@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[oracle@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES={oracle01}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 63999 MB    Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.


Performing tests to see whether nodes oracle01 are available
............................................................... 100% Done.

.
-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
   Source: /oracle/app/product/11.2.0/db_1
   New Nodes
Space Requirements
   New Nodes
      oracle01
         /oracle: Required 5.13GB : Available 57.03GB
Installed Products
   Product Names
      Oracle Database 11g 11.2.0.4.0 
      Java Development Kit 1.5.0.51.10 
      Installer SDK Component 11.2.0.4.0 
      Oracle One-Off Patch Installer 11.2.0.3.4 
      Oracle Universal Installer 11.2.0.4.0 
      Oracle USM Deconfiguration 11.2.0.4.0 
      Oracle Configuration Manager Deconfiguration 10.3.1.0.0 
      Oracle DBCA Deconfiguration 11.2.0.4.0 
      Oracle RAC Deconfiguration 11.2.0.4.0 
      Oracle Database Deconfiguration 11.2.0.4.0 
      Oracle Configuration Manager Client 10.3.2.1.0 
      Oracle Configuration Manager 10.3.8.1.0 
      Oracle ODBC Driverfor Instant Client 11.2.0.4.0 
      LDAP Required Support Files 11.2.0.4.0 
      SSL Required Support Files for InstantClient 11.2.0.4.0 
      Bali Share 1.1.18.0.0 
      Oracle Extended Windowing Toolkit 3.4.47.0.0 
      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0 
      Oracle Real Application Testing 11.2.0.4.0 
      Oracle Database Vault J2EE Application 11.2.0.4.0 
      Oracle Label Security 11.2.0.4.0 
      Oracle Data Mining RDBMS Files 11.2.0.4.0 
      Oracle OLAP RDBMS Files 11.2.0.4.0 
      Oracle OLAP API 11.2.0.4.0 
      Platform Required Support Files 11.2.0.4.0 
      Oracle Database Vault option 11.2.0.4.0 
      Oracle RAC Required Support Files-HAS 11.2.0.4.0 
      SQL*Plus Required Support Files 11.2.0.4.0 
      Oracle Display Fonts 9.0.2.0.0 
      Oracle Ice Browser 5.2.3.6.0 
      Oracle JDBC Server Support Package 11.2.0.4.0 
      Oracle SQL Developer 11.2.0.4.0 
      Oracle Application Express 11.2.0.4.0 
      XDK Required Support Files 11.2.0.4.0 
      RDBMS Required Support Files for Instant Client 11.2.0.4.0 
      SQLJ Runtime 11.2.0.4.0 
      Database Workspace Manager 11.2.0.4.0 
      RDBMS Required Support Files Runtime 11.2.0.4.0 
      Oracle Globalization Support 11.2.0.4.0 
      Exadata Storage Server 11.2.0.1.0 
      Provisioning Advisor Framework 10.2.0.4.3 
      Enterprise Manager Database Plugin -- Repository Support 11.2.0.4.0 
      Enterprise Manager Repository Core Files 10.2.0.4.5 
      Enterprise Manager Database Plugin -- Agent Support 11.2.0.4.0 
      Enterprise Manager Grid Control Core Files 10.2.0.4.5 
      Enterprise Manager Common Core Files 10.2.0.4.5 
      Enterprise Manager Agent Core Files 10.2.0.4.5 
      RDBMS Required Support Files 11.2.0.4.0 
      regexp 2.1.9.0.0 
      Agent Required Support Files 10.2.0.4.5 
      Oracle 11g Warehouse Builder Required Files 11.2.0.4.0 
      Oracle Notification Service (eONS) 11.2.0.4.0 
      Oracle Text Required Support Files 11.2.0.4.0 
      Parser Generator Required Support Files 11.2.0.4.0 
      Oracle Database 11g Multimedia Files 11.2.0.4.0 
      Oracle Multimedia Java Advanced Imaging 11.2.0.4.0 
      Oracle Multimedia Annotator 11.2.0.4.0 
      Oracle JDBC/OCI Instant Client 11.2.0.4.0 
      Oracle Multimedia Locator RDBMS Files 11.2.0.4.0 
      Precompiler Required Support Files 11.2.0.4.0 
      Oracle Core Required Support Files 11.2.0.4.0 
      Sample Schema Data 11.2.0.4.0 
      Oracle Starter Database 11.2.0.4.0 
      Oracle Message Gateway Common Files 11.2.0.4.0 
      Oracle XML Query 11.2.0.4.0 
      XML Parser for Oracle JVM 11.2.0.4.0 
      Oracle Help For Java 4.2.9.0.0 
      Installation Plugin Files 11.2.0.4.0 
      Enterprise Manager Common Files 10.2.0.4.5 
      Expat libraries 2.0.1.0.1 
      Deinstallation Tool 11.2.0.4.0 
      Oracle Quality of Service Management (Client) 11.2.0.4.0 
      Perl Modules 5.10.0.0.1 
      JAccelerator (COMPANION) 11.2.0.4.0 
      Oracle Containers for Java 11.2.0.4.0 
      Perl Interpreter 5.10.0.0.2 
      Oracle Net Required Support Files 11.2.0.4.0 
      Secure Socket Layer 11.2.0.4.0 
      Oracle Universal Connection Pool 11.2.0.4.0 
      Oracle JDBC/THIN Interfaces 11.2.0.4.0 
      Oracle Multimedia Client Option 11.2.0.4.0 
      Oracle Java Client 11.2.0.4.0 
      Character Set Migration Utility 11.2.0.4.0 
      Oracle Code Editor 1.2.1.0.0I 
      PL/SQL Embedded Gateway 11.2.0.4.0 
      OLAP SQL Scripts 11.2.0.4.0 
      Database SQL Scripts 11.2.0.4.0 
      Oracle Locale Builder 11.2.0.4.0 
      Oracle Globalization Support 11.2.0.4.0 
      SQL*Plus Files for Instant Client 11.2.0.4.0 
      Required Support Files 11.2.0.4.0 
      Oracle Database User Interface 2.2.13.0.0 
      Oracle ODBC Driver 11.2.0.4.0 
      Oracle Notification Service 11.2.0.3.0 
      XML Parser for Java 11.2.0.4.0 
      Oracle Security Developer Tools 11.2.0.4.0 
      Oracle Wallet Manager 11.2.0.4.0 
      Cluster Verification Utility Common Files 11.2.0.4.0 
      Oracle Clusterware RDBMS Files 11.2.0.4.0 
      Oracle UIX 2.2.24.6.0 
      Enterprise Manager plugin Common Files 11.2.0.4.0 
      HAS Common Files 11.2.0.4.0 
      Precompiler Common Files 11.2.0.4.0 
      Installation Common Files 11.2.0.4.0 
      Oracle Help for the  Web 2.0.14.0.0 
      Oracle LDAP administration 11.2.0.4.0 
      Buildtools Common Files 11.2.0.4.0 
      Assistant Common Files 11.2.0.4.0 
      Oracle Recovery Manager 11.2.0.4.0 
      PL/SQL 11.2.0.4.0 
      Generic Connectivity Common Files 11.2.0.4.0 
      Oracle Database Gateway for ODBC 11.2.0.4.0 
      Oracle Programmer 11.2.0.4.0 
      Oracle Database Utilities 11.2.0.4.0 
      Enterprise Manager Agent 10.2.0.4.5 
      SQL*Plus 11.2.0.4.0 
      Oracle Netca Client 11.2.0.4.0 
      Oracle Multimedia Locator 11.2.0.4.0 
      Oracle Call Interface (OCI) 11.2.0.4.0 
      Oracle Multimedia 11.2.0.4.0 
      Oracle Net 11.2.0.4.0 
      Oracle XML Development Kit 11.2.0.4.0 
      Oracle Internet Directory Client 11.2.0.4.0 
      Database Configuration and Upgrade Assistants 11.2.0.4.0 
      Oracle JVM 11.2.0.4.0 
      Oracle Advanced Security 11.2.0.4.0 
      Oracle Net Listener 11.2.0.4.0 
      Oracle Enterprise Manager Console DB 11.2.0.4.0 
      HAS Files for DB 11.2.0.4.0 
      Oracle Text 11.2.0.4.0 
      Oracle Net Services 11.2.0.4.0 
      Oracle Database 11g 11.2.0.4.0 
      Oracle OLAP 11.2.0.4.0 
      Oracle Spatial 11.2.0.4.0 
      Oracle Partitioning 11.2.0.4.0 
      Enterprise Edition Options 11.2.0.4.0 
-----------------------------------------------------------------------------


Instantiating scripts for add node (Wednesday, November 11, 2020 12:17:24 PM CST)
.                                                                 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Wednesday, November 11, 2020 12:17:26 PM CST)
...............................................................................................                                 96% Done.
Home copied to new nodes

Saving inventory on nodes (Wednesday, November 11, 2020 12:21:20 PM CST)
.                                                               100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the "root" user in each new cluster node. Each script in the list below is followed by a list of nodes.
/oracle/app/product/11.2.0/db_1/root.sh #On nodes oracle01
To execute the configuration scripts:
    1. Open a terminal window
    2. Log in as "root"
    3. Run the scripts in each cluster node
    
The Cluster Node Addition of /oracle/app/product/11.2.0/db_1 was successful.
Please check '/tmp/silentInstall.log' for more details.

[root@oracle01 rules.d]# /oracle/app/product/11.2.0/db_1/root.sh
Performing root user operation for Oracle 11g 

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /oracle/app/product/11.2.0/db_1

Enter the full pathname of the local bin directory: [/usr/local/bin]: 

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.

[root@oracle02 rules.d]# crsctl status res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.DATA.dg
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.LISTENER.lsnr
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.OCR_VOTE.dg
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.asm
               ONLINE  ONLINE       oracle01                 Started             
               ONLINE  ONLINE       oracle02                 Started             
ora.gsd
               OFFLINE OFFLINE      oracle01                                     
               OFFLINE OFFLINE      oracle02                                     
ora.net1.network
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.ons
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
ora.registry.acfs
               ONLINE  ONLINE       oracle01                                     
               ONLINE  ONLINE       oracle02                                     
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       oracle02                                     
ora.cvu
      1        ONLINE  ONLINE       oracle02                                     
ora.oc4j
      1        ONLINE  ONLINE       oracle02                                     
ora.oracle01.vip
      1        ONLINE  ONLINE       oracle01                                     
ora.oracle02.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.scan1.vip
      1        ONLINE  ONLINE       oracle02                                     
ora.orcl.db
      2        ONLINE  ONLINE       oracle02                 Open

3.5. 添加节点1至集群

[oracle@oracle02 ~]$ srvctl status database -d orcl
Instanceorcl2 is running on node oracle02
[oracle@oracle02 ~]$ srvctl add instance -dorcl -i orcl1 -n oracle01
[oracle@oracle02 ~]$ srvctl status database -d orcl                  
Instance orcl1 is not running on node oracle01
Instanceorcl2 is running on node oracle02
[oracle@oracle02 ~]$ srvctl stop instance -d orcl -i orcl1
[oracle@oracle02 ~]$ srvctl start instance -d orcl -i orcl1


[oracle@oracle02 ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Wed Nov 11 12:28:43 2020

Copyright (c) 1982, 2013, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> select thread#,inst_id,instance_number,instance_name,host_name,status,startup_time from gv$instance;

   THREAD#    INST_ID INSTANCE_NUMBER INSTANCE_NAME    HOST_NAME       STATUS       STARTUP_T
---------- ---------- --------------- ---------------- --------------- ------------ ---------
         2          2               2 orcl2            oracle02        OPEN         26-OCT-19
         1          1               1 orcl1            oracle01        OPEN         11-NOV-20

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值