Install Oracle10gRac On Solaris + HDS + Veritas5.0

Install Oracle10gRac On Solaris + HDS + Veritas5.0
1.安装操作系统
 
 
# uname -a
SunOS b1000a 5.8 Generic_117350-41 sun4u sparc SUNW,Sun-Blade-1000
 
 
配置hosts文件,设置相应别名,配置一个浮动ip(配置Cluster时需要)
 


# cat /etc/hosts
#
# Internet host table
#
127.0.0.1 localhost
172.18.2.202 b1000a b1000a.cluster.com loghost
172.18.2.203 b1000b
172.18.2.204 vip
172.18.2.205 b1000a_vip
172.18.2.206 b1000b_vip
192.168.12.1 b1000a_priv
192.168.12.2 b1000b_priv
    
 
5.安装VERITAS STORAGE FOUNDATION FOR ORACLE RAC 5.0软件

1).设置rsh许可
可以简单的配置.rhosts文件
# cat /.rhosts
+
#
在两台主机分别执行以下命令测试设置是否生效
# rsh cluster2 date
Fri Sep 3 04:06:56 CST 2004
2.使用安装工具进行安装


# ls
cluster_file_solutions_gsg.pdf          perl                                    storage_foundation_for_oracle_rac
gnu                                     rr_moved                                support
installer                               storage_foundation_cluster_file_system  windows
# ./installer

                                                 VERITAS Cluster File Solutions 4.0                                                 

Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.

VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.

                                                 VERITAS Cluster File Solutions 4.0                                                 

VERITAS Product                             Version Installed   Licensed
===========================================================================
Storage Foundation for Cluster File System        no              yes
Storage Foundation for Oracle RAC                 no              yes
Enterprise Administrator GUI                      no

Selection Menu:

    I) Install/Upgrade a Product    C) Configure an Installed Product
    L) License a Product            P) Perform a Preinstallation Check
    U) Uninstall a Product          D) View a Product Description
    Q) Quit                         ?) Help

Enter a Selection: [I,C,L,P,U,D,Q,?] I

--选择安装软件,最好在此前使用L,输入有效的License或Demo License

                                                 VERITAS Cluster File Solutions 4.0                                                 

     1)  VERITAS Storage Foundation for Cluster File System
     2)  VERITAS Storage Foundation for Oracle RAC
     3)  VERITAS Enterprise Administrator GUI
     B)    Back to previous menu

Select a product to install: [1-3,b,q] 2

--此处安装的是For Oracle RAC的版本

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.

VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.

Enter the system names separated by spaces on which to install SFRAC: cluster1 cluster2

--输入需要安装Cluster的节点名称

Checking system communication:

    Checking OS version on cluster1 ................................................................................. SunOS 5.9
    Checking VRTSdbac package ................................................................................... not installed
    Verifying communication with cluster2 ..................................................................... ping successful
    Attempting rsh with cluster2 ............................................................................... rsh successful
    Attempting rcp with cluster2 ............................................................................... rcp successful
    Checking OS version on cluster2 ................................................................................. SunOS 5.9
    Checking VRTSdbac package ................................................................................... not installed
    Creating log directory on cluster2 ................................................................................... Done

Logs for installer are being created in /var/tmp/installer902153656.

Using /usr/bin/rsh and /usr/bin/rcp to communicate with remote systems.

Initial system check completed successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

VERITAS Infrastructure package installation:

Installing VERITAS Infrastructure packages on cluster1:

    Checking VRTScpi package .......................................................................... version 4.0.5 installed
    Checking VRTSvlic package ..................................................................... version 3.02.005d installed

Installing VERITAS Infrastructure packages on cluster2:

    Checking VRTScpi package .......................................................................... version 4.0.5 installed
    Checking VRTSvlic package ..................................................................... version 3.02.005d installed

VERITAS Infrastructure packages installed successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Each system requires a SFRAC product license before installation.  License keys for additional product features should also be
added at this time.

Some license keys are node locked and are unique per system.  Other license keys, such as demo keys and site license keys, are
registered on all systems and must be entered on the first system.

SFRAC Licensing Verification:

    Checking SFRAC license key on cluster1 ............................................. Storage Foundation for Oracle RAC Demo

Do you want to enter another license key for cluster1? [y,n,q,?] (n)

    Checking SFRAC license key on cluster2 ............................................. Storage Foundation for Oracle RAC Demo

Do you want to enter another license key for cluster2? [y,n,q,?] (n)

--此处进行的是License验证,我的此前已经输入了Demo License

SFRAC licensing verified successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

installer will install the following SFRAC packages:
VRTSperl     VERITAS Perl 5.8.0 Redistribution
VRTSob       VERITAS Enterprise Administrator Service
VRTSmuob     VERITAS Enterprise Administrator Service Localized Package
VRTSobgui    VERITAS Enterprise Administrator
VRTSvxvm     VERITAS Volume Manager Binaries
VRTSvmman    VERITAS Volume Manager Manual Pages
VRTSvmdoc    VERITAS Volume Manager Documentation
VRTSvmpro    VERITAS Volume Manager Management Services Provider
VRTSfspro    VERITAS File System Management Services Provider
VRTSalloc    VERITAS Volume Manager Intelligent Storage Provisioning
VRTSddlpr    VERITAS Device Discovery Layer Services Provider
VRTSvxfs     VERITAS File System
VRTStep      VERITAS Task Provider
VRTSap       VERITAS Action Provider
VRTSfppm     VERITAS File Placement Policy Manager
VRTSfsman    VERITAS File System Manual Pages
VRTSfsdoc    VERITAS File System Documentation
VRTSllt      VERITAS Low Latency Transport
VRTSgab      VERITAS Group Membership and Atomic Broadcast

Press [Return] to continue:
...continued:
VRTSvxfen    VERITAS I/O Fencing
VRTSvcs      VERITAS Cluster Server
VRTSvcsmg    VERITAS Cluster Server Message Catalogs
VRTSvcsag    VERITAS Cluster Server Bundled Agents
VRTSvcsmn    VERITAS Cluster Server Man Pages
VRTScspro    VERITAS Cluster Server VEA Provider
VRTSvcsdc    VERITAS Cluster Server Documentation
VRTSjre      VERITAS Java Runtime Environment Redistribution
VRTScutil    VERITAS Cluster Utilities
VRTScssim    VERITAS Cluster Server Simulator
VRTScscw     VERITAS Cluster Server Configuration Wizards
VRTSweb      VERITAS Java Web Server
VRTSvcsw     VERITAS Cluster Manager (Web Console)
VRTScscm     VERITAS Cluster Server Cluster Manager
VRTScavf     VERITAS Cluster Server Agents for Cluster File System
VRTSglm      VERITAS Group Lock Manager
VRTSgms      VERITAS Group Messaging Services
VRTSodm      VERITAS Oracle Disk Manager
VRTSvail     VERITAS Array Provider
VRTSdbac     VERITAS Oracle Real Application Cluster Support Package

Press [Return] to continue:
...continued:
VRTSracdc    VERITAS Storage Foundation 4.0 for Oracle RAC Documentation
VRTSvcsor    VERITAS Cluster Server Oracle Enterprise Extension
VRTScsocw    VERITAS Cluster Server Oracle 9i RAC Wizard
VRTSvcsvr    VERITAS Cluster Server VVR Agent
VRTSdbckp    VERITAS Storage Foundation Checkpoint Scripts
VRTSvxmsa    VERITAS Mapping Service, Application Libraries

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Checking system installation requirements:

Checking SFRAC installation requirements on cluster1:

    Checking VRTSperl package ................................................................................... not installed
    Checking VRTSob package ..................................................................................... not installed
    Checking VRTSmuob package ................................................................................... not installed
    Checking VRTSobgui package .................................................................................. not installed
    Checking VRTSvxvm package ................................................................................... not installed
    Checking VRTSvmman package .................................................................................. not installed
    Checking VRTSvmdoc package .................................................................................. not installed
    Checking VRTSvmpro package .................................................................................. not installed
    Checking VRTSfspro package .................................................................................. not installed
    Checking VRTSalloc package .................................................................................. not installed
    Checking VRTSddlpr package .................................................................................. not installed
    Checking VRTSvxfs package ................................................................................... not installed
    Checking VRTStep package .................................................................................... not installed
    Checking VRTSap package ..................................................................................... not installed
    Checking VRTSfppm package ................................................................................... not installed
    Checking VRTSfsman package .................................................................................. not installed
    Checking VRTSfsdoc package .................................................................................. not installed
    Checking VRTSllt package .................................................................................... not installed
    Checking VRTSgab package .................................................................................... not installed
    Checking VRTSvxfen package .................................................................................. not installed
    Checking VRTSvcs package .................................................................................... not installed
    Checking VRTSvcsmg package .................................................................................. not installed
    Checking VRTSvcsag package .................................................................................. not installed
    Checking VRTSvcsmn package .................................................................................. not installed
    Checking VRTScspro package .................................................................................. not installed
    Checking VRTSvcsdc package .................................................................................. not installed
    Checking VRTSjre package .................................................................................... not installed
    Checking VRTScutil package .................................................................................. not installed
    Checking VRTScssim package .................................................................................. not installed
    Checking VRTScscw package ................................................................................... not installed
    Checking VRTSweb package .................................................................................... not installed
    Checking VRTSvcsw package ................................................................................... not installed
    Checking VRTScscm package ................................................................................... not installed
    Checking VRTScavf package ................................................................................... not installed
    Checking VRTSglm package .................................................................................... not installed
    Checking VRTSgms package .................................................................................... not installed
    Checking VRTSodm package .................................................................................... not installed
    Checking VRTSvail package ................................................................................... not installed
    Checking VRTSdbac package ................................................................................... not installed
    Checking VRTSracdc package .................................................................................. not installed
    Checking VRTSvcsor package .................................................................................. not installed
    Checking VRTScsocw package .................................................................................. not installed
    Checking VRTSvcsvr package .................................................................................. not installed
    Checking VRTSdbckp package .................................................................................. not installed
    Checking VRTSvxmsa package .................................................................................. not installed
    Checking required SunOS patch 113277-08 on cluster1 ................................................... 113277-24 installed
    Checking VERITAS patch 115209 ............................................................................... not installed
    Checking VERITAS patch 115212 ............................................................................... not installed
    Checking VERITAS patch 115210 ............................................................................... not installed
    Checking VERITAS patch 115217 ............................................................................... not installed
    Checking for any Solaris patch issues ................................................................................ None
    Checking file system space .................................................................... required space is available
    Checking odm driver ........................................................................................... not running
    Checking vxgms driver ......................................................................................... not running
    Checking vxportal driver ...................................................................................... not running
    Checking fdd driver ........................................................................................... not running
    Checking qlog driver .......................................................................................... not running
    Checking vxfs driver .......................................................................................... not running
    Checking VRTSweb process ...................................................................................... not running
    Checking had process .......................................................................................... not running
    Checking hashadow process ..................................................................................... not running
    Checking CmdServer process .................................................................................... not running
    Checking notifier process ..................................................................................... not running
    Checking vxsvc process ........................................................................................ not running
    Checking vcsmm driver ......................................................................................... not running
    Checking lmx driver ........................................................................................... not running
    Checking odm driver ........................................................................................... not running
    Checking vxgms driver ......................................................................................... not running
    Checking vxfen driver ......................................................................................... not running
    Checking gab driver ........................................................................................... not running
    Checking llt driver ........................................................................................... not running
    Checking vxportal driver ...................................................................................... not running
    Checking fdd driver ........................................................................................... not running
    Checking qlog driver .......................................................................................... not running
    Checking vxfs driver .......................................................................................... not running

Checking SFRAC installation requirements on cluster2:

    Checking VRTSperl package ................................................................................... not installed
    Checking VRTSob package ..................................................................................... not installed
    Checking VRTSmuob package ................................................................................... not installed
    Checking VRTSobgui package .................................................................................. not installed
    Checking VRTSvxvm package ................................................................................... not installed
    Checking VRTSvmman package .................................................................................. not installed
    Checking VRTSvmdoc package .................................................................................. not installed
    Checking VRTSvmpro package .................................................................................. not installed
    Checking VRTSfspro package .................................................................................. not installed
    Checking VRTSalloc package .................................................................................. not installed
    Checking VRTSddlpr package .................................................................................. not installed
    Checking VRTSvxfs package ................................................................................... not installed
    Checking VRTStep package .................................................................................... not installed
    Checking VRTSap package ..................................................................................... not installed
    Checking VRTSfppm package ................................................................................... not installed
    Checking VRTSfsman package .................................................................................. not installed
    Checking VRTSfsdoc package .................................................................................. not installed
    Checking VRTSllt package .................................................................................... not installed
    Checking VRTSgab package .................................................................................... not installed
    Checking VRTSvxfen package .................................................................................. not installed
    Checking VRTSvcs package .................................................................................... not installed
    Checking VRTSvcsmg package .................................................................................. not installed
    Checking VRTSvcsag package .................................................................................. not installed
    Checking VRTSvcsmn package .................................................................................. not installed
    Checking VRTScspro package .................................................................................. not installed
    Checking VRTSvcsdc package .................................................................................. not installed
    Checking VRTSjre package .................................................................................... not installed
    Checking VRTScutil package .................................................................................. not installed
    Checking VRTScssim package .................................................................................. not installed
    Checking VRTScscw package ................................................................................... not installed
    Checking VRTSweb package .................................................................................... not installed
    Checking VRTSvcsw package ................................................................................... not installed
    Checking VRTScscm package ................................................................................... not installed
    Checking VRTScavf package ................................................................................... not installed
    Checking VRTSglm package .................................................................................... not installed
    Checking VRTSgms package .................................................................................... not installed
    Checking VRTSodm package .................................................................................... not installed
    Checking VRTSvail package ................................................................................... not installed
    Checking VRTSdbac package ................................................................................... not installed
    Checking VRTSracdc package .................................................................................. not installed
    Checking VRTSvcsor package .................................................................................. not installed
    Checking VRTScsocw package .................................................................................. not installed
    Checking VRTSvcsvr package .................................................................................. not installed
    Checking VRTSdbckp package .................................................................................. not installed
    Checking VRTSvxmsa package .................................................................................. not installed
    Checking required SunOS patch 113277-08 on cluster2 ................................................... 113277-24 installed
    Checking VERITAS patch 115209 ............................................................................... not installed
    Checking VERITAS patch 115212 ............................................................................... not installed
    Checking VERITAS patch 115210 ............................................................................... not installed
    Checking VERITAS patch 115217 ............................................................................... not installed
    Checking for any Solaris patch issues ................................................................................ None
    Checking file system space .................................................................... required space is available
    Checking odm driver ........................................................................................... not running
    Checking vxgms driver ......................................................................................... not running
    Checking vxportal driver ...................................................................................... not running
    Checking fdd driver ........................................................................................... not running
    Checking qlog driver .......................................................................................... not running
    Checking vxfs driver .......................................................................................... not running
    Checking VRTSweb process ...................................................................................... not running
    Checking had process .......................................................................................... not running
    Checking hashadow process ..................................................................................... not running
    Checking CmdServer process .................................................................................... not running
    Checking notifier process ..................................................................................... not running
    Checking vxsvc process ........................................................................................ not running
    Checking vcsmm driver ......................................................................................... not running
    Checking lmx driver ........................................................................................... not running
    Checking odm driver ........................................................................................... not running
    Checking vxgms driver ......................................................................................... not running
    Checking vxfen driver ......................................................................................... not running
    Checking gab driver ........................................................................................... not running
    Checking llt driver ........................................................................................... not running
    Checking vxportal driver ...................................................................................... not running
    Checking fdd driver ........................................................................................... not running
    Checking qlog driver .......................................................................................... not running
    Checking vxfs driver .......................................................................................... not running

Installation requirement checks completed successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Before SFRAC is installed, be sure you have reviewed the VERITAS Storage Foundation 4.0 for Oracle RAC Installation and
Configuration Guide

A copy of a previous VxVM configuration is present on the system cluster2.

Do you want to restore and reuse the previous VxVM configuration of system cluster2 [y,n,q,?] (y) n

--如果之前安装过,配置文件有备份,可以重用,也可以重新配置

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

It is possible to install SFRAC packages without performing configuration.

SFRAC cannot be started without proper configuration.

It is optional to configure SFRAC now. If you choose to configure SFRAC later, you can either do so manually or run the
installsfrac -configure command.
Are you ready to configure SFRAC? [y,n,q] (y)

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

installer will now ask sets of SFRAC configuration-related questions.

When a [b] is presented after a question, 'b' may be entered to go back to the first question of the configuration set.

When a [?] is presented after a question, '?' may be entered for help or additional information about the question.

Following each set of questions, the information you have entered will be presented for confirmation.  To repeat the set of
questions and correct any previous errors, enter 'n' at the confirmation prompt.

No configuration changes are made to the systems until all configuration questions are completed and SFRAC is installed
successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

To configure VCS for SFRAC the following is required:

        A unique Cluster name
        A unique Cluster ID number between 0-255
        Two or more NIC cards per system used for heartbeat links

All systems are being configured to create one cluster

Enter the unique cluster name: [?] ora9i
Enter the unique Cluster ID number between 0-255: [b,?] 1

--输入Cluster名称及ID号

    Discovering NICs on cluster1 ......... discovered bge0 bge1 bge2 bge3 chipid driverinfo lpfc0 parameters phydata statistics

Enter the NIC for the first private heartbeat link on cluster1: [b,?] bge1
Would you like to configure a second private heartbeat link? [y,n,q,b,?] (y)
Enter the NIC for the second private heartbeat link on cluster1: [b,?] bge2
Would you like to configure a third private heartbeat link? [y,n,q,b,?] (n)
Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)

--选择心跳网卡,最好有两块

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Cluster information verification:

        Cluster Name: ora9i
        Cluster ID Number: 1
        Private Heartbeat NICs for cluster1: link1=bge1 link2=bge2
        Private Heartbeat NICs for cluster2: link1=bge1 link2=bge2

Is this information correct? [y,n,q] (y)

--确认配置信息后继续

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

The following information is required to configure Cluster Manager:

        A public NIC used by each system in the cluster
        A Virtual IP address and netmask for Cluster Manager

Do you want to configure Cluster Manager (Web Console) [y,n,q] (y)
Active NIC devices discovered on cluster1: bge0
Enter the NIC for Cluster Manager (Web Console) to use on cluster1: [b,?] (bge0)
Is bge0 to be the public NIC used by all systems [y,n,q,b,?] (y)
Enter the Virtual IP address for Cluster Manager: [b,?] 172.16.33.74
Enter the netmask for IP 172.16.33.74: [b,?] (255.255.255.0)

--设置虚拟浮动ip地址

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Cluster Manager (Web Console) verification:

        NIC: bge0
        IP: 172.16.33.74
        Netmask: 255.255.255.0

Is this information correct? [y,n,q] (y)

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

The following information is required to configure SMTP notification:

        The domain-based hostname of the SMTP server
        The email address of each SMTP recipient
        A minimum severity level of messages to send to each recipient

Do you want to configure SMTP notification? [y,n,q] (y) n

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

The following information is required to configure SNMP notification:

        System names of SNMP consoles to receive VCS trap messages
        SNMP trap daemon port numbers for each console
        A minimum severity level of messages to send to each console

Do you want to configure SNMP notification? [y,n,q] (y) n

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Enter Cluster Volume Manager cluster reconfiguration timeout (sec): (200)

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

SFRAC packages can be installed on systems consecutively or simultaneously. Installing packages on systems consecutively takes
more time but allows for better error handling.

Would you like to install Storage Foundation for Oracle RAC packages on all systems simultaneously? [y,n,q,?] (y)

--是否同时安装两个节点,此前配置好了rsh才有效

Installing Storage Foundation for Oracle RAC 4.0 on all systems simultaneously:

    Copying VRTSperl.tar.gz to cluster2 ................................................................... Done 1 of 147 steps
    Installing VRTSperl 4.0.2 on cluster1 ................................................................. Done 2 of 147 steps
    Installing VRTSperl 4.0.2 on cluster2 ................................................................. Done 3 of 147 steps
    Copying VRTSob.tar.gz to cluster2 ..................................................................... Done 4 of 147 steps
    Installing VRTSob 3.2.514.0 on cluster1 ............................................................... Done 5 of 147 steps
    Installing VRTSmuob 3.2.514.0 on cluster1 ............................................................. Done 6 of 147 steps
    Installing VRTSob 3.2.514.0 on cluster2 ............................................................... Done 7 of 147 steps
    Copying VRTSmuob.tar.gz to cluster2 ................................................................... Done 8 of 147 steps
    Installing VRTSobgui 3.2.514.0 on cluster1 ............................................................ Done 9 of 147 steps
    Installing VRTSmuob 3.2.514.0 on cluster2 ............................................................ Done 10 of 147 steps
    Copying VRTSobgui.tar.gz to cluster2 ................................................................. Done 11 of 147 steps
    Installing VRTSobgui 3.2.514.0 on cluster2 ........................................................... Done 12 of 147 steps
    Copying VRTSvxvm.tar.gz to cluster2 .................................................................. Done 13 of 147 steps
    Installing VRTSvxvm 4.0 on cluster1 .................................................................. Done 14 of 147 steps
    Installing VRTSvmman 4.0 on cluster1 ................................................................. Done 15 of 147 steps
    Installing VRTSvmdoc 4.0 on cluster1 ................................................................. Done 16 of 147 steps
    Installing VRTSvmpro 4.0 on cluster1 ................................................................. Done 17 of 147 steps
    Installing VRTSfspro 4.0 on cluster1 ................................................................. Done 18 of 147 steps
    Installing VRTSalloc 4.0 on cluster1 ................................................................. Done 19 of 147 steps
    Installing VRTSddlpr 4.0 on cluster1 ................................................................. Done 20 of 147 steps
    Installing VRTSvxvm 4.0 on cluster2 .................................................................. Done 21 of 147 steps
    Copying VRTSvmman.tar.gz to cluster2 ................................................................. Done 22 of 147 steps
    Installing VRTSvmman 4.0 on cluster2 ................................................................. Done 23 of 147 steps
    Installing VRTSvxfs 4.0 on cluster1 .................................................................. Done 24 of 147 steps
    Installing VRTStep 1.20.025 on cluster1 .............................................................. Done 25 of 147 steps
    Copying VRTSvmdoc.tar.gz to cluster2 ................................................................. Done 26 of 147 steps
    Installing VRTSap 2.00.015 on cluster1 ............................................................... Done 27 of 147 steps
    Installing VRTSfppm 4.0 on cluster1 .................................................................. Done 28 of 147 steps
    Installing VRTSvmdoc 4.0 on cluster2 ................................................................. Done 29 of 147 steps
    Installing VRTSfsman 4.0 on cluster1 ................................................................. Done 30 of 147 steps
    Copying VRTSvmpro.tar.gz to cluster2 ................................................................. Done 31 of 147 steps
    Installing VRTSfsdoc 4.0 on cluster1 ................................................................. Done 32 of 147 steps
    Installing VRTSllt 4.0 on cluster1 ................................................................... Done 33 of 147 steps
    Installing VRTSgab 4.0 on cluster1 ................................................................... Done 34 of 147 steps
    Installing VRTSvmpro 4.0 on cluster2 ................................................................. Done 35 of 147 steps
    Copying VRTSfspro.tar.gz to cluster2 ................................................................. Done 36 of 147 steps
    Installing VRTSvxfen 4.0 on cluster1 ................................................................. Done 37 of 147 steps
    Installing VRTSfspro 4.0 on cluster2 ................................................................. Done 38 of 147 steps
    Copying VRTSalloc.tar.gz to cluster2 ................................................................. Done 39 of 147 steps
    Installing VRTSvcs 4.0 on cluster1 ................................................................... Done 40 of 147 steps
    Installing VRTSvcsmg 4.0 on cluster1 ................................................................. Done 41 of 147 steps
    Installing VRTSvcsag 4.0 on cluster1 ................................................................. Done 42 of 147 steps
    Installing VRTSvcsmn 4.0 on cluster1 ................................................................. Done 43 of 147 steps
    Installing VRTScspro 4.0 on cluster1 ................................................................. Done 44 of 147 steps
    Installing VRTSvcsdc 4.0 on cluster1 ................................................................. Done 45 of 147 steps
    Installing VRTSalloc 4.0 on cluster2 ................................................................. Done 46 of 147 steps
    Copying VRTSddlpr.tar.gz to cluster2 ................................................................. Done 47 of 147 steps
    Installing VRTSddlpr 4.0 on cluster2 ................................................................. Done 48 of 147 steps
    Installing VRTSjre 1.4 on cluster1 ................................................................... Done 49 of 147 steps
    Installing VRTScutil 4.0 on cluster1 ................................................................. Done 50 of 147 steps
    Copying VRTSvxfs.tar.gz to cluster2 .................................................................. Done 51 of 147 steps
    Installing VRTScssim 4.0 on cluster1 ................................................................. Done 52 of 147 steps
    Installing VRTScscw 4.0 on cluster1 .................................................................. Done 53 of 147 steps
    Installing VRTSweb 4.0 on cluster1 ................................................................... Done 54 of 147 steps
    Installing VRTSvcsw 4.0 on cluster1 .................................................................. Done 55 of 147 steps
    Installing VRTScscm 4.0 on cluster1 .................................................................. Done 56 of 147 steps
    Installing VRTScavf 4.0 on cluster1 .................................................................. Done 57 of 147 steps
    Installing VRTSglm 4.0 on cluster1 ................................................................... Done 58 of 147 steps
    Installing VRTSgms 4.0 on cluster1 ................................................................... Done 59 of 147 steps
    Installing VRTSodm 4.0 on cluster1 ................................................................... Done 60 of 147 steps
    Installing VRTSvxfs 4.0 on cluster2 .................................................................. Done 61 of 147 steps
    Copying VRTStep.tar.gz to cluster2 ................................................................... Done 62 of 147 steps
    Installing VRTStep 1.20.025 on cluster2 .............................................................. Done 63 of 147 steps
    Copying VRTSap.tar.gz to cluster2 .................................................................... Done 64 of 147 steps
    Installing VRTSap 2.00.015 on cluster2 ............................................................... Done 65 of 147 steps
    Copying VRTSfppm.tar.gz to cluster2 .................................................................. Done 66 of 147 steps
    Installing VRTSvail 4.0.0 on cluster1 ................................................................ Done 67 of 147 steps
    Installing VRTSfppm 4.0 on cluster2 .................................................................. Done 68 of 147 steps
    Installing VRTSdbac 4.0 on cluster1 .................................................................. Done 69 of 147 steps
    Copying VRTSfsman.tar.gz to cluster2 ................................................................. Done 70 of 147 steps
    Installing VRTSracdc 4.0 on cluster1 ................................................................. Done 71 of 147 steps
    Installing VRTSvcsor 4.0 on cluster1 ................................................................. Done 72 of 147 steps
    Installing VRTScsocw 4.0 on cluster1 ................................................................. Done 73 of 147 steps
    Installing VRTSvcsvr 4.0 on cluster1 ................................................................. Done 74 of 147 steps
    Installing VRTSdbckp 4.0 on cluster1 ................................................................. Done 75 of 147 steps
    Installing VRTSfsman 4.0 on cluster2 ................................................................. Done 76 of 147 steps
    Installing VRTSvxmsa 4.0 on cluster1 ................................................................. Done 77 of 147 steps
    Copying VRTSfsdoc.tar.gz to cluster2 ................................................................. Done 78 of 147 steps
    Installing VRTSfsdoc 4.0 on cluster2 ................................................................. Done 79 of 147 steps
    Copying VRTSllt.tar.gz to cluster2 ................................................................... Done 80 of 147 steps
    Adding patch 115209-05 on cluster1 ................................................................... Done 81 of 147 steps
    Installing VRTSllt 4.0 on cluster2 ................................................................... Done 82 of 147 steps
    Copying VRTSgab.tar.gz to cluster2 ................................................................... Done 83 of 147 steps
    Adding patch 115212-05 on cluster1 ................................................................... Done 84 of 147 steps
    Adding patch 115210-05 on cluster1 ................................................................... Done 85 of 147 steps
    Installing VRTSgab 4.0 on cluster2 ................................................................... Done 86 of 147 steps
    Copying VRTSvxfen.tar.gz to cluster2 ................................................................. Done 87 of 147 steps
    Installing VRTSvxfen 4.0 on cluster2 ................................................................. Done 88 of 147 steps
    Copying VRTSvcs.tar.gz to cluster2 ................................................................... Done 89 of 147 steps
    Installing VRTSvcs 4.0 on cluster2 ................................................................... Done 90 of 147 steps
    Copying VRTSvcsmg.tar.gz to cluster2 ................................................................. Done 91 of 147 steps
    Installing VRTSvcsmg 4.0 on cluster2 ................................................................. Done 92 of 147 steps
    Adding patch 115217-01 on cluster1 ................................................................... Done 93 of 147 steps
    Copying VRTSvcsag.tar.gz to cluster2 ................................................................. Done 94 of 147 steps
    Installing VRTSvcsag 4.0 on cluster2 ................................................................. Done 95 of 147 steps
    Copying VRTSvcsmn.tar.gz to cluster2 ................................................................. Done 96 of 147 steps
    Installing VRTSvcsmn 4.0 on cluster2 ................................................................. Done 97 of 147 steps
    Copying VRTScspro.tar.gz to cluster2 ................................................................. Done 98 of 147 steps
    Installing VRTScspro 4.0 on cluster2 ................................................................. Done 99 of 147 steps
    Copying VRTSvcsdc.tar.gz to cluster2 ................................................................ Done 100 of 147 steps
    Installing VRTSvcsdc 4.0 on cluster2 ................................................................ Done 101 of 147 steps
    Copying VRTSjre.tar.gz to cluster2 .................................................................. Done 102 of 147 steps
    Installing VRTSjre 1.4 on cluster2 .................................................................. Done 103 of 147 steps
    Copying VRTScutil.tar.gz to cluster2 ................................................................ Done 104 of 147 steps
    Installing VRTScutil 4.0 on cluster2 ................................................................ Done 105 of 147 steps
    Copying VRTScssim.tar.gz to cluster2 ................................................................ Done 106 of 147 steps
    Installing VRTScssim 4.0 on cluster2 ................................................................ Done 107 of 147 steps
    Copying VRTScscw.tar.gz to cluster2 ................................................................. Done 108 of 147 steps
    Installing VRTScscw 4.0 on cluster2 ................................................................. Done 109 of 147 steps
    Copying VRTSweb.tar.gz to cluster2 .................................................................. Done 110 of 147 steps
    Installing VRTSweb 4.0 on cluster2 .................................................................. Done 111 of 147 steps
    Copying VRTSvcsw.tar.gz to cluster2 ................................................................. Done 112 of 147 steps
    Installing VRTSvcsw 4.0 on cluster2 ................................................................. Done 113 of 147 steps
    Copying VRTScscm.tar.gz to cluster2 ................................................................. Done 114 of 147 steps
    Installing VRTScscm 4.0 on cluster2 ................................................................. Done 115 of 147 steps
    Copying VRTScavf.tar.gz to cluster2 ................................................................. Done 116 of 147 steps
    Installing VRTScavf 4.0 on cluster2 ................................................................. Done 117 of 147 steps
    Copying VRTSglm.tar.gz to cluster2 .................................................................. Done 118 of 147 steps
    Installing VRTSglm 4.0 on cluster2 .................................................................. Done 119 of 147 steps
    Copying VRTSgms.tar.gz to cluster2 .................................................................. Done 120 of 147 steps
    Installing VRTSgms 4.0 on cluster2 .................................................................. Done 121 of 147 steps
    Copying VRTSodm.tar.gz to cluster2 .................................................................. Done 122 of 147 steps
    Installing VRTSodm 4.0 on cluster2 .................................................................. Done 123 of 147 steps
    Copying VRTSvail.tar.gz to cluster2 ................................................................. Done 124 of 147 steps
    Installing VRTSvail 4.0.0 on cluster2 ............................................................... Done 125 of 147 steps
    Copying VRTSdbac.tar.gz to cluster2 ................................................................. Done 126 of 147 steps
    Installing VRTSdbac 4.0 on cluster2 ................................................................. Done 127 of 147 steps
    Copying VRTSracdc.tar.gz to cluster2 ................................................................ Done 128 of 147 steps
    Installing VRTSracdc 4.0 on cluster2 ................................................................ Done 129 of 147 steps
    Copying VRTSvcsor.tar.gz to cluster2 ................................................................ Done 130 of 147 steps
    Installing VRTSvcsor 4.0 on cluster2 ................................................................ Done 131 of 147 steps
    Copying VRTScsocw.tar.gz to cluster2 ................................................................ Done 132 of 147 steps
    Installing VRTScsocw 4.0 on cluster2 ................................................................ Done 133 of 147 steps
    Copying VRTSvcsvr.tar.gz to cluster2 ................................................................ Done 134 of 147 steps
    Installing VRTSvcsvr 4.0 on cluster2 ................................................................ Done 135 of 147 steps
    Copying VRTSdbckp.tar.gz to cluster2 ................................................................ Done 136 of 147 steps
    Installing VRTSdbckp 4.0 on cluster2 ................................................................ Done 137 of 147 steps
    Copying VRTSvxmsa.tar.gz to cluster2 ................................................................ Done 138 of 147 steps
    Installing VRTSvxmsa 4.0 on cluster2 ................................................................ Done 139 of 147 steps
    Copying patch 115209-05 to cluster2 ................................................................. Done 140 of 147 steps
    Adding patch 115209-05 on cluster2 .................................................................. Done 141 of 147 steps
    Copying patch 115212-05 to cluster2 ................................................................. Done 142 of 147 steps
    Adding patch 115212-05 on cluster2 .................................................................. Done 143 of 147 steps
    Copying patch 115210-05 to cluster2 ................................................................. Done 144 of 147 steps
    Adding patch 115210-05 on cluster2 .................................................................. Done 145 of 147 steps
    Copying patch 115217-01 to cluster2 ................................................................. Done 146 of 147 steps
    Adding patch 115217-01 on cluster2 .................................................................. Done 147 of 147 steps
 
Storage Foundation for Oracle RAC installation completed successfully.

Press [Return] to continue:    

The enclosure-based naming scheme is a feature of Volume Manager. It allows one to reference disks using a symbolic name that is
more meaningful than the operating system's normal device access name.  This symbolic name is typically derived from the array
name.

Evaluating which systems can be configured for the enclosure-based naming scheme...

System cluster1 is eligible -- can configure.
System cluster2 is eligible -- can configure.

Do you want to set up the enclosure-based naming scheme? [y,n,q,?] (n)

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Configuring Storage Foundation for Oracle RAC:

    Creating Cluster Server configuration files .......................................................................... Done
    Copying configuration files to cluster1 .............................................................................. Done
    Copying configuration files to cluster2 .............................................................................. Done

Storage Foundation for Oracle RAC configured successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Do you want to start Storage Foundation for Oracle RAC processes now? [y,n,q] (y)

Starting SFRAC:

    Starting LLT on cluster1 .......................................................................................... Started
    Starting LLT on cluster2 .......................................................................................... Started
    Starting GAB on cluster1 .......................................................................................... Started
    Starting GAB on cluster2 .......................................................................................... Started
    Starting Cluster Server on cluster1 ............................................................................... Started
    Checking SFRAC drivers on cluster1 ................................................................................ Checked
    Starting SFRAC drivers on cluster1 ................................................................................ Started
    Starting Cluster Server on cluster2 ............................................................................... Started
    Checking SFRAC drivers on cluster2 ................................................................................ Checked
    Starting SFRAC drivers on cluster2 ................................................................................ Started
    Confirming SFRAC startup ................................................................................ 2 systems RUNNING

Evaluating which systems can now be started...

System cluster1 is eligible -- can be started.
System cluster2 is eligible -- can be started.

Preparing to start VxVM on target systems...

Begin starting VxVM on system cluster1
    Disabling enclosure-based naming ..................................................................................... Done
    Starting vxconfigd for VxVM ..................................................................................... Succeeded
Done starting VxVM on system cluster1

Begin starting VxVM on system cluster2
    Disabling enclosure-based naming ..................................................................................... Done
    Starting vxconfigd for VxVM ..................................................................................... Succeeded
Done starting VxVM on system cluster2

Done with starting VxVM on target systems...

Press [Return] to continue:

Configuring CFS agents for SFRAC:

    Confirming VxVM configuration daemons startup ......................................................... All systems Enabled
    Starting CFS agents ............................................................................................... Started

Full activation of Cluster Manager, Cluster Volume Manager,
and Cluster File System requires a reboot on All Systems.

Execute /usr/sbin/shutdown -y -i6 -g0 to properly restart your systems
Many Volume Manager commands affect the contents or configuration of a disk group. Such commands require that the user specify a
disk group.  This is accomplished by using the -g option of a command or setting the VXVM_DEFAULTDG environment variable.  An
alternative to these two methods is to configure the default disk group of a system.

Evaluating which systems can now have their default disk group configured...

System cluster1 is eligible -- can set the default disk group.
System cluster2 is eligible -- can set the default disk group.

Do you want to set up the default disk group for each system? [y,n,q,?] (y)

Will you specify one disk group name for all eligible systems? [y,n,q,?] (y)

Specify a default disk group for all systems or type 'l' to display a listing of existing disk group(s). [?] l

No previous disk group(s) were detected.

Specify a default disk group for all systems or type 'l' to display a listing of existing disk group(s). [?] 9iRac

You have decided to specify the default disk groups as follows:

    Host: cluster1 .......................................................................................... Disk group: 9iRac
    Host: cluster2 .......................................................................................... Disk group: 9iRac

Note: If 'nodg' is displayed, then the host will be configured to have no default disk group.

Is this correct? [y,n,q] (y)

    Setting default diskgroup to 9iRac on cluster1 ....................................................................... Done
    Setting default diskgroup to 9iRac on cluster2 ....................................................................... Done

Preparing to start daemons on target systems...
    Starting vxcached on cluster1 ..................................................................................... Success
    Starting vxcached on cluster2 ..................................................................................... Success

Storage Foundation for Oracle RAC was started successfully.

Press [Return] to continue:

                                 VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM                                 

Installation of Storage Foundation for Oracle RAC 4.0 has completed successfully.

The installation summary is saved at:

        /opt/VRTS/install/logs/installer902153656.summary

The installer log is saved at:

        /opt/VRTS/install/logs/installer902153656.log

The installation response file is saved at:

        /opt/VRTS/install/logs/installer902153656.response

#

至此安装完成

下面是安装管理GUI的过程

# ./installer

                                                 VERITAS Cluster File Solutions 4.0                                                 

Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.

VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.

                                                 VERITAS Cluster File Solutions 4.0                                                 

VERITAS Product                             Version Installed   Licensed
===========================================================================
Storage Foundation for Cluster File System        4.0             yes
Storage Foundation for Oracle RAC                 4.0             yes
Enterprise Administrator GUI                      3.2.514.0

Selection Menu:

    I) Install/Upgrade a Product    C) Configure an Installed Product
    L) License a Product            P) Perform a Preinstallation Check
    U) Uninstall a Product          D) View a Product Description
    Q) Quit                         ?) Help

Enter a Selection: [I,C,L,P,U,D,Q,?] I

                                                 VERITAS Cluster File Solutions 4.0                                                 

     1)  VERITAS Storage Foundation for Cluster File System
     2)  VERITAS Storage Foundation for Oracle RAC
     3)  VERITAS Enterprise Administrator GUI
     B)    Back to previous menu

Select a product to install: [1-3,b,q] 3

                                   VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM                                   

Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.

VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.

Enter the system names separated by spaces on which to install VEA GUI: cluster1 cluster2

Checking system communication:

    Checking OS version on cluster1 ................................................................................. SunOS 5.9
    Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
    Verifying communication with cluster2 ..................................................................... ping successful
    Attempting rsh with cluster2 ............................................................................... rsh successful
    Attempting rcp with cluster2 ............................................................................... rcp successful
    Checking OS version on cluster2 ................................................................................. SunOS 5.9
    Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
    Creating log directory on cluster2 ................................................................................... Done

Logs for installer are being created in /var/tmp/installer902160337.

Using /usr/bin/rsh and /usr/bin/rcp to communicate with remote systems.

Initial system check completed successfully.

Press [Return] to continue:

                                   VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM                                   

Checking system installation requirements:

Checking VEA GUI installation requirements on cluster1:

    Checking VRTScpi package .......................................................................... version 4.0.5 installed
    Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
    Checking VERITAS patch 115210 ......................................................................... 115210-05 installed
    Checking for any Solaris patch issues ................................................................................ None

Checking VEA GUI installation requirements on cluster2:

    Checking VRTScpi package .......................................................................... version 4.0.5 installed
    Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
    Checking VERITAS patch 115210 ......................................................................... 115210-05 installed
    Checking for any Solaris patch issues ................................................................................ None

Installation requirement checks completed successfully.

Press [Return] to continue:

                                   VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM                                   

                                   VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM                                   

VEA GUI packages can be installed on systems consecutively or simultaneously. Installing packages on systems consecutively takes
more time but allows for better error handling.

Would you like to install Enterprise Administrator GUI packages on all systems simultaneously? [y,n,q,?] (y)

Installing Enterprise Administrator GUI 4.0 on all systems simultaneously:

 
All VEA GUI packages are already installed.
The installer log is saved at:

        /opt/VRTS/install/logs/installer902160337.log

#

# reboot
Sep  2 16:46:07 cluster1 reboot: rebooted by root
Sep  2 16:46:07 cluster1 gab: GAB INFO V-15-1-20032 Port h closed
Sep  2 16:46:07 /usr/lib/snmp/snmpdx: received signal 15
Sep  2 16:46:07 rpcbind: rpcbind terminating on signal.
Sep  2 16:46:07 EV_AGENT[285]: Signal TERM received
Sep  2 16:46:07 cluster1 syslogd: going down on signal 15
syncing file systems... done
rebooting...

SC Alert: Host System has Reset

Sun Fire V210, No Keyboard
Copyright 1998-2002 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.8.2, 4096 MB memory installed, Serial #54274573.
Ethernet address 0:3:ba:3c:2a:d, Host ID: 833c2a0d.

Rebooting with command: boot                                          
Boot device: disk  File and args:
SunOS Release 5.9 Version Generic_117171-07 64-bit
Copyright 1983-2003 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
NOTICE:
Emulex LightPulse FC SCSI/IP 6.01c
NOTICE: lpfc0: Firmware Rev 3.90A7 (C2D3.90A7)
NOTICE: lpfc0: WWPN:10:00:00:00:c9:3d:cf:d3 WWNN:20:00:00:00:c9:3d:cf:d3 DID 0x10a00
WARNING: /pci@1d,700000/fibre-channel@1/sd@0,0 (sd30):
        Corrupt label; wrong magic number

Hardware watchdog enabled
Error: All paths to 6006016028A61000C2BDC4C591D4D811 are dead.
Error: 6006016028A61000C2BDC4C591D4D811 is dead.
Error: All paths to 6006016028A610009A75213E91D4D811 are dead.
Error: 6006016028A610009A75213E91D4D811 is dead.
Error: All paths to 6006016028A61000F42A89D591D4D811 are dead.
Error: 6006016028A61000F42A89D591D4D811 is dead.
Error: All paths to 6006016028A61000F075BD4E93D4D811 are dead.
Error: 6006016028A61000F075BD4E93D4D811 is dead.
Error: All paths to 60060160D2A91000AE22B826A6DED811 are dead.
Error: 60060160D2A91000AE22B826A6DED811 is dead.
Error: All paths to 6006016028A610005035CED392D4D811 are dead.
Error: 6006016028A610005035CED392D4D811 is dead.
Error: All paths to 6006016028A61000C65024C992D4D811 are dead.
Error: 6006016028A61000C65024C992D4D811 is dead.
VxVM sysboot INFO V-5-2-3244 Starting restore daemon...
VxVM sysboot INFO V-5-2-3445 starting in boot mode...
NOTICE: VxVM vxdmp V-5-0-34 added disk array DISKS, datype = Disk

configuring IPv4 interfaces: bge0ifconfig: setifflags: SIOCSLIFFLAGS: lpfc0: Cannot assign requested address
 lpfc0.
Setting netmask of lpfc0 to 255.255.255.0
ifconfig: setifflags: SIOCSLIFFLAGS: lpfc0: Cannot assign requested address
Hostname: cluster1
Configuring /dev and /devices
LLT INFO V-14-1-10009 LLT Protocol available
GAB INFO V-15-1-20021 GAB available
LMX Multiplexor available
Configuring the /dev directory (compatibility devices)
Setting up paths
VxVM vxvm-startup2 INFO V-5-2-503 VxVM general startup...
The system is coming up.  Please wait.
checking ufs filesystems
/dev/rdsk/c0t0d0s5: is logging.
/dev/rdsk/c0t0d0s7: is logging.
Starting LLT...
Starting LLT done.
Starting LMX
starting rpc services: rpcbind done.
Setting netmask of bge0 to 255.255.255.0
Setting default IPv4 interface for multicast: add net 224.0/4: gateway cluster1
syslog service starting.
Starting Navisphere Agent
Starting GAB...
Sep  2 16:48:45 cluster1 gab: GAB INFO V-15-1-20026 Port a registration waiting for seed port membership
Starting GAB done.
Starting ODM...
Sep  2 16:48:46 cluster1 llt: LLT INFO V-14-1-10024 link 1 (bge2) node 1 active
Sep  2 16:48:46 cluster1 llt: LLT INFO V-14-1-10024 link 0 (bge1) node 1 active
Sep  2 16:48:46 cluster1 gab: GAB INFO V-15-1-20026 Port d registration waiting for seed port membership
Starting vxfen..
Starting vxfen.. Done
Starting VCSMM
Sep  2 16:48:48 cluster1 gab: GAB INFO V-15-1-20026 Port o registration waiting for seed port membership
VCS FEN vxfenconfig NOTICE Driver will be disabled.
Sep  2 16:48:48 cluster1 gab: GAB INFO V-15-1-20026 Port b registration waiting for seed port membership
Sep  2 16:48:50 cluster1 gab: GAB INFO V-15-1-20036 Port d gen   2a9201 membership 01
Sep  2 16:48:50 cluster1 gab: GAB INFO V-15-1-20036 Port a gen   2a9202 membership 01
volume management starting.
The system is ready.

cluster1 console login: Sep  2 16:48:55 cluster1 gab: GAB INFO V-15-1-20036 Port o gen   2a9204 membership 01
Sep  2 16:48:55 cluster1 gab: GAB INFO V-15-1-20036 Port b gen   2a9205 membership 01
Sep  2 16:48:55 cluster1 vcsmm: VCS RAC INFO V-10-1-15047 plat_reconfig_ioctl: dev_ioctl failed, vxfen may not be configured
Sep  2 16:48:55 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-35 Fencing driver going into RUNNING state
VCS NOTICE V-16-1-10619 'HAD' starting on: cluster1
VCS NOTICE V-16-1-10620 Waiting for local cluster configuration status
VCS NOTICE V-16-1-10625 Local cluster configuration valid
VCS NOTICE V-16-1-11034 Registering for cluster membership
VCS NOTICE V-16-1-11035 Waiting for cluster membership
Sep  2 16:49:03 cluster1 gab: GAB INFO V-15-1-20036 Port h gen   2a9205 membership 01
VCS INFO V-16-1-10077 Received new cluster membership
VCS NOTICE V-16-1-10082 System (cluster1) is in Regular Membership - Membership: 0x3
VCS NOTICE V-16-1-10082 System () is in Regular Membership - Membership: 0x3
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS NOTICE V-16-1-10075 Building from remote system
VCS NOTICE V-16-1-10066 Entering RUNNING state
Sep  2 16:49:07 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-34 The ioctl VXFEN_IOC_CLUSTSTAT returned 0
Sep  2 16:49:11 cluster1 gab: GAB INFO V-15-1-20036 Port u gen   2a9207 membership 01
Sep  2 16:49:11 cluster1 gab: GAB INFO V-15-1-20032 Port u closed
Sep  2 16:49:11 cluster1 vxio: WARNING: VxVM vxio V-5-0-360 volcvm_vxnodeid_daemon:cluster join failed: error 11
Sep  2 16:49:17 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-34 The ioctl VXFEN_IOC_CLUSTSTAT returned 0
Sep  2 16:49:25 cluster1 gab: GAB INFO V-15-1-20036 Port u gen   2a9209 membership 0
Sep  2 16:49:25 cluster1 gab: GAB INFO V-15-1-20038 Port u gen   2a9209 k_jeopardy ;1
Sep  2 16:49:25 cluster1 gab: GAB INFO V-15-1-20040 Port u gen   2a9209    visible ;1
Sep  2 16:49:30 cluster1 gab: GAB INFO V-15-1-20036 Port v gen   2a920a membership 01
Sep  2 16:49:35 cluster1 gab: GAB INFO V-15-1-20036 Port w gen   2a920c membership 01
Sep  2 16:49:36 cluster1 gab: GAB INFO V-15-1-20032 Port u closed
Sep  2 16:49:44 cluster1 gab: GAB INFO V-15-1-20036 Port q gen   2a920e membership 01
Sep  2 16:49:46 cluster1 gab: GAB INFO V-15-1-20036 Port f gen   2a9210 membership 01

cluster1 console login:

#./installer –rsh –installonly
#./installsfrac –rsh –configure
Configure I/O Fencing
Test disk
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw –n
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw –c vxfencoorddg
Creating the vxfencoorddg Disk Group
# vxdg –coordinator=on init vxfencoorddg c1t1d0
# vxdg -g vxfencoorddg adddisk c2t1d0
# vxdg -g vxfencoorddg adddisk c3t1d0
Test DiskGroup
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw -c vxfencoorddg
# vxdg deport vxfencoorddg
# vxdg -t import vxfencoorddg
# vxdg deport vxfencoorddg
# echo "vxfencoorddg" > /etc/vxfendg
# haconf -dump –makero
# hastop –all
# cd /etc/VRTSvcs/conf/config
# cp main.cf main.orig
#vi main.cf
cluster rac_cluster1 (
UserNames = { admin = "cDRpdxPmHpzS." }
 Administrators = { admin }
HacliUserLevel = COMMANDROOT
CounterInterval = 5
UseFence = SCSI3
)
# cp /etc/vxfen.d/vxfenmode_scsi3_dmp /etc/vxfenmode
# vxfenadm -d
# /sbin/gabconfig -a
GAB Port Memberships               ========================================================
Port a gen 4a1c0001 membership 01
Port b gen g8ty0002 membership 01
Port d gen 40100001 membership 01
Port f gen f1990002 membership 01
Port h gen d8850002 membership 01
Port o gen f1100002 membership 01
Port q gen 28d10002 membership 01
Port v gen 1fc60002 membership 01
Port w gen 15ba0002 membership 01

6.配置共享磁盘

 

1).创建磁盘组


# vxdiskadm

Volume Manager Support Operations
Menu: VolumeManager/Disk

 1      Add or initialize one or more disks
 2      Encapsulate one or more disks
 3      Remove a disk
 4      Remove a disk for replacement
 5      Replace a failed or removed disk
 6      Mirror volumes on a disk
 7      Move volumes from a disk
 8      Enable access to (import) a disk group
 9      Remove access to (deport) a disk group
 10     Enable (online) a disk device
 11     Disable (offline) a disk device
 12     Mark a disk as a spare for a disk group
 13     Turn off the spare flag on a disk
 14     Unrelocate subdisks back to a disk
 15     Exclude a disk from hot-relocation use
 16     Make a disk available for hot-relocation use
 17     Prevent multipathing/Suppress devices from VxVM's view
 18     Allow multipathing/Unsuppress devices from VxVM's view
 19     List currently suppressed/non-multipathed devices
 20     Change the disk naming scheme
 21     Get the newly connected/zoned disks in VxVM view
 22     Change/Display the default disk layouts
 23     Mark a disk as allocator-reserved for a disk group
 24     Turn off the allocator-reserved flag on a disk
 list   List disk information

 ?      Display help about menu
 ??     Display help about the menuing system
 q      Exit from menus

Select an operation to perform: 1



Add or initialize disks
Menu: VolumeManager/Disk/AddDisks
  Use this operation to add one or more disks to a disk group.  You can
  add the selected disks to an existing disk group or to a new disk group
  that will be created as a part of the operation. The selected disks may
  also be added to a disk group as spares. Or they may be added as
  nohotuses to be excluded from hot-relocation use. The selected
  disks may also be initialized without adding them to a disk group
  leaving the disks available for use as replacement disks.

  More than one disk or pattern may be entered at the prompt.  Here are
  some disk selection examples:

  all:          all disks
  c3 c4t2:      all disks on both controller 3 and controller 4, target 2
  c3t4d2:       a single disk (in the c#t#d# naming scheme)
  xyz_0 :       a single disk (in the enclosure based naming scheme)
  xyz_ :        all disks on the enclosure whose name is xyz

Select disk devices to add: [,all,list,q,?] list

DEVICE       DISK         GROUP        STATUS
c0t0d0       -            -            online invalid
c0t1d0       -            -            online invalid
c2t0d2       -            -            online

Select disk devices to add: [,all,list,q,?] c2t0d2
  Here is the disk selected.  Output format: [Device_Name]

  c2t0d2

Continue operation? [y,n,q,?] (default: y)
  You can choose to add this disk to an existing disk group, a
  new disk group, or leave the disk available for use by future
  add or replacement operations.  To create a new disk group,
  select a disk group name that does not yet exist.  To leave
  the disk available for future use, specify a disk group name
  of "none".

Which disk group [,none,list,q,?] (default: 9iRac) oradg
  There is no active disk group named oradg.

Create a new group named oradg? [y,n,q,?] (default: y)

Create the disk group as a CDS disk group? [y,n,q,?] (default: y)

Use a default disk name for the disk? [y,n,q,?] (default: y)

Add disk as a spare disk for oradg? [y,n,q,?] (default: n)

Exclude disk from hot-relocation use? [y,n,q,?] (default: n)
  A new disk group will be created named oradg and the selected disks
  will be added to the disk group with default disk names.

  c2t0d2

Continue with operation? [y,n,q,?] (default: y)
  The following disk device appears to have been initialized already.
  The disk is currently available as a replacement disk.
  Output format: [Device_Name]

  c2t0d2

Use this device? [y,n,q,?] (default: y)
  The following disk you selected for use appears to already have
  been initialized for the Volume Manager.  If you are certain the
  disk has already been initialized for the Volume Manager, then you
  do not need to reinitialize the disk device.
  Output format: [Device_Name]

  c2t0d2

Reinitialize this device? [y,n,q,?] (default: y)
  Initializing device c2t0d2.

Enter desired private region length
[,q,?] (default: 2048)
  VxVM  NOTICE V-5-2-120
Creating a new disk group named oradg containing the disk
  device c2t0d2 with the name oradg01.

Add or initialize other disks? [y,n,q,?] (default: n)

Volume Manager Support Operations
Menu: VolumeManager/Disk

 1      Add or initialize one or more disks
 2      Encapsulate one or more disks
 3      Remove a disk
 4      Remove a disk for replacement
 5      Replace a failed or removed disk
 6      Mirror volumes on a disk
 7      Move volumes from a disk
 8      Enable access to (import) a disk group
 9      Remove access to (deport) a disk group
 10     Enable (online) a disk device
 11     Disable (offline) a disk device
 12     Mark a disk as a spare for a disk group
 13     Turn off the spare flag on a disk
 14     Unrelocate subdisks back to a disk
 15     Exclude a disk from hot-relocation use
 16     Make a disk available for hot-relocation use
 17     Prevent multipathing/Suppress devices from VxVM's view
 18     Allow multipathing/Unsuppress devices from VxVM's view
 19     List currently suppressed/non-multipathed devices
 20     Change the disk naming scheme
 21     Get the newly connected/zoned disks in VxVM view
 22     Change/Display the default disk layouts
 23     Mark a disk as allocator-reserved for a disk group
 24     Turn off the allocator-reserved flag on a disk
 list   List disk information

 ?      Display help about menu
 ??     Display help about the menuing system
 q      Exit from menus

Select an operation to perform: q

Goodbye.
 

2).设置共享磁盘组
 
# vxdg list
NAME STATE ID
oradg enabled,cds 1094209675.12.cluster2
# vxdg free
GROUP DISK DEVICE TAG OFFSET LENGTH FLAGS
oradg oradg01 c2t0d2s2 c2t0d2 0 244143872 -
 
3).通过以下方式验证主节点:
 
# vxclustadm -v nodestate
state: cluster member
        nodeId=1
        masterId=1 --这就是主节点id
        neighborId=0
        members=0x3
        joiners=0x0
        leavers=0x0
        reconfig_seqnum=0x2a9209
        vxfen=off
# fsclustadm idtoname 1
cluster1

或者使用:
# vxdctl -c mode
mode: enabled: cluster active - SLAVE
master: cluster1


如果你的输出出现以下提示:
# ./vxclustadm -v nodestate
state: out of cluster
这说明你没有正确配置IO Fencing.我们可以通过如下方式禁用IO Fencing.
创建/etc/vxfenmode 文件
增加一行:
vxfen_mode=disabled
重起Cluster既可.
4).在master节点上进行以下操作
# vxdg deport oradg
# vxdg -s import oradg
# vxdg list
NAME         STATE           ID
oradg        enabled,shared,cds   1094209675.12.cluster2
#
 
5).此时在另外节点上
应该可以看到此共享磁盘组
# vxdg list
NAME         STATE           ID
oradg        enabled,shared,cds   1094209675.12.cluster2
# hostname
cluster1
#
7.修改系统内核参数
为安装Oracle做准备
在/etc/system文件末尾追加以下参数,两台主机都需要修改:
 * kernal parameter for Oracle database  add by:gqgai
set shmsys:shminfo_shmmax=4294967295
set shmsys:shminfo_shmmin=1
set shmsys:shminfo_shmmni=100
set shmsys:shminfo_shmseg=10
set semsys:seminfo_semmni=1024
set semsys:seminfo_semmsl=1510
set semsys:seminfo_semmns=3010
set semsys:seminfo_semopm=100
set semsys:seminfo_semvmx=32767    
 修改后重新启动主机
8.划分磁盘空间,安装前的准备
Directory             Component
/app                  Mountpoint for Oracle/CRS binaries
/app/crshome           CRS_HOME
/app/oracle           ORACLE_BASE
/app/oracle/home      ORACLE_HOME
/ocrvote              Mountpoint for OCR/Vote
/oradata              Mountpoint for Oracle database
#chown –R oracle:dba /app
#chown –R oracle:dba /app/crshome
#chown –R oracle:dba /app/oracle
#chown –R oracle:dba /app/oracle/home
#chown –R oracle:dba /app/ocrvote
#chown –R oracle:dba /oradata
Creating OCR and VOTE-disk volumes
#vxdg –s init ocrvotedg ocrvotedg01=Disk_1
#vxassist –g ocrvotedg make ocrvotevol 1g
#mkfs –F vxfs /dev/vx/rdsk/ocrvotedg/ocrvotevol
#mount –F vxfs –o cluster /dev/vx/dsk/ocrvotedg/ocrvotevol /ocrvote
#rsh b100b mount –F vxfs –o cluster /dev/vx/dsk/ocrvotedg/ocrvotevol /ocrvote
#cd /ocrvote
#touch ocr vote
#chown –R oracle:dba ocr vote
ADD OCR to VCS
#hares –add ocrvote_mnt CFSMount cvm
#hares –modify ocrvote_mnt Critical 0
#hares –modify ocrvote_mnt MountPoint “/ocrvote”
#hares –modify ocrvote_mnt BlockDevice  “/dev/vx/dsk/ocrvotedg/ocrvotevol”   
#hares –add ocrvote_voldg CVMVolDg cvm
#hares –modify ocrvote_voldg CVMDiskGroup ocrvotedg
#hares –modify ocrvote_voldg CVMVolume –add ocrvotevol
#hares –modify ocrvote_voldg CVMActivation sw
#hares -add cssd  Application  cvm
#hares -modify cssd StartProgram  /opt/VRTSvcs/rac/bin/cssd-online
#hares -modify cssd StopProgram  /opt/VRTSvcs/rac/bin/cssd-offline
#hares -modify cssd CleanProgram /opt/VRTSvcs/rac/bin/cssd-clean 
#hares -modify cssd MonitorProgram /opt/VRTSvcs/rac/bin/cssd-monitor  
#hares –link ocrvote_mnt ocrvote_voldg
#hares –link ocrvote_mnt vxfsckd
#hares –link ocrvote_voldg cvm_clus
#hares –link cssd cssd ora_priv
#hares –link cssd cssd ocrvote_mnt
#hares –modify ocrvote_voldg Enabled 1
#hares –modify ocrvote_mnt Enabled 1
#haconf –dump –makero
 
            
Installing CRS
#cd /opt/VRTS/install/
#./installsfrac –rsh –configure  
    Veritas Storage Foundation for Oracle RAC 5.0 Configuration Program     
Main Menu
     1)  Check systems for SFRAC ** INSTRUCTIONS ONLY **
     2)  Configure SFRAC
     3)  Prepare to install Oracle
     4)  Install or relink Oracle
Select an option [1-4,q,?] 3   
#./$CRS_HOME/bin/vipca                
 Installing Oracle
 Veritas Storage Foundation for Oracle RAC 5.0 Configuration Program     
Main Menu
     1)  Check systems for SFRAC ** INSTRUCTIONS ONLY **
     2)  Configure SFRAC
     3)  Prepare to install Oracle
     4)  Install or relink Oracle
Select an option [1-4,q,?] 4                  

 ADD Oracle Aagent to VCS
group OracleRAC (
        SystemList = { b1000a = 0, b1000b = 1 }
        Parallel = 1
        )
        CFSMount oradata_mnt (
                Critical = 0
                MountPoint = "/oradata"
                BlockDevice = "/dev/vx/dsk/oradg/oradgvol"
                )
        CVMVolDg oradata_voldg (
                Critical = 0
                CVMDiskGroup = oradg
                CVMActivation = sw
                )
        Netlsnr ora_lsnr (
                Critical = 0
                Owner = oracle
                Home = "/app/oracle/home"
                TnsAdmin = "/app/oracle/home/network/admin/tnsnames.ora"
                Listener = LISTENER
                )
        Oracle oracle (
                Critical = 0
                Sid @b1000a = ora1
                Sid @b1000b = ora2
                Owner = oracle
                Home = "/app/oracle/home"
                Pfile @b1000a = "/app/oracle/home/dbs/initora1.ora"
                Pfile @b1000b = "/app/oracle/home/dbs/initora2.ora"
                )
        ora_lsnr requires oracle
        oracle requires oradata_mnt
        oradata_mnt requires oradata_voldg
 
$srvconfig –init
$gsdctl start (2 nodes)

$netca
13.开始创建数据库
$ dbca -datafileDestination /rac_ts
创建Oracle9i Rac数据库
14,Configure Listener.ora Spfile
Create or check the file sqlnet.ora in $ORACLE_HOME/network/admin
 NAMES.DEFAULT_DOMAIN = testlab.ibm.com
 NAMES.DIRECTORY_PATH= (TNSNAMES)


Create or check the file listener.ora in $ORACLE_HOME/network/admin


create or check the file tnsnames.ora
      
         


$ lsnrctl start
$ lsnrctl stop
$ lsnrctl
创建Oracle9i Rac数据库
1. 设置Oracle用户环境变量
修改.profile文件,增加如下环境变量:
 
DBCA_RAW_CONFIG=/opt/oracle/admin/Rac9i/create/DBCA_RAW_CONFIG.txt
export DBCA_RAW_CONFIG
 
2.设置rsh支持
编辑.rhost文件
 
$ id
uid=800(oracle) gid=800(dba)
$ more $HOME/.rhosts
+
$ hostname
cluster1
$ rsh cluster2 date
Sun Sep  5 15:46:27 CST 2004FIG

                   
.
Oracle 10G
 1建立心跳线
Vi /etc/VRTSvcs/conf/config/main.cf
include "PrivNIC.cf"
vxassist -g oradg -U gen make OCRFile 256m
vxassist -g oradg -U gen make OCRFile2 256m
vxassist -g oradg -U gen make CSSFile 256m
vxassist -g oradg -U gen make CSSFile2 256m
vxassist -g oradg -U gen make CSSFile3 256m


转自:http://blog.chinaunix.net/u1/42994/showart_1218241.html

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值