群集情况调研:
两台服务器 国库的ip
连接的ip: 10.104.112.245/28 网关 10.104.112.254
连接的ip: 10.104.112.246/28 网关 10.104.112.254
用户名 : root
密码: xtxczj
群集情况
[root@xtxgk1 ~]# clpstat
======================== CLUSTER STATUS ===========================
Cluster : RedFlag HA Cluster
<server>
*xtxgk1 ..........: Online
lanhb1 : Normal LAN Heartbeat
lanhb2 : Normal LAN Heartbeat
xtxgk2 ..........: Online
lanhb1 : Normal LAN Heartbeat
lanhb2 : Normal LAN Heartbeat
<group>
oracle ..........: Online
current : xtxgk1
oracle_disk : Online
oracle_exec : Online
oracle_fip : Online
oracle_mon : Online
<monitor>
diskw : Normal
miiw : Normal
pidw : Normal
userw : Normal user mode monitor
=====================================================================
磁盘挂载情况
[root@xtxgk1 ~]# df -h
Filesystem 容量 已用 可用 已用% 挂载点
/dev/sda3 9.7G 1.8G 7.5G 19% /
/dev/sda1 2.0G 111M 1.8G 6% /boot
none 2.0G 0 2.0G 0% /dev/shm
/dev/sda5 9.7G 55M 9.1G 1% /home
/dev/sda8 9.7G 109M 9.1G 2% /opt
/dev/sda6 4.9G 42M 4.6G 1% /tmp
/dev/sda7 4.9G 3.8G 797M 83% /usr
/dev/sda9 4.9G 230M 4.4G 5% /var
/dev/sdb1 270G 6.6G 249G 3% /oracle
Oracle Listener参数
Listener状态
[oracle@xtxgk2 ~]$ lsnrctl
LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 25-7月 -2008 13:11:35
Copyright (c) 1991, 2005, Oracle. All rights reserved.
欢迎来到LSNRCTL, 请键入"help"以获得信息。
LSNRCTL> status
正在连接到 (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC)))
LISTENER 的 STATUS
------------------------
别名 LISTENER
版本 TNSLSNR for Linux: Version 10.2.0.1.0 - Production
启动日期 25-7月 -2008 13:11:12
正常运行时间 0 天 0 小时 0 分 24 秒
跟踪级别 off
安全性 ON: Local OS Authentication
SNMP OFF
监听程序参数文件 /oracle/product/10.2.0/db_1/network/admin/listener.ora
监听程序日志文件 /oracle/product/10.2.0/db_1/network/log/listener.log
监听端点概要...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.104.112.247)(PORT=1521)))
服务摘要..
服务 "PLSExtProc" 包含 1 个例程。
例程 "PLSExtProc", 状态 UNKNOWN, 包含此服务的 1 个处理程序...
服务 "xtxgk" 包含 1 个例程。
例程 "xtxgk", 状态 UNKNOWN, 包含此服务的 1 个处理程序...
命令执行成功
LSNRCTL> quit
[oracle@xtxgk2 ~]$ tnsping xtxgk
TNS Ping Utility for Linux: Version 10.2.0.1.0 - Production on 25-7月 -2008 13:11:47
Copyright (c) 1997, 2005, Oracle. All rights reserved.
已使用的参数文件:
/oracle/product/10.2.0/db_1/network/admin/sqlnet.ora
已使用 TNSNAMES 适配器来解析别名
Attempting to contact (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 10.104.112.247)(PORT = 1521))) (CONNECT_DATA = (SERVICE_NAME = xtxgk) (GLOBAL_NAME = xtxgk)))
OK (0 毫秒)
oracle 环境变量
[root@xtxgk2 ~]# su - oracle
-bash-3.00$
-bash-3.00$
-bash-3.00$ env
HOSTNAME=xtxgk2.localdomain
SHELL=/bin/bash
TERM=vt100
HISTSIZE=1000
QTDIR=/usr/lib/qt-3.3
USER=oracle
LS_COLORS=no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=01;32:*.cmd=01;32:*.exe=01;32:*.com=01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tz=01;31:*.rpm=01;31:*.cpio=01;31:*.jpg=01;35:*.gif=01;35:*.bmp=01;35:*.xbm=01;35:*.xpm=01;35:*.png=01;35:*.tif=01;35:
MAIL=/var/spool/mail/oracle
PATH=/usr/lib/jdk/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin
INPUTRC=/etc/inputrc
PWD=/oracle
JAVA_HOME=/usr/lib/jdk
LANG=zh_CN.GB18030
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
SHLVL=1
HOME=/oracle
LANGUAGE=zh_CN.GB18030:zh_CN.GB2312:zh_CN
LOGNAME=oracle
LESSOPEN=|/usr/bin/lesspipe.sh %s
G_BROKEN_FILENAMES=1
_=/bin/env
[oracle@xtxgk1 ~]$ env
HOSTNAME=xtxgk1.localdomain
SHELL=/bin/bash
TERM=vt100
HISTSIZE=1000
NLS_LANG=Simplified Chinese_CHINA.ZHS16GBK
ORACLE_DOC=/oracle/product/10.2.0/db_1/doc
QTDIR=/usr/lib/qt-3.3
USER=oracle
LD_LIBRARY_PATH=/oracle/product/10.2.0/db_1/lib:/oracle/product/10.2.0/db_1/ctx/lib:/oracle/product/10.2.0/db_1/jdbc/lib
LS_COLORS=no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=01;32:*.cmd=01;32:*.exe=01;32:*.com=01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tz=01;31:*.rpm=01;31:*.cpio=01;31:*.jpg=01;35:*.gif=01;35:*.bmp=01;35:*.xbm=01;35:*.xpm=01;35:*.png=01;35:*.tif=01;35:
ORACLE_SID=xtxgk
ORACLE_BASE=/oracle
MAIL=/var/spool/mail/oracle
PATH=/usr/lib/jdk/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/oracle/bin:/oracle/product/10.2.0/db_1/bin
INPUTRC=/etc/inputrc
PWD=/oracle
JAVA_HOME=/usr/lib/jdk
SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
SHLVL=1
HOME=/oracle
LANGUAGE=zh_CN.GB18030:zh_CN.GB2312:zh_CN
LOGNAME=oracle
CLASSPATH=/oracle/product/10.2.0/db_1/jre:/oracle/product/10.2.0/db_1/JRE:/oracle/product/10.2.0/db_1/jlib:/oracle/product/10.2.0/db_1/rdbms/jlib:/oracle/product/10.2.0/db_1/jdbc/lib/classes12.jar:/oracle/product/10.2.0/db_1/jdbc/lib/nls_charset12.jar
LESSOPEN=|/usr/bin/lesspipe.sh %s
ORA_NLS33=/oracle/product/10.2.0/db_1/ocommon/nls/admin/data
ORACLE_HOME=/oracle/product/10.2.0/db_1
G_BROKEN_FILENAMES=1
_=/bin/env
两台服务器的基本信息
1.服务器名
hostname: xtxgk1.localdomain
心跳线
heartbeat
eth1 192.168.100.10/24
公网ip
public
eth2 10.104.112.245/28
对外浮动ip
service
eth2:0 :10.104.112.247/28
磁盘阵列通信ip
iscsi
eth0
192.168.3.10 /24
服务器名
hostname:xtxgk2.localdomain
心跳线ip
heartbeat
eth1 192.168.100.20/24
对外服务ip
public
eth2 10.104.112.246/28
磁盘阵列通信ip
iscsi
eth0
192.168.3.20 /24
修改群集ip的操作
1>修改主机信息
进入245
/etc/hosts
[root@xtxgk1 ~]# more /etc/hosts
192.168.3.10 xtxgk1.localdomain xtxgk1
127.0.0.1 localhost.localdomain localhost
不用修改
进入修改网卡信息
eth2 ip 为 10.105.68.1/28
掩码为 25
修改网关 10.105.68.14/28
2>修改oracle 信息
修改listener.ora
[oracle@xtxgk1 admin]$ more listener.ora
# LISTENER.ORA Network Configuration File: /oracle/9.2.0/network/admin/listener.
ora
# Generated by Oracle configuration tools.
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = PLSExtProc)
(ORACLE_HOME = /oracle/product/10.2.0/db_1)
(PROGRAM = extproc)
)
(SID_DESC =
(GLOBAL_DBNAME = xtxgk)
(ORACLE_HOME = /oracle/product/10.2.0/db_1)
(SID_NAME = xtxgk)
)
)
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
)
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = localhost)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = 10.104.112.247)(PORT = 1521))
)
)
)
红色部分改为 10.105.68.4
修改tnsnames.ora
[oracle@xtxgk1 admin]$ more tnsnames.ora
# tnsnames.ora Network Configuration File: /opt/app/oracle/product/10.2.0/db_1/n
etwork/admin/tnsnames.ora
# Generated by Oracle configuration tools.
xtxgk =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 10.104.112.247)(PORT = 1521))
)
(CONNECT_DATA =
(SERVICE_NAME = xtxgk)
(GLOBAL_NAME = xtxgk)
)
)
EXTPROC_CONNECTION_DATA =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1))
)
(CONNECT_DATA =
(SID = PLSExtProc)
(PRESENTATION = RO)
)
)
红色部分改为 10.105.68.4
3>修改群集的conf文件
修改位置如下的文件
/opt/redflag/hacluster/etc/clp.conf
把相关的ip该掉
[root@xtxgk1 etc]# more clp.conf
<?xml version="1.0" encoding="ASCII"?>
<root>
<all>
<charset>ASCII</charset>
<edition>SE</edition>
<encode>SJIS</encode>
</all>
<trekking>
<create>0</create>
<restart>0</restart>
<productid>1</productid>
</trekking>
<cluster>
<name>RedFlag HA Cluster</name>
<comment> </comment>
</cluster>
<monitor>
<types name="userw"/>
<userw name="userw">
<comment>user mode monitor</comment>
<target> </target>
<relation>
<type>cls</type>
<name>RedFlag HA Cluster</name>
</relation>
</userw>
<types name="miiw"/>
<miiw name="miiw">
<comment> </comment>
<target> </target>
<object>eth1</object>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
</miiw>
<types name="diskw"/>
<diskw name="diskw">
<comment> </comment>
<target> </target>
<object>/dev/sdb1</object>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
<emergency>
<threshold>
<restart>0</restart>
</threshold>
</emergency>
<method>TUR</method>
</diskw>
<types name="pidw"/>
<pidw name="pidw">
<comment> </comment>
<target>oracle_mon</target>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
<emergency>
<threshold>
<restart>0</restart>
</threshold>
</emergency>
</pidw>
</monitor>
<server name="xtxgk1">
<priority>0</priority>
<comment> </comment>
<device id="0">
<type>lan</type>
<info>192.168.100.10</info>
</device>
<device id="100">
<type>public</type>
<info>10.104.112.245</info>
</device>
<device id="1">
<type>lan</type>
<info>10.104.112.245</info>
</device>
</server>
<server name="xtxgk2">
<priority>1</priority>
<comment> </comment>
<device id="0">
<type>lan</type>
<info>192.168.100.20</info>
</device>
<device id="100">
<type>public</type>
<info>10.104.112.246</info>
</device>
<device id="1">
<type>lan</type>
<info>10.104.112.246</info>
</device>
</server>
<heartbeat>
<types name="lanhb"/>
<lanhb name="lanhb1">
<priority>0</priority>
<device>0</device>
</lanhb>
<lanhb name="lanhb2">
<priority>1</priority>
<device>1</device>
</lanhb>
</heartbeat>
<group name="oracle">
<comment> </comment>
<policy name="xtxgk1">
<order>0</order>
</policy>
<policy name="xtxgk2">
<order>1</order>
</policy>
<resource name="fip@oracle_fip"/>
<resource name="disk@oracle_disk"/>
<resource name="exec@oracle_exec"/>
<resource name="exec@oracle_mon"/>
</group>
<resource>
<types name="fip"/>
<fip name="oracle_fip">
<comment> </comment>
<ip>10.104.112.247</ip>
<deact>
<action>0</action>
</deact>
<depend name=""/>
<server name="xtxgk1">
<ip>10.104.112.247</ip>
</server>
<server name="xtxgk2">
<ip>10.104.112.247</ip>
</server>
</fip>
<types name="disk"/>
<disk name="oracle_disk">
<comment> </comment>
<device>/dev/sdb1</device>
<mount>
<point>/oracle</point>
</mount>
<fs>ext3</fs>
<deact>
<action>0</action>
</deact>
<depend name="oracle_fip"/>
</disk>
<types name="exec"/>
<exec name="oracle_exec">
<comment> </comment>
<act>
<path>start.sh</path>
</act>
<deact>
<path>stop.sh</path>
<action>0</action>
</deact>
<depend name="oracle_disk"/>
<depend name="oracle_fip"/>
</exec>
<exec name="oracle_mon">
<comment> </comment>
<act>
<path>start.sh</path>
<sync>0</sync>
</act>
<deact>
<path>stop.sh</path>
<sync>0</sync>
<action>0</action>
</deact>
<depend name="oracle_disk"/>
<depend name="oracle_exec"/>
<depend name="oracle_fip"/>
</exec>
</resource>
</root>
把 10.104.112.245 改为 10.105.68.1/28
把 10.104.112.246 改为 10.105.68.2/28
把 10.104.112.247 改为 10.105.68.4/28
进入246
1>修改主机信息
/etc/hosts
[root@xtxgk2 ~]# more /etc/hosts
192.168.3.20 xtxgk2.localdomain xtxgk2
127.0.0.1 localhost.localdomain localhost
不改
进入修改网卡信息
eth2 ip 为 10.105.68.2
掩码为 25
修改网关 10.105.68.14
2>修改群集的conf文件
修改位置如下的文件
/opt/redflag/hacluster/etc/clp.conf
把相关的ip该掉
[root@xtxgk2 etc]# more clp.conf
<?xml version="1.0" encoding="ASCII"?>
<root>
<all>
<charset>ASCII</charset>
<edition>SE</edition>
<encode>SJIS</encode>
</all>
<trekking>
<create>0</create>
<restart>0</restart>
<productid>1</productid>
</trekking>
<cluster>
<name>RedFlag HA Cluster</name>
<comment> </comment>
</cluster>
<monitor>
<types name="userw"/>
<userw name="userw">
<comment>user mode monitor</comment>
<target> </target>
<relation>
<type>cls</type>
<name>RedFlag HA Cluster</name>
</relation>
</userw>
<types name="miiw"/>
<miiw name="miiw">
<comment> </comment>
<target> </target>
<object>eth1</object>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
</miiw>
<types name="diskw"/>
<diskw name="diskw">
<comment> </comment>
<target> </target>
<object>/dev/sdb1</object>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
<emergency>
<threshold>
<restart>0</restart>
</threshold>
</emergency>
<method>TUR</method>
</diskw>
<types name="pidw"/>
<pidw name="pidw">
<comment> </comment>
<target>oracle_mon</target>
<relation>
<name>oracle</name>
<type>grp</type>
</relation>
<emergency>
<threshold>
<restart>0</restart>
</threshold>
</emergency>
</pidw>
</monitor>
<server name="xtxgk1">
<priority>0</priority>
<comment> </comment>
<device id="0">
<type>lan</type>
<info>192.168.100.10</info>
</device>
<device id="100">
<type>public</type>
<info>10.104.112.245</info>
</device>
<device id="1">
<type>lan</type>
<info>10.104.112.245</info>
</device>
</server>
<server name="xtxgk2">
<priority>1</priority>
<comment> </comment>
<device id="0">
<type>lan</type>
<info>192.168.100.20</info>
</device>
<device id="100">
<type>public</type>
<info>10.104.112.246</info>
</device>
<device id="1">
<type>lan</type>
<info>10.104.112.246</info>
</device>
</server>
<heartbeat>
<types name="lanhb"/>
<lanhb name="lanhb1">
<priority>0</priority>
<device>0</device>
</lanhb>
<lanhb name="lanhb2">
<priority>1</priority>
<device>1</device>
</lanhb>
</heartbeat>
<group name="oracle">
<comment> </comment>
<policy name="xtxgk1">
<order>0</order>
</policy>
<policy name="xtxgk2">
<order>1</order>
</policy>
<resource name="fip@oracle_fip"/>
<resource name="disk@oracle_disk"/>
<resource name="exec@oracle_exec"/>
<resource name="exec@oracle_mon"/>
</group>
<resource>
<types name="fip"/>
<fip name="oracle_fip">
<comment> </comment>
<ip>10.104.112.247</ip>
<deact>
<action>0</action>
</deact>
<depend name=""/>
<server name="xtxgk1">
<ip>10.104.112.247</ip>
</server>
<server name="xtxgk2">
<ip>10.104.112.247</ip>
</server>
</fip>
<types name="disk"/>
<disk name="oracle_disk">
<comment> </comment>
<device>/dev/sdb1</device>
<mount>
<point>/oracle</point>
</mount>
<fs>ext3</fs>
<deact>
<action>0</action>
</deact>
<depend name="oracle_fip"/>
</disk>
<types name="exec"/>
<exec name="oracle_exec">
<comment> </comment>
<act>
<path>start.sh</path>
</act>
<deact>
<path>stop.sh</path>
<action>0</action>
</deact>
<depend name="oracle_disk"/>
<depend name="oracle_fip"/>
</exec>
<exec name="oracle_mon">
<comment> </comment>
<act>
<path>start.sh</path>
<sync>0</sync>
</act>
<deact>
<path>stop.sh</path>
<sync>0</sync>
<action>0</action>
</deact>
<depend name="oracle_disk"/>
<depend name="oracle_exec"/>
<depend name="oracle_fip"/>
</exec>
</resource>
</root>
把 10.104.112.245 改为 10.105.68.1/28
把 10.104.112.246 改为 10.105.68.2/28
把 10.104.112.247 改为 10.105.68.4/28
重启后群集工作正常
信息总结
对外浮动ip
10.105.68.4/28
各台服务器单机ip
10.105.68.1/28 xtxgkk1
10.105.68.2/28 xtxgk2