oracle 11g rac模式下PSU补丁升级（四）

[grid@11g-rac1 ~]$ opatch version
OPatch Version: 11.2.0.3.4

OPatch succeeded.

[root@11g-rac1 grid]# unzip /tmp/p6880880_112000_Linux-x86-64.zip 
[root@11g-rac1 grid]# chown -R grid:oinstall OPatch

[grid@11g-rac1 grid]$ opatch version
OPatch Version: 11.2.0.3.16

OPatch succeeded.

我这里安装cluster和db 都是安装在本地没有使用共享以及ACFS，如果使用了ACFS将使用其他方法；

[grid@11g-rac1 grid]$ $ORACLE_HOME/OPatch/ocm/bin/emocmrsp -no_banner -output /tmp/ocm.rsp
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name: 

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
The OCM configuration response file (/tmp/ocm.rsp) was successfully created.

GI的PSU补丁中包括gi的升级补丁跟db的升级补丁

[grid@11g-rac1 tmp]$ unzip gridpsu180717_112040_Linux-x86-64.zip

[grid@11g-rac1 27967757]$ opatch lsinventory
Oracle Interim Patch Installer version 11.2.0.3.16
Copyright (c) 2018, Oracle Corporation.  All rights reserved.

Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.16
OUI version       : 11.2.0.4.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2018-09-14_11-56-59AM_1.log

Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2018-09-14_11-56-59AM.txt

--------------------------------------------------------------------------------
Local Machine Information::
Hostname: 11g-rac1
ARU platform id: 226
ARU platform description:: Linux x86-64

Installed Top-level Products (1): 

Oracle Grid Infrastructure 11g                                       11.2.0.4.0
There are 1 products installed in this Oracle Home.

There are no Interim patches installed in this Oracle Home.

--------------------------------------------------------------------------------

OPatch succeeded.

[root@11g-rac1 tmp]# /u01/app/11.2.0/grid/OPatch/opatch auto /tmp/27967757 -ocmrf /tmp/ocm.rsp 
Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /tmp -patchn 27967757 -ocmrf /tmp/ocm.rsp -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params

This is the main log file: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2018-09-14_11-57-30.log

This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/app/11.2.0/grid/cfgtoollogs/opatchauto2018-09-14_11-57-30.report.log

2018-09-14 11:57:30: Starting Clusterware Patch Setup
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

Stopping RAC /u01/app/oracle/product/11.2.4/db_1 ...
Stopped RAC /u01/app/oracle/product/11.2.4/db_1 successfully

patch /tmp/27967757/27734982  apply successful  for home  /u01/app/oracle/product/11.2.4/db_1

Stopping CRS...
Stopped CRS successfully

patch /tmp/27967757/27734982  apply successful for home  /u01/app/11.2.0/grid 
patch /tmp/27967757/27441052  apply successful for home  /u01/app/11.2.0/grid 
patch /tmp/27967757/27959254  apply successful for home  /u01/app/11.2.0/grid 

Starting CRS...
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.

Starting RAC /u01/app/oracle/product/11.2.4/db_1 ...
Started RAC /u01/app/oracle/product/11.2.4/db_1 successfully

opatch auto succeeded.

[grid@11g-rac1 27967757]$ opatch lsinventory
Oracle Interim Patch Installer version 11.2.0.3.16
Copyright (c) 2018, Oracle Corporation.  All rights reserved.

Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.16
OUI version       : 11.2.0.4.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2018-09-14_12-18-47PM_1.log

Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2018-09-14_12-18-47PM.txt

--------------------------------------------------------------------------------
Local Machine Information::
Hostname: 11g-rac1
ARU platform id: 226
ARU platform description:: Linux x86-64

Installed Top-level Products (1): 

Oracle Grid Infrastructure 11g                                       11.2.0.4.0
There are 1 products installed in this Oracle Home.

Interim patches (3) :

Patch  27959254     : applied on Fri Sep 14 12:10:10 CST 2018
Unique Patch ID:  22172315
Patch description:  "ACFS Patch Set Update : 11.2.0.4.180717 (27959254)"
   Created on 1 Jul 2018, 23:28:14 hrs PST8PDT
   Bugs fixed:
     16318126, 21369858, 19690653, 17203009, 17503605, 17359415, 20140148
     17611362, 25098392, 17164243, 17696547, 19053182, 17488768, 18168684
     21519796, 18143006, 21208140, 17428148, 17070158, 20438706, 17510275
     17172303, 18610307, 17376318, 17721778, 22198405, 17699423, 22810422
     18915417, 18155334, 18321597, 19919907, 18185024, 17636008, 17363999
     20681968, 17475946, 27463879

Patch  27441052     : applied on Fri Sep 14 12:08:30 CST 2018
Unique Patch ID:  22172315
Patch description:  "OCW PATCH SET UPDATE: 11.2.0.4.180417 (27441052)"
   Created on 5 Feb 2018, 01:05:22 hrs PST8PDT
   Bugs fixed:
     18328800, 19270660, 18691572, 18508710, 20038451, 21251192, 22162062
     20365005, 21232394, 17387214, 17750548, 17617807, 14497275, 20219458
     17733927, 18180541, 23757020, 18962892, 17292250, 17378618, 16759171
     20110156, 17843489, 17065496, 13991403, 21694632, 17273020, 22762046
     17155238, 18261183, 18053580, 20012766, 21245437, 20218012, 17013634
     17886392, 24422155, 20995001, 17039197, 16317771, 17947785, 10052729
     20340620, 22353346, 16237657, 20317221, 18199185, 15917869, 18399991
     20186278, 18024089, 17374271, 16849642, 20246071, 20746251, 14270845
     23621494, 20552947, 18414137, 18882642, 17001914, 17927970, 14378120
     16346413, 15986647, 18068871, 21222147, 16206997, 18143836, 21982225
     25490238, 19168690, 18343490, 20235511, 21875360, 16613232, 19276791
     17722664, 20440643, 12928658, 18226143, 18520351, 16249829, 18952577
     17172091, 18229842, 16076412, 18265482, 20676340, 17818075, 20091753
     18231837, 14373486, 17483479, 20136892, 20551654, 18120545, 18729166
     13843841, 17405302, 21225209, 18709496, 18330979, 18744838, 14525998
     18187697, 17087371, 20531190, 20598625, 14385860, 18348155, 19479503
     12928592, 17516024, 18370031, 17764053, 19272663, 17551223, 14671408
     18272135, 14207615, 21255373, 17500165, 18875012, 14769643, 25656952
     19558324, 18464784, 18848125, 19241857, 14851828, 17955615, 14693336
     20315294, 16284825, 17352230, 20014326, 17238586, 17089344, 17405605
     17531342, 21327402, 26546632, 19398098, 17159489, 17640316, 13823394
     16543190, 22024217, 17983675, 20795241, 17481314, 18346135, 17598201
     16281493, 15986311, 17208793, 19601468, 18999857, 18700935, 14076173
     18428146, 17435488, 18352845, 18352846, 20408163, 17592037, 19616601
     17387779, 17391726, 14777968, 15851860, 16206882, 20141091, 15832129
     17305100, 20175174, 21113068, 19885321, 16901346, 17985714, 25591658
     18536826, 17780903, 18752378, 18946768, 16876500, 16875342, 17769597
     19955755, 16429265, 18336452, 17273003, 17209968, 25484507, 16988311
     19319357, 20094984, 17046460, 17059927, 18053631, 16867761, 18774591
     21442094, 20235486, 19359787, 15869775, 17447588, 19642566, 21152052
     16798862, 15920201

Patch  27734982     : applied on Fri Sep 14 12:06:42 CST 2018
Unique Patch ID:  22229176
Patch description:  "Database Patch Set Update : 11.2.0.4.180717 (27734982)"
   Created on 31 May 2018, 01:37:49 hrs PST8PDT
Sub-patch  27338049; "Database Patch Set Update : 11.2.0.4.180417 (27338049)"
Sub-patch  26925576; "Database Patch Set Update : 11.2.0.4.180116 (26925576)"
Sub-patch  26392168; "Database Patch Set Update : 11.2.0.4.171017 (26392168)"
Sub-patch  26609445; "Database Patch Set Update : 11.2.0.4.170814 (26609445)"
Sub-patch  25869727; "Database Patch Set Update : 11.2.0.4.170718 (25869727)"
Sub-patch  24732075; "Database Patch Set Update : 11.2.0.4.170418 (24732075)"
Sub-patch  24006111; "Database Patch Set Update : 11.2.0.4.161018 (24006111)"
Sub-patch  23054359; "Database Patch Set Update : 11.2.0.4.160719 (23054359)"
Sub-patch  22502456; "Database Patch Set Update : 11.2.0.4.160419 (22502456)"
Sub-patch  21948347; "Database Patch Set Update : 11.2.0.4.160119 (21948347)"
Sub-patch  21352635; "Database Patch Set Update : 11.2.0.4.8 (21352635)"
Sub-patch  20760982; "Database Patch Set Update : 11.2.0.4.7 (20760982)"
Sub-patch  20299013; "Database Patch Set Update : 11.2.0.4.6 (20299013)"
Sub-patch  19769489; "Database Patch Set Update : 11.2.0.4.5 (19769489)"
Sub-patch  19121551; "Database Patch Set Update : 11.2.0.4.4 (19121551)"
Sub-patch  18522509; "Database Patch Set Update : 11.2.0.4.3 (18522509)"
Sub-patch  18031668; "Database Patch Set Update : 11.2.0.4.2 (18031668)"
Sub-patch  17478514; "Database Patch Set Update : 11.2.0.4.1 (17478514)"
   Bugs fixed:
     21174504, 17184721, 21538558, 16091637, 18092127, 17381384, 15979965
     20671094, 16731148, 16314254, 13837378, 18441944, 17835048, 13558557
     17008068, 17201159, 25427662, 17853498, 20717359, 17246576, 18356166
     18681862, 18440047, 20569094, 20031873, 16875449, 20387265, 19788842
     17296856, 21330264, 14010183, 17648596, 17551063, 17025461, 24719736
     17267114, 22507210, 17912217, 17889583, 18202441, 17040764, 17478145
     16524926, 25655390, 19358317, 22148226, 18747196, 26544823, 18641419
     17036973, 18948177, 17811789, 16542886, 14285317, 18009564, 16618694
     8322815, 16832076, 18247991, 16692232, 22507234, 17570240, 13871092
     24624166, 24348685, 17848897, 17441661, 14034426, 17465741, 16596890
     17437634, 21343897, 20506706, 21453153, 18339044, 17951233, 22321741
     21795111, 18430495, 21787056, 22380919, 19469538, 20506715, 17811429
     19721304, 17903598, 18230522, 19554106, 19458377, 21281607, 17612828
     6599380, 22092979, 22321756, 17040527, 17811438, 18641461, 14657740
     13364795, 21387964, 19490948, 17346671, 17588480, 22351572, 18235390
     26474853, 18849970, 17889549, 19309466, 16472716, 20596234, 18331850
     18641451, 17344412, 21179898, 19461270, 17546761, 24842886, 14521849
     18203835, 18203838, 18964939, 18203837, 17313525, 22195457, 18139690
     16837842, 22296366, 14106803, 17842825, 21352646, 22657942, 16360112
     20657441, 22195441, 17389192, 26198926, 14565184, 17205719, 18440095
     14764829, 22195448, 14354737, 13944971, 16571443, 21868720, 17186905
     17080436, 18673342, 22905130, 17027426, 27374796, 19972569, 19972568
     20144308, 19972566, 17282229, 19972564, 16870214, 21629064, 19615136
     21354456, 17390431, 18762750, 23007241, 16613964, 17957017, 18098207
     18471685, 19730508, 21538485, 18264060, 17323222, 17754782, 17600719
     18317531, 17852463, 17596908, 17655634, 16228604, 27053456, 20074391
     19972570, 18090142, 18996843, 19854503, 16042673, 17835627, 20334344
     17393683, 20861693, 18000422, 17551709, 26575788, 23315889, 20506699
     19006849, 18277454, 18456514, 19174430, 17258090, 17174582, 25654936
     17242746, 16399083, 17824637, 21132297, 22465352, 17762296, 22168163
     17397545, 16450169, 12364061, 20067212, 18856999, 19211724, 19463893
     19463897, 21343775, 17853456, 18673304, 20004021, 26030218, 21668627
     16194160, 17477958, 16538760, 12982566, 24570598, 20828947, 18259031
     20296213, 18293054, 17610798, 19699191, 23065323, 17311728, 18135678
     18774543, 23294548, 16785708, 10136473, 24560906, 22551446, 19777862
     17786518, 18315328, 18334586, 12747740, 18096714, 19032867, 21641760
     17390160, 18899974, 17232014, 20598042, 18673325, 16422541, 18155762
     14015842, 19827973, 22683225, 17726838, 18554871, 23177648, 18051556
     20803583, 21972320, 15990359, 17922254, 18282562, 16855292, 16668584
     21343838, 20299015, 17446237, 18093615, 18043064, 23713236, 17694209
     17288409, 18308268, 20475845, 17274537, 13955826, 16934803, 17634921
     17501491, 16315398, 23725036, 22683212, 17006183, 13829543, 18191164
     17655240, 26746894, 22809871, 18384391, 19393542, 21538567, 16198143
     21847223, 25823754, 17892268, 20142975, 19584068, 17165204, 25165496
     18604493, 21756699, 18508861, 16901385, 18554763, 21532755, 18189036
     17443671, 17385178, 14829250, 17936109, 20925795, 20509482, 17478514
     27441326, 16850630, 13951456, 16595641, 14054676, 15861775, 21142837
     16912439, 17299889, 17297939, 23003979, 18619917, 16833527, 17798953
     17816865, 18607546, 17571306, 21286665, 17341326, 26910644, 17851160
     20558005, 17586955, 19049453, 21051840, 17587063, 16956380, 18328509
     25423453, 14133975, 18061914, 18522509, 21051833, 20294666, 18765602
     20860659, 20324049, 18199537, 17332800, 13609098, 22502493, 18384537
     14338435, 17945983, 16392068, 21067387, 17752995, 21051862, 16863422
     25505382, 17237521, 18244962, 19544839, 24433711, 24717859, 17156148
     18973907, 23026585, 17877323, 17449815, 18180390, 17088068, 17037130
     20004087, 21422580, 19466309, 11733603, 25505371, 21051858, 18084625
     18674024, 21051852, 18091059, 25369547, 16306373, 18306996, 17787259
     18193833, 19915271, 20513399, 20631274, 25879656, 16344544, 14692762
     18614015, 17346091, 18228645, 17721717, 18436307, 21756677, 19888853
     11883252, 17891943, 19475971, 22353199, 16384983, 19121551, 27825893
     12816846, 17982555, 17761775, 22243719, 17265217, 25505394, 17071721
     16721594, 18262334, 21756661, 17891946, 15913355, 17672719, 17602269
     17239687, 17042658, 17238511, 17811456, 17284817, 17752121, 20879889
     21380789, 17394950, 17011832, 16579084, 22195465, 14602788, 18325460
     24476265, 26569225, 24476274, 12611721, 16903536, 17006570, 19689979
     16043574, 18783224, 24662775, 16494615, 21526048, 17392698, 19197175
     16069901, 17811447, 27870645, 17308789, 22195477, 24835538, 17865671
     17343514, 19013183, 17325413, 18316692, 16180763, 17348614, 14368995
     21983325, 17393915, 16285691, 19211433, 20331945, 17883081, 17705023
     24316947, 17614227, 19578350, 22195485, 14084247, 13645875, 16777840
     19727057, 14852021, 18744139, 18674047, 17716305, 19285025, 18482502
     27534509, 17622427, 19289642, 22195492, 25947799, 14458214, 20869721
     21172913, 17767676, 18723434, 25505407, 17786278, 19258504, 17082983
     21351877, 17365043, 13498382, 18331812, 16065166, 25489607, 16685417
     18031668, 22893153, 16943711, 19272701, 21517440, 25897615, 17649265
     13866822, 18094246, 24528741, 17783588, 14245531, 17082359, 18280813
     20448824, 23330119, 16268425, 19487147, 25600421, 18018515, 17302277
     17215560, 24411921, 19271443, 25764020, 17016369, 20777150, 23330124
     16756406, 20441797, 19769489, 28100487, 17545847, 25093656, 18260550
     13853126, 17227277, 23536835, 25957038, 24652769, 19207117, 9756271
     18868646, 17614134, 26667023, 17546973, 18704244, 19680952, 26667015
     17050888, 18828868, 18273830, 17360606, 16992075, 24563422, 17375354
     12905058, 18362222, 21429602, 27086138, 17571039, 17468141, 18436647
     17235750, 21168487, 16220077, 16929165

--------------------------------------------------------------------------------

OPatch succeeded.

[root@11g-rac1 tmp]# su - oracle
[oracle@11g-rac1 ~]$ cd /u01/app/oracle/product/11.2.4/db_1/rdbms/admin/
[oracle@11g-rac1 admin]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Fri Sep 14 12:14:41 2018

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> @catbundle.sql psu apply

SQL> @utlrp.sql

SQL> @dbmsjdev.sql

SQL> exec dbms_java_dev.disable

过程报错处理：

Following executables are active :
/u01/app/oracle/product/11.2.4/db_1/lib/libclntsh.so.11.1
Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:
Following executables are active :
/u01/app/oracle/product/11.2.4/db_1/lib/libsqlplus.so
UtilSession failed: Prerequisite check "CheckActiveFilesAndExecutables" failed.Prerequisite check "CheckActiveFilesAndExecutables" failed.
Log file location: /u01/app/oracle/product/11.2.4/db_1/cfgtoollogs/opatch/opatch2018-09-14_13-41-46PM_1.log

OPatch failed with error code 73
[oracle@11g-rac1 27734982]$ /sbin/fuser /u01/app/oracle/product/11.2.4/db_1/lib/libclntsh.so.11.1
/u01/app/oracle/product/11.2.4/db_1/lib/libclntsh.so.11.1:  1592m
[oracle@11g-rac1 27734982]$ ps -ef | grep 1592
oracle    1592 20358  0 11:34 pts/1    00:00:00 sqlplus   as sysdba
oracle   23841 10727  0 13:44 pts/0    00:00:00 grep 1592
[oracle@11g-rac1 27734982]$ kill -9 1592

有时报错需要关闭tfa服务：

[root@11g-rac1 ~]# /etc/init.d/init.tfa status
Usage: /etc/init.d/init.tfa {stop|start|shutdown|restart}

在第二台服务器一样的操作一遍。

如果使用手工干预的补丁升级：

su - root
 
/u01/app/11.2.0/grid/crs/install/rootcrs.pl -unlock
 
 su -  grid 
 
 opatch napply -oh /u01/app/11.2.0/grid -local /tmp/27967757/27734982
 opatch napply -oh /u01/app/11.2.0/grid -local /tmp/27967757/27441052

su - oracle

/tmp/27967757/27441052/custom/server/27441052/custom/scripts/prepatch.sh -dbhome /u01/app/oracle/product/11.2.4/db_1
/tmp/27967757/27441052/custom/server/27441052/custom/scripts/prepatch.sh completed successfully.

opatch napply -oh /u01/app/oracle/product/11.2.4/db_1 -local /tmp/27967757/27441052/custom/server/27441052
opatch napply -oh /u01/app/oracle/product/11.2.4/db_1 -local /tmp/27967757/27734982

/tmp/27967757/27441052/custom/server/27441052/custom/scripts/postpatch.sh -dbhome $ORACLE_HOME

su - root

/u01/app/11.2.0/grid/rdbms/install/rootadd_rdbms.sh 
/u01/app/11.2.0/grid/crs/install/rootcrs.pl -patch

总结：oracle11g rac 补丁升级完成，其中注意事项为在补丁升级前需要将usqlplus 等终端连接退出。