Oracle Grid Infrastructure & RAC Upgrade from Oracle 12c to Oracle 18c in Full Rack Exadata X7 Step by Step -1 Patch 27006180 Apply and 24600431 Patch Rollback 

Hi,

I will explain how to Upgrade Grid Infrastructure ( GI ) from Oracle 12cR2 to Oracle 18c in Full Rack ( Eight Nodes ) Oracle Exadata X7-2 in this article.

If you don’t know what is the Oracle RAC and Exadata, you can read following articles.

 

 

You can download Oracle 18c installation file from Metalink and following link.

https://www.oracle.com/technetwork/database/enterprise-edition/downloads/oracle18c-linux-180000-5022980.html

 

When you upgrade Grid Infrastructure ( GI ) from Oracle 12cR2 to Oracle 18c, You will get an error related with Oracle patch: 27006180 like following.

 

To upgrade Grid Infrastructure ( GI ) from Oracle 12cR2 to Oracle 18c, you need to apply 27006180 patch to the 12c Grid Infrastracture ( GI ) before upgrade.

Download Latest OPatch utility and 27006180 from Metalink.

 

Apply 27006180 patch like following.

[root@MehmetSalih01 OPatch]# ./opatchauto apply /u01/patch/27006180

OPatchauto session is initiated at Tue Jul 30 21:30:51 2019

System initialization log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchautodb/systemconfig2019-07-30_09-30-52PM.log.

Session log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchauto/opatchauto2019-07-30_09-31-23PM.log
The id for this session is SDXK

Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.2.0.1/grid
Patch applicability verification failed on home /u01/app/12.2.0.1/grid

Execution of [OPatchAutoBinaryAction] patch action failed, check log for more details. Failures:
Patch Target : MehmetSalih01->/u01/app/12.2.0.1/grid Type[crs]
Details: [
---------------------------Patching Failed---------------------------------
Command execution failed during patching in home: /u01/app/12.2.0.1/grid, host: MehmetSalih01.
Command failed: /u01/app/12.2.0.1/grid/OPatch/opatchauto apply /u01/patch/27006180 -oh /u01/app/12.2.0.1/grid -target_type cluster -binary -invPtrLoc /u01/app/12.2.0.1/grid/oraInst.loc -jre /u01/app/12.2.0.1/grid/OPatch/jre -persistresult /u01/app/12.2.0.1/grid/OPatch/auto/dbsessioninfo/sessionresult_analyze_MehmetSalih01_crs.ser -analyze -online -prepare_home
Command failure output: 
==Following patches FAILED in analysis for apply:

Patch: /u01/patch/27006180/27006180
Log: /u01/app/12.2.0.1/grid/cfgtoollogs/opatchauto/core/opatch/opatch2019-07-30_21-31-30PM_1.log
Reason: Failed during Analysis: CheckConflictAgainstOracleHome Failed, [ Prerequisite Status: FAILED, Prerequisite output: 
Summary of Conflict Analysis:

There are no patches that can be applied now.

Following patches have conflicts. Please contact Oracle Support and get the merged patch of the patches : 
24600431, 27006180

Conflicts/Supersets for each patch are:

Patch : 27006180

Bug Conflict with 24600431
Conflicting bugs are:
24462646, 25564644, 24732650, 25485737, 24824518, 25408895, 25667162 ...

After fixing the cause of failure Run opatchauto resume

]
OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.
OPatchAuto failed.

OPatchauto session completed at Tue Jul 30 21:31:30 2019
Time taken to complete the session 0 minute, 40 seconds

opatchauto failed with error code 42
[root@MehmetSalih01 OPatch]#

 

We could not apply Patch : 27006180 because of Bug Conflict with 24600431.

To apply Patch : 27006180, you need to rollback 24600431 patch from GI 12c home.

 

You can rollback 24600431 patch from GI 12c home like following.

 

Don’t forget that you should perform rollback and apply steps on all Nodes ( Eight Nodes )

 

Firstly run Prepatch step.

[root@MehmetSalih01 ~]#
[root@MehmetSalih01 ~]#
[root@MehmetSalih01 ~]# cd $ORACLE_HOME
[root@MehmetSalih01 grid]#
[root@MehmetSalih01 grid]# cd crs/install/
[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]# /u01/app/12.2.0.1/grid/perl/bin/perl rootcrs.pl -prepatch
Using configuration parameter file: ./crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/MehmetSalih01/crsconfig/crspatch_MehmetSalih01_2019-08-02_04-53-13PM.log
Oracle Clusterware active version on the cluster is [12.2.0.1.0]. The cluster upgrade state is [ROLLING PATCH]. The cluster active patch level is [660349355].
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.crsd' on 'MehmetSalih01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.reco.acfs_vol1.acfs' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.SPARSE.dg' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.SPARSE.dg' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.RECO.dg' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.RECO.dg' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.MehmetSalih01.vip' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.reco.acfs_vol1.acfs' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.RECO.ACFS_VOL1.advm' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.RECO.ACFS_VOL1.advm' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.proxy_advm' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.asm' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.scan2.vip' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.MehmetSalih01.vip' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.proxy_advm' on 'MehmetSalih01' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'MehmetSalih05'
CRS-2672: Attempting to start 'ora.MehmetSalih01.vip' on 'MehmetSalih01'
CRS-2676: Start of 'ora.scan2.vip' on 'MehmetSalih05' succeeded
CRS-2676: Start of 'ora.MehmetSalih01.vip' on 'MehmetSalih01' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'MehmetSalih05'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'MehmetSalih05' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.ons' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.net1.network' on 'MehmetSalih01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'MehmetSalih01' has completed
CRS-2677: Stop of 'ora.crsd' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.crf' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.drivers.acfs' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.crf' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.asm' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.evmd' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.ctssd' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.evmd' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.cssd' on 'MehmetSalih01' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'MehmetSalih01'
CRS-2673: Attempting to stop 'ora.gipcd' on 'MehmetSalih01'
CRS-2677: Stop of 'ora.gipcd' on 'MehmetSalih01' succeeded
CRS-2677: Stop of 'ora.diskmon' on 'MehmetSalih01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'MehmetSalih01' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2019/08/02 16:54:19 CLSRSC-4012: Shutting down Oracle Trace File Analyzer (TFA) Collector.
2019/08/02 16:54:27 CLSRSC-4013: Successfully shut down Oracle Trace File Analyzer (TFA) Collector.
2019/08/02 16:54:27 CLSRSC-347: Successfully unlock /u01/app/12.2.0.1/grid
[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]#



  

After Prepatch step is successfull, you can rollback 24600431 patch like following.

 

[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]# su - grid
[grid@MehmetSalih01 ~]$
[grid@MehmetSalih01 ~]$
[grid@MehmetSalih01 ~]$ cd $ORACLE_HOME
[grid@MehmetSalih01 grid]$
[grid@MehmetSalih01 grid]$ cd OPatch/
[grid@MehmetSalih01 OPatch]$
[grid@MehmetSalih01 OPatch]$
[grid@MehmetSalih01 OPatch]$ ./opatch rollback -local -id 24600431 -oh /u01/app/12.2.0.1/grid
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2019, Oracle Corporation. All rights reserved.

Oracle Home : /u01/app/12.2.0.1/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/12.2.0.1/grid/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.2.0.1.4
Log file location : /u01/app/12.2.0.1/grid/cfgtoollogs/opatch/opatch2019-08-02_16-55-32PM_1.log

Patches will be rolled back in the following order:
24600431

--------------------------------------------------------------------------------
Start OOP by Prereq process.
Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2019, Oracle Corporation. All rights reserved.

Oracle Home : /u01/app/12.2.0.1/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/12.2.0.1/grid/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.2.0.1.4
Log file location : /u01/app/12.2.0.1/grid/cfgtoollogs/opatch/opatch2019-08-02_16-55-46PM_1.log

Patches will be rolled back in the following order:
24600431
The following patch(es) will be rolled back: 24600431

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/app/12.2.0.1/grid')

Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y

Rolling back patch 24600431...

RollbackSession rolling back interim patch '24600431' from OH '/u01/app/12.2.0.1/grid'

Patching component oracle.has.deconfig, 12.2.0.1.0...

Patching component oracle.has.common, 12.2.0.1.0...

Patching component oracle.has.common.cvu, 12.2.0.1.0...

Patching component oracle.has.db, 12.2.0.1.0...

Patching component oracle.has.crs, 12.2.0.1.0...

Patching component oracle.has.cvu, 12.2.0.1.0...

Patching component oracle.has.rsf, 12.2.0.1.0...
RollbackSession removing interim patch '24600431' from inventory
Inactive sub-set patch [26925644] has become active due to the rolling back of a super-set patch [24600431].
Please refer to Doc ID 2161861.1 for any possible further required actions.
Log file location: /u01/app/12.2.0.1/grid/cfgtoollogs/opatch/opatch2019-08-02_16-55-46PM_1.log

OPatch succeeded.
[grid@MehmetSalih01 OPatch]$
[grid@MehmetSalih01 OPatch]$
[grid@MehmetSalih01 OPatch]$ exit
logout
[root@MehmetSalih01 install]#
[root@MehmetSalih01 install]# cd ../../OPatch/
[root@MehmetSalih01 OPatch]#



  

 

 

After  24600431 patch rollback is completed, you can apply 27006180  patch to GI 12c home like following.

[root@MehmetSalih01 OPatch]#
[root@MehmetSalih01 OPatch]# ./opatchauto apply /u01/patch/27006180 -oh /u01/app/12.2.0.1/grid -nonrolling

OPatchauto session is initiated at Fri Aug 2 16:56:31 2019

System initialization log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchautodb/systemconfig2019-08-02_04-56-46PM.log.

Session log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchauto/opatchauto2019-08-02_04-56-53PM.log
The id for this session is JZI5

Executing OPatch prereq operations to verify patch applicability on home /u01/app/12.2.0.1/grid
Patch applicability verified successfully on home /u01/app/12.2.0.1/grid

Checking shared status of home.....

Bringing down CRS service on home /u01/app/12.2.0.1/grid
Prepatch operation log file location: /u01/app/grid/crsdata/MehmetSalih01/crsconfig/crspatch_MehmetSalih01_2019-08-02_04-57-39PM.log
CRS service brought down successfully on home /u01/app/12.2.0.1/grid

Start applying binary patch on home /u01/app/12.2.0.1/grid
Binary patch applied successfully on home /u01/app/12.2.0.1/grid

Checking shared status of home.....

Starting CRS service on home /u01/app/12.2.0.1/grid
Postpatch operation log file location: /u01/app/grid/crsdata/MehmetSalih01/crsconfig/crspatch_MehmetSalih01_2019-08-02_05-01-22PM.log
CRS service started successfully on home /u01/app/12.2.0.1/grid

OPatchAuto successful.

--------------------------------Summary--------------------------------

Patching is completed successfully. Please find the summary as follows:

Host:MehmetSalih01
CRS Home:/u01/app/12.2.0.1/grid
Version:12.2.0.1.0
Summary:

==Following patches were SUCCESSFULLY applied:

Patch: /u01/patch/27006180/27006180
Log: /u01/app/12.2.0.1/grid/cfgtoollogs/opatchauto/core/opatch/opatch2019-08-02_16-58-11PM_1.log

OPatchauto session completed at Fri Aug 2 17:03:44 2019
Time taken to complete the session 7 minutes, 14 seconds
[root@MehmetSalih01 OPatch]#
[root@MehmetSalih01 OPatch]#
[root@MehmetSalih01 OPatch]#

I have performed 24600431 patch rollback and 27006180 patch apply on First node.

You should apply above steps on All nodes.

I will continue to explain Oracle 18c Upgrade in the next article.

Mehmet Salih Deveci

I am Founder of IT Tutorial and Certified Expert about Oracle & SQL Server database, Goldengate, Exadata Machine, Oracle Database Appliance administrator with 10+years experience.I have OCA, OCP, OCE RAC Expert Certificates I have worked 100+ Banking, Insurance, Finance, Telco and etc. clients as a Consultant, Insource or Outsource.I have done 200+ Operations in this clients such as Exadata Installation & PoC & Migration & Upgrade, Oracle & SQL Server Database Upgrade, Oracle RAC Installation, SQL Server AlwaysOn Installation, Database Migration, Disaster Recovery, Backup Restore, Performance Tuning, Periodic Healthchecks.I have done 2000+ Table replication with Goldengate or SQL Server Replication tool for DWH Databases in many clients.If you need Oracle DBA, SQL Server DBA, APPS DBA,  Exadata, Goldengate, EBS Consultancy and Training you can send my email adress mehmetsalih.deveci@outlook.com.-                                                                                                                                                                                                                                                 -Oracle DBA, SQL Server DBA, APPS DBA,  Exadata, Goldengate, EBS ve linux Danışmanlık ve Eğitim için  mehmetsalih.deveci@outlook.com a mail atabilirsiniz.

Leave a Reply

Your email address will not be published. Required fields are marked *