EM 12.1.0.4 Installing recommended plugins and patches¶
We use the DBaaS (Database as a Service) functionality of EM Cloud Control 12c. After facing with multiple issues, it was decided to update EM and install Oracle recommended plugins and patches. This post discusses the issues that I came across during the update exercise.
Following the MOS note: Enterprise Manager Cloud Control 12c Recommended Plug-Ins and Patches for Database as a Service (DBaaS) (Doc ID 1549855.1)
Specifically:
- Patch 20870437: ENTERPRISE MANAGER BASE PLATFORM - OMS 12.1.0.4.4 PSU (GENERIC)
- Patch 21415432: enterprise manager for oms plugins 12.1.0.4.14
We had a vanilla EM 12.1.0.4 installation without any PSU or patches (except Cloud Framework Plug-In version 12.1.0.2.0).
ENTERPRISE MANAGER BASE PLATFORM - OMS 12.1.0.4.4 PSU¶
At the step of the installation:
2.9 Run the following command on each OMS instance home to ensure that you do not have any issues with configuration and binary prerequisite checks,
I encountered an error:
Show
[oracle@mgmt 20870437]$
/u01/app/oracle/oms12/oms/OPatch/opatchauto apply -analyze
-property_file /u01/app/oracle/oms12/oms/OPatch/wlskeys/property_file
-invPtrLoc /u01/app/oracle/oms12/oms/oraInst.loc
OPatchAuto.OMS_DISABLE_HOST_CHECK=true
OPatch Automation Tool
Copyright (c) 2014, Oracle Corporation. All rights reserved.
OPatchauto version : 11.1.0.10.4
OUI version : 11.1.0.12.0
Running from : /u01/app/oracle/oms12/oms
Log file location : /u01/app/oracle/oms12/oms/cfgtoollogs/opatch/opatch2015-08-07_17-00-41PM_1.log
OPatchauto log file: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/20870437/opatch_oms_2015-08-07_17-00-43PM_analyze.log
OPatchauto
failed to establish JMX connection to weblogic server. This could be
because of one (or) more of the following reasons:
1. Weblogic admin server URL that manages OMS application may not be right.
2. Weblogic admin server credentials (username, password) may not be right.
3.
Virtual host configuration. If OMS, weblogic server are on virtual host
configuration, Please make sure to add
OPatchAuto.OMS_DISABLE_HOST_CHECK=true to command line and run again.
(example: /u01/app/oracle/oms12/oms/OPatch/opatchauto apply -analyze
-property_file /u01/app/oracle/oms12/oms/OPatch/wlskeys/property_file
-invPtrLoc /u01/app/oracle/oms12/oms/oraInst.loc
OPatchAuto.OMS_DISABLE_HOST_CHECK=true
OPatchAuto.OMS_DISABLE_HOST_CHECK=true)
Please check above conditions and if error(s) still persist, Please contact Oracle support.
[ Error during Get weblogic Admin Server information Phase]. Detail: OPatchauto was not able to find right interview inputs.
OPatchauto failed:
OPatchauto
failed to establish JMX connection to weblogic server. This could be
because of one (or) more of the following reasons:
1. Weblogic admin server URL that manages OMS application may not be right.
2. Weblogic admin server credentials (username, password) may not be right.
3.
Virtual host configuration. If OMS, weblogic server are on virtual host
configuration, Please make sure to add
OPatchAuto.OMS_DISABLE_HOST_CHECK=true to command line and run again.
(example: /u01/app/oracle/oms12/oms/OPatch/opatchauto apply -analyze
-property_file /u01/app/oracle/oms12/oms/OPatch/wlskeys/property_file
-invPtrLoc /u01/app/oracle/oms12/oms/oraInst.loc
OPatchAuto.OMS_DISABLE_HOST_CHECK=true
OPatchAuto.OMS_DISABLE_HOST_CHECK=true)
Please check above conditions and if error(s) still persist, Please contact Oracle support.
Log file location: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/20870437/opatch_oms_2015-08-07_17-00-43PM_analyze.log
Recommended actions: Please correct the interview inputs and run opatchauto again.
OPatchauto failed with error code 231
[oracle@mgmt 20870437]$
I searched through the MOS knowledge base and came to conclusion that the error was due to an old OPatch version. More specifically, I found a note with the same error: EM12c : OPatchauto fails with : opatchauto finds that weblogic credentials may not be right or admin server is down (Doc ID 1644317.1). From which I concluded that the issue should be resolved after installing OPatch 11.1.0.11. As I saw from the logs, we used OPatch version 11.1.0.10.4. I installed the latest OPatch version 11.1.0.x and the installation of the PSU ended without any issues.
Enterprise Manager for OMS Plug-Ins 12.1.0.4.14¶
opatchauto apply -analyze command showed that I could install only 1 sub-patch out of 18.
Show
[oracle@mgmt 21415432]$ /u01/app/oracle/oms12/oms/OPatch/opatchauto apply -analyze -invPtrLoc /u01/app/oracle/oms12/oms/oraInst.loc OPatchAuto.OMS_DISABLE_HOST_CHECK=true
OPatch Automation Tool
Copyright (c) 2014, Oracle Corporation. All rights reserved.
OPatchauto version : 11.1.0.12.3
OUI version : 11.1.0.12.0
Running from : /u01/app/oracle/oms12/oms
Log file location : /u01/app/oracle/oms12/oms/cfgtoollogs/opatch/opatch2015-08-10_15-52-13PM_1.log
OPatchauto log file: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/21415432/opatch_oms_2015-08-10_15-52-16PM_analyze.log
Please enter OMS weblogic admin server URL(t3s://mgmt.localdomain:7102):>
Please enter OMS weblogic admin server username:> weblogic
Please enter OMS weblogic admin server password:>
WARNING: Sub-patch "19060193" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "19513319" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "19512418" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20466650" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20623942" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20950018" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20950277" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21167953" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21167965" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21167991" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21174690" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21185095" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324604" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324646" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324654" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324861" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324890" skipped for incompatibility with components installed in the OMS system.
Configuration Validation: Success
Running apply prerequisite checks for sub-patch(es) "21167573" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0/cfgtoollogs/opatch/21167573_Aug_10_2015_15_52_13/ApplyPrereq2015-08-10_15-53-08PM_2.log
Sub-patch(es) "21167573" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0"
Complete Summary
================
All log file names referenced below can be accessed from the directory "/u01/app/oracle/oms12/oms/cfgtoollogs/opatch/2015-08-10_15-52-13PM_SystemPatch_21415432_1"
Prerequisites analysis summary:
-------------------------------
The following sub-patch(es) are applicable:
Oracle Home Name Sub-patches Log file
---------------- ----------- --------
OraHome18 21167573 21167573_ApplyPrereq2015-08-10_15-53-08PM_2.log
The following sub-patches are incompatible with components installed in the OMS system:
19060193,19513319,19512418,20466650,20623942,20950018,20950277,21167953,21167965,21167991,21174690,21185095,21324604,21324646,21324654,21324861,21324890
--------------------------------------------------------------------------------
The following warnings have occurred during OPatchauto execution:
1) Sub-patch "19060193" skipped for incompatibility with components installed in the OMS system.
2) Sub-patch "19513319" skipped for incompatibility with components installed in the OMS system.
3) Sub-patch "19512418" skipped for incompatibility with components installed in the OMS system.
4) Sub-patch "20466650" skipped for incompatibility with components installed in the OMS system.
5) Sub-patch "20623942" skipped for incompatibility with components installed in the OMS system.
6) Sub-patch "20950018" skipped for incompatibility with components installed in the OMS system.
7) Sub-patch "20950277" skipped for incompatibility with components installed in the OMS system.
8) Sub-patch "21167953" skipped for incompatibility with components installed in the OMS system.
9) Sub-patch "21167965" skipped for incompatibility with components installed in the OMS system.
10) Sub-patch "21167991" skipped for incompatibility with components installed in the OMS system.
11) Sub-patch "21174690" skipped for incompatibility with components installed in the OMS system.
12) Sub-patch "21185095" skipped for incompatibility with components installed in the OMS system.
13) Sub-patch "21324604" skipped for incompatibility with components installed in the OMS system.
14) Sub-patch "21324646" skipped for incompatibility with components installed in the OMS system.
15) Sub-patch "21324654" skipped for incompatibility with components installed in the OMS system.
16) Sub-patch "21324861" skipped for incompatibility with components installed in the OMS system.
17) Sub-patch "21324890" skipped for incompatibility with components installed in the OMS system.
--------------------------------------------------------------------------------
OPatchauto Session completed with warnings.
Log file location: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/21415432/opatch_oms_2015-08-10_15-52-16PM_analyze.log
OPatchauto completed with warnings.
[oracle@mgmt 21415432]$
Most of the patches were skipped due to incompatibility checks:
WARNING: Sub-patch "21324890" skipped for incompatibility with components installed in the OMS system.
I searched through the MOS knowledge base and found a note: EM 12c: Applying a System Patch to the Enterprise Manager 12.1.0.4 Cloud Control OMS Oracle Home Fails at Analyze with Error: Sub-patch skipped for incompatibility with components installed in the OMS system (Doc ID 1921337.1). It said that:
Such incompatibility errors result from two scenarios:
Case 1:The Bundle Patch is comprised of patches for the OMS Oracle Home as well as Plug-in Homes. If one of these Plugins is not present in the environment, then these patches would be skipped automatically as they are not needed.
Case 2: If the plug-in is present but is of a lower version than the plug-in versions mentioned above, then such errors can also result.
Patch 21415432 (Enterprise Manager for OMS Plug-Ins 12.1.0.4.14) contains patches for the following list of plugins:
- Enterprise Manager for Cloud: 12.1.0.8.0
- Enterprise Manager for Fusion Middleware: 12.1.0.6.0
- Enterprise Manager for Oracle Database: 12.1.0.6.0
- Enterprise Manager for Fusion Applications: 12.1.0.6.0
- Enterprise Manager for Storage Management Framework: 12.1.0.4.0
- Enterprise Manager for Siebel: 12.1.0.5.0
- Enterprise Manager for Exadata : 12.1.0.6.0
- Enterprise Manager for Oracle Virtual Infrastructure: 12.1.0.1.0
- Enterprise Manager for Virtualization: 12.1.0.6.0
- Enterprise Manager for My Oracle Support: 12.1.0.6.0
- Enterprise Manager for Chargeback and Capacity Planning: 12.1.0.6.0
- Enterprise Manager for Apache Tomcat: 12.1.0.3.0
- Enterprise Manager for Oracle Database: 12.1.0.7.0
- Enterprise Manager for Storage Management Framework: 12.1.0.5.0
- Enterprise Manager for Cloud: 12.1.0.9.0
- Enterprise Manager for Fusion Middleware: 12.1.0.7.0
While keep reading the note: EM 12c: Applying a System Patch to the Enterprise Manager 12.1.0.4 Cloud Control OMS Oracle Home Fails at Analyze with Error: Sub-patch skipped for incompatibility with components installed in the OMS system (Doc ID 1921337.1), I found emcli commands which can be used to verify versions of plugins installed on OMS:
./emcli login -username=sysman
./emcli sync
./emcli list_plugins_on_server
I ran the commands above and identified that I had plugin versions which should be patched by Patch 21415432 (I highlighted only DB and SMF plugins because I wanted to fix them first):
OMS name is mgmt.localdomain:4889_Management_Service
Plug-in Name Plugin-id Version [revision]
Oracle Cloud Framework oracle.sysman.cfw 12.1.0.2.0
Oracle Database oracle.sysman.db 12.1.0.6.0
Oracle Fusion Middleware oracle.sysman.emas 12.1.0.6.0
Oracle MOS (My Oracle Support) oracle.sysman.mos 12.1.0.6.0
Oracle Storage Management Framework oracle.sysman.smf 12.1.0.4.0
Oracle Cloud Application oracle.sysman.ssa 12.1.0.8.0
Oracle Virtual Infrastructure oracle.sysman.vi 12.1.0.1.0
Oracle Virtualization oracle.sysman.vt 12.1.0.6.0
Oracle Exadata oracle.sysman.xa 12.1.0.6.0
I kept searching through MOS and found Bug 21287619 : OPATCHAUTO UNABLE TO IDENTIFY INSTALLED PLUGIN_HOME.
It was without any resolution but it provided some ideas for further investigations.
Firstly, I verified that I had correct plugin versions in PLUGIN_HOME:
[oracle@mgmt 21415432]$ ls -la /u01/app/oracle/oms12/plugins/
drwxr-xr-x 14 oracle oinstall 4096 Aug 4 15:05 .
drwxr-x--- 16 oracle oinstall 4096 Jul 11 2014 ..
drwxr-xr-x 2 oracle oinstall 4096 Aug 4 15:31 backup
drwxr-xr-x 12 oracle oinstall 4096 Jul 11 2014 oracle.sysman.cfw.oms.plugin_12.1.0.1.0
drwxr----- 14 oracle oinstall 4096 Aug 10 14:58 oracle.sysman.cfw.oms.plugin_12.1.0.2.0
drwxr-xr-x 18 oracle oinstall 4096 Aug 4 15:03 oracle.sysman.db.oms.plugin_12.1.0.6.0
drwxr-xr-x 18 oracle oinstall 4096 Jul 11 2014 oracle.sysman.emas.oms.plugin_12.1.0.6.0
drwxr-xr-x 13 oracle oinstall 4096 Jul 11 2014 oracle.sysman.mos.oms.plugin_12.1.0.6.0
drwxr-xr-x 12 oracle oinstall 4096 Jul 11 2014 oracle.sysman.smf.oms.plugin_12.1.0.4.0
drwxr-xr-x 14 oracle oinstall 4096 Jul 11 2014 oracle.sysman.ssa.oms.plugin_12.1.0.8.0
drwxr-xr-x 12 oracle oinstall 4096 Jul 11 2014 oracle.sysman.vi.oms.plugin_12.1.0.1.0
drwxr-xr-x 15 oracle oinstall 4096 Jul 11 2014 oracle.sysman.vt.oms.plugin_12.1.0.6.0
drwxr-xr-x 13 oracle oinstall 4096 Jul 11 2014 oracle.sysman.xa.oms.plugin_12.1.0.6.0
drwxr-xr-x 2 oracle oinstall 4096 Jul 11 2014 tmp
I reviewed opatch/opatchauto lspatches output:
[oracle@mgmt 21415432]$ opatch lspatches
20870437;ENTERPRISE MANAGER BASE PLATFORM - OMS 12.1.0.4.4 PSU (GENERIC)
[oracle@mgmt 21415432]$ opatchauto lspatches
OPatch Automation Tool
Copyright (c) 2014, Oracle Corporation. All rights reserved.
Oracle Home:/u01/app/oracle/oms12/oms
20870437;ENTERPRISE MANAGER BASE PLATFORM - OMS 12.1.0.4.4 PSU (GENERIC)
The following groups of patch(es) are applied as System Patch bundle(s):
20870437
For more details on installed patch(es) in platform, plugin homes, Please do "/u01/app/oracle/oms12/oms/OPatch/opatch lsinventory -details -oh <desired home path>".
opatch lsinv output:
Show
[oracle@mgmt 21415432]$ opatch lsinv
Oracle Interim Patch Installer version 11.1.0.12.7
Copyright (c) 2015, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/oms12/oms
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/oms12/oms/oraInst.loc
OPatch version : 11.1.0.12.7
OUI version : 11.1.0.12.0
Log file location : /u01/app/oracle/oms12/oms/cfgtoollogs/opatch/opatch2015-08-11_08-41-48AM_1.log
OPatch detects the Middleware Home as "/u01/app/oracle/oms12"
Lsinventory Output file location : /u01/app/oracle/oms12/oms/cfgtoollogs/opatch/lsinv/lsinventory2015-08-11_08-41-48AM.txt
--------------------------------------------------------------------------------
Installed Top-level Products (1):
EM Platform (OMS) 12.1.0.4.0
There are 1 products installed in this Oracle Home.
Interim patches (1) :
Patch 20870437 : applied on Mon Aug 10 15:19:39 MSK 2015
Unique Patch ID: 18978384
Patch description: "ENTERPRISE MANAGER BASE PLATFORM - OMS 12.1.0.4.4 PSU (GENERIC)"
Created on 2 Jul 2015, 03:07:25 hrs PST8PDT
Bugs fixed:
20010360, 20346629, 18599481, 19459173, 20646440, 18830050, 18244680
19614772, 20492788, 18932882, 19355307, 20263906, 20556489, 20106145
14301574, 18721562, 19328391, 19535114, 19861538, 19794113, 19604817
20596437, 19892848, 19218456, 19978077, 18505219, 17843191, 20345612
20748748, 20024779, 18256983, 19329809, 19300103, 17987955, 18351725
18903783, 19430853, 19845101, 20870437, 20223681, 20019184, 20263188
19069940, 19861412, 19136663, 18446798, 19474685, 18765545, 18038059
17783148, 18041873, 19509780, 19030447, 20933667, 19574756, 19258481
18938561, 17812648, 20377474, 19572261, 18945007, 20307428, 18388324
19500609, 17991694, 19137411, 19474929, 19592446, 18710124, 20536095
19352118, 19557054, 18726708, 19595813, 19170861, 19685443, 18353162
19289270, 19367214, 18906451, 19458672, 20284029, 18490444, 19766881
18509136, 20739088, 19511544, 18695961, 19812966, 20576148, 20623258
19055251, 20260177, 19323634, 19941819, 18725891, 19824587, 19780847
18359621, 19393211, 19211048, 20505155, 18476364, 18490468, 18247849
19071602, 19068674, 18490455, 19524568, 19061168, 19077861, 20031287
18756725, 19281252, 18977955, 18521731, 18485889, 19775544, 18900197
17834366, 20460507, 19545505, 19823996, 20645335, 20633770, 17407918
18706824, 20568225, 18805935, 19376082, 19146514, 18490432, 19694744
18230284, 18726208, 20044313, 18516298, 20642633, 18999400, 20692416
20392036, 19362386, 19452280, 18356966, 20617058, 19055979, 19830994
20030493, 19823761, 18834216, 19196979, 19785223, 18389542
--------------------------------------------------------------------------------
OPatch succeeded.
I found the answer in inventory.xml from the Central Inventory:
<HOME NAME="oms12c1" LOC="/u01/app/oracle/oms12/oms" TYPE="O" IDX="3">
<REFHOMELIST>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.4.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.xa.oms.plugin_12.1.0.4.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.emas.oms.plugin_12.1.0.4.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.mos.oms.plugin_12.1.0.5.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/jdk16"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.vt.oms.plugin_12.1.0.5.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.ssa.oms.plugin_12.1.0.6.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.2.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.ssa.oms.plugin_12.1.0.7.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.3.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sun.oss7.oms.plugin_12.1.0.4.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.emas.oms.plugin_12.1.0.5.0"/>
<REFHOME LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0"/>
</REFHOMELIST>
</HOME>
Notice, that inventory.xml contains old plugin versions!
It is difficult to say what exactly led to a such behaviour, and I did not have enough time for further research.
It was enough for me to find that inventory.xml does not contain actual plugin versions.
Example 1: oracle.sysman.smf.oms.plugin (Storage Management Framework).
emcli list_plugins_on_server shows version 12.1.0.4:
Oracle Storage Management Framework oracle.sysman.smf 12.1.0.4.0
Whereas inventory.xml contains information about versions 12.1.0.2/12.1.0.3 (not 12.1.0.4):
<HOME NAME="OraHome13" LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.2.0" TYPE="O" IDX="24" PLUGIN="T">
<HOME NAME="OraHome16" LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.3.0" TYPE="O" IDX="29" PLUGIN="T">
Patch 21415432 has fixes for the SMF plugin versions 12.1.0.4/12.1.0.5.
Example 2: oracle.sysman.db.oms.plugin (Database Plugin).
emcli list_plugins_on_server shows version 12.1.0.6:
Oracle Database oracle.sysman.db 12.1.0.6.0
Whereas inventory.xml contains information about versions 12.1.0.4/12.1.0.5 (not 12.1.0.6.0):
<HOME NAME="oracle_sysman_db11" LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.4.0" TYPE="O" IDX="4" PLUGIN="T">
<HOME NAME="OraHome15" LOC="/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0" TYPE="O" IDX="28" PLUGIN="T">
Patch 21415432 has fixes for the Database Plugin versions 12.1.0.6/12.1.0.7.
Due to such inconsistencies opatch reported a message like below:
WARNING: Sub-patch "19060193" skipped for incompatibility with components installed in the OMS system.
I decided to recover lost inventory entities using this note: EM 12c: How to Recover a Lost Inventory Record for the Enterprise Manager 12.1.0.1 Cloud Control OMS and Management Agent (Doc ID 1480237.1)
GOAL
In the case that recovering a lost inventory record may be necessary, this note describes how to accomplish this for the Enterprise Manager 12.1.0.1 Cloud Control OMS and Management Agent.
First of all, I had to take a backup of the Central and local inventories, and ORACLE_HOME of OMS.
8 plugins out of 9 total did not have an actual version in inventory.xml.
For each of them, I executed steps from the note: EM 12c: How to Recover a Lost Inventory Record for the Enterprise Manager 12.1.0.1 Cloud Control OMS and Management Agent (Doc ID 1480237.1).
Let me remind that before my actions only 1 sub-patch out of 18 could be applied to the OMS.
And after executing the actions, opatchauto analyze showed that 9 sub-patches from 18 could be applied to the OMS.
Bingo!
OMS Plug-Ins patches contains fixes for 2 versions of each plugin. And only one of them was installed in my environment.
Show
[oracle@mgmt 21415432]$ /u01/app/oracle/oms12/oms/OPatch/opatchauto apply -analyze -invPtrLoc /u01/app/oracle/oms12/oms/oraInst.loc OPatchAuto.OMS_DISABLE_HOST_CHECK=true
OPatch Automation Tool
Copyright (c) 2014, Oracle Corporation. All rights reserved.
OPatchauto version : 11.1.0.12.3
OUI version : 11.1.0.12.0
Running from : /u01/app/oracle/oms12/oms
Log file location : /u01/app/oracle/oms12/oms/cfgtoollogs/opatch/opatch2015-08-11_17-13-05PM_1.log
OPatchauto log file: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/21415432/opatch_oms_2015-08-11_17-13-08PM_analyze.log
Please enter OMS weblogic admin server URL(t3s://mgmt.localdomain:7102):>
Please enter OMS weblogic admin server username:> weblogic
Please enter OMS weblogic admin server password:>
WARNING: Sub-patch "19512418" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20466650" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "20950277" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21167965" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21185095" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324604" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324646" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324654" skipped for incompatibility with components installed in the OMS system.
WARNING: Sub-patch "21324861" skipped for incompatibility with components installed in the OMS system.
Configuration Validation: Success
Running apply prerequisite checks for sub-patch(es) "21324890" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.vi.oms.plugin_12.1.0.1.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.vi.oms.plugin_12.1.0.1.0/cfgtoollogs/opatch/21324890_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-13-58PM_2.log
Sub-patch(es) "21324890" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.vi.oms.plugin_12.1.0.1.0"
Running apply prerequisite checks for sub-patch(es) "21167573" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0/cfgtoollogs/opatch/21167573_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-01PM_2.log
Sub-patch(es) "21167573" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.cfw.oms.plugin_12.1.0.2.0"
Running apply prerequisite checks for sub-patch(es) "21174690" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.6.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.6.0/cfgtoollogs/opatch/21174690_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-03PM_2.log
Sub-patch(es) "21174690" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.db.oms.plugin_12.1.0.6.0"
Running apply prerequisite checks for sub-patch(es) "21167953" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.xa.oms.plugin_12.1.0.6.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.xa.oms.plugin_12.1.0.6.0/cfgtoollogs/opatch/21167953_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-06PM_2.log
Sub-patch(es) "21167953" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.xa.oms.plugin_12.1.0.6.0"
Running apply prerequisite checks for sub-patch(es) "19060193" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.vt.oms.plugin_12.1.0.6.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.vt.oms.plugin_12.1.0.6.0/cfgtoollogs/opatch/19060193_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-09PM_2.log
Sub-patch(es) "19060193" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.vt.oms.plugin_12.1.0.6.0"
Running apply prerequisite checks for sub-patch(es) "20950018" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.emas.oms.plugin_12.1.0.6.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.emas.oms.plugin_12.1.0.6.0/cfgtoollogs/opatch/20950018_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-11PM_2.log
Sub-patch(es) "20950018" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.emas.oms.plugin_12.1.0.6.0"
Running apply prerequisite checks for sub-patch(es) "20623942" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.ssa.oms.plugin_12.1.0.8.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.ssa.oms.plugin_12.1.0.8.0/cfgtoollogs/opatch/20623942_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-14PM_2.log
Sub-patch(es) "20623942" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.ssa.oms.plugin_12.1.0.8.0"
Running apply prerequisite checks for sub-patch(es) "19513319" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.4.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.4.0/cfgtoollogs/opatch/19513319_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-17PM_2.log
Sub-patch(es) "19513319" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.smf.oms.plugin_12.1.0.4.0"
Running apply prerequisite checks for sub-patch(es) "21167991" and Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.mos.oms.plugin_12.1.0.6.0"...
Please monitor OPatch log file: /u01/app/oracle/oms12/plugins/oracle.sysman.mos.oms.plugin_12.1.0.6.0/cfgtoollogs/opatch/21167991_Aug_11_2015_17_13_05/ApplyPrereq2015-08-11_17-14-19PM_2.log
Sub-patch(es) "21167991" are successfully analyzed for Oracle Home "/u01/app/oracle/oms12/plugins/oracle.sysman.mos.oms.plugin_12.1.0.6.0"
Complete Summary
================
All log file names referenced below can be accessed from the directory "/u01/app/oracle/oms12/oms/cfgtoollogs/opatch/2015-08-11_17-13-05PM_SystemPatch_21415432_1"
Prerequisites analysis summary:
-------------------------------
The following sub-patch(es) are applicable:
Oracle Home Name Sub-patches Log file
---------------- ----------- --------
oracle_home_MOS_12_1_0_6_0 21167991 21167991_ApplyPrereq2015-08-11_17-14-19PM_2.log
oracle_home_Oracle_Fusion_Middleware_12_1_0_6_0 20950018 20950018_ApplyPrereq2015-08-11_17-14-11PM_2.log
oracle_home_OV_12_1_0_6_0 19060193 19060193_ApplyPrereq2015-08-11_17-14-09PM_2.log
OraHome18 21167573 21167573_ApplyPrereq2015-08-11_17-14-01PM_2.log
oracle_home_OVI_12_1_0_1_0 21324890 21324890_ApplyPrereq2015-08-11_17-13-58PM_2.log
oracle_home_OE_12_1_0_6_0 21167953 21167953_ApplyPrereq2015-08-11_17-14-06PM_2.log
oracle_home_OCA_12_1_0_8_0 20623942 20623942_ApplyPrereq2015-08-11_17-14-14PM_2.log
oracle_home_Oracle_Database_12_1_0_6_0 21174690 21174690_ApplyPrereq2015-08-11_17-14-03PM_2.log
oracle_home_SMF_12_1_0_4_0 19513319 19513319_ApplyPrereq2015-08-11_17-14-17PM_2.log
The following sub-patches are incompatible with components installed in the OMS system:
19512418,20466650,20950277,21167965,21185095,21324604,21324646,21324654,21324861
--------------------------------------------------------------------------------
The following warnings have occurred during OPatchauto execution:
1) Sub-patch "19512418" skipped for incompatibility with components installed in the OMS system.
2) Sub-patch "20466650" skipped for incompatibility with components installed in the OMS system.
3) Sub-patch "20950277" skipped for incompatibility with components installed in the OMS system.
4) Sub-patch "21167965" skipped for incompatibility with components installed in the OMS system.
5) Sub-patch "21185095" skipped for incompatibility with components installed in the OMS system.
6) Sub-patch "21324604" skipped for incompatibility with components installed in the OMS system.
7) Sub-patch "21324646" skipped for incompatibility with components installed in the OMS system.
8) Sub-patch "21324654" skipped for incompatibility with components installed in the OMS system.
9) Sub-patch "21324861" skipped for incompatibility with components installed in the OMS system.
--------------------------------------------------------------------------------
OPatchauto Session completed with warnings.
Log file location: /u01/app/oracle/oms12/oms/cfgtoollogs/opatchauto/21415432/opatch_oms_2015-08-11_17-13-08PM_analyze.log
OPatchauto completed with warnings.
The further installation was ended without any issues.