KBHS-00712: ORA-29024 received from local HTTP service during backup in RAC Oracle cloud

The backup of Oracle RAC DBaaS may fail during manual as well automatic backup.
If you manually invoke following command,The backup may not get successful.
Login to opc.
[opc@pocracdemo1 ~]$ raccli describe job 17
{
  “requestStatus” : “SUCCESS”,
  “jobStatus” : “FAILURE”,
  “message” : “Failed to run Rman Backup statement.”,
  “response” : [ {
    “startTime” : “Fri Apr 13 03:28:23 UTC 2018”,
    “endTime” : “Fri Apr 13 03:28:24 UTC 2018”,
    “status” : “SUCCESS”,
    “taskId” : “TaskZJsonRpcExt_2851”,
    “taskResult” : “backup validations done successfully”,
    “taskName” : ” backup validations”
  }, {
    “startTime” : “Fri Apr 13 03:28:24 UTC 2018”,
    “endTime” : “Fri Apr 13 03:28:49 UTC 2018”,
    “status” : “SUCCESS”,
    “taskId” : “TaskZJsonRpcExt_2853”,
    “taskResult” : “DB backup validations done successfully”,
    “taskName” : ” db backup validations”
  }, {
    “startTime” : “Fri Apr 13 03:28:49 UTC 2018”,
    “endTime” : “Fri Apr 13 03:29:07 UTC 2018”,
    “status” : “SUCCESS”,
    “taskId” : “TaskZJsonRpcExt_2855”,
    “taskName” : “cross check database backup”
  }, {
    “startTime” : “Fri Apr 13 03:29:07 UTC 2018”,
    “endTime” : “Fri Apr 13 03:29:57 UTC 2018”,
    “status” : “FAILURE“,
    “taskId” : “TaskZJsonRpcExt_2857”,
    “taskResult” : “Failed to run Rman Backup statement.”,
    “taskName” : “Database Backup”
  } ]
}
Now you need to check RMAN log for exact error:-

tail -100f  /home/oracle/bkup/logs/rman/rman_2018-04-13_02-16-15.0242.log

Starting backup at 04/13/2018 02:16:21
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of backup command at 04/13/2018 02:16:21
ORA-19554: error allocating device, device type: SBT_TAPE, device name:
ORA-27023: skgfqsbi: media manager protocol error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
KBHS-00715: HTTP error occurred ‘oracle-error’
KBHS-00712: ORA-29024 received from local HTTP service

Recovery Manager complete.

Solution:-
Please refer to below metalink note:-
RMAN Backup to Oracle Database Backup Cloud Service fails with KBHS-00715 ORA-29024 (Doc ID 2360941.1)
Till the bug is fixed, below workaround can be used:
1. Set below parameter in the config file (opcPROD.ora) and retry backup:

vi /u02/app/oracle/admin/orcl/oss_config/opc_orcl.ora

_OPC_VALIDATE_CERT=TRUE

2. If above does not help, re-install the cloud backup module with -trustedCerts option and provide opc.cert file attached in this document i.e.
You need to download opc.cert and opc_install.jar mentioned in above metalink note (Doc ID 2360941.1)
[oracle@pocracdemo1 ~]$ java -jar opc_install.jar -host https://xxx.eu.storage.oraclecloud.com/v1/Storage-xxx -opcId 'xxx@gmail.com' -opcPass 'xxx' -walletDir /home/oracle/opc_wallet -libDir $ORACLE_HOME/lib -libPlatform linux64 -debug -trustedCerts /home/oracle/opc.cert
Oracle Database Cloud Backup Module Install Tool, build 12.2.0.1.0DBBKPCSBP_2017-11-28
Debug: os.name        = Linux
Debug: os.arch        = amd64
Debug: os.version     = 4.1.12-112.14.10.el6uek.x86_64
Debug: file.separator = /
Debug: Platform = PLATFORM_LINUX64
Debug: OPC Account Verification: <?xml version=”1.0″ encoding=”UTF-8″ standalone=”yes”?><account name=”Storage-62b84aec8de8478ba17a6e1f84c3475c”><container><name>DBaaS</name><count>1</count><bytes>279552</bytes><accountId><id>31714</id></accountId><deleteTimestamp>0.0</deleteTimestamp><containerId><id>7665965</id></containerId></container></account>
Oracle Database Cloud Backup Module credentials are valid.
Debug: Certificate Success: file = /home/oracle/opc.cert
Debug: Certificate Success:
       Subject  : CN=DigiCert Global Root CA, OU=www.digicert.com, O=DigiCert Inc, C=US
       Validity : Fri Nov 10 00:00:00 UTC 2006 – Mon Nov 10 00:00:00 UTC 2031
       Issuer   : CN=DigiCert Global Root CA, OU=www.digicert.com, O=DigiCert Inc, C=US
Oracle Database Cloud Backup Module wallet created in directory /home/oracle/opc_wallet.
Oracle Database Cloud Backup Module initialization file /u01/app/oracle/product/12.2.0.1/dbhome_1/dbs/opcorcl1.ora created.
Downloading Oracle Database Cloud Backup Module Software Library from file opc_linux64.zip.
Debug: Temp zip file = /tmp/opc_linux646570785615594303284.zip
Debug: Downloaded 27314069 bytes in 4 seconds.
Debug: Transfer rate was 6828517 bytes/second.
Download complete.
Debug: Delete RC = true
After that,I faced another issue:-
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
KBHS-01404: See trace file /u01/app/oracle/product/12.1.0/dbhome_1/rdbms/log/sbtio_8654_139790089015904.log for details
KBHS-00719: Error ‘unknown’; You are not allowed to perform a tagging operation on a container that has objects in it, accountName:
KBHS-00700
Recovery Manager complete.
Solution :-
Metalink note:-Backup fails with error ‘KBHS-00719: ERROR ‘UNKNOWN’; YOU ARE NOT ALLOWED TO PERFORM A TAGGING OPERATION’ (Doc ID 2371818.1)
Empty the container by moving the existing files in a different one before taking the first RMAN backup, or just create a new empty container and update the opc parameter file to point to it.
Now the backup succeeds

[opc@pocracdemo1 ~]$ raccli describe job 20

{
“requestStatus” : “SUCCESS”,
“jobStatus” : “SUCCESS”,
“response” : [ {
“startTime” : “Fri Apr 13 06:39:39 UTC 2018”,
“endTime” : “Fri Apr 13 06:39:39 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3885”,
“taskResult” : “backup validations done successfully”,
“taskName” : ” backup validations”
}, {
“startTime” : “Fri Apr 13 06:39:39 UTC 2018”,
“endTime” : “Fri Apr 13 06:40:04 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3887”,
“taskResult” : “DB backup validations done successfully”,
“taskName” : ” db backup validations”
}, {
“startTime” : “Fri Apr 13 06:40:04 UTC 2018”,
“endTime” : “Fri Apr 13 06:41:08 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3889”,
“taskName” : “cross check database backup”
}, {
“startTime” : “Fri Apr 13 06:41:08 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:29 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3891”,
“taskResult” : “Resource { id: 97761124902577, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Database Backup”
}, {
“startTime” : “Fri Apr 13 06:49:29 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskParallel_3893”,
“taskName” : “DB Config files backup”
}, {
“startTime” : “Fri Apr 13 06:49:29 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3894”,
“taskResult” : “Resource { id: 98261108067814, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “DB config files backup on node_1”
}, {
“startTime” : “Fri Apr 13 06:49:29 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3896”,
“taskResult” : “Resource { id: 97712211539712, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “DB config files backup on node_2”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:45 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskParallel_3899”,
“taskName” : “GI Config files backup”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:45 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskParallel_3904”,
“taskName” : “OS Config files backup”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:38 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3900”,
“taskResult” : “Resource { id: 98265677604650, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Gi config files backup on node_1”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:41 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3905”,
“taskResult” : “Resource { id: 98269544616295, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Os config files backup on node_1”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:48 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskParallel_3909”,
“taskName” : “Derby DB files backup”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:42 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3902”,
“taskResult” : “Resource { id: 97721137057959, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Gi config files backup on node_2”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:45 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3907”,
“taskResult” : “Resource { id: 97725142391225, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Os config files backup on node_2”
}, {
“startTime” : “Fri Apr 13 06:49:33 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:42 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3910”,
“taskResult” : “Resource { id: 98272448241014, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Derby Db config files backup on node_1”
}, {
“startTime” : “Fri Apr 13 06:49:41 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:48 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3912”,
“taskResult” : “Resource { id: 97728013660122, name: rdbaas_backupComponent, type: BackupComponent }”,
“taskName” : “Derby Db config files backup on node_2”
}, {
“startTime” : “Fri Apr 13 06:49:48 UTC 2018”,
“endTime” : “Fri Apr 13 06:49:48 UTC 2018”,
“status” : “SUCCESS”,
“taskId” : “TaskZJsonRpcExt_3914”,
“taskResult” : “Resource { id: 98279542295230, name: dcs_backup, type: Backu p }”,
“taskName” : “Persisting Backup metadata”
} ]
}

 

 

 

 

 

 

Leave a Reply

Your email address will not be published. Required fields are marked *