Friday, October 4, 2019

JCS backup failing

Another case of failed backup on JCS,

Oct 2, 2019 12:17:29 AM UTC Activity Submitted
Oct 2, 2019 12:17:29 AM UTC Activity Started
Oct 2, 2019 12:17:47 AM UTC PSM-BKP-50095: Operation execution was abborted or it has crashed possibly due to script execution error or lack of space for capturing script output. If the problem persists, contact Oracle Support Services.
Oct 2, 2019 12:19:58 AM UTC PSM-BKP-50106: Operation failed and will be retried.
Oct 2, 2019 12:25:18 AM UTC PSM-BKP-50095: Operation execution was abborted or it has crashed possibly due to script execution error or lack of space for capturing script output. If the problem persists, contact Oracle Support Services.
Oct 2, 2019 12:27:29 AM UTC PSM-BKP-50106: Operation failed and will be retried.
Oct 2, 2019 12:32:48 AM UTC PSM-BKP-50095: Operation execution was abborted or it has crashed possibly due to script execution error or lack of space for capturing script output. If the problem persists, contact Oracle Support Services.
Oct 2, 2019 12:32:48 AM UTC Activity Ended

The reason was file system was full!

Dbaas credential update failed

So, we got a new customer and some consultant used his email/password to setup dbaas backup. So, we got a standard backup user created. When i tried updating from IDD console i got,

Sep 26, 2019 6:21:36 AM UTC    Activity Submitted
Sep 26, 2019 6:21:41 AM UTC    Activity Started
Sep 26, 2019 6:21:41 AM UTC    Resetting service credentials, updating the cloud storage password for Service Type DBaaS and Service id : ADB-DATAMART-TEST-DBCS
Sep 26, 2019 6:21:41 AM UTC    Initialization of Backup Config update operation.
Sep 26, 2019 6:21:41 AM UTC    Submitting update config command for vm instance : [ADB-DATAMART-TEST-DBCS]
Sep 26, 2019 6:21:42 AM UTC    DBaaS Tools version in Service Instance [ADB-DATAMART-TEST-DBCS] is an old version [18.2.3.1.0], please consider updating it.
Sep 26, 2019 6:21:44 AM UTC    Backup Config update operation in progress.
Sep 26, 2019 6:36:56 AM UTC    Backup Config update failed due to timeout within [15] minutes.
Sep 26, 2019 6:36:59 AM UTC    Failed to reset cloud storage credential, try again! Error message: Failed cloud storage credential reset for DBaaS service : ADB-DATAMART-TEST-DBCS
Sep 26, 2019 6:36:59 AM UTC    Activity Ended


I used this to update,
https://docs.oracle.com/en/cloud/paas/database-dbaas-cloud/csdbi/update-storage-container-password.html


# rpm -qa|grep -i dbaastools
dbaastools-version_number-release_number

dbaascli patch tools list

dbaascli patch tools apply --patchid LATEST 

# /var/opt/oracle/ocde/assistants/bkup/bkup