Installation Manual - 57 OADP scheduled backup validation

Accelerated scheduled OADP backup validation for hub-dc-v7 and spoke-dc-v7, followed by schedule restoration.

This chapter records the scheduled OADP backup validation for hub-dc-v7 and spoke-dc-v7. The original first daily backup windows were still several hours away, so the schedules were temporarily moved forward through GitOps, validated, and restored immediately after the backups completed.

Governance

FieldValue
IssueOP-GF-VAULTRECOVERY-1 / #389
MilestoneWorkspace Governance
ADRADR 0028: Greenfield Vault Replacement After Custody Loss
Existing controlsADR 0016 and ADR 0025

Temporary Schedule Change

The bootstrap VM clock was used to choose near-future UTC schedule windows:

ClusterTemporary cronExpected run
hub-dc-v735 22 * * *2026-05-17T22:35:00Z
spoke-dc-v745 22 * * *2026-05-17T22:45:00Z

GitOps commit:

03ef274 Temporarily accelerate v7 OADP schedules

The bootstrap clone was fast-forwarded and Argo CD was hard-refreshed. The hub bootstrap app, hub-side spoke app, and spoke-local app all reached Synced/Healthy at 03ef274 before the scheduled runs.

Backup Results

ClusterBackupPhaseItemsWarningsErrors
hub-dc-v7platform-resource-daily-20260517223546Completed10263/10263nonenone
spoke-dc-v7platform-resource-daily-20260517224523Completed15876/15876nonenone

The backup timestamps were:

ClusterStartedCompleted
hub-dc-v72026-05-17T22:35:46Z2026-05-17T22:36:14Z
spoke-dc-v72026-05-17T22:45:23Z2026-05-17T22:45:54Z

Object Store Validation

MinIO validation used the stored OADP backup user credential without printing secret values.

ClusterPrefixObjects
hub-dc-v7hub-dc-v7/general/backups/platform-resource-daily-2026051722354612
spoke-dc-v7spoke-dc-v7/general/backups/platform-resource-daily-2026051722452312

Both backup prefixes contained the Velero backup archive and velero-backup.json.

Schedule Restoration

The temporary change was reverted immediately after validation.

GitOps commit:

9fa0424 Restore v7 OADP daily schedules

Final live schedules:

ClusterRestored cron
hub-dc-v715 2 * * *
spoke-dc-v745 2 * * *

Argo CD reached Synced/Healthy at 9fa0424 for the same three checked apps.

Final State

ClusterOpenShiftClusterOperatorsBSLVeleroRestoresDeleteBackupRequests
hub-dc-v74.20.18steadyAvailable1/1nonenone
spoke-dc-v74.20.18steadyAvailable1/1nonenone

Operational Notes

The scheduled backups are broad resource-only backups across all namespaces. Do not run an uncontrolled full-cluster restore from these backups on the live clusters. The next validation should use a controlled namespace-scoped restore pattern.

Actions Not Taken

  • No Restore object was created.
  • No Backup object was manually created.
  • No Backup object or MinIO prefix was deleted.
  • No stable Vault DNS cutover was made.
  • No old Vault mutation was made.
  • No secret values were printed.

Next Action

Run a governed restore validation drill using a controlled namespace-scoped restore.