While working on upgrading django for wikilink, @Scardenasmolinar discovered serveral issues with our backups, which need to be resolved:
- backup volume full:
- existing backups transfered out
- backup volume detached and deleted
- new backup volume created, attached, formatted, mounted
- backups successfully writing to disk
- failing backups
- retry every 5 minutes, failing cron jobs should have backoff logic on failure: https://github.com/WikipediaLibrary/externallinks/pull/286
- get string output from backup script: https://github.com/WikipediaLibrary/externallinks/commit/be999e491a6263c5bea5c43dd43f587c0e76b0df
- backup schedule & retention https://github.com/WikipediaLibrary/externallinks/pull/296
- backup every other day instead of daily
- retain backups 14 days instead of 30