Some analytics_meta databases are not being backed up
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	jcrespo
	Feb 4 2025, 12:00 PM

Description

Backup definition and actual database contents drift. The following dbs are not configured to be backed up:

airflow_platform_eng_v2
database
datahub_temp
mpic_production
mpic_staging
oozie
percona
superset_staging

Some of them may be on purpose/mistakes but some could be unexpected.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	dbbackups: Add mpic_production and mpic_staging to scheduled backups	operations/puppet	production	+23 -0

Customize query in gerrit

Event Timeline

jcrespo created this task.Feb 4 2025, 12:00 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 4 2025, 12:00 PM

I compared ground truth to the definition on puppet:

https://phabricator.wikimedia.org/source/operations-puppet/browse/production/modules/profile/templates/mariadb/grants/dumps-eqiad-analytics_meta.sql.erb

jcrespo added a subscriber: BTullis.Feb 4 2025, 12:10 PM

Please could we add mpic_production and mpic_staging to the backup schedule? The rest are fine to omit from the backups. Thanks.

Please could we add mpic_production and mpic_staging to the backup schedule?

Sure! I just wanted to make sure you decided which ones were and were not backed up.

I can see that "oozie" db was added to backups (deployed) but not documented. Should I remove it from backups?

@BTullis ^

Change #1117187 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add mpic_production and mpic_staging to scheduled backups

https://gerrit.wikimedia.org/r/1117187

gerritbot added a project: Patch-For-Review.Feb 4 2025, 1:09 PM

@BTullis ^ See my question regarding the oozie db.

@jcrespo apologies for the delay, the team is at an offsite at the moment. Oozie isn't is used anymore, meaning that we can indeed remove it from backups. Thanks again!

Thank you, I wasn't aware of the offsite. Will merge and deploy https://gerrit.wikimedia.org/r/1117187 as is.

Mentioned in SAL (#wikimedia-operations) [2025-02-05T14:43:50Z] <jynus> deploy new grants to analytics_meta T385565

Backup configured and ran successfully:

In T385565#10525320, @jcrespo wrote:

@BTullis ^ See my question regarding the oozie db.

Apologies for the delay. Yes, please remove oozie from the database backups. It is now defunct and I will remove it from the source database servers soon. Thanks.

Change #1117187 merged by Jcrespo: