Page MenuHomePhabricator

Export xLab as static configs for disaster recovery
Closed, DeclinedPublic3 Estimated Story Points

Description

Epic: T360736

Description

Export the Metrics Platform Instrument Configurator (MPIC) configurations as static config in the event that the dse-k8s cluster fails.

Per design doc:

There is a non-zero chance that the cluster the app is running in could fail catastrophically. There is a lower (but still non-zero) chance that the Data Products MariaDB instance (https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Analytics_Meta) could fail catastrophically.

The dump_instrument_configurations script will export the current instrument configurations to a format compatible with the static configuration scripts in operations/mediawiki-config. The script will be run weekly and its output will be captured in a text file in the Metrics Platform shared GDrive.

Acceptance Criteria

  • Periodic dumps of MPIC configs are run regularly and saved to MP GDrive

Required

  • Unit/Integration tests?
  • Documentation?
  • Passed QA?

Event Timeline

Sfaci updated the task description. (Show Details)
Sfaci removed Sfaci as the assignee of this task.Aug 15 2024, 11:05 AM
Sfaci subscribed.
Sfaci renamed this task from Export MPIC as static configs for disaster recovery to Export xLab as static configs for disaster recovery.Sep 25 2025, 11:47 AM
Milimetric subscribed.

We believe the design of such a recovery system will change significantly with Growthbook (and potentially Kafka) in the picture.