Page MenuHomePhabricator

Move datahub to dse-k8s cluster
Open, MediumPublic

Description

[WIP]
Datahub is currently hosted on the wikiKube cluster and we would like to move it to the dse-k8s cluster. This task is to track any and all work related to the move.

  • Preferably ensure we are on v0.12.1 pending the move to Java 17 before further upgrades T361688 T355211
  • Provision staging and production namespaces on dse-k8s T363298
  • Move datahub and datahub-staging helfile deployments to dse-k8s T363300
  • Add kubaedm config files for the namespaces
  • Ensure the egress rules are compatible with dse-k8s cluster
  • Ensure datahub.wikimedia.org points to dse-k8s ingress
  • deploy datahub (next and prod) to dse-k8s-eqiad
  • change pybal datahub to be eqiad only (instead of eqiad/codfw)
  • remove datahub/codfw records
  • create Internal service DNS record for datahub pointing to dse-k8s T363299
  • Monitor the availability of datahub deployment on dse-k8s T363301
  • Create saved views for datahub deployment logs on dse-k8s T363304
  • Adapt datahub Puppet service to point to the eqiad datacenter only T363450

Event Timeline