Page MenuHomePhabricator

Experiment with WMCS as a k8s provider for gitlab-cloud-runner cluster
Open, Needs TriagePublic

Description

At the December 2023 DevEx offsite some folks from WMCS showcased to the group how Cloud VPS OpenStack resources including Magnum can be managed via OpenTofu (Terraform fork). We (some members of RelEng, WMCS, QTE) discussed as a group the benefits and drawbacks to using in-house cloud resources vs. those of a third-party like DigitalOcean and came to the conclusion that it would be worthwhile to experiment with running the gitlab-cloud-runner cluster on Magnum.

The gitlab-cloud-runner cluster is already managed via TF and the digitalocean parts are isolated to a module. This should make experimenting with an alternative platform fairly straightforward. Let's see what it would take to implement a wmcs module and unify the two interfaces (module inputs and outputs).

Event Timeline

@dduvall we've added this task to the current cloud-services-team goals [1]. In practice, it only means we are less likely to forget about it and more likely to help you if you find some bugs. :) We are very interested in your feedback and please open sub-tasks if you find things that don't work or can be improved!

[1] https://www.mediawiki.org/wiki/Wikimedia_Cloud_Services_team/goals/2023-24

releng people, still have interest in this? I still do :)

T372498: Figure out how to provision a Kubernetes cluster using Magnum and OpenTofu is semi-related work in that it is attempting to create a gitops system for working with Magnum and related things. If and when we have that working it would be possible to carry on with other deployments.

releng people, still have interest in this? I still do :)

Interested! As far as priority goes, I'm not sure at the moment. Perhaps next quarter?