Page MenuHomePhabricator

Finalize the dev and prod k8s gitlab runners configuration
Closed, ResolvedPublic

Description

The argocd-apps setup is finalized

  • Deploy runner in dev with the new config
  • Deploy runner in prod with the new config

Event Timeline

This.chris.corriere changed the task status from Open to In Progress.Dec 1 2025, 11:41 AM

Notes from chat:

  1. Finalize gitlab runner configuration to handle the concurrency required by the existing pipeline builds happening on ECS fargate.

A few other checks such as failed task cleanup and garbage dump of the pods should work as expected. Memory spec should be pipeline specific instead of changing runner configuration.

  1. Deploy the runner for production
  2. Start migrating pipelines for existing services first, APIs later

dags
content-integrity
commons

test-dags-import pipeline succeeded on MR in pipeline-test.

working to get an EKS gitlab runner deployed to production.
Remaining steps to deploy the runner to prod:

  • the existing eks runner Argocd app is not templated completely, It should read configurable values from values-wme-eks-<env>.yaml
  • we have to rename the runner tags appropriately for dev
  • For production, a separate runner registration token is required

The upcoming wikidata deployment will use the existing ECS runners instead of the EKS runners.

initial MR for eks runner app templates has been submitted

I was able to run a dags-check on both dv and pr eks runners in the pipeline-test project

Naike closed this task as Resolved.
Naike moved this task from In Progress to Done on the Wikimedia Enterprise (WME Kanban) board.