Page MenuHomePhabricator

Publish updated wmf/next container when deploying config backport or security patch
Closed, ResolvedPublicFeature

Description

Adopt the behavior described in the design agreements that came out of T379683: [FY24-25 WE6.2.6] Create design document for Pretrain (née Group -1) deployment.

Deployment of both MediaWiki configuration (operations/mediawiki-config.git) and security patches done via scap from a deployment server will also trigger new pretrain deployments. These deployments will not happen in-process with the other wiki updates. Instead they will trigger an asynchronous build and deployment workflow. We may choose to de-duplicate triggering events so that we only deploy pretrain once as the result of a typical backport or security window.

This first step is only concerned with publishing an updated container. We will be working on actually deploying this container in a future hypothesis.

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
config.py: Reenable build_mw_next_container_imagerepos/releng/scap!936dancymaster-Iea03955c84676a9bac90b9dc00b4af385409e72amaster
kubernetes: Use separate image repo for single version image buildrepos/releng/scap!935dancymaster-I2107eb9d4c1e5eee389662547598eec702ff3169master
config.py: Disable build_mw_next_container_imagerepos/releng/scap!929dancymaster-I6cff04283e850b595c8fff0af5716ed71b2b83c2master
AbstractSync: Build "next" image when building regular imagesrepos/releng/scap!925dancymaster-I2aeb31d412a7268bda538ccd4dcc77f8d135e3c0master
Customize query in GitLab

Event Timeline

bd808 triaged this task as High priority.
bd808 changed the subtype of this task from "Task" to "Feature Request".

Mentioned in SAL (#wikimedia-operations) [2025-07-31T16:21:13Z] <dancy@deploy1003> Started scap sync-world: Testing T398875

Mentioned in SAL (#wikimedia-operations) [2025-07-31T16:24:56Z] <dancy@deploy1003> Finished scap sync-world: Testing T398875 (duration: 03m 43s)

dancy claimed this task.
dancy subscribed.

This change is live!

The impact of building the next image during build-and-push-container-images is not noticeable:

16:21:36 Started build-and-push-container-images
16:21:36 K8s images build/push output redirected to /home/dancy/scap-image-build-and-push-log
16:21:36 K8s images build/push output redirected to /home/dancy/scap-image-build-and-push-log.next
16:21:55 Finished build-and-push-container-images (duration: 00m 18s)

(that was from a scap sync-world with no changes)

Should something go wrong, set build_mw_next_container_image to False in scap.cfg to disable this functionality.

Looks like the changes caused a deployment problem so I rolled back scap.

dancy merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/935

kubernetes: Use separate image repo for single version image build

Mentioned in SAL (#wikimedia-operations) [2025-08-05T18:37:00Z] <dancy@deploy1003> Started scap sync-world: testing T398875

Mentioned in SAL (#wikimedia-operations) [2025-08-05T18:39:54Z] <dancy@deploy1003> Finished scap sync-world: testing T398875 (duration: 02m 54s)