Page MenuHomePhabricator

Migrate wikimedia-portals-build to Docker container
Open, NormalPublic

Description

The CI job wikimedia-portals-build should be migrated to use Docker container. As of July 2019 it runs on Jenkins instances based on Debian Jessie which are provisioned with puppet. That infrastructure is deprecated and has to be dismissed in favor of using Docker containers.

The job wikimedia-portals-build runs every Monday and roughly:

  • git clone wikimedia/portals.git
  • run npm install && npm test && npm run-script build-all-portals, that results in assets intended to power https://www.wikipedia.org/
  • Craft a commit adding the content of ./prod and send that to Gerrit for review against wikimedia/portals/deploy.git
  • A human +2 the change, once merged operations/mediawiki-config.git has the submodule bumped and the portal assets are deployed using a wrapper around scap, similar to how mediawiki-config changes are deployed.

We should be able to use the Release Pipeline to orchestrate the CI build and ultimately switch https://www.wikipedia.org/ to be served by kubernetes.

See also T210286: Migrate wikidata-query-gui-build to Docker containers, the job is similar but the solution will certainly be different.

Event Timeline

hashar created this task.Jan 15 2019, 10:59 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 15 2019, 10:59 AM

I might look at migrating it to a CI Docker container. Longterm it would probably migrate to Blubber / Pipeline / Kubernetes which is T198901

greg triaged this task as Normal priority.Jan 16 2019, 4:38 PM
hashar updated the task description. (Show Details)
hashar moved this task from Backlog to Migration on the Release Pipeline board.
hashar added a subscriber: Jdrewniak.

To be clear: the current process should still work until the new process is in place.

debt added a comment.Aug 5 2019, 6:06 PM

To be clear: the current process should still work until the new process is in place.

it does seem to be working (wikipedia.org portal automatic updates) - or - at least, I'm not getting anymore failure emails. :)