Page MenuHomePhabricator

Migrate wikimedia-portals-build to Docker container
Open, MediumPublic


The CI job wikimedia-portals-build should be migrated to use Docker container. As of July 2019 it runs on Jenkins instances based on Debian Jessie which are provisioned with puppet. That infrastructure is deprecated and has to be dismissed in favor of using Docker containers.

The job wikimedia-portals-build runs every Monday and roughly:

  • git clone wikimedia/portals.git
  • run npm install && npm test && npm run-script build-all-portals, that results in assets intended to power
  • Craft a commit adding the content of ./prod and send that to Gerrit for review against wikimedia/portals/deploy.git
  • A human +2 the change, once merged operations/mediawiki-config.git has the submodule bumped and the portal assets are deployed using a wrapper around scap, similar to how mediawiki-config changes are deployed.

We should be able to use the Release Pipeline to orchestrate the CI build and ultimately switch to be served by kubernetes.

See also T210286: Migrate wikidata-query-gui-build to Docker containers, the job is similar but the solution will certainly be different.


Related Gerrit Patches:
wikimedia/portals : masterpipeline: add a .pipeline/blubber.yaml

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 15 2019, 10:59 AM

I might look at migrating it to a CI Docker container. Longterm it would probably migrate to Blubber / Pipeline / Kubernetes which is T198901

greg triaged this task as Medium priority.Jan 16 2019, 4:38 PM
hashar updated the task description. (Show Details)
hashar moved this task from Backlog to Migration on the Release Pipeline board.
hashar added a subscriber: Jdrewniak.

To be clear: the current process should still work until the new process is in place.

debt added a comment.Aug 5 2019, 6:06 PM

To be clear: the current process should still work until the new process is in place.

it does seem to be working ( portal automatic updates) - or - at least, I'm not getting anymore failure emails. :)

Change 552144 had a related patch set uploaded (by Hashar; owner: Thcipriani):
[wikimedia/portals@master] pipeline: add a .pipeline/blubber.yaml