Page MenuHomePhabricator
Create Task
Maniphest T238770

Deploy MediaWiki to Wikimedia production in containers
Closed, ResolvedPublic
Actions

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT198901 Migrate production services to kubernetes using the pipeline
 ResolvedClement_GoubertT238770 Deploy MediaWiki to Wikimedia production in containers
ResolvedJdforrester-WMFT238771 Get production MW-land images built and published
 DuplicateNoneT238773 Create initial production MW-land images with blubber
 InvalidNoneT238767 Don't recursive checkout wikimedia/production.git in the first step when we just want its blubber config
 ResolvedakosiarisT238774 Provide the official production base images for Wikimedia use
 ResolvedJoeT265324 Create the base container images for running MediaWiki in a production environment
 ResolvedClement_GoubertT265876 Logging options for apache httpd in k8s
 ResolvedkamilaT276095 Keep calculating latencies for MediaWiki requests in the WikiKube environment
 OpenNoneT367076 benthos mw-accesslog-metrics kafka lag and interpolation errors
 ResolvedClement_GoubertT324439 New mediawiki.httpd.accesslog topic on kafka-logging + logstash and dashboard
 DuplicateNoneT238776 Add testing entry point
 ResolveddduvallT259817 Sketch MediaWiki production image composition and workflows
 ResolveddduvallT260828 Experiment with PipelineLib/Blubber driven MediaWiki container image pipeline
 ResolveddduvallT260830 Support scratch based variants in Blubber
 ResolveddduvallT262453 Set up experimental Docker registry in integration project
 InvalidNoneT262458 Create an experimental wmf release branch for a handful of MW extensions and skins
 ResolveddduvallT265177 Refactor PipelineLib to allow for alternate docker image pusher
 Resolved• mmodellT240862 Can't do shallow clone from phabricator
 InvaliddduvallT267060 Experiment with buildkit's llb.ExecOp.AddMount in aggregate images
 ResolveddduvallT268368 Summarize experiments with buildkit based MediaWiki image builds
 ResolveddduvallT269617 Build single version MediaWiki image from wmf branch using only PipelineLib/Blubber
 ResolveddduvallT262460 Configure Zuul to trigger PipelineLib based pipelines during gate-and-submit for a few MW components
 ResolveddancyT271448 Proof of concept for multi-version MediaWiki images
 DeclinedNoneT262455 Author a presentation to demo MW image build pipeline
 ResolveddancyT271274 Security patch workflow for MediaWiki on k8s
 ResolvedLegoktmT273521 Create restricted docker-registry namespace for security patched images
 ResolveddduvallT273676 Jenkins job exists for building patched MediaWiki image
 ResolveddduvallT274182 Multi-version MediaWiki image is built and published
 ResolveddduvallT271472 Determine whether PipelineLib can run on releases-jenkins.wikimedia.org
 ResolveddduvallT271477 Define a PipelineLib based MW image build job on releases-jenkins.wikimedia.org
 ResolveddduvallT272092 Request volume for Docker images and container filesystems on releases machines
 ResolveddancyT279323 Profile single-version and multi-version image builds to identify bottlenecks
 ResolveddancyT260827 l10n process for MW containerization
 ResolveddduvallT261360 Get scap-vagrant working for use in l10n tracing
 ResolveddancyT268698 Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry
 ResolveddancyT238436 Allow running mergeMessageFileList (or any other maintenance script) without needing a DB connection
 ResolveddancyT237148 Allow running rebuildLocalizationCache with Gadgets extension loaded and no DB connection
 ResolvedakosiarisT264209 Run stress tests on docker images infrastructure
 ResolveddancyT284628 Kubernetes timeing out before pulling the mediawiki-multiversion image
ResolvedRequestJMeybohmT286046 decommission registry200[5-8].codfw.wmnet
 ResolvedJMeybohmT286054 Evaluate Dragonfly for distribution of docker images
 InvalidjeenaT271475 Ensure m7i private settings are deployed as secrets to k8s
 ResolvedjeenaT276145 Ensure MW PrivateSettings exist on releases server for production MW builds
 ResolvedNoneT279322 Design m8s deployment workflows and tooling
 ResolvedjeenaT287041 Scap Backport --list command
 ResolvedNoneT287042 Scap backport change_url command
 ResolvedNoneT287993 Train-dev: Ability to deploy to k8s
 ResolvedjeenaT294453 Scap backport change_url: Validate that the specified changes are suitable
ResolveddduvallT294454 Scap backport change_url: approve changes
 DeclinedNoneT294455 Scap backport change_url: update values.yaml
 InvalidNoneT294457 Scap backport change_url: copy files for legacy deployment
 ResolveddduvallT294459 Scap (backport) should support configuration of Gerrit URL
 DeclinedNoneT294462 Scap backport change_url: deploy to k8s
 ResolvedjeenaT294466 Scap backport change_url: legacy deployment
 ResolvedjeenaT295494 Scap backport change_url: Implement “wait for my commits to be merged”
 ResolvedjeenaT295495 Scap backport change_url: Implement “what are the commit hashes from the two repos that correspond to my merged commit(s)”.
 ResolvedjeenaT303755 Scap backport change_url: make gerrit plugin authorize with ssh
 ResolvedNoneT303967 Display mergeable status in scap backport --list output
 ResolvedjeenaT308474 scap backport change_url: Update to use new zuul plugin
 ResolvedjeenaT308476 scap backport change_url: Deploy to mwdebug
 ResolveddduvallT287045 Scap rollback command
 ResolvedjeenaT287046 scap backport --revert command
 ResolveddancyT279324 Provide a development environment for testing m8s deployment tooling
 DeclinedNoneT279340 Include MediaWiki testing in .pipeline/config.yaml execution graph

Event Timeline

Jdforrester-WMF created this task.Nov 20 2019, 6:02 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 20 2019, 6:02 PM
Jdforrester-WMF added a subtask: T238492: Figure out which production extensions have conflicting tests and fix them.Dec 2 2019, 7:41 PM
thcipriani added a parent task: T198901: Migrate production services to kubernetes using the pipeline.May 13 2020, 4:55 PM
Ladsgroup subscribed.May 13 2020, 7:10 PM
Ladsgroup awarded a token.May 13 2020, 8:16 PM
akosiaris subscribed.May 27 2020, 3:03 PM
thcipriani mentioned this in T263166: Convert static mediawiki configuration to form more suitable for containers.Dec 8 2020, 9:23 PM
thcipriani added a subtask: T260827: l10n process for MW containerization.Dec 8 2020, 9:26 PM
thcipriani added a subtask: T264209: Run stress tests on docker images infrastructure.Dec 8 2020, 9:28 PM
thcipriani added a project: MW-on-K8s.Dec 8 2020, 9:34 PM
thcipriani edited projects, added Release-Engineering-Team; removed Release-Engineering-Team-TODO.Jan 12 2021, 5:19 PM
akosiaris closed subtask T271475: Ensure m7i private settings are deployed as secrets to k8s as Invalid.Feb 24 2021, 5:09 PM
dancy closed subtask T260827: l10n process for MW containerization as Resolved.Mar 11 2021, 9:49 PM
jeena closed subtask T276145: Ensure MW PrivateSettings exist on releases server for production MW builds as Resolved.Apr 1 2021, 7:23 PM
thcipriani edited projects, added Release-Engineering-Team-TODO; removed Release-Engineering-Team.Apr 6 2021, 4:33 PM
thcipriani moved this task from Should be empty (use Release-Engineering-Team) to Epics on the Release-Engineering-Team-TODO board.
thcipriani edited projects, added Release-Engineering-Team (thcipriani-workboard-fiddling); removed Release-Engineering-Team-TODO.Apr 20 2021, 3:41 AM
thcipriani moved this task from thcipriani-workboard-fiddling to Seen (ARCHIVE) on the Release-Engineering-Team board.Apr 20 2021, 3:46 AM
thcipriani edited projects, added Release-Engineering-Team; removed Release-Engineering-Team (thcipriani-workboard-fiddling).
thcipriani edited projects, added Release-Engineering-Team (Seen); removed Release-Engineering-Team.Apr 20 2021, 3:23 PM
JMeybohm closed subtask T264209: Run stress tests on docker images infrastructure as Resolved.Aug 11 2021, 8:21 AM
dancy closed subtask T279324: Provide a development environment for testing m8s deployment tooling as Resolved.Apr 29 2022, 3:58 PM
Krinkle subscribed.May 26 2022, 9:40 PM
akosiaris closed subtask T238492: Figure out which production extensions have conflicting tests and fix them as Invalid.Jan 9 2023, 4:53 PM
Jdforrester-WMF reopened subtask T238492: Figure out which production extensions have conflicting tests and fix them as Open.Jan 9 2023, 5:01 PM
thcipriani closed subtask T279322: Design m8s deployment workflows and tooling as Resolved.Jun 9 2023, 9:19 PM
Clement_Goubert closed this task as Resolved.Tue, Jun 18, 12:09 PM
Clement_Goubert claimed this task.
Clement_Goubert subscribed.

Unless I'm mistaken, we've been doing this ever since the start of the MW-on-K8s migration. Resolving.

Jdforrester-WMF closed subtask T238771: Get production MW-land images built and published as Resolved.Tue, Jun 18, 12:34 PM
In T238770#9903034, @Clement_Goubert wrote:

Unless I'm mistaken, we've been doing this ever since the start of the MW-on-K8s migration. Resolving.

This is the top-level post-100% task, which we filed at the (middle of the) start of the mw-on-k8s work. I don't think it's done yet, but it seems like the remaining members of the original team have switched to different task trees?

Jdforrester-WMF closed subtask T279340: Include MediaWiki testing in .pipeline/config.yaml execution graph as Declined.Tue, Jun 18, 12:35 PM
Jdforrester-WMF removed a subtask: T238492: Figure out which production extensions have conflicting tests and fix them.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits