Page MenuHomePhabricator
Create Task
Maniphest T198901

Migrate production services to kubernetes using the pipeline
Open, MediumPublic
Actions

Description

Below is a list of "services" (broadly defined) that are deployed into production that are potential candidates for moving to kubernetes over the course of the current fiscal year.

List refined in late April 2020

New

  • sessionstore
  • eventgate-main
  • eventgate-analytics
  • termbox

Agreed

Out of scope for now.

TBD

  • 3d2png
  • analytics/aqs/deploy
  • analytics/pivot/deploy
  • analytics/refinery
  • analytics/superset/deploy
  • analytics/turnilo/deploy
  • debmonitor
  • design/styleguide
  • eventlogging/analytics
  • iegreview
  • kartotherian
  • logstash/plugins
  • performance/navtiming
  • relforge/mjolnir
  • scholarships
  • search/mjolnir
  • statsv
  • striker
  • tilerator
  • wdqs
  • wikimedia/portals ( T213806 )

Currently unsupported

  • netbox (stores uploaded pictures in local filesystem)
  • etherpad (stores information about the address of a client in a global variable and then uses it in logging)[1]

[1] https://github.com/ether/etherpad-lite/blob/develop/src/node/handler/SocketIORouter.js#L64

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT198901 Migrate production services to kubernetes using the pipeline
 ResolvedthciprianiT205919 TEC3:O3:O3.1:Q2 Goal - Move Blubberoid, ZoteroV2, and Graphoid through the production CD Pipeline
 Resolved• mobrovacT201611 Deploy translation-server-v2
 ResolveddduvallT205920 Blubberoid – create swagger spec
 ResolvedthciprianiT207694 Adopt JSON as blubber's internal configuration format
 ResolvedthciprianiT207696 Retain YAML support by converting to JSON in Blubber
 ResolvedjeenaT211708 Blubberoid - Create Helm Chart
 DeclinedNoneT182331 [Epic] Deploy ORES in kubernetes cluster
 InvalidNoneT182332 Refactor ORES puppet for Kubernetes
 ResolvedNoneT210264 Investigate memory usage of ORES in kubernetes
Declined• ACrazeT210268 Build blubber file for ORES
 ResolveddduvallT211625 Unify configuration for local build-context copies and variant artifacts
 ResolveddduvallT210267 Execution of the deployment pipeline should be configurable via .pipeline/config.yaml
 ResolveddduvallT222199 Post generated docs for pipelinelib
 DeclinedNoneT210269 Build helm charts for ORES
 DeclinedNoneT214054 Stress test ORES on kubernetes (above 4.5k scores/second)
 Resolved• ACrazeT219708 [Discuss] Changes to ores codebase for migrating to kubernets
ResolvedakosiarisT207200 Revisit the logging work done on Q1 2017-2018 for the standard pod setup
 InvalidNoneT212801 TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline
 ResolvedOttomataT211247 Modern Event Platform: Stream Intake Service: Implementation: Deployment Pipeline
 OpenbrouberolT213561 Discovery for Kafka cluster brokers
 DeclinedakosiarisT213963 Include git in our alpine docker image on docker-registry.wikimedia.org
 ResolvedjijikiT213195 Migrate cxserver to kubernetes
 ResolvedjijikiT213194 Migrate citoid to kubernetes
 Resolved• holger.knustT213193 Migrate changeprop to kubernetes
 Resolved• PcheloloT218396 Make change-prop tests independent of Kafka and Redis
 ResolvedjeenaT213090 TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation
 ResolvedjeenaT213197 Document helm chart creation
 ResolvedthciprianiT213198 Update Blubber documentation
 ResolvedNoneT225678 Migrate 3d2png to k8s
 ResolvedNoneT267327 Run latest Thumbor on Docker with Buster + Python 3
 DeclinedNoneT269215 Blubber "copies" and "builder command" steps should run in the opposite order
 ResolvedakosiarisT225680 Migrate Proton to k8s
 ResolvedMSantosT238830 Profile proton memory usage for Helm chart
 ResolvedMSantosT240594 Upgrade puppeteer to allow Proton to move to Buster
 InvalidNoneT225681 Migrate trending-edits to k8s
 OpenNoneT216826 Move Kartotherian to Kubernetes
 Resolved• Mathew.onipeT223275 Create blubberfile for deploying kartotherian into docker environment.
 InvalidNoneT231009 Make jobprocessor's test not depend on external files
 OpenNoneT322522 Deploy containerized Kartotherian service to the beta cluster
 In ProgressNoneT231006 Create helm chart for kartotherian k8s deployment
 ResolvedNoneT324471 Migrate our draft charts to newer scaffolding
 OpenNoneT322647 Create a dedicated postgresql+postgis cluster for maps
 OpenNoneT323360 Provision a hot-reload local development environment in k8s for kartotherian
 ResolvedakosiarisT218733 Migrate mobileapps to k8s and node 10
 DeclinedNoneT215539 Node.js 10 changes encoding for at least one Georgian character
 Resolved• MhollowayT258186 Investigate why mobileapps in k8s "/{domain}/v1/data/css/mobile/site" endpoint takes way longer than on scb to complete
 DeclinedakosiarisT223953 Deploy the RESTBase front-end service (RESTRouter) to Kubernetes
 Resolved• PcheloloT226538 Conduct basic load-test experiments for RESTRouter in k8s
 Resolved• PcheloloT226536 Trigger RESTRouter image builds on push/tag
 DeclinedNoneT235437 RESTBase/RESTRouter/service-runner rate limiting plans
 Declined• PcheloloT249919 Move service-runner legacy rate limiter into hyperswitch
 ResolvedOttomataT238658 Migrate EventStreams to k8s deployment pipeline
 ResolvedakosiarisT241230 Migrate recommendation-api to kubernetes
 ResolvedhnowlanT220399 Migrate cpjobqueue to kubernetes
 Resolved• holger.knustT244387 Change-Prop consumer group must respect service name
 Resolved• holger.knustT245803 Make changeprop chart depend on Kafka-dev for minikube
 ResolvedakosiarisT220401 Introduce kask session storage service to kubernetes
 ResolvedakosiarisT220821 Add security sensitive nodes to our kubernetes cluster
 ResolvedayounsiT220822 Site: 4 VM request for kubernetes
 OpenNoneT224041 Kask functional testing with Cassandra via the Deployment Pipeline
 DeclinedNoneT255595 Support for deleting images in PipelineLib
 ResolvedjeenaT255596 PipelineLib helm test log output
 ResolvedjeenaT256281 Create WMF Cassandra image
 OpenNoneT238770 Deploy MediaWiki to Wikimedia production in containers
OpenNoneT238771 Get production MW-land images built and published
 DuplicateNoneT238773 Create initial production MW-land images with blubber
 InvalidNoneT238767 Don't recursive checkout wikimedia/production.git in the first step when we just want its blubber config
 ResolvedakosiarisT238774 Provide the official production base images for Wikimedia use
 ResolvedJoeT265324 Create the base container images for running MediaWiki in a production environment
 ResolvedClement_GoubertT265876 Logging options for apache httpd in k8s
 ResolvedkamilaT276095 Keep calculating latencies for MediaWiki requests in the WikiKube environment
 ResolvedClement_GoubertT324439 New mediawiki.httpd.accesslog topic on kafka-logging + logstash and dashboard
 DuplicateNoneT238776 Add testing entry point
 ResolveddduvallT259817 Sketch MediaWiki production image composition and workflows
 ResolveddduvallT260828 Experiment with PipelineLib/Blubber driven MediaWiki container image pipeline
 ResolveddduvallT260830 Support scratch based variants in Blubber
 ResolveddduvallT262453 Set up experimental Docker registry in integration project
 InvalidNoneT262458 Create an experimental wmf release branch for a handful of MW extensions and skins
 ResolveddduvallT265177 Refactor PipelineLib to allow for alternate docker image pusher
 Resolved• mmodellT240862 Can't do shallow clone from phabricator
 InvaliddduvallT267060 Experiment with buildkit's llb.ExecOp.AddMount in aggregate images
 ResolveddduvallT268368 Summarize experiments with buildkit based MediaWiki image builds
 ResolveddduvallT269617 Build single version MediaWiki image from wmf branch using only PipelineLib/Blubber
 ResolveddduvallT262460 Configure Zuul to trigger PipelineLib based pipelines during gate-and-submit for a few MW components
 ResolveddancyT271448 Proof of concept for multi-version MediaWiki images
 DeclinedNoneT262455 Author a presentation to demo MW image build pipeline
 ResolveddancyT271274 Security patch workflow for MediaWiki on k8s
 ResolvedLegoktmT273521 Create restricted docker-registry namespace for security patched images
 ResolveddduvallT273676 Jenkins job exists for building patched MediaWiki image
 ResolveddduvallT274182 Multi-version MediaWiki image is built and published
 ResolveddduvallT271472 Determine whether PipelineLib can run on releases-jenkins.wikimedia.org
 ResolveddduvallT271477 Define a PipelineLib based MW image build job on releases-jenkins.wikimedia.org
 ResolveddduvallT272092 Request volume for Docker images and container filesystems on releases machines
 ResolveddancyT279323 Profile single-version and multi-version image builds to identify bottlenecks
 OpenNoneT238492 Figure out which production extensions have conflicting tests and fix them
 ResolvedUmherirrenderT235783 CentralAuth tests failing if GlobalPreferences is loaded
 ResolveddancyT260827 l10n process for MW containerization
 ResolveddduvallT261360 Get scap-vagrant working for use in l10n tracing
 ResolveddancyT268698 Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry
 ResolveddancyT238436 Allow running mergeMessageFileList (or any other maintenance script) without needing a DB connection
 ResolveddancyT237148 Allow running rebuildLocalizationCache with Gadgets extension loaded and no DB connection
 ResolvedakosiarisT264209 Run stress tests on docker images infrastructure
 ResolveddancyT284628 Kubernetes timeing out before pulling the mediawiki-multiversion image
ResolvedRequestJMeybohmT286046 decommission registry200[5-8].codfw.wmnet
 ResolvedJMeybohmT286054 Evaluate Dragonfly for distribution of docker images
 InvalidjeenaT271475 Ensure m7i private settings are deployed as secrets to k8s
 ResolvedjeenaT276145 Ensure MW PrivateSettings exist on releases server for production MW builds
 ResolvedNoneT279322 Design m8s deployment workflows and tooling
 ResolvedjeenaT287041 Scap Backport --list command
 ResolvedNoneT287042 Scap backport change_url command
 ResolvedNoneT287993 Train-dev: Ability to deploy to k8s
 ResolvedjeenaT294453 Scap backport change_url: Validate that the specified changes are suitable
ResolveddduvallT294454 Scap backport change_url: approve changes
 DeclinedNoneT294455 Scap backport change_url: update values.yaml
 InvalidNoneT294457 Scap backport change_url: copy files for legacy deployment
 ResolveddduvallT294459 Scap (backport) should support configuration of Gerrit URL
 DeclinedNoneT294462 Scap backport change_url: deploy to k8s
 ResolvedjeenaT294466 Scap backport change_url: legacy deployment
 ResolvedjeenaT295494 Scap backport change_url: Implement “wait for my commits to be merged”
 ResolvedjeenaT295495 Scap backport change_url: Implement “what are the commit hashes from the two repos that correspond to my merged commit(s)”.
 ResolvedjeenaT303755 Scap backport change_url: make gerrit plugin authorize with ssh
 ResolvedNoneT303967 Display mergeable status in scap backport --list output
 ResolvedjeenaT308474 scap backport change_url: Update to use new zuul plugin
 ResolvedjeenaT308476 scap backport change_url: Deploy to mwdebug
 ResolveddduvallT287045 Scap rollback command
 ResolvedjeenaT287046 scap backport --revert command
 ResolveddancyT279324 Provide a development environment for testing m8s deployment tooling
 OpenNoneT279340 Include MediaWiki testing in .pipeline/config.yaml execution graph
 ResolvedKartikMistryT255672 Migrate apertium to the deployment pipeline
 ResolvedjeenaT261809 Migrate mathoid to use PipelineLib
 ResolvedjeenaT262987 Migrate termbox to pipelineLib CI

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Ladsgroup subscribed.Sep 17 2018, 9:30 PM
thcipriani removed a subtask: T203091: Move Graphoid to Kubernetes via the deployment pipeline.Oct 1 2018, 7:52 PM
thcipriani added a subtask: T205919: TEC3:O3:O3.1:Q2 Goal - Move Blubberoid, ZoteroV2, and Graphoid through the production CD Pipeline.
thcipriani updated the task description. (Show Details)Oct 9 2018, 5:18 PM
• LarsWirzenius subscribed.Oct 12 2018, 3:17 PM
hashar mentioned this in T207087: Replace all the npm* images with node10* ones.Oct 16 2018, 7:31 AM
greg edited projects, added Release-Engineering-Team; removed Release-Engineering-Team (Kanban).Nov 26 2018, 5:36 PM
greg moved this task from INBOX to Epics (ARCHIVED) on the Release-Engineering-Team board.
Ladsgroup added a subtask: T182331: [Epic] Deploy ORES in kubernetes cluster.Nov 26 2018, 5:42 PM
• mobrovac added a project: Platform Team Legacy (Watching / External).Dec 20 2018, 12:03 PM
hashar merged a task: T152684: Setup change-propagation service CI.Jan 1 2019, 3:45 PM
hashar mentioned this in T152684: Setup change-propagation service CI.
hashar added subscribers: • NHarateh_WMF, Stashbot, • Pchelolo and 7 others.
thcipriani added a subtask: T207200: Revisit the logging work done on Q1 2017-2018 for the standard pod setup.Jan 2 2019, 7:18 PM
thcipriani closed subtask T205919: TEC3:O3:O3.1:Q2 Goal - Move Blubberoid, ZoteroV2, and Graphoid through the production CD Pipeline as Resolved.
greg added a subtask: T212801: TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline.Jan 2 2019, 7:18 PM
• fsero mentioned this in T212935: SRE FY2019-20 Q3 goal: Increase reach of deployment pipeline.Jan 4 2019, 2:14 PM
thcipriani added a subtask: T213090: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation.Jan 8 2019, 5:24 PM
hashar updated the task description. (Show Details)Jan 15 2019, 5:43 PM
hashar mentioned this in T213806: Migrate wikimedia-portals-build to Docker container.

From the releng meeting, I have added wikimedia/portals to the list.

• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 10:09 PM
hashar mentioned this in T213366: [2 hrs] Decide on handling system updates for Proton.Feb 7 2019, 10:58 AM
MSantos subscribed.Feb 11 2019, 2:06 PM
Jdforrester-WMF updated the task description. (Show Details)Mar 5 2019, 5:04 PM
brennen subscribed.Mar 5 2019, 5:05 PM
Jdforrester-WMF updated the task description. (Show Details)Mar 5 2019, 5:07 PM
KartikMistry mentioned this in T220235: Migrate Beta cluster services to use Kubernetes .Apr 5 2019, 8:05 PM
Krenair subscribed.May 3 2019, 4:06 PM
Krenair mentioned this in T218729: Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster.May 3 2019, 4:09 PM
• Fjalapeno subscribed.May 8 2019, 11:00 PM
Krenair added a comment.May 29 2019, 1:58 PM

Is apertium part of the cxserver migration?

akosiaris added a comment.May 30 2019, 7:11 PM
In T198901#5220959, @Krenair wrote:

Is apertium part of the cxserver migration?

No, completely different software.

Krenair added a comment.May 30 2019, 7:13 PM

Okay. Is it potentially in-scope i.e. should it appear on one of the lists in this task?

akosiaris updated the task description. (Show Details)May 30 2019, 7:18 PM
akosiaris updated the task description. (Show Details)

Indeed. I added it under TBD. The exact way this will be done will need to be investigated.

akosiaris updated the task description. (Show Details)Jun 5 2019, 6:41 PM
akosiaris updated the task description. (Show Details)
Ottomata added a comment.Jun 5 2019, 6:43 PM

I don't think eventstreams is in k8s, is it?

akosiaris added a comment.Jun 5 2019, 6:44 PM
In T198901#5237895, @Ottomata wrote:

I don't think eventstreams is in k8s, is it?

Indeed it is not. I got carried away due to the other event* things being in k8s

akosiaris updated the task description. (Show Details)Jun 5 2019, 6:45 PM
akosiaris updated the task description. (Show Details)
akosiaris updated the task description. (Show Details)Jun 5 2019, 7:10 PM
• Phabricator_maintenance edited projects, added Release-Engineering-Team-TODO; removed Release-Engineering-Team.Jun 12 2019, 11:39 PM
• Phabricator_maintenance moved this task from Should be empty (use Release-Engineering-Team) to Epics on the Release-Engineering-Team-TODO board.Jun 12 2019, 11:41 PM
• mobrovac closed subtask T225681: Migrate trending-edits to k8s as Invalid.Jun 13 2019, 7:19 AM
greg added a project: Release-Engineering-Team.Jun 21 2019, 10:35 PM
Jdforrester-WMF added a subtask: T216826: Move Kartotherian to Kubernetes.Jul 8 2019, 3:45 PM
Jdforrester-WMF added a subtask: T218733: Migrate mobileapps to k8s and node 10.Jul 16 2019, 4:12 PM
Jdforrester-WMF added a subtask: T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes.Jul 16 2019, 4:18 PM
greg edited projects, added Release-Engineering-Team (Pipeline); removed Release-Engineering-Team.Aug 1 2019, 11:21 PM
akosiaris closed subtask T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes as Resolved.Sep 25 2019, 1:42 PM
• mobrovac reopened subtask T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes as Open.Sep 26 2019, 7:43 AM
akosiaris closed subtask T207200: Revisit the logging work done on Q1 2017-2018 for the standard pod setup as Resolved.Sep 30 2019, 4:42 PM
Ladsgroup updated the task description. (Show Details)Oct 28 2019, 10:46 AM
hashar unsubscribed.Oct 29 2019, 3:03 PM
Ottomata updated the task description. (Show Details)Nov 19 2019, 2:54 PM
akosiaris changed the status of subtask T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes from Open to Stalled.Dec 16 2019, 4:19 PM
WDoranWMF closed subtask T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes as Declined.Mar 24 2020, 9:14 PM
akosiaris closed subtask T238658: Migrate EventStreams to k8s deployment pipeline as Resolved.Mar 31 2020, 9:55 AM
thcipriani closed subtask T213090: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation as Resolved.May 4 2020, 10:14 PM
thcipriani updated the task description. (Show Details)May 4 2020, 10:21 PM
thcipriani closed subtask T212801: TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline as Invalid.May 4 2020, 10:24 PM
thcipriani added a subtask: T220399: Migrate cpjobqueue to kubernetes.May 11 2020, 3:50 PM
thcipriani added a subtask: T220401: Introduce kask session storage service to kubernetes.May 11 2020, 3:54 PM
thcipriani added a subtask: T238770: Deploy MediaWiki to Wikimedia production in containers .May 13 2020, 4:55 PM
thcipriani updated the task description. (Show Details)
akosiaris updated the task description. (Show Details)Jun 17 2020, 1:19 PM
akosiaris added a subtask: T255672: Migrate apertium to the deployment pipeline.
hnowlan closed subtask T220399: Migrate cpjobqueue to kubernetes as Resolved.Jul 7 2020, 12:41 PM
akosiaris closed subtask T225680: Migrate Proton to k8s as Resolved.Jul 10 2020, 7:26 AM
akosiaris closed subtask T218733: Migrate mobileapps to k8s and node 10 as Resolved.Aug 5 2020, 1:48 PM
• chasemp subscribed.Aug 5 2020, 3:12 PM
hashar added a subtask: T261809: Migrate mathoid to use PipelineLib.Sep 2 2020, 7:10 AM
• Pchelolo mentioned this in T263489: AQS 2.0.Sep 21 2020, 6:18 PM
jeena closed subtask T261809: Migrate mathoid to use PipelineLib as Resolved.Nov 16 2020, 8:28 PM
akosiaris closed subtask T241230: Migrate recommendation-api to kubernetes as Resolved.Nov 19 2020, 9:59 AM
Jdforrester-WMF updated the task description. (Show Details)Nov 19 2020, 6:06 PM
• Mholloway updated the task description. (Show Details)Nov 19 2020, 6:07 PM
akosiaris closed subtask T182331: [Epic] Deploy ORES in kubernetes cluster as Declined.Nov 20 2020, 7:48 AM
akosiaris updated the task description. (Show Details)
Jdforrester-WMF updated the task description. (Show Details)Dec 9 2020, 3:33 PM
Pginer-WMF closed subtask T255672: Migrate apertium to the deployment pipeline as Resolved.Dec 18 2020, 11:17 AM
thcipriani removed a project: Release-Engineering-Team (Pipeline).Apr 20 2021, 1:25 AM
thcipriani edited projects, added Release-Engineering-Team (thcipriani-workboard-fiddling); removed Release-Engineering-Team-TODO.Apr 20 2021, 3:42 AM
thcipriani moved this task from thcipriani-workboard-fiddling to Seen (ARCHIVE) on the Release-Engineering-Team board.Apr 20 2021, 3:54 AM
thcipriani edited projects, added Release-Engineering-Team; removed Release-Engineering-Team (thcipriani-workboard-fiddling).
thcipriani edited projects, added Release-Engineering-Team (Seen); removed Release-Engineering-Team.Apr 20 2021, 3:23 PM
• LarsWirzenius unsubscribed.Jun 15 2021, 5:33 AM
dduvall mentioned this in T293823: [SPIKE] Investigate Backstage's ability to apply transformations .Oct 28 2021, 9:43 PM
LSobanski added a project: serviceops.Jan 6 2023, 1:04 PM
jijiki moved this task from Incoming 🐫 to 🗄 Projects on the serviceops board.Jan 10 2023, 1:36 PM
Aklapper mentioned this in T217872: Create official docker images for Mediawiki and services used in the local development environment.Apr 7 2023, 5:58 PM
hnowlan closed subtask T225678: Migrate 3d2png to k8s as Resolved.Oct 2 2023, 9:36 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL