Maniphest T213090

TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation
Closed, ResolvedPublic
Actions

Description

I'd like to start working T212801: TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline. To do so, I need to start learning how our new k8s based deployment pipeline works. I've been poking around in wikitech and mediawiki.org, but haven't yet found docs yet. I know this is project is still WIP, so this makes sense. Perhaps I could help write some documentation as I figure out T212801? Even so, I'd be nice to have some starters.

Could someone write up at least an outline of steps needed to deploy a new k8s based service to production?

Thanks!

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T198901 Migrate production services to kubernetes using the pipeline
		Resolved		jeena	T213090 TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation
		Resolved		jeena	T213197 Document helm chart creation
		Resolved		thcipriani	T213198 Update Blubber documentation

Event Timeline

Ottomata created this task.Jan 7 2019, 4:04 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 7 2019, 4:04 PM

Aklapper added a project: Documentation.Jan 7 2019, 4:22 PM

thcipriani triaged this task as Medium priority.Jan 7 2019, 4:27 PM

thcipriani added a parent task: T212801: TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline.

thcipriani moved this task from Backlog to Migration on the Release Pipeline board.

Yeah it's part of the TEC3 goal to do so (it's Outcome 6/Output 6.1 under https://www.mediawiki.org/w/index.php?title=Wikimedia_Technology/Annual_Plans/FY2019/TEC3:_Deployment_Pipeline/Goals). I 'll be starting this this week. Some preliminary stuff already exists under https://wikitech.wikimedia.org/wiki/User:Alexandros_Kosiaris/Benchmarking_kubernetes_apps and https://wikitech.wikimedia.org/wiki/Kubernetes/Helm. Both are a bit more down the road, but the very first step would be to get a .blubber.yaml file under .pipeline in the repo of eventgate and then enabling the pipeline for it. For more information about blubber see https://wikitech.wikimedia.org/wiki/Blubber. I 'll try and gather docs on streamlining this this week.

• fsero mentioned this in T212935: SRE FY2019-20 Q3 goal: Increase reach of deployment pipeline.Jan 7 2019, 4:38 PM

Awesome, those are good starts, I'll check those out thank you!

• LarsWirzenius subscribed.Jan 7 2019, 5:43 PM

FYI I added some more notes for the EventGate deployment based on some IRC convos today: https://phabricator.wikimedia.org/T211247#4860256

thcipriani edited parent tasks, added: T198901: Migrate production services to kubernetes using the pipeline; removed: T212801: TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production CD Pipeline.Jan 8 2019, 5:24 PM

Ladsgroup subscribed.Jan 9 2019, 4:25 AM

greg edited projects, added Release-Engineering-Team (Next); removed Release-Engineering-Team.Jan 9 2019, 7:43 PM

• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 11:00 PM

Jdforrester-WMF subscribed.Feb 12 2019, 5:20 PM

akosiaris mentioned this in T220397: TEC3:O6:O:6.1:Q4: Deployment Pipeline Documentation.Apr 8 2019, 2:35 PM

thcipriani closed subtask T213198: Update Blubber documentation as Resolved.Jun 9 2019, 7:02 PM

• Phabricator_maintenance edited projects, added Release-Engineering-Team-TODO; removed Release-Engineering-Team (Next).Jun 14 2019, 9:45 PM

• Phabricator_maintenance moved this task from Should be empty (use Release-Engineering-Team) to Soon-ish on the Release-Engineering-Team-TODO board.Jun 14 2019, 9:46 PM

greg added a project: Release-Engineering-Team.Jun 21 2019, 10:35 PM

greg edited projects, added Release-Engineering-Team (Pipeline); removed Release-Engineering-Team.Jun 24 2019, 9:20 PM

jijiki mentioned this in T227306: Missing Documentation for Service Operations.Jul 5 2019, 10:15 AM

Dzahn subscribed.Jul 9 2019, 8:58 PM

@LarsWirzenius and @Jdforrester-WMF worked on the initial draft of https://wikitech.wikimedia.org/wiki/Deployment_pipeline

Recently @jeena added the actual migration tutorial: https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration/Tutorial

Claiming resolved.

thcipriani merged a task: T220397: TEC3:O6:O:6.1:Q4: Deployment Pipeline Documentation.May 11 2020, 4:24 PM

thcipriani closed subtask T213197: Document helm chart creation as Resolved.May 18 2021, 8:18 PM