Maniphest T313405

Migrate remaining tools off Gridengine
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• nskaggs
	Jul 20 2022, 1:02 PM

Tags

Referenced Files

None

Subscribers

Description

Now that the migration to the buster gridengine is complete (T304247), it's time to deprecate Gridengine itself. See https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/ for background information.

Generate list of tools needing migration https://grid-deprecation.toolforge.org/
Create phabricator task for each tool
Examine tools for potential migration paths (ie, webservices, python tools, cron jobs, etc) for each one
Categorize tools into a migration path
Work with tool authors to plan migration
Work the list and migrate or shut down tools still running on the grid
Plan grid shutdown

Timeline is now set: https://wikitech.wikimedia.org/wiki/News/Toolforge_Grid_Engine_deprecation#Timeline

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
		Open		None	T362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
		Open		None	T362867 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.28
		Open		None	T359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
		Open		None	T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
		Open		None	T316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
		Resolved		aborrero	T307651 Upgrade Toolforge Kubernetes to version 1.24
		Open		None	T360699 Toolsbeta: migrate to Debian Bullseye or later
		Open		None	T311897 Toolforge: migrate to Debian Bullseye or later
		Stalled		dcaro	T314665 Toolforge: Replace all bastion with grid-less bookworm based bastion hosts
		Resolved		taavi	T361223 Upgrade Toolforge front proxies to Bookworm
		Invalid		None	T197804 Puppet: forbid new Python2 code
		Resolved		taavi	T218427 Upgrade various Toolforge infrastructure scripts from Python 2 to Python 3
		Resolved		taavi	T358320 [toolforge-webservice] Remove old webservice-runner code
		Stalled		taavi	T314664 [infra] Decommission the Grid Engine infrastructure
		Resolved		komla	T313405 Migrate remaining tools off Gridengine
		Declined		None	T316124 Make Grid Engine tooling emit deprecation warnings

Event Timeline

• nskaggs created this task.Jul 20 2022, 1:02 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 20 2022, 1:02 PM

taavi updated the task description. (Show Details)Aug 5 2022, 2:04 PM

RhinosF1 subscribed.Aug 5 2022, 2:08 PM

taavi mentioned this in T314664: [infra] Decommission the Grid Engine infrastructure.Aug 5 2022, 2:19 PM

taavi added a parent task: T314664: [infra] Decommission the Grid Engine infrastructure.

bd808 moved this task from Backlog to In Progress on the Toolforge board.Aug 10 2022, 5:02 PM

komla updated the task description. (Show Details)Aug 30 2022, 3:50 PM

Tracking this using Grid-Engine-to-K8s-Migration

bd808 moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.Sep 27 2022, 9:24 PM

komla updated the task description. (Show Details)Oct 6 2022, 11:19 PM

bd808 mentioned this in Grid-Engine-to-K8s-Migration.Oct 7 2022, 5:38 PM

TheresNoTime removed a subscriber: RhinosF1.Dec 15 2022, 11:35 PM

fnegri edited projects, added cloud-services-team; removed cloud-services-team (Kanban).Jan 18 2023, 7:26 PM

fnegri moved this task from Kanban to Doing? (legacy column) on the cloud-services-team board.

Amorymeltzer subscribed.Jan 18 2023, 9:04 PM

fnegri moved this task from Doing? (legacy column) to Soon! on the cloud-services-team board.Jan 19 2023, 12:51 PM

wahrani closed this task as Resolved.Mar 19 2023, 11:29 AM

taavi reopened this task as Open.Mar 19 2023, 11:31 AM

• nskaggs changed the task status from Open to In Progress.Apr 7 2023, 4:52 PM

• nskaggs triaged this task as Medium priority.

• nskaggs updated the task description. (Show Details)

fnegri moved this task from In Progress to Ready to be worked on on the Toolforge board.Nov 7 2023, 2:24 PM

• nskaggs updated the task description. (Show Details)Nov 28 2023, 4:23 PM

Muhammed4IT subscribed.Dec 28 2023, 12:10 PM

dcaro moved this task from Ready to be worked on to Workspace for triaging whenever needed on the Toolforge board.Jan 24 2024, 1:49 PM

taavi closed subtask T316124: Make Grid Engine tooling emit deprecation warnings as Declined.Feb 15 2024, 12:08 PM

dcaro raised the priority of this task from Medium to High.Feb 20 2024, 3:21 PM

dcaro edited projects, added Toolforge (Toolforge iteration 05); removed Toolforge.

dcaro edited projects, added Toolforge (Toolforge iteration 06); removed Toolforge (Toolforge iteration 05).Feb 21 2024, 10:11 AM

dcaro subscribed.Mar 5 2024, 3:06 PM

dcaro edited projects, added Toolforge (Toolforge iteration 07); removed Toolforge (Toolforge iteration 06).Mar 5 2024, 5:13 PM

It's March 14th, and we can say that as all tools that are going to migrate before the shutdown have been migrated at this point.

taavi moved this task from Next Up to Done on the Toolforge (Toolforge iteration 07) board.Mar 14 2024, 9:32 AM