Page MenuHomePhabricator
Create Task
Maniphest T314664

[infra] Decommission the Grid Engine infrastructure
Closed, ResolvedPublic
Actions

Description

This task is tracking the removal of Grid Engine-specific bits from the Toolforge infrastructure. It is effectively blocked on migrating tools off the grid, which is tracked separately as T313405: Migrate remaining tools off Gridengine.

Before Thursday shutdown window:

  • Stop alerting

Plan for Thursday (C10):

Then afterwards:

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Tag 0.103.5repos/cloud/toolforge/webservice-cli!32taavitaavi/tagmain
Drop Grid Engine supportrepos/cloud/toolforge/disable-tool!18taavigridmaster
Remove grid engine supportrepos/cloud/toolforge/webservice-cli!31taavitaavi/remove-gridmain
Customize query in GitLab

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRaymond_NdibeT359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
Restricted Task
 ResolvedSlst2020T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
 Resolved• aborreroT316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
 Resolved• aborreroT307651 Upgrade Toolforge Kubernetes to version 1.24
 ResolvedNoneT360699 Toolsbeta: migrate to Debian Bullseye or later
 ResolvedtaaviT311897 [infra] Toolforge: migrate to Debian Bullseye or later
 ResolvedtaaviT314665 Toolforge: Replace all bastion with grid-less bookworm based bastion hosts
 ResolvedtaaviT361223 Upgrade Toolforge front proxies to Bookworm
 DeclinedNoneT197804 Puppet: forbid new Python2 code
 ResolvedtaaviT218427 Upgrade various Toolforge infrastructure scripts from Python 2 to Python 3
 ResolvedtaaviT358320 [toolforge-webservice] Remove old webservice-runner code
 ResolvedtaaviT314664 [infra] Decommission the Grid Engine infrastructure
 ResolvedkomlaT313405 Migrate remaining tools off Gridengine
 DeclinedNoneT316124 Make Grid Engine tooling emit deprecation warnings
 ResolvedtaaviT329619 Toolforge: decide what to do with tools that have 'stretch' in their service manifests
 ResolvedAndrewT353351 Provide tools for disabling the grid for specific tools
 ResolvedAndrewT353642 Relocate disable-tool-archive-dbs.service
 ResolvedtaaviT358333 Remove toolschecker grid engine checks
 ResolvedtaaviT359934 [infra] Archive grid engine related infrastructure tools
 ResolvedtaaviT359935 [infra] Archive grid engine related Gerrit repositories

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Mar 14 2024, 11:02 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-14T11:02:45Z] <taavi> stop grid related VMs T314664

taavi updated the task description. (Show Details)Mar 14 2024, 11:02 AM
gerritbot added a comment.Mar 14 2024, 11:03 AM

Change 1010503 merged by Majavah:

[operations/puppet@production] P:toolforge::proxy: drop grid engine dynamicproxy support

https://gerrit.wikimedia.org/r/1010503

taavi updated the task description. (Show Details)Mar 14 2024, 11:08 AM
CodeReviewBot added a comment.Mar 14 2024, 11:08 AM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/18

Drop Grid Engine support

taavi updated the task description. (Show Details)Mar 14 2024, 11:10 AM
gerritbot added a comment.Mar 14 2024, 11:12 AM

Change 1010892 merged by Majavah:

[operations/puppet@production] Remove Toolforge grid engine

https://gerrit.wikimedia.org/r/1010892

taavi closed subtask T359934: [infra] Archive grid engine related infrastructure tools as Resolved.Mar 14 2024, 11:17 AM
taavi updated the task description. (Show Details)
taavi updated the task description. (Show Details)Mar 14 2024, 12:20 PM
taavi updated the task description. (Show Details)Mar 14 2024, 5:28 PM
gerritbot added a comment.Mar 14 2024, 5:45 PM

Change 1010504 merged by Majavah:

[operations/puppet@production] dynamicproxy: cleanup after removing toolforge support

https://gerrit.wikimedia.org/r/1010504

greg awarded a token.Mar 14 2024, 11:37 PM
greg rescinded a token.
greg awarded a token.
Stashbot added a comment.Mar 18 2024, 9:27 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-18T09:27:32Z] <taavi> deleted shutdown grid engine VMs T314664

taavi updated the task description. (Show Details)Mar 18 2024, 9:30 AM
taavi updated the task description. (Show Details)
gerritbot added a comment.Mar 18 2024, 10:47 AM

Change 1010520 merged by jenkins-bot:

[cloud/wmcs-cookbooks@main] Remove Grid Engine support

https://gerrit.wikimedia.org/r/1010520

taavi updated the task description. (Show Details)Mar 18 2024, 10:47 AM
jenkins-bot mentioned this in rCCKBd888e8402291: Remove Grid Engine support.Mar 18 2024, 10:55 AM
taavi updated the task description. (Show Details)Mar 18 2024, 11:11 AM
CodeReviewBot added a comment.Mar 18 2024, 1:58 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/31

Remove grid engine support

CodeReviewBot added a comment.Mar 18 2024, 2:04 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/32

Tag 0.103.5

CodeReviewBot added a comment.Mar 18 2024, 2:32 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/32

Tag 0.103.5

gerritbot added a comment.Mar 18 2024, 2:42 PM

Change 1012390 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge: move webservice CLI to the CLI profile

https://gerrit.wikimedia.org/r/1012390

taavi updated the task description. (Show Details)Mar 18 2024, 2:46 PM
gerritbot added a comment.Mar 19 2024, 10:49 AM

Change 1012390 merged by Majavah:

[operations/puppet@production] P:toolforge: move webservice CLI to the CLI profile

https://gerrit.wikimedia.org/r/1012390

taavi updated the task description. (Show Details)Mar 20 2024, 4:02 PM
hoshimi unsubscribed.Mar 20 2024, 4:47 PM
taavi added a parent task: T361223: Upgrade Toolforge front proxies to Bookworm.Mar 28 2024, 1:18 PM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2023/2024-Q3-Q4) board.Mar 28 2024, 2:46 PM
dcaro edited projects, added Toolforge (Toolforge iteration 08); removed Toolforge (Toolforge iteration 07).Apr 3 2024, 4:15 PM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 08) board.
gerritbot added a comment.Apr 15 2024, 11:47 AM

Change #1019732 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] hieradata: Drop defusedxml dependency from cloudcumins

https://gerrit.wikimedia.org/r/1019732

gerritbot added a comment.Apr 15 2024, 11:51 AM

Change #1019732 merged by Majavah:

[operations/puppet@production] hieradata: Drop defusedxml dependency from cloudcumins

https://gerrit.wikimedia.org/r/1019732

dcaro edited projects, added Toolforge (Toolforge iteration 09); removed Toolforge (Toolforge iteration 08).Apr 17 2024, 7:48 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 09) board.
dcaro changed the task status from In Progress to Stalled.Apr 30 2024, 1:27 PM
dcaro moved this task from In Progress to Blocked/Paused on the Toolforge (Toolforge iteration 09) board.
dcaro edited projects, added Toolforge (Toolforge iteration 10); removed Toolforge (Toolforge iteration 09).May 22 2024, 4:40 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 10) board.
Maintenance_bot removed a project: Patch-For-Review.May 22 2024, 5:31 PM
dcaro edited projects, added Toolforge (Toolforge iteration 11); removed Toolforge (Toolforge iteration 10).Jun 4 2024, 2:55 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 11) board.
fnegri removed taavi as the assignee of this task.Jun 28 2024, 12:55 PM
dcaro edited projects, added Toolforge (Toolforge iteration 12); removed Toolforge (Toolforge iteration 11).Jul 2 2024, 2:01 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 12) board.
dcaro claimed this task.Jul 16 2024, 1:39 PM
dcaro edited projects, added Toolforge (Toolforge iteration 13); removed Toolforge (Toolforge iteration 12).Jul 17 2024, 11:22 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 13) board.
dcaro edited projects, added Toolforge (Toolforge iteration 14); removed Toolforge (Toolforge iteration 13).Aug 5 2024, 7:39 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 14) board.
fnegri edited projects, added cloud-services-team (FY2024/2025-Q1-Q2); removed cloud-services-team (FY2023/2024-Q3-Q4).Aug 19 2024, 9:18 AM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q1-Q2) board.
dcaro edited projects, added Toolforge (Toolforge iteration 15); removed Toolforge (Toolforge iteration 14).Sep 25 2024, 7:55 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 15) board.
dcaro edited projects, added Toolforge (Toolforge iteration 16); removed Toolforge (Toolforge iteration 15).Oct 15 2024, 7:32 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 16) board.
dcaro edited projects, added Toolforge (Toolforge iteration 17); removed Toolforge (Toolforge iteration 16).Jan 8 2025, 12:48 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 17) board.
fnegri moved this task from In progress to Blocked on the cloud-services-team (FY2024/2025-Q1-Q2) board.Jan 13 2025, 4:28 PM
gerritbot added a comment.Jan 14 2025, 1:40 PM

Change #1111222 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] toolforge::proxy: remove absenting statement

https://gerrit.wikimedia.org/r/1111222

gerritbot added a project: Patch-For-Review.Jan 14 2025, 1:40 PM

Change #1111221 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] toolforge::prometheus: remove frontproxy-redis

https://gerrit.wikimedia.org/r/1111221

fnegri edited projects, added cloud-services-team (FY2024/2025-Q3-Q4); removed cloud-services-team (FY2024/2025-Q1-Q2).Jan 14 2025, 2:51 PM
gerritbot added a comment.Jan 14 2025, 3:47 PM

Change #1111221 merged by David Caro:

[operations/puppet@production] toolforge::prometheus: remove frontproxy-redis

https://gerrit.wikimedia.org/r/1111221

gerritbot added a comment.Jan 14 2025, 3:47 PM

Change #1111222 merged by David Caro:

[operations/puppet@production] toolforge::proxy: remove absenting statement

https://gerrit.wikimedia.org/r/1111222

fnegri moved this task from Backlog to Blocked on the cloud-services-team (FY2024/2025-Q3-Q4) board.Jan 14 2025, 4:15 PM
dcaro edited projects, added Toolforge (Toolforge iteration 18); removed Toolforge (Toolforge iteration 17).Feb 25 2025, 3:29 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 18) board.
dcaro edited projects, added Toolforge (Toolforge iteration 19); removed Toolforge (Toolforge iteration 18).Mar 18 2025, 3:57 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 19) board.
dcaro edited projects, added Toolforge (Toolforge iteration 20); removed Toolforge (Toolforge iteration 19).May 14 2025, 2:30 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 20) board.
dcaro edited projects, added Toolforge (Toolforge iteration 21); removed Toolforge (Toolforge iteration 20).Jun 11 2025, 10:38 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 21) board.
• Godspowertechnical renamed this task from [infra] Decommission the Grid Engine infrastructure to [infra] Commission the Grid Engine infrastructure.Jun 22 2025, 6:59 AM
JJMC89 renamed this task from [infra] Commission the Grid Engine infrastructure to [infra] Decommission the Grid Engine infrastructure.Jun 22 2025, 7:55 AM
dcaro edited projects, added Toolforge (Toolforge iteration 22); removed Toolforge (Toolforge iteration 21).Jul 14 2025, 9:47 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 22) board.
fnegri edited projects, added cloud-services-team (FY2025/26-Q1-Q2); removed cloud-services-team (FY2024/2025-Q3-Q4).Jul 15 2025, 1:32 PM
fnegri moved this task from Backlog to Blocked on the cloud-services-team (FY2025/26-Q1-Q2) board.
dcaro edited projects, added Toolforge (Toolforge iteration 23); removed Toolforge (Toolforge iteration 22).Aug 5 2025, 3:45 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 23) board.
dcaro edited projects, added Toolforge (Toolforge iteration 24); removed Toolforge (Toolforge iteration 23).Aug 27 2025, 9:43 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 24) board.
gerritbot added a comment.Sep 16 2025, 1:44 PM

Change #1188783 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::checker: Remove grid base profile

https://gerrit.wikimedia.org/r/1188783

gerritbot added a comment.Sep 16 2025, 2:46 PM

Change #1188783 merged by Majavah:

[operations/puppet@production] P:toolforge::checker: Remove grid base profile

https://gerrit.wikimedia.org/r/1188783

taavi claimed this task.Sep 16 2025, 3:25 PM
taavi changed the task status from Stalled to Open.Sep 16 2025, 3:44 PM
taavi updated the task description. (Show Details)Sep 16 2025, 3:54 PM
taavi updated the task description. (Show Details)Sep 16 2025, 3:59 PM
taavi updated the task description. (Show Details)Sep 18 2025, 6:47 AM
taavi updated the task description. (Show Details)
taavi closed this task as Resolved.Sep 23 2025, 3:27 PM
taavi mentioned this in T405371: Delete SGE system directory and user.
dcaro moved this task from Blocked/Paused to Done on the Toolforge (Toolforge iteration 24) board.Sep 24 2025, 1:53 PM
fnegri moved this task from Blocked to Done on the cloud-services-team (FY2025/26-Q1-Q2) board.Sep 29 2025, 2:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits