[infra] Toolforge: migrate to Debian Bullseye or later
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	taavi
	Jul 2 2022, 6:18 AM

Description

< T275864: Toolforge: migrate to Debian Buster or later || T387005: [infra] Toolforge: migrate to Debian Bookworm or later >

This is the meta-task to track work (subtasks) to migrate Toolforge system to Debian Bullseye or later.

Remaining instances: tools toolsbeta

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		None	T360699 Toolsbeta: migrate to Debian Bullseye or later
Resolved		taavi	T311897 [infra] Toolforge: migrate to Debian Bullseye or later
Resolved		Andrew	T311905 Upgrade Toolforge (Elastic\|Open)Search cluster to Debian Bullseye
Resolved		taavi	T311907 Upgrade Toolforge acme-chief hosts to Debian Bullseye or later
Resolved		taavi	T311908 Migrate Toolforge Kubernetes hosts to Debian Bullseye or later
Resolved		taavi	T284656 Toolforge k8s: Migrate workers to Containerd and Bookworm
Resolved		taavi	T349795 Upgrade cadvisor
Resolved		taavi	T350227 toolforge prometheus servers OOMing
Resolved		taavi	T357901 Request increased server-group-members quota for tools
Resolved		• aborrero	T358476 toolforge k8s: some static pods needs manual restart
Resolved		taavi	T349206 [infra] Upgrade Toolforge K8s haproxies to Bookworm
Resolved		Andrew	T349207 [infra] Upgrade Toolforge K8s etcd nodes to Bullseye
Resolved		taavi	T311909 Upgrade Toolforge legacy URL redirectors to Debian Bullseye or later
Resolved		taavi	T311910 Upgrade Toolforge mail server to Debian Bullseye or later
Resolved		taavi	T311911 Upgrade Toolforge Prometheus servers to Debian Bullseye or later
Resolved		• nskaggs	T312692 Request increased quota for tools Cloud VPS project
Resolved		Andrew	T311912 Upgrade Toolforge Puppet infrastructure to Debian Bullseye or later
Resolved		Andrew	T351494 Migrate Toolforge to Puppet 7
Resolved		taavi	T311913 Upgrade Toolforge static server (tools-static.wmflabs.org) to Debian Bookworm
Resolved		dcaro	T311914 Upgrade Toolforge apt repository (tools-services hosts) to Debian Bullseye or later
Resolved		taavi	T358483 Upgrade Toolforge image builder to Bookworm
Resolved		taavi	T314665 Toolforge: Replace all bastion with grid-less bookworm based bastion hosts
Stalled		None	T356377 [toolforge] simplify calling the different toolforge apis from within the containers
Stalled		None	T356262 [jobs-cli,builds-cli,toolforge-cli,webservice] Consolidate the Toolforge CLIs
Open		None	T356261 [toolforge-cli,jobs-cli,builds-cli,envvars-cli] Explore OpenAPI SDK tooling for client consolidation
Open		None	T398651 [toolforge-cli-gen] review the https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli client as potential consolidation
Resolved		Slst2020	T354745 [jobs-api,buildservice-api,envvars-api] Investigate ways to present our multiple Openapi definitions to a future consolidated CLI client
Resolved		Slst2020	T358100 [toolforge API] expose all backend APIs OpenAPI specs
Resolved		• aborrero	T356523 [jobs-api] introduce OpenAPI to jobs framework
Resolved		Slst2020	T362299 [api-gateway] Add a python server to serve consolidated openapi docs
Declined		None	T369693 [toolforge, toolforge-cli] Experiment with PyInstaller to package CLI tools for buildpack images
Resolved	BUG REPORT	dcaro	T369569 `webservice` requires effective user to be the tool user and listed in NSS passwd data
Resolved	BUG REPORT	dcaro	T369573 `toolforge jobs` requires current user to be the tool user and listed in NSS passwd data
Resolved	BUG REPORT	None	T360488 Missing Perl packages on dev.toolforge.org for anomiebot workflows
Resolved		dcaro	T371556 Please re-install "joe"
Resolved		taavi	T397459 Lock down tools-sgebastion-10 (login-buster.toolforge.org) to only members of tools with known dependencies on it
Resolved		taavi	T360514 Upgrade toolschecker hosts to bookworm
Resolved		taavi	T361030 Upgrade Toolforge Docker registry to bookworm
Resolved		taavi	T361223 Upgrade Toolforge front proxies to Bookworm
Resolved		taavi	T314664 [infra] Decommission the Grid Engine infrastructure
Resolved		komla	T313405 Migrate remaining tools off Gridengine
Declined		None	T316124 Make Grid Engine tooling emit deprecation warnings
Resolved		taavi	T329619 Toolforge: decide what to do with tools that have 'stretch' in their service manifests
Resolved		Andrew	T353351 Provide tools for disabling the grid for specific tools
Resolved		Andrew	T353642 Relocate disable-tool-archive-dbs.service
Resolved		taavi	T358333 Remove toolschecker grid engine checks
Resolved		taavi	T359934 [infra] Archive grid engine related infrastructure tools
Resolved		taavi	T359935 [infra] Archive grid engine related Gerrit repositories

Event Timeline

taavi created this task.Jul 2 2022, 6:18 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 2 2022, 6:18 AM

taavi mentioned this in T275864: Toolforge: migrate to Debian Buster or later.Jul 2 2022, 6:20 AM

taavi changed the status of subtask T314664: [infra] Decommission the Grid Engine infrastructure from Open to Stalled.Aug 5 2022, 2:19 PM

RhinosF1 subscribed.Aug 5 2022, 2:20 PM

taavi closed subtask T311911: Upgrade Toolforge Prometheus servers to Debian Bullseye or later as Resolved.Sep 23 2022, 12:59 PM

TheresNoTime removed a subscriber: RhinosF1.Dec 15 2022, 11:35 PM

fnegri edited projects, added cloud-services-team; removed cloud-services-team (Kanban).Jan 18 2023, 6:38 PM

fnegri moved this task from Kanban to Inbox on the cloud-services-team board.

taavi added a project: Cloud-VPS (Debian Buster Deprecation).Jan 29 2023, 10:21 AM

taavi updated the task description. (Show Details)

taavi moved this task from Unsorted to WMCS infrastructure on the Cloud-VPS (Debian Buster Deprecation) board.

fnegri moved this task from Inbox to Epics on the cloud-services-team board.Jan 22 2024, 6:07 PM

fnegri edited projects, added Goal, cloud-services-team (FY2023/2024-Q3-Q4); removed cloud-services-team.Feb 1 2024, 11:20 AM

taavi closed subtask T311910: Upgrade Toolforge mail server to Debian Bullseye or later as Resolved.Feb 6 2024, 1:59 PM

dcaro changed the status of subtask T358483: Upgrade Toolforge image builder to Bookworm from Open to In Progress.Mar 5 2024, 9:35 AM

taavi added a subtask: T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts.Mar 13 2024, 12:30 PM

taavi changed the status of subtask T314664: [infra] Decommission the Grid Engine infrastructure from Stalled to In Progress.Mar 14 2024, 10:55 AM

taavi closed subtask T358483: Upgrade Toolforge image builder to Bookworm as Resolved.Mar 16 2024, 5:24 PM

taavi changed the status of subtask T311913: Upgrade Toolforge static server (tools-static.wmflabs.org) to Debian Bookworm from Open to In Progress.Mar 18 2024, 11:23 AM

taavi closed subtask T311913: Upgrade Toolforge static server (tools-static.wmflabs.org) to Debian Bookworm as Resolved.Mar 19 2024, 11:23 AM

taavi changed the status of subtask T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts from Open to In Progress.Mar 19 2024, 2:07 PM

taavi closed subtask T311907: Upgrade Toolforge acme-chief hosts to Debian Bullseye or later as Resolved.Mar 20 2024, 1:39 PM

taavi closed subtask T360514: Upgrade toolschecker hosts to bookworm as Resolved.Mar 20 2024, 2:22 PM

taavi added a parent task: T360699: Toolsbeta: migrate to Debian Bullseye or later.Mar 21 2024, 7:38 PM

taavi removed a subtask: T360419: Upgrade toolsbeta-nfs to Debian Bullseye/Bookworm.

taavi changed the status of subtask T311909: Upgrade Toolforge legacy URL redirectors to Debian Bullseye or later from Open to In Progress.Mar 22 2024, 11:44 AM

taavi changed the status of subtask T361030: Upgrade Toolforge Docker registry to bookworm from Open to In Progress.Mar 26 2024, 6:21 PM

taavi closed subtask T311909: Upgrade Toolforge legacy URL redirectors to Debian Bullseye or later as Resolved.Mar 27 2024, 12:20 PM

taavi closed subtask T311912: Upgrade Toolforge Puppet infrastructure to Debian Bullseye or later as Resolved.Mar 27 2024, 1:46 PM

taavi closed subtask T361030: Upgrade Toolforge Docker registry to bookworm as Resolved.Apr 2 2024, 7:54 AM

taavi closed subtask T361223: Upgrade Toolforge front proxies to Bookworm as Resolved.Apr 5 2024, 12:31 PM

dcaro changed the status of subtask T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts from In Progress to Stalled.Apr 17 2024, 2:08 PM

dcaro changed the status of subtask T314664: [infra] Decommission the Grid Engine infrastructure from In Progress to Stalled.Apr 30 2024, 1:27 PM

taavi closed subtask T311908: Migrate Toolforge Kubernetes hosts to Debian Bullseye or later as Resolved.Jun 27 2024, 9:14 PM

dcaro triaged this task as High priority.Jul 4 2024, 4:07 PM

dcaro edited projects, added Toolforge (Toolforge iteration 12); removed Toolforge.

dcaro edited projects, added Toolforge (Toolforge iteration 13); removed Toolforge (Toolforge iteration 12).Jul 17 2024, 11:23 AM

Andrew closed subtask T311905: Upgrade Toolforge (Elastic|Open)Search cluster to Debian Bullseye as Resolved.Jul 17 2024, 7:29 PM

• joanna_borun edited projects, added cloud-services-team (FY2024/2025-Q1-Q2); removed cloud-services-team (FY2023/2024-Q3-Q4).Jul 22 2024, 10:02 AM

dcaro changed the status of subtask T311914: Upgrade Toolforge apt repository (tools-services hosts) to Debian Bullseye or later from Open to In Progress.Jul 22 2024, 4:03 PM

dcaro closed subtask T311914: Upgrade Toolforge apt repository (tools-services hosts) to Debian Bullseye or later as Resolved.Jul 22 2024, 5:19 PM

dcaro claimed this task.Jul 25 2024, 3:21 PM

dcaro moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q1-Q2) board.

dcaro edited projects, added Toolforge (Toolforge iteration 14); removed Toolforge (Toolforge iteration 13).Aug 5 2024, 7:40 AM

dcaro edited projects, added Toolforge (Toolforge iteration 15); removed Toolforge (Toolforge iteration 14).Sep 25 2024, 8:01 AM

dcaro edited projects, added Toolforge (Toolforge iteration 16); removed Toolforge (Toolforge iteration 15).Oct 15 2024, 7:33 AM

dcaro edited projects, added Toolforge (Toolforge iteration 17); removed Toolforge (Toolforge iteration 16).Jan 8 2025, 12:50 PM

fnegri edited projects, added cloud-services-team (FY2024/2025-Q3-Q4); removed cloud-services-team (FY2024/2025-Q1-Q2).Jan 14 2025, 2:37 PM

fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q3-Q4) board.

dcaro changed the status of subtask T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts from Stalled to In Progress.Jan 21 2025, 2:29 PM

taavi mentioned this in T387005: [infra] Toolforge: migrate to Debian Bookworm or later.Feb 21 2025, 10:23 AM

taavi updated the task description. (Show Details)

taavi removed a subtask: T375523: [toolforge-prometheus] upgrade to bookworm.Feb 21 2025, 10:26 AM

dcaro edited projects, added Toolforge (Toolforge iteration 18); removed Toolforge (Toolforge iteration 17).Feb 25 2025, 3:29 PM

dcaro edited projects, added Toolforge (Toolforge iteration 19); removed Toolforge (Toolforge iteration 18).Mar 18 2025, 3:56 PM

dcaro edited projects, added Toolforge (Toolforge iteration 20); removed Toolforge (Toolforge iteration 19).May 14 2025, 2:31 PM

dcaro renamed this task from Toolforge: migrate to Debian Bullseye or later to [infra] Toolforge: migrate to Debian Bullseye or later.May 22 2025, 9:36 AM

dcaro edited projects, added Toolforge (Toolforge iteration 21); removed Toolforge (Toolforge iteration 20).Jun 11 2025, 10:39 AM

dcaro updated the task description. (Show Details)Jun 19 2025, 2:00 PM

tedbot is now on Debian Bookworm.

taavi updated the task description. (Show Details)Jun 20 2025, 8:48 AM

dcaro edited projects, added Toolforge (Toolforge iteration 22); removed Toolforge (Toolforge iteration 21).Jul 14 2025, 9:49 AM

dcaro edited projects, added cloud-services-team (FY2025/2026-Q1-Q2); removed cloud-services-team (FY2024/2025-Q3-Q4).Jul 15 2025, 2:28 PM

dcaro edited projects, added Toolforge (Toolforge iteration 23); removed Toolforge (Toolforge iteration 22).Aug 5 2025, 3:46 PM

dcaro edited projects, added Toolforge (Toolforge iteration 24); removed Toolforge (Toolforge iteration 23).Aug 27 2025, 9:46 AM

taavi claimed this task.Sep 16 2025, 3:23 PM

taavi added a subscriber: dcaro.

taavi changed the status of subtask T314664: [infra] Decommission the Grid Engine infrastructure from Stalled to Open.Sep 16 2025, 3:44 PM

taavi closed this task as Resolved.Sep 18 2025, 6:47 AM