Toolforge: migrate bastions to Debian Buster
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	aborrero
	Feb 26 2021, 11:37 AM

Description

Toolforge (and toolsbeta) bastions run Debian Stretch. We need to migrate them to Debian Buster.

Details

Subject	Repo	Branch	Lines +/-
toolforge.exec_environ: use libnode-dev on buster	operations/puppet	production	+1 -1
toolforge.exec_environ: add tests	operations/puppet	production	+10 -0
toolforge.genpp: add buster repos	operations/puppet	production	+299 -140
toolforge: Add buster specific packages/setting	operations/puppet	production	+256 -151
misctools: switch away from python3-mysql.connector to python3-mysqldb	labs/toollabs	master	+3 -4
toolforge: initial support for Debian Buster on bastions	operations/puppet	production	+17 -7

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Andrew	T289883 cloud-vps: actively deprecate/phase out use of Debian Stretch
Resolved	taavi	T306099 Cloud VPS "tools" project Stretch deprecation
Resolved	taavi	T306100 Cloud VPS "toolsbeta" project Stretch deprecation
Resolved	taavi	T275864 Toolforge: migrate to Debian Buster or later
Resolved	aborrero	T275865 Toolforge: migrate bastions to Debian Buster
Invalid	aborrero	T276040 Puppet failure on toolsbeta-bastion-05.toolsbeta.eqiad1.wikimedia.cloud
Resolved	taavi	T282949 Wheel of Misfortune should provide bastion host details

Event Timeline

aborrero triaged this task as Medium priority.Feb 26 2021, 11:37 AM

aborrero created this task.

aborrero moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.

Mentioned in SAL (#wikimedia-cloud) [2021-02-26T11:39:45Z] <arturo> created puppet prefix 'toolsbeta-bastion' to hold new configuration for buster-based bastions (T275865)

taavi added a project: Toolforge.Feb 26 2021, 11:39 AM

Mentioned in SAL (#wikimedia-cloud) [2021-02-26T11:46:26Z] <arturo> openstack server create --os-project-id toolsbeta --image debian-10.0-buster --flavor g2.cores2.ram4.disk40 --network lan-flat-cloudinstances2b --property description='buster bastion test' toolsbeta-bastion-05 (T275865)

Change 667144 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] toolforge: initial support for Debian Buster on bastions

https://gerrit.wikimedia.org/r/667144

gerritbot added a project: Patch-For-Review.Feb 26 2021, 12:02 PM

dcaro added a subtask: T276040: Puppet failure on toolsbeta-bastion-05.toolsbeta.eqiad1.wikimedia.cloud.Mar 1 2021, 10:04 AM

aborrero closed subtask T276040: Puppet failure on toolsbeta-bastion-05.toolsbeta.eqiad1.wikimedia.cloud as Invalid.Mar 2 2021, 9:53 AM

Mentioned in SAL (#wikimedia-cloud) [2021-03-11T12:33:00Z] <arturo> livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/667144 for T275865

Mentioned in SAL (#wikimedia-operations) [2021-03-11T13:03:51Z] <arturo> copy python-mwclient 0.8.4-1 from stretch-wikimedia to buster-wikimedia for T275865

Mentioned in SAL (#wikimedia-cloud) [2021-03-11T13:10:50Z] <arturo> add jobutils 1.40 to buster-tools aptly repo for T275865

Mentioned in SAL (#wikimedia-cloud) [2021-03-11T13:11:25Z] <arturo> add misctools 1.37 to buster-tools|toolsbeta aptly repo for T275865

Change 667144 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] toolforge: initial support for Debian Buster on bastions

https://gerrit.wikimedia.org/r/667144

Maintenance_bot removed a project: Patch-For-Review.Mar 11 2021, 2:10 PM

Change 670859 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/toollabs@master] misctools: switch away from python3-mysql.connector to python3-mysqldb

https://gerrit.wikimedia.org/r/670859

gerritbot added a project: Patch-For-Review.Mar 11 2021, 4:22 PM

Change 670859 merged by Arturo Borrero Gonzalez:
[labs/toollabs@master] misctools: switch away from python3-mysql.connector to python3-mysqldb

https://gerrit.wikimedia.org/r/670859

Maintenance_bot removed a project: Patch-For-Review.Mar 11 2021, 5:12 PM

FYI, I looked up list-user-databases. It is part of an ancient method of removing tools https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Deleting_a_tool. It no longer works with the authentication model of the wikireplicas. It's likely been broken for years. It should just be dropped.

A new tool-deleting process would better be done very differently (and some parts might honestly need cookbooks to go smoothly until a better volunteer-usable process is added).

Mentioned in SAL (#wikimedia-cloud) [2021-03-17T10:34:03Z] <arturo> re-create toolsbeta-bastion-05 (T275865)

This basically works!

Well, what works is the supporting puppet code. I'll leave the task open until actual migration of all VM is completed.

Mentioned in SAL (#wikimedia-cloud) [2021-03-30T11:05:40Z] <arturo> created VM tools-sgebastion-10 as Debian Buster (T275865)

Mentioned in SAL (#wikimedia-cloud) [2021-04-08T09:12:58Z] <arturo> created tools-sgebastion-11 (buster) (T275865)

Mentioned in SAL (#wikimedia-cloud) [2021-04-08T09:20:40Z] <arturo> associate floating IP 185.15.56.66 to tools-sgebastion-10 (T275865)

Mentioned in SAL (#wikimedia-cloud) [2021-04-08T09:22:10Z] <arturo> create DNS A record login-buster.toolforge.org pointing to 185.15.56.66 (tools-sgebastion-10) (T275865)

Mentioned in SAL (#wikimedia-cloud) [2021-04-08T09:24:14Z] <arturo> allocate & associate floating IP 185.15.56.122 for tools-sgebastion-11, also with DNS A record dev-buster.toolforge.org (T275865)