Page MenuHomePhabricator

upgrade moscovium (RT) to bullseye
Closed, ResolvedPublic

Description

perform an in-place upgrade of host moscovium, hosting https://rt.wikimedia.org from buster to bullseye

Related Objects

StatusSubtypeAssignedTask
OpenNone
In ProgressDzahn
ResolvedArnoldokoth
ResolvedArnoldokoth
ResolvedArnoldokoth
Resolvedeoghan
Resolvedandrea.denisse
Resolvedandrea.denisse
Resolvedhashar
ResolvedDzahn
ResolvedDzahn
ResolvedDzahn
ResolvedRequestDzahn
ResolvedDzahn
Resolvedeoghan
Resolvedeoghan
Resolvedeoghan
ResolvedDzahn
ResolvedDzahn
ResolvedDzahn
ResolvedNone
Resolvedhashar
ResolvedDzahn
Resolvedhashar
DeclinedNone
Resolvedhashar
ResolvedDzahn
ResolvedDzahn
ResolvedDzahn
ResolvedDzahn
ResolvedJclark-ctr
ResolvedBUG REPORThashar
ResolvedJelto
ResolvedDzahn
ResolvedLegoktm
ResolvedDzahn
ResolvedMoritzMuehlenhoff
InvalidNone

Event Timeline

Dzahn changed the task status from Open to In Progress.Mar 23 2023, 10:13 PM
Dzahn triaged this task as High priority.

[2023-03-23T21:57:30Z] <mutante> moscovium - apt-get upgrade (rt.wikimedia.org going into maintenance) T327068

[2023-03-23T22:00:53Z] <mutante> moscovium - apt-get full-upgrade ; apt autoremove ; replace buster with bullseye in sources.list ; repeat apt-get upgrade/full-upgrade etc. (https://wiki.debian.org/DebianUpgrade)

[2023-03-23T22:09:28Z] <mutante> moscovium - when doing an in-place upgrade from buster to bullseye and you replace the string in sources.list, you also need to replace "bullseye-updates" with "bullseye-security" in the security.debian.org lines - that this is needed is called a bug at https://shagain.club/index.php/archives/641/ -

Mentioned in SAL (#wikimedia-operations) [2023-03-23T22:20:29Z] <mutante> moscovium performing apt-get full-upgrade T332952

Mentioned in SAL (#wikimedia-operations) [2023-03-23T22:30:32Z] <mutante> moscovium - rebooting to finalize distro release upgrade - T332952

Done! So the steps were ~:

systemctl stop rsync (after cleanup of migration stuff)
apt-get update (ensure first everything within buster is upgraded)
apt-get upgrade
apt-get full-upgrade
apt autoremove
disable-puppet 'dzahn' (stop puppet from messing with APT source files and other stuff)
vi /etc/apt/sources.list (s/buster/bullseye/g)
vi /etc/apt/sources.list.d/wikimedia.list
vi /etc/apt/sources.list.d/debian-backports.list
vi /etc/apt/sources.list.d/debian-debug.list
apt-get clean
apt-get update (an error appears that ""bullseye-updates" has no release file", fix with 's/bullseye-updates/bullseye-security but only in the lines including security.debian.org)
vi /etc/apt/sources.list
apt-get update (error gone)
apt-get upgrade (actual upgrade starts)
apt-get full-upgrade (the interesting part starts where you have to answer a bunch of questions which config files to keep and which to overwrite, puppet will of course again overwrite certain things after it's enabled again)
apt-get autoremove
shutdown -r now
run-puppet-agent (will revert some things, remove some old packages as well via base class)


22:38 < somiaj> !bullseye/updates
22:38 < dpkg> There is no "bullseye/updates" repository for security updates. To reduce confusion with <bullseye-updates> (which is for other bug fixes), security updates are distributed via the 
              <bullseye-security> repository "deb http://deb.debian.org/debian-security bullseye-security main". Note that you may also need to adjust your Default-Release and pinning settings for apt.

22:38 < somiaj> .. though when upgrading you should really read the release notes. https://www.debian.org/releases/stable/i386/release-notes/ch-upgrading.en.html
22:39 < somiaj> hmm, surprised the release notes don't mention the security change
22:40 < somiaj> https://www.debian.org/releases/stable/i386/release-notes/ch-information.en.html#security-archive -- oh nevermind it is there, just not where I expected it

https://rt.wikimedia.org/ - up and login works, see tickets as normal

[moscovium:~] $ uname -a
Linux moscovium 5.10.0-21-amd64 #1 SMP Debian 5.10.162-1 (2023-01-21) x86_64 GNU/Linux
[moscovium:~] $ lsb_release -c
Codename:	bullseye
Dzahn added subscribers: joanna_borun, MoritzMuehlenhoff.

@joanna_borun @MoritzMuehlenhoff moscovium (rt.wikimedia.org) can be removed off the list (or rather, added to the list of things achieved in sprint)