< T252432: Drop MediaWiki testing in stretch and instead test only in buster | T362705: Migrate Quibble images from bullseye to bookworm >
The images based on sury.org have been migrated from Buster to Bullseye on July 11th after sury.org dropped support for Buster: T369146.
Wikimedia production still uses php 7.4 and Buster, as of July 2024.
Change 914316 had a related patch set uploaded (by Jforrester; author: Jforrester):
[integration/config@master] [WIP] Docker: Provide bullseye-based Quibble images
Change 914316 abandoned by Hashar:
[integration/config@master] [WIP] Docker: Provide bullseye-based Quibble images
Reason:
The production PHP 7.4 packages are only available on Buster for now. There is a work in progress to first migrate to libicu 67 T345561 which should open the path to port php 7.4 to Bullseye.
Change 914316 restored by Hashar:
[integration/config@master] [WIP] Docker: Provide bullseye-based Quibble images
Change 914316 abandoned by Hashar:
[integration/config@master] Docker: Provide bullseye-based Quibble images
Reason:
Change #914316 restored by Jforrester:
[integration/config@master] Docker: Provide bullseye-based Quibble images
Change #1020299 had a related patch set uploaded (by Jforrester; author: Jforrester):
[integration/config@master] jjb: Migrate all quibble-based jobs from buster to bullseye
Change #914316 merged by jenkins-bot:
[integration/config@master] Docker: Provide bullseye-based Quibble images
Change #1020299 merged by jenkins-bot:
[integration/config@master] jjb: Migrate all quibble-based jobs from buster to bullseye
Current state:
Quibble-buster images work but can't be updated
E: The repository 'http://mirrors.wikimedia.org/debian buster-backports Release' does not have a Release file.
That is because the SRE base image provides the buster-backports component which has been removed by Debian.org.
That is tracked by T362518
Change #1038913 had a related patch set uploaded (by Jforrester; author: Jforrester):
[integration/config@master] [DNM] jjb: Switch all Quibble jobs from buster to bullseye
Mentioned in SAL (#wikimedia-releng) [2024-06-04T22:12:51Z] <James_F> Zuul: Tried rolling mediawiki-quibble-composer-mysql-php74 to bullseye to test T335766, but still failing with "Cannot start ChromeHeadless … Multiple targets are not supported". Reverted.
I finally start having some cycles to look into the Buster → Bullseye transition. My understanding is production baremetal still runs Buster and I don't know what is used for MW-on-K8s , I imagine they might already have migrated the base images to Bullseye. From some earlier OS upgrade we did, one of the thing to care of was the libICU upgrade (unicode support), on CI we would also have Chromium upgraded which might cause Karma/QUnit or webdriver.io to require some adjustments.
I have rebuild the Quibble images 3 days ago, we can get the list of installed packages with dpkg --show for both the Buster and Bullseye images:
docker run --rm -it --entrypoint=dpkg-query docker-registry.wikimedia.org/releng/quibble-buster-php74:1.9.0 --show docker run --rm -it --entrypoint=dpkg-query docker-registry.wikimedia.org/releng/quibble-bullseye-php74:1.9.0 --show
I have looked at the list of packages we manually install from our Dockerfiles:
| Package | Buster | Bullseye | Notes |
|---|---|---|---|
| Chromium | 90.0.4430.212 | 120.0.6099.224 | |
| ffmpeg | 4.1.11 | 4.3.6 | Video capture by wdio-mediawiki |
| firefox-esr | 115.12.0 | 115.12.0 | Luckily identical |
| git | 2.20.1 | 2.30.2 | Should be fine |
| libicux | 63.1 | 67.1 | This might break tests here and there |
| mariadb | 10.3.39 | 10.5.23 | |
| postgresql | 11+200 | 13+225 | |
| python | 3.7.3 | 3.9.3 | Affects Quibble, it should support it just fine |
| ruby | 2.5.1 | 2.7 | Affects jsduck which is phased out but might still be in releases branches |
The php packages seems to be kept in sync, though the Bullseye one have one more patch (version suffix is wmf10 for Buster, wmf11 for Bullseye).
Bare metal MW is never going to be migrated. The mw-on-k8s migration is T356293, blocked on this task being done.
Change #1051721 had a related patch set uploaded (by Hashar; author: Jforrester):
[integration/config@master] Dockerfiles: [quibble-buster-php74] Fix libICU to 67 not 63
Change #1051721 merged by jenkins-bot:
[integration/config@master] Dockerfiles: [quibble-buster-php74] Fix libICU to 67 not 63
Change #1053325 had a related patch set uploaded (by Hashar; author: Hashar):
[integration/config@master] jjb: switch Quibble php74 jobs to libICU 67
Mentioned in SAL (#wikimedia-releng) [2024-07-10T14:20:13Z] <hashar> Switching Quibble php7.4 jobs to lib ICU 67 # T335766 T345561
Change #1053325 merged by jenkins-bot:
[integration/config@master] jjb: switch Quibble php74 jobs to libICU 67
Change #1053347 had a related patch set uploaded (by Hashar; author: Hashar):
[integration/config@master] jjb: switch php8 Quibble jobs to Bullseye
Mentioned in SAL (#wikimedia-operations) [2024-07-11T08:30:51Z] <hashar> Switched CI Quibble and Phan jobs based on PHP 8.1, 8.2 and 8.3 from Buster to Bullseye - T335766 T366799 T369146
Change #1053347 merged by jenkins-bot:
[integration/config@master] jjb: switch php8 Quibble jobs to Bullseye
Status as of 2024-09-23:
Change #1038913 abandoned by Jforrester:
[integration/config@master] [DNM] jjb: Switch all Quibble PHP 7.4 jobs from buster to bullseye
Reason:
Instead, we'll just drop 7.4 ASAP.
Stalled waiting for Wikimedia production to fully and finally switch off the last PHP 7.4 boxes, at which point we'll drop the 7.4/buster images from CI.
Production has pretty much migrated everything and maintenance scripts are the last one to move.
Our Buster image has:
deb http://apt.wikimedia.org/wikimedia buster-wikimedia component/icu67
That is the backport of libicu 67 from Bullseye to upgrade version 63 that comes with Buster.
The image has libpcre2-8-0 package at version 10.32.5 whereas Bullseye has 10.36.2. But maybe it is not an issue for maintenance script. Of course there would be other differences such as Firefox/Chromium versions changing :/
It thus might be wiser to just wait a little bit more.