Page MenuHomePhabricator

Migrate all CI jobs from stretch to buster or later and drop stretch testing support
Closed, ResolvedPublic

Description

< T224908: Drop jessie testing support | T335765: Migrate all CI jobs from buster to bullseye or later and drop buster testing support >

rg stretch dockerfiles/*/control -l | sed 's/dockerfiles\//\[ \] /' | sed 's/\/control//' | sort

  • ci-stretch – obviously
  • tox and child images (tox-acme-chief, tox-cergen, tox-mysqld, tox-poolcounter, tox-pyspark). See T278203#9139708 below.

Done

  • cassandra311 – doesn't even extend from ci-stretch(!) {T335780}

Details

SubjectRepoBranchLines +/-
integration/configmaster+0 -129
integration/configmaster+1 -398
integration/configmaster+1 -1
integration/configmaster+9 -2
integration/configmaster+1 -1
integration/configmaster+4 -4
integration/configmaster+2 -1
integration/configmaster+10 -3
integration/configmaster+7 -1
integration/configmaster+4 -4
integration/configmaster+9 -4
integration/configmaster+1 -115
integration/configmaster+17 -0
integration/configmaster+1 -1
integration/configmaster+5 -8
integration/configmaster+6 -6
integration/configmaster+60 -2
integration/configmaster+10 -4
integration/configmaster+1 -28
integration/configmaster+4 -74
integration/configmaster+3 -3
integration/configmaster+3 -3
integration/configmaster+7 -1
integration/pipelinelibmaster+1 -1
integration/configmaster+1 -1
integration/configmaster+21 -0
integration/configmaster+9 -2
integration/configmaster+71 -71
integration/configmaster+226 -3
integration/configmaster+88 -88
integration/configmaster+96 -6
integration/configmaster+1 -1
integration/configmaster+8 -2
integration/configmaster+1 -1
integration/configmaster+1 -1
integration/configmaster+8 -2
integration/configmaster+0 -12
integration/configmaster+17 -17
integration/configmaster+45 -11
integration/configmaster+1 -1
integration/configmaster+8 -2
integration/configmaster+6 -6
integration/configmaster+378 -0
Show related patches Customize query in gerrit

Related Objects

StatusSubtypeAssignedTask
Resolvedhashar
ResolvedJdforrester-WMF
InvalidNone
ResolvedLadsgroup
ResolvedJdforrester-WMF
ResolvedDzahn
Resolvedhashar
ResolvedJdforrester-WMF
ResolvedLadsgroup
ResolvedMoritzMuehlenhoff
Resolvedjijiki
ResolvedMoritzMuehlenhoff
ResolvedTrizek-WMF
ResolvedDzahn
Resolved Gilles
ResolvedDzahn
ResolvedRequestPapaul
Resolvedjijiki
DeclinedNone
ResolvedDzahn
ResolvedDzahn
ResolvedPapaul
Resolved Cmjohnson
ResolvedRequest Cmjohnson
ResolvedRequestPapaul
ResolvedAndrew
ResolvedArielGlenn
ResolvedDzahn
ResolvedLegoktm
ResolvedPapaul
ResolvedDzahn
Declined Gilles
ResolvedVolans
ResolvedDzahn
ResolvedLegoktm
ResolvedEjegg
ResolvedRequesthashar
Resolvedhashar

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change 898789 merged by jenkins-bot:

[integration/pipelinelib@master] blubber: update base image to Gradle 4.4.1

https://gerrit.wikimedia.org/r/898789

hashar subscribed.

I have fixed gradle and updated it to Bullseye.

helm-linter got updated ages ago.

For typos I think we should phase it out. IIRC it is a shell one linter and it is only used by operations/mediawiki-config so we can move the shell line to tox for example.

Change 899505 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: upgrade castor Stretch Bullseye

https://gerrit.wikimedia.org/r/899505

Change 899508 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: switch jobs to releng/castor:0.3.0

https://gerrit.wikimedia.org/r/899508

Change 899505 merged by jenkins-bot:

[integration/config@master] dockerfiles: upgrade castor Stretch > Bullseye

https://gerrit.wikimedia.org/r/899505

Mentioned in SAL (#wikimedia-releng) [2023-03-16T10:48:38Z] <hashar> Updating all jobs to switch Castor from Stretch to Bullseye based image | https://gerrit.wikimedia.org/r/c/integration/config/+/899508/ | T278203

Change 899508 merged by jenkins-bot:

[integration/config@master] jjb: switch jobs to releng/castor:0.3.0

https://gerrit.wikimedia.org/r/899508

Change 914330 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: update Depends in control files

https://gerrit.wikimedia.org/r/914330

Change 914330 merged by jenkins-bot:

[integration/config@master] dockerfiles: update Depends in control files

https://gerrit.wikimedia.org/r/914330

For docker.wikimedia.org/releng/cassandra311 I have filed T335780

hashar added a subtask: Restricted Task.

Change 914715 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] Archive analytics/wikistats and drop perl image

https://gerrit.wikimedia.org/r/914715

Change 914715 merged by jenkins-bot:

[integration/config@master] Archive analytics/wikistats and drop perl image

https://gerrit.wikimedia.org/r/914715

hashar closed subtask Restricted Task as Resolved.May 15 2023, 9:14 AM

Change 928102 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] Revert "Dockerfiles: [maven-java8] Update gerrit.wikimedia.org IP"

https://gerrit.wikimedia.org/r/928102

Change 928102 merged by jenkins-bot:

[integration/config@master] Revert "Dockerfiles: [maven-java8] Update gerrit.wikimedia.org IP"

https://gerrit.wikimedia.org/r/928102

With https://gerrit.wikimedia.org/r/c/operations/puppet/+/953201 , SRE is no more building fresh Stretch images (which makes sense since it stopped receiving updates).

Change 954302 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: update zuul-cloner from Stretch to Buster

https://gerrit.wikimedia.org/r/954302

Change 767877 merged by jenkins-bot:

[integration/config@master] dockerfiles: [zuul-cloner] Migrate from stretch to buster

https://gerrit.wikimedia.org/r/767877

Mentioned in SAL (#wikimedia-releng) [2023-09-01T15:07:44Z] <hashar> Successfully published image docker-registry.wikimedia.org/releng/zuul-cloner:0.3.0 # T278203

Change 954318 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: java8 from Stretch to Bullseye and cascade

https://gerrit.wikimedia.org/r/954318

For Java I picked Bullseye rather than Buster as a base image.

The releng/java8:1.0-s1 image had:

openjdk version "1.8.0_302"
OpenJDK Runtime Environment (build 1.8.0_302-8u302-b08-1~deb9u1-b08)
OpenJDK 64-Bit Server VM (build 25.302-b08, mixed mode)

With https://gerrit.wikimedia.org/r/954318, the Bullseye forward port has:

openjdk version "1.8.0_372"
OpenJDK Runtime Environment (build 1.8.0_372-8u372-ga-1~deb11u1-b07)
OpenJDK 64-Bit Server VM (build 25.372-b07, mixed mode)

I have no idea what it would break, so that has to be announced I guess. We internally have a Java Slack channel, that is probably a good fit.

Change 954318 merged by jenkins-bot:

[integration/config@master] dockerfiles: java8 from Stretch to Bullseye and cascade

https://gerrit.wikimedia.org/r/954318

Change 954601 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: java8 jobs from Stretch to Bullseye and cascade

https://gerrit.wikimedia.org/r/954601

Change 954601 merged by jenkins-bot:

[integration/config@master] jjb: java8 jobs from Stretch to Bullseye and cascade

https://gerrit.wikimedia.org/r/954601

Mentioned in SAL (#wikimedia-releng) [2023-09-04T09:24:51Z] <hashar> Switched Java8 Jenkins jobs base image from Stretch to Bullseye | https://gerrit.wikimedia.org/r/c/integration/config/+/954601 | T278203

Change 954606 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: remove zuul-cloner and submodules for mw core Phan job

https://gerrit.wikimedia.org/r/954606

Mentioned in SAL (#wikimedia-releng) [2023-09-04T09:59:13Z] <hashar> Removed git submodule processing from mediawiki/core Phan jobs ( mediawiki-core-php73-phan-docker mediawiki-core-php74-phan-docker mediawiki-core-php80-phan-docker mediawiki-core-php81-phan-docker ) | https://gerrit.wikimedia.org/r/954606 | T44455 | T278203

Change 954606 merged by jenkins-bot:

[integration/config@master] jjb: remove zuul-cloner and submodules for mw core Phan job

https://gerrit.wikimedia.org/r/954606

Change 954302 merged by jenkins-bot:

[integration/config@master] jjb: update zuul-cloner from Stretch to Buster

https://gerrit.wikimedia.org/r/954302

tox-cergen

Same as tox with the addition of Java 8 (which should be a tox-java8 image so we can reuse for Spark (see below).

tox-mysqld

With MariaDB + percona-toolkit (T261098) which was for operations/software/wmfmariadbpy but is no more needed ( T261098#6817841 ) since the test suite setups the environment (different db, percona etc). The repository uses the regular tox job already.

There are some other repositories using tox-mysqld so it should be kept but percona-toolkit can be removed

tox-poolcounter

With build-essential and libevent-dev. The image was created for mediawiki/services/poolcounter

tox-pyspark

With Java8 and a tarball of Spark with gpg verification. That can be refactored by:

Change 954680 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: tox + java8 on Buster

https://gerrit.wikimedia.org/r/954680

Change 954686 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] Remove tox-cergen and switch job to tox-java8

https://gerrit.wikimedia.org/r/954686

Change 954687 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: tox-pyspark to Buster

https://gerrit.wikimedia.org/r/954687

Change 954688 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: spark jobs to from Stretch to Buster

https://gerrit.wikimedia.org/r/954688

Change 954680 merged by jenkins-bot:

[integration/config@master] dockerfiles: tox + java8 on Buster

https://gerrit.wikimedia.org/r/954680

Change 954686 merged by jenkins-bot:

[integration/config@master] Remove tox-cergen and switch job to tox-java8

https://gerrit.wikimedia.org/r/954686

Change 954687 merged by jenkins-bot:

[integration/config@master] dockerfiles: tox-pyspark to Buster

https://gerrit.wikimedia.org/r/954687

Change 954688 merged by jenkins-bot:

[integration/config@master] jjb: spark jobs to from Stretch to Buster

https://gerrit.wikimedia.org/r/954688

Change 954713 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: remove tox image, replaced by tox-buster

https://gerrit.wikimedia.org/r/954713

Change 954714 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: sample-workspace-sizes job from Stretch to Bullseye

https://gerrit.wikimedia.org/r/954714

Change 954716 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: remove ci-stretch, no more used

https://gerrit.wikimedia.org/r/954716

Change 954718 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: remove percona-toolkit from tox-mysqld

https://gerrit.wikimedia.org/r/954718

Change 954719 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: tox-mysqld to Buster

https://gerrit.wikimedia.org/r/954719

Change 954718 merged by jenkins-bot:

[integration/config@master] dockerfiles: remove percona-toolkit from tox-mysqld

https://gerrit.wikimedia.org/r/954718

Change 954719 merged by jenkins-bot:

[integration/config@master] dockerfiles: tox-mysqld to Buster

https://gerrit.wikimedia.org/r/954719

Change 954723 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: tox-mysqld use mariadb-server package name

https://gerrit.wikimedia.org/r/954723

Change 954723 merged by jenkins-bot:

[integration/config@master] dockerfiles: tox-mysqld use mariadb-server package name

https://gerrit.wikimedia.org/r/954723

Change 954725 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: update tox-mysqld jobs to Buster

https://gerrit.wikimedia.org/r/954725

For the remaining tox jobs:

fundraising-tools-tox-docker passed on https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/tools/+/954747

labs-tools-map-of-monuments-tox-docker passed on https://gerrit.wikimedia.org/r/c/labs/tools/map-of-monuments/+/954749

wikimedia-cz-tracker-tox-docker broke due the repo previously failing CI but reverting the faulty commit fixed it https://gerrit.wikimedia.org/r/c/wikimedia-cz/tracker/+/954631

labs-tools-wikinity-tox-docker to be investigated.

Change 954725 merged by jenkins-bot:

[integration/config@master] jjb: update tox-mysqld jobs to Buster

https://gerrit.wikimedia.org/r/954725

labs-tools-wikinity-tox-docker to be investigated.

That failure is an aftermath of the tox 4 upgrade (T345152) and I have filed it as T345607.

Change 954714 merged by jenkins-bot:

[integration/config@master] jjb: sample-workspace-sizes job from Stretch to Bullseye

https://gerrit.wikimedia.org/r/954714

Change 954895 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] dockerfiles: tox-poolcounter to Buster

https://gerrit.wikimedia.org/r/954895

Change 954895 merged by jenkins-bot:

[integration/config@master] dockerfiles: tox-poolcounter to Buster

https://gerrit.wikimedia.org/r/954895

Change 954906 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: update poolcounter tox job to Buster

https://gerrit.wikimedia.org/r/954906

Change 954906 merged by jenkins-bot:

[integration/config@master] jjb: update poolcounter tox job to Buster

https://gerrit.wikimedia.org/r/954906

Change 954713 merged by jenkins-bot:

[integration/config@master] dockerfiles: remove tox image, replaced by tox-buster

https://gerrit.wikimedia.org/r/954713

Change 954716 merged by jenkins-bot:

[integration/config@master] dockerfiles: remove ci-stretch, no more used

https://gerrit.wikimedia.org/r/954716

hashar claimed this task.

Stretch images are gone from integration/config.git.

The CiviCRM repository is still tested with Stretch, that is being addressed by T307178