Page MenuHomePhabricator
Create Task
Maniphest T256877

Handle sunset of stretch-backports
Closed, ResolvedPublic
Actions

Description

backports is only available for Debian stable and oldstable and Debian stretch will move to LTS state in about a week. Packages which we were using from stretch-backports need to be migrate to components on apt.wikimedia.org.

  • Stretch Docker base image
  • librdkafka1 - eventlogging
  • osm2pgsql - osm
  • analytics - git-lfs
  • python3-prometheus-client-package - prometheus
  • systemd, systemd-sysv, udev, libsystemd0, libpam-systemd - systemd
  • npm - testreduce
  • libhwloc5 - trafficserver
  • librdkafka1 - varnishkafka
  • graphite-web - graphite
  • npm - testreduce T257906
  • lilypond - mediawiki
  • 'librados2', 'librgw2', 'librbd1', 'python-rados', 'python-rbd', 'ceph-common', 'python-cephfs', 'libradosstriper1' - openstack/queens&rocky

Non exhaustive list for CI (at least)

  • golang-1.11-go - CI tox-acme-chef image T257456
  • golang-1.11-go - docker-registry.wikimedia.org/golang:1.11 which is based on Stretch T261920
  • git 2.20.1 - git-protocol-v2 for CI and scap at least. T257308

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Jul 2 2020, 8:03 AM

Change 609104 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Unconditionally install systemd packages

https://gerrit.wikimedia.org/r/c/operations/puppet/ /609104

hashar added a comment.Jul 2 2020, 8:10 AM

I am wondering how to find packages that got installed from stretch-backports. Our base images have backports configured and one can borrow a package from it when it does not exist in stretch (an example is golang-1.11-go) or by specifying an explicit version pinning.

MoritzMuehlenhoff added a comment.Jul 2 2020, 8:20 AM
In T256877#6273759, @hashar wrote:

I am wondering how to find packages that got installed from stretch-backports.

Any package from backports should follow the "~bpo9+X" naming convention, so you should be able to find affected package versions in debmonitor.wikimedia.org

gerritbot added a comment.Jul 2 2020, 12:26 PM

Change 609100 merged by Muehlenhoff:
[operations/puppet@production] Remove obsolete pinning for libhwloc

https://gerrit.wikimedia.org/r/c/operations/puppet/ /609100

gerritbot added a comment.Jul 2 2020, 3:30 PM

Change 609181 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Create component/systemd241

https://gerrit.wikimedia.org/r/c/operations/puppet/ /609181

gerritbot added a comment.Jul 3 2020, 6:07 AM

Change 609181 merged by Muehlenhoff:
[operations/puppet@production] Create component/systemd241

https://gerrit.wikimedia.org/r/609181

gerritbot added a comment.Jul 3 2020, 12:45 PM

Change 609419 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] systemd/slice: Install systemd 241 from component/systemd241

https://gerrit.wikimedia.org/r/609419

gerritbot added a comment.Jul 3 2020, 12:47 PM

Change 609104 abandoned by Muehlenhoff:
[operations/puppet@production] Unconditionally install systemd packages

Reason:
In favour of https://gerrit.wikimedia.org/r/c/operations/puppet/ /609419/

https://gerrit.wikimedia.org/r/609104

gerritbot added a comment.Jul 3 2020, 12:58 PM

Change 609420 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove apt::pin for python3-prometheus-client-package

https://gerrit.wikimedia.org/r/609420

gerritbot added a comment.Jul 7 2020, 7:05 AM

Change 609420 merged by Elukey:
[operations/puppet@production] Remove apt::pin for python3-prometheus-client-package

https://gerrit.wikimedia.org/r/609420

MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 7:25 AM
aborrero subscribed.Jul 7 2020, 9:21 AM

@MoritzMuehlenhoff I'm now thinking this is going to happen with every single debian release (archival of the backports repo).

Perhaps a more sustainable way to approach this is to mirror the backports repo ourselves and drop a whole category of problems in the package management field.

gerritbot added a comment.Jul 7 2020, 10:33 AM

Change 609419 merged by Muehlenhoff:
[operations/puppet@production] systemd/slice: Install systemd 241 from component/systemd241

https://gerrit.wikimedia.org/r/609419

MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 10:36 AM
gerritbot added a comment.Jul 7 2020, 10:41 AM

Change 610015 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Stop installing git-lfs from stretch-backports

https://gerrit.wikimedia.org/r/610015

MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 10:43 AM
MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 12:10 PM
MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 12:15 PM
hashar mentioned this in T257308: Upload git 2.20 package from stretch-backports to component/git.Jul 7 2020, 12:15 PM
hashar added a subtask: T257308: Upload git 2.20 package from stretch-backports to component/git.
hashar updated the task description. (Show Details)Jul 7 2020, 12:20 PM
gerritbot added a comment.Jul 7 2020, 12:29 PM

Change 610043 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Drop Puppet code which tries to install graphite-web from stretch-bpo

https://gerrit.wikimedia.org/r/610043

MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 12:46 PM
gerritbot added a comment.Jul 7 2020, 12:46 PM

Change 610050 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Stop including backports in Stretch images

https://gerrit.wikimedia.org/r/610050

JMeybohm added a subtask: T257327: Rebuild wikimedia-stretch docker image for repository updates.Jul 7 2020, 2:48 PM
gerritbot added a comment.Jul 7 2020, 5:25 PM

Change 610043 merged by Muehlenhoff:
[operations/puppet@production] Drop Puppet code which tries to install graphite-web from stretch-bpo

https://gerrit.wikimedia.org/r/610043

MoritzMuehlenhoff updated the task description. (Show Details)Jul 7 2020, 5:27 PM
gerritbot added a comment.Jul 7 2020, 5:35 PM

Change 610120 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove obsolete apt::pin for librdkafka1 on eventlogging

https://gerrit.wikimedia.org/r/610120

gerritbot added a comment.Jul 8 2020, 7:22 AM

Change 610120 merged by Muehlenhoff:
[operations/puppet@production] Remove obsolete apt::pin for librdkafka1 on eventlogging

https://gerrit.wikimedia.org/r/610120

MoritzMuehlenhoff updated the task description. (Show Details)Jul 8 2020, 7:24 AM
MoritzMuehlenhoff closed subtask T257308: Upload git 2.20 package from stretch-backports to component/git as Resolved.Jul 8 2020, 1:32 PM
MoritzMuehlenhoff updated the task description. (Show Details)
hashar mentioned this in T257456: Change CI image for acme-chief from Stretch to Buster.Jul 8 2020, 1:49 PM
hashar updated the task description. (Show Details)
MoritzMuehlenhoff added a comment.Jul 8 2020, 1:53 PM
In T256877#6284764, @aborrero wrote:

@MoritzMuehlenhoff I'm now thinking this is going to happen with every single debian release (archival of the backports repo).

Perhaps a more sustainable way to approach this is to mirror the backports repo ourselves and drop a whole category of problems in the package management field.

Yes, that is a recurring issue, but mirroring something which intentionally vanishes isn't a solution. backports is explicitly designed as the stepstone to the next release, it's not a PPA-like mechanism or a library of old/abandoned code. Most of the patches merged for prod were actually dropping unused pins since the underlying service had moved to Buster in the mean time.

gerritbot added a comment.Jul 9 2020, 8:02 AM

Change 610015 merged by Muehlenhoff:
[operations/puppet@production] Stop installing git-lfs from stretch-backports

https://gerrit.wikimedia.org/r/610015

Stashbot added a comment.Jul 9 2020, 8:23 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-09T08:23:46Z] <moritzm> imported osm2pgsql 0.96.0+ds-1~bpo9+1 to "main" component T256877

gerritbot added a comment.Jul 9 2020, 8:27 AM

Change 610706 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] No longer install osm2pgsql from stretch-backports

https://gerrit.wikimedia.org/r/610706

MoritzMuehlenhoff updated the task description. (Show Details)Jul 9 2020, 8:56 AM
hashar closed subtask T257553: Audit stretch-backports usage in CI images as Resolved.Jul 9 2020, 2:50 PM
MoritzMuehlenhoff mentioned this in T257062: Lilypond seemingly not subject to restrictions (CVE-2020-29007).Jul 13 2020, 1:11 PM
gerritbot added a comment.Jul 13 2020, 2:33 PM

Change 610706 merged by Muehlenhoff:
[operations/puppet@production] No longer install osm2pgsql from stretch-backports

https://gerrit.wikimedia.org/r/610706

MoritzMuehlenhoff updated the task description. (Show Details)Jul 13 2020, 2:42 PM
aborrero added a comment.Jul 13 2020, 4:36 PM
In T256877#6289542, @MoritzMuehlenhoff wrote:
In T256877#6284764, @aborrero wrote:

@MoritzMuehlenhoff I'm now thinking this is going to happen with every single debian release (archival of the backports repo).

Perhaps a more sustainable way to approach this is to mirror the backports repo ourselves and drop a whole category of problems in the package management field.

Yes, that is a recurring issue, but mirroring something which intentionally vanishes isn't a solution. backports is explicitly designed as the stepstone to the next release, it's not a PPA-like mechanism or a library of old/abandoned code. Most of the patches merged for prod were actually dropping unused pins since the underlying service had moved to Buster in the mean time.

I think I understand your point. Cleanup is great, indeed. But not all we are doing is cleanup. Having a mirror or replica would relax pressure on us generated by external parties. I mean, this already happened in the past and can put a lot of pressure.

Having a mirror so we can decide when to do such cleanup and upgrading is something really interesting to consider.

MoritzMuehlenhoff updated the task description. (Show Details)Jul 14 2020, 12:45 PM
gerritbot added a comment.Jul 14 2020, 12:50 PM

Change 612568 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove apt pin for stretch-backports for npm

https://gerrit.wikimedia.org/r/612568

gerritbot added a comment.Jul 15 2020, 7:05 AM

Change 612568 merged by Muehlenhoff:
[operations/puppet@production] Remove apt pin for stretch-backports for npm

https://gerrit.wikimedia.org/r/612568

MoritzMuehlenhoff updated the task description. (Show Details)Jul 15 2020, 7:15 AM
akosiaris subscribed.Jul 16 2020, 9:25 AM

An exhaustive list of docker registry images that have bpo9 packages is at P11925 (alongside the script that generated them)

akosiaris mentioned this in T258155: Bump kask base images from stretch to buster.Jul 16 2020, 11:22 AM
akosiaris mentioned this in T258158: Bump zotero base images from stretch to buster.Jul 16 2020, 11:29 AM
akosiaris mentioned this in T258160: Bump blubberoid base images from stretch to buster.Jul 16 2020, 11:36 AM
akosiaris added a subtask: T258155: Bump kask base images from stretch to buster.
akosiaris added a subtask: T258158: Bump zotero base images from stretch to buster.
gerritbot added a comment.Jul 17 2020, 10:06 AM

Change 613611 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Disable backports on stretch

https://gerrit.wikimedia.org/r/613611

gerritbot added a comment.Jul 24 2020, 12:30 PM

Change 616077 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Add component/lilypond

https://gerrit.wikimedia.org/r/616077

gerritbot added a comment.Jul 24 2020, 12:33 PM

Change 616077 merged by Muehlenhoff:
[operations/puppet@production] Add component/lilypond

https://gerrit.wikimedia.org/r/616077

MoritzMuehlenhoff triaged this task as High priority.Jul 24 2020, 1:35 PM
MoritzMuehlenhoff updated the task description. (Show Details)
Stashbot added a comment.Jul 31 2020, 7:50 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-31T07:50:20Z] <moritzm> uploaded lilypond 2.19.81+really-2.18.2-13~bpo9+1+wmf1 to stretch-wikimedia T256877

MoritzMuehlenhoff mentioned this in T259210: LilyPond safe mode escape due to output-def-lookup and output-def-scope (CVE-2020-17354).Jul 31 2020, 8:10 AM
MoritzMuehlenhoff updated the task description. (Show Details)Jul 31 2020, 1:04 PM
hashar updated the task description. (Show Details)Aug 17 2020, 12:01 PM
gerritbot added a comment.Aug 25 2020, 10:49 AM

Change 622326 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Add component/ceph

https://gerrit.wikimedia.org/r/622326

gerritbot added a comment.Aug 25 2020, 11:21 AM

Change 622326 merged by Muehlenhoff:
[operations/puppet@production] Add component/ceph

https://gerrit.wikimedia.org/r/622326

Stashbot added a comment.Aug 25 2020, 12:35 PM

Mentioned in SAL (#wikimedia-operations) [2020-08-25T12:35:31Z] <moritzm> imported ceph packages from stretch-backports to component/ceph T256877

gerritbot added a comment.Aug 25 2020, 12:35 PM

Change 622340 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Switch openstack::serverpackages::rocky::stretch to component/ceph

https://gerrit.wikimedia.org/r/622340

gerritbot added a comment.Aug 28 2020, 9:17 AM

Change 622340 merged by Muehlenhoff:
[operations/puppet@production] Switch openstack::serverpackages::rocky::stretch to component/ceph

https://gerrit.wikimedia.org/r/622340

gerritbot added a comment.Aug 28 2020, 9:47 AM

Change 622974 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove apt::pin for ceph packages in openstack/rocky/stretch

https://gerrit.wikimedia.org/r/622974

hashar added a subtask: T261920: docker-registry.wikimedia.org/golang:1.11 should no more depends on stretch-backports.Sep 3 2020, 7:16 AM
hashar updated the task description. (Show Details)

The CI containers maintained at integration/config.git no more rely on stretch-backports. In 1122fbdf11e1f681283db19a6b57415eab5875f3 I went to delete /etc/apt/sources.list.d/backports.list which comes from docker-registry.wikimedia.org/wikimedia-stretch.

For docker-registry.wikimedia.org/golang:1.11 I have filed T261920

gerritbot added a comment.Sep 3 2020, 2:45 PM

Change 622974 merged by Muehlenhoff:
[operations/puppet@production] Remove apt::pin for ceph packages in openstack/rocky/stretch

https://gerrit.wikimedia.org/r/622974

MoritzMuehlenhoff updated the task description. (Show Details)Sep 3 2020, 2:49 PM
gerritbot added a comment.Sep 9 2020, 6:58 AM

Change 613611 merged by Muehlenhoff:
[operations/puppet@production] Disable backports on stretch for production

https://gerrit.wikimedia.org/r/613611

MoritzMuehlenhoff mentioned this in T238753: [OSM] Backport imposm3 to the debian channel.Dec 9 2020, 2:43 PM
gerritbot added a comment.Jan 12 2021, 12:46 PM

Change 655649 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[eventgate-wikimedia@master] Switch to using buster

https://gerrit.wikimedia.org/r/655649

gerritbot added a comment.Jan 12 2021, 12:49 PM

Change 655653 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[mediawiki/services/eventstreams@master] Switch to using buster

https://gerrit.wikimedia.org/r/655653

Mvolz closed subtask T258158: Bump zotero base images from stretch to buster as Resolved.Mar 10 2021, 2:05 PM
Legoktm closed subtask T258160: Bump blubberoid base images from stretch to buster as Resolved.Mar 15 2021, 5:25 PM
hashar unsubscribed.Mar 29 2021, 12:36 PM
aborrero closed subtask T256881: wmcs: evaluate impact of stretch-backports being archived as Resolved.Nov 15 2021, 4:32 PM
gerritbot added a comment.Apr 26 2022, 8:04 AM

Change 610050 abandoned by Hashar:

[operations/puppet@production] Stop including backports in Stretch images

Reason:

that specific file has been removed in May 2021 by Ieab1a53ed7cae5224c62fa9da23b08e951a76278

stretch-backports is still included and apparently hasn't vanished yet. Given Stretch is no more supported end of June 2022, I guess we can give up on this change (and probably decline the attached tasks as well)

https://gerrit.wikimedia.org/r/610050

MoritzMuehlenhoff closed this task as Resolved.Apr 26 2022, 8:09 AM

Closing this task, the remaining bits will be cleaned out when Stretch is removed completely.

MoritzMuehlenhoff closed subtask T257327: Rebuild wikimedia-stretch docker image for repository updates as Resolved.Apr 26 2022, 8:10 AM
gerritbot added a comment.May 4 2022, 4:07 PM

Change 655649 merged by Ottomata:

[eventgate-wikimedia@master] Switch to using buster

https://gerrit.wikimedia.org/r/655649

LSobanski closed subtask T261920: docker-registry.wikimedia.org/golang:1.11 should no more depends on stretch-backports as Resolved.Jan 6 2023, 12:59 PM
Eevans closed subtask T258155: Bump kask base images from stretch to buster as Resolved.Jan 20 2023, 4:45 PM
gerritbot added a comment.Mon, Apr 15, 10:55 AM

Change #1019718 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[mediawiki/libs/Shellbox@master] blubber: add lilypond component

https://gerrit.wikimedia.org/r/1019718

gerritbot added a comment.Mon, Apr 15, 11:05 AM

Change #1019718 abandoned by Hnowlan:

[mediawiki/libs/Shellbox@master] blubber: add lilypond component

Reason:

duplicate of claime's work

https://gerrit.wikimedia.org/r/1019718

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL